vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #236
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb: QEMU running (pid 50)14lb # Formatting '/build/vm-state-lb/tmp.eHpPCBtBOs', fmt=raw size=107374182415worker2 # Disk image does not exist, creating the virtualisation disk image...16lb # mke2fs 1.47.4 (6-Mar-2025)17worker2 # Formatting '/build/vm-state-worker2/tmp.HMYCJpjaRK', fmt=raw size=107374182418lb # Discarding device blocks: 0/262144 done19worker2 # mke2fs 1.47.4 (6-Mar-2025)20lb # Creating filesystem with 262144 4k blocks and 65536 inodes21worker2 # Discarding device blocks: 0/262144 done22lb # Filesystem UUID: f4a5924f-e6ee-4c83-9fbc-b504f0b0ee0723worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes24lb # Superblock backups stored on blocks:25worker2 # Filesystem UUID: e835cf02-91ab-4589-93f5-dc02bece95f526lb # 32768, 98304, 163840, 22937627worker2 # Superblock backups stored on blocks:28lb # 29worker2 # 32768, 98304, 163840, 22937630lb # Allocating group tables: 0/8 done31worker2 # 32worker2 # Allocating group tables: 0/8 done33worker2: QEMU running (pid 52)34worker2 # Writing inode tables: 0/8 done35lb # Writing inode tables: 0/8 done36worker2 # Creating journal (8192 blocks): done37worker1 # Disk image does not exist, creating the virtualisation disk image...38worker1: QEMU running (pid 51)39lb # Creating journal (8192 blocks): done40worker2 # Writing superblocks and filesystem accounting information: 0/8 done41lb # Writing superblocks and filesystem accounting information: 0/8 done42worker2 # 43lb # 44worker2 # Virtualisation disk image created.45lb # Virtualisation disk image created.46worker1 # Formatting '/build/vm-state-worker1/tmp.uaj8TEIGtF', fmt=raw size=107374182447worker1 # mke2fs 1.47.4 (6-Mar-2025)48worker1 # Discarding device blocks: 0/262144 done49worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes50worker1 # Filesystem UUID: dbb73203-c256-4e23-9b5e-122c3507a5e551worker1 # Superblock backups stored on blocks:52worker1 # 32768, 98304, 163840, 22937653worker1 # 54worker1 # Allocating group tables: 0/8 done55worker1 # Writing inode tables: 0/8 done56worker1 # Creating journal (8192 blocks): done57worker1 # Writing superblocks and filesystem accounting information: 0/8 done58worker1 # 59worker1 # Virtualisation disk image created.60client # Disk image does not exist, creating the virtualisation disk image...61client: QEMU running (pid 49)62client # Formatting '/build/vm-state-client/tmp.iv538LB5tt', fmt=raw size=107374182463client # mke2fs 1.47.4 (6-Mar-2025)64client # Discarding device blocks: 0/262144 done65client # Creating filesystem with 262144 4k blocks and 65536 inodes66(finished: start all VMs, in 0.22 seconds)67client # Filesystem UUID: 59364d13-5a49-43a3-b82a-d648879f37bf68client: waiting for unit network-addresses-eth1.service69client # Superblock backups stored on blocks:70client: waiting for the VM to finish booting71client # 32768, 98304, 163840, 22937672client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87worker2 # 88worker2 # 89worker2 # 90worker2 # 91worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092lb # 93lb # 94lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0095worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...96worker2 # 97worker2 # 98lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99lb # 100lb # 101lb # 102lb # 103lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105lb # 106lb # 107client # 108client # 109client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00110client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...111client # 112client # 113client # 114client # 115client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117client # 118client # 119worker1 # 120worker1 # 121worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker2 # Booting from ROM...123worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...124worker1 # 125worker1 # 126worker1 # 127worker1 # 128worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00129lb # Booting from ROM...130worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...131worker1 # 132worker1 # 133client # Booting from ROM...134worker1 # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/47mw1xvsk4y6plrpsdd4pkpph1gdvz3w-nixos-system-worker2-test/init regInfo=/nix/store/d5711pdw05qs8qzcz17cgdb9f0l1al6x-closure-info/registration console=ttyS0,115200n8 console=tty0137worker2 # [ 0.000000] BIOS-provided physical RAM map:138worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148worker2 # [ 0.000000] NX (Execute Disable) protection: active149worker2 # [ 0.000000] APIC: Static calls initialized150worker2 # [ 0.000000] SMBIOS 2.8 present.151lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026152worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014153worker2 # [ 0.000000] DMI: Memory slots populated: 1/1154worker2 # [ 0.000000] Hypervisor detected: KVM155worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000156worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00157worker2 # [ 0.000000] kvm-clock: using sched offset of 465147464 cycles158lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0159lb # [ 0.000000] BIOS-provided physical RAM map:160worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns161lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable162worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor163lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved164worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000165lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved166worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs167lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable168worker2 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT169lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved170worker2 # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f]171worker2 # [ 0.002746] Using GB pages for direct mapping172lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved173worker2 # [ 0.002833] RAMDISK: [mem 0x5e367000-0x5ffcffff]174client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026175lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved176worker2 # [ 0.002841] ACPI: Early table checksum verification disabled177lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved178worker2 # [ 0.002845] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )179lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved180worker2 # [ 0.002849] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)181lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved182worker2 # [ 0.002853] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)183lb # [ 0.000000] NX (Execute Disable) protection: active184client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test/init regInfo=/nix/store/7wm6wv3n1vf9nhkdwfxmb35w47sz4l9r-closure-info/registration console=ttyS0,115200n8 console=tty0185lb # [ 0.000000] APIC: Static calls initialized186client # [ 0.000000] BIOS-provided physical RAM map:187worker2 # [ 0.002860] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)188lb # [ 0.000000] SMBIOS 2.8 present.189worker2 # [ 0.002862] ACPI: FACS 0x000000005FFE0000 000040190client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable191lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014192worker2 # [ 0.002864] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)193client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved194lb # [ 0.000000] DMI: Memory slots populated: 1/1195lb # [ 0.000000] Hypervisor detected: KVM196client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved197worker2 # [ 0.002866] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)198lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000199client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable200worker2 # [ 0.002867] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)201lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00202client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved203lb # [ 0.000000] kvm-clock: using sched offset of 480186929 cycles204worker2 # [ 0.002869] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)205client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved206worker2 # [ 0.002870] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]207lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns208client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved209lb # [ 0.000005] tsc: Detected 2400.012 MHz processor210worker2 # [ 0.002871] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]211worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026212client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved213lb # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000214worker2 # [ 0.002872] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]215client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved216lb # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs217worker2 # [ 0.002872] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]218client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved219lb # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT220worker2 # [ 0.002873] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]221client # [ 0.000000] NX (Execute Disable) protection: active222lb # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]223client # [ 0.000000] APIC: Static calls initialized224worker2 # [ 0.002873] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]225client # [ 0.000000] SMBIOS 2.8 present.226lb # [ 0.002751] Using GB pages for direct mapping227worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rflhg1b5zrixj1rcpbr7z98w25zwg4pd-nixos-system-worker1-test/init regInfo=/nix/store/zvfskanm5rba1gmdvihjrbpm8rg8m1jw-closure-info/registration console=ttyS0,115200n8 console=tty0228lb # [ 0.002867] RAMDISK: [mem 0x5e367000-0x5ffcffff]229worker2 # [ 0.002873] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]230worker1 # [ 0.000000] BIOS-provided physical RAM map:231worker2 # [ 0.003100] No NUMA configuration found232client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014233lb # [ 0.002875] ACPI: Early table checksum verification disabled234worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable235client # [ 0.000000] DMI: Memory slots populated: 1/1236lb # [ 0.002879] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )237worker2 # [ 0.003101] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]238worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved239client # [ 0.000000] Hypervisor detected: KVM240worker2 # [ 0.003104] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]241worker2 # [ 0.005481] Zone ranges:242lb # [ 0.002883] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)243client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000244worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved245client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00246worker2 # [ 0.005483] DMA [mem 0x0000000000001000-0x0000000000ffffff]247worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable248lb # [ 0.002888] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)249client # [ 0.000000] kvm-clock: using sched offset of 471735222 cycles250worker2 # [ 0.005485] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]251worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved252worker2 # [ 0.005486] Normal empty253lb # [ 0.002895] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)254worker2 # [ 0.005487] Device empty255lb # [ 0.002897] ACPI: FACS 0x000000005FFE0000 000040256worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved257client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns258worker2 # [ 0.005487] Movable zone start for each node259worker2 # [ 0.005488] Early memory node ranges260client # [ 0.000005] tsc: Detected 2400.012 MHz processor261worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved262lb # [ 0.002898] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)263client # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000264worker2 # [ 0.005489] node 0: [mem 0x0000000000001000-0x000000000009efff]265worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved266worker2 # [ 0.005490] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]267lb # [ 0.002900] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)268client # [ 0.000833] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs269worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved270worker2 # [ 0.005491] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]271client # [ 0.000836] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT272lb # [ 0.002901] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)273worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved274worker2 # [ 0.005514] On node 0, zone DMA: 1 pages in unavailable ranges275client # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]276worker1 # [ 0.000000] NX (Execute Disable) protection: active277lb # [ 0.002903] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)278worker2 # [ 0.005798] On node 0, zone DMA: 97 pages in unavailable ranges279client # [ 0.002750] Using GB pages for direct mapping280worker1 # [ 0.000000] APIC: Static calls initialized281worker1 # [ 0.000000] SMBIOS 2.8 present.282client # [ 0.002888] RAMDISK: [mem 0x5e366000-0x5ffcffff]283lb # [ 0.002904] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]284worker2 # [ 0.034543] On node 0, zone DMA32: 40 pages in unavailable ranges285worker2 # [ 0.035019] ACPI: PM-Timer IO Port: 0x608286client # [ 0.002896] ACPI: Early table checksum verification disabled287lb # [ 0.002905] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]288worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014289worker2 # [ 0.035032] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])290client # [ 0.002900] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )291worker1 # [ 0.000000] DMI: Memory slots populated: 1/1292lb # [ 0.002906] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]293worker1 # [ 0.000000] Hypervisor detected: KVM294worker2 # [ 0.035061] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23295client # [ 0.002904] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)296lb # [ 0.002906] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]297worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000298worker2 # [ 0.035064] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)299client # [ 0.002909] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)300lb # [ 0.002907] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]301worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00302worker2 # [ 0.035066] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)303worker1 # [ 0.000000] kvm-clock: using sched offset of 481341253 cycles304lb # [ 0.002907] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]305client # [ 0.002916] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)306worker2 # [ 0.035067] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)307client # [ 0.002918] ACPI: FACS 0x000000005FFE0000 000040308lb # [ 0.002908] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]309worker2 # [ 0.035068] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)310worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns311lb # [ 0.003133] No NUMA configuration found312worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor313client # [ 0.002919] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)314worker2 # [ 0.035069] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)315lb # [ 0.003134] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]316worker1 # [ 0.000821] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000317worker2 # [ 0.035072] ACPI: Using ACPI (MADT) for SMP configuration information318client # [ 0.002921] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)319lb # [ 0.003136] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]320lb # [ 0.005921] Zone ranges:321worker2 # [ 0.035073] ACPI: HPET id: 0x8086a201 base: 0xfed00000322worker1 # [ 0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs323worker2 # [ 0.035078] TSC deadline timer available324client # [ 0.002922] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)325lb # [ 0.005922] DMA [mem 0x0000000000001000-0x0000000000ffffff]326worker1 # [ 0.000850] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT327worker2 # [ 0.035082] CPU topo: Max. logical packages: 1328lb # [ 0.005923] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]329worker1 # [ 0.002754] found SMP MP-table at [mem 0x000f5450-0x000f545f]330worker2 # [ 0.035083] CPU topo: Max. logical dies: 1331client # [ 0.002924] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)332lb # [ 0.005925] Normal empty333worker1 # [ 0.002765] Using GB pages for direct mapping334worker2 # [ 0.035083] CPU topo: Max. dies per package: 1335lb # [ 0.005925] Device empty336client # [ 0.002925] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]337worker1 # [ 0.002855] RAMDISK: [mem 0x5e367000-0x5ffcffff]338lb # [ 0.005926] Movable zone start for each node339worker2 # [ 0.035088] CPU topo: Max. threads per core: 1340lb # [ 0.005927] Early memory node ranges341worker2 # [ 0.035089] CPU topo: Num. cores per package: 1342client # [ 0.002926] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]343worker1 # [ 0.002863] ACPI: Early table checksum verification disabled344lb # [ 0.005927] node 0: [mem 0x0000000000001000-0x000000000009efff]345worker2 # [ 0.035089] CPU topo: Num. threads per package: 1346worker1 # [ 0.002865] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )347client # [ 0.002927] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]348lb # [ 0.005928] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]349worker2 # [ 0.035089] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs350worker1 # [ 0.002869] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)351client # [ 0.002927] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]352lb # [ 0.005929] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]353worker2 # [ 0.035115] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()354client # [ 0.002928] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]355worker1 # [ 0.002873] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)356lb # [ 0.005952] On node 0, zone DMA: 1 pages in unavailable ranges357worker2 # [ 0.035156] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]358client # [ 0.002928] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]359lb # [ 0.006256] On node 0, zone DMA: 97 pages in unavailable ranges360worker1 # [ 0.002880] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)361worker2 # [ 0.035158] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]362client # [ 0.002929] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]363lb # [ 0.035051] On node 0, zone DMA32: 40 pages in unavailable ranges364worker1 # [ 0.002882] ACPI: FACS 0x000000005FFE0000 000040365worker2 # [ 0.035159] [mem 0x60000000-0xafffffff] available for PCI devices366client # [ 0.003163] No NUMA configuration found367lb # [ 0.035528] ACPI: PM-Timer IO Port: 0x608368worker2 # [ 0.035161] Booting paravirtualized kernel on KVM369worker1 # [ 0.002883] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)370lb # [ 0.035542] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])371client # [ 0.003163] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]372client # [ 0.003166] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]373lb # [ 0.035569] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23374worker1 # [ 0.002885] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)375worker2 # [ 0.035165] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns376client # [ 0.005561] Zone ranges:377lb # [ 0.035572] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)378client # [ 0.005563] DMA [mem 0x0000000000001000-0x0000000000ffffff]379worker1 # [ 0.002886] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)380worker2 # [ 0.039663] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1381lb # [ 0.035574] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)382client # [ 0.005565] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]383worker2 # [ 0.042043] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152384worker1 # [ 0.002888] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)385client # [ 0.005566] Normal empty386lb # [ 0.035575] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)387client # [ 0.005567] Device empty388worker2 # [ 0.042090] kvm-guest: PV spinlocks disabled, single CPU389worker1 # [ 0.002889] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]390client # [ 0.005567] Movable zone start for each node391lb # [ 0.035576] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)392client # [ 0.005568] Early memory node ranges393worker1 # [ 0.002890] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]394lb # [ 0.035577] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)395client # [ 0.005569] node 0: [mem 0x0000000000001000-0x000000000009efff]396worker1 # [ 0.002891] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]397lb # [ 0.035579] ACPI: Using ACPI (MADT) for SMP configuration information398client # [ 0.005570] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]399lb # [ 0.035580] ACPI: HPET id: 0x8086a201 base: 0xfed00000400worker1 # [ 0.002891] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]401client # [ 0.005571] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]402lb # [ 0.035584] TSC deadline timer available403worker1 # [ 0.002892] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]404worker2 # [ 0.042092] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/47mw1xvsk4y6plrpsdd4pkpph1gdvz3w-nixos-system-worker2-test/init regInfo=/nix/store/d5711pdw05qs8qzcz17cgdb9f0l1al6x-closure-info/registration console=ttyS0,115200n8 console=tty0405client # [ 0.005591] On node 0, zone DMA: 1 pages in unavailable ranges406lb # [ 0.035588] CPU topo: Max. logical packages: 1407lb # [ 0.035589] CPU topo: Max. logical dies: 1408client # [ 0.005869] On node 0, zone DMA: 97 pages in unavailable ranges409worker1 # [ 0.002892] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]410lb # [ 0.035590] CPU topo: Max. dies per package: 1411client # [ 0.034436] On node 0, zone DMA32: 40 pages in unavailable ranges412worker2 # [ 0.042195] Unknown kernel command line parameters "regInfo=/nix/store/d5711pdw05qs8qzcz17cgdb9f0l1al6x-closure-info/registration", will be passed to user space.413worker1 # [ 0.002893] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]414lb # [ 0.035593] CPU topo: Max. threads per core: 1415client # [ 0.034904] ACPI: PM-Timer IO Port: 0x608416worker1 # [ 0.003128] No NUMA configuration found417worker2 # [ 0.042208] random: crng init done418lb # [ 0.035594] CPU topo: Num. cores per package: 1419client # [ 0.034918] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])420worker1 # [ 0.003128] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]421worker2 # [ 0.042209] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes422lb # [ 0.035594] CPU topo: Num. threads per package: 1423worker1 # [ 0.003131] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]424client # [ 0.034947] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23425lb # [ 0.035595] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs426worker2 # [ 0.044483] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)427worker1 # [ 0.005596] Zone ranges:428client # [ 0.034950] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)429lb # [ 0.035618] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()430worker1 # [ 0.005597] DMA [mem 0x0000000000001000-0x0000000000ffffff]431worker2 # [ 0.045622] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)432client # [ 0.034952] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)433worker2 # [ 0.045656] Fallback order for Node 0: 0434worker1 # [ 0.005599] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]435lb # [ 0.035656] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]436worker1 # [ 0.005600] Normal empty437client # [ 0.034953] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)438worker1 # [ 0.005601] Device empty439worker2 # [ 0.045659] Built 1 zonelists, mobility grouping on. Total pages: 393078440lb # [ 0.035657] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]441worker2 # [ 0.045660] Policy zone: DMA32442worker1 # [ 0.005602] Movable zone start for each node443client # [ 0.034954] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)444worker1 # [ 0.005603] Early memory node ranges445lb # [ 0.035659] [mem 0x60000000-0xafffffff] available for PCI devices446worker2 # [ 0.048581] mem auto-init: stack:all(zero), heap alloc:on, heap free:off447client # [ 0.034955] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)448lb # [ 0.035661] Booting paravirtualized kernel on KVM449worker1 # [ 0.005603] node 0: [mem 0x0000000000001000-0x000000000009efff]450worker2 # [ 0.052135] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1451client # [ 0.034957] ACPI: Using ACPI (MADT) for SMP configuration information452worker1 # [ 0.005604] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]453worker2 # [ 0.055645] allocated 3145728 bytes of page_ext454lb # [ 0.035665] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns455client # [ 0.034958] ACPI: HPET id: 0x8086a201 base: 0xfed00000456worker1 # [ 0.005605] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]457worker2 # [ 0.066206] ftrace: allocating 48731 entries in 192 pages458client # [ 0.034972] TSC deadline timer available459lb # [ 0.040366] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1460worker2 # [ 0.066208] ftrace: allocated 192 pages with 2 groups461client # [ 0.034977] CPU topo: Max. logical packages: 1462worker1 # [ 0.005625] On node 0, zone DMA: 1 pages in unavailable ranges463worker2 # [ 0.067101] Dynamic Preempt: lazy464lb # [ 0.043037] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152465client # [ 0.034977] CPU topo: Max. logical dies: 1466worker1 # [ 0.005889] On node 0, zone DMA: 97 pages in unavailable ranges467worker2 # [ 0.067280] rcu: Preemptible hierarchical RCU implementation.468client # [ 0.034978] CPU topo: Max. dies per package: 1469lb # [ 0.043092] kvm-guest: PV spinlocks disabled, single CPU470worker1 # [ 0.033098] On node 0, zone DMA32: 40 pages in unavailable ranges471worker2 # [ 0.067281] rcu: RCU event tracing is enabled.472client # [ 0.034981] CPU topo: Max. threads per core: 1473worker1 # [ 0.033577] ACPI: PM-Timer IO Port: 0x608474client # [ 0.034982] CPU topo: Num. cores per package: 1475worker2 # [ 0.067282] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.476worker1 # [ 0.033588] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])477client # [ 0.034982] CPU topo: Num. threads per package: 1478worker2 # [ 0.067283] Trampoline variant of Tasks RCU enabled.479worker2 # [ 0.067284] Rude variant of Tasks RCU enabled.480worker1 # [ 0.033614] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23481client # [ 0.034983] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs482worker2 # [ 0.067284] Tracing variant of Tasks RCU enabled.483worker1 # [ 0.033617] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)484client # [ 0.035007] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()485lb # [ 0.043094] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0486worker2 # [ 0.067285] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.487worker1 # [ 0.033618] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)488client # [ 0.035044] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]489worker1 # [ 0.033619] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)490worker2 # [ 0.067285] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1491client # [ 0.035046] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]492lb # [ 0.043247] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.493worker1 # [ 0.033620] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)494worker2 # [ 0.067309] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.495client # [ 0.035048] [mem 0x60000000-0xafffffff] available for PCI devices496lb # [ 0.043263] random: crng init done497worker1 # [ 0.033621] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)498client # [ 0.035049] Booting paravirtualized kernel on KVM499lb # [ 0.043264] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes500worker2 # [ 0.067311] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.501worker1 # [ 0.033623] ACPI: Using ACPI (MADT) for SMP configuration information502client # [ 0.035053] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns503lb # [ 0.045998] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)504worker1 # [ 0.033624] ACPI: HPET id: 0x8086a201 base: 0xfed00000505worker2 # [ 0.067312] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.506worker1 # [ 0.033628] TSC deadline timer available507worker2 # [ 0.071812] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16508client # [ 0.039536] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1509lb # [ 0.047374] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)510worker1 # [ 0.033632] CPU topo: Max. logical packages: 1511lb # [ 0.047414] Fallback order for Node 0: 0512worker1 # [ 0.033633] CPU topo: Max. logical dies: 1513client # [ 0.041850] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152514worker2 # [ 0.072099] rcu: srcu_init: Setting srcu_struct sizes based on contention.515worker1 # [ 0.033633] CPU topo: Max. dies per package: 1516lb # [ 0.047417] Built 1 zonelists, mobility grouping on. Total pages: 393078517client # [ 0.041894] kvm-guest: PV spinlocks disabled, single CPU518lb # [ 0.047419] Policy zone: DMA32519worker1 # [ 0.033636] CPU topo: Max. threads per core: 1520worker2 # [ 0.072105] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns521worker1 # [ 0.033637] CPU topo: Num. cores per package: 1522lb # [ 0.050842] mem auto-init: stack:all(zero), heap alloc:on, heap free:off523worker1 # [ 0.033638] CPU topo: Num. threads per package: 1524worker2 # [ 0.072219] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)525lb # [ 0.055153] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1526worker2 # [ 0.075759] Console: colour VGA+ 80x25527worker1 # [ 0.033638] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs528lb # [ 0.059405] allocated 3145728 bytes of page_ext529worker2 # [ 0.075763] printk: legacy console [tty0] enabled530lb # [ 0.070507] ftrace: allocating 48731 entries in 192 pages531worker1 # [ 0.033655] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()532worker2 # [ 0.105253] printk: legacy console [ttyS0] enabled533lb # [ 0.070509] ftrace: allocated 192 pages with 2 groups534worker1 # [ 0.033687] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]535lb # [ 0.071434] Dynamic Preempt: lazy536worker2 # [ 0.201527] ACPI: Core revision 20250807537client # [ 0.041896] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test/init regInfo=/nix/store/7wm6wv3n1vf9nhkdwfxmb35w47sz4l9r-closure-info/registration console=ttyS0,115200n8 console=tty0538lb # [ 0.071625] rcu: Preemptible hierarchical RCU implementation.539worker1 # [ 0.033689] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]540lb # [ 0.071626] rcu: RCU event tracing is enabled.541worker1 # [ 0.033690] [mem 0x60000000-0xafffffff] available for PCI devices542worker2 # [ 0.202400] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns543lb # [ 0.071626] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.544worker1 # [ 0.033692] Booting paravirtualized kernel on KVM545client # [ 0.042007] Unknown kernel command line parameters "regInfo=/nix/store/7wm6wv3n1vf9nhkdwfxmb35w47sz4l9r-closure-info/registration", will be passed to user space.546lb # [ 0.071628] Trampoline variant of Tasks RCU enabled.547worker2 # [ 0.203930] APIC: Switch to symmetric I/O mode setup548client # [ 0.042022] random: crng init done549lb # [ 0.071629] Rude variant of Tasks RCU enabled.550worker2 # [ 0.204848] x2apic enabled551worker1 # [ 0.033695] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns552lb # [ 0.071629] Tracing variant of Tasks RCU enabled.553client # [ 0.042023] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes554worker1 # [ 0.038176] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1555worker2 # [ 0.205573] APIC: Switched APIC routing to: physical x2apic556lb # [ 0.071630] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.557client # [ 0.044304] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)558worker1 # [ 0.040380] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152559lb # [ 0.071630] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1560worker1 # [ 0.040425] kvm-guest: PV spinlocks disabled, single CPU561client # [ 0.045748] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)562worker2 # [ 0.207325] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1563lb # [ 0.071646] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.564client # [ 0.045787] Fallback order for Node 0: 0565client # [ 0.045793] Built 1 zonelists, mobility grouping on. Total pages: 393078566lb # [ 0.071648] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.567worker2 # [ 0.208263] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns568client # [ 0.045794] Policy zone: DMA32569lb # [ 0.071649] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570client # [ 0.048830] mem auto-init: stack:all(zero), heap alloc:on, heap free:off571worker2 # [ 0.209829] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)572worker1 # [ 0.040426] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rflhg1b5zrixj1rcpbr7z98w25zwg4pd-nixos-system-worker1-test/init regInfo=/nix/store/zvfskanm5rba1gmdvihjrbpm8rg8m1jw-closure-info/registration console=ttyS0,115200n8 console=tty0573lb # [ 0.076254] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16574client # [ 0.052334] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1575lb # [ 0.076547] rcu: srcu_init: Setting srcu_struct sizes based on contention.576worker2 # [ 0.211914] x86/cpu: User Mode Instruction Prevention (UMIP) activated577client # [ 0.055833] allocated 3145728 bytes of page_ext578worker1 # [ 0.040519] Unknown kernel command line parameters "regInfo=/nix/store/zvfskanm5rba1gmdvihjrbpm8rg8m1jw-closure-info/registration", will be passed to user space.579lb # [ 0.076554] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns580client # [ 0.066270] ftrace: allocating 48731 entries in 192 pages581worker1 # [ 0.040532] random: crng init done582worker2 # [ 0.213419] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127583client # [ 0.066272] ftrace: allocated 192 pages with 2 groups584worker1 # [ 0.040533] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes585client # [ 0.067150] Dynamic Preempt: lazy586lb # [ 0.076667] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)587worker2 # [ 0.214503] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0588lb # [ 0.080276] Console: colour VGA+ 80x25589worker1 # [ 0.042681] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)590client # [ 0.067309] rcu: Preemptible hierarchical RCU implementation.591lb # [ 0.080280] printk: legacy console [tty0] enabled592client # [ 0.067309] rcu: RCU event tracing is enabled.593worker1 # [ 0.044028] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)594lb # [ 0.109998] printk: legacy console [ttyS0] enabled595worker2 # [ 0.215562] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto596worker1 # [ 0.044059] Fallback order for Node 0: 0597lb # [ 0.206687] ACPI: Core revision 20250807598client # [ 0.067310] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.599worker1 # [ 0.044062] Built 1 zonelists, mobility grouping on. Total pages: 393078600client # [ 0.067312] Trampoline variant of Tasks RCU enabled.601worker1 # [ 0.044063] Policy zone: DMA32602worker2 # [ 0.216826] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl603client # [ 0.067312] Rude variant of Tasks RCU enabled.604worker1 # [ 0.046581] mem auto-init: stack:all(zero), heap alloc:on, heap free:off605lb # [ 0.207560] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns606worker2 # [ 0.217826] Transient Scheduler Attacks: Vulnerable: No microcode607client # [ 0.067312] Tracing variant of Tasks RCU enabled.608worker1 # [ 0.049790] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1609lb # [ 0.209097] APIC: Switch to symmetric I/O mode setup610worker2 # [ 0.218826] Spectre V2 : Mitigation: Enhanced / Automatic IBRS611worker1 # [ 0.053167] allocated 3145728 bytes of page_ext612client # [ 0.067313] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.613lb # [ 0.210044] x2apic enabled614worker1 # [ 0.063204] ftrace: allocating 48731 entries in 192 pages615worker2 # [ 0.219826] Speculative Return Stack Overflow: Mitigation: Safe RET616worker1 # [ 0.063205] ftrace: allocated 192 pages with 2 groups617client # [ 0.067314] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1618lb # [ 0.210799] APIC: Switched APIC routing to: physical x2apic619worker1 # [ 0.064046] Dynamic Preempt: lazy620worker1 # [ 0.064182] rcu: Preemptible hierarchical RCU implementation.621client # [ 0.067375] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.622worker1 # [ 0.064182] rcu: RCU event tracing is enabled.623lb # [ 0.212590] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1624worker1 # [ 0.064183] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.625client # [ 0.067377] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.626worker1 # [ 0.064185] Trampoline variant of Tasks RCU enabled.627worker2 # [ 0.220825] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization628worker1 # [ 0.064185] Rude variant of Tasks RCU enabled.629lb # [ 0.213547] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns630client # [ 0.067378] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.631worker1 # [ 0.064185] Tracing variant of Tasks RCU enabled.632worker2 # [ 0.222833] Spectre V2 : Enabling IBPB for BPF633client # [ 0.072121] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16634worker1 # [ 0.064186] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.635lb # [ 0.215135] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)636worker2 # [ 0.223827] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier637worker1 # [ 0.064187] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1638client # [ 0.072404] rcu: srcu_init: Setting srcu_struct sizes based on contention.639lb # [ 0.216221] x86/cpu: User Mode Instruction Prevention (UMIP) activated640worker2 # [ 0.224826] active return thunk: srso_alias_return_thunk641worker1 # [ 0.064196] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.642client # [ 0.072410] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns643lb # [ 0.217252] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127644worker2 # [ 0.225847] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'645worker1 # [ 0.064198] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.646lb # [ 0.218132] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0647worker2 # [ 0.226826] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'648client # [ 0.072522] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)649worker1 # [ 0.064199] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.650client # [ 0.076098] Console: colour VGA+ 80x25651worker2 # [ 0.227825] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'652worker1 # [ 0.068590] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16653client # [ 0.076101] printk: legacy console [tty0] enabled654lb # [ 0.219136] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto655worker1 # [ 0.068875] rcu: srcu_init: Setting srcu_struct sizes based on contention.656client # [ 0.105536] printk: legacy console [ttyS0] enabled657worker2 # [ 0.228825] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'658lb # [ 0.220132] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl659client # [ 0.207759] ACPI: Core revision 20250807660worker1 # [ 0.068880] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns661worker2 # [ 0.229825] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'662lb # [ 0.221133] Transient Scheduler Attacks: Vulnerable: No microcode663worker2 # [ 0.230825] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'664worker1 # [ 0.068984] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)665worker1 # [ 0.072823] Console: colour VGA+ 80x25666lb # [ 0.222132] Spectre V2 : Mitigation: Enhanced / Automatic IBRS667client # [ 0.208847] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns668worker1 # [ 0.072825] printk: legacy console [tty0] enabled669worker2 # [ 0.231825] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'670lb # [ 0.223132] Speculative Return Stack Overflow: Mitigation: Safe RET671worker1 # [ 0.102376] printk: legacy console [ttyS0] enabled672client # [ 0.210765] APIC: Switch to symmetric I/O mode setup673worker2 # [ 0.232826] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256674worker1 # [ 0.197812] ACPI: Core revision 20250807675client # [ 0.212014] x2apic enabled676worker2 # [ 0.233825] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64677worker1 # [ 0.198708] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns678worker2 # [ 0.234825] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512679client # [ 0.212916] APIC: Switched APIC routing to: physical x2apic680worker1 # [ 0.200249] APIC: Switch to symmetric I/O mode setup681worker2 # [ 0.235825] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024682worker1 # [ 0.201176] x2apic enabled683lb # [ 0.224132] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization684worker2 # [ 0.236825] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8685lb # [ 0.226140] Spectre V2 : Enabling IBPB for BPF686worker1 # [ 0.201906] APIC: Switched APIC routing to: physical x2apic687client # [ 0.215181] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1688worker2 # [ 0.237825] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.689lb # [ 0.227133] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier690worker1 # [ 0.203670] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1691lb # [ 0.228134] active return thunk: srso_alias_return_thunk692client # [ 0.216374] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns693lb # [ 0.229153] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'694worker1 # [ 0.204612] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns695client # [ 0.218375] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)696lb # [ 0.230132] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'697worker1 # [ 0.206186] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)698client # [ 0.220478] x86/cpu: User Mode Instruction Prevention (UMIP) activated699lb # [ 0.231132] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'700worker1 # [ 0.208268] x86/cpu: User Mode Instruction Prevention (UMIP) activated701lb # [ 0.232881] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'702client # [ 0.221532] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127703worker1 # [ 0.209295] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127704lb # [ 0.233132] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'705client # [ 0.223219] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0706worker1 # [ 0.210183] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0707lb # [ 0.234943] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'708lb # [ 0.235965] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'709worker1 # [ 0.211187] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto710client # [ 0.224378] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto711lb # [ 0.237132] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256712worker1 # [ 0.212183] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl713client # [ 0.225374] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl714lb # [ 0.238132] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64715worker1 # [ 0.213183] Transient Scheduler Attacks: Vulnerable: No microcode716lb # [ 0.239132] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512717client # [ 0.226373] Transient Scheduler Attacks: Vulnerable: No microcode718worker1 # [ 0.214182] Spectre V2 : Mitigation: Enhanced / Automatic IBRS719lb # [ 0.240132] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024720client # [ 0.227372] Spectre V2 : Mitigation: Enhanced / Automatic IBRS721worker1 # [ 0.215182] Speculative Return Stack Overflow: Mitigation: Safe RET722lb # [ 0.241057] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8723client # [ 0.228373] Speculative Return Stack Overflow: Mitigation: Safe RET724lb # [ 0.241831] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.725worker1 # [ 0.216182] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization726worker1 # [ 0.218189] Spectre V2 : Enabling IBPB for BPF727client # [ 0.229373] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization728worker1 # [ 0.218892] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier729worker1 # [ 0.220183] active return thunk: srso_alias_return_thunk730client # [ 0.231384] Spectre V2 : Enabling IBPB for BPF731worker1 # [ 0.221204] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'732client # [ 0.232375] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier733worker1 # [ 0.222182] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'734client # [ 0.234373] active return thunk: srso_alias_return_thunk735worker1 # [ 0.223182] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'736worker1 # [ 0.224182] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'737client # [ 0.235400] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'738worker1 # [ 0.225182] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'739client # [ 0.236372] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'740worker1 # [ 0.226182] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'741client # [ 0.237372] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'742worker1 # [ 0.227182] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'743client # [ 0.239372] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'744worker1 # [ 0.228183] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256745worker1 # [ 0.229182] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64746client # [ 0.240372] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'747worker1 # [ 0.230183] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512748client # [ 0.241373] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'749worker1 # [ 0.231182] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024750worker1 # [ 0.232183] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8751client # [ 0.242373] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'752client # [ 0.244373] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256753worker1 # [ 0.233182] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.754client # [ 0.245373] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755client # [ 0.246372] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756worker2 # [ 0.274804] Freeing SMP alternatives memory: 44K757worker2 # [ 0.275384] pid_max: default: 32768 minimum: 301758client # [ 0.248373] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024759worker2 # [ 0.275920] LSM: initializing lsm=capability,landlock,yama,bpf,ima760client # [ 0.249372] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8761worker2 # [ 0.276948] landlock: Up and running.762worker2 # [ 0.277826] Yama: becoming mindful.763worker2 # [ 0.279044] LSM support for eBPF active764client # [ 0.250372] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.765worker2 # [ 0.279851] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766worker2 # [ 0.280864] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker2 # [ 0.283320] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768worker2 # [ 0.284393] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769worker2 # [ 0.284830] ... version: 2770worker2 # [ 0.285523] ... bit width: 48771worker2 # [ 0.285828] ... generic counters: 6772worker2 # [ 0.286504] ... generic bitmap: 000000000000003f773lb # [ 0.277406] Freeing SMP alternatives memory: 44K774worker2 # [ 0.286877] ... fixed-purpose counters: 0775lb # [ 0.278136] pid_max: default: 32768 minimum: 301776worker2 # [ 0.287600] ... fixed-purpose bitmap: 0000000000000000777lb # [ 0.278966] LSM: initializing lsm=capability,landlock,yama,bpf,ima778worker2 # [ 0.287829] ... value mask: 0000ffffffffffff779lb # [ 0.279958] landlock: Up and running.780worker2 # [ 0.288678] ... max period: 00007fffffffffff781lb # [ 0.280556] Yama: becoming mindful.782worker2 # [ 0.289474] ... global_ctrl mask: 000000000000003f783lb # [ 0.281354] LSM support for eBPF active784worker2 # [ 0.289970] signal: max sigframe size: 3376785lb # [ 0.282247] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)786worker2 # [ 0.290747] rcu: Hierarchical SRCU implementation.787worker2 # [ 0.291407] rcu: Max phase no-delay instances is 400.788lb # [ 0.283179] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)789lb # [ 0.286267] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)790lb # [ 0.287753] Performance Events: Fam17h+ core perfctr, AMD PMU driver.791lb # [ 0.288141] ... version: 2792worker2 # [ 0.296561] smp: Bringing up secondary CPUs ...793lb # [ 0.288815] ... bit width: 48794worker2 # [ 0.296845] smp: Brought up 1 node, 1 CPU795lb # [ 0.289134] ... generic counters: 6796worker2 # [ 0.297509] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)797lb # [ 0.289825] ... generic bitmap: 000000000000003f798lb # [ 0.290134] ... fixed-purpose counters: 0799lb # [ 0.290803] ... fixed-purpose bitmap: 0000000000000000800worker2 # [ 0.298046] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)801lb # [ 0.291135] ... value mask: 0000ffffffffffff802worker2 # [ 0.299152] devtmpfs: initialized803lb # [ 0.292001] ... max period: 00007fffffffffff804worker2 # [ 0.299929] x86/mm: Memory block size: 128MB805worker1 # [ 0.268322] Freeing SMP alternatives memory: 44K806lb # [ 0.292790] ... global_ctrl mask: 000000000000003f807worker1 # [ 0.269117] pid_max: default: 32768 minimum: 301808lb # [ 0.293247] signal: max sigframe size: 3376809worker1 # [ 0.269792] LSM: initializing lsm=capability,landlock,yama,bpf,ima810lb # [ 0.294035] rcu: Hierarchical SRCU implementation.811worker2 # [ 0.301736] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)812worker1 # [ 0.270285] landlock: Up and running.813lb # [ 0.294690] rcu: Max phase no-delay instances is 400.814worker1 # [ 0.271618] Yama: becoming mindful.815worker2 # [ 0.302780] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).816worker1 # [ 0.272398] LSM support for eBPF active817worker2 # [ 0.303933] pinctrl core: initialized pinctrl subsystem818worker1 # [ 0.273315] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)819worker2 # [ 0.305035] PM: RTC time: 08:15:43, date: 2026-09-20820worker1 # [ 0.274226] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)821lb # [ 0.299769] smp: Bringing up secondary CPUs ...822lb # [ 0.300149] smp: Brought up 1 node, 1 CPU823worker1 # [ 0.276909] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)824worker2 # [ 0.308743] NET: Registered PF_NETLINK/PF_ROUTE protocol family825lb # [ 0.300784] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)826worker1 # [ 0.277732] Performance Events: Fam17h+ core perfctr, AMD PMU driver.827worker2 # [ 0.310064] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations828worker1 # [ 0.278188] ... version: 2829lb # [ 0.301345] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)830worker1 # [ 0.278887] ... bit width: 48831worker2 # [ 0.310854] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations832worker1 # [ 0.279185] ... generic counters: 6833lb # [ 0.302401] devtmpfs: initialized834worker1 # [ 0.279859] ... generic bitmap: 000000000000003f835worker2 # [ 0.312138] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations836lb # [ 0.303173] x86/mm: Memory block size: 128MB837worker1 # [ 0.280195] ... fixed-purpose counters: 0838worker2 # [ 0.312842] audit: initializing netlink subsys (disabled)839worker1 # [ 0.280893] ... fixed-purpose bitmap: 0000000000000000840client # [ 0.294574] Freeing SMP alternatives memory: 44K841worker2 # [ 0.313830] audit: type=2000 audit(1789892144.090:1): state=initialized audit_enabled=0 res=1842lb # [ 0.304885] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)843worker1 # [ 0.281185] ... value mask: 0000ffffffffffff844client # [ 0.295379] pid_max: default: 32768 minimum: 301845worker1 # [ 0.282054] ... max period: 00007fffffffffff846worker2 # [ 0.315008] thermal_sys: Registered thermal governor 'fair_share'847lb # [ 0.306001] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).848worker1 # [ 0.282857] ... global_ctrl mask: 000000000000003f849worker2 # [ 0.315010] thermal_sys: Registered thermal governor 'bang_bang'850client # [ 0.296495] LSM: initializing lsm=capability,landlock,yama,bpf,ima851lb # [ 0.307227] pinctrl core: initialized pinctrl subsystem852worker1 # [ 0.283295] signal: max sigframe size: 3376853worker2 # [ 0.315829] thermal_sys: Registered thermal governor 'step_wise'854client # [ 0.297486] landlock: Up and running.855lb # [ 0.308343] PM: RTC time: 08:15:43, date: 2026-09-20856worker1 # [ 0.284091] rcu: Hierarchical SRCU implementation.857client # [ 0.298373] Yama: becoming mindful.858worker2 # [ 0.316722] thermal_sys: Registered thermal governor 'user_space'859worker1 # [ 0.284771] rcu: Max phase no-delay instances is 400.860worker2 # [ 0.317512] thermal_sys: Registered thermal governor 'power_allocator'861client # [ 0.299657] LSM support for eBPF active862worker2 # [ 0.317843] cpuidle: using governor menu863client # [ 0.300520] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)864worker2 # [ 0.320045] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5865lb # [ 0.312062] NET: Registered PF_NETLINK/PF_ROUTE protocol family866client # [ 0.301425] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)867worker2 # [ 0.321093] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]868lb # [ 0.313372] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations869worker1 # [ 0.289703] smp: Bringing up secondary CPUs ...870worker2 # [ 0.321831] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry871lb # [ 0.314160] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations872worker1 # [ 0.290198] smp: Brought up 1 node, 1 CPU873worker2 # [ 0.322845] PCI: Using configuration type 1 for base access874client # [ 0.305142] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)875worker1 # [ 0.290864] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)876lb # [ 0.315424] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations877worker2 # [ 0.323996] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.878lb # [ 0.316146] audit: initializing netlink subsys (disabled)879client # [ 0.306112] Performance Events: Fam17h+ core perfctr, AMD PMU driver.880lb # [ 0.317260] thermal_sys: Registered thermal governor 'fair_share'881worker1 # [ 0.291356] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)882client # [ 0.307338] ... version: 2883lb # [ 0.317262] thermal_sys: Registered thermal governor 'bang_bang'884worker1 # [ 0.292460] devtmpfs: initialized885client # [ 0.308029] ... bit width: 48886lb # [ 0.318135] thermal_sys: Registered thermal governor 'step_wise'887worker1 # [ 0.293261] x86/mm: Memory block size: 128MB888client # [ 0.308390] ... generic counters: 6889lb # [ 0.319056] thermal_sys: Registered thermal governor 'user_space'890client # [ 0.309268] ... generic bitmap: 000000000000003f891lb # [ 0.319841] audit: type=2000 audit(1789892144.102:1): state=initialized audit_enabled=0 res=1892worker1 # [ 0.295023] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)893client # [ 0.310205] ... fixed-purpose counters: 0894lb # [ 0.321137] thermal_sys: Registered thermal governor 'power_allocator'895client # [ 0.311015] ... fixed-purpose bitmap: 0000000000000000896worker1 # [ 0.296076] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).897lb # [ 0.321151] cpuidle: using governor menu898worker2 # [ 0.330852] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages899client # [ 0.311375] ... value mask: 0000ffffffffffff900worker1 # [ 0.297268] pinctrl core: initialized pinctrl subsystem901worker2 # [ 0.331830] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page902lb # [ 0.323152] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5903client # [ 0.312375] ... max period: 00007fffffffffff904worker1 # [ 0.298441] PM: RTC time: 08:15:43, date: 2026-09-20905client # [ 0.313375] ... global_ctrl mask: 000000000000003f906lb # [ 0.324366] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]907client # [ 0.314542] signal: max sigframe size: 3376908lb # [ 0.325137] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry909lb # [ 0.326148] PCI: Using configuration type 1 for base access910client # [ 0.315496] rcu: Hierarchical SRCU implementation.911worker1 # [ 0.301952] NET: Registered PF_NETLINK/PF_ROUTE protocol family912worker2 # [ 0.336830] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages913client # [ 0.316382] rcu: Max phase no-delay instances is 400.914lb # [ 0.327217] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.915worker2 # [ 0.337830] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page916worker1 # [ 0.302660] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations917worker1 # [ 0.303207] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations918worker1 # [ 0.304464] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations919worker1 # [ 0.305194] audit: initializing netlink subsys (disabled)920lb # [ 0.332376] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages921worker1 # [ 0.306305] thermal_sys: Registered thermal governor 'fair_share'922lb # [ 0.333136] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page923client # [ 0.323211] smp: Bringing up secondary CPUs ...924worker1 # [ 0.306308] thermal_sys: Registered thermal governor 'bang_bang'925client # [ 0.324067] smp: Brought up 1 node, 1 CPU926worker1 # [ 0.307186] thermal_sys: Registered thermal governor 'step_wise'927client # [ 0.324377] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)928worker1 # [ 0.308088] thermal_sys: Registered thermal governor 'user_space'929worker1 # [ 0.308877] audit: type=2000 audit(1789892144.121:1): state=initialized audit_enabled=0 res=1930worker1 # [ 0.310188] thermal_sys: Registered thermal governor 'power_allocator'931client # [ 0.325628] Memory: 1454536K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109352K reserved, 0K cma-reserved)932lb # [ 0.338136] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages933worker1 # [ 0.310201] cpuidle: using governor menu934worker2 # [ 0.349229] ACPI: Added _OSI(Module Device)935client # [ 0.326705] devtmpfs: initialized936lb # [ 0.339134] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page937worker2 # [ 0.349830] ACPI: Added _OSI(Processor Device)938client # [ 0.327541] x86/mm: Memory block size: 128MB939worker1 # [ 0.312399] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5940worker2 # [ 0.350563] ACPI: Added _OSI(Processor Aggregator Device)941worker1 # [ 0.313421] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]942worker1 # [ 0.314187] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry943client # [ 0.329620] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)944worker1 # [ 0.315196] PCI: Using configuration type 1 for base access945client # [ 0.330417] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).946worker1 # [ 0.316253] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.947client # [ 0.331497] pinctrl core: initialized pinctrl subsystem948client # [ 0.332787] PM: RTC time: 08:15:43, date: 2026-09-20949worker2 # [ 0.359041] ACPI: 1 ACPI AML tables successfully acquired and loaded950lb # [ 0.350534] ACPI: Added _OSI(Module Device)951lb # [ 0.351136] ACPI: Added _OSI(Processor Device)952worker2 # [ 0.360820] ACPI: Interpreter enabled953client # [ 0.336956] NET: Registered PF_NETLINK/PF_ROUTE protocol family954worker2 # [ 0.361300] ACPI: PM: (supports S0 S3 S4 S5)955lb # [ 0.351857] ACPI: Added _OSI(Processor Aggregator Device)956worker1 # [ 0.323435] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages957worker1 # [ 0.324187] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page958client # [ 0.338065] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations959worker2 # [ 0.363830] ACPI: Using IOAPIC for interrupt routing960client # [ 0.338420] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations961worker2 # [ 0.364710] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug962client # [ 0.339738] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations963client # [ 0.340390] audit: initializing netlink subsys (disabled)964worker1 # [ 0.329186] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages965worker2 # [ 0.367829] PCI: Using E820 reservations for host bridge windows966worker1 # [ 0.330186] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page967client # [ 0.341802] thermal_sys: Registered thermal governor 'fair_share'968worker2 # [ 0.368927] ACPI: Enabled 2 GPEs in block 00 to 3F969lb # [ 0.359712] ACPI: 1 ACPI AML tables successfully acquired and loaded970client # [ 0.341805] thermal_sys: Registered thermal governor 'bang_bang'971client # [ 0.342376] thermal_sys: Registered thermal governor 'step_wise'972client # [ 0.343380] audit: type=2000 audit(1789892144.136:1): state=initialized audit_enabled=0 res=1973lb # [ 0.363556] ACPI: Interpreter enabled974client # [ 0.345378] thermal_sys: Registered thermal governor 'user_space'975lb # [ 0.364150] ACPI: PM: (supports S0 S3 S4 S5)976lb # [ 0.364832] ACPI: Using IOAPIC for interrupt routing977client # [ 0.345380] thermal_sys: Registered thermal governor 'power_allocator'978client # [ 0.346401] cpuidle: using governor menu979lb # [ 0.365179] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug980worker1 # [ 0.338762] ACPI: Added _OSI(Module Device)981lb # [ 0.366136] PCI: Using E820 reservations for host bridge windows982worker1 # [ 0.339187] ACPI: Added _OSI(Processor Device)983worker2 # [ 0.377167] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])984client # [ 0.348905] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5985worker1 # [ 0.339879] ACPI: Added _OSI(Processor Aggregator Device)986worker2 # [ 0.377837] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]987worker2 # [ 0.378923] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]988client # [ 0.349688] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]989lb # [ 0.369186] ACPI: Enabled 2 GPEs in block 00 to 3F990worker2 # [ 0.379965] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]991client # [ 0.350379] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry992worker2 # [ 0.381207] PCI host bridge to bus 0000:00993client # [ 0.351394] PCI: Using configuration type 1 for base access994worker2 # [ 0.381835] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]995worker2 # [ 0.382828] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]996client # [ 0.352654] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.997worker2 # [ 0.383829] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]998worker1 # [ 0.346734] ACPI: 1 ACPI AML tables successfully acquired and loaded999worker2 # [ 0.384829] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1000worker2 # [ 0.385828] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1001lb # [ 0.377824] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1002worker2 # [ 0.386828] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1003worker1 # [ 0.350093] ACPI: Interpreter enabled1004worker1 # [ 0.350624] ACPI: PM: (supports S0 S3 S4 S5)1005worker2 # [ 0.387829] pci_bus 0000:00: root bus resource [bus 00-ff]1006lb # [ 0.378141] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1007worker1 # [ 0.351186] ACPI: Using IOAPIC for interrupt routing1008worker2 # [ 0.388802] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1009lb # [ 0.379701] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1010client # [ 0.359754] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1011worker1 # [ 0.352071] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1012worker2 # [ 0.390279] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1013lb # [ 0.380258] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1014client # [ 0.360375] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1015lb # [ 0.381490] PCI host bridge to bus 0000:001016client # [ 0.361375] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1017lb # [ 0.382139] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1018lb # [ 0.383135] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1019worker1 # [ 0.357186] PCI: Using E820 reservations for host bridge windows1020lb # [ 0.384134] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1021worker1 # [ 0.358231] ACPI: Enabled 2 GPEs in block 00 to 3F1022lb # [ 0.385135] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1023lb # [ 0.386135] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1024lb # [ 0.387135] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1025lb # [ 0.388135] pci_bus 0000:00: root bus resource [bus 00-ff]1026client # [ 0.368376] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1027worker2 # [ 0.392895] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1028lb # [ 0.389093] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1029worker2 # [ 0.393842] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1030lb # [ 0.390589] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1031worker2 # [ 0.394851] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1032worker1 # [ 0.366824] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1033worker2 # [ 0.396186] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1034worker1 # [ 0.367703] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1035worker2 # [ 0.397635] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1036worker1 # [ 0.368264] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1037worker1 # [ 0.369308] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1038client # [ 0.377910] ACPI: Added _OSI(Module Device)1039client # [ 0.378376] ACPI: Added _OSI(Processor Device)1040worker1 # [ 0.370558] PCI host bridge to bus 0000:001041worker2 # [ 0.400836] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1042client # [ 0.379164] ACPI: Added _OSI(Processor Aggregator Device)1043worker1 # [ 0.371189] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1044worker2 # [ 0.401667] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1045worker1 # [ 0.372176] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1046lb # [ 0.393247] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1047worker2 # [ 0.402553] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1048worker1 # [ 0.372968] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1049lb # [ 0.394147] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1050worker2 # [ 0.402836] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1051worker1 # [ 0.374050] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1052lb # [ 0.395099] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1053worker1 # [ 0.375065] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1054worker2 # [ 0.404435] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1055lb # [ 0.396231] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1056worker1 # [ 0.376059] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1057worker1 # [ 0.377090] pci_bus 0000:00: root bus resource [bus 00-ff]1058lb # [ 0.398054] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1059worker2 # [ 0.405859] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1060worker1 # [ 0.377947] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1061worker2 # [ 0.406767] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1062worker2 # [ 0.407604] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1063worker1 # [ 0.379623] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1064lb # [ 0.401166] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1065lb # [ 0.402012] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1066worker2 # [ 0.409266] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1067lb # [ 0.402871] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1068client # [ 0.391777] ACPI: 1 ACPI AML tables successfully acquired and loaded1069lb # [ 0.403141] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1070worker2 # [ 0.410870] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1071lb # [ 0.404701] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1072worker2 # [ 0.411726] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1073worker2 # [ 0.412573] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1074lb # [ 0.406167] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1075worker2 # [ 0.413414] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1076client # [ 0.397880] ACPI: Interpreter enabled1077worker1 # [ 0.382265] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1078lb # [ 0.407017] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1079client # [ 0.398396] ACPI: PM: (supports S0 S3 S4 S5)1080worker1 # [ 0.383197] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1081client # [ 0.399135] ACPI: Using IOAPIC for interrupt routing1082lb # [ 0.407865] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1083worker1 # [ 0.384141] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1084lb # [ 0.408687] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1085worker1 # [ 0.385246] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1086worker2 # [ 0.416094] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1087client # [ 0.401503] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1088worker2 # [ 0.417468] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1089worker1 # [ 0.386977] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1090client # [ 0.402376] PCI: Using E820 reservations for host bridge windows1091worker2 # [ 0.417850] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1092lb # [ 0.411175] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1093lb # [ 0.412060] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1094worker2 # [ 0.419406] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1095lb # [ 0.412869] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1096client # [ 0.405583] ACPI: Enabled 2 GPEs in block 00 to 3F1097worker1 # [ 0.390220] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1098worker1 # [ 0.391073] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1099lb # [ 0.413674] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1100worker2 # [ 0.420857] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1101worker2 # [ 0.421674] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1102worker1 # [ 0.391945] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1103worker2 # [ 0.422544] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1104worker1 # [ 0.392191] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1105lb # [ 0.415179] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1106lb # [ 0.415989] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1107worker1 # [ 0.393929] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1108worker2 # [ 0.423480] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1109lb # [ 0.416838] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1110lb # [ 0.417708] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1111worker1 # [ 0.397129] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1112worker2 # [ 0.426649] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1113client # [ 0.414521] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1114worker1 # [ 0.397822] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1115worker2 # [ 0.427482] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1116worker1 # [ 0.398207] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1117worker2 # [ 0.427851] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1118lb # [ 0.419163] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1119client # [ 0.415384] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1120lb # [ 0.419967] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1121worker1 # [ 0.399741] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1122client # [ 0.416480] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1123worker2 # [ 0.429467] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1124lb # [ 0.420839] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1125client # [ 0.417527] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1126lb # [ 0.421762] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1127client # [ 0.418859] PCI host bridge to bus 0000:001128worker1 # [ 0.402216] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1129worker2 # [ 0.431799] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1130client # [ 0.419382] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1131worker1 # [ 0.403052] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1132worker2 # [ 0.432837] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1133client # [ 0.420377] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1134worker1 # [ 0.403909] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1135worker2 # [ 0.433814] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1136lb # [ 0.424449] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1137client # [ 0.421376] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1138worker2 # [ 0.434708] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1139lb # [ 0.425773] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1140worker1 # [ 0.404716] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1141client # [ 0.422376] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1142lb # [ 0.426156] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1143worker2 # [ 0.436192] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1144client # [ 0.423376] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1145lb # [ 0.427670] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1146worker1 # [ 0.407214] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1147worker2 # [ 0.437868] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1148client # [ 0.424376] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1149worker1 # [ 0.408048] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1150worker2 # [ 0.438851] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1151client # [ 0.425377] pci_bus 0000:00: root bus resource [bus 00-ff]1152lb # [ 0.429165] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1153worker1 # [ 0.408894] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1154lb # [ 0.430017] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1155client # [ 0.426472] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1156lb # [ 0.430863] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1157worker2 # [ 0.440412] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1158worker1 # [ 0.409749] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1159lb # [ 0.431141] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1160client # [ 0.427982] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1161worker2 # [ 0.442588] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1162worker1 # [ 0.412216] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1163lb # [ 0.432717] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1164worker2 # [ 0.442835] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1165worker1 # [ 0.413031] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1166worker2 # [ 0.443844] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1167worker1 # [ 0.413920] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1168lb # [ 0.434147] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1169lb # [ 0.435091] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1170worker2 # [ 0.445411] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1171worker1 # [ 0.414784] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1172lb # [ 0.436508] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1173worker2 # [ 0.446855] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1174lb # [ 0.438173] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1175worker1 # [ 0.417211] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1176worker2 # [ 0.447836] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1177worker1 # [ 0.418053] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1178lb # [ 0.439013] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1179worker2 # [ 0.448805] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1180worker1 # [ 0.418911] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1181lb # [ 0.440179] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1182client # [ 0.431482] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1183worker2 # [ 0.450334] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1184worker1 # [ 0.419803] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1185client # [ 0.432391] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1186lb # [ 0.441703] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1187worker2 # [ 0.451564] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1188client # [ 0.433402] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1189worker1 # [ 0.421193] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1190lb # [ 0.443155] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1191worker2 # [ 0.452051] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1192client # [ 0.434633] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1193worker1 # [ 0.422009] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1194lb # [ 0.443976] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1195worker2 # [ 0.453565] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1196lb # [ 0.444863] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1197worker1 # [ 0.422887] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1198client # [ 0.436354] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1199lb # [ 0.445750] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1200worker1 # [ 0.423192] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1201worker1 # [ 0.424680] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1202lb # [ 0.446815] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1203lb # [ 0.447974] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1204client # [ 0.439386] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1205worker1 # [ 0.426217] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1206client # [ 0.440385] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1207lb # [ 0.449852] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1208worker1 # [ 0.427208] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1209client # [ 0.441428] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1210worker1 # [ 0.428734] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1211client # [ 0.442384] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1212client # [ 0.444082] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1213worker1 # [ 0.430678] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1214worker2 # [ 0.454033] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1215worker1 # [ 0.431821] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1216worker1 # [ 0.432207] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1217client # [ 0.447412] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1218worker1 # [ 0.433765] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1219worker2 # [ 0.457576] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1220client # [ 0.448384] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1221client # [ 0.449402] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1222worker2 # [ 0.458103] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1223worker1 # [ 0.435848] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1224lb # [ 0.450366] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1225worker1 # [ 0.436193] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1226client # [ 0.451058] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1227worker2 # [ 0.459864] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1228lb # [ 0.452815] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1229worker1 # [ 0.437149] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1230worker2 # [ 0.461099] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1231lb # [ 0.453409] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1232client # [ 0.454400] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1233worker2 # [ 0.462142] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1234worker1 # [ 0.438570] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1235lb # [ 0.454740] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1236client # [ 0.455384] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1237worker2 # [ 0.463084] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1238worker1 # [ 0.440988] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1239lb # [ 0.456065] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1240client # [ 0.456404] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1241worker1 # [ 0.442015] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1242lb # [ 0.457421] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1243worker2 # [ 0.465758] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1244worker1 # [ 0.443879] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1245worker2 # [ 0.466452] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1246client # [ 0.458108] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1247lb # [ 0.458422] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1248worker2 # [ 0.467165] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1249lb # [ 0.460157] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1250lb # [ 0.461060] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1251client # [ 0.461395] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1252worker2 # [ 0.468857] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1253client # [ 0.462384] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1254lb # [ 0.462191] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1255client # [ 0.463403] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1256lb # [ 0.463811] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1257worker2 # [ 0.472799] ACPI: PCI: Interrupt link LNKA configured for IRQ 101258client # [ 0.465132] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1259worker2 # [ 0.473645] ACPI: PCI: Interrupt link LNKB configured for IRQ 101260worker2 # [ 0.474633] ACPI: PCI: Interrupt link LNKC configured for IRQ 111261lb # [ 0.467074] ACPI: PCI: Interrupt link LNKA configured for IRQ 101262worker2 # [ 0.475656] ACPI: PCI: Interrupt link LNKD configured for IRQ 111263client # [ 0.467398] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1264lb # [ 0.467979] ACPI: PCI: Interrupt link LNKB configured for IRQ 101265client # [ 0.468252] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1266worker2 # [ 0.476632] ACPI: PCI: Interrupt link LNKE configured for IRQ 101267worker1 # [ 0.444396] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1268lb # [ 0.468963] ACPI: PCI: Interrupt link LNKC configured for IRQ 111269client # [ 0.469122] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1270worker2 # [ 0.477682] ACPI: PCI: Interrupt link LNKF configured for IRQ 101271lb # [ 0.469951] ACPI: PCI: Interrupt link LNKD configured for IRQ 111272worker1 # [ 0.446965] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1273worker2 # [ 0.478652] ACPI: PCI: Interrupt link LNKG configured for IRQ 111274lb # [ 0.470978] ACPI: PCI: Interrupt link LNKE configured for IRQ 101275client # [ 0.470060] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1276worker2 # [ 0.479637] ACPI: PCI: Interrupt link LNKH configured for IRQ 111277worker1 # [ 0.447421] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1278lb # [ 0.471990] ACPI: PCI: Interrupt link LNKF configured for IRQ 101279worker2 # [ 0.480594] ACPI: PCI: Interrupt link GSIA configured for IRQ 161280lb # [ 0.472968] ACPI: PCI: Interrupt link LNKG configured for IRQ 111281worker2 # [ 0.480844] ACPI: PCI: Interrupt link GSIB configured for IRQ 171282worker1 # [ 0.448894] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1283lb # [ 0.473980] ACPI: PCI: Interrupt link LNKH configured for IRQ 111284worker2 # [ 0.481842] ACPI: PCI: Interrupt link GSIC configured for IRQ 181285worker1 # [ 0.449450] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1286lb # [ 0.474982] ACPI: PCI: Interrupt link GSIA configured for IRQ 161287worker2 # [ 0.482846] ACPI: PCI: Interrupt link GSID configured for IRQ 191288client # [ 0.473565] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1289lb # [ 0.475874] ACPI: PCI: Interrupt link GSIB configured for IRQ 171290worker2 # [ 0.483819] ACPI: PCI: Interrupt link GSIE configured for IRQ 201291client # [ 0.474380] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1292worker1 # [ 0.450468] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1293lb # [ 0.476146] ACPI: PCI: Interrupt link GSIC configured for IRQ 181294worker2 # [ 0.484544] ACPI: PCI: Interrupt link GSIF configured for IRQ 211295client # [ 0.475302] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1296lb # [ 0.477088] ACPI: PCI: Interrupt link GSID configured for IRQ 191297worker1 # [ 0.451450] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1298worker2 # [ 0.484842] ACPI: PCI: Interrupt link GSIG configured for IRQ 221299lb # [ 0.477854] ACPI: PCI: Interrupt link GSIE configured for IRQ 201300worker2 # [ 0.485793] ACPI: PCI: Interrupt link GSIH configured for IRQ 231301client # [ 0.476762] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1302lb # [ 0.478147] ACPI: PCI: Interrupt link GSIF configured for IRQ 211303worker1 # [ 0.453214] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1304lb # [ 0.479102] ACPI: PCI: Interrupt link GSIG configured for IRQ 221305worker2 # [ 0.487803] iommu: Default domain type: Translated1306client # [ 0.478405] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1307worker1 # [ 0.454063] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1308lb # [ 0.479911] ACPI: PCI: Interrupt link GSIH configured for IRQ 231309worker2 # [ 0.488455] iommu: DMA domain TLB invalidation policy: lazy mode1310client # [ 0.479242] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1311worker2 # [ 0.489122] ACPI: bus type USB registered1312worker1 # [ 0.455523] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1313client # [ 0.480111] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1314worker2 # [ 0.489862] usbcore: registered new interface driver usbfs1315client # [ 0.480379] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1316worker2 # [ 0.490786] usbcore: registered new interface driver hub1317worker1 # [ 0.456979] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1318lb # [ 0.481240] iommu: Default domain type: Translated1319worker2 # [ 0.491495] usbcore: registered new device driver usb1320lb # [ 0.482145] iommu: DMA domain TLB invalidation policy: lazy mode1321client # [ 0.482255] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1322lb # [ 0.483415] ACPI: bus type USB registered1323worker2 # [ 0.492777] NetLabel: Initializing1324worker2 # [ 0.493262] NetLabel: domain hash size = 1281325lb # [ 0.484163] usbcore: registered new interface driver usbfs1326client # [ 0.484405] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1327worker1 # [ 0.460732] ACPI: PCI: Interrupt link LNKA configured for IRQ 101328lb # [ 0.485056] usbcore: registered new interface driver hub1329worker1 # [ 0.461292] ACPI: PCI: Interrupt link LNKB configured for IRQ 101330client # [ 0.485339] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1331lb # [ 0.485780] usbcore: registered new device driver usb1332worker2 # [ 0.493835] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1333worker1 # [ 0.462286] ACPI: PCI: Interrupt link LNKC configured for IRQ 111334worker2 # [ 0.494906] NetLabel: unlabeled traffic allowed by default1335lb # [ 0.487040] NetLabel: Initializing1336client # [ 0.486720] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1337worker2 # [ 0.495824] PCI: Using ACPI for IRQ routing1338worker1 # [ 0.463283] ACPI: PCI: Interrupt link LNKD configured for IRQ 111339lb # [ 0.487529] NetLabel: domain hash size = 1281340worker1 # [ 0.464282] ACPI: PCI: Interrupt link LNKE configured for IRQ 101341lb # [ 0.488715] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1342client # [ 0.488381] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1343worker1 # [ 0.465280] ACPI: PCI: Interrupt link LNKF configured for IRQ 101344lb # [ 0.489197] NetLabel: unlabeled traffic allowed by default1345client # [ 0.489196] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1346worker1 # [ 0.466282] ACPI: PCI: Interrupt link LNKG configured for IRQ 111347lb # [ 0.490148] PCI: Using ACPI for IRQ routing1348client # [ 0.490091] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1349worker1 # [ 0.467280] ACPI: PCI: Interrupt link LNKH configured for IRQ 111350worker1 # [ 0.468220] ACPI: PCI: Interrupt link GSIA configured for IRQ 161351client # [ 0.491724] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1352worker1 # [ 0.469200] ACPI: PCI: Interrupt link GSIB configured for IRQ 171353worker1 # [ 0.470151] ACPI: PCI: Interrupt link GSIC configured for IRQ 181354client # [ 0.493380] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1355worker1 # [ 0.470975] ACPI: PCI: Interrupt link GSID configured for IRQ 191356client # [ 0.494216] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1357worker1 # [ 0.471938] ACPI: PCI: Interrupt link GSIE configured for IRQ 201358client # [ 0.495102] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1359worker1 # [ 0.472197] ACPI: PCI: Interrupt link GSIF configured for IRQ 211360worker1 # [ 0.473197] ACPI: PCI: Interrupt link GSIG configured for IRQ 221361client # [ 0.495921] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1362worker1 # [ 0.474134] ACPI: PCI: Interrupt link GSIH configured for IRQ 231363client # [ 0.497063] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1364worker1 # [ 0.475931] iommu: Default domain type: Translated1365worker1 # [ 0.476192] iommu: DMA domain TLB invalidation policy: lazy mode1366client # [ 0.497902] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1367worker1 # [ 0.477403] ACPI: bus type USB registered1368client # [ 0.498919] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1369worker1 # [ 0.478164] usbcore: registered new interface driver usbfs1370worker1 # [ 0.478924] usbcore: registered new interface driver hub1371worker1 # [ 0.479196] usbcore: registered new device driver usb1372worker1 # [ 0.480943] NetLabel: Initializing1373worker1 # [ 0.481191] NetLabel: domain hash size = 1281374worker1 # [ 0.482013] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1375worker1 # [ 0.483022] NetLabel: unlabeled traffic allowed by default1376worker1 # [ 0.483922] PCI: Using ACPI for IRQ routing1377client # [ 0.499610] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1378client # [ 0.502200] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1379client # [ 0.503252] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1380client # [ 0.505357] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1381client # [ 0.506311] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1382client # [ 0.507615] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1383client # [ 0.508652] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1384client # [ 0.510413] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1385client # [ 0.511247] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1386worker2 # [ 0.539245] pci 0000:00:01.0: vgaarb: setting as boot VGA device1387worker2 # [ 0.539824] pci 0000:00:01.0: vgaarb: bridge control possible1388client # [ 0.512400] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1389worker2 # [ 0.539824] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1390worker2 # [ 0.539833] vgaarb: loaded1391client # [ 0.513949] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1392lb # [ 0.533729] pci 0000:00:01.0: vgaarb: setting as boot VGA device1393worker2 # [ 0.540599] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01394lb # [ 0.534131] pci 0000:00:01.0: vgaarb: bridge control possible1395worker2 # [ 0.540829] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1396lb # [ 0.534131] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1397lb # [ 0.534139] vgaarb: loaded1398client # [ 0.517692] ACPI: PCI: Interrupt link LNKA configured for IRQ 101399lb # [ 0.534899] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01400client # [ 0.518476] ACPI: PCI: Interrupt link LNKB configured for IRQ 101401lb # [ 0.535136] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1402client # [ 0.519470] ACPI: PCI: Interrupt link LNKC configured for IRQ 111403worker2 # [ 0.544923] clocksource: Switched to clocksource kvm-clock1404client # [ 0.520471] ACPI: PCI: Interrupt link LNKD configured for IRQ 111405client # [ 0.521473] ACPI: PCI: Interrupt link LNKE configured for IRQ 101406worker2 # [ 0.546643] VFS: Disk quotas dquot_6.6.01407client # [ 0.522487] ACPI: PCI: Interrupt link LNKF configured for IRQ 101408client # [ 0.523484] ACPI: PCI: Interrupt link LNKG configured for IRQ 111409lb # [ 0.539229] clocksource: Switched to clocksource kvm-clock1410client # [ 0.524474] ACPI: PCI: Interrupt link LNKH configured for IRQ 111411worker2 # [ 0.549247] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1412client # [ 0.525410] ACPI: PCI: Interrupt link GSIA configured for IRQ 161413worker2 # [ 0.550646] pnp: PnP ACPI init1414client # [ 0.526335] ACPI: PCI: Interrupt link GSIB configured for IRQ 171415worker2 # [ 0.551468] ACPI: IRQ 4 override to edge(!), high(!)1416client # [ 0.527080] ACPI: PCI: Interrupt link GSIC configured for IRQ 181417lb # [ 0.543183] VFS: Disk quotas dquot_6.6.01418worker2 # [ 0.552488] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1419client # [ 0.527388] ACPI: PCI: Interrupt link GSID configured for IRQ 191420lb # [ 0.543884] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1421client # [ 0.528299] ACPI: PCI: Interrupt link GSIE configured for IRQ 201422worker2 # [ 0.554307] pnp: PnP ACPI: found 6 devices1423lb # [ 0.545221] pnp: PnP ACPI init1424client # [ 0.529087] ACPI: PCI: Interrupt link GSIF configured for IRQ 211425lb # [ 0.546025] ACPI: IRQ 4 override to edge(!), high(!)1426client # [ 0.529385] ACPI: PCI: Interrupt link GSIG configured for IRQ 221427lb # [ 0.547015] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1428client # [ 0.530341] ACPI: PCI: Interrupt link GSIH configured for IRQ 231429lb # [ 0.548623] pnp: PnP ACPI: found 6 devices1430client # [ 0.532181] iommu: Default domain type: Translated1431client # [ 0.532960] iommu: DMA domain TLB invalidation policy: lazy mode1432client # [ 0.533672] ACPI: bus type USB registered1433worker1 # [ 0.528000] pci 0000:00:01.0: vgaarb: setting as boot VGA device1434client # [ 0.534411] usbcore: registered new interface driver usbfs1435worker1 # [ 0.528181] pci 0000:00:01.0: vgaarb: bridge control possible1436client # [ 0.535277] usbcore: registered new interface driver hub1437worker2 # [ 0.562099] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1438client # [ 0.535992] usbcore: registered new device driver usb1439worker2 # [ 0.563531] clocksource: Switched to clocksource acpi_pm1440worker1 # [ 0.528181] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1441worker1 # [ 0.528190] vgaarb: loaded1442worker2 # [ 0.564477] NET: Registered PF_INET protocol family1443client # [ 0.537328] NetLabel: Initializing1444worker1 # [ 0.528910] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01445client # [ 0.537784] NetLabel: domain hash size = 1281446lb # [ 0.556267] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1447worker2 # [ 0.565668] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1448worker1 # [ 0.529187] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1449client # [ 0.538373] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1450lb # [ 0.557655] clocksource: Switched to clocksource acpi_pm1451client # [ 0.539304] NetLabel: unlabeled traffic allowed by default1452lb # [ 0.558865] NET: Registered PF_INET protocol family1453client # [ 0.540093] PCI: Using ACPI for IRQ routing1454lb # [ 0.560048] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1455worker1 # [ 0.532291] clocksource: Switched to clocksource kvm-clock1456worker1 # [ 0.534139] VFS: Disk quotas dquot_6.6.01457worker1 # [ 0.536743] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1458worker1 # [ 0.538177] pnp: PnP ACPI init1459worker1 # [ 0.539025] ACPI: IRQ 4 override to edge(!), high(!)1460worker1 # [ 0.540083] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1461worker1 # [ 0.541761] pnp: PnP ACPI: found 6 devices1462worker2 # [ 0.582652] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1463worker2 # [ 0.584261] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1464worker2 # [ 0.585640] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1465lb # [ 0.577186] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1466worker2 # [ 0.587055] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1467worker1 # [ 0.549496] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1468lb # [ 0.578866] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1469worker2 # [ 0.588294] TCP: Hash tables configured (established 16384 bind 16384)1470worker1 # [ 0.550947] clocksource: Switched to clocksource acpi_pm1471lb # [ 0.580217] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1472worker2 # [ 0.589636] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1473worker1 # [ 0.552168] NET: Registered PF_INET protocol family1474lb # [ 0.581536] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1475worker2 # [ 0.591068] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1476worker1 # [ 0.553581] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1477lb # [ 0.582862] TCP: Hash tables configured (established 16384 bind 16384)1478worker2 # [ 0.592211] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1479worker2 # [ 0.593424] NET: Registered PF_UNIX/PF_LOCAL protocol family1480lb # [ 0.583986] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1481worker2 # [ 0.594461] NET: Registered PF_XDP protocol family1482lb # [ 0.585349] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1483worker2 # [ 0.595329] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1484lb # [ 0.586442] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1485worker2 # [ 0.596359] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1486lb # [ 0.587717] NET: Registered PF_UNIX/PF_LOCAL protocol family1487worker2 # [ 0.597414] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1488lb # [ 0.588756] NET: Registered PF_XDP protocol family1489worker2 # [ 0.598549] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1490lb # [ 0.589645] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1491worker2 # [ 0.599691] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1492lb # [ 0.590680] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1493worker2 # [ 0.600859] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1494lb # [ 0.591784] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1495lb # [ 0.592991] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1496worker2 # [ 0.602831] ACPI: \_SB_.GSIA: Enabled at IRQ 161497lb # [ 0.594254] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1498lb # [ 0.595410] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1499worker2 # [ 0.605142] ACPI: \_SB_.GSIB: Enabled at IRQ 171500lb # [ 0.597400] ACPI: \_SB_.GSIA: Enabled at IRQ 161501worker2 # [ 0.607144] ACPI: \_SB_.GSIC: Enabled at IRQ 181502lb # [ 0.599657] ACPI: \_SB_.GSIB: Enabled at IRQ 171503worker1 # [ 0.570439] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1504worker2 # [ 0.609198] ACPI: \_SB_.GSID: Enabled at IRQ 191505worker1 # [ 0.571993] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1506worker2 # [ 0.610942] PCI: CLS 0 bytes, default 641507lb # [ 0.601607] ACPI: \_SB_.GSIC: Enabled at IRQ 181508worker1 # [ 0.573240] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1509worker2 # [ 0.611854] Trying to unpack rootfs image as initramfs...1510client # [ 0.583603] pci 0000:00:01.0: vgaarb: setting as boot VGA device1511lb # [ 0.603520] ACPI: \_SB_.GSID: Enabled at IRQ 191512worker1 # [ 0.574560] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1513client # [ 0.584369] pci 0000:00:01.0: vgaarb: bridge control possible1514worker1 # [ 0.575761] TCP: Hash tables configured (established 16384 bind 16384)1515lb # [ 0.605240] PCI: CLS 0 bytes, default 641516client # [ 0.584369] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1517worker1 # [ 0.576936] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1518client # [ 0.584378] vgaarb: loaded1519lb # [ 0.606099] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1520worker1 # [ 0.578143] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1521client # [ 0.585118] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01522lb # [ 0.607796] Trying to unpack rootfs image as initramfs...1523client # [ 0.585375] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1524worker1 # [ 0.579164] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1525worker1 # [ 0.580324] NET: Registered PF_UNIX/PF_LOCAL protocol family1526worker2 # [ 0.617837] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1527worker1 # [ 0.581240] NET: Registered PF_XDP protocol family1528worker1 # [ 0.582045] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1529worker1 # [ 0.583022] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1530client # [ 0.588464] clocksource: Switched to clocksource kvm-clock1531worker1 # [ 0.584001] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1532worker1 # [ 0.585065] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1533worker1 # [ 0.586127] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1534client # [ 0.592064] VFS: Disk quotas dquot_6.6.01535worker1 # [ 0.587185] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1536client # [ 0.592767] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1537worker1 # [ 0.588862] ACPI: \_SB_.GSIA: Enabled at IRQ 161538client # [ 0.594161] pnp: PnP ACPI init1539client # [ 0.594954] ACPI: IRQ 4 override to edge(!), high(!)1540client # [ 0.595946] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1541worker1 # [ 0.591485] ACPI: \_SB_.GSIB: Enabled at IRQ 171542client # [ 0.597464] pnp: PnP ACPI: found 6 devices1543worker1 # [ 0.593361] ACPI: \_SB_.GSIC: Enabled at IRQ 181544worker1 # [ 0.595291] ACPI: \_SB_.GSID: Enabled at IRQ 191545worker1 # [ 0.596959] PCI: CLS 0 bytes, default 641546worker1 # [ 0.597823] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1547worker1 # [ 0.599497] Trying to unpack rootfs image as initramfs...1548client # [ 0.605126] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1549client # [ 0.606581] clocksource: Switched to clocksource acpi_pm1550client # [ 0.607562] NET: Registered PF_INET protocol family1551client # [ 0.608778] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1552worker2 # [ 0.658487] Initialise system trusted keyrings1553client # [ 0.625838] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1554client # [ 0.627447] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1555worker2 # [ 0.661786] workingset: timestamp_bits=40 max_order=19 bucket_order=01556client # [ 0.628813] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1557lb # [ 0.654088] Initialise system trusted keyrings1558client # [ 0.630204] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1559client # [ 0.631526] TCP: Hash tables configured (established 16384 bind 16384)1560client # [ 0.632735] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1561lb # [ 0.656672] workingset: timestamp_bits=40 max_order=19 bucket_order=01562client # [ 0.634069] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1563client # [ 0.635333] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1564client # [ 0.636645] NET: Registered PF_UNIX/PF_LOCAL protocol family1565client # [ 0.637657] NET: Registered PF_XDP protocol family1566client # [ 0.638534] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1567client # [ 0.639571] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1568client # [ 0.640632] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1569client # [ 0.641798] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1570client # [ 0.642953] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1571client # [ 0.644131] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1572client # [ 0.645868] ACPI: \_SB_.GSIA: Enabled at IRQ 161573client # [ 0.648044] ACPI: \_SB_.GSIB: Enabled at IRQ 171574client # [ 0.650095] ACPI: \_SB_.GSIC: Enabled at IRQ 181575worker2 # [ 0.683230] Key type asymmetric registered1576worker1 # [ 0.645760] Initialise system trusted keyrings1577worker2 # [ 0.683968] Asymmetric key parser 'x509' registered1578worker1 # [ 0.646722] workingset: timestamp_bits=40 max_order=19 bucket_order=01579client # [ 0.652057] ACPI: \_SB_.GSID: Enabled at IRQ 191580client # [ 0.653737] PCI: CLS 0 bytes, default 641581worker2 # [ 0.686806] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1582client # [ 0.654632] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1583lb # [ 0.679999] Key type asymmetric registered1584client # [ 0.656412] Trying to unpack rootfs image as initramfs...1585lb # [ 0.680717] Asymmetric key parser 'x509' registered1586worker2 # [ 0.690818] io scheduler mq-deadline registered1587worker2 # [ 0.691569] io scheduler kyber registered1588lb # [ 0.683644] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1589worker2 # [ 0.694320] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1590worker2 # [ 0.695689] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1591lb # [ 0.687645] io scheduler mq-deadline registered1592lb # [ 0.688471] io scheduler kyber registered1593worker2 # [ 0.701019] Linux agpgart interface v0.1031594lb # [ 0.691798] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1595worker2 # [ 0.701880] ACPI: bus type drm_connector registered1596lb # [ 0.693118] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1597worker2 # [ 0.705192] usbcore: registered new interface driver usbserial_generic1598worker2 # [ 0.706380] usbserial: USB Serial support registered for generic1599lb # [ 0.698636] Linux agpgart interface v0.1031600worker1 # [ 0.670383] Key type asymmetric registered1601lb # [ 0.699464] ACPI: bus type drm_connector registered1602worker1 # [ 0.671062] Asymmetric key parser 'x509' registered1603worker1 # [ 0.672067] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1604worker2 # [ 0.709761] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1605worker2 # [ 0.709761] Please enable it if your BIOS has the CPPC option.1606lb # [ 0.702176] usbcore: registered new interface driver usbserial_generic1607worker1 # [ 0.674509] io scheduler mq-deadline registered1608worker2 # [ 0.712110] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1609lb # [ 0.703264] usbserial: USB Serial support registered for generic1610worker1 # [ 0.675219] io scheduler kyber registered1611worker2 # [ 0.715885] drop_monitor: Initializing network drop monitor service1612worker2 # [ 0.717130] NET: Registered PF_INET6 protocol family1613worker1 # [ 0.679336] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1614lb # [ 0.707643] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1615lb # [ 0.707643] Please enable it if your BIOS has the CPPC option.1616worker1 # [ 0.680603] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1617lb # [ 0.709842] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1618worker2 # [ 0.720246] Segment Routing with IPv61619worker2 # [ 0.722771] In-situ OAM (IOAM) with IPv61620lb # [ 0.713767] drop_monitor: Initializing network drop monitor service1621worker2 # [ 0.723847] IPI shorthand broadcast: enabled1622worker1 # [ 0.686149] Linux agpgart interface v0.1031623lb # [ 0.714988] NET: Registered PF_INET6 protocol family1624worker1 # [ 0.686927] ACPI: bus type drm_connector registered1625worker1 # [ 0.689763] usbcore: registered new interface driver usbserial_generic1626lb # [ 0.719158] Segment Routing with IPv61627worker1 # [ 0.690820] usbserial: USB Serial support registered for generic1628lb # [ 0.721629] In-situ OAM (IOAM) with IPv61629lb # [ 0.722794] IPI shorthand broadcast: enabled1630worker2 # [ 0.732199] sched_clock: Marking stable (598014431, 133719802)->(809989220, -78254987)1631worker1 # [ 0.694333] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1632worker1 # [ 0.694333] Please enable it if your BIOS has the CPPC option.1633client # [ 0.701447] Initialise system trusted keyrings1634worker1 # [ 0.696562] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1635worker1 # [ 0.699501] drop_monitor: Initializing network drop monitor service1636worker2 # [ 0.737976] registered taskstats version 11637client # [ 0.705033] workingset: timestamp_bits=40 max_order=19 bucket_order=01638worker1 # [ 0.700638] NET: Registered PF_INET6 protocol family1639worker2 # [ 0.738946] Loading compiled-in X.509 certificates1640lb # [ 0.731213] sched_clock: Marking stable (596015363, 134577457)->(808655536, -78062716)1641worker1 # [ 0.705425] Segment Routing with IPv61642worker1 # [ 0.706108] In-situ OAM (IOAM) with IPv61643worker1 # [ 0.707155] IPI shorthand broadcast: enabled1644lb # [ 0.736702] registered taskstats version 11645lb # [ 0.737817] Loading compiled-in X.509 certificates1646worker1 # [ 0.717439] sched_clock: Marking stable (584013799, 133301664)->(796223949, -78908486)1647worker1 # [ 0.718906] registered taskstats version 11648worker2 # [ 0.757751] Demotion targets for Node 0: null1649worker1 # [ 0.719845] Loading compiled-in X.509 certificates1650worker2 # [ 0.758635] Key type .fscrypt registered1651client # [ 0.726348] Key type asymmetric registered1652worker2 # [ 0.759371] Key type fscrypt-provisioning registered1653client # [ 0.727129] Asymmetric key parser 'x509' registered1654worker2 # [ 0.762861] ima: No TPM chip found, activating TPM-bypass!1655worker2 # [ 0.763836] ima: Allocated hash algorithm: sha11656client # [ 0.731068] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1657worker2 # [ 0.764614] ima: No architecture policies found1658client # [ 0.732583] io scheduler mq-deadline registered1659client # [ 0.733359] io scheduler kyber registered1660lb # [ 0.756838] Demotion targets for Node 0: null1661worker2 # [ 0.766927] PM: Magic number: 10:89:2711662worker2 # [ 0.768605] RAS: Correctable Errors collector initialized.1663lb # [ 0.759658] Key type .fscrypt registered1664lb # [ 0.760335] Key type fscrypt-provisioning registered1665client # [ 0.736539] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1666lb # [ 0.761306] ima: No TPM chip found, activating TPM-bypass!1667client # [ 0.737860] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1668lb # [ 0.765612] ima: Allocated hash algorithm: sha11669lb # [ 0.766483] ima: No architecture policies found1670worker1 # [ 0.738328] Demotion targets for Node 0: null1671client # [ 0.743632] Linux agpgart interface v0.1031672worker1 # [ 0.739160] Key type .fscrypt registered1673client # [ 0.744396] ACPI: bus type drm_connector registered1674worker1 # [ 0.739880] Key type fscrypt-provisioning registered1675lb # [ 0.768778] PM: Magic number: 10:89:2711676worker1 # [ 0.740837] ima: No TPM chip found, activating TPM-bypass!1677worker2 # [ 0.779459] clk: Disabling unused clocks1678client # [ 0.747517] usbcore: registered new interface driver usbserial_generic1679client # [ 0.748636] usbserial: USB Serial support registered for generic1680worker2 # [ 0.781748] PM: genpd: Disabling unused power domains1681lb # [ 0.772731] RAS: Correctable Errors collector initialized.1682worker1 # [ 0.745335] ima: Allocated hash algorithm: sha11683worker1 # [ 0.746122] ima: No architecture policies found1684worker1 # [ 0.747090] PM: Magic number: 10:89:2711685client # [ 0.751997] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1686client # [ 0.751997] Please enable it if your BIOS has the CPPC option.1687client # [ 0.754199] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1688worker1 # [ 0.751737] RAS: Correctable Errors collector initialized.1689lb # [ 0.781408] clk: Disabling unused clocks1690client # [ 0.758129] drop_monitor: Initializing network drop monitor service1691client # [ 0.759367] NET: Registered PF_INET6 protocol family1692lb # [ 0.783620] PM: genpd: Disabling unused power domains1693client # [ 0.762456] Segment Routing with IPv61694client # [ 0.763190] In-situ OAM (IOAM) with IPv61695client # [ 0.765264] IPI shorthand broadcast: enabled1696worker1 # [ 0.760418] clk: Disabling unused clocks1697worker1 # [ 0.761092] PM: genpd: Disabling unused power domains1698client # [ 0.773618] sched_clock: Marking stable (633014984, 139960011)->(860439517, -87464522)1699client # [ 0.778187] registered taskstats version 11700client # [ 0.779177] Loading compiled-in X.509 certificates1701client # [ 0.796996] Demotion targets for Node 0: null1702client # [ 0.799026] Key type .fscrypt registered1703client # [ 0.799723] Key type fscrypt-provisioning registered1704client # [ 0.800678] ima: No TPM chip found, activating TPM-bypass!1705client # [ 0.804994] ima: Allocated hash algorithm: sha11706client # [ 0.805784] ima: No architecture policies found1707client # [ 0.807988] PM: Magic number: 10:89:2711708client # [ 0.809664] RAS: Correctable Errors collector initialized.1709client # [ 0.819677] clk: Disabling unused clocks1710client # [ 0.822001] PM: genpd: Disabling unused power domains1711worker2 # [ 0.950620] Freeing initrd memory: 29092K1712worker2 # [ 0.953947] Freeing unused decrypted memory: 2028K1713worker2 # [ 0.956668] Freeing unused kernel image (initmem) memory: 3644K1714worker2 # [ 0.957873] Write protecting the kernel read-only data: 32768k1715worker2 # [ 0.959833] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker2 # [ 0.961440] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker1 # [ 0.928130] Freeing initrd memory: 29092K1718worker1 # [ 0.931363] Freeing unused decrypted memory: 2028K1719worker1 # [ 0.933984] Freeing unused kernel image (initmem) memory: 3644K1720worker1 # [ 0.935094] Write protecting the kernel read-only data: 32768k1721worker1 # [ 0.936986] Freeing unused kernel image (text/rodata gap) memory: 1208K1722worker1 # [ 0.938573] Freeing unused kernel image (rodata/data gap) memory: 752K1723lb # [ 0.977845] Freeing initrd memory: 29092K1724lb # [ 0.981110] Freeing unused decrypted memory: 2028K1725lb # [ 0.983822] Freeing unused kernel image (initmem) memory: 3644K1726lb # [ 0.984883] Write protecting the kernel read-only data: 32768k1727lb # [ 0.986759] Freeing unused kernel image (text/rodata gap) memory: 1208K1728lb # [ 0.988348] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker2 # [ 1.012598] x86/mm: Checked W+X mappings: passed, no W+X pages found.1730worker2 # [ 1.013706] Run /init as init process1731worker2 # [ 1.024205] systemd[1]: Inserted module 'autofs4'1732client # [ 0.993676] Freeing initrd memory: 29096K1733worker1 # [ 0.989920] x86/mm: Checked W+X mappings: passed, no W+X pages found.1734worker1 # [ 0.991034] Run /init as init process1735client # [ 0.996929] Freeing unused decrypted memory: 2028K1736client # [ 0.999698] Freeing unused kernel image (initmem) memory: 3644K1737client # [ 1.000788] Write protecting the kernel read-only data: 32768k1738client # [ 1.002720] Freeing unused kernel image (text/rodata gap) memory: 1208K1739client # [ 1.004286] Freeing unused kernel image (rodata/data gap) memory: 752K1740worker1 # [ 1.001267] systemd[1]: Inserted module 'autofs4'1741worker2 # [ 1.040589] fuse: init (API version 7.45)1742worker2 # [ 1.046337] ACPI: \_SB_.GSIG: Enabled at IRQ 221743worker2 # [ 1.048787] ACPI: \_SB_.GSIH: Enabled at IRQ 231744lb # [ 1.039358] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745lb # [ 1.040476] Run /init as init process1746worker2 # [ 1.053059] ACPI: \_SB_.GSIE: Enabled at IRQ 201747worker1 # [ 1.017611] fuse: init (API version 7.45)1748worker2 # [ 1.056067] ACPI: \_SB_.GSIF: Enabled at IRQ 211749lb # [ 1.051464] systemd[1]: Inserted module 'autofs4'1750worker1 # [ 1.023492] ACPI: \_SB_.GSIG: Enabled at IRQ 221751worker1 # [ 1.026037] ACPI: \_SB_.GSIH: Enabled at IRQ 231752worker1 # [ 1.029352] ACPI: \_SB_.GSIE: Enabled at IRQ 201753worker1 # [ 1.031742] ACPI: \_SB_.GSIF: Enabled at IRQ 211754lb # [ 1.067956] fuse: init (API version 7.45)1755lb # [ 1.073900] ACPI: \_SB_.GSIG: Enabled at IRQ 221756lb # [ 1.076271] ACPI: \_SB_.GSIH: Enabled at IRQ 231757worker2 # [ 1.087863] systemd[1]: Successfully made /usr/ read-only.1758client # [ 1.055291] x86/mm: Checked W+X mappings: passed, no W+X pages found.1759lb # [ 1.079247] ACPI: \_SB_.GSIE: Enabled at IRQ 201760client # [ 1.056398] Run /init as init process1761lb # [ 1.081516] ACPI: \_SB_.GSIF: Enabled at IRQ 211762worker1 # [ 1.058025] systemd[1]: Successfully made /usr/ read-only.1763client # [ 1.066847] systemd[1]: Inserted module 'autofs4'1764client # [ 1.083078] fuse: init (API version 7.45)1765lb # [ 1.110778] systemd[1]: Successfully made /usr/ read-only.1766client # [ 1.089015] ACPI: \_SB_.GSIG: Enabled at IRQ 221767client # [ 1.091447] ACPI: \_SB_.GSIH: Enabled at IRQ 231768client # [ 1.094855] ACPI: \_SB_.GSIE: Enabled at IRQ 201769client # [ 1.097953] ACPI: \_SB_.GSIF: Enabled at IRQ 211770client # [ 1.130113] systemd[1]: Successfully made /usr/ read-only.1771worker2 # [ 1.423897] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker2 # [ 1.428903] systemd[1]: Detected virtualization kvm.1773worker2 # [ 1.429794] systemd[1]: Detected architecture x86-64.1774worker2 # [ 1.430680] systemd[1]: Running in initrd.1775worker2 # [ 1.432033] systemd[1]: Initializing machine ID from random generator.1776worker2 # [ 1.433341] systemd[1]: Hostname set to <worker2>.1777worker1 # [ 1.394589] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker1 # [ 1.407079] systemd[1]: Detected virtualization kvm.1779worker1 # [ 1.409277] systemd[1]: Detected architecture x86-64.1780worker1 # [ 1.411611] systemd[1]: Running in initrd.1781worker1 # [ 1.414187] systemd[1]: Initializing machine ID from random generator.1782worker1 # [ 1.417177] systemd[1]: Hostname set to <worker1>.1783lb # [ 1.447514] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784lb # [ 1.459621] systemd[1]: Detected virtualization kvm.1785lb # [ 1.461704] systemd[1]: Detected architecture x86-64.1786lb # [ 1.463802] systemd[1]: Running in initrd.1787lb # [ 1.466327] systemd[1]: Initializing machine ID from random generator.1788lb # [ 1.469234] systemd[1]: Hostname set to <lb>.1789client # [ 1.466006] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790client # [ 1.472458] systemd[1]: Detected virtualization kvm.1791client # [ 1.473416] systemd[1]: Detected architecture x86-64.1792client # [ 1.474445] systemd[1]: Running in initrd.1793client # [ 1.475833] systemd[1]: Initializing machine ID from random generator.1794client # [ 1.477347] systemd[1]: Hostname set to <client>.1795worker2 # [ 1.646984] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker1 # [ 1.625992] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker2 # [ 1.700523] systemd[1]: Queued start job for default target Initrd Default Target.1798lb # [ 1.691910] systemd[1]: bpf-restrict-fs: LSM BPF program attached1799worker2 # [ 1.705146] systemd[1]: Created slice Slice /system/modprobe.1800worker2 # [ 1.706355] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801worker2 # [ 1.707837] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802worker2 # [ 1.708983] systemd[1]: Reached target Path Units.1803worker2 # [ 1.709919] systemd[1]: Reached target Slice Units.1804worker2 # [ 1.710858] systemd[1]: Reached target Swaps.1805worker2 # [ 1.711651] systemd[1]: Reached target Timer Units.1806worker2 # [ 1.712678] systemd[1]: Listening on D-Bus System Message Bus Socket.1807worker2 # [ 1.714027] systemd[1]: Listening on Journal Socket (/dev/log).1808worker2 # [ 1.715253] systemd[1]: Listening on Journal Sockets.1809worker2 # [ 1.716290] systemd[1]: Listening on udev Control Socket.1810worker2 # [ 1.717408] systemd[1]: Listening on udev Kernel Socket.1811worker2 # [ 1.718417] systemd[1]: Reached target Socket Units.1812worker1 # [ 1.680235] systemd[1]: Queued start job for default target Initrd Default Target.1813worker2 # [ 1.720407] systemd[1]: Starting Create List of Static Device Nodes...1814worker1 # [ 1.684639] systemd[1]: Created slice Slice /system/modprobe.1815worker1 # [ 1.685824] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1816worker2 # [ 1.724892] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1817worker1 # [ 1.687186] systemd[1]: Expecting device /dev/disk/by-label/nixos...1818worker1 # [ 1.688234] systemd[1]: Reached target Path Units.1819worker1 # [ 1.689121] systemd[1]: Reached target Slice Units.1820worker1 # [ 1.689992] systemd[1]: Reached target Swaps.1821worker1 # [ 1.690814] systemd[1]: Reached target Timer Units.1822worker1 # [ 1.691818] systemd[1]: Listening on D-Bus System Message Bus Socket.1823worker2 # [ 1.730529] systemd[1]: Starting Load Kernel Module configfs...1824worker1 # [ 1.693023] systemd[1]: Listening on Journal Socket (/dev/log).1825worker1 # [ 1.694212] systemd[1]: Listening on Journal Sockets.1826worker1 # [ 1.695177] systemd[1]: Listening on udev Control Socket.1827worker1 # [ 1.696175] systemd[1]: Listening on udev Kernel Socket.1828worker1 # [ 1.697080] systemd[1]: Reached target Socket Units.1829client # [ 1.702283] systemd[1]: bpf-restrict-fs: LSM BPF program attached1830worker1 # [ 1.698855] systemd[1]: Starting Create List of Static Device Nodes...1831worker1 # [ 1.703386] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1832worker1 # [ 1.710595] systemd[1]: Starting Load Kernel Module configfs...1833worker2 # [ 1.748824] systemd[1]: Starting Journal Service...1834lb # [ 1.749662] systemd[1]: Queued start job for default target Initrd Default Target.1835worker2 # [ 1.760963] systemd[1]: Starting Load Kernel Modules...1836lb # [ 1.754262] systemd[1]: Created slice Slice /system/modprobe.1837worker1 # [ 1.725938] systemd[1]: Starting Journal Service...1838lb # [ 1.755525] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1839lb # [ 1.756986] systemd[1]: Expecting device /dev/disk/by-label/nixos...1840lb # [ 1.758174] systemd[1]: Reached target Path Units.1841lb # [ 1.759080] systemd[1]: Reached target Slice Units.1842lb # [ 1.759972] systemd[1]: Reached target Swaps.1843lb # [ 1.760807] systemd[1]: Reached target Timer Units.1844lb # [ 1.762001] systemd[1]: Listening on D-Bus System Message Bus Socket.1845lb # [ 1.763232] systemd[1]: Listening on Journal Socket (/dev/log).1846lb # [ 1.764375] systemd[1]: Listening on Journal Sockets.1847lb # [ 1.765402] systemd[1]: Listening on udev Control Socket.1848lb # [ 1.766476] systemd[1]: Listening on udev Kernel Socket.1849worker1 # [ 1.738425] systemd[1]: Starting Load Kernel Modules...1850lb # [ 1.767475] systemd[1]: Reached target Socket Units.1851lb # [ 1.769501] systemd[1]: Starting Create List of Static Device Nodes...1852lb # [ 1.773516] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1853worker2 # [ 1.770827] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1854worker2 # [ 1.786578] netfs: FS-Cache loaded1855client # [ 1.756405] systemd[1]: Queued start job for default target Initrd Default Target.1856lb # [ 1.781810] systemd[1]: Starting Load Kernel Module configfs...1857worker2 # [ 1.791809] 9pnet: Installing 9P2000 support1858worker1 # [ 1.743367] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1859client # [ 1.761079] systemd[1]: Created slice Slice /system/modprobe.1860client # [ 1.762277] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1861client # [ 1.763716] systemd[1]: Expecting device /dev/disk/by-label/nixos...1862client # [ 1.764839] systemd[1]: Reached target Path Units.1863worker1 # [ 1.760723] netfs: FS-Cache loaded1864client # [ 1.765777] systemd[1]: Reached target Slice Units.1865client # [ 1.766681] systemd[1]: Reached target Swaps.1866client # [ 1.767517] systemd[1]: Reached target Timer Units.1867client # [ 1.768597] systemd[1]: Listening on D-Bus System Message Bus Socket.1868client # [ 1.769866] systemd[1]: Listening on Journal Socket (/dev/log).1869worker1 # [ 1.765377] 9pnet: Installing 9P2000 support1870worker2 # [ 1.803818] systemd[1]: Starting Coldplug All udev Devices...1871client # [ 1.771041] systemd[1]: Listening on Journal Sockets.1872client # [ 1.772045] systemd[1]: Listening on udev Control Socket.1873client # [ 1.773098] systemd[1]: Listening on udev Kernel Socket.1874client # [ 1.774093] systemd[1]: Reached target Socket Units.1875lb # [ 1.799416] systemd[1]: Starting Journal Service...1876client # [ 1.775992] systemd[1]: Starting Create List of Static Device Nodes...1877worker1 # [ 1.776410] systemd[1]: Starting Coldplug All udev Devices...1878client # [ 1.782048] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1879worker2 # [ 1.818887] systemd[1]: Finished Create List of Static Device Nodes.1880lb # [ 1.811699] systemd[1]: Starting Load Kernel Modules...1881client # [ 1.789131] systemd[1]: Starting Load Kernel Module configfs...1882worker2 # [ 1.825471] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1883worker1 # [ 1.793403] systemd[1]: Finished Create List of Static Device Nodes.1884worker2 # [ 1.834200] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1885client # [ 1.802076] systemd[1]: Starting Journal Service...1886worker1 # [ 1.798195] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1887worker2 # [ 1.840215] systemd-journald[67]: Collecting audit messages is disabled.1888worker2 # [ 1.841961] systemd[1]: modprobe@configfs.service: Deactivated successfully.1889lb # [ 1.820694] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1890worker1 # [ 1.807390] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1891lb # [ 1.836999] netfs: FS-Cache loaded1892client # [ 1.814068] systemd[1]: Starting Load Kernel Modules...1893worker2 # [ 1.849134] systemd[1]: Finished Load Kernel Module configfs.1894lb # [ 1.842461] 9pnet: Installing 9P2000 support1895worker1 # [ 1.814818] systemd[1]: modprobe@configfs.service: Deactivated successfully.1896worker2 # [ 1.853235] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1897worker1 # [ 1.816501] systemd-journald[67]: Collecting audit messages is disabled.1898worker1 # [ 1.820402] systemd[1]: Finished Load Kernel Module configfs.1899worker2 # [ 1.857811] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1900worker2 # [ 1.864768] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1901worker1 # [ 1.826868] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1902lb # [ 1.856882] systemd[1]: Starting Coldplug All udev Devices...1903client # [ 1.821092] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1904worker2 # [ 1.866548] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1905worker1 # [ 1.831893] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1906client # [ 1.842035] netfs: FS-Cache loaded1907worker1 # [ 1.839572] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1908client # [ 1.846861] 9pnet: Installing 9P2000 support1909worker1 # [ 1.841131] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1910lb # [ 1.873006] systemd[1]: Finished Create List of Static Device Nodes.1911lb # [ 1.877497] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1912client # [ 1.855204] systemd[1]: Starting Coldplug All udev Devices...1913lb # [ 1.887103] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1914worker2 # [ 1.897448] systemd[1]: Finished Load Kernel Modules.1915lb # [ 1.894065] systemd[1]: modprobe@configfs.service: Deactivated successfully.1916client # [ 1.872090] systemd[1]: Finished Create List of Static Device Nodes.1917lb # [ 1.896225] systemd-journald[67]: Collecting audit messages is disabled.1918worker2 # [ 1.906973] systemd[1]: Starting Apply Kernel Variables...1919lb # [ 1.901962] systemd[1]: Finished Load Kernel Module configfs.1920client # [ 1.878631] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1921worker1 # [ 1.875927] systemd[1]: Finished Load Kernel Modules.1922lb # [ 1.906057] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1923client # [ 1.887418] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1924lb # [ 1.911212] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1925worker2 # [ 1.921866] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1926worker1 # [ 1.884560] systemd[1]: Starting Apply Kernel Variables...1927client # [ 1.891576] systemd-journald[67]: Collecting audit messages is disabled.1928client # [ 1.893323] systemd[1]: modprobe@configfs.service: Deactivated successfully.1929lb # [ 1.918677] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1930lb # [ 1.920172] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1931worker2 # [ 1.931990] systemd[1]: Starting Create Static Device Nodes in /dev...1932worker1 # [ 1.895446] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1933client # [ 1.901370] systemd[1]: Finished Load Kernel Module configfs.1934client # [ 1.906474] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1935client # [ 1.911416] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1936worker1 # [ 1.907651] systemd[1]: Starting Create Static Device Nodes in /dev...1937client # [ 1.919013] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1938client # [ 1.921036] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1939worker2 # [ 1.955073] systemd[1]: Finished Apply Kernel Variables.1940lb # [ 1.949175] systemd[1]: Finished Load Kernel Modules.1941lb # [ 1.954782] systemd[1]: Starting Apply Kernel Variables...1942worker2 # [ 1.830445] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.965321] systemd[1]: Started Journal Service.1943worker2 # 1944worker1 # [ 1.930638] systemd[1]: Finished Apply Kernel Variables.1945worker2 # [ 1.835330] systemd-modules-load[68]: Inserted module 'virtio_balloon'1946worker2 # [ 1.836454] systemd-modules-load[68]: Inserted module 'virtio_gpu'1947worker1 # [ 1.937698] systemd[1]: Started Journal Service.1948lb # [ 1.968690] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1949worker1 # [ 1.805414] systemd-modules-load[68]: Inserted module 'dm_mod'1950worker1 # [ 1.809360] systemd-modules-load[68]: Inserted module 'virtio_balloon'1951worker1 # [ 1.810451] systemd-modules-load[68]: Inserted module 'virtio_gpu'1952worker2 # [ 1.849161] systemd[1]: Finished Create Static Device Nodes in /dev.1953client # [ 1.952605] systemd[1]: Finished Load Kernel Modules.1954worker2 # [ 1.852073] systemd[1]: Reached target Preparation for Local File Systems.1955worker2 # [ 1.853083] systemd[1]: Reached target Local File Systems.1956lb # [ 1.978790] systemd[1]: Starting Create Static Device Nodes in /dev...1957worker2 # [ 1.856063] systemd[1]: Starting Create System Files and Directories...1958worker1 # [ 1.823116] systemd[1]: Finished Create Static Device Nodes in /dev.1959client # [ 1.962405] systemd[1]: Starting Apply Kernel Variables...1960worker2 # [ 1.862081] systemd[1]: Starting Rule-based Manager for Device Events and Files...1961worker1 # [ 1.826132] systemd[1]: Reached target Preparation for Local File Systems.1962worker1 # [ 1.827175] systemd[1]: Reached target Local File Systems.1963worker1 # [ 1.830116] systemd[1]: Starting Create System Files and Directories...1964lb # [ 1.992714] systemd[1]: Finished Apply Kernel Variables.1965worker1 # [ 1.837359] systemd[1]: Starting Rule-based Manager for Device Events and Files...1966client # [ 1.980078] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1967lb # [ 2.008200] systemd[1]: Finished Create Static Device Nodes in /dev.1968client # [ 1.988686] systemd[1]: Starting Create Static Device Nodes in /dev...1969lb # [ 1.877640] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.013429] systemd[1]: Started Journal Service.1970lb # 1971lb # [ 1.880290] systemd-modules-load[68]: Inserted module 'virtio_balloon'1972lb # [ 1.881337] systemd-modules-load[68]: Inserted module 'virtio_gpu'1973lb # [ 1.884272] systemd[1]: Reached target Preparation for Local File Systems.1974worker2 # [ 1.895186] systemd[1]: Finished Create System Files and Directories.1975lb # [ 1.885450] systemd[1]: Reached target Local File Systems.1976lb # [ 1.890075] systemd[1]: Starting Create System Files and Directories...1977lb # [ 1.893519] systemd[1]: Starting Rule-based Manager for Device Events and Files...1978worker1 # [ 1.868220] systemd[1]: Finished Create System Files and Directories.1979client # [ 2.009629] systemd[1]: Finished Apply Kernel Variables.1980worker2 # [ 1.917379] systemd-udevd[83]: Using default interface naming scheme 'v261'.1981client # [ 2.021597] systemd[1]: Started Journal Service.1982client # [ 1.882612] systemd-modules-load[68]: Inserted module 'dm_mod'1983client # [ 1.886304] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984client # [ 1.887358] systemd-modules-load[68]: Inserted module 'virtio_gpu'1985worker1 # [ 1.891355] systemd-udevd[83]: Using default interface naming scheme 'v261'.1986lb # [ 1.922069] systemd[1]: Finished Create System Files and Directories.1987client # [ 1.896177] systemd[1]: Finished Create Static Device Nodes in /dev.1988client # [ 1.899906] systemd[1]: Reached target Preparation for Local File Systems.1989worker2 # [ 1.941888] systemd[1]: Started Rule-based Manager for Device Events and Files.1990client # [ 1.903070] systemd[1]: Reached target Local File Systems.1991client # [ 1.906074] systemd[1]: Starting Create System Files and Directories...1992client # [ 1.910899] systemd[1]: Starting Rule-based Manager for Device Events and Files...1993worker1 # [ 1.916972] systemd[1]: Started Rule-based Manager for Device Events and Files.1994lb # [ 1.948587] systemd-udevd[77]: Using default interface naming scheme 'v261'.1995client # [ 1.939711] systemd[1]: Finished Create System Files and Directories.1996lb # [ 1.975950] systemd[1]: Started Rule-based Manager for Device Events and Files.1997worker2 # [ 1.988871] systemd[1]: Finished Coldplug All udev Devices.1998worker2 # [ 1.991516] systemd[1]: Reached target System Initialization.1999worker2 # [ 1.992430] systemd[1]: Reached target Basic System.2000worker1 # [ 1.961881] systemd[1]: Finished Coldplug All udev Devices.
loading 1,854 hidden lines…
3855client # [ 10.990825] systemd[1]: Finished Extra networking commands..3856worker1 # [ 10.993217] systemd[1]: Finished Extra networking commands..3857client # [ 10.992734] systemd[1]: Reached target Network.3858worker1 # [ 10.994468] dhcpcd[703]: dev: loaded udev3859worker1 # [ 10.996611] systemd[1]: Reached target Network.3860client # [ 10.996132] systemd[1]: Starting Permit User Sessions...3861worker1 # [ 10.999296] systemd[1]: Starting Permit User Sessions...3862worker1 # [ 11.151781] 8021q: 802.1Q VLAN Support v1.83863worker1 # [ 11.152219] 8021q: adding VLAN 0 to HW filter on device eth13864client # [ 11.019623] systemd[1]: Finished Permit User Sessions.3865client # [ 11.023344] systemd[1]: Started Getty on tty1.3866worker2 # [ 11.063101] dhcpcd[690]: eth0: soliciting a DHCP lease3867client # [ 11.024530] systemd[1]: Reached target Login Prompts.3868worker1 # [ 11.027851] systemd[1]: Finished Permit User Sessions.3869worker1 # [ 11.032226] systemd[1]: Started Getty on tty1.3870worker1 # [ 11.032856] systemd[1]: Reached target Login Prompts.3871worker2 # [ 11.213787] NET: Registered PF_PACKET protocol family3872worker2 # [ 11.084511] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.23873worker2 # [ 11.086149] dhcpcd[690]: eth0: probing address 10.0.2.15/243874worker1 # [ 11.052066] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3875lb # [ 11.121693] dhcpcd[720]: eth0: soliciting a DHCP lease3876worker1 # [ 11.239971] cfg80211: Loading compiled-in X.509 certificates for regulatory database3877lb # [ 11.269466] NET: Registered PF_PACKET protocol family3878lb # [ 11.138474] dhcpcd[720]: eth0: offered 10.0.2.15 from 10.0.2.23879lb # [ 11.141168] dhcpcd[720]: eth0: probing address 10.0.2.15/243880worker1 # [ 11.265858] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3881worker1 # [ 11.266720] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3882worker1 # [ 11.270188] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23883worker1 # [ 11.271059] cfg80211: failed to load regulatory.db3884worker1 # [ 11.320453] 8021q: adding VLAN 0 to HW filter on device eth03885worker1 # [ 11.188570] dhcpcd[703]: eth0: waiting for carrier3886worker1 # [ 11.189414] dhcpcd[703]: eth0: carrier acquired3887worker1 # [ 11.199040] dhcpcd[703]: DUID 00:01:00:01:32:42:52:bb:52:54:00:12:34:563888worker1 # [ 11.199903] dhcpcd[703]: eth0: IAID 00:12:34:563889worker1 # [ 11.200623] dhcpcd[703]: eth0: adding address fe80::5054:ff:fe12:34563890worker1 # [ 11.440526] dhcpcd[703]: eth0: soliciting a DHCP lease3891worker1 # [ 11.596898] NET: Registered PF_PACKET protocol family3892worker1 # [ 11.469951] dhcpcd[703]: eth0: offered 10.0.2.15 from 10.0.2.23893worker1 # [ 11.474357] dhcpcd[703]: eth0: probing address 10.0.2.15/243894worker1: (finished: waiting for unit network-addresses-eth1.service, in 1.24 seconds)3895worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3896worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3897worker2: waiting for unit network-addresses-eth1.service3898worker2: waiting for the VM to finish booting3899worker2: Guest shell says: b'Spawning backdoor root shell...\n'3900worker2: connected to guest root shell3901worker2: (connecting took 0.00 seconds)3902worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3903worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3904worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3905worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds)3906lb: waiting for unit niks3.service3907client # [ 12.095499] dhcpcd[565]: eth0: soliciting an IPv6 router3908client # [ 12.096854] dhcpcd[565]: eth0: Router Advertisement from fe80::23909client # [ 12.097700] dhcpcd[565]: eth0: adding address fec0::5054:ff:fe12:3456/643910client # [ 12.098577] dhcpcd[565]: eth0: adding route to fec0::/643911client # [ 12.099336] dhcpcd[565]: eth0: adding default route via fe80::23912worker2 # [ 12.277755] dhcpcd[690]: eth0: soliciting an IPv6 router3913worker2 # [ 12.279199] dhcpcd[690]: eth0: Router Advertisement from fe80::23914worker2 # [ 12.280073] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/643915worker2 # [ 12.280986] dhcpcd[690]: eth0: adding route to fec0::/643916worker2 # [ 12.281871] dhcpcd[690]: eth0: adding default route via fe80::23917lb # [ 12.349107] dhcpcd[720]: eth0: soliciting an IPv6 router3918lb # [ 12.350799] dhcpcd[720]: eth0: Router Advertisement from fe80::23919lb # [ 12.351717] dhcpcd[720]: eth0: adding address fec0::5054:ff:fe12:3456/643920lb # [ 12.354492] dhcpcd[720]: eth0: adding route to fec0::/643921lb # [ 12.355316] dhcpcd[720]: eth0: adding default route via fe80::23922lb # [ 12.370592] postgresql-pre-start[734]: selecting default time zone ... UTC3923lb # [ 12.374458] postgresql-pre-start[734]: creating configuration files ... ok3924lb # [ 12.611870] postgresql-pre-start[734]: running bootstrap script ... ok3925lb # [ 13.159134] postgresql-pre-start[734]: performing post-bootstrap initialization ... ok3926lb # [ 13.303859] postgresql-pre-start[734]: syncing data to disk ... ok3927lb # [ 13.305767] postgresql-pre-start[734]: initdb: warning: enabling "trust" authentication for local connections3928lb # [ 13.307219] postgresql-pre-start[734]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3929lb # [ 13.309385] postgresql-pre-start[734]: Success. You can now start the database server using:3930lb # [ 13.310623] postgresql-pre-start[734]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3931lb # [ 13.431537] postgres[794]: [794] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3932lb # [ 13.436547] postgres[794]: [794] LOG: listening on IPv6 address "::1", port 54323933lb # [ 13.437801] postgres[794]: [794] LOG: listening on IPv4 address "127.0.0.1", port 54323934lb # [ 13.439917] postgres[794]: [794] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3935lb # [ 13.452858] postgres[803]: [803] LOG: database system was shut down at 2026-09-20 08:15:56 GMT3936lb # [ 13.459060] postgres[794]: [794] LOG: database system is ready to accept connections3937lb # [ 13.465335] systemd[1]: Started PostgreSQL Server.3938lb # [ 13.470207] systemd[1]: Starting PostgreSQL Setup Scripts...3939worker1 # [ 13.568794] dhcpcd[703]: eth0: soliciting an IPv6 router3940worker1 # [ 13.571646] dhcpcd[703]: eth0: Router Advertisement from fe80::23941worker1 # [ 13.573773] dhcpcd[703]: eth0: adding address fec0::5054:ff:fe12:3456/643942worker1 # [ 13.576107] dhcpcd[703]: eth0: adding route to fec0::/643943worker1 # [ 13.578076] dhcpcd[703]: eth0: adding default route via fe80::23944lb # [ 14.154325] postgresql-setup-start[819]: CREATE DATABASE3945lb # [ 14.200636] postgresql-setup-start[824]: CREATE ROLE3946lb # [ 14.225036] postgresql-setup-start[826]: ALTER DATABASE3947lb # [ 14.230853] systemd[1]: Finished PostgreSQL Setup Scripts.3948lb # [ 14.232659] systemd[1]: Reached target PostgreSQL.3949client # [ 15.718242] dhcpcd[565]: eth0: leased 10.0.2.15 for 86400 seconds3950client # [ 15.720847] dhcpcd[565]: eth0: adding route to 10.0.2.0/243951client # [ 15.722914] dhcpcd[565]: eth0: adding default route via 10.0.2.23952client # [ 15.836606] systemd[1]: Started DHCP Client.3953client # [ 15.839669] systemd[1]: Reached target Multi-User System.3954client # [ 15.840697] systemd[1]: Startup finished in 919ms (kernel) + 4.085s (initrd) + 10.834s (userspace) = 15.840s.3955worker2 # [ 16.214782] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds3956worker2 # [ 16.218193] dhcpcd[690]: eth0: adding route to 10.0.2.0/243957worker2 # [ 16.220261] dhcpcd[690]: eth0: adding default route via 10.0.2.23958worker2 # [ 16.323770] systemd[1]: Started DHCP Client.3959worker2 # [ 16.325398] systemd[1]: Reached target Multi-User System.3960worker2 # [ 16.326296] systemd[1]: Startup finished in 883ms (kernel) + 4.059s (initrd) + 11.382s (userspace) = 16.324s.3961worker1 # [ 16.529206] dhcpcd[703]: eth0: leased 10.0.2.15 for 86400 seconds3962worker1 # [ 16.530356] dhcpcd[703]: eth0: adding route to 10.0.2.0/243963worker1 # [ 16.531336] dhcpcd[703]: eth0: adding default route via 10.0.2.23964worker1 # [ 16.626673] systemd[1]: Started DHCP Client.3965worker1 # [ 16.628516] systemd[1]: Reached target Multi-User System.3966worker1 # [ 16.629524] systemd[1]: Startup finished in 861ms (kernel) + 4.934s (initrd) + 10.832s (userspace) = 16.628s.3967lb # [ 16.816596] dhcpcd[720]: eth0: leased 10.0.2.15 for 86400 seconds3968lb # [ 16.817485] dhcpcd[720]: eth0: adding route to 10.0.2.0/243969lb # [ 16.818174] dhcpcd[720]: eth0: adding default route via 10.0.2.23970lb # [ 16.900658] systemd[1]: Started DHCP Client.3971lb # [ 16.902703] systemd[1]: Reached target Network is Online.3972lb # [ 16.906386] systemd[1]: Started Envoy reverse proxy.3973lb # [ 16.909729] systemd[1]: Started mock-oidc.service.3974lb # [ 16.998814] mock-oidc-server[913]: Mock OIDC Server running3975lb # [ 16.999861] mock-oidc-server[913]: OIDC Address: 192.168.1.2:80803976lb # [ 17.000979] mock-oidc-server[913]: Issue Address: 0.0.0.0:80813977lb # [ 17.002066] mock-oidc-server[913]: Issuer: http://192.168.1.2:8080/oidc3978lb # [ 17.003150] mock-oidc-server[913]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3979lb # [ 17.004458] mock-oidc-server[913]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3980lb # [ 17.005742] mock-oidc-server[913]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3981lb # [ 17.429820] envoy[912]: [2026-09-20 08:16:01.262][912][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3982lb # [ 17.431545] envoy[912]: [2026-09-20 08:16:01.263][912][info][main] [source/server/server.cc:469] statically linked extensions:3983lb # [ 17.433251] envoy[912]: [2026-09-20 08:16:01.263][912][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3984lb # [ 17.435373] envoy[912]: [2026-09-20 08:16:01.263][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13985lb # [ 17.437250] envoy[912]: [2026-09-20 08:16:01.263][912][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3986lb # [ 17.449943] envoy[912]: [2026-09-20 08:16:01.263][912][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3987lb # [ 17.451878] envoy[912]: [2026-09-20 08:16:01.263][912][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3988lb # [ 17.454291] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3989lb # [ 17.458717] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3990lb # [ 17.462848] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3991lb # [ 17.464462] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3992lb # [ 17.466192] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3993lb # [ 17.468833] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3994lb # [ 17.470373] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3995lb # [ 17.472104] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3996lb # [ 17.474645] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3997lb # [ 17.476830] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3998lb # [ 17.480073] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3999lb # [ 17.482097] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4000lb # [ 17.484459] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4001lb # [ 17.486539] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4002lb # [ 17.488101] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4003lb # [ 17.492694] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4004lb # [ 17.496330] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4005lb # [ 17.498369] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4006lb # [ 17.502252] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4007lb # [ 17.503922] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4008lb # [ 17.506962] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4009lb # [ 17.509247] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4010lb # [ 17.511985] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4011lb # [ 17.513902] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4012lb # [ 17.515706] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4013lb # [ 17.520591] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4014lb # [ 17.522404] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4015lb # [ 17.527299] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4016lb # [ 17.528907] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4017lb # [ 17.530659] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4018lb # [ 17.532933] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4019lb # [ 17.538194] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4020lb # [ 17.539663] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4021lb # [ 17.542256] envoy[912]: [2026-09-20 08:16:01.266][912][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4022lb # [ 17.545546] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4023lb # [ 17.548936] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4024lb # [ 17.573666] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4025lb # [ 17.575441] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4026lb # [ 17.577623] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4027lb # [ 17.580333] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4028lb # [ 17.591559] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4029lb # [ 17.593524] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4030lb # [ 17.596476] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4031lb # [ 17.600665] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4032lb # [ 17.602459] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24033lb # [ 17.604648] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4034lb # [ 17.606777] envoy[912]: [2026-09-20 08:16:01.268][912][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4035lb # [ 17.608657] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4036lb # [ 17.611379] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4037lb # [ 17.613777] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4038lb # [ 17.616397] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4039lb # [ 17.618155] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4040lb # [ 17.621107] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4041lb # [ 17.623368] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24042lb # [ 17.625113] envoy[912]: [2026-09-20 08:16:01.276][912][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4043lb # [ 17.627172] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4044lb # [ 17.629505] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4045lb # [ 17.632092] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24046lb # [ 17.634104] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4047lb # [ 17.636223] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84048lb # [ 17.639110] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4049lb # [ 17.641874] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4050lb # [ 17.644146] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4051lb # [ 17.649949] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4052lb # [ 17.651568] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4053lb # [ 17.652928] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4054lb # [ 17.655282] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4055lb # [ 17.661420] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4056lb # [ 17.663894] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4057lb # [ 17.665960] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4058lb # [ 17.668310] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4059lb # [ 17.671097] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4060lb # [ 17.676207] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4061lb # [ 17.682129] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4062lb # [ 17.683669] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4063lb # [ 17.685385] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4064lb # [ 17.687390] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4065lb # [ 17.689138] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4066lb # [ 17.692040] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4067lb # [ 17.700848] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4068lb # [ 17.703465] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4069lb # [ 17.705601] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4070lb # [ 17.707503] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4071lb # [ 17.709630] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4072lb # [ 17.711464] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4073lb # [ 17.714176] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4074lb # [ 17.718560] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4075lb # [ 17.720525] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4076lb # [ 17.723044] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4077lb # [ 17.725722] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4078lb # [ 17.732540] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4079lb # [ 17.735617] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4080lb # [ 17.737695] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4081lb # [ 17.739961] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4082lb # [ 17.743082] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4083lb # [ 17.745092] envoy[912]: [2026-09-20 08:16:01.277][912][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4084lb # [ 17.747649] envoy[912]: [2026-09-20 08:16:01.278][912][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4085lb # [ 17.749377] envoy[912]: [2026-09-20 08:16:01.278][912][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4086lb # [ 17.751698] envoy[912]: [2026-09-20 08:16:01.278][912][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4087lb # [ 17.753453] envoy[912]: [2026-09-20 08:16:01.408][912][info][main] [source/server/server.cc:531] HTTP header map info:4088lb # [ 17.755154] envoy[912]: [2026-09-20 08:16:01.456][912][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4089lb # [ 17.768367] envoy[912]: [2026-09-20 08:16:01.456][912][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4090lb # [ 17.770132] envoy[912]: [2026-09-20 08:16:01.456][912][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4091lb # [ 17.777681] envoy[912]: [2026-09-20 08:16:01.456][912][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4092lb # [ 17.821151] envoy[912]: [2026-09-20 08:16:01.654][912][info][main] [source/server/server.cc:968] runtime: {}4093lb # [ 17.828699] envoy[912]: [2026-09-20 08:16:01.662][912][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4094lb # [ 17.831118] envoy[912]: [2026-09-20 08:16:01.664][912][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014095lb # [ 17.834543] envoy[912]: [2026-09-20 08:16:01.668][912][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014096lb # [ 17.838116] envoy[912]: [2026-09-20 08:16:01.671][912][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4097lb # [ 17.840099] envoy[912]: [2026-09-20 08:16:01.673][912][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4098lb # [ 17.841690] envoy[912]: [2026-09-20 08:16:01.673][912][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4099worker1 # [ 17.864727] systemd[1]: Starting Nix worker-protocol over gRPC...4100lb # [ 17.892473] envoy[912]: [2026-09-20 08:16:01.725][912][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4101worker2 # [ 17.907818] systemd[1]: Starting Nix worker-protocol over gRPC...4102lb # [ 17.913505] envoy[912]: [2026-09-20 08:16:01.746][912][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4103lb # [ 17.916263] envoy[912]: [2026-09-20 08:16:01.749][912][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4104lb # [ 17.919243] envoy[912]: [2026-09-20 08:16:01.749][912][info][main] [source/server/server.cc:1077] starting main dispatch loop4105worker1 # [ 18.053621] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4106worker1 # [ 18.067531] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14107worker2 # [ 18.112069] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4108worker2 # [ 18.124164] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14109worker1 # [ 18.105683] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4110worker1 # [ 18.108823] systemd[1]: Started Nix worker-protocol over gRPC.4111worker2 # [ 18.164881] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4112worker2 # [ 18.167890] systemd[1]: Started Nix worker-protocol over gRPC.4113lb # [ 18.188975] envoy[912]: [2026-09-20 08:16:02.022][912][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4114lb # [ 18.193699] envoy[912]: [2026-09-20 08:16:02.022][912][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4115lb # [ 18.198511] envoy[912]: [2026-09-20 08:16:02.022][912][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4116lb # [ 18.203190] envoy[912]: [2026-09-20 08:16:02.026][912][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4117worker1 # [ 18.200988] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514118worker2 # [ 18.240843] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514119worker1 # [ 18.223529] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4120worker2 # [ 18.261405] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4121worker1 # [ 18.424255] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514122worker2 # [ 18.464473] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514123worker1 # [ 18.428721] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4124worker2 # [ 18.468729] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4125worker1 # [ 18.629032] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514126worker2 # [ 18.668852] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514127worker1 # [ 18.632293] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4128worker2 # [ 18.672479] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4129worker1 # [ 18.832935] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 18.836269] nix-grpc-daemon[794]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4131worker2 # [ 18.874260] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514132worker2 # [ 18.878234] nix-grpc-daemon[784]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4133worker1 # [ 19.037492] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 19.078402] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514135worker2 # [ 19.080530] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker1 # [ 19.042727] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4137worker1 # [ 19.242677] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514138worker2 # [ 19.281933] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514139worker1 # [ 19.245087] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker2 # [ 19.283847] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4141worker1 # [ 19.445749] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514142worker2 # [ 19.484639] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514143worker1 # [ 19.451804] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker2 # [ 19.489148] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4145worker2 # [ 19.689821] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514146worker1 # [ 19.653734] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 19.693341] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 19.657763] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4149worker2 # [ 19.893582] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514150worker2 # [ 19.896071] nix-grpc-daemon[784]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4151worker1 # [ 19.859552] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514152worker1 # [ 19.863293] nix-grpc-daemon[794]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4153worker1 # [ 20.061325] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514154worker2 # [ 20.099139] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514155worker1 # [ 20.066158] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker2 # [ 20.104132] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4157worker2 # [ 20.304819] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514158worker1 # [ 20.267818] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 20.309897] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 20.272543] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4161worker1 # [ 20.472986] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514162worker2 # [ 20.511058] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514163worker1 # [ 20.478306] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker2 # [ 20.515977] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4165worker1 # [ 20.678917] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514166worker2 # [ 20.716528] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514167worker1 # [ 20.681762] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker2 # [ 20.721937] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4169worker1 # [ 20.882442] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514170worker2 # [ 20.922495] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514171worker1 # [ 20.885938] nix-grpc-daemon[794]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker2 # [ 20.924454] nix-grpc-daemon[784]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4173worker1 # [ 21.087414] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514174worker2 # [ 21.125229] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514175worker1 # [ 21.093172] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker2 # [ 21.130882] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4177worker1 # [ 21.294912] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514178worker2 # [ 21.332844] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 21.338492] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 21.300401] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4181worker1 # [ 21.501578] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514182worker2 # [ 21.539696] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514183worker1 # [ 21.506938] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker2 # [ 21.544674] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4185worker1 # [ 21.707850] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514186worker2 # [ 21.745362] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514187worker1 # [ 21.712791] nix-grpc-daemon[794]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker2 # [ 21.750470] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4189worker2 # [ 21.951188] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 21.913962] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 21.954324] nix-grpc-daemon[784]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 21.919256] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4193worker2 # [ 22.155571] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 22.119843] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 22.160639] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 22.124707] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4197worker2 # [ 22.362910] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514198worker2 # [ 22.368839] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4199worker1 # [ 22.332954] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514200worker1 # [ 22.336353] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4201worker2 # [ 22.570172] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 22.533906] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 22.575447] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 22.539301] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4205worker2 # [ 22.776474] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 22.741179] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 22.781943] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 22.745218] nix-grpc-daemon[794]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4209worker1 # [ 22.942560] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514210worker2 # [ 22.983243] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 22.944950] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker2 # [ 22.985850] nix-grpc-daemon[784]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4213worker1 # [ 23.146234] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514214worker2 # [ 23.186532] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514215worker1 # [ 23.152118] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker2 # [ 23.190587] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4217worker1 # [ 23.353674] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514218worker2 # [ 23.393550] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514219worker1 # [ 23.358864] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker2 # [ 23.397635] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4221worker1 # [ 23.560066] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514222worker2 # [ 23.598546] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514223worker1 # [ 23.566333] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker2 # [ 23.603957] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4225worker1 # [ 23.766960] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514226worker2 # [ 23.804884] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514227worker1 # [ 23.772405] nix-grpc-daemon[794]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker2 # [ 23.810497] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4229worker1 # [ 23.973380] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514230worker2 # [ 24.011132] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514231worker1 # [ 23.976332] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker2 # [ 24.016776] nix-grpc-daemon[784]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4233worker1 # [ 24.176909] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 24.179324] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235worker2 # [ 24.217880] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514236worker2 # [ 24.221856] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4237worker1 # [ 24.381268] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514238worker2 # [ 24.423339] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514239worker1 # [ 24.386419] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker2 # [ 24.427374] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4241worker1 # [ 24.587130] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514242worker2 # [ 24.628248] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514243worker1 # [ 24.592256] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker2 # [ 24.632371] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4245worker1 # [ 24.792244] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514246worker2 # [ 24.832656] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514247worker2 # [ 24.835102] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 24.797895] nix-grpc-daemon[794]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4249worker1 # [ 24.998606] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514250worker2 # [ 25.036364] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514251worker2 # [ 25.041792] nix-grpc-daemon[784]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker1 # [ 25.004243] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4253worker1 # [ 25.205440] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514254worker2 # [ 25.243948] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514255worker1 # [ 25.210695] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker2 # [ 25.249337] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4257worker2 # [ 25.450412] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 25.412468] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514259worker2 # [ 25.455154] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker1 # [ 25.417859] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4261worker2 # [ 25.656098] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514262worker1 # [ 25.618677] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514263worker1 # [ 25.621925] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker2 # [ 25.659465] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4265worker2 # [ 25.860865] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 25.823440] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514267worker1 # [ 25.829429] nix-grpc-daemon[794]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker2 # [ 25.866821] nix-grpc-daemon[784]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4269worker2 # [ 26.067611] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 26.030585] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514271worker2 # [ 26.070644] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker1 # [ 26.033870] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4273worker2 # [ 26.271269] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514274worker2 # [ 26.274502] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4275worker1 # [ 26.235137] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514276worker1 # [ 26.240788] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4277worker2 # [ 26.477784] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514278worker2 # [ 26.482087] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4279worker1 # [ 26.445227] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514280worker1 # [ 26.448479] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4281worker2 # [ 26.682524] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514282worker2 # [ 26.685538] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4283worker1 # [ 26.647596] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514284worker1 # [ 26.651671] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4285worker2 # [ 26.886380] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514286worker2 # [ 26.889341] nix-grpc-daemon[784]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287worker1 # [ 26.850449] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_connected addr=lb:500514288worker1 # [ 26.856706] nix-grpc-daemon[794]: ts=2026-09-20T08:16:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4289worker2 # [ 27.090513] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514290worker1 # [ 27.057361] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514291worker2 # [ 27.095825] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4292worker1 # [ 27.062933] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4293worker2 # [ 27.296750] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514294worker2 # [ 27.301767] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4295worker1 # [ 27.265521] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514296worker1 # [ 27.268763] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4297worker2 # [ 27.503225] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514298worker2 # [ 27.507121] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4299worker1 # [ 27.470164] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514300worker1 # [ 27.473482] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4301worker2 # [ 27.707871] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514302worker1 # [ 27.671980] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514303worker2 # [ 27.711202] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304worker1 # [ 27.676215] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4305worker2 # [ 27.912117] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514306worker2 # [ 27.915453] nix-grpc-daemon[784]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4307worker1 # [ 27.877408] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_connected addr=lb:500514308worker1 # [ 27.882912] nix-grpc-daemon[794]: ts=2026-09-20T08:16:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4309worker2 # [ 28.116733] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514310worker2 # [ 28.119881] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4311worker1 # [ 28.083664] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514312worker1 # [ 28.086696] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4313worker2 # [ 28.320564] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514314worker2 # [ 28.323103] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4315worker1 # [ 28.289434] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514316worker1 # [ 28.293668] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4317worker2 # [ 28.524481] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514318worker2 # [ 28.526959] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4319worker1 # [ 28.494370] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514320worker1 # [ 28.497704] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4321worker2 # [ 28.727820] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514322worker2 # [ 28.730509] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4323worker1 # [ 28.693989] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514324worker1 # [ 28.697457] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4325worker2 # [ 28.931298] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514326worker2 # [ 28.933774] nix-grpc-daemon[784]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4327worker1 # [ 28.899745] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_connected addr=lb:500514328worker1 # [ 28.902248] nix-grpc-daemon[794]: ts=2026-09-20T08:16:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4329worker2 # [ 29.135152] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514330worker1 # [ 29.101820] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514331worker2 # [ 29.140940] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4332worker1 # [ 29.108138] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4333worker2 # [ 29.342210] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514334worker1 # [ 29.309493] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514335worker2 # [ 29.347290] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4336worker1 # [ 29.314673] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4337worker2 # [ 29.548487] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514338worker2 # [ 29.551347] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4339worker1 # [ 29.516882] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514340worker1 # [ 29.519382] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4341worker2 # [ 29.752592] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514342worker1 # [ 29.721249] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514343worker2 # [ 29.759425] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4344worker1 # [ 29.727647] nix-grpc-daemon[794]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4345worker2 # [ 29.960890] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_connected addr=lb:500514346worker1 # [ 29.929174] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514347worker2 # [ 29.966386] nix-grpc-daemon[784]: ts=2026-09-20T08:16:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4348worker1 # [ 29.935692] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4349worker2 # [ 30.167225] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514350worker2 # [ 30.170108] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4351worker1 # [ 30.138289] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514352worker1 # [ 30.141551] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4353worker2 # [ 30.372756] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514354worker2 # [ 30.375688] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4355worker1 # [ 30.340624] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514356worker1 # [ 30.345252] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4357lb # [ 30.480354] rustfs-bucket-start[1041]: mb s3://farm4358lb # [ 30.485741] systemd[1]: Finished rustfs-bucket.service.4359lb # [ 30.493127] systemd[1]: Starting niks3 server...4360worker2 # [ 30.579895] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514361worker2 # [ 30.583221] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4362worker1 # [ 30.549566] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514363worker1 # [ 30.552921] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4364lb # [ 30.713260] postgres[1057]: [1057] ERROR: relation "goose_db_version" does not exist at character 364365lb # [ 30.714493] postgres[1057]: [1057] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4366lb # [ 30.751766] niks3-server[1051]: 2026/09/20 08:16:14 OK 20241026095416_initial_model.sql (20.57ms)4367lb # [ 30.754874] niks3-server[1051]: 2026/09/20 08:16:14 OK 20251210153512_drop_unused_gin_index.sql (3.33ms)4368lb # [ 30.760303] niks3-server[1051]: 2026/09/20 08:16:14 OK 20251218171726_add_pins.sql (4.07ms)4369lb # [ 30.765374] niks3-server[1051]: 2026/09/20 08:16:14 OK 20260628120000_add_object_size_and_stats.sql (5.13ms)4370lb # [ 30.770506] niks3-server[1051]: 2026/09/20 08:16:14 OK 20260905000000_add_claims.sql (3.75ms)4371worker2 # [ 30.781181] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514372lb # [ 30.775827] niks3-server[1051]: 2026/09/20 08:16:14 OK 20260920000000_drop_claims.sql (5.23ms)4373lb # [ 30.776977] niks3-server[1051]: 2026/09/20 08:16:14 goose: successfully migrated database to version: 202609200000004374worker1 # [ 30.750315] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514375worker2 # [ 30.790637] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4376lb # [ 30.785626] niks3-server[1051]: 2026/09/20 08:16:14 OK 1_commit_pending_closure.sql (9.73ms)4377worker1 # [ 30.757112] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4378lb # [ 30.788759] niks3-server[1051]: 2026/09/20 08:16:14 OK 2_object_stats_trigger.sql (3.18ms)4379lb # [ 30.790160] niks3-server[1051]: 2026/09/20 08:16:14 goose: up to current file version: 24380lb # [ 30.797775] niks3-server[1051]: 2026/09/20 08:16:14 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4381lb # [ 30.880274] niks3-server[1051]: 2026/09/20 08:16:14 INFO Read proxy enabled — serving cache objects from S34382lb # [ 30.882504] niks3-server[1051]: 2026/09/20 08:16:14 INFO Using socket-activated listener address=0.0.0.0:57514383lb # [ 30.886212] niks3-server[1051]: 2026/09/20 08:16:14 INFO systemd watchdog enabled interval=15s4384lb # [ 30.888319] systemd[1]: Started niks3 server.4385lb # [ 30.888967] systemd[1]: Reached target Multi-User System.4386lb # [ 30.891748] systemd[1]: Startup finished in 909ms (kernel) + 4.156s (initrd) + 25.825s (userspace) = 30.891s.4387lb # [ 30.893925] niks3-server[1051]: 2026/09/20 08:16:14 INFO Starting HTTP server address=0.0.0.0:57514388lb # [ 30.901099] niks3-server[1051]: 2026/09/20 08:16:14 INFO lead: acquired remote=192.168.1.3:606724389worker1 # [ 30.881924] nix-grpc-daemon[794]: ts=2026-09-20T08:16:14Z level=info event=scheduler_take_over4390worker2 # [ 30.991870] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_connected addr=lb:500514391worker1 # [ 30.958992] nix-grpc-daemon[794]: ts=2026-09-20T08:16:15Z level=info event=scheduler_connected addr=lb:500514392worker2 # [ 30.997920] nix-grpc-daemon[784]: ts=2026-09-20T08:16:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4393worker1 # [ 30.964692] nix-grpc-daemon[794]: ts=2026-09-20T08:16:15Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04394worker2 # [ 31.198846] nix-grpc-daemon[784]: ts=2026-09-20T08:16:15Z level=info event=scheduler_connected addr=lb:500514395worker2 # [ 31.204829] nix-grpc-daemon[784]: ts=2026-09-20T08:16:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4396worker2 # [ 31.405614] nix-grpc-daemon[784]: ts=2026-09-20T08:16:15Z level=info event=scheduler_connected addr=lb:500514397worker1 # [ 31.369887] nix-grpc-daemon[794]: ts=2026-09-20T08:16:15Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04398lb: (finished: waiting for unit niks3.service, in 19.80 seconds)4399lb: waiting for TCP port 5751 on localhost4400lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4401lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds)4402lb: waiting for unit envoy.service4403lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4404lb: waiting for TCP port 50051 on localhost4405lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4406lb # [ 32.012141] envoy[912]: conn peer=[::1]:43286 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24407lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4408lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4409??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4410 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284411lb: must succeed: curl -sf localhost:9901/clusters4412lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4413lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4414subtest: one node schedules and both builders hold a WorkerSession on it4415lb: must succeed: curl -sf localhost:9901/clusters4416lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4417worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4418worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4419(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.13 seconds)4420subtest: balancer auth: client cert, bearer token, nothing, unknown CN4421worker2 # [ 32.690317] nix-grpc-daemon[784]: ts=2026-09-20T08:16:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425964422worker2 # [ 32.696817] systemd[1]: Started Nix Daemon.4423worker2 # [ 32.917788] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4424worker2 # [ 32.974137] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 1/5)4425worker2 # [ 33.038462] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 149 ms (attempt 2/5)4426worker2 # [ 33.192549] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 3/5)4427worker2 # [ 33.475235] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 752 ms (attempt 4/5)4428worker2 # [ 34.237169] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4429worker1 # [ 34.240748] nix-grpc-daemon[794]: ts=2026-09-20T08:16:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352004430worker1 # [ 34.255274] systemd[1]: Started Nix Daemon.4431worker1 # [ 34.479213] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4432worker1 # [ 34.509893] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 1/5)4433worker1 # [ 34.598444] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 196 ms (attempt 2/5)4434worker1 # [ 34.797494] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 3/5)4435worker1 # [ 34.815394] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 4/5)4436worker1 # [ 35.159940] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4437worker1 # [ 35.172738] nix-grpc-daemon[794]: ts=2026-09-20T08:16:19Z level=debug event=path_info_miss path=v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test error="error: path '/nix/store/v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test' is required, but there is no substituter that can build it"4438worker2 # [ 35.217360] nix-grpc-daemon[784]: ts=2026-09-20T08:16:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425964439worker2 # [ 35.234656] nix-grpc-daemon[784]: ts=2026-09-20T08:16:19Z level=debug event=path_info_miss path=v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test error="error: path '/nix/store/v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test' is required, but there is no substituter that can build it"4440client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4441client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4442client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4443client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4444worker1 # [ 35.563299] nix-grpc-daemon[794]: ts=2026-09-20T08:16:19Z level=info event=oidc_jwks provider=mock keys=14445worker1 # [ 35.565234] nix-grpc-daemon[794]: ts=2026-09-20T08:16:19Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:352004446worker1 # [ 35.578554] nix-grpc-daemon[794]: ts=2026-09-20T08:16:19Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:352004447worker1 # [ 35.583699] nix-grpc-daemon[794]: ts=2026-09-20T08:16:19Z level=debug event=path_info_miss path=v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test error="error: path '/nix/store/v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test' is required, but there is no substituter that can build it"4448worker1 # [ 35.588956] nix-grpc-daemon[794]: ts=2026-09-20T08:16:19Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:352004449worker1 # [ 35.594238] nix-grpc-daemon[794]: ts=2026-09-20T08:16:19Z level=debug event=path_info_miss path=v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test error="error: path '/nix/store/v1xv4p4x02a7zqq7wy65xh7iml1c1agv-nixos-system-client-test' is required, but there is no substituter that can build it"4450client: must succeed: rm -r /var/lib/nix-grpc-store4451client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4452worker1 # [ 37.817848] nix-grpc-daemon[794]: ts=2026-09-20T08:16:21Z level=info event=denied method=QueryMissing cn=- role=none4453lb # [ 37.901249] envoy[912]: conn peer=[2001:db8:1::1]:33506 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=25924454lb # [ 37.905114] envoy[912]: conn peer=[2001:db8:1::1]:35394 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=360 ms=604455lb # [ 37.908393] envoy[912]: conn peer=[2001:db8:1::1]:35410 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94456worker2 # [ 38.044677] nix-grpc-daemon[784]: ts=2026-09-20T08:16:21Z level=info event=denied method=QueryMissing cn=stranger role=none4457(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.66 seconds)4458subtest: DAG build is scheduled across workers and lands in the cache4459client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24460worker1 # [ 38.226476] nix-grpc-daemon[794]: ts=2026-09-20T08:16:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:352004461client # don't know how to build these paths:4462client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4463worker1 # [ 38.250036] nix-grpc-daemon[794]: ts=2026-09-20T08:16:22Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04464worker1 # [ 38.251766] nix-grpc-daemon[794]: ts=2026-09-20T08:16:22Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14465worker1 # [ 38.301426] nix-grpc-daemon[794]: ts=2026-09-20T08:16:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004466worker1 # [ 38.317795] nix-grpc-daemon[794]: ts=2026-09-20T08:16:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004467client # copying 1 paths to 'lb:50051'...4468worker1 # [ 38.327895] nix-grpc-daemon[794]: ts=2026-09-20T08:16:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352004469client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4470worker1 # [ 38.354301] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4471worker1 # [ 38.382138] nix-grpc-daemon[794]: ts=2026-09-20T08:16:22Z level=info event=niks3_push_started pid=8704472worker1 # [ 38.809092] nix-daemon[858]: accepted connection from pid 881, user nix-grpc-daemon (trusted)4473worker1 # [ 38.823121] nix-daemon[858]: reaped child process 885, status = succeeded4474worker1 # [ 38.947025] nix-daemon[858]: accepted connection from pid 887, user nix-grpc-daemon (trusted)4475worker1 # [ 38.958806] nix-daemon[858]: reaped child process 890, status = succeeded4476lb # [ 39.001458] niks3-server[1051]: 2026/09/20 08:16:22 INFO Received uploads request method=POST path=/api/pending_closures4477worker1 # [ 38.994027] nix-grpc-daemon[870]: time=2026-09-20T08:16:23.089Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4478worker1 # [ 38.996849] nix-grpc-daemon[870]: time=2026-09-20T08:16:23.092Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4479lb # [ 39.054623] niks3-server[1051]: 2026/09/20 08:16:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4480lb # [ 39.061090] niks3-server[1051]: 2026/09/20 08:16:22 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4481lb # [ 39.086884] niks3-server[1051]: 2026/09/20 08:16:22 INFO Signed narinfos id=1 count=14482worker1 # [ 39.061510] nix-grpc-daemon[870]: time=2026-09-20T08:16:23.157Z level=INFO msg="Uploading 1 narinfos"4483lb # [ 39.107371] niks3-server[1051]: 2026/09/20 08:16:22 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4484lb # [ 39.110052] niks3-server[1051]: 2026/09/20 08:16:22 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4485lb # [ 39.121211] niks3-server[1051]: 2026/09/20 08:16:22 INFO Completed upload id=14486worker1 # [ 39.094333] nix-grpc-daemon[870]: time=2026-09-20T08:16:23.190Z level=INFO msg="Upload complete. (441ms)"4487lb # [ 39.128862] niks3-server[1051]: 2026/09/20 08:16:22 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4488worker1 # [ 39.099352] nix-grpc-daemon[794]: ts=2026-09-20T08:16:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 paths=1 nar_bytes_in=5044489worker1 # [ 39.106369] nix-grpc-daemon[794]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004490worker1 # [ 39.117272] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4491worker1 # [ 39.125608] nix-daemon[858]: reaped child process 868, status = succeeded4492client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4493worker1 # [ 39.135087] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4494client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4495client # farm-a> LOG-farm-a-t14496worker1 # [ 40.365125] nix-daemon[858]: reaped child process 894, status = succeeded4497worker1 # [ 40.513777] nix-daemon[858]: accepted connection from pid 910, user nix-grpc-daemon (trusted)4498worker1 # [ 40.527438] nix-daemon[858]: reaped child process 913, status = succeeded4499lb # [ 40.562884] niks3-server[1051]: 2026/09/20 08:16:24 INFO Received uploads request method=POST path=/api/pending_closures4500worker1 # [ 40.553600] nix-grpc-daemon[870]: time=2026-09-20T08:16:24.649Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4501worker1 # [ 40.555280] nix-grpc-daemon[870]: time=2026-09-20T08:16:24.649Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4502lb # [ 40.615737] niks3-server[1051]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4503lb # [ 40.629269] niks3-server[1051]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4504lb # [ 40.640836] niks3-server[1051]: 2026/09/20 08:16:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4505lb # [ 40.645777] niks3-server[1051]: 2026/09/20 08:16:24 INFO Signed narinfos id=2 count=14506worker1 # [ 40.622275] nix-grpc-daemon[870]: time=2026-09-20T08:16:24.717Z level=INFO msg="Uploading 1 narinfos"4507lb # [ 40.651650] niks3-server[1051]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4508lb # [ 40.657676] niks3-server[1051]: 2026/09/20 08:16:24 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4509lb # [ 40.664437] niks3-server[1051]: 2026/09/20 08:16:24 INFO Completed upload id=24510lb # [ 40.665690] niks3-server[1051]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4511worker1 # [ 40.637389] nix-grpc-daemon[870]: time=2026-09-20T08:16:24.733Z level=INFO msg="Upload complete. (289ms)"4512worker1 # [ 40.647988] nix-grpc-daemon[794]: ts=2026-09-20T08:16:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14513worker1 # [ 40.664424] nix-grpc-daemon[794]: ts=2026-09-20T08:16:24Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04514worker1 # [ 40.668529] nix-grpc-daemon[794]: ts=2026-09-20T08:16:24Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14515worker1 # [ 40.674922] nix-daemon[858]: reaped child process 892, status = succeeded4516worker1 # [ 40.708413] nix-grpc-daemon[794]: ts=2026-09-20T08:16:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004517worker1 # [ 40.724628] nix-grpc-daemon[794]: ts=2026-09-20T08:16:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004518worker1 # [ 40.748726] nix-grpc-daemon[870]: time=2026-09-20T08:16:24.845Z level=INFO msg="All 1 paths already cached"4519client # copying 1 paths to 'lb:50051'...4520worker1 # [ 40.757339] nix-grpc-daemon[794]: ts=2026-09-20T08:16:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352004521client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4522worker1 # [ 40.774136] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4523worker1 # [ 40.920112] nix-daemon[858]: accepted connection from pid 920, user nix-grpc-daemon (trusted)4524worker1 # [ 40.933424] nix-daemon[858]: reaped child process 923, status = succeeded4525worker1 # [ 41.077611] nix-daemon[858]: accepted connection from pid 925, user nix-grpc-daemon (trusted)4526worker1 # [ 41.090469] nix-daemon[858]: reaped child process 928, status = succeeded4527lb # [ 41.128800] niks3-server[1051]: 2026/09/20 08:16:24 INFO Received uploads request method=POST path=/api/pending_closures4528worker1 # [ 41.133445] nix-grpc-daemon[870]: time=2026-09-20T08:16:25.229Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4529worker1 # [ 41.134930] nix-grpc-daemon[870]: time=2026-09-20T08:16:25.229Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4530lb # [ 41.170620] niks3-server[1051]: 2026/09/20 08:16:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4531lb # [ 41.172625] niks3-server[1051]: 2026/09/20 08:16:25 INFO Signed narinfos id=3 count=14532worker1 # [ 41.145560] nix-grpc-daemon[870]: time=2026-09-20T08:16:25.241Z level=INFO msg="Uploading 1 narinfos"4533lb # [ 41.176938] niks3-server[1051]: 2026/09/20 08:16:25 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4534lb # [ 41.182255] niks3-server[1051]: 2026/09/20 08:16:25 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4535lb # [ 41.187242] niks3-server[1051]: 2026/09/20 08:16:25 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4536lb # [ 41.193240] niks3-server[1051]: 2026/09/20 08:16:25 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4537lb # [ 41.201028] niks3-server[1051]: 2026/09/20 08:16:25 INFO Completed upload id=34538worker1 # [ 41.173848] nix-grpc-daemon[870]: time=2026-09-20T08:16:25.270Z level=INFO msg="Upload complete. (393ms)"4539worker1 # [ 41.177074] nix-grpc-daemon[794]: ts=2026-09-20T08:16:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 paths=1 nar_bytes_in=6244540worker1 # [ 41.179468] nix-grpc-daemon[794]: ts=2026-09-20T08:16:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004541worker1 # [ 41.183800] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4542worker1 # [ 41.188265] nix-daemon[858]: reaped child process 918, status = succeeded4543worker1 # [ 41.193993] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4544client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4545client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4546worker1 # [ 42.205841] nix-daemon[858]: reaped child process 932, status = succeeded4547client # farm-b> LOG-farm-b-t14548worker1 # [ 42.329275] nix-daemon[858]: accepted connection from pid 947, user nix-grpc-daemon (trusted)4549worker1 # [ 42.342643] nix-daemon[858]: reaped child process 950, status = succeeded4550lb # [ 42.379698] niks3-server[1051]: 2026/09/20 08:16:26 INFO Received uploads request method=POST path=/api/pending_closures4551worker1 # [ 42.363951] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.460Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4552worker1 # [ 42.365544] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.462Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4553lb # [ 42.417451] niks3-server[1051]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4554lb # [ 42.427447] niks3-server[1051]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4555lb # [ 42.428996] niks3-server[1051]: 2026/09/20 08:16:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4556lb # [ 42.432188] niks3-server[1051]: 2026/09/20 08:16:26 INFO Signed narinfos id=4 count=14557worker1 # [ 42.405210] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.501Z level=INFO msg="Uploading 1 narinfos"4558lb # [ 42.435247] niks3-server[1051]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4559lb # [ 42.439147] niks3-server[1051]: 2026/09/20 08:16:26 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4560lb # [ 42.443443] niks3-server[1051]: 2026/09/20 08:16:26 INFO Completed upload id=44561worker1 # [ 42.416168] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.512Z level=INFO msg="Upload complete. (215ms)"4562lb # [ 42.444669] niks3-server[1051]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4563worker1 # [ 42.419356] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14564worker1 # [ 42.424725] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04565worker1 # [ 42.426941] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14566worker1 # [ 42.431265] nix-daemon[858]: reaped child process 930, status = succeeded4567worker1 # [ 42.469130] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004568worker1 # [ 42.477068] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004569worker1 # [ 42.486372] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.582Z level=INFO msg="All 2 paths already cached"4570client # copying 1 paths to 'lb:50051'...4571worker1 # [ 42.491933] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352004572client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4573worker1 # [ 42.510084] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4574worker1 # [ 42.631083] nix-daemon[858]: accepted connection from pid 956, user nix-grpc-daemon (trusted)4575worker1 # [ 42.645481] nix-daemon[858]: reaped child process 959, status = succeeded4576worker1 # [ 42.768340] nix-daemon[858]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4577worker1 # [ 42.781312] nix-daemon[858]: reaped child process 964, status = succeeded4578lb # [ 42.816459] niks3-server[1051]: 2026/09/20 08:16:26 INFO Received uploads request method=POST path=/api/pending_closures4579worker1 # [ 42.798373] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.894Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4580worker1 # [ 42.799800] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.896Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4581lb # [ 42.846440] niks3-server[1051]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4582lb # [ 42.858643] niks3-server[1051]: 2026/09/20 08:16:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4583worker1 # [ 42.836546] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.933Z level=INFO msg="Uploading 1 narinfos"4584lb # [ 42.864205] niks3-server[1051]: 2026/09/20 08:16:26 INFO Signed narinfos id=5 count=14585lb # [ 42.870193] niks3-server[1051]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4586lb # [ 42.882726] niks3-server[1051]: 2026/09/20 08:16:26 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4587lb # [ 42.888193] niks3-server[1051]: 2026/09/20 08:16:26 INFO Completed upload id=54588worker1 # [ 42.863402] nix-grpc-daemon[870]: time=2026-09-20T08:16:26.959Z level=INFO msg="Upload complete. (347ms)"4589lb # [ 42.891447] niks3-server[1051]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4590worker1 # [ 42.868113] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 paths=1 nar_bytes_in=7524591worker1 # [ 42.873342] nix-grpc-daemon[794]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004592worker1 # [ 42.881891] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4593worker1 # [ 42.888399] nix-daemon[858]: reaped child process 954, status = succeeded4594client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4595client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4596worker1 # [ 42.892851] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4597client # farm-top> LOG-farm-top-t14598worker1 # [ 43.912713] nix-daemon[858]: reaped child process 968, status = succeeded4599worker1 # [ 44.061138] nix-daemon[858]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4600worker1 # [ 44.073656] nix-daemon[858]: reaped child process 987, status = succeeded4601lb # [ 44.112174] niks3-server[1051]: 2026/09/20 08:16:27 INFO Received uploads request method=POST path=/api/pending_closures4602worker1 # [ 44.097053] nix-grpc-daemon[870]: time=2026-09-20T08:16:28.192Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4603worker1 # [ 44.098626] nix-grpc-daemon[870]: time=2026-09-20T08:16:28.192Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4604lb # [ 44.132715] niks3-server[1051]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4605lb # [ 44.138261] niks3-server[1051]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4606lb # [ 44.142174] niks3-server[1051]: 2026/09/20 08:16:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4607lb # [ 44.144368] niks3-server[1051]: 2026/09/20 08:16:27 INFO Signed narinfos id=6 count=14608worker1 # [ 44.118431] nix-grpc-daemon[870]: time=2026-09-20T08:16:28.214Z level=INFO msg="Uploading 1 narinfos"4609lb # [ 44.149624] niks3-server[1051]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4610lb # [ 44.154145] niks3-server[1051]: 2026/09/20 08:16:27 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4611lb # [ 44.157339] niks3-server[1051]: 2026/09/20 08:16:27 INFO Completed upload id=64612worker1 # [ 44.130077] nix-grpc-daemon[870]: time=2026-09-20T08:16:28.226Z level=INFO msg="Upload complete. (231ms)"4613lb # [ 44.160537] niks3-server[1051]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4614worker1 # [ 44.132672] nix-grpc-daemon[794]: ts=2026-09-20T08:16:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14615worker1 # [ 44.139227] nix-daemon[858]: reaped child process 966, status = succeeded4616client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.14 seconds)4617client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4618client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.16 seconds)4619client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4620client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4621client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4622client # copying 3 paths...4623client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4624client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4625client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4626client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.21 seconds)4627(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.59 seconds)4628subtest: repeat is answered Cached by the scheduler without building4629worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4630worker1 # finding garbage collector roots...4631worker1 # deleting specified paths...4632worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4633worker1 # deleting unused links...4634worker1 # note: hard linking is currently saving 0.0 KiB4635worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4636worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4637worker2 # finding garbage collector roots...4638worker2 # deleting specified paths...4639worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4640worker2 # deleting unused links...4641worker2 # note: hard linking is currently saving 0.0 KiB4642worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4643client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24644worker1 # [ 45.324642] nix-grpc-daemon[794]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:352004645client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4646client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4647worker1 # [ 45.345643] nix-grpc-daemon[794]: ts=2026-09-20T08:16:29Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14648worker1 # [ 45.352117] nix-grpc-daemon[794]: ts=2026-09-20T08:16:29Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14649worker1 # [ 45.358403] nix-grpc-daemon[794]: ts=2026-09-20T08:16:29Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14650client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.27 seconds)4651client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4652client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.16 seconds)4653lb: must succeed: curl -sf localhost:9901/clusters4654lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4655lb: must succeed: curl -sf localhost:9901/clusters4656lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4657worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4658worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.04 seconds)4659(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.15 seconds)4660subtest: two clients wanting the same drv build it once4661client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4662client # [ 45.828905] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4663client # Running as unit: dedup1.service; invocation ID: b567e8ebb61d4345b6c105b77e3a002a4664client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4665client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4666worker2 # [ 46.057938] nix-grpc-daemon[784]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425964667client # [ 46.024221] nix[875]: don't know how to build these paths:4668client # [ 46.025111] nix[875]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4669worker1 # [ 46.033543] nix-grpc-daemon[794]: ts=2026-09-20T08:16:30Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04670worker1 # [ 46.035427] nix-grpc-daemon[794]: ts=2026-09-20T08:16:30Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14671worker2 # [ 46.115343] nix-grpc-daemon[784]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425964672worker2 # [ 46.132110] nix-grpc-daemon[784]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425964673client # [ 46.106251] nix[875]: copying 1 paths to 'lb:50051'...4674client # [ 46.109161] nix[875]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4675worker2 # [ 46.147695] nix-grpc-daemon[784]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425964676worker2 # [ 46.161380] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4677worker2 # [ 46.185126] nix-grpc-daemon[784]: ts=2026-09-20T08:16:30Z level=info event=niks3_push_started pid=8684678worker2 # [ 46.619792] nix-daemon[842]: accepted connection from pid 879, user nix-grpc-daemon (trusted)4679worker2 # [ 46.636706] nix-daemon[842]: reaped child process 883, status = succeeded4680worker2 # [ 46.768633] nix-daemon[842]: accepted connection from pid 885, user nix-grpc-daemon (trusted)4681worker2 # [ 46.783458] nix-daemon[842]: reaped child process 888, status = succeeded4682lb # [ 46.783811] niks3-server[1051]: 2026/09/20 08:16:30 INFO Received uploads request method=POST path=/api/pending_closures4683worker2 # [ 46.805618] nix-grpc-daemon[868]: time=2026-09-20T08:16:30.754Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4684worker2 # [ 46.807965] nix-grpc-daemon[868]: time=2026-09-20T08:16:30.756Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4685lb # [ 46.815379] niks3-server[1051]: 2026/09/20 08:16:30 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4686lb # [ 46.817990] niks3-server[1051]: 2026/09/20 08:16:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4687lb # [ 46.819794] niks3-server[1051]: 2026/09/20 08:16:30 INFO Signed narinfos id=7 count=14688worker2 # [ 46.831406] nix-grpc-daemon[868]: time=2026-09-20T08:16:30.782Z level=INFO msg="Uploading 1 narinfos"4689lb # [ 46.832361] niks3-server[1051]: 2026/09/20 08:16:30 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4690lb # [ 46.839187] niks3-server[1051]: 2026/09/20 08:16:30 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4691lb # [ 46.844044] niks3-server[1051]: 2026/09/20 08:16:30 INFO Completed upload id=74692worker2 # [ 46.855634] nix-grpc-daemon[868]: time=2026-09-20T08:16:30.806Z level=INFO msg="Upload complete. (401ms)"4693lb # [ 46.845440] niks3-server[1051]: 2026/09/20 08:16:30 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4694worker2 # [ 46.858196] nix-grpc-daemon[784]: ts=2026-09-20T08:16:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_in=4324695worker2 # [ 46.860947] nix-grpc-daemon[784]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425964696worker2 # [ 46.866308] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4697worker2 # [ 46.874319] nix-daemon[842]: reaped child process 866, status = succeeded4698client # [ 46.837654] nix[875]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4699worker2 # [ 46.877599] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4700client # [ 46.893695] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4701client # Running as unit: dedup2.service; invocation ID: c467703df8e849f59053a5155075692f4702client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.06 seconds)4703worker2 # [ 47.173172] nix-grpc-daemon[784]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425964704client # [ 47.144731] nix[891]: this derivation will be built:4705worker1 # [ 47.148760] nix-grpc-daemon[794]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352004706worker1 # [ 47.160636] nix-grpc-daemon[794]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'...4707client # [ 47.177786] nix[891]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4708worker1 # [ 47.188204] nix-grpc-daemon[794]: ts=2026-09-20T08:16:31Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04709worker2 # [ 47.235433] nix-grpc-daemon[784]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425964710client # [ 47.202041] nix[891]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4711lb # [ 47.901284] envoy[912]: conn peer=[2001:db8:1::1]:35414 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=94712lb # [ 47.902911] envoy[912]: conn peer=[2001:db8:1::1]:35420 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9342 tx=3742 ms=59454713lb # [ 47.904325] envoy[912]: conn peer=[2001:db8:1::1]:60614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=434714client: must succeed: sleep 24715client: (finished: must succeed: sleep 2, in 2.03 seconds)4716??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4717 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394718client: waiting for success: ! systemctl is-active dedup1 dedup24719??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4720 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394721worker2 # [ 50.508792] nix-daemon[842]: reaped child process 892, status = succeeded4722worker2 # [ 50.654940] nix-daemon[842]: accepted connection from pid 921, user nix-grpc-daemon (trusted)4723worker2 # [ 50.670162] nix-daemon[842]: reaped child process 924, status = succeeded4724lb # [ 50.674826] niks3-server[1051]: 2026/09/20 08:16:34 INFO Received uploads request method=POST path=/api/pending_closures4725worker2 # [ 50.693253] nix-grpc-daemon[868]: time=2026-09-20T08:16:34.644Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4726worker2 # [ 50.694893] nix-grpc-daemon[868]: time=2026-09-20T08:16:34.645Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4727lb # [ 50.712142] niks3-server[1051]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4728lb # [ 50.726219] niks3-server[1051]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4729lb # [ 50.735139] niks3-server[1051]: 2026/09/20 08:16:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4730lb # [ 50.740858] niks3-server[1051]: 2026/09/20 08:16:34 INFO Signed narinfos id=8 count=14731worker2 # [ 50.754506] nix-grpc-daemon[868]: time=2026-09-20T08:16:34.704Z level=INFO msg="Uploading 1 narinfos"4732lb # [ 50.748141] niks3-server[1051]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4733lb # [ 50.754967] niks3-server[1051]: 2026/09/20 08:16:34 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4734lb # [ 50.762305] niks3-server[1051]: 2026/09/20 08:16:34 INFO Completed upload id=84735worker2 # [ 50.772936] nix-grpc-daemon[868]: time=2026-09-20T08:16:34.723Z level=INFO msg="Upload complete. (282ms)"4736lb # [ 50.764228] niks3-server[1051]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4737worker2 # [ 50.780238] nix-grpc-daemon[784]: ts=2026-09-20T08:16:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14738worker2 # [ 50.784877] nix-grpc-daemon[784]: ts=2026-09-20T08:16:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14739worker2 # [ 50.795838] nix-daemon[842]: reaped child process 890, status = succeeded4740client # [ 50.768993] systemd[1]: dedup1.service: Deactivated successfully.4741client # [ 50.770619] systemd[1]: dedup1.service: Consumed 105ms CPU time over 4.940s wall clock time, 39.3M memory peak, 8.4K incoming IP traffic, 9.1K outgoing IP traffic.4742client # [ 50.802157] systemd[1]: dedup2.service: Deactivated successfully.4743client # [ 50.803859] systemd[1]: dedup2.service: Consumed 127ms CPU time over 3.909s wall clock time, 31.2M memory peak, 8.1K incoming IP traffic, 6.7K outgoing IP traffic.4744client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.10 seconds)4745client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4746client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4747worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4748worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4749worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4750worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4751worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4752worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.04 seconds)4753worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4754worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4755(finished: subtest: two clients wanting the same drv build it once, in 5.82 seconds)4756subtest: build hook: nix-daemon with builders = grpc://lb4757client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4758client # [ 51.755497] systemd[1]: Started Nix Daemon.4759client # [ 51.923217] nix-daemon[933]: accepted connection from pid 930, user root (trusted)4760worker2 # [ 52.116906] nix-grpc-daemon[784]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:425964761worker1 # [ 52.089714] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004762worker1 # [ 52.106456] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04763worker1 # [ 52.111455] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14764worker1 # [ 52.117738] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004765worker1 # [ 52.129249] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004766worker1 # [ 52.141158] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352004767worker1 # [ 52.153408] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4768worker1 # [ 52.323223] nix-daemon[858]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)4769worker1 # [ 52.336635] nix-daemon[858]: reaped child process 1048, status = succeeded4770worker1 # [ 52.491074] nix-daemon[858]: accepted connection from pid 1050, user nix-grpc-daemon (trusted)4771worker1 # [ 52.503363] nix-daemon[858]: reaped child process 1053, status = succeeded4772lb # [ 52.544901] niks3-server[1051]: 2026/09/20 08:16:36 INFO Received uploads request method=POST path=/api/pending_closures4773worker1 # [ 52.525707] nix-grpc-daemon[870]: time=2026-09-20T08:16:36.622Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4774worker1 # [ 52.527183] nix-grpc-daemon[870]: time=2026-09-20T08:16:36.623Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4775lb # [ 52.573862] niks3-server[1051]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4776lb # [ 52.585513] niks3-server[1051]: 2026/09/20 08:16:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4777worker1 # [ 52.565555] nix-grpc-daemon[870]: time=2026-09-20T08:16:36.661Z level=INFO msg="Uploading 1 narinfos"4778lb # [ 52.592680] niks3-server[1051]: 2026/09/20 08:16:36 INFO Signed narinfos id=9 count=14779lb # [ 52.596821] niks3-server[1051]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4780lb # [ 52.608888] niks3-server[1051]: 2026/09/20 08:16:36 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4781lb # [ 52.615177] niks3-server[1051]: 2026/09/20 08:16:36 INFO Completed upload id=94782worker1 # [ 52.587936] nix-grpc-daemon[870]: time=2026-09-20T08:16:36.684Z level=INFO msg="Upload complete. (422ms)"4783lb # [ 52.617435] niks3-server[1051]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4784worker1 # [ 52.592131] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 paths=1 nar_bytes_in=5124785worker1 # [ 52.596976] nix-grpc-daemon[794]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004786worker1 # [ 52.606480] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4787worker1 # [ 52.611207] nix-daemon[858]: reaped child process 1043, status = succeeded4788worker1 # [ 52.616046] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4789worker1 # [ 53.241430] nix-daemon[858]: reaped child process 1057, status = succeeded4790worker1 # [ 53.388763] nix-daemon[858]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4791worker1 # [ 53.400623] nix-daemon[858]: reaped child process 1075, status = succeeded4792lb # [ 53.442889] niks3-server[1051]: 2026/09/20 08:16:37 INFO Received uploads request method=POST path=/api/pending_closures4793worker1 # [ 53.571792] nix-grpc-daemon[870]: time=2026-09-20T08:16:37.667Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4794worker1 # [ 53.581327] nix-grpc-daemon[870]: time=2026-09-20T08:16:37.671Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4795lb # [ 53.647492] niks3-server[1051]: 2026/09/20 08:16:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4796worker1 # [ 53.626170] nix-grpc-daemon[870]: time=2026-09-20T08:16:37.722Z level=INFO msg="Uploading 1 narinfos"4797lb # [ 53.653314] niks3-server[1051]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4798lb # [ 53.657750] niks3-server[1051]: 2026/09/20 08:16:37 INFO Signed narinfos id=10 count=14799lb # [ 53.663873] niks3-server[1051]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4800lb # [ 53.678269] niks3-server[1051]: 2026/09/20 08:16:37 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4801lb # [ 53.682588] niks3-server[1051]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4802lb # [ 53.691518] niks3-server[1051]: 2026/09/20 08:16:37 INFO Completed upload id=104803worker1 # [ 53.664218] nix-grpc-daemon[870]: time=2026-09-20T08:16:37.760Z level=INFO msg="Upload complete. (441ms)"4804lb # [ 53.698487] niks3-server[1051]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4805worker1 # [ 53.671201] nix-grpc-daemon[794]: ts=2026-09-20T08:16:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14806worker1 # [ 53.683969] nix-daemon[858]: reaped child process 1055, status = succeeded4807worker2 # [ 53.755367] nix-grpc-daemon[784]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425964808worker2 # [ 53.769792] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4809worker2 # [ 53.812338] nix-grpc-daemon[784]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425964810worker2 # [ 53.818456] nix-grpc-daemon[784]: ts=2026-09-20T08:16:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_out=1284811worker1 # [ 54.032817] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:352004812worker1 # [ 54.039196] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004813worker1 # [ 54.044153] nix-grpc-daemon[870]: time=2026-09-20T08:16:38.139Z level=INFO msg="All 1 paths already cached"4814worker1 # [ 54.052205] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04815worker1 # [ 54.057773] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14816worker1 # [ 54.063385] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004817worker1 # [ 54.073447] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004818worker1 # [ 54.085790] nix-grpc-daemon[870]: time=2026-09-20T08:16:38.182Z level=INFO msg="All 1 paths already cached"4819worker1 # [ 54.092413] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352004820worker1 # [ 54.099803] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4821worker1 # [ 54.243749] nix-daemon[858]: accepted connection from pid 1081, user nix-grpc-daemon (trusted)4822worker1 # [ 54.256978] nix-daemon[858]: reaped child process 1084, status = succeeded4823worker1 # [ 54.406241] nix-daemon[858]: accepted connection from pid 1086, user nix-grpc-daemon (trusted)4824worker1 # [ 54.418057] nix-daemon[858]: reaped child process 1089, status = succeeded4825lb # [ 54.454526] niks3-server[1051]: 2026/09/20 08:16:38 INFO Received uploads request method=POST path=/api/pending_closures4826worker1 # [ 54.431448] nix-grpc-daemon[870]: time=2026-09-20T08:16:38.527Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4827worker1 # [ 54.432909] nix-grpc-daemon[870]: time=2026-09-20T08:16:38.529Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4828lb # [ 54.480136] niks3-server[1051]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4829lb # [ 54.494189] niks3-server[1051]: 2026/09/20 08:16:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4830worker1 # [ 54.473682] nix-grpc-daemon[870]: time=2026-09-20T08:16:38.570Z level=INFO msg="Uploading 1 narinfos"4831lb # [ 54.501180] niks3-server[1051]: 2026/09/20 08:16:38 INFO Signed narinfos id=11 count=14832lb # [ 54.512420] niks3-server[1051]: 2026/09/20 08:16:38 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4833lb # [ 54.609780] niks3-server[1051]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4834lb # [ 54.621506] niks3-server[1051]: 2026/09/20 08:16:38 INFO Completed upload id=114835worker1 # [ 54.594714] nix-grpc-daemon[870]: time=2026-09-20T08:16:38.690Z level=INFO msg="Upload complete. (482ms)"4836lb # [ 54.627217] niks3-server[1051]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4837worker1 # [ 54.600356] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 paths=1 nar_bytes_in=6244838worker1 # [ 54.606921] nix-grpc-daemon[794]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004839worker1 # [ 54.618367] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4840worker1 # [ 54.625932] nix-daemon[858]: reaped child process 1079, status = succeeded4841worker1 # [ 54.636740] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4842worker1 # [ 55.254875] nix-daemon[858]: reaped child process 1093, status = succeeded4843worker1 # [ 55.374032] nix-daemon[858]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4844worker1 # [ 55.386294] nix-daemon[858]: reaped child process 1111, status = succeeded4845lb # [ 55.424517] niks3-server[1051]: 2026/09/20 08:16:39 INFO Received uploads request method=POST path=/api/pending_closures4846worker1 # [ 55.406070] nix-grpc-daemon[870]: time=2026-09-20T08:16:39.501Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4847worker1 # [ 55.407394] nix-grpc-daemon[870]: time=2026-09-20T08:16:39.501Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4848lb # [ 55.465124] niks3-server[1051]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4849lb # [ 55.470772] niks3-server[1051]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4850lb # [ 55.483925] niks3-server[1051]: 2026/09/20 08:16:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4851lb # [ 55.488099] niks3-server[1051]: 2026/09/20 08:16:39 INFO Signed narinfos id=12 count=14852worker1 # [ 55.463409] nix-grpc-daemon[870]: time=2026-09-20T08:16:39.559Z level=INFO msg="Uploading 1 narinfos"4853lb # [ 55.493261] niks3-server[1051]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4854lb # [ 55.501295] niks3-server[1051]: 2026/09/20 08:16:39 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4855lb # [ 55.504138] niks3-server[1051]: 2026/09/20 08:16:39 INFO Completed upload id=124856worker1 # [ 55.477077] nix-grpc-daemon[870]: time=2026-09-20T08:16:39.573Z level=INFO msg="Upload complete. (230ms)"4857lb # [ 55.506524] niks3-server[1051]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4858worker1 # [ 55.482554] nix-grpc-daemon[794]: ts=2026-09-20T08:16:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14859worker1 # [ 55.489812] nix-grpc-daemon[794]: ts=2026-09-20T08:16:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352004860worker1 # [ 55.498348] nix-daemon[858]: reaped child process 1091, status = succeeded4861worker2 # [ 55.541799] nix-grpc-daemon[784]: ts=2026-09-20T08:16:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425964862worker2 # [ 55.551110] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4863worker2 # [ 55.562640] nix-grpc-daemon[784]: ts=2026-09-20T08:16:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_out=1764864worker1 # [ 55.780905] nix-grpc-daemon[794]: ts=2026-09-20T08:16:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:352004865worker2 # [ 55.822739] nix-grpc-daemon[784]: ts=2026-09-20T08:16:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425964866worker2 # [ 55.968764] nix-grpc-daemon[868]: time=2026-09-20T08:16:39.919Z level=INFO msg="All 2 paths already cached"4867worker1 # [ 55.949197] nix-grpc-daemon[794]: ts=2026-09-20T08:16:40Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04868worker1 # [ 55.954577] nix-grpc-daemon[794]: ts=2026-09-20T08:16:40Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14869worker1 # [ 55.960286] nix-grpc-daemon[794]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004870worker1 # [ 55.972631] nix-grpc-daemon[794]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352004871worker1 # [ 55.992394] nix-grpc-daemon[870]: time=2026-09-20T08:16:40.088Z level=INFO msg="All 2 paths already cached"4872worker1 # [ 56.000116] nix-grpc-daemon[794]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352004873worker1 # [ 56.008289] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4874worker1 # [ 56.191178] nix-daemon[858]: accepted connection from pid 1117, user nix-grpc-daemon (trusted)4875worker1 # [ 56.206073] nix-daemon[858]: reaped child process 1120, status = succeeded4876worker1 # [ 56.355260] nix-daemon[858]: accepted connection from pid 1122, user nix-grpc-daemon (trusted)4877worker1 # [ 56.367335] nix-daemon[858]: reaped child process 1125, status = succeeded4878lb # [ 56.409812] niks3-server[1051]: 2026/09/20 08:16:40 INFO Received uploads request method=POST path=/api/pending_closures4879worker1 # [ 56.390705] nix-grpc-daemon[870]: time=2026-09-20T08:16:40.487Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4880worker1 # [ 56.392231] nix-grpc-daemon[870]: time=2026-09-20T08:16:40.488Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4881lb # [ 56.439807] niks3-server[1051]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4882lb # [ 56.449819] niks3-server[1051]: 2026/09/20 08:16:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4883lb # [ 56.454413] niks3-server[1051]: 2026/09/20 08:16:40 INFO Signed narinfos id=13 count=14884worker1 # [ 56.429916] nix-grpc-daemon[870]: time=2026-09-20T08:16:40.526Z level=INFO msg="Uploading 1 narinfos"4885lb # [ 56.462805] niks3-server[1051]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4886lb # [ 56.473378] niks3-server[1051]: 2026/09/20 08:16:40 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4887lb # [ 56.480279] niks3-server[1051]: 2026/09/20 08:16:40 INFO Completed upload id=134888worker1 # [ 56.452847] nix-grpc-daemon[870]: time=2026-09-20T08:16:40.549Z level=INFO msg="Upload complete. (430ms)"4889lb # [ 56.483894] niks3-server[1051]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4890worker1 # [ 56.455924] nix-grpc-daemon[794]: ts=2026-09-20T08:16:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 paths=1 nar_bytes_in=7524891worker1 # [ 56.461282] nix-grpc-daemon[794]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352004892worker1 # [ 56.470137] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4893worker1 # [ 56.474129] nix-daemon[858]: reaped child process 1115, status = succeeded4894worker1 # [ 56.478982] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)4895worker1 # [ 57.493095] nix-daemon[858]: reaped child process 1129, status = succeeded4896worker1 # [ 57.642748] nix-daemon[858]: accepted connection from pid 1144, user nix-grpc-daemon (trusted)4897worker1 # [ 57.655693] nix-daemon[858]: reaped child process 1147, status = succeeded4898lb # [ 57.699455] niks3-server[1051]: 2026/09/20 08:16:41 INFO Received uploads request method=POST path=/api/pending_closures4899worker1 # [ 57.676372] nix-grpc-daemon[870]: time=2026-09-20T08:16:41.772Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4900worker1 # [ 57.678099] nix-grpc-daemon[870]: time=2026-09-20T08:16:41.774Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4901lb # [ 57.717869] niks3-server[1051]: 2026/09/20 08:16:41 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4902lb # [ 57.720694] niks3-server[1051]: 2026/09/20 08:16:41 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4903lb # [ 57.724638] niks3-server[1051]: 2026/09/20 08:16:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4904lb # [ 57.726388] niks3-server[1051]: 2026/09/20 08:16:41 INFO Signed narinfos id=14 count=14905worker1 # [ 57.700503] nix-grpc-daemon[870]: time=2026-09-20T08:16:41.796Z level=INFO msg="Uploading 1 narinfos"4906lb # [ 57.732580] niks3-server[1051]: 2026/09/20 08:16:41 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4907lb # [ 57.733980] niks3-server[1051]: 2026/09/20 08:16:41 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4908lb # [ 57.737834] niks3-server[1051]: 2026/09/20 08:16:41 INFO Completed upload id=144909worker1 # [ 57.710432] nix-grpc-daemon[870]: time=2026-09-20T08:16:41.806Z level=INFO msg="Upload complete. (224ms)"4910lb # [ 57.739339] niks3-server[1051]: 2026/09/20 08:16:41 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4911worker1 # [ 57.712772] nix-grpc-daemon[794]: ts=2026-09-20T08:16:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14912worker1 # [ 57.719463] nix-grpc-daemon[794]: ts=2026-09-20T08:16:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352004913worker1 # [ 57.722070] nix-daemon[858]: reaped child process 1127, status = succeeded4914worker2 # [ 57.772414] nix-grpc-daemon[784]: ts=2026-09-20T08:16:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425964915worker2 # [ 57.781594] nix-grpc-daemon[784]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4916worker2 # [ 57.793415] nix-grpc-daemon[784]: ts=2026-09-20T08:16:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_out=2324917client # [ 57.862988] nix-daemon[933]: reaped child process 935, status = succeeded4918lb # [ 57.902150] envoy[912]: conn peer=[2001:db8:1::1]:60624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2985 tx=1373 ms=47334919client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.29 seconds)4920lb # [ 57.905889] envoy[912]: conn peer=[2001:db8:1::1]:60640 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1576 tx=1487 ms=36604921client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4922lb # [ 57.909328] envoy[912]: conn peer=[2001:db8:1::1]:47804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=664923lb # [ 57.913348] envoy[912]: conn peer=[2001:db8:1::1]:60644 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3395 tx=1771 ms=17564924lb # [ 57.917068] envoy[912]: conn peer=[2001:db8:1::1]:47810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1857 ms=15444925lb # [ 57.921367] envoy[912]: conn peer=[2001:db8:1::1]:47816 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=744926lb # [ 57.925449] envoy[912]: conn peer=[2001:db8:1::1]:47824 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=734927lb # [ 57.929457] envoy[912]: conn peer=[2001:db8:1::1]:47818 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4326 tx=2110 ms=20294928client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4929client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4930client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4931client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4932client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4933(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.38 seconds)4934subtest: an input only one worker has still reaches the builder4935client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4936client # this derivation will be built:4937client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4938client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4939client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.48 seconds)4940client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4941client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds)4942worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4943worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4944worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4945worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4946client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24947client # [ 59.029320] nix-daemon[933]: accepted connection from pid 1016, user root (trusted)4948client # this derivation will be built:4949client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4950worker2 # [ 59.249615] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:425964951client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4952worker2 # [ 59.252924] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425964953client # copying 1 paths...4954client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4955worker2 # [ 59.258964] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425964956worker2 # [ 59.263559] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4957worker2 # [ 59.428547] nix-daemon[842]: accepted connection from pid 947, user nix-grpc-daemon (trusted)4958worker2 # [ 59.443682] nix-daemon[842]: reaped child process 950, status = succeeded4959lb # [ 59.449366] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received uploads request method=POST path=/api/pending_closures4960worker2 # [ 59.463588] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.414Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4961worker2 # [ 59.465452] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.416Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4962lb # [ 59.462985] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4963lb # [ 59.467248] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4964lb # [ 59.469513] niks3-server[1051]: 2026/09/20 08:16:43 INFO Signed narinfos id=15 count=14965worker2 # [ 59.480181] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.431Z level=INFO msg="Uploading 1 narinfos"4966lb # [ 59.475252] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4967lb # [ 59.478944] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4968lb # [ 59.481750] niks3-server[1051]: 2026/09/20 08:16:43 INFO Completed upload id=154969worker2 # [ 59.493388] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.444Z level=INFO msg="Upload complete. (222ms)"4970lb # [ 59.484269] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4971worker2 # [ 59.495569] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_in=1204972worker2 # [ 59.502053] nix-daemon[842]: reaped child process 944, status = succeeded4973worker2 # [ 59.512107] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425964974worker1 # [ 59.473093] nix-grpc-daemon[794]: ts=2026-09-20T08:16:43Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04975worker1 # [ 59.477372] nix-grpc-daemon[794]: ts=2026-09-20T08:16:43Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14976worker2 # [ 59.518682] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425964977client # copying 2 paths to 'lb:50051'...4978worker2 # [ 59.527134] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425964979client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4980client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4981worker2 # [ 59.538813] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4982worker2 # [ 59.698668] nix-daemon[842]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4983worker2 # [ 59.711985] nix-daemon[842]: reaped child process 957, status = succeeded4984worker2 # [ 59.873786] nix-daemon[842]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4985worker2 # [ 59.889678] nix-daemon[842]: reaped child process 962, status = succeeded4986lb # [ 59.890976] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received uploads request method=POST path=/api/pending_closures4987lb # [ 59.901097] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received uploads request method=POST path=/api/pending_closures4988worker2 # [ 59.920171] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.870Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4989worker2 # [ 59.921508] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.870Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4990worker2 # [ 59.923080] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.870Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4991lb # [ 59.939217] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4992lb # [ 59.943804] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4993lb # [ 59.947605] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4994lb # [ 59.950134] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4995lb # [ 59.951933] niks3-server[1051]: 2026/09/20 08:16:43 INFO Signed narinfos id=16 count=14996lb # [ 59.954172] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4997lb # [ 59.957119] niks3-server[1051]: 2026/09/20 08:16:43 INFO Signed narinfos id=17 count=24998lb # [ 59.959131] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4999worker2 # [ 59.968428] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.918Z level=INFO msg="Uploading 3 narinfos"5000lb # [ 59.972292] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5001lb # [ 59.976025] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5002lb # [ 59.980384] niks3-server[1051]: 2026/09/20 08:16:43 INFO Completed upload id=165003lb # [ 59.981671] niks3-server[1051]: 2026/09/20 08:16:43 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5004lb # [ 59.983886] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5005lb # [ 59.986680] niks3-server[1051]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5006lb # [ 59.988823] niks3-server[1051]: 2026/09/20 08:16:43 INFO Completed upload id=175007worker2 # [ 59.999325] nix-grpc-daemon[868]: time=2026-09-20T08:16:43.950Z level=INFO msg="Upload complete. (453ms)"5008worker2 # [ 60.004402] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=2 nar_bytes_in=9765009worker2 # [ 60.010284] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425965010worker2 # [ 60.020284] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5011worker2 # [ 60.027628] nix-daemon[842]: reaped child process 952, status = succeeded5012worker2 # [ 60.032635] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5013client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5014client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5015worker2 # [ 61.248315] nix-daemon[842]: reaped child process 966, status = succeeded5016worker2 # [ 61.390149] nix-daemon[842]: accepted connection from pid 981, user nix-grpc-daemon (trusted)5017worker2 # [ 61.403772] nix-daemon[842]: reaped child process 984, status = succeeded5018lb # [ 61.409608] niks3-server[1051]: 2026/09/20 08:16:45 INFO Received uploads request method=POST path=/api/pending_closures5019worker2 # [ 61.428572] nix-grpc-daemon[868]: time=2026-09-20T08:16:45.379Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5020lb # [ 61.441151] niks3-server[1051]: 2026/09/20 08:16:45 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5021lb # [ 61.447747] niks3-server[1051]: 2026/09/20 08:16:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5022lb # [ 61.452467] niks3-server[1051]: 2026/09/20 08:16:45 INFO Signed narinfos id=18 count=15023worker2 # [ 61.465720] nix-grpc-daemon[868]: time=2026-09-20T08:16:45.416Z level=INFO msg="Uploading 1 narinfos"5024lb # [ 61.460698] niks3-server[1051]: 2026/09/20 08:16:45 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5025lb # [ 61.472939] niks3-server[1051]: 2026/09/20 08:16:45 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5026worker2 # [ 61.487994] nix-grpc-daemon[868]: time=2026-09-20T08:16:45.439Z level=INFO msg="Upload complete. (248ms)"5027lb # [ 61.478148] niks3-server[1051]: 2026/09/20 08:16:45 INFO Completed upload id=185028worker2 # [ 61.490478] nix-grpc-daemon[784]: ts=2026-09-20T08:16:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=15029lb # [ 61.481282] niks3-server[1051]: 2026/09/20 08:16:45 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5030worker2 # [ 61.498042] nix-daemon[842]: reaped child process 964, status = succeeded5031client # copying 1 paths...5032worker1 # [ 61.500075] nix-grpc-daemon[794]: ts=2026-09-20T08:16:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352005033worker1 # [ 61.517100] nix-grpc-daemon[794]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5034client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5035worker2 # [ 61.587485] nix-grpc-daemon[784]: ts=2026-09-20T08:16:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425965036worker2 # [ 61.590093] nix-grpc-daemon[784]: ts=2026-09-20T08:16:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_out=1205037client # [ 61.619285] nix-daemon[933]: reaped child process 1019, status = succeeded5038client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.79 seconds)5039client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25040client # [ 61.793895] nix-daemon[933]: accepted connection from pid 1038, user root (trusted)5041client # this derivation will be built:5042client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5043worker1 # [ 61.972115] nix-grpc-daemon[794]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:352005044client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5045worker2 # [ 62.012882] nix-grpc-daemon[784]: ts=2026-09-20T08:16:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425965046worker2 # [ 62.023239] nix-grpc-daemon[868]: time=2026-09-20T08:16:45.974Z level=INFO msg="All 1 paths already cached"5047worker1 # [ 61.999476] nix-grpc-daemon[794]: ts=2026-09-20T08:16:46Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05048worker1 # [ 62.001822] nix-grpc-daemon[794]: ts=2026-09-20T08:16:46Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15049worker1 # [ 62.004591] nix-grpc-daemon[794]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352005050worker1 # [ 62.012460] nix-grpc-daemon[794]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352005051client # copying 1 paths to 'lb:50051'...5052client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5053worker1 # [ 62.026527] nix-grpc-daemon[794]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352005054worker1 # [ 62.030928] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)5055worker1 # [ 62.040795] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5)5056worker1 # [ 62.065271] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 2/5)5057worker1 # [ 62.200963] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 3/5)5058worker1 # [ 62.349620] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 301 ms (attempt 4/5)5059worker1 # [ 62.651948] nix-grpc-daemon[794]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5060worker1 # [ 62.656291] nix-grpc-daemon[794]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5061worker1 # [ 62.843823] nix-daemon[858]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5062worker1 # [ 62.858949] nix-daemon[858]: reaped child process 1168, status = succeeded5063worker1 # [ 63.026691] nix-daemon[858]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5064worker1 # [ 63.039214] nix-daemon[858]: reaped child process 1173, status = succeeded5065lb # [ 63.083071] niks3-server[1051]: 2026/09/20 08:16:46 INFO Received uploads request method=POST path=/api/pending_closures5066worker1 # [ 63.064650] nix-grpc-daemon[870]: time=2026-09-20T08:16:47.160Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5067worker1 # [ 63.066607] nix-grpc-daemon[870]: time=2026-09-20T08:16:47.162Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5068lb # [ 63.110057] niks3-server[1051]: 2026/09/20 08:16:46 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5069lb # [ 63.122227] niks3-server[1051]: 2026/09/20 08:16:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5070lb # [ 63.128838] niks3-server[1051]: 2026/09/20 08:16:46 INFO Signed narinfos id=19 count=15071worker1 # [ 63.104938] nix-grpc-daemon[870]: time=2026-09-20T08:16:47.201Z level=INFO msg="Uploading 1 narinfos"5072lb # [ 63.132357] niks3-server[1051]: 2026/09/20 08:16:46 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5073lb # [ 63.145268] niks3-server[1051]: 2026/09/20 08:16:46 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5074lb # [ 63.149924] niks3-server[1051]: 2026/09/20 08:16:46 INFO Completed upload id=195075worker1 # [ 63.124849] nix-grpc-daemon[870]: time=2026-09-20T08:16:47.221Z level=INFO msg="Upload complete. (456ms)"5076lb # [ 63.154471] niks3-server[1051]: 2026/09/20 08:16:46 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5077worker1 # [ 63.128401] nix-grpc-daemon[794]: ts=2026-09-20T08:16:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=1 paths=1 nar_bytes_in=5605078worker1 # [ 63.134280] nix-grpc-daemon[794]: ts=2026-09-20T08:16:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352005079worker1 # [ 63.144920] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)5080worker1 # [ 63.150340] nix-daemon[858]: reaped child process 1159, status = succeeded5081worker1 # [ 63.154841] nix-daemon[858]: accepted connection from pid 794, user nix-grpc-daemon (trusted)5082client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5083client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5084worker1 # [ 64.369677] nix-daemon[858]: reaped child process 1177, status = succeeded5085worker1 # [ 64.526747] nix-daemon[858]: accepted connection from pid 1192, user nix-grpc-daemon (trusted)5086worker1 # [ 64.540725] nix-daemon[858]: reaped child process 1195, status = succeeded5087lb # [ 64.584487] niks3-server[1051]: 2026/09/20 08:16:48 INFO Received uploads request method=POST path=/api/pending_closures5088worker1 # [ 64.561920] nix-grpc-daemon[870]: time=2026-09-20T08:16:48.658Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5089lb # [ 64.598904] niks3-server[1051]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5090lb # [ 64.603495] niks3-server[1051]: 2026/09/20 08:16:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5091lb # [ 64.605301] niks3-server[1051]: 2026/09/20 08:16:48 INFO Signed narinfos id=20 count=15092worker1 # [ 64.579471] nix-grpc-daemon[870]: time=2026-09-20T08:16:48.675Z level=INFO msg="Uploading 1 narinfos"5093lb # [ 64.608880] niks3-server[1051]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5094lb # [ 64.613932] niks3-server[1051]: 2026/09/20 08:16:48 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5095lb # [ 64.616736] niks3-server[1051]: 2026/09/20 08:16:48 INFO Completed upload id=205096worker1 # [ 64.589515] nix-grpc-daemon[870]: time=2026-09-20T08:16:48.686Z level=INFO msg="Upload complete. (227ms)"5097lb # [ 64.619590] niks3-server[1051]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5098worker1 # [ 64.592595] nix-grpc-daemon[794]: ts=2026-09-20T08:16:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15099client # copying 1 paths...5100worker1 # [ 64.600033] nix-daemon[858]: reaped child process 1175, status = succeeded5101worker2 # [ 64.637652] nix-grpc-daemon[784]: ts=2026-09-20T08:16:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425965102worker2 # [ 64.644974] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5103client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5104worker1 # [ 64.627951] nix-grpc-daemon[794]: ts=2026-09-20T08:16:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:352005105worker1 # [ 64.630965] nix-grpc-daemon[794]: ts=2026-09-20T08:16:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35200 duration_s=0 paths=1 nar_bytes_out=1205106client # [ 64.723805] nix-daemon[933]: reaped child process 1041, status = succeeded5107client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.11 seconds)5108client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25109client # [ 64.910078] nix-daemon[933]: accepted connection from pid 1060, user root (trusted)5110client # this derivation will be built:5111client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5112worker1 # [ 65.096211] nix-grpc-daemon[794]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:352005113worker2 # [ 65.136585] nix-grpc-daemon[784]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425965114client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5115worker2 # [ 65.143178] nix-grpc-daemon[868]: time=2026-09-20T08:16:49.093Z level=INFO msg="All 1 paths already cached"5116worker1 # [ 65.121172] nix-grpc-daemon[794]: ts=2026-09-20T08:16:49Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05117worker1 # [ 65.125414] nix-grpc-daemon[794]: ts=2026-09-20T08:16:49Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15118worker2 # [ 65.202766] nix-grpc-daemon[784]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425965119worker2 # [ 65.215654] nix-grpc-daemon[784]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425965120worker2 # [ 65.228215] nix-grpc-daemon[868]: time=2026-09-20T08:16:49.179Z level=INFO msg="All 1 paths already cached"5121client # copying 1 paths to 'lb:50051'...5122client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5123worker2 # [ 65.236911] nix-grpc-daemon[784]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425965124worker2 # [ 65.248394] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5125worker2 # [ 65.420251] nix-daemon[842]: accepted connection from pid 989, user nix-grpc-daemon (trusted)5126worker2 # [ 65.435133] nix-daemon[842]: reaped child process 992, status = succeeded5127worker2 # [ 65.587204] nix-daemon[842]: accepted connection from pid 994, user nix-grpc-daemon (trusted)5128worker2 # [ 65.602210] nix-daemon[842]: reaped child process 997, status = succeeded5129lb # [ 65.608846] niks3-server[1051]: 2026/09/20 08:16:49 INFO Received uploads request method=POST path=/api/pending_closures5130worker2 # [ 65.625526] nix-grpc-daemon[868]: time=2026-09-20T08:16:49.576Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5131worker2 # [ 65.626986] nix-grpc-daemon[868]: time=2026-09-20T08:16:49.576Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5132lb # [ 65.631817] niks3-server[1051]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5133lb # [ 65.643445] niks3-server[1051]: 2026/09/20 08:16:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5134worker2 # [ 65.659321] nix-grpc-daemon[868]: time=2026-09-20T08:16:49.610Z level=INFO msg="Uploading 1 narinfos"5135lb # [ 65.648782] niks3-server[1051]: 2026/09/20 08:16:49 INFO Signed narinfos id=21 count=15136lb # [ 65.654654] niks3-server[1051]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5137lb # [ 65.664931] niks3-server[1051]: 2026/09/20 08:16:49 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5138lb # [ 65.671341] niks3-server[1051]: 2026/09/20 08:16:49 INFO Completed upload id=215139worker2 # [ 65.684482] nix-grpc-daemon[868]: time=2026-09-20T08:16:49.634Z level=INFO msg="Upload complete. (423ms)"5140lb # [ 65.675621] niks3-server[1051]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5141worker2 # [ 65.687265] nix-grpc-daemon[784]: ts=2026-09-20T08:16:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_in=5605142worker2 # [ 65.690118] nix-grpc-daemon[784]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425965143worker2 # [ 65.699325] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5144worker2 # [ 65.702046] nix-daemon[842]: reaped child process 987, status = succeeded5145worker2 # [ 65.708054] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5146client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5147client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5148worker2 # [ 66.538320] nix-daemon[842]: reaped child process 1001, status = succeeded5149worker2 # [ 66.695216] nix-daemon[842]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)5150worker2 # [ 66.708882] nix-daemon[842]: reaped child process 1019, status = succeeded5151lb # [ 66.714328] niks3-server[1051]: 2026/09/20 08:16:50 INFO Received uploads request method=POST path=/api/pending_closures5152worker2 # [ 66.729547] nix-grpc-daemon[868]: time=2026-09-20T08:16:50.680Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5153lb # [ 66.729218] niks3-server[1051]: 2026/09/20 08:16:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5154lb # [ 66.732488] niks3-server[1051]: 2026/09/20 08:16:50 INFO Signed narinfos id=22 count=15155worker2 # [ 66.742835] nix-grpc-daemon[868]: time=2026-09-20T08:16:50.693Z level=INFO msg="Uploading 1 narinfos"5156lb # [ 66.734120] niks3-server[1051]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5157lb # [ 66.737497] niks3-server[1051]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5158lb # [ 66.741650] niks3-server[1051]: 2026/09/20 08:16:50 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5159lb # [ 66.745581] niks3-server[1051]: 2026/09/20 08:16:50 INFO Completed upload id=225160worker2 # [ 66.755961] nix-grpc-daemon[868]: time=2026-09-20T08:16:50.707Z level=INFO msg="Upload complete. (239ms)"5161lb # [ 66.746821] niks3-server[1051]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5162worker2 # [ 66.758676] nix-grpc-daemon[784]: ts=2026-09-20T08:16:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15163worker2 # [ 66.766065] nix-daemon[842]: reaped child process 999, status = succeeded5164client # copying 1 paths...5165worker2 # [ 66.806215] nix-grpc-daemon[784]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425965166client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5167worker2 # [ 66.825127] nix-grpc-daemon[784]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425965168worker2 # [ 66.829203] nix-grpc-daemon[784]: ts=2026-09-20T08:16:50Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42596 duration_s=0 paths=1 nar_bytes_out=1205169client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.16 seconds)5170(finished: subtest: an input only one worker has still reaches the builder, in 8.93 seconds)5171subtest: upload whose reference the worker lacks is completed from the cache5172client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5173client # [ 66.950409] nix-daemon[933]: reaped child process 1063, status = succeeded5174client # this derivation will be built:5175client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5176client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5177client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds)5178client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5179client # this derivation will be built:5180client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5181client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5182client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds)5183client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5184client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5185worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5186lb # [ 67.902355] envoy[912]: conn peer=[2001:db8:1::1]:47836 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4201 tx=1862 ms=23535187lb # [ 67.903879] envoy[912]: conn peer=[2001:db8:1::1]:47838 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=165188lb # [ 67.905229] envoy[912]: conn peer=[2001:db8:1::1]:47854 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3684 tx=1916 ms=27105189lb # [ 67.906694] envoy[912]: conn peer=[2001:db8:1::1]:34932 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=505190lb # [ 67.908078] envoy[912]: conn peer=[2001:db8:1::1]:34952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=545191lb # [ 67.909433] envoy[912]: conn peer=[2001:db8:1::1]:34936 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3699 tx=1800 ms=17455192worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.22 seconds)5193worker2 # [ 68.149953] systemd[1]: Stopping Nix worker-protocol over gRPC...5194worker2 # [ 68.193949] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=signal_exit5195worker2 # [ 69.455482] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_restarting5196worker1 # [ 69.423820] nix-grpc-daemon[794]: ts=2026-09-20T08:16:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:469865197worker1 # [ 69.427628] nix-grpc-daemon[794]: ts=2026-09-20T08:16:53Z level=info event=worker_gone addr=192.168.1.4:500515198worker2 # [ 69.475594] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5199worker2 # [ 69.493430] nix-daemon[842]: reaped child process 845, status = succeeded5200worker2 # [ 69.674545] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5201worker2 # [ 69.675634] systemd[1]: Stopped Nix worker-protocol over gRPC.5202worker2 # [ 69.678242] systemd[1]: nix-grpc-daemon.service: Consumed 1.479s CPU time over 51.766s wall clock time, 50.1M memory peak, 52.3K incoming IP traffic, 98.3K outgoing IP traffic.5203worker2 # [ 69.682614] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5204worker2 # [ 69.684446] systemd[1]: Closed Nix worker-protocol over gRPC.5205worker2 # [ 69.685692] systemd[1]: nix-grpc-daemon.socket: Consumed 337us CPU time over 1min 188ms wall clock time, 256K memory peak, 83.6K incoming IP traffic, 67.8K outgoing IP traffic.5206lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5207lb: must succeed: curl -sf localhost:9901/clusters5208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5209lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5210client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25211worker1 # [ 69.907816] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:352005212worker1 # [ 69.915329] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352005213client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5214client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.22 seconds)5215worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5216worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5217worker2 # [ 70.064807] systemd[1]: Listening on Nix worker-protocol over gRPC.5218worker1 # [ 70.090527] systemd[1]: Stopping Nix worker-protocol over gRPC...5219worker1 # [ 70.135738] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=info event=signal_exit5220worker2 # [ 70.328761] systemd[1]: Starting Nix worker-protocol over gRPC...5221worker1 # [ 70.389138] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=info event=scheduler_yield5222worker1 # [ 70.393825] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=info event=scheduler_restarting addr=lb:500515223lb # [ 70.420762] niks3-server[1051]: 2026/09/20 08:16:54 INFO lead: released remote=192.168.1.3:606725224worker1 # [ 70.398641] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:469865225worker1 # [ 70.402117] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=info event=worker_gone addr=192.168.1.3:500515226worker2 # [ 70.510573] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5227worker2 # [ 70.514905] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15228worker2 # [ 70.522157] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5229worker2 # [ 70.523813] systemd[1]: Started Nix worker-protocol over gRPC.5230lb # [ 70.523784] niks3-server[1051]: 2026/09/20 08:16:54 INFO lead: acquired remote=192.168.1.4:560025231worker2 # [ 70.538181] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=scheduler_take_over5232worker2 # [ 70.556201] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500515233worker2 # [ 70.567428] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5234worker1 # [ 70.595530] nix-grpc-daemon[794]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500515235worker2 # [ 70.642511] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05236worker2 # [ 70.768666] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500515237worker2 # [ 70.773087] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5238worker2 # [ 70.973332] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500515239worker2 # [ 70.975488] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05240worker1 # [ 71.393199] nix-grpc-daemon[794]: ts=2026-09-20T08:16:55Z level=info event=scheduler_restarting5241worker2 # [ 71.439835] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:607805242worker2 # [ 71.441935] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:55Z level=info event=worker_gone addr=192.168.1.3:500515243worker1 # [ 71.413779] nix-grpc-daemon[794]: ts=2026-09-20T08:16:55Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5244worker1 # [ 71.422884] nix-daemon[858]: reaped child process 860, status = succeeded5245worker1 # [ 71.579375] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5246worker1 # [ 71.582703] systemd[1]: Stopped Nix worker-protocol over gRPC.5247worker1 # [ 71.587393] systemd[1]: nix-grpc-daemon.service: Consumed 2.379s CPU time over 53.713s wall clock time, 60M memory peak, 84.7K incoming IP traffic, 167.1K outgoing IP traffic.5248worker1 # [ 71.599414] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5249worker1 # [ 71.602929] systemd[1]: Closed Nix worker-protocol over gRPC.5250worker1 # [ 71.606303] systemd[1]: nix-grpc-daemon.socket: Consumed 351us CPU time over 1min 1.234s wall clock time, 256K memory peak, 115.5K incoming IP traffic, 93.7K outgoing IP traffic.5251lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5252lb: must succeed: curl -sf localhost:9901/clusters5253lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5254lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5255client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25256worker2 # [ 71.932513] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607885257worker2 # [ 71.938223] nix-daemon[842]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)5258worker2 # [ 71.946064] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)5259worker2 # [ 71.974654] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 2/5)5260worker2 # [ 72.078976] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 243 ms (attempt 3/5)5261worker2 # [ 72.328132] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 217 ms (attempt 4/5)5262worker2 # [ 72.551289] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5263client # copying 2 paths...5264worker2 # [ 72.572593] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607885265client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5266client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5267worker2 # [ 72.583253] nix-daemon[842]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)5268worker2 # [ 72.597243] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:56Z level=info event=niks3_push_started pid=10965269worker2 # [ 72.891298] nix-daemon[842]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)5270worker2 # [ 72.906584] nix-daemon[842]: reaped child process 1112, status = succeeded5271lb # [ 72.913748] niks3-server[1051]: 2026/09/20 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures5272lb # [ 72.920230] niks3-server[1051]: 2026/09/20 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures5273worker2 # [ 72.939416] nix-grpc-daemon[1096]: time=2026-09-20T08:16:56.889Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5274worker2 # [ 72.940862] nix-grpc-daemon[1096]: time=2026-09-20T08:16:56.889Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5275worker2 # [ 72.945442] nix-grpc-daemon[1096]: time=2026-09-20T08:16:56.889Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5276lb # [ 72.964802] niks3-server[1051]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5277lb # [ 72.985645] niks3-server[1051]: 2026/09/20 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5278lb # [ 72.991357] niks3-server[1051]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5279lb # [ 72.999073] niks3-server[1051]: 2026/09/20 08:16:56 INFO Signed narinfos id=23 count=15280lb # [ 73.000093] niks3-server[1051]: 2026/09/20 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5281lb # [ 73.002266] niks3-server[1051]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5282lb # [ 73.004134] niks3-server[1051]: 2026/09/20 08:16:56 INFO Signed narinfos id=24 count=25283worker2 # [ 73.015145] nix-grpc-daemon[1096]: time=2026-09-20T08:16:56.965Z level=INFO msg="Uploading 3 narinfos"5284lb # [ 73.018863] niks3-server[1051]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5285lb # [ 73.024280] niks3-server[1051]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5286lb # [ 73.028175] niks3-server[1051]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5287lb # [ 73.031132] niks3-server[1051]: 2026/09/20 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5288lb # [ 73.036422] niks3-server[1051]: 2026/09/20 08:16:56 INFO Completed upload id=245289lb # [ 73.037697] niks3-server[1051]: 2026/09/20 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5290lb # [ 73.039889] niks3-server[1051]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5291lb # [ 73.041810] niks3-server[1051]: 2026/09/20 08:16:56 INFO Completed upload id=235292worker2 # [ 73.052471] nix-grpc-daemon[1096]: time=2026-09-20T08:16:57.003Z level=INFO msg="Upload complete. (305ms)"5293worker2 # [ 73.058646] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60788 duration_s=0 paths=2 nar_bytes_in=3125294worker2 # [ 73.071923] nix-daemon[842]: reaped child process 1094, status = succeeded5295client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.37 seconds)5296worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5297worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5298worker1 # [ 73.139469] systemd[1]: Listening on Nix worker-protocol over gRPC.5299worker1 # [ 73.146719] systemd[1]: Starting Nix worker-protocol over gRPC...5300worker1 # [ 73.318228] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5301worker1 # [ 73.322296] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15302worker1 # [ 73.329061] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5303worker1 # [ 73.333163] systemd[1]: Started Nix worker-protocol over gRPC.5304lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5305lb: must succeed: curl -sf localhost:9901/clusters5306worker1 # [ 73.366110] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515307worker2 # [ 73.407040] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05308lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5309lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5310(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 6.52 seconds)5311subtest: scheduler down: the other node takes the lock and keeps it5312lb: must succeed: curl -sf localhost:9901/clusters5313lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5314lb: must succeed: curl -sf localhost:9901/clusters5315lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5316lb: must succeed: curl -sf localhost:9901/clusters5317lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5318lb: must succeed: curl -sf localhost:9901/clusters5319lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5320worker2 # [ 73.683945] systemd[1]: Stopping Nix worker-protocol over gRPC...5321worker2 # [ 74.524453] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=signal_exit5322worker2 # [ 74.736664] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=scheduler_yield5323lb # [ 74.728802] niks3-server[1051]: 2026/09/20 08:16:58 INFO lead: released remote=192.168.1.4:560025324worker1 # [ 74.707459] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:58Z level=info event=scheduler_restarting addr=lb:500515325worker2 # [ 74.745321] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:607805326worker2 # [ 74.751654] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=worker_gone addr=192.168.1.3:500515327worker2 # [ 74.754791] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:607805328worker2 # [ 74.758164] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=worker_gone addr=192.168.1.4:500515329worker2 # [ 74.761144] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=scheduler_restarting addr=lb:500515330worker1 # [ 74.906948] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515331worker1 # [ 74.914901] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5332worker2 # [ 74.952839] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500515333worker2 # [ 74.964532] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5334worker1 # [ 75.116069] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515335worker1 # [ 75.121571] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5336worker2 # [ 75.165617] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515337worker2 # [ 75.171442] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5338worker1 # [ 75.322513] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515339worker1 # [ 75.327674] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5340worker2 # [ 75.372373] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515341worker2 # [ 75.378402] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5342worker1 # [ 75.528607] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515343worker1 # [ 75.533630] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5344worker2 # [ 75.579327] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515345worker2 # [ 75.582227] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5346worker2 # [ 75.738214] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=scheduler_restarting5347worker2 # [ 75.751689] nix-daemon[842]: reaped child process 1089, status = succeeded5348worker1 # [ 75.735645] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515349worker1 # [ 75.740210] nix-grpc-daemon[1220]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5350worker2 # [ 75.788663] nix-grpc-daemon[1040]: ts=2026-09-20T08:16:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5351worker1 # [ 75.941277] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500515352worker2 # [ 75.981873] nix-grpc-daemon[1040]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5353worker2 # [ 75.985791] nix-grpc-daemon[1040]: E0000 00:00:1789892219.932301 1083 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5354worker1 # [ 76.499633] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5355worker2 # [ 76.551512] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5356worker2 # [ 76.557058] systemd[1]: Stopped Nix worker-protocol over gRPC.5357worker2 # [ 76.559343] systemd[1]: nix-grpc-daemon.service: Consumed 354ms CPU time over 6.221s wall clock time, 32.8M memory peak, 17.7K incoming IP traffic, 23.2K outgoing IP traffic.5358worker2 # [ 76.571372] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5359worker2 # [ 76.575752] systemd[1]: Closed Nix worker-protocol over gRPC.5360worker2 # [ 76.579158] systemd[1]: nix-grpc-daemon.socket: Consumed 318us CPU time over 6.514s wall clock time, 256K memory peak, 26.3K incoming IP traffic, 22.5K outgoing IP traffic.5361worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5362worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds)5363worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5364worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5365worker1 # [ 76.700128] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500515366worker1 # [ 76.703112] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5367worker1 # [ 76.904902] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515368worker1 # [ 76.908789] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5369worker1 # [ 77.109583] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515370worker1 # [ 77.114692] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5371worker1 # [ 77.315576] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515372worker1 # [ 77.319645] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5373worker1 # [ 77.520562] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515374worker1 # [ 77.526294] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5375worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5376worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5377worker1 # [ 77.726774] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515378worker1 # [ 77.729609] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5379lb # [ 77.903490] envoy[912]: conn peer=[2001:db8:1::4]:49862 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=13548 tx=2580 ms=512355380lb # [ 77.907531] envoy[912]: conn peer=[2001:db8:1::1]:34964 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=225381lb # [ 77.911067] envoy[912]: conn peer=[2001:db8:1::3]:59196 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=14471 tx=2875 ms=532205382lb # [ 77.914753] envoy[912]: conn peer=[2001:db8:1::1]:34978 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1003 tx=282 ms=11375383lb # [ 77.918423] envoy[912]: conn peer=[2001:db8:1::4]:46512 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1711 tx=441 ms=52325384worker1 # [ 77.930522] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500515385worker1 # [ 77.933104] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5386worker1 # [ 78.133850] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500515387worker1 # [ 78.136578] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5388worker1 # [ 78.337086] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500515389worker1 # [ 78.339703] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5390worker1 # [ 78.344331] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_take_over5391lb # [ 78.372605] niks3-server[1051]: 2026/09/20 08:17:02 INFO lead: acquired remote=192.168.1.3:426545392worker1 # [ 78.540383] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500515393worker1 # [ 78.542338] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:02Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05394worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5395worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5396client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25397worker1 # [ 79.118344] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:465825398worker1 # [ 79.123559] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5399client # don't know how to build these paths:5400client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5401worker1 # [ 79.140343] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:03Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05402worker1 # [ 79.142259] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:03Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15403worker1 # [ 79.186561] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825404worker1 # [ 79.192573] nix-grpc-daemon[1220]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5405worker1 # [ 79.233976] nix-grpc-daemon[1220]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 2/5)5406worker1 # [ 79.329554] nix-grpc-daemon[1220]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 3/5)5407worker1 # [ 79.365030] nix-grpc-daemon[1220]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 474 ms (attempt 4/5)5408worker1 # [ 79.842212] nix-grpc-daemon[1220]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5409worker1 # [ 79.859772] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:465825410client # copying 1 paths to 'lb:50051'...5411client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5412worker1 # [ 79.873116] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:465825413worker1 # [ 79.881508] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5414worker1 # [ 79.902917] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:03Z level=info event=niks3_push_started pid=12995415worker1 # [ 80.237407] nix-daemon[858]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5416worker1 # [ 80.248199] nix-daemon[858]: reaped child process 1315, status = succeeded5417worker1 # [ 80.406516] nix-daemon[858]: accepted connection from pid 1317, user nix-grpc-daemon (trusted)5418worker1 # [ 80.418488] nix-daemon[858]: reaped child process 1320, status = succeeded5419lb # [ 80.462681] niks3-server[1051]: 2026/09/20 08:17:04 INFO Received uploads request method=POST path=/api/pending_closures5420worker1 # [ 80.445330] nix-grpc-daemon[1299]: time=2026-09-20T08:17:04.540Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5421worker1 # [ 80.447670] nix-grpc-daemon[1299]: time=2026-09-20T08:17:04.541Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5422lb # [ 80.501493] niks3-server[1051]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5423lb # [ 80.508130] niks3-server[1051]: 2026/09/20 08:17:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5424worker1 # [ 80.488926] nix-grpc-daemon[1299]: time=2026-09-20T08:17:04.585Z level=INFO msg="Uploading 1 narinfos"5425lb # [ 80.516615] niks3-server[1051]: 2026/09/20 08:17:04 INFO Signed narinfos id=25 count=15426lb # [ 80.523379] niks3-server[1051]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5427lb # [ 80.532701] niks3-server[1051]: 2026/09/20 08:17:04 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5428lb # [ 80.538586] niks3-server[1051]: 2026/09/20 08:17:04 INFO Completed upload id=255429worker1 # [ 80.511561] nix-grpc-daemon[1299]: time=2026-09-20T08:17:04.607Z level=INFO msg="Upload complete. (430ms)"5430lb # [ 80.543926] niks3-server[1051]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5431worker1 # [ 80.516557] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=0 paths=1 nar_bytes_in=5205432worker1 # [ 80.521800] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825433worker1 # [ 80.531064] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5434worker1 # [ 80.534439] nix-daemon[858]: reaped child process 1297, status = succeeded5435client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5436client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5437worker1 # [ 80.539407] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5438client # farm-a> LOG-farm-a-on-standby5439worker1 # [ 81.151415] nix-daemon[858]: reaped child process 1324, status = succeeded5440worker1 # [ 81.312389] nix-daemon[858]: accepted connection from pid 1339, user nix-grpc-daemon (trusted)5441worker1 # [ 81.323197] nix-daemon[858]: reaped child process 1342, status = succeeded5442lb # [ 81.367823] niks3-server[1051]: 2026/09/20 08:17:05 INFO Received uploads request method=POST path=/api/pending_closures5443worker1 # [ 81.549349] nix-grpc-daemon[1299]: time=2026-09-20T08:17:05.645Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5444worker1 # [ 81.550748] nix-grpc-daemon[1299]: time=2026-09-20T08:17:05.645Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5445lb # [ 81.608675] niks3-server[1051]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5446lb # [ 81.619418] niks3-server[1051]: 2026/09/20 08:17:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5447worker1 # [ 81.596888] nix-grpc-daemon[1299]: time=2026-09-20T08:17:05.692Z level=INFO msg="Uploading 1 narinfos"5448lb # [ 81.624312] niks3-server[1051]: 2026/09/20 08:17:05 INFO Signed narinfos id=26 count=15449lb # [ 81.631507] niks3-server[1051]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5450lb # [ 81.643335] niks3-server[1051]: 2026/09/20 08:17:05 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5451lb # [ 81.649447] niks3-server[1051]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5452lb # [ 81.663061] niks3-server[1051]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5453lb # [ 81.670894] niks3-server[1051]: 2026/09/20 08:17:05 INFO Completed upload id=265454worker1 # [ 81.643922] nix-grpc-daemon[1299]: time=2026-09-20T08:17:05.740Z level=INFO msg="Upload complete. (498ms)"5455worker1 # [ 81.656717] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15456worker1 # [ 81.668896] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:05Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05457worker1 # [ 81.673412] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:05Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15458worker1 # [ 81.686328] nix-daemon[858]: reaped child process 1322, status = succeeded5459worker1 # [ 81.712339] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825460worker1 # [ 81.726096] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:465825461worker1 # [ 81.738307] nix-grpc-daemon[1299]: time=2026-09-20T08:17:05.834Z level=INFO msg="All 1 paths already cached"5462client # copying 1 paths to 'lb:50051'...5463client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5464worker1 # [ 81.746287] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:465825465worker1 # [ 81.756478] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5466worker1 # [ 81.933215] nix-daemon[858]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5467worker1 # [ 81.945930] nix-daemon[858]: reaped child process 1351, status = succeeded5468worker1 # [ 82.108040] nix-daemon[858]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5469worker1 # [ 82.120101] nix-daemon[858]: reaped child process 1356, status = succeeded5470lb # [ 82.164373] niks3-server[1051]: 2026/09/20 08:17:05 INFO Received uploads request method=POST path=/api/pending_closures5471worker1 # [ 82.142718] nix-grpc-daemon[1299]: time=2026-09-20T08:17:06.238Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5472worker1 # [ 82.144214] nix-grpc-daemon[1299]: time=2026-09-20T08:17:06.238Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5473lb # [ 82.178458] niks3-server[1051]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5474lb # [ 82.181926] niks3-server[1051]: 2026/09/20 08:17:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5475lb # [ 82.184625] niks3-server[1051]: 2026/09/20 08:17:06 INFO Signed narinfos id=27 count=15476worker1 # [ 82.157649] nix-grpc-daemon[1299]: time=2026-09-20T08:17:06.253Z level=INFO msg="Uploading 1 narinfos"5477lb # [ 82.187741] niks3-server[1051]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5478lb # [ 82.192398] niks3-server[1051]: 2026/09/20 08:17:06 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5479lb # [ 82.195367] niks3-server[1051]: 2026/09/20 08:17:06 INFO Completed upload id=275480worker1 # [ 82.169294] nix-grpc-daemon[1299]: time=2026-09-20T08:17:06.265Z level=INFO msg="Upload complete. (398ms)"5481lb # [ 82.196969] niks3-server[1051]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5482worker1 # [ 82.171164] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=0 paths=1 nar_bytes_in=6405483worker1 # [ 82.174150] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825484worker1 # [ 82.178288] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5485worker1 # [ 82.183252] nix-daemon[858]: reaped child process 1346, status = succeeded5486worker1 # [ 82.188122] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5487client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5488client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5489client # farm-b> LOG-farm-b-on-standby5490worker1 # [ 83.402278] nix-daemon[858]: reaped child process 1360, status = succeeded5491worker1 # [ 83.551587] nix-daemon[858]: accepted connection from pid 1375, user nix-grpc-daemon (trusted)5492worker1 # [ 83.564609] nix-daemon[858]: reaped child process 1378, status = succeeded5493lb # [ 83.603267] niks3-server[1051]: 2026/09/20 08:17:07 INFO Received uploads request method=POST path=/api/pending_closures5494worker1 # [ 83.580669] nix-grpc-daemon[1299]: time=2026-09-20T08:17:07.676Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5495worker1 # [ 83.582885] nix-grpc-daemon[1299]: time=2026-09-20T08:17:07.678Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5496lb # [ 83.620920] niks3-server[1051]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5497lb # [ 83.627324] niks3-server[1051]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5498lb # [ 83.630420] niks3-server[1051]: 2026/09/20 08:17:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5499lb # [ 83.632389] niks3-server[1051]: 2026/09/20 08:17:07 INFO Signed narinfos id=28 count=15500worker1 # [ 83.606807] nix-grpc-daemon[1299]: time=2026-09-20T08:17:07.703Z level=INFO msg="Uploading 1 narinfos"5501lb # [ 83.637097] niks3-server[1051]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5502lb # [ 83.642428] niks3-server[1051]: 2026/09/20 08:17:07 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5503lb # [ 83.645290] niks3-server[1051]: 2026/09/20 08:17:07 INFO Completed upload id=285504worker1 # [ 83.618087] nix-grpc-daemon[1299]: time=2026-09-20T08:17:07.714Z level=INFO msg="Upload complete. (223ms)"5505lb # [ 83.648278] niks3-server[1051]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5506worker1 # [ 83.621677] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15507worker1 # [ 83.629110] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:07Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05508worker1 # [ 83.631458] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:07Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15509worker1 # [ 83.636183] nix-daemon[858]: reaped child process 1358, status = succeeded5510worker1 # [ 83.673372] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825511worker1 # [ 83.685504] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:465825512worker1 # [ 83.696868] nix-grpc-daemon[1299]: time=2026-09-20T08:17:07.793Z level=INFO msg="All 2 paths already cached"5513client # copying 1 paths to 'lb:50051'...5514client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5515worker1 # [ 83.703990] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:465825516worker1 # [ 83.710679] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5517worker1 # [ 83.871123] nix-daemon[858]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5518worker1 # [ 83.883253] nix-daemon[858]: reaped child process 1387, status = succeeded5519worker1 # [ 84.047152] nix-daemon[858]: accepted connection from pid 1389, user nix-grpc-daemon (trusted)5520worker1 # [ 84.059094] nix-daemon[858]: reaped child process 1392, status = succeeded5521lb # [ 84.102198] niks3-server[1051]: 2026/09/20 08:17:07 INFO Received uploads request method=POST path=/api/pending_closures5522worker1 # [ 84.083771] nix-grpc-daemon[1299]: time=2026-09-20T08:17:08.179Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5523worker1 # [ 84.085171] nix-grpc-daemon[1299]: time=2026-09-20T08:17:08.180Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5524lb # [ 84.128391] niks3-server[1051]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5525lb # [ 84.141264] niks3-server[1051]: 2026/09/20 08:17:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5526lb # [ 84.146736] niks3-server[1051]: 2026/09/20 08:17:07 INFO Signed narinfos id=29 count=15527worker1 # [ 84.122861] nix-grpc-daemon[1299]: time=2026-09-20T08:17:08.219Z level=INFO msg="Uploading 1 narinfos"5528lb # [ 84.152861] niks3-server[1051]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5529lb # [ 84.164228] niks3-server[1051]: 2026/09/20 08:17:07 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5530worker1 # [ 84.143484] nix-grpc-daemon[1299]: time=2026-09-20T08:17:08.239Z level=INFO msg="Upload complete. (422ms)"5531lb # [ 84.170484] niks3-server[1051]: 2026/09/20 08:17:08 INFO Completed upload id=295532worker1 # [ 84.146067] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=0 paths=1 nar_bytes_in=7685533lb # [ 84.176851] niks3-server[1051]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5534worker1 # [ 84.149915] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825535worker1 # [ 84.159368] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5536worker1 # [ 84.161581] nix-daemon[858]: reaped child process 1382, status = succeeded5537worker1 # [ 84.166965] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5538client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5539client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5540client # farm-top> LOG-farm-top-on-standby5541worker1 # [ 85.193716] nix-daemon[858]: reaped child process 1396, status = succeeded5542worker1 # [ 85.327975] nix-daemon[858]: accepted connection from pid 1411, user nix-grpc-daemon (trusted)5543worker1 # [ 85.340423] nix-daemon[858]: reaped child process 1414, status = succeeded5544lb # [ 85.383325] niks3-server[1051]: 2026/09/20 08:17:09 INFO Received uploads request method=POST path=/api/pending_closures5545worker1 # [ 85.365047] nix-grpc-daemon[1299]: time=2026-09-20T08:17:09.461Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5546worker1 # [ 85.368060] nix-grpc-daemon[1299]: time=2026-09-20T08:17:09.463Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5547lb # [ 85.413674] niks3-server[1051]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5548lb # [ 85.427170] niks3-server[1051]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5549lb # [ 85.440108] niks3-server[1051]: 2026/09/20 08:17:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5550lb # [ 85.445112] niks3-server[1051]: 2026/09/20 08:17:09 INFO Signed narinfos id=30 count=15551worker1 # [ 85.420346] nix-grpc-daemon[1299]: time=2026-09-20T08:17:09.516Z level=INFO msg="Uploading 1 narinfos"5552lb # [ 85.448964] niks3-server[1051]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5553lb # [ 85.458048] niks3-server[1051]: 2026/09/20 08:17:09 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5554lb # [ 85.461047] niks3-server[1051]: 2026/09/20 08:17:09 INFO Completed upload id=305555worker1 # [ 85.433785] nix-grpc-daemon[1299]: time=2026-09-20T08:17:09.530Z level=INFO msg="Upload complete. (259ms)"5556lb # [ 85.463428] niks3-server[1051]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5557worker1 # [ 85.439394] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15558worker1 # [ 85.452213] nix-daemon[858]: reaped child process 1394, status = succeeded5559client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 6.74 seconds)5560client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5561client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5562worker2 # [ 85.788821] systemd[1]: Listening on Nix worker-protocol over gRPC.5563worker2 # [ 85.795705] systemd[1]: Starting Nix worker-protocol over gRPC...5564worker2 # [ 85.931766] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5565worker2 # [ 85.934110] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15566worker2 # [ 85.939299] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5567worker2 # [ 85.944305] systemd[1]: Started Nix worker-protocol over gRPC.5568lb: must succeed: curl -sf localhost:9901/clusters5569worker2 # [ 85.964782] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515570worker1 # [ 85.928671] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05571lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5572worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5573worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5574lb: must succeed: curl -sf localhost:9901/clusters5575lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5576lb: must succeed: curl -sf localhost:9901/clusters5577lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5578worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5579worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5580(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.81 seconds)5581subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5582client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5583client # [ 86.274117] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5584client # Running as unit: rs.service; invocation ID: 11b4bb32fc52470395fef63851f6f6a65585client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5586client # [ 86.487786] nix[1163]: don't know how to build these paths:5587client # [ 86.488713] nix[1163]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5588worker1 # [ 86.488514] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:465825589worker1 # [ 86.499236] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:10Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05590worker1 # [ 86.503279] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:10Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15591worker1 # [ 86.552618] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825592worker1 # [ 86.565277] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:465825593client # [ 86.574309] nix[1163]: copying 1 paths to 'lb:50051'...5594worker1 # [ 86.576904] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:465825595client # [ 86.576631] nix[1163]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5596worker1 # [ 86.589416] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5597worker1 # [ 86.758357] nix-daemon[858]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5598worker1 # [ 86.770769] nix-daemon[858]: reaped child process 1432, status = succeeded5599worker1 # [ 86.922942] nix-daemon[858]: accepted connection from pid 1434, user nix-grpc-daemon (trusted)5600worker1 # [ 86.935254] nix-daemon[858]: reaped child process 1437, status = succeeded5601lb # [ 86.975380] niks3-server[1051]: 2026/09/20 08:17:10 INFO Received uploads request method=POST path=/api/pending_closures5602worker1 # [ 86.957121] nix-grpc-daemon[1299]: time=2026-09-20T08:17:11.053Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5603worker1 # [ 86.958456] nix-grpc-daemon[1299]: time=2026-09-20T08:17:11.053Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5604lb # [ 87.005128] niks3-server[1051]: 2026/09/20 08:17:10 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5605lb # [ 87.015122] niks3-server[1051]: 2026/09/20 08:17:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5606lb # [ 87.020246] niks3-server[1051]: 2026/09/20 08:17:10 INFO Signed narinfos id=31 count=15607worker1 # [ 86.998448] nix-grpc-daemon[1299]: time=2026-09-20T08:17:11.094Z level=INFO msg="Uploading 1 narinfos"5608lb # [ 87.029928] niks3-server[1051]: 2026/09/20 08:17:10 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5609lb # [ 87.042630] niks3-server[1051]: 2026/09/20 08:17:10 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5610lb # [ 87.046372] niks3-server[1051]: 2026/09/20 08:17:10 INFO Completed upload id=315611worker1 # [ 87.019228] nix-grpc-daemon[1299]: time=2026-09-20T08:17:11.115Z level=INFO msg="Upload complete. (418ms)"5612lb # [ 87.047942] niks3-server[1051]: 2026/09/20 08:17:10 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5613worker1 # [ 87.022561] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=0 paths=1 nar_bytes_in=4165614worker1 # [ 87.028291] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465825615worker1 # [ 87.036483] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5616worker1 # [ 87.041565] nix-daemon[858]: reaped child process 1427, status = succeeded5617worker1 # [ 87.047320] nix-daemon[858]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5618client # [ 87.044196] nix[1163]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5619lb # [ 87.904399] envoy[912]: conn peer=[2001:db8:1::1]:51618 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9451 tx=3799 ms=64835620lb: must succeed: curl -sf localhost:9901/clusters5621lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5622lb: must succeed: curl -sf localhost:9901/clusters5623lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5624lb: must succeed: curl -sf localhost:9901/clusters5625lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5626lb: must succeed: curl -sf localhost:9901/clusters5627lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5628worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5629worker2 # [ 89.165028] systemd-journald[287]: Received client request to rotate journal, rotating.5630worker2 # [ 89.184387] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/3a439f3931cf4733a6b04b9024ac7703.5631worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.08 seconds)5632worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5633worker1 # [ 89.064764] systemd[1]: Stopping Nix worker-protocol over gRPC...5634worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5635??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5636 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735637client: must succeed: sleep 5.05638worker1 # [ 89.339153] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:13Z level=info event=draining5639client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5640worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5641worker1 # [ 94.478561] nix-daemon[858]: reaped child process 1441, status = succeeded5642worker1 # [ 94.639842] nix-daemon[858]: accepted connection from pid 1481, user nix-grpc-daemon (trusted)5643worker1 # [ 94.650728] nix-daemon[858]: reaped child process 1484, status = succeeded5644lb # [ 94.695291] niks3-server[1051]: 2026/09/20 08:17:18 INFO Received uploads request method=POST path=/api/pending_closures5645worker1 # [ 94.677837] nix-grpc-daemon[1299]: time=2026-09-20T08:17:18.774Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5646worker1 # [ 94.679331] nix-grpc-daemon[1299]: time=2026-09-20T08:17:18.775Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5647lb # [ 94.740704] niks3-server[1051]: 2026/09/20 08:17:18 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5648lb # [ 94.747082] niks3-server[1051]: 2026/09/20 08:17:18 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5649lb # [ 94.758732] niks3-server[1051]: 2026/09/20 08:17:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5650worker1 # [ 94.738271] nix-grpc-daemon[1299]: time=2026-09-20T08:17:18.834Z level=INFO msg="Uploading 1 narinfos"5651lb # [ 94.765237] niks3-server[1051]: 2026/09/20 08:17:18 INFO Signed narinfos id=32 count=15652lb # [ 94.770072] niks3-server[1051]: 2026/09/20 08:17:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5653lb # [ 94.777331] niks3-server[1051]: 2026/09/20 08:17:18 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5654lb # [ 94.780636] niks3-server[1051]: 2026/09/20 08:17:18 INFO Completed upload id=325655lb # [ 94.782208] niks3-server[1051]: 2026/09/20 08:17:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5656worker1 # [ 94.754671] nix-grpc-daemon[1299]: time=2026-09-20T08:17:18.851Z level=INFO msg="Upload complete. (294ms)"5657worker1 # [ 94.761728] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46582 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15658worker1 # [ 94.774581] nix-daemon[858]: reaped child process 1439, status = succeeded5659client # [ 94.788733] systemd[1]: rs.service: Deactivated successfully.5660client # [ 94.790660] systemd[1]: rs.service: Consumed 108ms CPU time over 8.515s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.5661worker1 # [ 95.340972] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=signal_exit5662worker1 # [ 95.566218] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=scheduler_yield5663worker2 # [ 95.608125] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:19Z level=info event=scheduler_restarting addr=lb:500515664lb # [ 95.596516] niks3-server[1051]: 2026/09/20 08:17:19 INFO lead: released remote=192.168.1.3:426545665worker1 # [ 95.573920] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=scheduler_restarting addr=lb:500515666worker1 # [ 95.578874] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465685667worker1 # [ 95.582418] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=worker_gone addr=192.168.1.4:500515668worker1 # [ 95.585849] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465685669worker1 # [ 95.589666] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=worker_gone addr=192.168.1.3:500515670worker2 # [ 95.808748] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500515671worker1 # [ 95.778405] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500515672worker2 # [ 95.819195] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5673worker1 # [ 95.785282] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5674worker2 # [ 95.949323] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:19Z level=info event=scheduler_take_over5675lb # [ 95.939305] niks3-server[1051]: 2026/09/20 08:17:19 INFO lead: acquired remote=192.168.1.4:395505676worker2 # [ 96.020254] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500515677worker1 # [ 95.985927] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500515678worker2 # [ 96.025248] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05679worker1 # [ 95.991479] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5680worker1 # [ 96.192824] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500515681worker2 # [ 96.232546] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05682worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.14 seconds)5683client: waiting for success: ! systemctl is-active rs5684client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds)5685client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5686client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5687client: must fail: journalctl -u rs | grep -q 'reconnecting'5688worker1 # [ 96.570992] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:20Z level=info event=scheduler_restarting5689worker2 # [ 96.616403] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:538965690client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5691lb: must succeed: curl -sf localhost:9901/clusters5692worker2 # [ 96.620385] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:20Z level=info event=worker_gone addr=192.168.1.3:500515693worker1 # [ 96.591625] nix-grpc-daemon[1220]: ts=2026-09-20T08:17:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5694worker1 # [ 96.606470] nix-daemon[858]: reaped child process 1290, status = succeeded5695lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5696worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5697worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5698worker1 # [ 97.384193] nix-grpc-daemon[1220]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5699worker1 # [ 97.385613] nix-grpc-daemon[1220]: E0000 00:00:1789892241.479832 1263 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5700worker1 # [ 97.387475] nix-grpc-daemon[1220]: E0000 00:00:1789892241.480289 1263 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5701lb: must succeed: curl -sf localhost:9901/clusters5702lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5703worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5704worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5705lb # [ 97.904879] envoy[912]: conn peer=[2001:db8:1::1]:35578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1324 ms=82875706lb # [ 97.909119] envoy[912]: conn peer=[2001:db8:1::3]:55218 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5185 tx=1268 ms=232195707worker1 # [ 98.078751] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5708worker1 # [ 98.081500] systemd[1]: Stopped Nix worker-protocol over gRPC.5709worker1 # [ 98.084363] systemd[1]: nix-grpc-daemon.service: Consumed 1.267s CPU time over 24.931s wall clock time, 35M memory peak, 47.1K incoming IP traffic, 89.9K outgoing IP traffic.5710worker1 # [ 98.099578] systemd[1]: Starting Nix worker-protocol over gRPC...5711worker1 # [ 98.262606] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5712worker1 # [ 98.265214] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15713worker1 # [ 98.271248] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5714worker1 # [ 98.272798] systemd[1]: Started Nix worker-protocol over gRPC.5715worker1 # [ 98.296262] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500515716worker2 # [ 98.336844] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:22Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05717lb: must succeed: curl -sf localhost:9901/clusters5718lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5719worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5720worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5721(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.75 seconds)5722subtest: scheduler restart mid-build: build finishes, no double build5723client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5724client # [ 99.025872] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5725client # Running as unit: mid.service; invocation ID: 25bd526b76724bfeba62688e055180955726client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5727worker1 # [ 99.230534] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483085728worker1 # [ 99.241577] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5729client # [ 99.252331] nix[1199]: don't know how to build these paths:5730client # [ 99.253327] nix[1199]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5731worker2 # [ 99.301685] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:23Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05732worker2 # [ 99.307572] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:23Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15733worker2 # [ 99.356657] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539105734worker2 # [ 99.367618] nix-daemon[842]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5735worker2 # [ 99.384643] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 1/5)5736worker2 # [ 99.478087] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 2/5)5737worker2 # [ 99.493990] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 212 ms (attempt 3/5)5738worker2 # [ 99.711869] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 219 ms (attempt 4/5)5739worker2 # [ 99.937144] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5740worker2 # [ 99.955265] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539105741client # [ 99.926089] nix[1199]: copying 1 paths to 'lb:50051'...5742client # [ 99.927233] nix[1199]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5743worker2 # [ 99.966423] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539105744worker2 # [ 99.974624] nix-daemon[842]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5745worker2 # [ 100.010626] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:23Z level=info event=niks3_push_started pid=12625746worker2 # [ 100.335081] nix-daemon[842]: accepted connection from pid 1275, user nix-grpc-daemon (trusted)5747worker2 # [ 100.355128] nix-daemon[842]: reaped child process 1282, status = succeeded5748worker2 # [ 100.494701] nix-daemon[842]: accepted connection from pid 1284, user nix-grpc-daemon (trusted)5749worker2 # [ 100.507144] nix-daemon[842]: reaped child process 1287, status = succeeded5750lb # [ 100.510306] niks3-server[1051]: 2026/09/20 08:17:24 INFO Received uploads request method=POST path=/api/pending_closures5751worker2 # [ 100.530941] nix-grpc-daemon[1262]: time=2026-09-20T08:17:24.481Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5752worker2 # [ 100.532642] nix-grpc-daemon[1262]: time=2026-09-20T08:17:24.483Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5753lb # [ 100.543969] niks3-server[1051]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5754lb # [ 100.555172] niks3-server[1051]: 2026/09/20 08:17:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5755lb # [ 100.559742] niks3-server[1051]: 2026/09/20 08:17:24 INFO Signed narinfos id=33 count=15756worker2 # [ 100.573248] nix-grpc-daemon[1262]: time=2026-09-20T08:17:24.524Z level=INFO msg="Uploading 1 narinfos"5757lb # [ 100.574839] niks3-server[1051]: 2026/09/20 08:17:24 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5758lb # [ 100.584890] niks3-server[1051]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5759lb # [ 100.588891] niks3-server[1051]: 2026/09/20 08:17:24 INFO Completed upload id=335760worker2 # [ 100.599316] nix-grpc-daemon[1262]: time=2026-09-20T08:17:24.550Z level=INFO msg="Upload complete. (414ms)"5761lb # [ 100.590223] niks3-server[1051]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5762worker2 # [ 100.603527] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53910 duration_s=0 paths=1 nar_bytes_in=4245763worker2 # [ 100.609280] nix-grpc-daemon[1133]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539105764worker2 # [ 100.617060] nix-daemon[842]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5765worker2 # [ 100.624975] nix-daemon[842]: reaped child process 1260, status = succeeded5766worker2 # [ 100.627960] nix-daemon[842]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5767client # [ 100.588890] nix[1199]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5768lb: must succeed: curl -sf localhost:9901/clusters5769lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5770lb: must succeed: curl -sf localhost:9901/clusters5771lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5772worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5773worker2 # [ 102.874455] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1133 (nix-grpc-daemon) on client request.5774worker2 # [ 102.877422] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5775client # [ 102.846824] nix[1199]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5776lb # [ 102.875688] niks3-server[1051]: 2026/09/20 08:17:26 INFO lead: released remote=192.168.1.4:395505777client # [ 102.848783] nix[1199]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5778worker1 # [ 102.848658] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5779worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5780client: must succeed: sleep 5.05781worker2 # [ 102.911336] nix-daemon[842]: reaped child process 1289, status = succeeded5782worker2 # [ 102.914464] nix-daemon[842]: reaped child process 1255, status = succeeded5783worker2 # [ 102.916516] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5784worker2 # [ 102.918097] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5785worker2 # [ 102.920084] systemd[1]: nix-grpc-daemon.service: Consumed 453ms CPU time over 17.118s wall clock time, 33M memory peak, 14K incoming IP traffic, 21.3K outgoing IP traffic.5786worker2 # [ 102.927249] nix-daemon[1291]: unexpected Nix daemon error: error: interrupted by the user5787worker2 # [ 102.932342] nix-daemon[842]: reaped child process 1291, status = failed with exit code 15788worker1 # [ 103.048697] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:27Z level=info event=scheduler_connected addr=lb:500515789worker2 # [ 103.090628] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5790worker2 # [ 103.100499] systemd[1]: Starting Nix worker-protocol over gRPC...5791worker2 # [ 103.268812] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5792worker2 # [ 103.271157] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15793worker2 # [ 103.277286] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5794worker2 # [ 103.280546] systemd[1]: Started Nix worker-protocol over gRPC.5795worker2 # [ 103.288680] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=info event=scheduler_take_over5796lb # [ 103.278539] niks3-server[1051]: 2026/09/20 08:17:27 INFO lead: acquired remote=192.168.1.4:609385797worker1 # [ 103.256400] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5798worker2 # [ 103.306508] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=info event=scheduler_connected addr=lb:500515799worker2 # [ 103.308237] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05800worker2 # [ 103.397505] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05801worker2 # [ 103.402887] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15802worker2 # [ 103.450154] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410505803worker2 # [ 103.460221] nix-daemon[842]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5804worker2 # [ 103.474751] nix-daemon[842]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5805client # [ 103.446210] nix[1199]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5806worker2 # [ 103.486880] nix-daemon[842]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5807worker1 # [ 103.457562] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:27Z level=info event=scheduler_connected addr=lb:500515808worker2 # [ 103.496207] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05809lb # [ 107.905122] envoy[912]: conn peer=[2001:db8:1::4]:49110 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=978 tx=389 ms=169225810client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5811client: waiting for success: ! systemctl is-active mid5812worker2 # [ 108.308080] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:32Z level=info event=niks3_push_started pid=14065813worker2 # [ 108.338799] nix-daemon[842]: reaped child process 1382, status = succeeded5814worker2 # [ 108.650576] nix-daemon[842]: accepted connection from pid 1419, user nix-grpc-daemon (trusted)5815worker2 # [ 108.664221] nix-daemon[842]: reaped child process 1422, status = succeeded5816lb # [ 108.670450] niks3-server[1051]: 2026/09/20 08:17:32 INFO Received uploads request method=POST path=/api/pending_closures5817worker2 # [ 108.689953] nix-grpc-daemon[1406]: time=2026-09-20T08:17:32.640Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5818worker2 # [ 108.692140] nix-grpc-daemon[1406]: time=2026-09-20T08:17:32.642Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5819lb # [ 108.705492] niks3-server[1051]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5820lb # [ 108.720299] niks3-server[1051]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5821lb # [ 108.729925] niks3-server[1051]: 2026/09/20 08:17:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5822lb # [ 108.735796] niks3-server[1051]: 2026/09/20 08:17:32 INFO Signed narinfos id=34 count=15823worker2 # [ 108.748811] nix-grpc-daemon[1406]: time=2026-09-20T08:17:32.699Z level=INFO msg="Uploading 1 narinfos"5824lb # [ 108.750141] niks3-server[1051]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5825lb # [ 108.752060] niks3-server[1051]: 2026/09/20 08:17:32 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5826lb # [ 108.756046] niks3-server[1051]: 2026/09/20 08:17:32 INFO Completed upload id=345827worker2 # [ 108.766272] nix-grpc-daemon[1406]: time=2026-09-20T08:17:32.717Z level=INFO msg="Upload complete. (264ms)"5828lb # [ 108.757640] niks3-server[1051]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5829worker2 # [ 108.771821] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41050 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15830worker2 # [ 108.786553] nix-daemon[842]: reaped child process 1380, status = succeeded5831client # [ 108.787355] systemd[1]: mid.service: Deactivated successfully.5832client # [ 108.791075] systemd[1]: mid.service: Consumed 117ms CPU time over 9.764s wall clock time, 39.3M memory peak, 9.8K incoming IP traffic, 10.7K outgoing IP traffic.5833client: (finished: waiting for success: ! systemctl is-active mid, in 1.10 seconds)5834client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5835client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5836(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.29 seconds)5837subtest: interrupting the client stops the build on the worker5838client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5839client # [ 109.288454] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5840client # Running as unit: intr.service; invocation ID: 84f2b51a740f4538ba4c5b7f615a2d6d5841client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5842client # [ 109.454276] nix[1235]: don't know how to build these paths:5843client # [ 109.455218] nix[1235]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5844worker2 # [ 109.492661] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:410505845worker2 # [ 109.504621] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:33Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05846worker2 # [ 109.508743] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:33Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15847worker1 # [ 109.512200] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483085848worker1 # [ 109.524252] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 1/5)5849worker1 # [ 109.594196] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 2/5)5850worker1 # [ 109.646225] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 271 ms (attempt 3/5)5851worker1 # [ 109.923505] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 4/5)5852worker1 # [ 110.180348] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5853worker1 # [ 110.198567] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483085854client # [ 110.207160] nix[1235]: copying 1 paths to 'lb:50051'...5855worker1 # [ 110.209623] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483085856client # [ 110.209601] nix[1235]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5857worker1 # [ 110.222081] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5858worker1 # [ 110.241137] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:34Z level=info event=niks3_push_started pid=15795859worker1 # [ 110.605969] nix-daemon[858]: accepted connection from pid 1596, user nix-grpc-daemon (trusted)5860worker1 # [ 110.617939] nix-daemon[858]: reaped child process 1599, status = succeeded5861worker1 # [ 110.791587] nix-daemon[858]: accepted connection from pid 1601, user nix-grpc-daemon (trusted)5862worker1 # [ 110.803417] nix-daemon[858]: reaped child process 1604, status = succeeded5863lb # [ 110.849527] niks3-server[1051]: 2026/09/20 08:17:34 INFO Received uploads request method=POST path=/api/pending_closures5864worker1 # [ 110.834233] nix-grpc-daemon[1579]: time=2026-09-20T08:17:34.930Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5865worker1 # [ 110.837271] nix-grpc-daemon[1579]: time=2026-09-20T08:17:34.932Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5866lb # [ 110.886334] niks3-server[1051]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5867lb # [ 110.894884] niks3-server[1051]: 2026/09/20 08:17:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5868worker1 # [ 110.875415] nix-grpc-daemon[1579]: time=2026-09-20T08:17:34.971Z level=INFO msg="Uploading 1 narinfos"5869lb # [ 110.902236] niks3-server[1051]: 2026/09/20 08:17:34 INFO Signed narinfos id=35 count=15870lb # [ 110.912245] niks3-server[1051]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5871lb # [ 110.920504] niks3-server[1051]: 2026/09/20 08:17:34 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5872worker1 # [ 110.899599] nix-grpc-daemon[1579]: time=2026-09-20T08:17:34.996Z level=INFO msg="Upload complete. (454ms)"5873lb # [ 110.927096] niks3-server[1051]: 2026/09/20 08:17:34 INFO Completed upload id=355874lb # [ 110.930634] niks3-server[1051]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5875worker1 # [ 110.902236] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=4245876worker1 # [ 110.908419] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483085877worker1 # [ 110.917510] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5878worker1 # [ 110.921160] nix-daemon[858]: reaped child process 1577, status = succeeded5879worker1 # [ 110.925994] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5880client # [ 110.925172] nix[1235]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5881client: must succeed: systemctl kill -s INT intr5882client # [ 111.694103] systemd[1]: intr.service: Sent signal SIGINT to main process 1235 (nix) on client request.5883client # [ 111.701258] nix[1235]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5884client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5885client # [ 111.708525] nix[1235]: error: interrupted by the user5886client # [ 111.739501] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5887client # [ 111.741437] systemd[1]: intr.service: Failed with result 'exit-code'.5888worker1 # [ 111.744909] nix-daemon[858]: reaped child process 1606, status = succeeded5889client # [ 111.743138] systemd[1]: intr.service: Consumed 103ms CPU time over 2.452s wall clock time, 39.3M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5890worker1 # [ 111.748248] nix-daemon[1608]: unexpected Nix daemon error: error: interrupted by the user5891worker1 # [ 111.752927] nix-daemon[858]: reaped child process 1608, status = failed with exit code 15892(finished: subtest: interrupting the client stops the build on the worker, in 2.57 seconds)5893subtest: a deploy mid-build drains: the build finishes, the new generation takes over5894client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5895client # [ 111.859727] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5896client # Running as unit: sw.service; invocation ID: eaa2f5c7f7db46369471911c0aa601095897client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5898client # [ 112.054616] nix[1256]: don't know how to build these paths:5899client # [ 112.055965] nix[1256]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5900worker1 # [ 112.055094] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483085901worker2 # [ 112.103162] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:36Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05902worker2 # [ 112.105331] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:36Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15903worker2 # [ 112.146696] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410505904worker2 # [ 112.153833] nix-grpc-daemon[1327]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5905worker2 # [ 112.195696] nix-grpc-daemon[1327]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 2/5)5906worker2 # [ 112.378648] nix-grpc-daemon[1327]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 3/5)5907worker2 # [ 112.392162] nix-grpc-daemon[1327]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 4/5)5908worker2 # [ 112.420846] nix-grpc-daemon[1327]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5909worker2 # [ 112.433532] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410505910client # [ 112.401159] nix[1256]: copying 1 paths to 'lb:50051'...5911worker2 # [ 112.441124] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410505912client # [ 112.405063] nix[1256]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5913worker2 # [ 112.446885] nix-daemon[842]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5914worker2 # [ 112.600610] nix-daemon[842]: accepted connection from pid 1453, user nix-grpc-daemon (trusted)5915worker2 # [ 112.615052] nix-daemon[842]: reaped child process 1456, status = succeeded5916worker2 # [ 112.781262] nix-daemon[842]: accepted connection from pid 1458, user nix-grpc-daemon (trusted)5917worker2 # [ 112.794554] nix-daemon[842]: reaped child process 1461, status = succeeded5918lb # [ 112.804168] niks3-server[1051]: 2026/09/20 08:17:36 INFO Received uploads request method=POST path=/api/pending_closures5919worker2 # [ 112.821562] nix-grpc-daemon[1406]: time=2026-09-20T08:17:36.772Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5920worker2 # [ 112.823055] nix-grpc-daemon[1406]: time=2026-09-20T08:17:36.774Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5921lb # [ 112.836091] niks3-server[1051]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5922lb # [ 112.849336] niks3-server[1051]: 2026/09/20 08:17:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5923lb # [ 112.853337] niks3-server[1051]: 2026/09/20 08:17:36 INFO Signed narinfos id=36 count=15924worker2 # [ 112.866701] nix-grpc-daemon[1406]: time=2026-09-20T08:17:36.817Z level=INFO msg="Uploading 1 narinfos"5925lb # [ 112.860483] niks3-server[1051]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5926lb # [ 112.871430] niks3-server[1051]: 2026/09/20 08:17:36 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5927worker2 # [ 112.887945] nix-grpc-daemon[1406]: time=2026-09-20T08:17:36.839Z level=INFO msg="Upload complete. (434ms)"5928lb # [ 112.877784] niks3-server[1051]: 2026/09/20 08:17:36 INFO Completed upload id=365929worker2 # [ 112.890067] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41050 duration_s=0 paths=1 nar_bytes_in=4165930worker2 # [ 112.894195] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410505931lb # [ 112.883656] niks3-server[1051]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5932worker2 # [ 112.901406] nix-daemon[842]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5933worker2 # [ 112.903925] nix-daemon[842]: reaped child process 1451, status = succeeded5934worker2 # [ 112.909337] nix-daemon[842]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5935client # [ 112.869516] nix[1256]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5936worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25937worker2 # Checking switch inhibitors... done5938worker2 # [ 115.056404] nixos[1496]: switching to system configuration /nix/store/zs0ssf35ybp424vba3378idd6czs45gr-nixos-system-worker2-test5939worker2 # [ 115.059411] systemd[1]: Stopped target Local File Systems.5940worker2 # activating the configuration...5941worker2 # [ 115.061451] systemd[1]: Stopped target Remote File Systems.5942worker2 # setting up /etc...5943worker2 # [ 115.713207] systemd[1]: Reload requested from client PID 1496 ('.switch-to-conf') (unit backdoor.service)...5944worker2 # [ 115.714789] systemd[1]: Reloading...5945worker2 # [ 116.408336] systemd[1]: Reloading finished in 690 ms.5946worker2 # restarting sysinit-reactivation.target5947worker2 # [ 116.466131] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5948worker2 # [ 116.606530] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5949worker2 # [ 116.609363] systemd[1]: Reached target Reactivate sysinit units.5950worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5951worker2 # [ 116.613903] systemd[1]: Reloading D-Bus System Message Bus...5952worker2 # [ 116.615673] dbus-broker-launch[532]: Caught SIGHUP, trigger reload.5953worker2 # [ 116.619859] systemd[1]: Reloading Nix worker-protocol over gRPC...5954worker2 # [ 116.652359] dbus-broker-launch[532]: Looking up NSS user entry for 'systemd-timesync'...5955worker2 # [ 116.654401] dbus-broker-launch[532]: NSS returned no entry for 'systemd-timesync'5956worker2 # [ 116.655858] dbus-broker-launch[532]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5957worker2 # [ 116.663629] systemd[1]: Reloaded Nix worker-protocol over gRPC.5958worker2 # [ 116.682372] systemd[1]: Reloaded D-Bus System Message Bus.5959worker2 # [ 116.688405] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5960worker2 # [ 116.689905] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5961worker2 # [ 116.693344] systemd[1]: Reached target Local File Systems.5962worker2 # [ 116.695141] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5963worker2 # [ 116.700652] systemd[1]: Starting Create SUID/SGID Wrappers...5964worker2 # [ 116.702813] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5965worker2 # [ 116.704075] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675966worker2 # [ 116.706156] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5967worker2 # [ 116.707595] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5968worker2 # [ 116.708787] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5969worker2 # [ 116.713689] systemd[1]: Reached target Remote File Systems.5970worker2 # [ 117.123741] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5971worker2 # [ 117.130247] systemd[1]: Finished Create SUID/SGID Wrappers.5972worker2 # [ 117.132310] systemd[1]: Starting linger-users.service...5973worker2 # [ 117.175192] systemd[1]: linger-users.service: Deactivated successfully.5974worker2 # [ 117.178107] systemd[1]: Finished linger-users.service.5975worker2 # [ 117.284300] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:41Z level=info event=draining5976worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5977worker2 # [ 117.435042] nixos[1496]: finished switching to system configuration /nix/store/zs0ssf35ybp424vba3378idd6czs45gr-nixos-system-worker2-test5978worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.05 seconds)5979worker2: must succeed: pgrep -f 'read -t [9]0 x'5980worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5981client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25982worker1 # [ 117.646937] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483085983client # don't know how to build these paths:5984client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5985worker2 # [ 117.699735] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:41Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05986worker2 # [ 117.701799] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:41Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15987worker1 # [ 117.705598] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483085988worker1 # [ 117.720746] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483085989client # copying 1 paths to 'lb:50051'...5990worker1 # [ 117.730929] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483085991client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5992worker1 # [ 117.751544] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5993lb # [ 117.906465] envoy[912]: conn peer=[2001:db8:1::1]:56824 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3865 tx=1680 ms=95355994lb # [ 117.908065] envoy[912]: conn peer=[2001:db8:1::1]:54434 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=730 ms=22675995worker1 # [ 117.919348] nix-daemon[858]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)5996worker1 # [ 117.931306] nix-daemon[858]: reaped child process 1653, status = succeeded5997worker1 # [ 118.076074] nix-daemon[858]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)5998worker1 # [ 118.087377] nix-daemon[858]: reaped child process 1658, status = succeeded5999lb # [ 118.127545] niks3-server[1051]: 2026/09/20 08:17:41 INFO Received uploads request method=POST path=/api/pending_closures6000worker1 # [ 118.110478] nix-grpc-daemon[1579]: time=2026-09-20T08:17:42.206Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6001worker1 # [ 118.111972] nix-grpc-daemon[1579]: time=2026-09-20T08:17:42.208Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6002lb # [ 118.164122] niks3-server[1051]: 2026/09/20 08:17:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6003worker1 # [ 118.145755] nix-grpc-daemon[1579]: time=2026-09-20T08:17:42.242Z level=INFO msg="Uploading 1 narinfos"6004lb # [ 118.172797] niks3-server[1051]: 2026/09/20 08:17:42 INFO Signed narinfos id=37 count=16005lb # [ 118.192600] niks3-server[1051]: 2026/09/20 08:17:42 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6006lb # [ 118.225577] niks3-server[1051]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6007lb # [ 118.239168] niks3-server[1051]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6008lb # [ 118.245536] niks3-server[1051]: 2026/09/20 08:17:42 INFO Completed upload id=376009worker1 # [ 118.218489] nix-grpc-daemon[1579]: time=2026-09-20T08:17:42.314Z level=INFO msg="Upload complete. (455ms)"6010lb # [ 118.250326] niks3-server[1051]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6011worker1 # [ 118.224182] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=5286012worker1 # [ 118.231407] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086013worker1 # [ 118.245172] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6014worker1 # [ 118.258106] nix-daemon[858]: reaped child process 1648, status = succeeded6015client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6016client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6017worker1 # [ 118.268283] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6018client # farm-a> LOG-farm-a-during-drain6019worker1 # [ 119.287241] nix-daemon[858]: reaped child process 1662, status = succeeded6020worker1 # [ 119.432336] nix-daemon[858]: accepted connection from pid 1677, user nix-grpc-daemon (trusted)6021worker1 # [ 119.443454] nix-daemon[858]: reaped child process 1680, status = succeeded6022lb # [ 119.485069] niks3-server[1051]: 2026/09/20 08:17:43 INFO Received uploads request method=POST path=/api/pending_closures6023worker1 # [ 119.462438] nix-grpc-daemon[1579]: time=2026-09-20T08:17:43.558Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6024worker1 # [ 119.463896] nix-grpc-daemon[1579]: time=2026-09-20T08:17:43.560Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6025lb # [ 119.508669] niks3-server[1051]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6026lb # [ 119.513197] niks3-server[1051]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6027lb # [ 119.524379] niks3-server[1051]: 2026/09/20 08:17:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6028lb # [ 119.526704] niks3-server[1051]: 2026/09/20 08:17:43 INFO Signed narinfos id=38 count=16029worker1 # [ 119.501048] nix-grpc-daemon[1579]: time=2026-09-20T08:17:43.597Z level=INFO msg="Uploading 1 narinfos"6030lb # [ 119.530087] niks3-server[1051]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6031lb # [ 119.535267] niks3-server[1051]: 2026/09/20 08:17:43 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6032lb # [ 119.538532] niks3-server[1051]: 2026/09/20 08:17:43 INFO Completed upload id=386033worker1 # [ 119.512471] nix-grpc-daemon[1579]: time=2026-09-20T08:17:43.608Z level=INFO msg="Upload complete. (234ms)"6034lb # [ 119.540405] niks3-server[1051]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6035worker1 # [ 119.514906] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16036worker2 # [ 119.557672] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:43Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06037worker1 # [ 119.521598] nix-daemon[858]: reaped child process 1660, status = succeeded6038worker2 # [ 119.559764] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:43Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16039worker1 # [ 119.565939] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086040worker1 # [ 119.574341] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086041worker1 # [ 119.580380] nix-grpc-daemon[1579]: time=2026-09-20T08:17:43.676Z level=INFO msg="All 1 paths already cached"6042client # copying 1 paths to 'lb:50051'...6043worker1 # [ 119.585348] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086044client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6045worker1 # [ 119.602522] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6046worker1 # [ 119.749687] nix-daemon[858]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)6047worker1 # [ 119.761715] nix-daemon[858]: reaped child process 1687, status = succeeded6048worker1 # [ 119.912348] nix-daemon[858]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6049worker1 # [ 119.924312] nix-daemon[858]: reaped child process 1692, status = succeeded6050lb # [ 119.963667] niks3-server[1051]: 2026/09/20 08:17:43 INFO Received uploads request method=POST path=/api/pending_closures6051worker1 # [ 119.940769] nix-grpc-daemon[1579]: time=2026-09-20T08:17:44.037Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6052worker1 # [ 119.942267] nix-grpc-daemon[1579]: time=2026-09-20T08:17:44.038Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6053lb # [ 119.980953] niks3-server[1051]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6054lb # [ 119.983365] niks3-server[1051]: 2026/09/20 08:17:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6055lb # [ 119.986546] niks3-server[1051]: 2026/09/20 08:17:43 INFO Signed narinfos id=39 count=16056worker1 # [ 119.959485] nix-grpc-daemon[1579]: time=2026-09-20T08:17:44.056Z level=INFO msg="Uploading 1 narinfos"6057lb # [ 119.989657] niks3-server[1051]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6058lb # [ 119.994155] niks3-server[1051]: 2026/09/20 08:17:43 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6059lb # [ 119.997925] niks3-server[1051]: 2026/09/20 08:17:43 INFO Completed upload id=396060worker1 # [ 119.970670] nix-grpc-daemon[1579]: time=2026-09-20T08:17:44.067Z level=INFO msg="Upload complete. (362ms)"6061lb # [ 119.999519] niks3-server[1051]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6062worker1 # [ 119.972713] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=6406063worker1 # [ 119.976452] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086064worker1 # [ 119.983071] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6065worker1 # [ 119.984342] nix-daemon[858]: reaped child process 1682, status = succeeded6066worker1 # [ 119.989385] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6067client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6068client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6069worker1 # [ 121.002077] nix-daemon[858]: reaped child process 1696, status = succeeded6070client # farm-b> LOG-farm-b-during-drain6071worker1 # [ 121.144293] nix-daemon[858]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6072worker1 # [ 121.156331] nix-daemon[858]: reaped child process 1714, status = succeeded6073lb # [ 121.200086] niks3-server[1051]: 2026/09/20 08:17:45 INFO Received uploads request method=POST path=/api/pending_closures6074worker1 # [ 121.177419] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.273Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6075worker1 # [ 121.178909] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.275Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6076lb # [ 121.219189] niks3-server[1051]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6077lb # [ 121.223152] niks3-server[1051]: 2026/09/20 08:17:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6078lb # [ 121.224756] niks3-server[1051]: 2026/09/20 08:17:45 INFO Signed narinfos id=40 count=16079worker1 # [ 121.198913] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.295Z level=INFO msg="Uploading 1 narinfos"6080lb # [ 121.228475] niks3-server[1051]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6081lb # [ 121.230437] niks3-server[1051]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6082lb # [ 121.235430] niks3-server[1051]: 2026/09/20 08:17:45 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6083lb # [ 121.238398] niks3-server[1051]: 2026/09/20 08:17:45 INFO Completed upload id=406084worker1 # [ 121.212389] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.308Z level=INFO msg="Upload complete. (215ms)"6085lb # [ 121.240208] niks3-server[1051]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6086worker1 # [ 121.214974] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16087worker2 # [ 121.258406] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:45Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06088worker1 # [ 121.221707] nix-daemon[858]: reaped child process 1694, status = succeeded6089worker2 # [ 121.260333] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:45Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16090worker1 # [ 121.264401] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086091worker1 # [ 121.276091] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086092worker1 # [ 121.287839] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.384Z level=INFO msg="All 2 paths already cached"6093client # copying 1 paths to 'lb:50051'...6094client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6095worker1 # [ 121.295524] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086096worker1 # [ 121.309201] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6097worker1 # [ 121.475729] nix-daemon[858]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6098worker1 # [ 121.488337] nix-daemon[858]: reaped child process 1721, status = succeeded6099worker1 # [ 121.646314] nix-daemon[858]: accepted connection from pid 1723, user nix-grpc-daemon (trusted)6100worker1 # [ 121.658105] nix-daemon[858]: reaped child process 1726, status = succeeded6101lb # [ 121.701669] niks3-server[1051]: 2026/09/20 08:17:45 INFO Received uploads request method=POST path=/api/pending_closures6102worker1 # [ 121.678857] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.775Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6103worker1 # [ 121.680310] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.775Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6104lb # [ 121.719508] niks3-server[1051]: 2026/09/20 08:17:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6105lb # [ 121.721544] niks3-server[1051]: 2026/09/20 08:17:45 INFO Signed narinfos id=41 count=16106worker1 # [ 121.695657] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.792Z level=INFO msg="Uploading 1 narinfos"6107lb # [ 121.724469] niks3-server[1051]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6108lb # [ 121.727407] niks3-server[1051]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6109lb # [ 121.732024] niks3-server[1051]: 2026/09/20 08:17:45 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6110lb # [ 121.735107] niks3-server[1051]: 2026/09/20 08:17:45 INFO Completed upload id=416111worker1 # [ 121.708994] nix-grpc-daemon[1579]: time=2026-09-20T08:17:45.805Z level=INFO msg="Upload complete. (388ms)"6112lb # [ 121.736897] niks3-server[1051]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6113worker1 # [ 121.710902] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=7686114worker1 # [ 121.713648] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086115worker1 # [ 121.718969] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6116worker1 # [ 121.724944] nix-daemon[858]: reaped child process 1716, status = succeeded6117worker1 # [ 121.728249] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6118client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6119client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6120worker1 # [ 122.741534] nix-daemon[858]: reaped child process 1730, status = succeeded6121client # farm-top> LOG-farm-top-during-drain6122worker1 # [ 122.872134] nix-daemon[858]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6123worker1 # [ 122.884203] nix-daemon[858]: reaped child process 1748, status = succeeded6124lb # [ 122.924582] niks3-server[1051]: 2026/09/20 08:17:46 INFO Received uploads request method=POST path=/api/pending_closures6125worker1 # [ 122.902305] nix-grpc-daemon[1579]: time=2026-09-20T08:17:46.997Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6126worker1 # [ 122.903638] nix-grpc-daemon[1579]: time=2026-09-20T08:17:46.997Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6127lb # [ 122.938252] niks3-server[1051]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6128lb # [ 122.946869] niks3-server[1051]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6129lb # [ 122.949228] niks3-server[1051]: 2026/09/20 08:17:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6130lb # [ 122.951295] niks3-server[1051]: 2026/09/20 08:17:46 INFO Signed narinfos id=42 count=16131worker1 # [ 122.924220] nix-grpc-daemon[1579]: time=2026-09-20T08:17:47.020Z level=INFO msg="Uploading 1 narinfos"6132lb # [ 122.954874] niks3-server[1051]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6133lb # [ 122.958926] niks3-server[1051]: 2026/09/20 08:17:46 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6134lb # [ 122.961660] niks3-server[1051]: 2026/09/20 08:17:46 INFO Completed upload id=426135worker1 # [ 122.934234] nix-grpc-daemon[1579]: time=2026-09-20T08:17:47.030Z level=INFO msg="Upload complete. (199ms)"6136lb # [ 122.964162] niks3-server[1051]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6137worker1 # [ 122.936545] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16138worker1 # [ 122.943060] nix-daemon[858]: reaped child process 1728, status = succeeded6139client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 5.52 seconds)6140client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6141client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.21 seconds)6142worker2: must succeed: pkill -f 'read -t [9]0 x'6143worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6144client: waiting for success: ! systemctl is-active sw6145worker2 # [ 123.337168] nix-daemon[842]: reaped child process 1465, status = succeeded6146worker2 # [ 123.473106] nix-daemon[842]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6147worker2 # [ 123.488218] nix-daemon[842]: reaped child process 1645, status = succeeded6148lb # [ 123.489775] niks3-server[1051]: 2026/09/20 08:17:47 INFO Received uploads request method=POST path=/api/pending_closures6149worker2 # [ 123.508432] nix-grpc-daemon[1406]: time=2026-09-20T08:17:47.459Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6150worker2 # [ 123.510654] nix-grpc-daemon[1406]: time=2026-09-20T08:17:47.459Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6151lb # [ 123.519282] niks3-server[1051]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6152lb # [ 123.534859] niks3-server[1051]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6153lb # [ 123.542623] niks3-server[1051]: 2026/09/20 08:17:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6154worker2 # [ 123.559078] nix-grpc-daemon[1406]: time=2026-09-20T08:17:47.509Z level=INFO msg="Uploading 1 narinfos"6155lb # [ 123.548880] niks3-server[1051]: 2026/09/20 08:17:47 INFO Signed narinfos id=43 count=16156lb # [ 123.555618] niks3-server[1051]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6157lb # [ 123.563445] niks3-server[1051]: 2026/09/20 08:17:47 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6158lb # [ 123.569361] niks3-server[1051]: 2026/09/20 08:17:47 INFO Completed upload id=436159worker2 # [ 123.579837] nix-grpc-daemon[1406]: time=2026-09-20T08:17:47.530Z level=INFO msg="Upload complete. (251ms)"6160lb # [ 123.570845] niks3-server[1051]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6161worker2 # [ 123.585549] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41050 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16162worker2 # [ 123.598206] nix-daemon[842]: reaped child process 1463, status = succeeded6163client # [ 123.586191] systemd[1]: sw.service: Deactivated successfully.6164client # [ 123.589836] systemd[1]: sw.service: Consumed 111ms CPU time over 11.729s wall clock time, 39.2M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.6165worker2 # [ 124.286842] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=signal_exit6166client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6167client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6168client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6169worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6170worker2 # [ 124.504743] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=scheduler_yield6171worker1 # [ 124.470422] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:48Z level=info event=scheduler_restarting addr=lb:500516172lb # [ 124.497370] niks3-server[1051]: 2026/09/20 08:17:48 INFO lead: released remote=192.168.1.4:609386173worker2 # [ 124.511460] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:410406174worker2 # [ 124.515986] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=worker_gone addr=192.168.1.3:500516175worker2 # [ 124.519848] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=scheduler_restarting addr=lb:500516176worker2 # [ 124.522897] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:410406177worker2 # [ 124.526227] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=worker_gone addr=192.168.1.4:500516178worker1 # [ 124.670706] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500516179worker2 # [ 124.721344] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500516180worker1 # [ 124.682854] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6181worker2 # [ 124.725380] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6182worker1 # [ 124.883894] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500516183worker2 # [ 124.925913] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500516184worker1 # [ 124.889523] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6185worker2 # [ 124.931559] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6186worker1 # [ 125.090599] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500516187worker2 # [ 125.132436] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500516188worker1 # [ 125.096101] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6189worker2 # [ 125.137633] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6190worker1 # [ 125.296956] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500516191worker2 # [ 125.338936] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500516192worker1 # [ 125.302219] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6193worker2 # [ 125.343803] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6194worker2 # [ 125.508881] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:49Z level=info event=scheduler_restarting6195worker2 # [ 125.531416] nix-daemon[842]: reaped child process 1378, status = succeeded6196worker1 # [ 125.503994] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500516197worker1 # [ 125.508730] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6198worker2 # [ 125.555978] nix-grpc-daemon[1327]: ts=2026-09-20T08:17:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6199worker2 # [ 125.674241] nix-grpc-daemon[1327]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6200worker2 # [ 125.677918] nix-grpc-daemon[1327]: E0000 00:00:1789892269.624809 1370 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6201worker2 # [ 125.682607] nix-grpc-daemon[1327]: E0000 00:00:1789892269.625308 1370 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6202worker1 # [ 125.709439] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500516203worker2 # [ 125.749607] nix-grpc-daemon[1327]: E0000 00:00:1789892269.699763 1370 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true6204worker1 # [ 127.266896] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"6205worker2 # [ 127.320683] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6206worker2 # [ 127.324436] systemd[1]: nix-grpc-daemon.service: Consumed 689ms CPU time over 24.404s wall clock time, 33.8M memory peak, 23.7K incoming IP traffic, 32.4K outgoing IP traffic.6207worker2 # [ 127.340470] systemd[1]: Starting Nix worker-protocol over gRPC...6208worker2 # [ 127.490965] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6209worker2 # [ 127.495201] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16210worker2 # [ 127.501605] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6211worker2 # [ 127.505971] systemd[1]: Started Nix worker-protocol over gRPC.6212worker1 # [ 127.467130] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500516213worker1 # [ 127.472681] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6214lb # [ 127.502243] niks3-server[1051]: 2026/09/20 08:17:51 INFO lead: acquired remote=192.168.1.4:410146215worker2 # [ 127.518081] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:51Z level=info event=scheduler_take_over6216worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.14 seconds)6217lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6218lb: must succeed: curl -sf localhost:9901/clusters6219worker2 # [ 127.532492] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500516220worker2 # [ 127.541618] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06221lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6222worker1 # [ 127.673421] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500516223worker1 # [ 127.676403] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6224worker1 # [ 127.877503] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500516225lb # [ 127.907198] envoy[912]: conn peer=[2001:db8:1::1]:49250 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9429 tx=3765 ms=53066226worker2 # [ 127.917899] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06227lb # [ 127.911191] envoy[912]: conn peer=[2001:db8:1::1]:54440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1352 ms=115086228lb # [ 127.914906] envoy[912]: conn peer=[2001:db8:1::4]:39062 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1721 tx=529 ms=222436229lb: must succeed: curl -sf localhost:9901/clusters6230lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6231lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.12 seconds)6232lb: must succeed: curl -sf localhost:9901/clusters6233lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6234worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6235worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6236(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.89 seconds)6237subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6238client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16239worker1 # [ 128.943229] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483086240worker2 # [ 128.991881] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:52Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06241worker2 # [ 128.996483] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:52Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16242worker2 # [ 129.000820] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:52Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06243worker2 # [ 129.004669] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:52Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06244worker1 # [ 129.001859] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086245worker1 # [ 129.010831] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086246worker1 # [ 129.018777] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086247worker1 # [ 129.025736] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6248worker1 # [ 129.197118] nix-daemon[858]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6249worker1 # [ 129.209457] nix-daemon[858]: reaped child process 1755, status = succeeded6250worker1 # [ 129.383315] nix-daemon[858]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)6251worker1 # [ 129.394954] nix-daemon[858]: reaped child process 1760, status = succeeded6252lb # [ 129.439817] niks3-server[1051]: 2026/09/20 08:17:53 INFO Received uploads request method=POST path=/api/pending_closures6253worker1 # [ 129.421893] nix-grpc-daemon[1579]: time=2026-09-20T08:17:53.517Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6254worker1 # [ 129.423271] nix-grpc-daemon[1579]: time=2026-09-20T08:17:53.517Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6255lb # [ 129.468644] niks3-server[1051]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6256lb # [ 129.482125] niks3-server[1051]: 2026/09/20 08:17:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6257worker1 # [ 129.459904] nix-grpc-daemon[1579]: time=2026-09-20T08:17:53.556Z level=INFO msg="Uploading 1 narinfos"6258lb # [ 129.487644] niks3-server[1051]: 2026/09/20 08:17:53 INFO Signed narinfos id=44 count=16259lb # [ 129.492896] niks3-server[1051]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6260lb # [ 129.504581] niks3-server[1051]: 2026/09/20 08:17:53 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6261lb # [ 129.510236] niks3-server[1051]: 2026/09/20 08:17:53 INFO Completed upload id=446262worker1 # [ 129.482910] nix-grpc-daemon[1579]: time=2026-09-20T08:17:53.579Z level=INFO msg="Upload complete. (450ms)"6263worker1 # [ 129.486636] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=5046264lb # [ 129.515131] niks3-server[1051]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6265worker1 # [ 129.491696] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086266worker1 # [ 129.500798] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6267worker1 # [ 129.509744] nix-daemon[858]: reaped child process 1750, status = succeeded6268worker1 # [ 129.512958] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6269worker1 # [ 130.940773] nix-daemon[858]: reaped child process 1764, status = succeeded6270worker1 # [ 131.096439] nix-daemon[858]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)6271worker1 # [ 131.108188] nix-daemon[858]: reaped child process 1782, status = succeeded6272lb # [ 131.152684] niks3-server[1051]: 2026/09/20 08:17:54 INFO Received uploads request method=POST path=/api/pending_closures6273worker1 # [ 131.137096] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.233Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6274worker1 # [ 131.138590] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.235Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6275lb # [ 131.199067] niks3-server[1051]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6276lb # [ 131.205324] niks3-server[1051]: 2026/09/20 08:17:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6277worker1 # [ 131.187486] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.283Z level=INFO msg="Uploading 1 narinfos"6278lb # [ 131.214504] niks3-server[1051]: 2026/09/20 08:17:55 INFO Signed narinfos id=45 count=16279lb # [ 131.223554] niks3-server[1051]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6280lb # [ 131.236896] niks3-server[1051]: 2026/09/20 08:17:55 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6281lb # [ 131.241972] niks3-server[1051]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6282lb # [ 131.244419] niks3-server[1051]: 2026/09/20 08:17:55 INFO Completed upload id=456283lb # [ 131.245913] niks3-server[1051]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6284worker1 # [ 131.218470] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.314Z level=INFO msg="Upload complete. (296ms)"6285worker2 # [ 131.263838] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:55Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16286worker2 # [ 131.266238] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:55Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06287worker1 # [ 131.223980] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16288worker1 # [ 131.238861] nix-daemon[858]: reaped child process 1762, status = succeeded6289worker1 # [ 131.269522] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086290worker1 # [ 131.281267] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086291worker1 # [ 131.292889] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086292worker1 # [ 131.302168] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6293worker1 # [ 131.474665] nix-daemon[858]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6294worker1 # [ 131.486465] nix-daemon[858]: reaped child process 1789, status = succeeded6295worker1 # [ 131.635248] nix-daemon[858]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)6296worker1 # [ 131.647099] nix-daemon[858]: reaped child process 1794, status = succeeded6297lb # [ 131.689760] niks3-server[1051]: 2026/09/20 08:17:55 INFO Received uploads request method=POST path=/api/pending_closures6298worker1 # [ 131.672038] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.768Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6299worker1 # [ 131.673839] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.770Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6300lb # [ 131.722458] niks3-server[1051]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6301lb # [ 131.733132] niks3-server[1051]: 2026/09/20 08:17:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6302lb # [ 131.740353] niks3-server[1051]: 2026/09/20 08:17:55 INFO Signed narinfos id=46 count=16303worker1 # [ 131.716497] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.812Z level=INFO msg="Uploading 1 narinfos"6304lb # [ 131.744213] niks3-server[1051]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6305lb # [ 131.757297] niks3-server[1051]: 2026/09/20 08:17:55 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6306lb # [ 131.761900] niks3-server[1051]: 2026/09/20 08:17:55 INFO Completed upload id=466307worker1 # [ 131.737344] nix-grpc-daemon[1579]: time=2026-09-20T08:17:55.833Z level=INFO msg="Upload complete. (423ms)"6308lb # [ 131.765295] niks3-server[1051]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6309worker1 # [ 131.742164] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=5046310worker1 # [ 131.747537] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086311worker1 # [ 131.757262] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6312worker1 # [ 131.764452] nix-daemon[858]: reaped child process 1784, status = succeeded6313worker1 # [ 131.769589] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6314worker1 # [ 132.595385] nix-daemon[858]: reaped child process 1798, status = succeeded6315worker1 # [ 132.746295] nix-daemon[858]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)6316worker1 # [ 132.757319] nix-daemon[858]: reaped child process 1816, status = succeeded6317lb # [ 132.801833] niks3-server[1051]: 2026/09/20 08:17:56 INFO Received uploads request method=POST path=/api/pending_closures6318worker1 # [ 132.782962] nix-grpc-daemon[1579]: time=2026-09-20T08:17:56.879Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6319worker1 # [ 132.784647] nix-grpc-daemon[1579]: time=2026-09-20T08:17:56.881Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6320lb # [ 132.839314] niks3-server[1051]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6321lb # [ 132.852349] niks3-server[1051]: 2026/09/20 08:17:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6322worker1 # [ 132.830772] nix-grpc-daemon[1579]: time=2026-09-20T08:17:56.927Z level=INFO msg="Uploading 1 narinfos"6323lb # [ 132.858671] niks3-server[1051]: 2026/09/20 08:17:56 INFO Signed narinfos id=47 count=16324lb # [ 132.864106] niks3-server[1051]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6325lb # [ 132.869150] niks3-server[1051]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6326lb # [ 132.878760] niks3-server[1051]: 2026/09/20 08:17:56 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6327lb # [ 132.884798] niks3-server[1051]: 2026/09/20 08:17:56 INFO Completed upload id=476328worker1 # [ 132.857811] nix-grpc-daemon[1579]: time=2026-09-20T08:17:56.954Z level=INFO msg="Upload complete. (281ms)"6329lb # [ 132.887215] niks3-server[1051]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6330worker1 # [ 132.864656] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16331worker2 # [ 132.901928] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:56Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16332worker2 # [ 132.911978] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:56Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06333worker1 # [ 132.876954] nix-daemon[858]: reaped child process 1796, status = succeeded6334worker1 # [ 132.907357] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086335worker1 # [ 132.921758] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086336worker1 # [ 132.933201] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086337worker1 # [ 132.943128] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6338worker1 # [ 133.110347] nix-daemon[858]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)6339worker1 # [ 133.122916] nix-daemon[858]: reaped child process 1823, status = succeeded6340worker1 # [ 133.283506] nix-daemon[858]: accepted connection from pid 1825, user nix-grpc-daemon (trusted)6341worker1 # [ 133.295976] nix-daemon[858]: reaped child process 1828, status = succeeded6342lb # [ 133.337808] niks3-server[1051]: 2026/09/20 08:17:57 INFO Received uploads request method=POST path=/api/pending_closures6343worker1 # [ 133.318346] nix-grpc-daemon[1579]: time=2026-09-20T08:17:57.414Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6344worker1 # [ 133.319828] nix-grpc-daemon[1579]: time=2026-09-20T08:17:57.416Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6345lb # [ 133.364575] niks3-server[1051]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6346lb # [ 133.375487] niks3-server[1051]: 2026/09/20 08:17:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6347worker1 # [ 133.354759] nix-grpc-daemon[1579]: time=2026-09-20T08:17:57.451Z level=INFO msg="Uploading 1 narinfos"6348lb # [ 133.383158] niks3-server[1051]: 2026/09/20 08:17:57 INFO Signed narinfos id=48 count=16349lb # [ 133.393266] niks3-server[1051]: 2026/09/20 08:17:57 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6350lb # [ 133.400132] niks3-server[1051]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6351worker1 # [ 133.377885] nix-grpc-daemon[1579]: time=2026-09-20T08:17:57.474Z level=INFO msg="Upload complete. (423ms)"6352lb # [ 133.404937] niks3-server[1051]: 2026/09/20 08:17:57 INFO Completed upload id=486353lb # [ 133.408504] niks3-server[1051]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6354worker1 # [ 133.381117] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=5046355worker1 # [ 133.385731] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086356worker1 # [ 133.394955] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6357worker1 # [ 133.398171] nix-daemon[858]: reaped child process 1818, status = succeeded6358worker1 # [ 133.403031] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6359worker1 # [ 134.226614] nix-daemon[858]: reaped child process 1832, status = succeeded6360worker1 # [ 134.374075] nix-daemon[858]: accepted connection from pid 1847, user nix-grpc-daemon (trusted)6361worker1 # [ 134.386138] nix-daemon[858]: reaped child process 1850, status = succeeded6362lb # [ 134.428813] niks3-server[1051]: 2026/09/20 08:17:58 INFO Received uploads request method=POST path=/api/pending_closures6363worker1 # [ 134.414127] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.510Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6364worker1 # [ 134.416155] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.512Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6365lb # [ 134.462940] niks3-server[1051]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6366lb # [ 134.478509] niks3-server[1051]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6367lb # [ 134.489097] niks3-server[1051]: 2026/09/20 08:17:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6368worker1 # [ 134.465611] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.561Z level=INFO msg="Uploading 1 narinfos"6369lb # [ 134.492786] niks3-server[1051]: 2026/09/20 08:17:58 INFO Signed narinfos id=49 count=16370lb # [ 134.497642] niks3-server[1051]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6371lb # [ 134.507482] niks3-server[1051]: 2026/09/20 08:17:58 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6372lb # [ 134.512637] niks3-server[1051]: 2026/09/20 08:17:58 INFO Completed upload id=496373worker1 # [ 134.485386] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.581Z level=INFO msg="Upload complete. (275ms)"6374lb # [ 134.513898] niks3-server[1051]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6375worker1 # [ 134.488375] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16376worker1 # [ 134.493439] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086377worker2 # [ 134.531237] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:58Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16378worker1 # [ 134.497642] nix-daemon[858]: reaped child process 1830, status = succeeded6379worker1 # [ 134.501237] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086380worker2 # [ 134.537689] nix-grpc-daemon[1659]: ts=2026-09-20T08:17:58Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06381worker1 # [ 134.506755] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.603Z level=INFO msg="All 1 paths already cached"6382worker1 # [ 134.511291] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086383worker1 # [ 134.516204] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6384worker1 # [ 134.664486] nix-daemon[858]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6385worker1 # [ 134.676745] nix-daemon[858]: reaped child process 1857, status = succeeded6386worker1 # [ 134.808513] nix-daemon[858]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6387worker1 # [ 134.820268] nix-daemon[858]: reaped child process 1862, status = succeeded6388lb # [ 134.858944] niks3-server[1051]: 2026/09/20 08:17:58 INFO Received uploads request method=POST path=/api/pending_closures6389worker1 # [ 134.839598] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.936Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6390worker1 # [ 134.841083] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.937Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6391lb # [ 134.888272] niks3-server[1051]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6392lb # [ 134.898841] niks3-server[1051]: 2026/09/20 08:17:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6393lb # [ 134.903380] niks3-server[1051]: 2026/09/20 08:17:58 INFO Signed narinfos id=50 count=16394worker1 # [ 134.878923] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.975Z level=INFO msg="Uploading 1 narinfos"6395lb # [ 134.907995] niks3-server[1051]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6396lb # [ 134.921106] niks3-server[1051]: 2026/09/20 08:17:58 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6397lb # [ 134.928609] niks3-server[1051]: 2026/09/20 08:17:58 INFO Completed upload id=506398worker1 # [ 134.901539] nix-grpc-daemon[1579]: time=2026-09-20T08:17:58.997Z level=INFO msg="Upload complete. (380ms)"6399worker1 # [ 134.905068] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=6246400lb # [ 134.932637] niks3-server[1051]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6401worker1 # [ 134.909389] nix-grpc-daemon[1491]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086402worker1 # [ 134.913825] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6403worker1 # [ 134.916095] nix-daemon[858]: reaped child process 1852, status = succeeded6404worker1 # [ 134.921335] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6405worker1 # [ 135.934384] nix-daemon[858]: reaped child process 1866, status = succeeded6406worker1 # [ 136.072775] nix-daemon[858]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6407worker1 # [ 136.085194] nix-daemon[858]: reaped child process 1884, status = succeeded6408lb # [ 136.129897] niks3-server[1051]: 2026/09/20 08:17:59 INFO Received uploads request method=POST path=/api/pending_closures6409worker1 # [ 136.109360] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.205Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6410worker1 # [ 136.112060] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.207Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6411lb # [ 136.161174] niks3-server[1051]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6412lb # [ 136.178256] niks3-server[1051]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6413lb # [ 136.188116] niks3-server[1051]: 2026/09/20 08:18:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6414worker1 # [ 136.165680] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.262Z level=INFO msg="Uploading 1 narinfos"6415lb # [ 136.192740] niks3-server[1051]: 2026/09/20 08:18:00 INFO Signed narinfos id=51 count=16416lb # [ 136.197249] niks3-server[1051]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6417lb # [ 136.202884] niks3-server[1051]: 2026/09/20 08:18:00 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6418lb # [ 136.206024] niks3-server[1051]: 2026/09/20 08:18:00 INFO Completed upload id=516419worker1 # [ 136.178841] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.275Z level=INFO msg="Upload complete. (251ms)"6420lb # [ 136.208419] niks3-server[1051]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6421worker1 # [ 136.183976] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16422worker2 # [ 136.222890] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:00Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16423worker1 # [ 136.196104] nix-daemon[858]: reaped child process 1864, status = succeeded6424worker2 # [ 136.232543] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:00Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06425worker1 # [ 136.227949] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086426worker1 # [ 136.238116] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086427worker1 # [ 136.249305] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.345Z level=INFO msg="All 1 paths already cached"6428worker1 # [ 136.255159] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086429worker1 # [ 136.265171] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6430worker1 # [ 136.436639] nix-daemon[858]: accepted connection from pid 1888, user nix-grpc-daemon (trusted)6431worker1 # [ 136.449241] nix-daemon[858]: reaped child process 1891, status = succeeded6432worker1 # [ 136.616170] nix-daemon[858]: accepted connection from pid 1893, user nix-grpc-daemon (trusted)6433worker1 # [ 136.627940] nix-daemon[858]: reaped child process 1896, status = succeeded6434lb # [ 136.671252] niks3-server[1051]: 2026/09/20 08:18:00 INFO Received uploads request method=POST path=/api/pending_closures6435worker1 # [ 136.648772] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.745Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6436worker1 # [ 136.650309] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.746Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6437lb # [ 136.690785] niks3-server[1051]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6438lb # [ 136.692737] niks3-server[1051]: 2026/09/20 08:18:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6439lb # [ 136.695555] niks3-server[1051]: 2026/09/20 08:18:00 INFO Signed narinfos id=52 count=16440worker1 # [ 136.668315] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.764Z level=INFO msg="Uploading 1 narinfos"6441lb # [ 136.698823] niks3-server[1051]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6442lb # [ 136.704199] niks3-server[1051]: 2026/09/20 08:18:00 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6443lb # [ 136.708114] niks3-server[1051]: 2026/09/20 08:18:00 INFO Completed upload id=526444worker1 # [ 136.680783] nix-grpc-daemon[1579]: time=2026-09-20T08:18:00.777Z level=INFO msg="Upload complete. (405ms)"6445lb # [ 136.709784] niks3-server[1051]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6446worker1 # [ 136.682726] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=6246447worker1 # [ 136.687038] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086448worker1 # [ 136.692467] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6449worker1 # [ 136.694771] nix-daemon[858]: reaped child process 1886, status = succeeded6450worker1 # [ 136.700179] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6451worker1 # [ 137.526900] nix-daemon[858]: reaped child process 1900, status = succeeded6452worker1 # [ 137.701079] nix-daemon[858]: accepted connection from pid 1915, user nix-grpc-daemon (trusted)6453worker1 # [ 137.713726] nix-daemon[858]: reaped child process 1918, status = succeeded6454lb # [ 137.757662] niks3-server[1051]: 2026/09/20 08:18:01 INFO Received uploads request method=POST path=/api/pending_closures6455worker1 # [ 137.736504] nix-grpc-daemon[1579]: time=2026-09-20T08:18:01.832Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6456worker1 # [ 137.737971] nix-grpc-daemon[1579]: time=2026-09-20T08:18:01.832Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6457lb # [ 137.776473] niks3-server[1051]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6458lb # [ 137.781301] niks3-server[1051]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6459lb # [ 137.783918] niks3-server[1051]: 2026/09/20 08:18:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6460lb # [ 137.786066] niks3-server[1051]: 2026/09/20 08:18:01 INFO Signed narinfos id=53 count=16461worker1 # [ 137.758972] nix-grpc-daemon[1579]: time=2026-09-20T08:18:01.855Z level=INFO msg="Uploading 1 narinfos"6462lb # [ 137.790515] niks3-server[1051]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6463lb # [ 137.796699] niks3-server[1051]: 2026/09/20 08:18:01 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6464lb # [ 137.799422] niks3-server[1051]: 2026/09/20 08:18:01 INFO Completed upload id=536465worker1 # [ 137.773446] nix-grpc-daemon[1579]: time=2026-09-20T08:18:01.869Z level=INFO msg="Upload complete. (266ms)"6466lb # [ 137.801602] niks3-server[1051]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6467worker1 # [ 137.775868] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16468worker2 # [ 137.816204] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:01Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16469worker1 # [ 137.780278] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086470worker2 # [ 137.822445] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:01Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06471worker1 # [ 137.786637] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086472worker1 # [ 137.788921] nix-daemon[858]: reaped child process 1898, status = succeeded6473worker1 # [ 137.793210] nix-grpc-daemon[1579]: time=2026-09-20T08:18:01.889Z level=INFO msg="All 1 paths already cached"6474worker1 # [ 137.797084] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086475worker1 # [ 137.800926] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6476worker1 # [ 137.961150] nix-daemon[858]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6477worker1 # [ 137.973697] nix-daemon[858]: reaped child process 1925, status = succeeded6478worker1 # [ 138.137678] nix-daemon[858]: accepted connection from pid 1927, user nix-grpc-daemon (trusted)6479worker1 # [ 138.151114] nix-daemon[858]: reaped child process 1930, status = succeeded6480lb # [ 138.193496] niks3-server[1051]: 2026/09/20 08:18:02 INFO Received uploads request method=POST path=/api/pending_closures6481worker1 # [ 138.170891] nix-grpc-daemon[1579]: time=2026-09-20T08:18:02.267Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6482worker1 # [ 138.172308] nix-grpc-daemon[1579]: time=2026-09-20T08:18:02.267Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6483lb # [ 138.207921] niks3-server[1051]: 2026/09/20 08:18:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6484lb # [ 138.209795] niks3-server[1051]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6485lb # [ 138.212243] niks3-server[1051]: 2026/09/20 08:18:02 INFO Signed narinfos id=54 count=16486worker1 # [ 138.186404] nix-grpc-daemon[1579]: time=2026-09-20T08:18:02.282Z level=INFO msg="Uploading 1 narinfos"6487lb # [ 138.216190] niks3-server[1051]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6488lb # [ 138.220065] niks3-server[1051]: 2026/09/20 08:18:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6489lb # [ 138.222827] niks3-server[1051]: 2026/09/20 08:18:02 INFO Completed upload id=546490worker1 # [ 138.195582] nix-grpc-daemon[1579]: time=2026-09-20T08:18:02.292Z level=INFO msg="Upload complete. (388ms)"6491worker1 # [ 138.197482] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=6246492lb # [ 138.225440] niks3-server[1051]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6493worker1 # [ 138.200545] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086494worker1 # [ 138.206477] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6495worker1 # [ 138.209870] nix-daemon[858]: reaped child process 1920, status = succeeded6496worker1 # [ 138.215119] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6497worker1 # [ 139.028838] nix-daemon[858]: reaped child process 1934, status = succeeded6498worker1 # [ 139.182282] nix-daemon[858]: accepted connection from pid 1949, user nix-grpc-daemon (trusted)6499worker1 # [ 139.196166] nix-daemon[858]: reaped child process 1952, status = succeeded6500lb # [ 139.234694] niks3-server[1051]: 2026/09/20 08:18:03 INFO Received uploads request method=POST path=/api/pending_closures6501worker1 # [ 139.215584] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.311Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6502worker1 # [ 139.217180] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.313Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6503lb # [ 139.274977] niks3-server[1051]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6504lb # [ 139.281102] niks3-server[1051]: 2026/09/20 08:18:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6505lb # [ 139.285084] niks3-server[1051]: 2026/09/20 08:18:03 INFO Signed narinfos id=55 count=16506worker1 # [ 139.260335] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.356Z level=INFO msg="Uploading 1 narinfos"6507lb # [ 139.292282] niks3-server[1051]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6508lb # [ 139.299762] niks3-server[1051]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6509lb # [ 139.305915] niks3-server[1051]: 2026/09/20 08:18:03 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6510lb # [ 139.308609] niks3-server[1051]: 2026/09/20 08:18:03 INFO Completed upload id=556511worker1 # [ 139.281601] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.377Z level=INFO msg="Upload complete. (260ms)"6512lb # [ 139.312056] niks3-server[1051]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6513worker1 # [ 139.286592] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16514worker1 # [ 139.293500] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086515worker2 # [ 139.329590] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:03Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16516worker2 # [ 139.338244] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:03Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06517worker1 # [ 139.303444] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086518worker1 # [ 139.306840] nix-daemon[858]: reaped child process 1932, status = succeeded6519worker1 # [ 139.310392] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.406Z level=INFO msg="All 2 paths already cached"6520worker1 # [ 139.313949] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086521worker1 # [ 139.317992] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6522worker1 # [ 139.482487] nix-daemon[858]: accepted connection from pid 1956, user nix-grpc-daemon (trusted)6523worker1 # [ 139.494537] nix-daemon[858]: reaped child process 1959, status = succeeded6524worker1 # [ 139.654352] nix-daemon[858]: accepted connection from pid 1961, user nix-grpc-daemon (trusted)6525worker1 # [ 139.666277] nix-daemon[858]: reaped child process 1964, status = succeeded6526lb # [ 139.709064] niks3-server[1051]: 2026/09/20 08:18:03 INFO Received uploads request method=POST path=/api/pending_closures6527worker1 # [ 139.689472] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.785Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6528worker1 # [ 139.690960] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.787Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6529lb # [ 139.741777] niks3-server[1051]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6530lb # [ 139.748393] niks3-server[1051]: 2026/09/20 08:18:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6531lb # [ 139.753925] niks3-server[1051]: 2026/09/20 08:18:03 INFO Signed narinfos id=56 count=16532worker1 # [ 139.729732] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.826Z level=INFO msg="Uploading 1 narinfos"6533lb # [ 139.758920] niks3-server[1051]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6534lb # [ 139.770975] niks3-server[1051]: 2026/09/20 08:18:03 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6535lb # [ 139.778046] niks3-server[1051]: 2026/09/20 08:18:03 INFO Completed upload id=566536worker1 # [ 139.750629] nix-grpc-daemon[1579]: time=2026-09-20T08:18:03.847Z level=INFO msg="Upload complete. (426ms)"6537lb # [ 139.780460] niks3-server[1051]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6538worker1 # [ 139.754174] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=7526539worker1 # [ 139.759805] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086540worker1 # [ 139.768156] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6541worker1 # [ 139.773085] nix-daemon[858]: reaped child process 1954, status = succeeded6542worker1 # [ 139.778763] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6543worker1 # [ 140.791969] nix-daemon[858]: reaped child process 1968, status = succeeded6544worker1 # [ 140.946026] nix-daemon[858]: accepted connection from pid 1983, user nix-grpc-daemon (trusted)6545worker1 # [ 140.959166] nix-daemon[858]: reaped child process 1986, status = succeeded6546lb # [ 141.004258] niks3-server[1051]: 2026/09/20 08:18:04 INFO Received uploads request method=POST path=/api/pending_closures6547worker1 # [ 140.985483] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.081Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6548worker1 # [ 140.988486] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.083Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6549lb # [ 141.048903] niks3-server[1051]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6550lb # [ 141.052451] niks3-server[1051]: 2026/09/20 08:18:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6551lb # [ 141.057794] niks3-server[1051]: 2026/09/20 08:18:04 INFO Signed narinfos id=57 count=16552worker1 # [ 141.033877] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.130Z level=INFO msg="Uploading 1 narinfos"6553lb # [ 141.063101] niks3-server[1051]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6554lb # [ 141.073547] niks3-server[1051]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6555lb # [ 141.078907] niks3-server[1051]: 2026/09/20 08:18:04 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6556lb # [ 141.082984] niks3-server[1051]: 2026/09/20 08:18:04 INFO Completed upload id=576557worker1 # [ 141.055950] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.152Z level=INFO msg="Upload complete. (271ms)"6558lb # [ 141.084103] niks3-server[1051]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6559worker2 # [ 141.099730] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:05Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16560worker1 # [ 141.062392] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16561worker1 # [ 141.073256] nix-daemon[858]: reaped child process 1966, status = succeeded6562worker1 # [ 141.105443] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086563worker1 # [ 141.117688] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086564worker1 # [ 141.130222] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.226Z level=INFO msg="All 2 paths already cached"6565worker1 # [ 141.137420] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086566worker1 # [ 141.148343] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6567worker1 # [ 141.314295] nix-daemon[858]: accepted connection from pid 1990, user nix-grpc-daemon (trusted)6568worker1 # [ 141.326990] nix-daemon[858]: reaped child process 1993, status = succeeded6569worker1 # [ 141.496051] nix-daemon[858]: accepted connection from pid 1995, user nix-grpc-daemon (trusted)6570worker1 # [ 141.507822] nix-daemon[858]: reaped child process 1998, status = succeeded6571lb # [ 141.552987] niks3-server[1051]: 2026/09/20 08:18:05 INFO Received uploads request method=POST path=/api/pending_closures6572worker1 # [ 141.534936] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.631Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6573worker1 # [ 141.536382] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.631Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6574lb # [ 141.578374] niks3-server[1051]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6575lb # [ 141.591920] niks3-server[1051]: 2026/09/20 08:18:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6576lb # [ 141.597715] niks3-server[1051]: 2026/09/20 08:18:05 INFO Signed narinfos id=58 count=16577worker1 # [ 141.573747] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.670Z level=INFO msg="Uploading 1 narinfos"6578lb # [ 141.604764] niks3-server[1051]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6579lb # [ 141.616510] niks3-server[1051]: 2026/09/20 08:18:05 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6580lb # [ 141.621438] niks3-server[1051]: 2026/09/20 08:18:05 INFO Completed upload id=586581worker1 # [ 141.596663] nix-grpc-daemon[1579]: time=2026-09-20T08:18:05.693Z level=INFO msg="Upload complete. (437ms)"6582lb # [ 141.624959] niks3-server[1051]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6583worker1 # [ 141.600995] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=7526584worker1 # [ 141.605569] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086585worker1 # [ 141.615168] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6586worker1 # [ 141.619923] nix-daemon[858]: reaped child process 1988, status = succeeded6587worker1 # [ 141.624936] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6588worker1 # [ 143.050776] nix-daemon[858]: reaped child process 2002, status = succeeded6589worker1 # [ 143.202963] nix-daemon[858]: accepted connection from pid 2017, user nix-grpc-daemon (trusted)6590worker1 # [ 143.215101] nix-daemon[858]: reaped child process 2020, status = succeeded6591lb # [ 143.255500] niks3-server[1051]: 2026/09/20 08:18:07 INFO Received uploads request method=POST path=/api/pending_closures6592worker1 # [ 143.238153] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.334Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6593worker1 # [ 143.240054] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.336Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6594lb # [ 143.295329] niks3-server[1051]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6595lb # [ 143.305936] niks3-server[1051]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6596lb # [ 143.312513] niks3-server[1051]: 2026/09/20 08:18:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6597lb # [ 143.318370] niks3-server[1051]: 2026/09/20 08:18:07 INFO Signed narinfos id=59 count=16598worker1 # [ 143.293750] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.390Z level=INFO msg="Uploading 1 narinfos"6599lb # [ 143.324215] niks3-server[1051]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6600lb # [ 143.333883] niks3-server[1051]: 2026/09/20 08:18:07 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6601lb # [ 143.339839] niks3-server[1051]: 2026/09/20 08:18:07 INFO Completed upload id=596602worker1 # [ 143.312896] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.409Z level=INFO msg="Upload complete. (278ms)"6603lb # [ 143.342540] niks3-server[1051]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6604worker2 # [ 143.356397] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:07Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16605worker1 # [ 143.319704] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16606worker1 # [ 143.332255] nix-daemon[858]: reaped child process 2000, status = succeeded6607worker1 # [ 143.363060] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086608worker1 # [ 143.375329] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483086609worker1 # [ 143.387971] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.484Z level=INFO msg="All 2 paths already cached"6610worker1 # [ 143.395253] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483086611worker1 # [ 143.405180] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6612worker1 # [ 143.564669] nix-daemon[858]: accepted connection from pid 2024, user nix-grpc-daemon (trusted)6613worker1 # [ 143.577139] nix-daemon[858]: reaped child process 2027, status = succeeded6614worker1 # [ 143.742551] nix-daemon[858]: accepted connection from pid 2029, user nix-grpc-daemon (trusted)6615worker1 # [ 143.754575] nix-daemon[858]: reaped child process 2032, status = succeeded6616lb # [ 143.796980] niks3-server[1051]: 2026/09/20 08:18:07 INFO Received uploads request method=POST path=/api/pending_closures6617worker1 # [ 143.778405] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.874Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6618worker1 # [ 143.780275] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.876Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6619lb # [ 143.825137] niks3-server[1051]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6620lb # [ 143.836596] niks3-server[1051]: 2026/09/20 08:18:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6621worker1 # [ 143.814118] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.910Z level=INFO msg="Uploading 1 narinfos"6622lb # [ 143.841723] niks3-server[1051]: 2026/09/20 08:18:07 INFO Signed narinfos id=60 count=16623lb # [ 143.848502] niks3-server[1051]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6624lb # [ 143.860230] niks3-server[1051]: 2026/09/20 08:18:07 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6625lb # [ 143.865472] niks3-server[1051]: 2026/09/20 08:18:07 INFO Completed upload id=606626worker1 # [ 143.838360] nix-grpc-daemon[1579]: time=2026-09-20T08:18:07.934Z level=INFO msg="Upload complete. (422ms)"6627lb # [ 143.867651] niks3-server[1051]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6628worker1 # [ 143.842129] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=0 paths=1 nar_bytes_in=7526629worker1 # [ 143.846915] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483086630worker1 # [ 143.857104] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6631worker1 # [ 143.861071] nix-daemon[858]: reaped child process 2022, status = succeeded6632worker1 # [ 143.866058] nix-daemon[858]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6633worker1 # [ 144.889636] nix-daemon[858]: reaped child process 2036, status = succeeded6634worker1 # [ 145.063089] nix-daemon[858]: accepted connection from pid 2051, user nix-grpc-daemon (trusted)6635worker1 # [ 145.073842] nix-daemon[858]: reaped child process 2054, status = succeeded6636lb # [ 145.118724] niks3-server[1051]: 2026/09/20 08:18:08 INFO Received uploads request method=POST path=/api/pending_closures6637worker1 # [ 145.096569] nix-grpc-daemon[1579]: time=2026-09-20T08:18:09.192Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6638worker1 # [ 145.098108] nix-grpc-daemon[1579]: time=2026-09-20T08:18:09.194Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6639lb # [ 145.142170] niks3-server[1051]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6640lb # [ 145.145540] niks3-server[1051]: 2026/09/20 08:18:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6641lb # [ 145.148032] niks3-server[1051]: 2026/09/20 08:18:08 INFO Signed narinfos id=61 count=16642worker1 # [ 145.122424] nix-grpc-daemon[1579]: time=2026-09-20T08:18:09.218Z level=INFO msg="Uploading 1 narinfos"6643lb # [ 145.151509] niks3-server[1051]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6644lb # [ 145.154287] niks3-server[1051]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6645lb # [ 145.160905] niks3-server[1051]: 2026/09/20 08:18:08 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6646lb # [ 145.164337] niks3-server[1051]: 2026/09/20 08:18:08 INFO Completed upload id=616647worker1 # [ 145.137131] nix-grpc-daemon[1579]: time=2026-09-20T08:18:09.233Z level=INFO msg="Upload complete. (262ms)"6648lb # [ 145.166171] niks3-server[1051]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6649worker1 # [ 145.139534] nix-grpc-daemon[1491]: ts=2026-09-20T08:18:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48308 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16650worker1 # [ 145.146065] nix-daemon[858]: reaped child process 2034, status = succeeded6651client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.52 seconds)6652worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6653worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6654client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16655worker2 # [ 145.571902] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:370906656worker2 # [ 145.583832] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6657worker2 # [ 145.601393] nix-grpc-daemon[1659]: ts=2026-09-20T08:18:09Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06658lb # [ 147.908074] envoy[912]: conn peer=[2001:db8:1::1]:50650 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26817 tx=10627 ms=162586659client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.29 seconds)6660(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 136.86 seconds)6661subtest: low disk drains a worker and builds go to the other6662worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6663worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.02 seconds)6664worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6665worker1 # [ 267.339801] nix-grpc-daemon[1491]: ts=2026-09-20T08:20:11Z level=info event=unhealthy reason=min_free6666worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds)6667client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26668lb # [ 267.913835] envoy[912]: conn peer=[2001:db8:1::1]:58474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=725 tx=456 ms=1200526669worker2 # [ 267.946691] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:370906670client # don't know how to build these paths:6671client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6672worker2 # [ 267.963160] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:11Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06673worker2 # [ 267.966942] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:11Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16674worker2 # [ 268.016579] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370906675worker2 # [ 268.027665] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5)6676worker2 # [ 268.100534] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5)6677worker2 # [ 268.161486] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 3/5)6678worker2 # [ 268.350286] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 4/5)6679worker2 # [ 268.655570] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6680worker2 # [ 268.673608] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370906681client # copying 1 paths to 'lb:50051'...6682client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6683worker2 # [ 268.685243] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:370906684worker2 # [ 268.697450] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6685worker2 # [ 268.717489] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:12Z level=info event=niks3_push_started pid=17386686worker2 # [ 269.034622] nix-daemon[842]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)6687worker2 # [ 269.048848] nix-daemon[842]: reaped child process 1754, status = succeeded6688worker2 # [ 269.195695] nix-daemon[842]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6689worker2 # [ 269.209076] nix-daemon[842]: reaped child process 1759, status = succeeded6690lb # [ 269.209408] niks3-server[1051]: 2026/09/20 08:20:13 INFO Received uploads request method=POST path=/api/pending_closures6691worker2 # [ 269.229361] nix-grpc-daemon[1738]: time=2026-09-20T08:20:13.180Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6692worker2 # [ 269.232593] nix-grpc-daemon[1738]: time=2026-09-20T08:20:13.181Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6693lb # [ 269.251663] niks3-server[1051]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6694lb # [ 269.257718] niks3-server[1051]: 2026/09/20 08:20:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6695lb # [ 269.262585] niks3-server[1051]: 2026/09/20 08:20:13 INFO Signed narinfos id=62 count=16696worker2 # [ 269.276174] nix-grpc-daemon[1738]: time=2026-09-20T08:20:13.226Z level=INFO msg="Uploading 1 narinfos"6697lb # [ 269.275630] niks3-server[1051]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6698lb # [ 269.285873] niks3-server[1051]: 2026/09/20 08:20:13 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6699worker2 # [ 269.302736] nix-grpc-daemon[1738]: time=2026-09-20T08:20:13.253Z level=INFO msg="Upload complete. (410ms)"6700lb # [ 269.292294] niks3-server[1051]: 2026/09/20 08:20:13 INFO Completed upload id=626701lb # [ 269.296381] niks3-server[1051]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6702worker2 # [ 269.305225] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37090 duration_s=0 paths=1 nar_bytes_in=5126703worker2 # [ 269.309382] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370906704worker2 # [ 269.316111] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6705worker2 # [ 269.318336] nix-daemon[842]: reaped child process 1736, status = succeeded6706worker2 # [ 269.323865] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6707client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6708client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6709client # farm-a> LOG-farm-a-drain6710worker2 # [ 269.938072] nix-daemon[842]: reaped child process 1763, status = succeeded6711worker2 # [ 270.051375] nix-daemon[842]: accepted connection from pid 1778, user nix-grpc-daemon (trusted)6712worker2 # [ 270.064803] nix-daemon[842]: reaped child process 1781, status = succeeded6713lb # [ 270.062041] niks3-server[1051]: 2026/09/20 08:20:13 INFO Received uploads request method=POST path=/api/pending_closures6714worker2 # [ 270.077538] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.028Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6715worker2 # [ 270.079071] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.030Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6716lb # [ 270.083828] niks3-server[1051]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6717lb # [ 270.087337] niks3-server[1051]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6718lb # [ 270.091469] niks3-server[1051]: 2026/09/20 08:20:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6719lb # [ 270.094274] niks3-server[1051]: 2026/09/20 08:20:13 INFO Signed narinfos id=63 count=16720worker2 # [ 270.105766] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.056Z level=INFO msg="Uploading 1 narinfos"6721lb # [ 270.096029] niks3-server[1051]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6722lb # [ 270.102111] niks3-server[1051]: 2026/09/20 08:20:13 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6723lb # [ 270.104949] niks3-server[1051]: 2026/09/20 08:20:13 INFO Completed upload id=636724worker2 # [ 270.115254] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.066Z level=INFO msg="Upload complete. (185ms)"6725lb # [ 270.107730] niks3-server[1051]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6726worker2 # [ 270.118059] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37090 duration_s=0 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16727worker2 # [ 270.124210] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06728worker2 # [ 270.126113] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16729worker2 # [ 270.130587] nix-daemon[842]: reaped child process 1761, status = succeeded6730worker2 # [ 270.167057] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370906731worker2 # [ 270.173642] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370906732worker2 # [ 270.179996] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.131Z level=INFO msg="All 1 paths already cached"6733client # copying 1 paths to 'lb:50051'...6734worker2 # [ 270.184818] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:370906735client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6736worker2 # [ 270.191323] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6737worker2 # [ 270.315609] nix-daemon[842]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6738worker2 # [ 270.328702] nix-daemon[842]: reaped child process 1790, status = succeeded6739worker2 # [ 270.481148] nix-daemon[842]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6740worker2 # [ 270.493688] nix-daemon[842]: reaped child process 1795, status = succeeded6741lb # [ 270.497921] niks3-server[1051]: 2026/09/20 08:20:14 INFO Received uploads request method=POST path=/api/pending_closures6742worker2 # [ 270.519083] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.469Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6743worker2 # [ 270.520513] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.469Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6744lb # [ 270.528801] niks3-server[1051]: 2026/09/20 08:20:14 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6745lb # [ 270.537221] niks3-server[1051]: 2026/09/20 08:20:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6746lb # [ 270.541912] niks3-server[1051]: 2026/09/20 08:20:14 INFO Signed narinfos id=64 count=16747worker2 # [ 270.554614] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.505Z level=INFO msg="Uploading 1 narinfos"6748lb # [ 270.550232] niks3-server[1051]: 2026/09/20 08:20:14 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6749lb # [ 270.554956] niks3-server[1051]: 2026/09/20 08:20:14 INFO Completed upload id=646750worker2 # [ 270.565069] nix-grpc-daemon[1738]: time=2026-09-20T08:20:14.516Z level=INFO msg="Upload complete. (368ms)"6751lb # [ 270.556386] niks3-server[1051]: 2026/09/20 08:20:14 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6752worker2 # [ 270.567473] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37090 duration_s=0 paths=1 nar_bytes_in=6246753worker2 # [ 270.571440] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370906754lb # [ 270.564261] niks3-server[1051]: 2026/09/20 08:20:14 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6755worker2 # [ 270.579477] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6756worker2 # [ 270.581240] nix-daemon[842]: reaped child process 1785, status = succeeded6757worker2 # [ 270.586281] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6758client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6759client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6760client # farm-b> LOG-farm-b-drain6761worker2 # [ 272.208446] nix-daemon[842]: reaped child process 1799, status = succeeded6762worker2 # [ 272.331701] nix-daemon[842]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)6763worker2 # [ 272.345225] nix-daemon[842]: reaped child process 1817, status = succeeded6764lb # [ 272.347804] niks3-server[1051]: 2026/09/20 08:20:16 INFO Received uploads request method=POST path=/api/pending_closures6765worker2 # [ 272.366088] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.316Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6766worker2 # [ 272.367958] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.318Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6767lb # [ 272.384447] niks3-server[1051]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6768lb # [ 272.392892] niks3-server[1051]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6769lb # [ 272.406225] niks3-server[1051]: 2026/09/20 08:20:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6770lb # [ 272.412206] niks3-server[1051]: 2026/09/20 08:20:16 INFO Signed narinfos id=65 count=16771worker2 # [ 272.425468] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.376Z level=INFO msg="Uploading 1 narinfos"6772lb # [ 272.414886] niks3-server[1051]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6773lb # [ 272.424517] niks3-server[1051]: 2026/09/20 08:20:16 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6774lb # [ 272.430294] niks3-server[1051]: 2026/09/20 08:20:16 INFO Completed upload id=656775worker2 # [ 272.440707] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.391Z level=INFO msg="Upload complete. (245ms)"6776lb # [ 272.433221] niks3-server[1051]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6777worker2 # [ 272.446751] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37090 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16778worker2 # [ 272.458746] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06779worker2 # [ 272.462358] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16780worker2 # [ 272.471662] nix-daemon[842]: reaped child process 1797, status = succeeded6781worker2 # [ 272.502161] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370906782worker2 # [ 272.514532] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370906783worker2 # [ 272.527459] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.478Z level=INFO msg="All 2 paths already cached"6784client # copying 1 paths to 'lb:50051'...6785client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6786worker2 # [ 272.534402] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:370906787worker2 # [ 272.542808] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6788worker2 # [ 272.690148] nix-daemon[842]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)6789worker2 # [ 272.703226] nix-daemon[842]: reaped child process 1826, status = succeeded6790worker2 # [ 272.849924] nix-daemon[842]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)6791worker2 # [ 272.861375] nix-daemon[842]: reaped child process 1831, status = succeeded6792lb # [ 272.864356] niks3-server[1051]: 2026/09/20 08:20:16 INFO Received uploads request method=POST path=/api/pending_closures6793worker2 # [ 272.882240] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.833Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6794worker2 # [ 272.883765] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.834Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6795lb # [ 272.891390] niks3-server[1051]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6796lb # [ 272.903061] niks3-server[1051]: 2026/09/20 08:20:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6797worker2 # [ 272.918194] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.869Z level=INFO msg="Uploading 1 narinfos"6798lb # [ 272.907863] niks3-server[1051]: 2026/09/20 08:20:16 INFO Signed narinfos id=66 count=16799lb # [ 272.914305] niks3-server[1051]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6800lb # [ 272.922898] niks3-server[1051]: 2026/09/20 08:20:16 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6801lb # [ 272.931207] niks3-server[1051]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6802lb # [ 272.936156] niks3-server[1051]: 2026/09/20 08:20:16 INFO Completed upload id=666803worker2 # [ 272.946379] nix-grpc-daemon[1738]: time=2026-09-20T08:20:16.897Z level=INFO msg="Upload complete. (390ms)"6804worker2 # [ 272.950065] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37090 duration_s=0 paths=1 nar_bytes_in=7526805worker2 # [ 272.955271] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370906806worker2 # [ 272.964193] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6807worker2 # [ 272.969877] nix-daemon[842]: reaped child process 1821, status = succeeded6808client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6809worker2 # [ 272.974911] nix-daemon[842]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6810client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6811client # farm-top> LOG-farm-top-drain6812worker2 # [ 273.989817] nix-daemon[842]: reaped child process 1835, status = succeeded6813worker2 # [ 274.119743] nix-daemon[842]: accepted connection from pid 1850, user nix-grpc-daemon (trusted)6814worker2 # [ 274.132899] nix-daemon[842]: reaped child process 1853, status = succeeded6815lb # [ 274.136939] niks3-server[1051]: 2026/09/20 08:20:17 INFO Received uploads request method=POST path=/api/pending_closures6816worker2 # [ 274.152168] nix-grpc-daemon[1738]: time=2026-09-20T08:20:18.103Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6817worker2 # [ 274.155339] nix-grpc-daemon[1738]: time=2026-09-20T08:20:18.104Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6818lb # [ 274.155112] niks3-server[1051]: 2026/09/20 08:20:17 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6819lb # [ 274.159132] niks3-server[1051]: 2026/09/20 08:20:17 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6820lb # [ 274.160907] niks3-server[1051]: 2026/09/20 08:20:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6821lb # [ 274.162678] niks3-server[1051]: 2026/09/20 08:20:17 INFO Signed narinfos id=67 count=16822worker2 # [ 274.174325] nix-grpc-daemon[1738]: time=2026-09-20T08:20:18.125Z level=INFO msg="Uploading 1 narinfos"6823lb # [ 274.165947] niks3-server[1051]: 2026/09/20 08:20:17 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6824lb # [ 274.170942] niks3-server[1051]: 2026/09/20 08:20:18 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6825lb # [ 274.174454] niks3-server[1051]: 2026/09/20 08:20:18 INFO Completed upload id=676826worker2 # [ 274.184747] nix-grpc-daemon[1738]: time=2026-09-20T08:20:18.135Z level=INFO msg="Upload complete. (203ms)"6827lb # [ 274.176534] niks3-server[1051]: 2026/09/20 08:20:18 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6828worker2 # [ 274.187561] nix-grpc-daemon[1659]: ts=2026-09-20T08:20:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37090 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16829worker2 # [ 274.194952] nix-daemon[842]: reaped child process 1833, status = succeeded6830client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.48 seconds)6831client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6832client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.15 seconds)6833worker1: must succeed: rm /nix/.rw-store/fill6834worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6835worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6836worker1 # [ 275.343780] nix-grpc-daemon[1491]: ts=2026-09-20T08:20:19Z level=info event=healthy reason=min_free6837worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6838(finished: subtest: low disk drains a worker and builds go to the other, in 10.05 seconds)6839(finished: run the VM test script, in 276.55 seconds)6840test script finished in 276.75s6841cleanup6842kill QemuMachine (pid 49)6843client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6844kill QemuMachine (pid 50)6845lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6846kill QemuMachine (pid 51)6847worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6848kill QemuMachine (pid 52)6849worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6850(finished: cleanup, in 1.03 seconds)6851additionally exposed symbols:6852 client, lb, worker1, worker2,6853 vlan1,6854 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh