vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #223
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13client # Disk image does not exist, creating the virtualisation disk image...14lb # Formatting '/build/vm-state-lb/tmp.IG6dmLVZhg', fmt=raw size=107374182415client: QEMU running (pid 49)16lb: QEMU running (pid 50)17client # Formatting '/build/vm-state-client/tmp.xH4pN5695i', fmt=raw size=107374182418lb # mke2fs 1.47.4 (6-Mar-2025)19client # mke2fs 1.47.4 (6-Mar-2025)20worker1 # Disk image does not exist, creating the virtualisation disk image...21worker2: QEMU running (pid 51)22worker2 # Disk image does not exist, creating the virtualisation disk image...23worker1: QEMU running (pid 52)24lb # Discarding device blocks: 0/262144 done25worker2 # Formatting '/build/vm-state-worker2/tmp.V5R6Gi6zYf', fmt=raw size=107374182426client # Discarding device blocks: 0/262144 done27worker1 # Formatting '/build/vm-state-worker1/tmp.bTVLccLMlw', fmt=raw size=107374182428lb # Creating filesystem with 262144 4k blocks and 65536 inodes29client # Creating filesystem with 262144 4k blocks and 65536 inodes30worker1 # mke2fs 1.47.4 (6-Mar-2025)31lb # Filesystem UUID: 3191afb0-4a69-4a02-86e6-96a3c595f1bc32client # Filesystem UUID: 2c13fb44-6871-4645-8c2d-d8fdfed7279833client # Superblock backups stored on blocks:34worker1 # Discarding device blocks: 0/262144 done35(finished: start all VMs, in 0.23 seconds)36worker2 # mke2fs 1.47.4 (6-Mar-2025)37worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes38client: waiting for unit network-addresses-eth1.service39worker2 # Discarding device blocks: 0/262144 done40worker1 # Filesystem UUID: 153befba-dc83-4b08-9e38-ae14c1b06dff41worker1 # Superblock backups stored on blocks:42client: waiting for the VM to finish booting43lb # Superblock backups stored on blocks:44worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes45lb # 32768, 98304, 163840, 22937646worker2 # Filesystem UUID: 012b7dae-92b0-45a3-ae0a-330cf13bfeca47lb # 48client # 32768, 98304, 163840, 22937649worker1 # 32768, 98304, 163840, 22937650worker2 # Superblock backups stored on blocks:51lb # Allocating group tables: 0/8 done52client # 53worker1 # 54worker2 # 32768, 98304, 163840, 22937655lb # Writing inode tables: 0/8 done56client # Allocating group tables: 0/8 done57worker1 # Allocating group tables: 0/8 done58worker2 # 59lb # Creating journal (8192 blocks): done60client # Writing inode tables: 0/8 done61worker1 # Writing inode tables: 0/8 done62worker1 # Creating journal (8192 blocks): done63worker2 # Allocating group tables: 0/8 done64client # Creating journal (8192 blocks): done65lb # Writing superblocks and filesystem accounting information: 0/8 done66client # Writing superblocks and filesystem accounting information: 0/8 done67lb # 68lb # Virtualisation disk image created.69worker2 # Writing inode tables: 0/8 done70client # 71worker2 # Creating journal (8192 blocks): done72client # Virtualisation disk image created.73worker2 # Writing superblocks and filesystem accounting information: 0/8 done74worker1 # Writing superblocks and filesystem accounting information: 0/8 done75worker2 # 76worker1 # 77worker2 # Virtualisation disk image created.78worker1 # Virtualisation disk image created.79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87worker2 # 88worker2 # 89worker2 # 90worker2 # 91worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...93worker2 # 94worker2 # 95worker1 # 96worker1 # 97lb # 98lb # 99worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00100lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00101client # 102client # 103worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...104worker1 # 105worker1 # 106worker1 # 107worker1 # 108lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...109lb # 110lb # 111lb # 112lb # 113client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00114worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00115lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...117client # 118client # 119client # 120client # 121worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...122worker1 # 123client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00124worker1 # 125lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126lb # 127lb # 128client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129client # 130client # 131worker2 # Booting from ROM...132worker2 # Probing EDD (edd=off to disable)... ok133worker1 # Booting from ROM...134lb # Booting from ROM...135client # Booting from ROM...136lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026138lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0139lb # [ 0.000000] BIOS-provided physical RAM map:140lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable141worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yjhllwxv9qqbrjk4hd9a682zq4vlvvls-nixos-system-worker2-test/init regInfo=/nix/store/g9ksak3xrgdnm0g3160yq6vlsbza2x78-closure-info/registration console=ttyS0,115200n8 console=tty0142worker2 # [ 0.000000] BIOS-provided physical RAM map:143lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved144lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved145worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable146worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026147lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable148worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved149lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved150worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved151lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved152worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable153client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026154lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved155worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved156worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/k2cy394p95by4wv71a18n1sc4wcrx9jy-nixos-system-worker1-test/init regInfo=/nix/store/jg1h0iwj0574z3ck7yq11bia4cp5rhrd-closure-info/registration console=ttyS0,115200n8 console=tty0157lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved158worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved159worker1 # [ 0.000000] BIOS-provided physical RAM map:160lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved161worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved162worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable163lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved164worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved165client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test/init regInfo=/nix/store/lsvg9dpl4mgz6n1bdwv0ac6w2jkmwkjc-closure-info/registration console=ttyS0,115200n8 console=tty0166worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved167lb # [ 0.000000] NX (Execute Disable) protection: active168worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved169lb # [ 0.000000] APIC: Static calls initialized170client # [ 0.000000] BIOS-provided physical RAM map:171worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved172lb # [ 0.000000] SMBIOS 2.8 present.173client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable174worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved175worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable176worker2 # [ 0.000000] NX (Execute Disable) protection: active177client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved178lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014179worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved180worker2 # [ 0.000000] APIC: Static calls initialized181lb # [ 0.000000] DMI: Memory slots populated: 1/1182worker2 # [ 0.000000] SMBIOS 2.8 present.183client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved184lb # [ 0.000000] Hypervisor detected: KVM185worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved186client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable187lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000188worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014189worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved190lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00191worker2 # [ 0.000000] DMI: Memory slots populated: 1/1192client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved193worker2 # [ 0.000000] Hypervisor detected: KVM194worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved195lb # [ 0.000000] kvm-clock: using sched offset of 502266129 cycles196client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved197worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000198worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved199client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved200lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns201worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00202worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved203lb # [ 0.000006] tsc: Detected 2400.012 MHz processor204worker2 # [ 0.000001] kvm-clock: using sched offset of 497241054 cycles205client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved206worker1 # [ 0.000000] NX (Execute Disable) protection: active207lb # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000208worker1 # [ 0.000000] APIC: Static calls initialized209client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved210worker1 # [ 0.000000] SMBIOS 2.8 present.211worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns212lb # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs213client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved214worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor215worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014216lb # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT217client # [ 0.000000] NX (Execute Disable) protection: active218worker2 # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000219client # [ 0.000000] APIC: Static calls initialized220worker1 # [ 0.000000] DMI: Memory slots populated: 1/1221lb # [ 0.002748] found SMP MP-table at [mem 0x000f5450-0x000f545f]222client # [ 0.000000] SMBIOS 2.8 present.223worker1 # [ 0.000000] Hypervisor detected: KVM224lb # [ 0.002760] Using GB pages for direct mapping225worker2 # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs226worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000227lb # [ 0.002897] RAMDISK: [mem 0x5e367000-0x5ffcffff]228worker2 # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT229client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014230worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00231lb # [ 0.002905] ACPI: Early table checksum verification disabled232client # [ 0.000000] DMI: Memory slots populated: 1/1233worker2 # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]234client # [ 0.000000] Hypervisor detected: KVM235lb # [ 0.002908] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )236worker1 # [ 0.000001] kvm-clock: using sched offset of 494812076 cycles237worker2 # [ 0.002752] Using GB pages for direct mapping238client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000239worker2 # [ 0.002843] RAMDISK: [mem 0x5e367000-0x5ffcffff]240lb # [ 0.002912] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)241client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00242worker1 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns243worker2 # [ 0.002853] ACPI: Early table checksum verification disabled244worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor245client # [ 0.000000] kvm-clock: using sched offset of 513793111 cycles246lb # [ 0.002917] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)247worker2 # [ 0.002857] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )248worker1 # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000249client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns250worker2 # [ 0.002861] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)251worker1 # [ 0.000833] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs252lb # [ 0.002924] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)253client # [ 0.000006] tsc: Detected 2400.012 MHz processor254lb # [ 0.002926] ACPI: FACS 0x000000005FFE0000 000040255worker1 # [ 0.000836] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT256worker2 # [ 0.002866] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)257client # [ 0.000819] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000258lb # [ 0.002928] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)259worker1 # [ 0.002754] found SMP MP-table at [mem 0x000f5450-0x000f545f]260worker2 # [ 0.002875] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)261client # [ 0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs262worker1 # [ 0.002766] Using GB pages for direct mapping263lb # [ 0.002929] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)264worker2 # [ 0.002878] ACPI: FACS 0x000000005FFE0000 000040265worker1 # [ 0.002860] RAMDISK: [mem 0x5e367000-0x5ffcffff]266client # [ 0.000850] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT267lb # [ 0.002931] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)268worker2 # [ 0.002879] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)269worker1 # [ 0.002870] ACPI: Early table checksum verification disabled270client # [ 0.002751] found SMP MP-table at [mem 0x000f5450-0x000f545f]271worker1 # [ 0.002874] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )272client # [ 0.002766] Using GB pages for direct mapping273lb # [ 0.002932] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)274worker2 # [ 0.002881] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)275client # [ 0.002855] RAMDISK: [mem 0x5e366000-0x5ffcffff]276worker1 # [ 0.002878] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)277lb # [ 0.002933] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]278client # [ 0.002865] ACPI: Early table checksum verification disabled279worker2 # [ 0.002882] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)280lb # [ 0.002935] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]281client # [ 0.002869] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )282worker1 # [ 0.002885] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)283worker2 # [ 0.002884] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)284lb # [ 0.002935] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]285client # [ 0.002873] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)286worker1 # [ 0.002894] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)287worker2 # [ 0.002885] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]288lb # [ 0.002936] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]289worker1 # [ 0.002897] ACPI: FACS 0x000000005FFE0000 000040290client # [ 0.002878] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)291worker2 # [ 0.002886] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]292lb # [ 0.002936] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]293worker1 # [ 0.002899] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)294client # [ 0.002886] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)295worker2 # [ 0.002887] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]296lb # [ 0.002936] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]297client # [ 0.002888] ACPI: FACS 0x000000005FFE0000 000040298worker1 # [ 0.002901] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)299worker2 # [ 0.002887] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]300lb # [ 0.002937] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]301client # [ 0.002889] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)302lb # [ 0.003162] No NUMA configuration found303worker2 # [ 0.002888] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]304worker1 # [ 0.002902] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)305lb # [ 0.003163] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]306worker2 # [ 0.002888] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]307client # [ 0.002891] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)308worker1 # [ 0.002904] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)309lb # [ 0.003166] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]310lb # [ 0.005449] Zone ranges:311worker2 # [ 0.002889] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]312worker1 # [ 0.002905] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]313client # [ 0.002892] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)314worker2 # [ 0.003130] No NUMA configuration found315lb # [ 0.005450] DMA [mem 0x0000000000001000-0x0000000000ffffff]316worker1 # [ 0.002906] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]317client # [ 0.002894] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)318worker2 # [ 0.003130] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]319lb # [ 0.005452] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]320worker1 # [ 0.002907] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]321lb # [ 0.005453] Normal empty322client # [ 0.002895] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]323worker2 # [ 0.003133] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]324lb # [ 0.005454] Device empty325worker2 # [ 0.005546] Zone ranges:326lb # [ 0.005454] Movable zone start for each node327worker1 # [ 0.002907] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]328client # [ 0.002896] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]329worker2 # [ 0.005547] DMA [mem 0x0000000000001000-0x0000000000ffffff]330lb # [ 0.005455] Early memory node ranges331worker1 # [ 0.002908] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]332client # [ 0.002897] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]333lb # [ 0.005455] node 0: [mem 0x0000000000001000-0x000000000009efff]334worker2 # [ 0.005549] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]335worker2 # [ 0.005550] Normal empty336worker1 # [ 0.002908] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]337worker2 # [ 0.005551] Device empty338lb # [ 0.005456] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]339client # [ 0.002897] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]340worker2 # [ 0.005551] Movable zone start for each node341worker1 # [ 0.002908] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]342lb # [ 0.005458] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]343worker2 # [ 0.005552] Early memory node ranges344client # [ 0.002898] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]345worker1 # [ 0.003149] No NUMA configuration found346lb # [ 0.005478] On node 0, zone DMA: 1 pages in unavailable ranges347worker2 # [ 0.005552] node 0: [mem 0x0000000000001000-0x000000000009efff]348client # [ 0.002898] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]349worker1 # [ 0.003150] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]350lb # [ 0.005745] On node 0, zone DMA: 97 pages in unavailable ranges351worker2 # [ 0.005553] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]352client # [ 0.002899] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]353worker1 # [ 0.003152] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]354lb # [ 0.033178] On node 0, zone DMA32: 40 pages in unavailable ranges355client # [ 0.003137] No NUMA configuration found356worker1 # [ 0.005535] Zone ranges:357worker2 # [ 0.005555] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]358lb # [ 0.033643] ACPI: PM-Timer IO Port: 0x608359worker1 # [ 0.005536] DMA [mem 0x0000000000001000-0x0000000000ffffff]360client # [ 0.003138] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]361worker2 # [ 0.005576] On node 0, zone DMA: 1 pages in unavailable ranges362lb # [ 0.033657] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])363worker1 # [ 0.005538] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]364client # [ 0.003140] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]365worker2 # [ 0.005930] On node 0, zone DMA: 97 pages in unavailable ranges366client # [ 0.005479] Zone ranges:367worker1 # [ 0.005539] Normal empty368lb # [ 0.033686] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23369worker1 # [ 0.005540] Device empty370worker2 # [ 0.035674] On node 0, zone DMA32: 40 pages in unavailable ranges371client # [ 0.005480] DMA [mem 0x0000000000001000-0x0000000000ffffff]372worker1 # [ 0.005541] Movable zone start for each node373lb # [ 0.033689] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)374worker2 # [ 0.036159] ACPI: PM-Timer IO Port: 0x608375worker1 # [ 0.005542] Early memory node ranges376client # [ 0.005481] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]377lb # [ 0.033691] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)378worker2 # [ 0.036174] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])379client # [ 0.005483] Normal empty380worker1 # [ 0.005542] node 0: [mem 0x0000000000001000-0x000000000009efff]381client # [ 0.005483] Device empty382lb # [ 0.033692] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)383worker2 # [ 0.036209] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23384worker1 # [ 0.005543] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]385client # [ 0.005484] Movable zone start for each node386client # [ 0.005485] Early memory node ranges387lb # [ 0.033693] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)388worker2 # [ 0.036211] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)389worker1 # [ 0.005544] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]390client # [ 0.005485] node 0: [mem 0x0000000000001000-0x000000000009efff]391lb # [ 0.033694] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)392worker2 # [ 0.036213] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)393worker1 # [ 0.005567] On node 0, zone DMA: 1 pages in unavailable ranges394client # [ 0.005486] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]395lb # [ 0.033696] ACPI: Using ACPI (MADT) for SMP configuration information396worker2 # [ 0.036214] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)397worker1 # [ 0.005830] On node 0, zone DMA: 97 pages in unavailable ranges398lb # [ 0.033698] ACPI: HPET id: 0x8086a201 base: 0xfed00000399client # [ 0.005488] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]400worker1 # [ 0.034114] On node 0, zone DMA32: 40 pages in unavailable ranges401worker2 # [ 0.036216] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)402lb # [ 0.033702] TSC deadline timer available403worker1 # [ 0.034591] ACPI: PM-Timer IO Port: 0x608404client # [ 0.005511] On node 0, zone DMA: 1 pages in unavailable ranges405lb # [ 0.033706] CPU topo: Max. logical packages: 1406worker2 # [ 0.036216] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)407lb # [ 0.033707] CPU topo: Max. logical dies: 1408client # [ 0.005791] On node 0, zone DMA: 97 pages in unavailable ranges409worker1 # [ 0.034605] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])410worker2 # [ 0.036219] ACPI: Using ACPI (MADT) for SMP configuration information411lb # [ 0.033707] CPU topo: Max. dies per package: 1412client # [ 0.033783] On node 0, zone DMA32: 40 pages in unavailable ranges413worker1 # [ 0.034632] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23414worker2 # [ 0.036220] ACPI: HPET id: 0x8086a201 base: 0xfed00000415lb # [ 0.033713] CPU topo: Max. threads per core: 1416client # [ 0.034263] ACPI: PM-Timer IO Port: 0x608417worker2 # [ 0.036226] TSC deadline timer available418worker1 # [ 0.034635] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)419lb # [ 0.033714] CPU topo: Num. cores per package: 1420client # [ 0.034279] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])421worker2 # [ 0.036230] CPU topo: Max. logical packages: 1422lb # [ 0.033714] CPU topo: Num. threads per package: 1423worker1 # [ 0.034636] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)424worker2 # [ 0.036231] CPU topo: Max. logical dies: 1425client # [ 0.034311] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23426lb # [ 0.033714] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs427worker1 # [ 0.034638] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)428worker2 # [ 0.036232] CPU topo: Max. dies per package: 1429client # [ 0.034313] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)430lb # [ 0.033737] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()431worker2 # [ 0.036235] CPU topo: Max. threads per core: 1432worker1 # [ 0.034639] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)433client # [ 0.034315] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)434worker2 # [ 0.036236] CPU topo: Num. cores per package: 1435worker1 # [ 0.034639] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)436lb # [ 0.033784] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]437worker2 # [ 0.036236] CPU topo: Num. threads per package: 1438client # [ 0.034316] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)439worker1 # [ 0.034642] ACPI: Using ACPI (MADT) for SMP configuration information440lb # [ 0.033786] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]441worker2 # [ 0.036237] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs442client # [ 0.034317] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)443worker1 # [ 0.034643] ACPI: HPET id: 0x8086a201 base: 0xfed00000444lb # [ 0.033787] [mem 0x60000000-0xafffffff] available for PCI devices445worker2 # [ 0.036261] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()446client # [ 0.034318] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)447worker1 # [ 0.034647] TSC deadline timer available448lb # [ 0.033789] Booting paravirtualized kernel on KVM449worker1 # [ 0.034652] CPU topo: Max. logical packages: 1450client # [ 0.034321] ACPI: Using ACPI (MADT) for SMP configuration information451worker2 # [ 0.036301] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]452worker1 # [ 0.034652] CPU topo: Max. logical dies: 1453client # [ 0.034322] ACPI: HPET id: 0x8086a201 base: 0xfed00000454lb # [ 0.033792] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns455worker1 # [ 0.034653] CPU topo: Max. dies per package: 1456client # [ 0.034327] TSC deadline timer available457worker2 # [ 0.036303] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]458worker1 # [ 0.034656] CPU topo: Max. threads per core: 1459lb # [ 0.038321] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1460client # [ 0.034332] CPU topo: Max. logical packages: 1461worker2 # [ 0.036304] [mem 0x60000000-0xafffffff] available for PCI devices462worker1 # [ 0.034657] CPU topo: Num. cores per package: 1463client # [ 0.034332] CPU topo: Max. logical dies: 1464worker2 # [ 0.036306] Booting paravirtualized kernel on KVM465lb # [ 0.040536] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152466worker1 # [ 0.034658] CPU topo: Num. threads per package: 1467client # [ 0.034333] CPU topo: Max. dies per package: 1468lb # [ 0.040582] kvm-guest: PV spinlocks disabled, single CPU469worker1 # [ 0.034658] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs470client # [ 0.034337] CPU topo: Max. threads per core: 1471worker2 # [ 0.036310] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns472client # [ 0.034337] CPU topo: Num. cores per package: 1473worker1 # [ 0.034680] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()474client # [ 0.034338] CPU topo: Num. threads per package: 1475worker2 # [ 0.040862] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1476worker1 # [ 0.034716] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]477client # [ 0.034338] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs478worker2 # [ 0.043264] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152479worker1 # [ 0.034718] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]480worker2 # [ 0.043309] kvm-guest: PV spinlocks disabled, single CPU481client # [ 0.034362] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()482worker1 # [ 0.034719] [mem 0x60000000-0xafffffff] available for PCI devices483lb # [ 0.040583] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0484client # [ 0.034403] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]485worker1 # [ 0.034721] Booting paravirtualized kernel on KVM486client # [ 0.034404] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]487lb # [ 0.040679] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.488worker1 # [ 0.034725] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns489client # [ 0.034406] [mem 0x60000000-0xafffffff] available for PCI devices490lb # [ 0.040692] random: crng init done491client # [ 0.034408] Booting paravirtualized kernel on KVM492worker1 # [ 0.039203] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1493worker2 # [ 0.043311] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yjhllwxv9qqbrjk4hd9a682zq4vlvvls-nixos-system-worker2-test/init regInfo=/nix/store/g9ksak3xrgdnm0g3160yq6vlsbza2x78-closure-info/registration console=ttyS0,115200n8 console=tty0494lb # [ 0.040692] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes495worker1 # [ 0.041438] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152496client # [ 0.034412] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns497lb # [ 0.043185] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)498worker1 # [ 0.041480] kvm-guest: PV spinlocks disabled, single CPU499client # [ 0.038878] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1500worker2 # [ 0.043434] Unknown kernel command line parameters "regInfo=/nix/store/g9ksak3xrgdnm0g3160yq6vlsbza2x78-closure-info/registration", will be passed to user space.501lb # [ 0.044277] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)502worker2 # [ 0.043450] random: crng init done503client # [ 0.041181] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152504lb # [ 0.044312] Fallback order for Node 0: 0505client # [ 0.041233] kvm-guest: PV spinlocks disabled, single CPU506worker2 # [ 0.043451] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes507lb # [ 0.044315] Built 1 zonelists, mobility grouping on. Total pages: 393078508lb # [ 0.044316] Policy zone: DMA32509worker2 # [ 0.045829] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)510lb # [ 0.046881] mem auto-init: stack:all(zero), heap alloc:on, heap free:off511worker2 # [ 0.047023] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)512worker1 # [ 0.041482] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/k2cy394p95by4wv71a18n1sc4wcrx9jy-nixos-system-worker1-test/init regInfo=/nix/store/jg1h0iwj0574z3ck7yq11bia4cp5rhrd-closure-info/registration console=ttyS0,115200n8 console=tty0513lb # [ 0.050198] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1514worker2 # [ 0.047065] Fallback order for Node 0: 0515lb # [ 0.053605] allocated 3145728 bytes of page_ext516worker2 # [ 0.047069] Built 1 zonelists, mobility grouping on. Total pages: 393078517lb # [ 0.064243] ftrace: allocating 48731 entries in 192 pages518worker2 # [ 0.047071] Policy zone: DMA32519worker1 # [ 0.041583] Unknown kernel command line parameters "regInfo=/nix/store/jg1h0iwj0574z3ck7yq11bia4cp5rhrd-closure-info/registration", will be passed to user space.520client # [ 0.041235] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test/init regInfo=/nix/store/lsvg9dpl4mgz6n1bdwv0ac6w2jkmwkjc-closure-info/registration console=ttyS0,115200n8 console=tty0521lb # [ 0.064246] ftrace: allocated 192 pages with 2 groups522worker1 # [ 0.041597] random: crng init done523worker2 # [ 0.050122] mem auto-init: stack:all(zero), heap alloc:on, heap free:off524lb # [ 0.065118] Dynamic Preempt: lazy525worker1 # [ 0.041598] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes526lb # [ 0.065282] rcu: Preemptible hierarchical RCU implementation.527worker2 # [ 0.053746] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1528client # [ 0.041333] Unknown kernel command line parameters "regInfo=/nix/store/lsvg9dpl4mgz6n1bdwv0ac6w2jkmwkjc-closure-info/registration", will be passed to user space.529lb # [ 0.065283] rcu: RCU event tracing is enabled.530worker2 # [ 0.057350] allocated 3145728 bytes of page_ext531client # [ 0.041346] random: crng init done532worker1 # [ 0.043817] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)533worker2 # [ 0.068069] ftrace: allocating 48731 entries in 192 pages534lb # [ 0.065284] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.535client # [ 0.041347] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes536worker1 # [ 0.045217] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)537worker2 # [ 0.068072] ftrace: allocated 192 pages with 2 groups538lb # [ 0.065285] Trampoline variant of Tasks RCU enabled.539worker1 # [ 0.045252] Fallback order for Node 0: 0540worker2 # [ 0.069038] Dynamic Preempt: lazy541lb # [ 0.065286] Rude variant of Tasks RCU enabled.542client # [ 0.043555] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)543worker2 # [ 0.069249] rcu: Preemptible hierarchical RCU implementation.544worker1 # [ 0.045255] Built 1 zonelists, mobility grouping on. Total pages: 393078545lb # [ 0.065286] Tracing variant of Tasks RCU enabled.546worker1 # [ 0.045256] Policy zone: DMA32547worker2 # [ 0.069249] rcu: RCU event tracing is enabled.548client # [ 0.044660] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)549lb # [ 0.065287] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.550client # [ 0.044700] Fallback order for Node 0: 0551worker1 # [ 0.047879] mem auto-init: stack:all(zero), heap alloc:on, heap free:off552worker2 # [ 0.069250] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.553lb # [ 0.065288] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1554client # [ 0.044715] Built 1 zonelists, mobility grouping on. Total pages: 393078555worker2 # [ 0.069252] Trampoline variant of Tasks RCU enabled.556worker1 # [ 0.051228] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1557client # [ 0.044716] Policy zone: DMA32558worker2 # [ 0.069252] Rude variant of Tasks RCU enabled.559worker1 # [ 0.054669] allocated 3145728 bytes of page_ext560lb # [ 0.065338] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.561client # [ 0.047608] mem auto-init: stack:all(zero), heap alloc:on, heap free:off562worker2 # [ 0.069253] Tracing variant of Tasks RCU enabled.563worker1 # [ 0.064912] ftrace: allocating 48731 entries in 192 pages564worker1 # [ 0.064915] ftrace: allocated 192 pages with 2 groups565client # [ 0.051021] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1566lb # [ 0.065340] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.567worker2 # [ 0.069253] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.568worker1 # [ 0.065809] Dynamic Preempt: lazy569client # [ 0.054466] allocated 3145728 bytes of page_ext570worker2 # [ 0.069254] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1571worker1 # [ 0.065962] rcu: Preemptible hierarchical RCU implementation.572client # [ 0.064900] ftrace: allocating 48731 entries in 192 pages573lb # [ 0.065341] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.574worker1 # [ 0.065963] rcu: RCU event tracing is enabled.575client # [ 0.064901] ftrace: allocated 192 pages with 2 groups576lb # [ 0.069782] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16577worker2 # [ 0.069270] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.578client # [ 0.065777] Dynamic Preempt: lazy579worker1 # [ 0.065963] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.580lb # [ 0.070079] rcu: srcu_init: Setting srcu_struct sizes based on contention.581client # [ 0.065975] rcu: Preemptible hierarchical RCU implementation.582worker1 # [ 0.065965] Trampoline variant of Tasks RCU enabled.583worker2 # [ 0.069272] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.584client # [ 0.065975] rcu: RCU event tracing is enabled.585worker1 # [ 0.065966] Rude variant of Tasks RCU enabled.586lb # [ 0.070086] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns587worker1 # [ 0.065966] Tracing variant of Tasks RCU enabled.588client # [ 0.065976] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.589worker2 # [ 0.069273] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.590client # [ 0.065978] Trampoline variant of Tasks RCU enabled.591worker2 # [ 0.073781] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16592lb # [ 0.070192] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)593worker1 # [ 0.065967] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.594client # [ 0.065978] Rude variant of Tasks RCU enabled.595lb # [ 0.073721] Console: colour VGA+ 80x25596worker2 # [ 0.074090] rcu: srcu_init: Setting srcu_struct sizes based on contention.597client # [ 0.065978] Tracing variant of Tasks RCU enabled.598worker1 # [ 0.065968] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1599lb # [ 0.073725] printk: legacy console [tty0] enabled600lb # [ 0.103148] printk: legacy console [ttyS0] enabled601client # [ 0.065979] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.602worker1 # [ 0.066023] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.603worker2 # [ 0.074097] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns604lb # [ 0.198386] ACPI: Core revision 20250807605client # [ 0.065980] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1606worker1 # [ 0.066025] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.607worker2 # [ 0.074214] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)608worker2 # [ 0.077827] Console: colour VGA+ 80x25609client # [ 0.066002] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.610lb # [ 0.199243] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns611worker1 # [ 0.066026] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612worker2 # [ 0.077830] printk: legacy console [tty0] enabled613worker2 # [ 0.107751] printk: legacy console [ttyS0] enabled614client # [ 0.066004] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.615lb # [ 0.200730] APIC: Switch to symmetric I/O mode setup616worker1 # [ 0.070812] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16617lb # [ 0.201702] x2apic enabled618worker2 # [ 0.204720] ACPI: Core revision 20250807619worker1 # [ 0.071092] rcu: srcu_init: Setting srcu_struct sizes based on contention.620client # [ 0.066005] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.621client # [ 0.070411] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16622lb # [ 0.202445] APIC: Switched APIC routing to: physical x2apic623worker1 # [ 0.071097] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns624worker2 # [ 0.205661] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns625client # [ 0.070714] rcu: srcu_init: Setting srcu_struct sizes based on contention.626worker1 # [ 0.071204] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)627worker2 # [ 0.207272] APIC: Switch to symmetric I/O mode setup628worker1 # [ 0.074859] Console: colour VGA+ 80x25629client # [ 0.070721] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns630lb # [ 0.204246] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1631worker2 # [ 0.208201] x2apic enabled632worker1 # [ 0.074863] printk: legacy console [tty0] enabled633worker1 # [ 0.104941] printk: legacy console [ttyS0] enabled634client # [ 0.070830] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)635worker2 # [ 0.208940] APIC: Switched APIC routing to: physical x2apic636client # [ 0.074418] Console: colour VGA+ 80x25637lb # [ 0.205213] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns638worker1 # [ 0.201454] ACPI: Core revision 20250807639client # [ 0.074423] printk: legacy console [tty0] enabled640client # [ 0.104106] printk: legacy console [ttyS0] enabled641lb # [ 0.206857] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)642worker2 # [ 0.210733] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1643worker1 # [ 0.202346] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns644client # [ 0.199938] ACPI: Core revision 20250807645lb # [ 0.207942] x86/cpu: User Mode Instruction Prevention (UMIP) activated646worker1 # [ 0.203871] APIC: Switch to symmetric I/O mode setup647worker2 # [ 0.211679] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns648worker1 # [ 0.204819] x2apic enabled649lb # [ 0.208979] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127650client # [ 0.201154] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns651worker1 # [ 0.205597] APIC: Switched APIC routing to: physical x2apic652lb # [ 0.209854] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0653client # [ 0.202644] APIC: Switch to symmetric I/O mode setup654worker2 # [ 0.213322] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)655client # [ 0.203584] x2apic enabled656worker2 # [ 0.214410] x86/cpu: User Mode Instruction Prevention (UMIP) activated657lb # [ 0.210858] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto658worker1 # [ 0.207418] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1659client # [ 0.204322] APIC: Switched APIC routing to: physical x2apic660worker2 # [ 0.215465] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127661lb # [ 0.212854] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl662worker2 # [ 0.216319] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0663worker1 # [ 0.208419] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns664client # [ 0.206097] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1665lb # [ 0.213854] Transient Scheduler Attacks: Vulnerable: No microcode666worker1 # [ 0.210112] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)667lb # [ 0.214854] Spectre V2 : Mitigation: Enhanced / Automatic IBRS668worker2 # [ 0.217323] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto669client # [ 0.207041] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns670lb # [ 0.215854] Speculative Return Stack Overflow: Mitigation: Safe RET671worker1 # [ 0.211194] x86/cpu: User Mode Instruction Prevention (UMIP) activated672worker2 # [ 0.218320] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl673worker1 # [ 0.212237] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127674client # [ 0.208908] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)675worker2 # [ 0.219320] Transient Scheduler Attacks: Vulnerable: No microcode676worker1 # [ 0.213816] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0677worker2 # [ 0.220320] Spectre V2 : Mitigation: Enhanced / Automatic IBRS678client # [ 0.210024] x86/cpu: User Mode Instruction Prevention (UMIP) activated679worker2 # [ 0.221320] Speculative Return Stack Overflow: Mitigation: Safe RET680client # [ 0.212058] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127681lb # [ 0.216854] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization682worker1 # [ 0.214919] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto683lb # [ 0.218861] Spectre V2 : Enabling IBPB for BPF684client # [ 0.212907] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0685worker1 # [ 0.216109] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl686lb # [ 0.219855] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier687worker1 # [ 0.217109] Transient Scheduler Attacks: Vulnerable: No microcode688lb # [ 0.220854] active return thunk: srso_alias_return_thunk689client # [ 0.213911] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto690worker1 # [ 0.218818] Spectre V2 : Mitigation: Enhanced / Automatic IBRS691worker2 # [ 0.222331] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization692worker2 # [ 0.224327] Spectre V2 : Enabling IBPB for BPF693lb # [ 0.221875] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'694worker1 # [ 0.219776] Speculative Return Stack Overflow: Mitigation: Safe RET695client # [ 0.215907] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl696lb # [ 0.222854] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'697client # [ 0.216907] Transient Scheduler Attacks: Vulnerable: No microcode698worker2 # [ 0.225320] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier699lb # [ 0.223854] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'700worker2 # [ 0.226320] active return thunk: srso_alias_return_thunk701client # [ 0.218906] Spectre V2 : Mitigation: Enhanced / Automatic IBRS702lb # [ 0.224854] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'703worker2 # [ 0.227351] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'704client # [ 0.219907] Speculative Return Stack Overflow: Mitigation: Safe RET705worker1 # [ 0.220826] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization706lb # [ 0.225854] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'707worker2 # [ 0.228320] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'708worker1 # [ 0.222116] Spectre V2 : Enabling IBPB for BPF709lb # [ 0.226854] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'710worker2 # [ 0.230140] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'711worker1 # [ 0.223109] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier712lb # [ 0.227854] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'713worker2 # [ 0.231320] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'714worker1 # [ 0.224110] active return thunk: srso_alias_return_thunk715lb # [ 0.229750] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256716worker2 # [ 0.232319] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'717client # [ 0.220907] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization718lb # [ 0.230560] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64719worker1 # [ 0.225772] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'720worker2 # [ 0.233319] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'721client # [ 0.222919] Spectre V2 : Enabling IBPB for BPF722worker1 # [ 0.226977] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'723lb # [ 0.231547] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512724lb # [ 0.232538] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024725worker1 # [ 0.227820] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'726worker2 # [ 0.234320] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'727client # [ 0.224539] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier728lb # [ 0.232854] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8729worker1 # [ 0.228823] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'730client # [ 0.225908] active return thunk: srso_alias_return_thunk731worker2 # [ 0.235321] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256732worker1 # [ 0.229844] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'733lb # [ 0.233854] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.734worker2 # [ 0.237321] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64735client # [ 0.226933] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'736worker1 # [ 0.230857] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'737worker2 # [ 0.238320] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512738client # [ 0.227908] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'739worker1 # [ 0.231871] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'740worker2 # [ 0.239319] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024741worker1 # [ 0.233109] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256742client # [ 0.229907] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'743worker2 # [ 0.240319] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8744worker1 # [ 0.234108] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64745client # [ 0.230908] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'746worker1 # [ 0.235108] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512747worker2 # [ 0.241319] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.748client # [ 0.231908] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'749worker1 # [ 0.236108] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024750client # [ 0.232907] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'751worker1 # [ 0.237108] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8752worker1 # [ 0.238109] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.753client # [ 0.234907] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'754client # [ 0.235908] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256755client # [ 0.236908] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64756client # [ 0.238907] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512757client # [ 0.239907] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024758client # [ 0.240907] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8759client # [ 0.241907] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.760lb # [ 0.270407] Freeing SMP alternatives memory: 44K761lb # [ 0.270857] pid_max: default: 32768 minimum: 301762lb # [ 0.271955] LSM: initializing lsm=capability,landlock,yama,bpf,ima763lb # [ 0.272966] landlock: Up and running.764lb # [ 0.273854] Yama: becoming mindful.765lb # [ 0.274660] LSM support for eBPF active766lb # [ 0.275446] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker2 # [ 0.278428] Freeing SMP alternatives memory: 44K768worker2 # [ 0.279202] pid_max: default: 32768 minimum: 301769lb # [ 0.276890] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)770worker2 # [ 0.279980] LSM: initializing lsm=capability,landlock,yama,bpf,ima771worker1 # [ 0.273809] Freeing SMP alternatives memory: 44K772worker2 # [ 0.280431] landlock: Up and running.773worker1 # [ 0.274112] pid_max: default: 32768 minimum: 301774worker2 # [ 0.281755] Yama: becoming mindful.775lb # [ 0.279171] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)776worker1 # [ 0.275202] LSM: initializing lsm=capability,landlock,yama,bpf,ima777worker2 # [ 0.282545] LSM support for eBPF active778worker1 # [ 0.276223] landlock: Up and running.779lb # [ 0.280426] Performance Events: Fam17h+ core perfctr, AMD PMU driver.780worker1 # [ 0.277109] Yama: becoming mindful.781worker2 # [ 0.283460] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)782lb # [ 0.280863] ... version: 2783worker1 # [ 0.277901] LSM support for eBPF active784lb # [ 0.281604] ... bit width: 48785worker2 # [ 0.284367] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)786lb # [ 0.281856] ... generic counters: 6787worker1 # [ 0.278672] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)788lb # [ 0.282581] ... generic bitmap: 000000000000003f789worker1 # [ 0.279998] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)790lb # [ 0.282856] ... fixed-purpose counters: 0791lb # [ 0.283574] ... fixed-purpose bitmap: 0000000000000000792worker2 # [ 0.287678] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)793lb # [ 0.283856] ... value mask: 0000ffffffffffff794worker1 # [ 0.282321] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)795lb # [ 0.284768] ... max period: 00007fffffffffff796worker2 # [ 0.288907] Performance Events: Fam17h+ core perfctr, AMD PMU driver.797worker2 # [ 0.289329] ... version: 2798lb # [ 0.285486] ... global_ctrl mask: 000000000000003f799worker1 # [ 0.283677] Performance Events: Fam17h+ core perfctr, AMD PMU driver.800worker2 # [ 0.290087] ... bit width: 48801lb # [ 0.285975] signal: max sigframe size: 3376802worker1 # [ 0.284118] ... version: 2803worker2 # [ 0.290322] ... generic counters: 6804client # [ 0.282532] Freeing SMP alternatives memory: 44K805lb # [ 0.286787] rcu: Hierarchical SRCU implementation.806worker1 # [ 0.284784] ... bit width: 48807worker2 # [ 0.291011] ... generic bitmap: 000000000000003f808client # [ 0.282908] pid_max: default: 32768 minimum: 301809lb # [ 0.287440] rcu: Max phase no-delay instances is 400.810worker1 # [ 0.285111] ... generic counters: 6811worker2 # [ 0.291321] ... fixed-purpose counters: 0812client # [ 0.283995] LSM: initializing lsm=capability,landlock,yama,bpf,ima813worker1 # [ 0.285818] ... generic bitmap: 000000000000003f814worker2 # [ 0.292014] ... fixed-purpose bitmap: 0000000000000000815worker1 # [ 0.286111] ... fixed-purpose counters: 0816client # [ 0.285020] landlock: Up and running.817client # [ 0.285616] Yama: becoming mindful.818worker2 # [ 0.292321] ... value mask: 0000ffffffffffff819worker1 # [ 0.286787] ... fixed-purpose bitmap: 0000000000000000820client # [ 0.286524] LSM support for eBPF active821worker2 # [ 0.293267] ... max period: 00007fffffffffff822worker1 # [ 0.287111] ... value mask: 0000ffffffffffff823worker2 # [ 0.294006] ... global_ctrl mask: 000000000000003f824worker1 # [ 0.287993] ... max period: 00007fffffffffff825client # [ 0.287018] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)826worker2 # [ 0.294423] signal: max sigframe size: 3376827worker1 # [ 0.288789] ... global_ctrl mask: 000000000000003f828lb # [ 0.292412] smp: Bringing up secondary CPUs ...829client # [ 0.287943] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)830worker2 # [ 0.295216] rcu: Hierarchical SRCU implementation.831worker1 # [ 0.289208] signal: max sigframe size: 3376832lb # [ 0.292870] smp: Brought up 1 node, 1 CPU833worker2 # [ 0.295887] rcu: Max phase no-delay instances is 400.834worker1 # [ 0.289995] rcu: Hierarchical SRCU implementation.835lb # [ 0.293547] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)836worker1 # [ 0.290700] rcu: Max phase no-delay instances is 400.837client # [ 0.290847] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)838lb # [ 0.294022] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)839client # [ 0.291425] Performance Events: Fam17h+ core perfctr, AMD PMU driver.840lb # [ 0.295108] devtmpfs: initialized841client # [ 0.291910] ... version: 2842client # [ 0.292630] ... bit width: 48843lb # [ 0.295959] x86/mm: Memory block size: 128MB844client # [ 0.292908] ... generic counters: 6845worker2 # [ 0.301016] smp: Bringing up secondary CPUs ...846client # [ 0.293646] ... generic bitmap: 000000000000003f847worker2 # [ 0.301337] smp: Brought up 1 node, 1 CPU848worker1 # [ 0.295647] smp: Bringing up secondary CPUs ...849client # [ 0.293955] ... fixed-purpose counters: 0850worker1 # [ 0.296127] smp: Brought up 1 node, 1 CPU851lb # [ 0.297733] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)852worker2 # [ 0.302028] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)853client # [ 0.294614] ... fixed-purpose bitmap: 0000000000000000854worker1 # [ 0.296762] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)855lb # [ 0.298789] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).856client # [ 0.294907] ... value mask: 0000ffffffffffff857lb # [ 0.299950] pinctrl core: initialized pinctrl subsystem858client # [ 0.295769] ... max period: 00007fffffffffff859worker2 # [ 0.302527] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)860worker1 # [ 0.297387] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)861client # [ 0.296551] ... global_ctrl mask: 000000000000003f862lb # [ 0.301060] PM: RTC time: 08:04:35, date: 2026-09-20863worker2 # [ 0.303660] devtmpfs: initialized864worker1 # [ 0.298354] devtmpfs: initialized865client # [ 0.297028] signal: max sigframe size: 3376866worker2 # [ 0.304573] x86/mm: Memory block size: 128MB867worker1 # [ 0.299186] x86/mm: Memory block size: 128MB868client # [ 0.297859] rcu: Hierarchical SRCU implementation.869client # [ 0.298503] rcu: Max phase no-delay instances is 400.870worker2 # [ 0.306420] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)871lb # [ 0.304695] NET: Registered PF_NETLINK/PF_ROUTE protocol family872worker1 # [ 0.300972] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)873worker2 # [ 0.307351] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).874worker1 # [ 0.301996] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).875lb # [ 0.306086] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations876worker2 # [ 0.308434] pinctrl core: initialized pinctrl subsystem877worker1 # [ 0.303195] pinctrl core: initialized pinctrl subsystem878lb # [ 0.306879] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations879worker1 # [ 0.304283] PM: RTC time: 08:04:35, date: 2026-09-20880worker2 # [ 0.309629] PM: RTC time: 08:04:35, date: 2026-09-20881client # [ 0.303589] smp: Bringing up secondary CPUs ...882lb # [ 0.308135] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations883client # [ 0.303921] smp: Brought up 1 node, 1 CPU884lb # [ 0.308866] audit: initializing netlink subsys (disabled)885client # [ 0.304600] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)886lb # [ 0.310040] thermal_sys: Registered thermal governor 'fair_share'887worker1 # [ 0.307996] NET: Registered PF_NETLINK/PF_ROUTE protocol family888worker2 # [ 0.313289] NET: Registered PF_NETLINK/PF_ROUTE protocol family889lb # [ 0.310042] thermal_sys: Registered thermal governor 'bang_bang'890client # [ 0.305113] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)891lb # [ 0.310857] thermal_sys: Registered thermal governor 'step_wise'892worker1 # [ 0.309328] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations893client # [ 0.306154] devtmpfs: initialized894worker2 # [ 0.314559] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations895lb # [ 0.311737] thermal_sys: Registered thermal governor 'user_space'896client # [ 0.306897] x86/mm: Memory block size: 128MB897worker1 # [ 0.310135] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations898worker2 # [ 0.315347] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations899lb # [ 0.312607] audit: type=2000 audit(1789891476.533:1): state=initialized audit_enabled=0 res=1900worker1 # [ 0.311399] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations901worker2 # [ 0.316618] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations902lb # [ 0.313859] thermal_sys: Registered thermal governor 'power_allocator'903client # [ 0.308541] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)904worker1 # [ 0.312123] audit: initializing netlink subsys (disabled)905lb # [ 0.313874] cpuidle: using governor menu906worker2 # [ 0.317343] audit: initializing netlink subsys (disabled)907client # [ 0.308941] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).908worker1 # [ 0.313232] thermal_sys: Registered thermal governor 'fair_share'909worker2 # [ 0.318499] thermal_sys: Registered thermal governor 'fair_share'910lb # [ 0.316065] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5911client # [ 0.309995] pinctrl core: initialized pinctrl subsystem912worker1 # [ 0.313235] thermal_sys: Registered thermal governor 'bang_bang'913worker2 # [ 0.318501] thermal_sys: Registered thermal governor 'bang_bang'914client # [ 0.311070] PM: RTC time: 08:04:35, date: 2026-09-20915worker1 # [ 0.314113] thermal_sys: Registered thermal governor 'step_wise'916lb # [ 0.317128] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]917worker2 # [ 0.319323] thermal_sys: Registered thermal governor 'step_wise'918worker1 # [ 0.315030] thermal_sys: Registered thermal governor 'user_space'919lb # [ 0.317860] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry920worker2 # [ 0.320287] thermal_sys: Registered thermal governor 'user_space'921lb # [ 0.318869] PCI: Using configuration type 1 for base access922worker1 # [ 0.315799] audit: type=2000 audit(1789891476.539:1): state=initialized audit_enabled=0 res=1923worker2 # [ 0.321098] audit: type=2000 audit(1789891476.536:1): state=initialized audit_enabled=0 res=1924worker1 # [ 0.317115] thermal_sys: Registered thermal governor 'power_allocator'925worker2 # [ 0.322326] thermal_sys: Registered thermal governor 'power_allocator'926lb # [ 0.319935] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.927client # [ 0.314670] NET: Registered PF_NETLINK/PF_ROUTE protocol family928worker1 # [ 0.317130] cpuidle: using governor menu929worker2 # [ 0.322341] cpuidle: using governor menu930client # [ 0.315412] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations931worker1 # [ 0.319334] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5932worker2 # [ 0.324572] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5933client # [ 0.315930] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations934worker1 # [ 0.320343] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]935worker2 # [ 0.325629] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]936client # [ 0.317174] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations937worker1 # [ 0.321114] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry938worker2 # [ 0.326325] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry939client # [ 0.317918] audit: initializing netlink subsys (disabled)940lb # [ 0.325109] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages941worker1 # [ 0.322123] PCI: Using configuration type 1 for base access942worker2 # [ 0.327333] PCI: Using configuration type 1 for base access943lb # [ 0.325858] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page944client # [ 0.318909] audit: type=2000 audit(1789891476.549:1): state=initialized audit_enabled=0 res=1945worker1 # [ 0.323212] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.946lb # [ 0.326833] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages947worker2 # [ 0.328406] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.948client # [ 0.319993] thermal_sys: Registered thermal governor 'fair_share'949client # [ 0.319995] thermal_sys: Registered thermal governor 'bang_bang'950client # [ 0.320908] thermal_sys: Registered thermal governor 'step_wise'951client # [ 0.321908] thermal_sys: Registered thermal governor 'user_space'952client # [ 0.322907] thermal_sys: Registered thermal governor 'power_allocator'953worker1 # [ 0.328239] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages954lb # [ 0.331856] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page955client # [ 0.323921] cpuidle: using governor menu956worker2 # [ 0.333574] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages957worker1 # [ 0.329112] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page958worker2 # [ 0.334323] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page959client # [ 0.326111] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5960client # [ 0.327150] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]961client # [ 0.327911] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry962client # [ 0.328919] PCI: Using configuration type 1 for base access963worker1 # [ 0.334113] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages964worker2 # [ 0.339324] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages965worker1 # [ 0.335110] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page966client # [ 0.330036] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.967worker2 # [ 0.340321] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page968lb # [ 0.342150] ACPI: Added _OSI(Module Device)969lb # [ 0.342858] ACPI: Added _OSI(Processor Device)970lb # [ 0.343619] ACPI: Added _OSI(Processor Aggregator Device)971client # [ 0.336925] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages972client # [ 0.337908] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page973worker1 # [ 0.345508] ACPI: Added _OSI(Module Device)974worker2 # [ 0.350751] ACPI: Added _OSI(Module Device)975worker1 # [ 0.346113] ACPI: Added _OSI(Processor Device)976worker2 # [ 0.351323] ACPI: Added _OSI(Processor Device)977worker1 # [ 0.346816] ACPI: Added _OSI(Processor Aggregator Device)978lb # [ 0.350430] ACPI: 1 ACPI AML tables successfully acquired and loaded979worker2 # [ 0.352072] ACPI: Added _OSI(Processor Aggregator Device)980client # [ 0.342908] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages981client # [ 0.343908] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page982lb # [ 0.354266] ACPI: Interpreter enabled983lb # [ 0.354874] ACPI: PM: (supports S0 S3 S4 S5)984lb # [ 0.355642] ACPI: Using IOAPIC for interrupt routing985worker1 # [ 0.355581] ACPI: 1 ACPI AML tables successfully acquired and loaded986lb # [ 0.357898] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug987worker2 # [ 0.360881] ACPI: 1 ACPI AML tables successfully acquired and loaded988lb # [ 0.358857] PCI: Using E820 reservations for host bridge windows989worker1 # [ 0.359520] ACPI: Interpreter enabled990client # [ 0.355180] ACPI: Added _OSI(Module Device)991lb # [ 0.362000] ACPI: Enabled 2 GPEs in block 00 to 3F992client # [ 0.355895] ACPI: Added _OSI(Processor Device)993worker1 # [ 0.360127] ACPI: PM: (supports S0 S3 S4 S5)994worker2 # [ 0.364724] ACPI: Interpreter enabled995worker1 # [ 0.360849] ACPI: Using IOAPIC for interrupt routing996client # [ 0.356433] ACPI: Added _OSI(Processor Aggregator Device)997worker2 # [ 0.365338] ACPI: PM: (supports S0 S3 S4 S5)998worker2 # [ 0.366048] ACPI: Using IOAPIC for interrupt routing999worker1 # [ 0.363152] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1000worker2 # [ 0.368388] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1001worker1 # [ 0.364112] PCI: Using E820 reservations for host bridge windows1002worker2 # [ 0.369322] PCI: Using E820 reservations for host bridge windows1003client # [ 0.362615] ACPI: 1 ACPI AML tables successfully acquired and loaded1004worker1 # [ 0.367235] ACPI: Enabled 2 GPEs in block 00 to 3F1005lb # [ 0.370656] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1006worker2 # [ 0.372461] ACPI: Enabled 2 GPEs in block 00 to 3F1007lb # [ 0.371628] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1008client # [ 0.366319] ACPI: Interpreter enabled1009lb # [ 0.373315] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1010client # [ 0.366923] ACPI: PM: (supports S0 S3 S4 S5)1011lb # [ 0.373981] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1012client # [ 0.367666] ACPI: Using IOAPIC for interrupt routing1013lb # [ 0.375273] PCI host bridge to bus 0000:001014lb # [ 0.375862] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1015worker1 # [ 0.375023] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1016lb # [ 0.376857] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1017client # [ 0.369978] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1018worker2 # [ 0.379900] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1019lb # [ 0.377857] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1020client # [ 0.370908] PCI: Using E820 reservations for host bridge windows1021worker1 # [ 0.375860] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1022worker2 # [ 0.380328] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1023lb # [ 0.378856] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1024worker1 # [ 0.377191] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1025worker2 # [ 0.381401] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1026lb # [ 0.379857] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1027worker1 # [ 0.378246] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1028client # [ 0.373930] ACPI: Enabled 2 GPEs in block 00 to 3F1029worker2 # [ 0.382444] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1030lb # [ 0.380856] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1031worker1 # [ 0.379484] PCI host bridge to bus 0000:001032worker2 # [ 0.383687] PCI host bridge to bus 0000:001033lb # [ 0.381857] pci_bus 0000:00: root bus resource [bus 00-ff]1034worker1 # [ 0.380116] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1035worker2 # [ 0.384325] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1036worker1 # [ 0.381112] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1037lb # [ 0.382850] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1038worker2 # [ 0.385321] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1039worker1 # [ 0.382111] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1040worker2 # [ 0.386321] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1041lb # [ 0.384303] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1042worker1 # [ 0.383111] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1043worker2 # [ 0.387322] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1044worker1 # [ 0.384112] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1045worker2 # [ 0.388321] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1046client # [ 0.381269] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1047worker1 # [ 0.385112] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1048worker2 # [ 0.389321] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1049worker1 # [ 0.386112] pci_bus 0000:00: root bus resource [bus 00-ff]1050client # [ 0.381913] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1051worker2 # [ 0.390322] pci_bus 0000:00: root bus resource [bus 00-ff]1052worker1 # [ 0.387058] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1053client # [ 0.382997] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1054worker2 # [ 0.391285] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1055client # [ 0.384031] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1056worker1 # [ 0.388582] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1057worker2 # [ 0.392777] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1058client # [ 0.385279] PCI host bridge to bus 0000:001059client # [ 0.385911] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1060lb # [ 0.387044] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1061client # [ 0.386907] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1062lb # [ 0.387913] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1063client # [ 0.387907] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1064lb # [ 0.388878] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1065client # [ 0.388907] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1066lb # [ 0.390183] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1067client # [ 0.389907] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1068client # [ 0.390907] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1069lb # [ 0.391609] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1070client # [ 0.391908] pci_bus 0000:00: root bus resource [bus 00-ff]1071worker1 # [ 0.391194] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1072client # [ 0.392909] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1073worker2 # [ 0.395529] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1074worker1 # [ 0.392169] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1075worker2 # [ 0.396334] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1076lb # [ 0.394864] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1077client # [ 0.394360] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1078worker1 # [ 0.393135] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1079worker2 # [ 0.397343] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1080lb # [ 0.395749] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1081lb # [ 0.396620] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1082worker1 # [ 0.394413] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1083worker2 # [ 0.398635] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1084lb # [ 0.396863] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1085worker1 # [ 0.395870] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1086worker2 # [ 0.400099] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1087lb # [ 0.398432] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1088worker1 # [ 0.399154] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1089worker2 # [ 0.403350] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1090worker1 # [ 0.400034] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1091lb # [ 0.400894] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1092worker2 # [ 0.404213] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1093lb # [ 0.401703] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1094client # [ 0.397095] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1095worker1 # [ 0.400815] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1096client # [ 0.397920] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1097lb # [ 0.402557] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1098worker2 # [ 0.405063] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1099worker1 # [ 0.401118] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1100worker2 # [ 0.405327] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1101client # [ 0.398854] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1102lb # [ 0.403436] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1103worker1 # [ 0.402677] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1104worker2 # [ 0.406893] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1105client # [ 0.400044] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1106client # [ 0.401668] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1107worker1 # [ 0.405147] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1108worker2 # [ 0.409255] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1109lb # [ 0.406857] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1110worker1 # [ 0.406015] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1111worker2 # [ 0.409947] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1112lb # [ 0.407673] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1113worker1 # [ 0.406870] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1114worker2 # [ 0.410343] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1115lb # [ 0.408550] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1116client # [ 0.404942] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1117client # [ 0.405848] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1118worker2 # [ 0.411918] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1119lb # [ 0.409447] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1120worker1 # [ 0.407677] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1121client # [ 0.406629] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1122client # [ 0.406914] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1123lb # [ 0.411894] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1124worker1 # [ 0.410068] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1125worker2 # [ 0.414425] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1126lb # [ 0.412751] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1127worker1 # [ 0.410758] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1128worker2 # [ 0.415297] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1129client # [ 0.408452] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1130worker1 # [ 0.411136] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1131worker2 # [ 0.416040] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1132lb # [ 0.413597] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1133worker1 # [ 0.412677] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1134worker2 # [ 0.416951] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1135client # [ 0.410877] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1136lb # [ 0.414439] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1137client # [ 0.411589] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1138client # [ 0.411930] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1139lb # [ 0.416770] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1140client # [ 0.413449] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1141lb # [ 0.417522] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1142worker2 # [ 0.419348] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1143worker1 # [ 0.415144] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1144lb # [ 0.417879] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1145worker1 # [ 0.416119] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1146worker2 # [ 0.420329] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1147worker2 # [ 0.421344] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1148worker1 # [ 0.417078] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1149lb # [ 0.419436] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1150client # [ 0.415810] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1151worker2 # [ 0.422881] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1152client # [ 0.416713] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1153worker1 # [ 0.418678] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1154client # [ 0.417596] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1155worker2 # [ 0.424347] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1156worker1 # [ 0.420735] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1157lb # [ 0.422892] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1158client # [ 0.419360] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1159worker2 # [ 0.425199] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1160worker1 # [ 0.421120] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1161lb # [ 0.423698] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1162worker2 # [ 0.426021] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1163worker1 # [ 0.422082] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1164lb # [ 0.424622] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1165lb # [ 0.426333] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1166worker2 # [ 0.426988] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1167worker1 # [ 0.424555] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1168client # [ 0.421939] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1169client # [ 0.422915] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1170lb # [ 0.428680] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1171client # [ 0.423929] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1172worker2 # [ 0.430276] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1173worker1 # [ 0.427024] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1174lb # [ 0.429524] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1175worker2 # [ 0.430973] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1176worker1 # [ 0.427760] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1177client # [ 0.425465] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1178worker2 # [ 0.431345] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1179worker1 # [ 0.428134] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1180lb # [ 0.429878] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1181lb # [ 0.430863] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1182worker2 # [ 0.432921] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1183client # [ 0.427585] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1184worker1 # [ 0.429683] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1185client # [ 0.427914] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1186lb # [ 0.432414] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1187client # [ 0.428865] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1188lb # [ 0.433869] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1189worker2 # [ 0.435349] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1190worker1 # [ 0.432437] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1191lb # [ 0.434856] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1192worker2 # [ 0.436330] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1193client # [ 0.430406] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1194worker1 # [ 0.433762] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1195worker2 # [ 0.437263] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1196worker1 # [ 0.434134] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1197lb # [ 0.436436] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1198worker2 # [ 0.438181] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1199worker1 # [ 0.435119] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1200client # [ 0.433779] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1201client # [ 0.434580] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1202worker2 # [ 0.439709] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1203worker1 # [ 0.436675] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1204client # [ 0.434943] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1205lb # [ 0.438697] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1206worker2 # [ 0.441336] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1207lb # [ 0.439492] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1208worker1 # [ 0.438124] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1209client # [ 0.436483] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1210worker2 # [ 0.442300] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1211lb # [ 0.439878] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1212worker1 # [ 0.439084] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1213lb # [ 0.441441] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1214worker2 # [ 0.443693] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1215worker1 # [ 0.440519] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1216client # [ 0.438898] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1217client # [ 0.439915] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1218lb # [ 0.443580] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1219worker2 # [ 0.446010] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1220client # [ 0.440917] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1221worker1 # [ 0.442841] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1222lb # [ 0.443865] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1223worker2 # [ 0.446330] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1224client # [ 0.441913] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1225worker1 # [ 0.443119] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1226lb # [ 0.444803] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1227worker2 # [ 0.447296] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1228worker1 # [ 0.444080] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1229client # [ 0.443398] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1230worker2 # [ 0.448715] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1231lb # [ 0.446235] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1232worker1 # [ 0.445542] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1233client # [ 0.444927] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1234lb # [ 0.448697] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1235worker2 # [ 0.450349] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1236client # [ 0.445918] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1237lb # [ 0.449707] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1238worker2 # [ 0.451230] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1239worker1 # [ 0.447119] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1240worker1 # [ 0.448119] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1241client # [ 0.447433] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1242worker2 # [ 0.452345] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1243lb # [ 0.451541] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1244worker1 # [ 0.449060] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1245worker2 # [ 0.453927] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1246client # [ 0.449576] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1247worker1 # [ 0.450645] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1248client # [ 0.449915] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1249worker2 # [ 0.455118] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1250client # [ 0.450874] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1251worker1 # [ 0.451957] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1252worker2 # [ 0.456245] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1253worker1 # [ 0.452971] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1254client # [ 0.452305] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1255worker2 # [ 0.457976] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1256worker1 # [ 0.454801] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1257client # [ 0.453983] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1258client # [ 0.454881] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1259client # [ 0.455929] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1260lb # [ 0.452057] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1261client # [ 0.457462] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1262lb # [ 0.454639] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1263client # [ 0.458692] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1264lb # [ 0.455265] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1265client # [ 0.459753] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1266lb # [ 0.456557] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1267client # [ 0.461565] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1268lb # [ 0.457160] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1269worker2 # [ 0.458558] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1270lb # [ 0.458147] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1271worker1 # [ 0.455315] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1272lb # [ 0.459119] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1273lb # [ 0.460921] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1274worker2 # [ 0.462240] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1275lb # [ 0.461863] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1276worker1 # [ 0.458877] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1277worker2 # [ 0.463279] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1278lb # [ 0.463163] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1279worker1 # [ 0.459433] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1280lb # [ 0.464721] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1281worker2 # [ 0.465772] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1282worker1 # [ 0.461141] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1283worker2 # [ 0.466573] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1284client # [ 0.462113] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1285worker1 # [ 0.462335] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1286worker2 # [ 0.467621] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1287lb # [ 0.468560] ACPI: PCI: Interrupt link LNKA configured for IRQ 101288worker1 # [ 0.463434] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1289lb # [ 0.468962] ACPI: PCI: Interrupt link LNKB configured for IRQ 101290worker2 # [ 0.468590] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1291worker1 # [ 0.464365] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1292lb # [ 0.469958] ACPI: PCI: Interrupt link LNKC configured for IRQ 111293lb # [ 0.470957] ACPI: PCI: Interrupt link LNKD configured for IRQ 111294client # [ 0.465577] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1295worker2 # [ 0.471311] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1296lb # [ 0.471953] ACPI: PCI: Interrupt link LNKE configured for IRQ 101297worker1 # [ 0.466170] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1298worker2 # [ 0.472217] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1299worker1 # [ 0.466997] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1300lb # [ 0.472951] ACPI: PCI: Interrupt link LNKF configured for IRQ 101301client # [ 0.466168] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1302lb # [ 0.473951] ACPI: PCI: Interrupt link LNKG configured for IRQ 111303worker2 # [ 0.473396] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1304worker1 # [ 0.468127] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1305lb # [ 0.474954] ACPI: PCI: Interrupt link LNKH configured for IRQ 111306client # [ 0.467980] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1307lb # [ 0.475891] ACPI: PCI: Interrupt link GSIA configured for IRQ 161308worker1 # [ 0.470139] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1309worker2 # [ 0.475372] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1310client # [ 0.469169] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1311lb # [ 0.476815] ACPI: PCI: Interrupt link GSIB configured for IRQ 171312lb # [ 0.477544] ACPI: PCI: Interrupt link GSIC configured for IRQ 181313client # [ 0.470191] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1314lb # [ 0.477872] ACPI: PCI: Interrupt link GSID configured for IRQ 191315client # [ 0.471163] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1316lb # [ 0.478822] ACPI: PCI: Interrupt link GSIE configured for IRQ 201317lb # [ 0.479746] ACPI: PCI: Interrupt link GSIF configured for IRQ 211318worker1 # [ 0.474236] ACPI: PCI: Interrupt link LNKA configured for IRQ 101319worker2 # [ 0.479717] ACPI: PCI: Interrupt link LNKA configured for IRQ 101320lb # [ 0.480562] ACPI: PCI: Interrupt link GSIG configured for IRQ 221321worker1 # [ 0.475220] ACPI: PCI: Interrupt link LNKB configured for IRQ 101322worker2 # [ 0.480441] ACPI: PCI: Interrupt link LNKB configured for IRQ 101323lb # [ 0.480871] ACPI: PCI: Interrupt link GSIH configured for IRQ 231324client # [ 0.473658] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1325worker1 # [ 0.476290] ACPI: PCI: Interrupt link LNKC configured for IRQ 111326worker2 # [ 0.481429] ACPI: PCI: Interrupt link LNKC configured for IRQ 111327client # [ 0.473914] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1328worker1 # [ 0.477217] ACPI: PCI: Interrupt link LNKD configured for IRQ 111329worker2 # [ 0.482420] ACPI: PCI: Interrupt link LNKD configured for IRQ 111330lb # [ 0.482942] iommu: Default domain type: Translated1331client # [ 0.475177] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1332worker2 # [ 0.483419] ACPI: PCI: Interrupt link LNKE configured for IRQ 101333lb # [ 0.483728] iommu: DMA domain TLB invalidation policy: lazy mode1334worker2 # [ 0.484459] ACPI: PCI: Interrupt link LNKF configured for IRQ 101335client # [ 0.476785] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1336worker1 # [ 0.478214] ACPI: PCI: Interrupt link LNKE configured for IRQ 101337worker2 # [ 0.485464] ACPI: PCI: Interrupt link LNKG configured for IRQ 111338worker1 # [ 0.479339] ACPI: PCI: Interrupt link LNKF configured for IRQ 101339lb # [ 0.484858] ACPI: bus type USB registered1340worker2 # [ 0.486428] ACPI: PCI: Interrupt link LNKH configured for IRQ 111341worker1 # [ 0.480219] ACPI: PCI: Interrupt link LNKG configured for IRQ 111342worker2 # [ 0.487361] ACPI: PCI: Interrupt link GSIA configured for IRQ 161343lb # [ 0.485940] usbcore: registered new interface driver usbfs1344lb # [ 0.486876] usbcore: registered new interface driver hub1345worker2 # [ 0.488338] ACPI: PCI: Interrupt link GSIB configured for IRQ 171346worker1 # [ 0.481216] ACPI: PCI: Interrupt link LNKH configured for IRQ 111347lb # [ 0.487830] usbcore: registered new device driver usb1348worker2 # [ 0.489348] ACPI: PCI: Interrupt link GSIC configured for IRQ 181349worker1 # [ 0.482157] ACPI: PCI: Interrupt link GSIA configured for IRQ 161350worker2 # [ 0.490338] ACPI: PCI: Interrupt link GSID configured for IRQ 191351lb # [ 0.489559] NetLabel: Initializing1352worker1 # [ 0.483133] ACPI: PCI: Interrupt link GSIB configured for IRQ 171353client # [ 0.481814] ACPI: PCI: Interrupt link LNKA configured for IRQ 101354worker2 # [ 0.491336] ACPI: PCI: Interrupt link GSIE configured for IRQ 201355lb # [ 0.489858] NetLabel: domain hash size = 1281356worker1 # [ 0.484126] ACPI: PCI: Interrupt link GSIC configured for IRQ 181357client # [ 0.482731] ACPI: PCI: Interrupt link LNKB configured for IRQ 101358worker2 # [ 0.492270] ACPI: PCI: Interrupt link GSIF configured for IRQ 211359lb # [ 0.490552] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1360worker1 # [ 0.485092] ACPI: PCI: Interrupt link GSID configured for IRQ 191361worker2 # [ 0.493042] ACPI: PCI: Interrupt link GSIG configured for IRQ 221362client # [ 0.483700] ACPI: PCI: Interrupt link LNKC configured for IRQ 111363lb # [ 0.490907] NetLabel: unlabeled traffic allowed by default1364lb # [ 0.491770] PCI: Using ACPI for IRQ routing1365worker1 # [ 0.485844] ACPI: PCI: Interrupt link GSIE configured for IRQ 201366worker2 # [ 0.493337] ACPI: PCI: Interrupt link GSIH configured for IRQ 231367client # [ 0.484701] ACPI: PCI: Interrupt link LNKD configured for IRQ 111368worker1 # [ 0.486125] ACPI: PCI: Interrupt link GSIF configured for IRQ 211369client # [ 0.485700] ACPI: PCI: Interrupt link LNKE configured for IRQ 101370worker1 # [ 0.487125] ACPI: PCI: Interrupt link GSIG configured for IRQ 221371worker2 # [ 0.495447] iommu: Default domain type: Translated1372client # [ 0.486759] ACPI: PCI: Interrupt link LNKF configured for IRQ 101373worker1 # [ 0.488111] ACPI: PCI: Interrupt link GSIH configured for IRQ 231374worker2 # [ 0.496263] iommu: DMA domain TLB invalidation policy: lazy mode1375client # [ 0.487692] ACPI: PCI: Interrupt link LNKG configured for IRQ 111376worker2 # [ 0.497367] ACPI: bus type USB registered1377client # [ 0.488714] ACPI: PCI: Interrupt link LNKH configured for IRQ 111378worker1 # [ 0.490224] iommu: Default domain type: Translated1379worker2 # [ 0.498179] usbcore: registered new interface driver usbfs1380client # [ 0.489678] ACPI: PCI: Interrupt link GSIA configured for IRQ 161381worker1 # [ 0.491038] iommu: DMA domain TLB invalidation policy: lazy mode1382worker2 # [ 0.499068] usbcore: registered new interface driver hub1383worker2 # [ 0.499336] usbcore: registered new device driver usb1384worker1 # [ 0.492141] ACPI: bus type USB registered1385client # [ 0.489925] ACPI: PCI: Interrupt link GSIB configured for IRQ 171386worker1 # [ 0.492903] usbcore: registered new interface driver usbfs1387client # [ 0.490925] ACPI: PCI: Interrupt link GSIC configured for IRQ 181388worker2 # [ 0.501116] NetLabel: Initializing1389worker1 # [ 0.493852] usbcore: registered new interface driver hub1390client # [ 0.491920] ACPI: PCI: Interrupt link GSID configured for IRQ 191391worker2 # [ 0.501328] NetLabel: domain hash size = 1281392worker1 # [ 0.494128] usbcore: registered new device driver usb1393client # [ 0.492853] ACPI: PCI: Interrupt link GSIE configured for IRQ 201394worker2 # [ 0.502043] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1395client # [ 0.493627] ACPI: PCI: Interrupt link GSIF configured for IRQ 211396worker2 # [ 0.502361] NetLabel: unlabeled traffic allowed by default1397worker1 # [ 0.495917] NetLabel: Initializing1398worker2 # [ 0.503251] PCI: Using ACPI for IRQ routing1399client # [ 0.493919] ACPI: PCI: Interrupt link GSIG configured for IRQ 221400worker1 # [ 0.496118] NetLabel: domain hash size = 1281401client # [ 0.494861] ACPI: PCI: Interrupt link GSIH configured for IRQ 231402worker1 # [ 0.496874] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1403worker1 # [ 0.497176] NetLabel: unlabeled traffic allowed by default1404client # [ 0.496735] iommu: Default domain type: Translated1405worker1 # [ 0.498125] PCI: Using ACPI for IRQ routing1406client # [ 0.497526] iommu: DMA domain TLB invalidation policy: lazy mode1407client # [ 0.498182] ACPI: bus type USB registered1408client # [ 0.498964] usbcore: registered new interface driver usbfs1409client # [ 0.499899] usbcore: registered new interface driver hub1410client # [ 0.500592] usbcore: registered new device driver usb1411client # [ 0.503154] NetLabel: Initializing1412client # [ 0.503779] NetLabel: domain hash size = 1281413client # [ 0.504483] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1414client # [ 0.504954] NetLabel: unlabeled traffic allowed by default1415client # [ 0.505922] PCI: Using ACPI for IRQ routing1416lb # [ 0.535202] pci 0000:00:01.0: vgaarb: setting as boot VGA device1417lb # [ 0.535853] pci 0000:00:01.0: vgaarb: bridge control possible1418lb # [ 0.535853] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1419lb # [ 0.535862] vgaarb: loaded1420lb # [ 0.536653] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01421lb # [ 0.537518] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1422lb # [ 0.542956] clocksource: Switched to clocksource kvm-clock1423worker2 # [ 0.547045] pci 0000:00:01.0: vgaarb: setting as boot VGA device1424lb # [ 0.544718] VFS: Disk quotas dquot_6.6.01425worker2 # [ 0.547317] pci 0000:00:01.0: vgaarb: bridge control possible1426worker2 # [ 0.547317] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1427worker2 # [ 0.547326] vgaarb: loaded1428worker1 # [ 0.542427] pci 0000:00:01.0: vgaarb: setting as boot VGA device1429lb # [ 0.547350] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1430worker2 # [ 0.548084] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01431worker1 # [ 0.543107] pci 0000:00:01.0: vgaarb: bridge control possible1432lb # [ 0.548697] pnp: PnP ACPI init1433worker2 # [ 0.548324] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434lb # [ 0.549541] ACPI: IRQ 4 override to edge(!), high(!)1435worker1 # [ 0.543107] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1436worker1 # [ 0.543117] vgaarb: loaded1437lb # [ 0.550517] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1438worker1 # [ 0.543859] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01439lb # [ 0.552136] pnp: PnP ACPI: found 6 devices1440worker1 # [ 0.544113] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1441worker2 # [ 0.552414] clocksource: Switched to clocksource kvm-clock1442worker1 # [ 0.548206] clocksource: Switched to clocksource kvm-clock1443worker2 # [ 0.556217] VFS: Disk quotas dquot_6.6.01444worker1 # [ 0.549949] VFS: Disk quotas dquot_6.6.01445worker2 # [ 0.556985] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1446client # [ 0.550245] pci 0000:00:01.0: vgaarb: setting as boot VGA device1447worker2 # [ 0.558408] pnp: PnP ACPI init1448client # [ 0.550903] pci 0000:00:01.0: vgaarb: bridge control possible1449worker2 # [ 0.559290] ACPI: IRQ 4 override to edge(!), high(!)1450lb # [ 0.559809] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1451client # [ 0.550903] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1452client # [ 0.550915] vgaarb: loaded1453worker1 # [ 0.552647] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454lb # [ 0.561211] clocksource: Switched to clocksource acpi_pm1455worker2 # [ 0.560305] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1456worker1 # [ 0.553979] pnp: PnP ACPI init1457client # [ 0.551664] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01458lb # [ 0.562138] NET: Registered PF_INET protocol family1459worker2 # [ 0.561823] pnp: PnP ACPI: found 6 devices1460worker1 # [ 0.554785] ACPI: IRQ 4 override to edge(!), high(!)1461client # [ 0.551908] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1462lb # [ 0.563283] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1463worker1 # [ 0.555799] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1464worker1 # [ 0.557387] pnp: PnP ACPI: found 6 devices1465client # [ 0.555027] clocksource: Switched to clocksource kvm-clock1466worker2 # [ 0.569580] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1467client # [ 0.559143] VFS: Disk quotas dquot_6.6.01468worker2 # [ 0.571150] clocksource: Switched to clocksource acpi_pm1469client # [ 0.560099] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1470worker2 # [ 0.572141] NET: Registered PF_INET protocol family1471client # [ 0.561665] pnp: PnP ACPI init1472worker1 # [ 0.565124] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1473worker2 # [ 0.573456] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1474client # [ 0.562658] ACPI: IRQ 4 override to edge(!), high(!)1475worker1 # [ 0.566607] clocksource: Switched to clocksource acpi_pm1476worker1 # [ 0.567576] NET: Registered PF_INET protocol family1477client # [ 0.563694] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1478client # [ 0.565313] pnp: PnP ACPI: found 6 devices1479worker1 # [ 0.568770] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1480lb # [ 0.580208] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1481lb # [ 0.582164] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1482lb # [ 0.583563] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1483lb # [ 0.584996] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1484client # [ 0.573195] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1485lb # [ 0.586272] TCP: Hash tables configured (established 16384 bind 16384)1486client # [ 0.574651] clocksource: Switched to clocksource acpi_pm1487client # [ 0.575656] NET: Registered PF_INET protocol family1488lb # [ 0.587426] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1489lb # [ 0.588686] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1490client # [ 0.576874] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1491lb # [ 0.589813] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1492lb # [ 0.591086] NET: Registered PF_UNIX/PF_LOCAL protocol family1493lb # [ 0.592101] NET: Registered PF_XDP protocol family1494worker2 # [ 0.591183] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1495lb # [ 0.592937] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1496worker2 # [ 0.592803] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1497worker1 # [ 0.585326] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1498lb # [ 0.593989] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1499lb # [ 0.594971] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1500worker2 # [ 0.594073] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1501worker1 # [ 0.586843] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1502lb # [ 0.596048] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1503worker2 # [ 0.595437] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1504worker1 # [ 0.588183] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1505lb # [ 0.597137] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1506worker2 # [ 0.596654] TCP: Hash tables configured (established 16384 bind 16384)1507worker1 # [ 0.589524] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1508lb # [ 0.598199] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1509worker2 # [ 0.597789] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1510worker1 # [ 0.590782] TCP: Hash tables configured (established 16384 bind 16384)1511lb # [ 0.599986] ACPI: \_SB_.GSIA: Enabled at IRQ 161512worker2 # [ 0.599103] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1513worker1 # [ 0.591990] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1514worker2 # [ 0.600202] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1515worker1 # [ 0.593320] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1516worker2 # [ 0.601447] NET: Registered PF_UNIX/PF_LOCAL protocol family1517lb # [ 0.602416] ACPI: \_SB_.GSIB: Enabled at IRQ 171518worker1 # [ 0.594462] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1519worker2 # [ 0.602426] NET: Registered PF_XDP protocol family1520worker1 # [ 0.595640] NET: Registered PF_UNIX/PF_LOCAL protocol family1521worker2 # [ 0.603340] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1522lb # [ 0.604386] ACPI: \_SB_.GSIC: Enabled at IRQ 181523worker1 # [ 0.596617] NET: Registered PF_XDP protocol family1524worker2 # [ 0.604391] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1525worker1 # [ 0.597454] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1526lb # [ 0.606279] ACPI: \_SB_.GSID: Enabled at IRQ 191527worker2 # [ 0.605397] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1528worker1 # [ 0.598450] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1529worker2 # [ 0.606516] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1530client # [ 0.595146] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1531lb # [ 0.607940] PCI: CLS 0 bytes, default 641532worker1 # [ 0.599429] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1533worker2 # [ 0.607615] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1534worker1 # [ 0.600503] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1535lb # [ 0.608907] Trying to unpack rootfs image as initramfs...1536client # [ 0.596733] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1537worker2 # [ 0.608714] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1538worker1 # [ 0.601572] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1539client # [ 0.597987] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1540worker2 # [ 0.610460] ACPI: \_SB_.GSIA: Enabled at IRQ 161541worker1 # [ 0.602669] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1542client # [ 0.599370] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1543worker1 # [ 0.604488] ACPI: \_SB_.GSIA: Enabled at IRQ 161544client # [ 0.600624] TCP: Hash tables configured (established 16384 bind 16384)1545worker2 # [ 0.612901] ACPI: \_SB_.GSIB: Enabled at IRQ 171546lb # [ 0.613304] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1547client # [ 0.601782] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1548client # [ 0.603031] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1549worker1 # [ 0.607328] ACPI: \_SB_.GSIB: Enabled at IRQ 171550worker2 # [ 0.615002] ACPI: \_SB_.GSIC: Enabled at IRQ 181551client # [ 0.604081] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1552worker1 # [ 0.609244] ACPI: \_SB_.GSIC: Enabled at IRQ 181553worker2 # [ 0.616995] ACPI: \_SB_.GSID: Enabled at IRQ 191554client # [ 0.605410] NET: Registered PF_UNIX/PF_LOCAL protocol family1555client # [ 0.606480] NET: Registered PF_XDP protocol family1556worker2 # [ 0.618689] PCI: CLS 0 bytes, default 641557worker1 # [ 0.611225] ACPI: \_SB_.GSID: Enabled at IRQ 191558client # [ 0.607379] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1559client # [ 0.608373] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1560worker1 # [ 0.612880] PCI: CLS 0 bytes, default 641561worker2 # [ 0.619617] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1562client # [ 0.609370] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1563worker2 # [ 0.621360] Trying to unpack rootfs image as initramfs...1564worker1 # [ 0.613768] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1565client # [ 0.610516] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566worker1 # [ 0.615538] Trying to unpack rootfs image as initramfs...1567client # [ 0.611615] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1568client # [ 0.612724] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1569client # [ 0.614604] ACPI: \_SB_.GSIA: Enabled at IRQ 161570client # [ 0.616966] ACPI: \_SB_.GSIB: Enabled at IRQ 171571client # [ 0.619039] ACPI: \_SB_.GSIC: Enabled at IRQ 181572client # [ 0.621381] ACPI: \_SB_.GSID: Enabled at IRQ 191573client # [ 0.623113] PCI: CLS 0 bytes, default 641574client # [ 0.624053] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575client # [ 0.625891] Trying to unpack rootfs image as initramfs...1576lb # [ 0.654396] Initialise system trusted keyrings1577lb # [ 0.657849] workingset: timestamp_bits=40 max_order=19 bucket_order=01578worker2 # [ 0.666274] Initialise system trusted keyrings1579worker1 # [ 0.661649] Initialise system trusted keyrings1580worker2 # [ 0.669296] workingset: timestamp_bits=40 max_order=19 bucket_order=01581worker1 # [ 0.665082] workingset: timestamp_bits=40 max_order=19 bucket_order=01582lb # [ 0.679532] Key type asymmetric registered1583lb # [ 0.680317] Asymmetric key parser 'x509' registered1584lb # [ 0.682860] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1585lb # [ 0.685846] io scheduler mq-deadline registered1586lb # [ 0.686689] io scheduler kyber registered1587client # [ 0.675763] Initialise system trusted keyrings1588client # [ 0.676869] workingset: timestamp_bits=40 max_order=19 bucket_order=01589lb # [ 0.690985] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1590lb # [ 0.692348] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1591worker1 # [ 0.684970] Key type asymmetric registered1592worker2 # [ 0.694455] Key type asymmetric registered1593worker2 # [ 0.695193] Asymmetric key parser 'x509' registered1594worker1 # [ 0.689064] Asymmetric key parser 'x509' registered1595worker2 # [ 0.696129] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1596lb # [ 0.697696] Linux agpgart interface v0.1031597worker1 # [ 0.689922] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1598lb # [ 0.698562] ACPI: bus type drm_connector registered1599worker2 # [ 0.699427] io scheduler mq-deadline registered1600worker2 # [ 0.700256] io scheduler kyber registered1601worker1 # [ 0.693203] io scheduler mq-deadline registered1602lb # [ 0.701343] usbcore: registered new interface driver usbserial_generic1603worker1 # [ 0.693977] io scheduler kyber registered1604lb # [ 0.702458] usbserial: USB Serial support registered for generic1605worker1 # [ 0.696627] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1606worker2 # [ 0.704471] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1607lb # [ 0.705803] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1608worker1 # [ 0.697930] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1609worker2 # [ 0.705933] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1610lb # [ 0.705803] Please enable it if your BIOS has the CPPC option.1611lb # [ 0.708061] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1612worker1 # [ 0.703926] Linux agpgart interface v0.1031613worker2 # [ 0.711599] Linux agpgart interface v0.1031614lb # [ 0.712006] drop_monitor: Initializing network drop monitor service1615worker1 # [ 0.704719] ACPI: bus type drm_connector registered1616worker2 # [ 0.712431] ACPI: bus type drm_connector registered1617lb # [ 0.713246] NET: Registered PF_INET6 protocol family1618client # [ 0.701306] Key type asymmetric registered1619client # [ 0.701997] Asymmetric key parser 'x509' registered1620client # [ 0.702874] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1621worker1 # [ 0.707524] usbcore: registered new interface driver usbserial_generic1622worker2 # [ 0.715800] usbcore: registered new interface driver usbserial_generic1623worker1 # [ 0.708631] usbserial: USB Serial support registered for generic1624worker2 # [ 0.716836] usbserial: USB Serial support registered for generic1625lb # [ 0.718348] Segment Routing with IPv61626lb # [ 0.719080] In-situ OAM (IOAM) with IPv61627worker1 # [ 0.711054] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1628client # [ 0.708471] io scheduler mq-deadline registered1629worker1 # [ 0.711054] Please enable it if your BIOS has the CPPC option.1630client # [ 0.709281] io scheduler kyber registered1631worker2 # [ 0.720264] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1632worker1 # [ 0.713242] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1633lb # [ 0.722103] IPI shorthand broadcast: enabled1634worker2 # [ 0.720264] Please enable it if your BIOS has the CPPC option.1635worker2 # [ 0.722576] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1636client # [ 0.711955] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1637worker1 # [ 0.717231] drop_monitor: Initializing network drop monitor service1638worker1 # [ 0.718401] NET: Registered PF_INET6 protocol family1639worker2 # [ 0.726427] drop_monitor: Initializing network drop monitor service1640client # [ 0.715425] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1641worker2 # [ 0.727637] NET: Registered PF_INET6 protocol family1642lb # [ 0.730457] sched_clock: Marking stable (597017979, 132767557)->(808251788, -78466252)1643worker1 # [ 0.723377] Segment Routing with IPv61644worker1 # [ 0.724045] In-situ OAM (IOAM) with IPv61645worker2 # [ 0.731795] Segment Routing with IPv61646client # [ 0.720800] Linux agpgart interface v0.1031647client # [ 0.721642] ACPI: bus type drm_connector registered1648lb # [ 0.734164] registered taskstats version 11649worker2 # [ 0.734263] In-situ OAM (IOAM) with IPv61650lb # [ 0.735183] Loading compiled-in X.509 certificates1651worker1 # [ 0.727357] IPI shorthand broadcast: enabled1652worker2 # [ 0.735711] IPI shorthand broadcast: enabled1653client # [ 0.724842] usbcore: registered new interface driver usbserial_generic1654client # [ 0.725917] usbserial: USB Serial support registered for generic1655client # [ 0.728250] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1656client # [ 0.728250] Please enable it if your BIOS has the CPPC option.1657client # [ 0.730646] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1658worker1 # [ 0.735801] sched_clock: Marking stable (600013993, 135010255)->(816795506, -81771258)1659worker2 # [ 0.745205] sched_clock: Marking stable (609018399, 135221154)->(826510367, -82270814)1660client # [ 0.734624] drop_monitor: Initializing network drop monitor service1661worker1 # [ 0.739261] registered taskstats version 11662client # [ 0.735871] NET: Registered PF_INET6 protocol family1663worker1 # [ 0.740212] Loading compiled-in X.509 certificates1664worker2 # [ 0.748437] registered taskstats version 11665worker2 # [ 0.749458] Loading compiled-in X.509 certificates1666client # [ 0.739864] Segment Routing with IPv61667lb # [ 0.753841] Demotion targets for Node 0: null1668client # [ 0.742348] In-situ OAM (IOAM) with IPv61669lb # [ 0.756840] Key type .fscrypt registered1670lb # [ 0.757584] Key type fscrypt-provisioning registered1671client # [ 0.745594] IPI shorthand broadcast: enabled1672lb # [ 0.758616] ima: No TPM chip found, activating TPM-bypass!1673lb # [ 0.760804] ima: Allocated hash algorithm: sha11674lb # [ 0.761633] ima: No architecture policies found1675lb # [ 0.763806] PM: Magic number: 10:880:681676client # [ 0.752286] sched_clock: Marking stable (618015110, 134182989)->(834696927, -82498828)1677worker1 # [ 0.756919] Demotion targets for Node 0: null1678lb # [ 0.765642] RAS: Correctable Errors collector initialized.1679worker1 # [ 0.760093] Key type .fscrypt registered1680worker1 # [ 0.760742] Key type fscrypt-provisioning registered1681worker2 # [ 0.768350] Demotion targets for Node 0: null1682worker2 # [ 0.769274] Key type .fscrypt registered1683worker1 # [ 0.761668] ima: No TPM chip found, activating TPM-bypass!1684client # [ 0.758523] registered taskstats version 11685worker2 # [ 0.769937] Key type fscrypt-provisioning registered1686client # [ 0.759515] Loading compiled-in X.509 certificates1687worker2 # [ 0.770885] ima: No TPM chip found, activating TPM-bypass!1688worker1 # [ 0.764038] ima: Allocated hash algorithm: sha11689worker1 # [ 0.764841] ima: No architecture policies found1690worker2 # [ 0.774259] ima: Allocated hash algorithm: sha11691worker2 # [ 0.775080] ima: No architecture policies found1692lb # [ 0.776655] clk: Disabling unused clocks1693worker1 # [ 0.769043] PM: Magic number: 10:880:681694lb # [ 0.778807] PM: genpd: Disabling unused power domains1695worker1 # [ 0.770663] RAS: Correctable Errors collector initialized.1696worker2 # [ 0.779261] PM: Magic number: 10:880:681697worker2 # [ 0.781037] RAS: Correctable Errors collector initialized.1698worker1 # [ 0.778757] clk: Disabling unused clocks1699client # [ 0.778533] Demotion targets for Node 0: null1700worker2 # [ 0.790139] clk: Disabling unused clocks1701worker1 # [ 0.783041] PM: genpd: Disabling unused power domains1702client # [ 0.779617] Key type .fscrypt registered1703worker2 # [ 0.792252] PM: genpd: Disabling unused power domains1704client # [ 0.782217] Key type fscrypt-provisioning registered1705client # [ 0.783239] ima: No TPM chip found, activating TPM-bypass!1706client # [ 0.786226] ima: Allocated hash algorithm: sha11707client # [ 0.787039] ima: No architecture policies found1708client # [ 0.789230] PM: Magic number: 10:880:681709client # [ 0.793262] RAS: Correctable Errors collector initialized.1710client # [ 0.802153] clk: Disabling unused clocks1711client # [ 0.804253] PM: genpd: Disabling unused power domains1712lb # [ 0.959195] Freeing initrd memory: 29092K1713worker1 # [ 0.954127] Freeing initrd memory: 29092K1714lb # [ 0.962557] Freeing unused decrypted memory: 2028K1715worker1 # [ 0.957318] Freeing unused decrypted memory: 2028K1716lb # [ 0.965319] Freeing unused kernel image (initmem) memory: 3644K1717lb # [ 0.966463] Write protecting the kernel read-only data: 32768k1718worker1 # [ 0.959969] Freeing unused kernel image (initmem) memory: 3644K1719lb # [ 0.968448] Freeing unused kernel image (text/rodata gap) memory: 1208K1720worker1 # [ 0.961057] Write protecting the kernel read-only data: 32768k1721lb # [ 0.970033] Freeing unused kernel image (rodata/data gap) memory: 752K1722worker1 # [ 0.962933] Freeing unused kernel image (text/rodata gap) memory: 1208K1723worker1 # [ 0.964538] Freeing unused kernel image (rodata/data gap) memory: 752K1724worker2 # [ 0.979733] Freeing initrd memory: 29092K1725worker2 # [ 0.983055] Freeing unused decrypted memory: 2028K1726worker2 # [ 0.985871] Freeing unused kernel image (initmem) memory: 3644K1727worker2 # [ 0.986993] Write protecting the kernel read-only data: 32768k1728worker2 # [ 0.988935] Freeing unused kernel image (text/rodata gap) memory: 1208K1729worker2 # [ 0.990572] Freeing unused kernel image (rodata/data gap) memory: 752K1730client # [ 1.007026] Freeing initrd memory: 29096K1731lb # [ 1.021528] x86/mm: Checked W+X mappings: passed, no W+X pages found.1732lb # [ 1.022719] Run /init as init process1733client # [ 1.010647] Freeing unused decrypted memory: 2028K1734worker1 # [ 1.015701] x86/mm: Checked W+X mappings: passed, no W+X pages found.1735worker1 # [ 1.016825] Run /init as init process1736client # [ 1.013724] Freeing unused kernel image (initmem) memory: 3644K1737client # [ 1.014871] Write protecting the kernel read-only data: 32768k1738client # [ 1.016966] Freeing unused kernel image (text/rodata gap) memory: 1208K1739client # [ 1.018610] Freeing unused kernel image (rodata/data gap) memory: 752K1740lb # [ 1.033443] systemd[1]: Inserted module 'autofs4'1741worker1 # [ 1.027182] systemd[1]: Inserted module 'autofs4'1742worker2 # [ 1.041663] x86/mm: Checked W+X mappings: passed, no W+X pages found.1743worker2 # [ 1.042798] Run /init as init process1744lb # [ 1.050171] fuse: init (API version 7.45)1745worker1 # [ 1.043317] fuse: init (API version 7.45)1746worker2 # [ 1.053537] systemd[1]: Inserted module 'autofs4'1747lb # [ 1.055968] ACPI: \_SB_.GSIG: Enabled at IRQ 221748worker1 # [ 1.049091] ACPI: \_SB_.GSIG: Enabled at IRQ 221749lb # [ 1.058710] ACPI: \_SB_.GSIH: Enabled at IRQ 231750worker1 # [ 1.051692] ACPI: \_SB_.GSIH: Enabled at IRQ 231751lb # [ 1.062880] ACPI: \_SB_.GSIE: Enabled at IRQ 201752worker1 # [ 1.054915] ACPI: \_SB_.GSIE: Enabled at IRQ 201753lb # [ 1.065468] ACPI: \_SB_.GSIF: Enabled at IRQ 211754worker1 # [ 1.057396] ACPI: \_SB_.GSIF: Enabled at IRQ 211755worker2 # [ 1.070295] fuse: init (API version 7.45)1756worker2 # [ 1.076263] ACPI: \_SB_.GSIG: Enabled at IRQ 221757worker2 # [ 1.078846] ACPI: \_SB_.GSIH: Enabled at IRQ 231758client # [ 1.069809] x86/mm: Checked W+X mappings: passed, no W+X pages found.1759worker2 # [ 1.081892] ACPI: \_SB_.GSIE: Enabled at IRQ 201760client # [ 1.070921] Run /init as init process1761worker2 # [ 1.084142] ACPI: \_SB_.GSIF: Enabled at IRQ 211762client # [ 1.082139] systemd[1]: Inserted module 'autofs4'1763lb # [ 1.097081] systemd[1]: Successfully made /usr/ read-only.1764worker1 # [ 1.089817] systemd[1]: Successfully made /usr/ read-only.1765client # [ 1.099051] fuse: init (API version 7.45)1766client # [ 1.105071] ACPI: \_SB_.GSIG: Enabled at IRQ 221767worker2 # [ 1.117505] systemd[1]: Successfully made /usr/ read-only.1768client # [ 1.107645] ACPI: \_SB_.GSIH: Enabled at IRQ 231769client # [ 1.111682] ACPI: \_SB_.GSIE: Enabled at IRQ 201770client # [ 1.114899] ACPI: \_SB_.GSIF: Enabled at IRQ 211771client # [ 1.151607] systemd[1]: Successfully made /usr/ read-only.1772worker1 # [ 1.425355] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1773worker1 # [ 1.430498] systemd[1]: Detected virtualization kvm.1774worker1 # [ 1.431410] systemd[1]: Detected architecture x86-64.1775worker1 # [ 1.432316] systemd[1]: Running in initrd.1776worker1 # [ 1.433389] systemd[1]: Initializing machine ID from random generator.1777worker1 # [ 1.434608] systemd[1]: Hostname set to <worker1>.1778lb # [ 1.433942] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1779lb # [ 1.446041] systemd[1]: Detected virtualization kvm.1780lb # [ 1.448129] systemd[1]: Detected architecture x86-64.1781lb # [ 1.450223] systemd[1]: Running in initrd.1782lb # [ 1.452921] systemd[1]: Initializing machine ID from random generator.1783lb # [ 1.455855] systemd[1]: Hostname set to <lb>.1784worker2 # [ 1.454211] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1785worker2 # [ 1.466379] systemd[1]: Detected virtualization kvm.1786worker2 # [ 1.468532] systemd[1]: Detected architecture x86-64.1787worker2 # [ 1.470634] systemd[1]: Running in initrd.1788worker2 # [ 1.473284] systemd[1]: Initializing machine ID from random generator.1789worker2 # [ 1.476147] systemd[1]: Hostname set to <worker2>.1790client # [ 1.487938] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1791client # [ 1.499915] systemd[1]: Detected virtualization kvm.1792client # [ 1.502027] systemd[1]: Detected architecture x86-64.1793client # [ 1.504159] systemd[1]: Running in initrd.1794client # [ 1.506714] systemd[1]: Initializing machine ID from random generator.1795client # [ 1.509647] systemd[1]: Hostname set to <client>.1796worker1 # [ 1.639312] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797lb # [ 1.670943] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798worker1 # [ 1.693263] systemd[1]: Queued start job for default target Initrd Default Target.1799worker1 # [ 1.697370] systemd[1]: Created slice Slice /system/modprobe.1800worker1 # [ 1.698513] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801worker1 # [ 1.699882] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802worker1 # [ 1.700915] systemd[1]: Reached target Path Units.1803worker2 # [ 1.707271] systemd[1]: bpf-restrict-fs: LSM BPF program attached1804worker1 # [ 1.701742] systemd[1]: Reached target Slice Units.1805worker1 # [ 1.702613] systemd[1]: Reached target Swaps.1806worker1 # [ 1.703428] systemd[1]: Reached target Timer Units.1807worker1 # [ 1.704424] systemd[1]: Listening on D-Bus System Message Bus Socket.1808worker1 # [ 1.705605] systemd[1]: Listening on Journal Socket (/dev/log).1809worker1 # [ 1.706744] systemd[1]: Listening on Journal Sockets.1810lb # [ 1.714596] systemd[1]: Queued start job for default target Initrd Default Target.1811worker1 # [ 1.707729] systemd[1]: Listening on udev Control Socket.1812worker1 # [ 1.708729] systemd[1]: Listening on udev Kernel Socket.1813worker1 # [ 1.709677] systemd[1]: Reached target Socket Units.1814lb # [ 1.719207] systemd[1]: Created slice Slice /system/modprobe.1815worker1 # [ 1.711508] systemd[1]: Starting Create List of Static Device Nodes...1816lb # [ 1.720402] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1817lb # [ 1.721781] systemd[1]: Expecting device /dev/disk/by-label/nixos...1818lb # [ 1.722847] systemd[1]: Reached target Path Units.1819worker1 # [ 1.715123] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1820lb # [ 1.723683] systemd[1]: Reached target Slice Units.1821lb # [ 1.724548] systemd[1]: Reached target Swaps.1822lb # [ 1.725314] systemd[1]: Reached target Timer Units.1823lb # [ 1.726268] systemd[1]: Listening on D-Bus System Message Bus Socket.1824lb # [ 1.727457] systemd[1]: Listening on Journal Socket (/dev/log).1825lb # [ 1.728890] systemd[1]: Listening on Journal Sockets.1826lb # [ 1.730116] systemd[1]: Listening on udev Control Socket.1827lb # [ 1.731197] systemd[1]: Listening on udev Kernel Socket.1828lb # [ 1.732152] systemd[1]: Reached target Socket Units.1829worker1 # [ 1.724131] systemd[1]: Starting Load Kernel Module configfs...1830client # [ 1.721113] systemd[1]: bpf-restrict-fs: LSM BPF program attached1831lb # [ 1.734140] systemd[1]: Starting Create List of Static Device Nodes...1832lb # [ 1.738852] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1833worker1 # [ 1.733653] systemd[1]: Starting Journal Service...1834lb # [ 1.743665] systemd[1]: Starting Load Kernel Module configfs...1835worker1 # [ 1.744220] systemd[1]: Starting Load Kernel Modules...1836lb # [ 1.757219] systemd[1]: Starting Journal Service...1837worker2 # [ 1.760202] systemd[1]: Queued start job for default target Initrd Default Target.1838worker2 # [ 1.764635] systemd[1]: Created slice Slice /system/modprobe.1839worker2 # [ 1.765815] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1840worker2 # [ 1.767164] systemd[1]: Expecting device /dev/disk/by-label/nixos...1841worker2 # [ 1.768247] systemd[1]: Reached target Path Units.1842worker2 # [ 1.769070] systemd[1]: Reached target Slice Units.1843worker2 # [ 1.769916] systemd[1]: Reached target Swaps.1844worker1 # [ 1.750103] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1845worker2 # [ 1.770682] systemd[1]: Reached target Timer Units.1846lb # [ 1.771872] systemd[1]: Starting Load Kernel Modules...1847worker2 # [ 1.771654] systemd[1]: Listening on D-Bus System Message Bus Socket.1848worker2 # [ 1.772825] systemd[1]: Listening on Journal Socket (/dev/log).1849worker2 # [ 1.773933] systemd[1]: Listening on Journal Sockets.1850worker2 # [ 1.774911] systemd[1]: Listening on udev Control Socket.1851client # [ 1.763394] systemd[1]: Queued start job for default target Initrd Default Target.1852worker2 # [ 1.775888] systemd[1]: Listening on udev Kernel Socket.1853worker2 # [ 1.776809] systemd[1]: Reached target Socket Units.1854worker2 # [ 1.778854] systemd[1]: Starting Create List of Static Device Nodes...1855worker1 # [ 1.773642] netfs: FS-Cache loaded1856client # [ 1.771752] systemd[1]: Created slice Slice /system/modprobe.1857worker2 # [ 1.783305] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1858client # [ 1.773264] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1859client # [ 1.774817] systemd[1]: Expecting device /dev/disk/by-label/nixos...1860worker1 # [ 1.779444] 9pnet: Installing 9P2000 support1861client # [ 1.776045] systemd[1]: Reached target Path Units.1862client # [ 1.776991] systemd[1]: Reached target Slice Units.1863client # [ 1.777947] systemd[1]: Reached target Swaps.1864lb # [ 1.777885] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1865client # [ 1.778818] systemd[1]: Reached target Timer Units.1866worker2 # [ 1.791304] systemd[1]: Starting Load Kernel Module configfs...1867client # [ 1.779986] systemd[1]: Listening on D-Bus System Message Bus Socket.1868client # [ 1.781383] systemd[1]: Listening on Journal Socket (/dev/log).1869client # [ 1.782724] systemd[1]: Listening on Journal Sockets.1870client # [ 1.783942] systemd[1]: Listening on udev Control Socket.1871client # [ 1.785084] systemd[1]: Listening on udev Kernel Socket.1872client # [ 1.786146] systemd[1]: Reached target Socket Units.1873worker1 # [ 1.789922] systemd[1]: Starting Coldplug All udev Devices...1874lb # [ 1.799215] netfs: FS-Cache loaded1875client # [ 1.788825] systemd[1]: Starting Create List of Static Device Nodes...1876lb # [ 1.804070] 9pnet: Installing 9P2000 support1877client # [ 1.794312] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1878worker2 # [ 1.806932] systemd[1]: Starting Journal Service...1879lb # [ 1.812685] systemd[1]: Starting Coldplug All udev Devices...1880client # [ 1.801338] systemd[1]: Starting Load Kernel Module configfs...1881worker2 # [ 1.819320] systemd[1]: Starting Load Kernel Modules...1882worker1 # [ 1.815201] systemd[1]: Finished Create List of Static Device Nodes.1883client # [ 1.817773] systemd[1]: Starting Journal Service...1884worker1 # [ 1.822854] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1885lb # [ 1.832932] systemd[1]: Finished Create List of Static Device Nodes.1886worker2 # [ 1.826321] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1887worker1 # [ 1.830852] systemd-journald[67]: Collecting audit messages is disabled.1888lb # [ 1.839538] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1889worker1 # [ 1.833088] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1890worker2 # [ 1.842652] netfs: FS-Cache loaded1891client # [ 1.832291] systemd[1]: Starting Load Kernel Modules...1892worker1 # [ 1.838577] systemd[1]: modprobe@configfs.service: Deactivated successfully.1893worker2 # [ 1.847729] 9pnet: Installing 9P2000 support1894lb # [ 1.848339] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1895lb # [ 1.853080] systemd-journald[67]: Collecting audit messages is disabled.1896worker1 # [ 1.846503] systemd[1]: Finished Load Kernel Module configfs.1897lb # [ 1.854683] systemd[1]: modprobe@configfs.service: Deactivated successfully.1898worker2 # [ 1.858034] systemd[1]: Starting Coldplug All udev Devices...1899worker1 # [ 1.850662] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1900lb # [ 1.862251] systemd[1]: Finished Load Kernel Module configfs.1901worker1 # [ 1.853861] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1902client # [ 1.839312] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1903lb # [ 1.866347] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1904client # [ 1.857978] netfs: FS-Cache loaded1905worker1 # [ 1.863279] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1906lb # [ 1.871535] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1907worker2 # [ 1.873366] systemd[1]: Finished Create List of Static Device Nodes.1908worker1 # [ 1.866266] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1909client # [ 1.862980] 9pnet: Installing 9P2000 support1910lb # [ 1.879022] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1911worker2 # [ 1.879913] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1912lb # [ 1.880472] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1913client # [ 1.872862] systemd[1]: Starting Coldplug All udev Devices...1914worker2 # [ 1.888686] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1915worker2 # [ 1.893034] systemd-journald[67]: Collecting audit messages is disabled.1916worker2 # [ 1.895685] systemd[1]: modprobe@configfs.service: Deactivated successfully.1917client # [ 1.890765] systemd[1]: Finished Create List of Static Device Nodes.1918worker2 # [ 1.902614] systemd[1]: Finished Load Kernel Module configfs.1919worker2 # [ 1.905723] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1920worker1 # [ 1.900698] systemd[1]: Finished Load Kernel Modules.1921lb # [ 1.911090] systemd[1]: Finished Load Kernel Modules.1922client # [ 1.899289] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1923worker2 # [ 1.910067] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1924client # [ 1.905286] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1925worker1 # [ 1.909588] systemd[1]: Starting Apply Kernel Variables...1926worker2 # [ 1.918432] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1927lb # [ 1.920002] systemd[1]: Starting Apply Kernel Variables...1928worker2 # [ 1.920313] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1929client # [ 1.912725] systemd[1]: modprobe@configfs.service: Deactivated successfully.1930client # [ 1.914844] systemd-journald[67]: Collecting audit messages is disabled.1931client # [ 1.919599] systemd[1]: Finished Load Kernel Module configfs.1932lb # [ 1.932896] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1933client # [ 1.924707] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1934worker1 # [ 1.929887] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1935client # [ 1.927417] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1936lb # [ 1.943017] systemd[1]: Starting Create Static Device Nodes in /dev...1937client # [ 1.936238] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1938worker2 # [ 1.948872] systemd[1]: Finished Load Kernel Modules.1939worker1 # [ 1.941483] systemd[1]: Starting Create Static Device Nodes in /dev...1940client # [ 1.937921] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1941worker2 # [ 1.958460] systemd[1]: Starting Apply Kernel Variables...1942lb # [ 1.961104] systemd[1]: Finished Apply Kernel Variables.1943worker1 # [ 1.955185] systemd[1]: Finished Apply Kernel Variables.1944worker1 # [ 1.828329] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.964504] systemd[1]: Started Journal Service.1945lb # [ 1.972705] systemd[1]: Started Journal Service.1946worker1 # 1947worker1 # [ 1.832409] systemd-modules-load[68]: Inserted module 'virtio_balloon'1948lb # [ 1.843238] systemd-modules-load[68]: Inserted module 'dm_mod'1949worker2 # [ 1.975563] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1950lb # [ 1.844643] systemd-modules-load[68]: Inserted module 'virtio_balloon'1951worker1 # [ 1.834368] systemd-modules-load[68]: Inserted module 'virtio_gpu'1952client # [ 1.966732] systemd[1]: Finished Load Kernel Modules.1953lb # [ 1.848470] systemd-modules-load[68]: Inserted module 'virtio_gpu'1954client # [ 1.973420] systemd[1]: Starting Apply Kernel Variables...1955lb # [ 1.854173] systemd[1]: Finished Create Static Device Nodes in /dev.1956worker2 # [ 1.986477] systemd[1]: Starting Create Static Device Nodes in /dev...1957lb # [ 1.858456] systemd[1]: Reached target Preparation for Local File Systems.1958lb # [ 1.860165] systemd[1]: Reached target Local File Systems.1959lb # [ 1.863074] systemd[1]: Starting Create System Files and Directories...1960worker1 # [ 1.856239] systemd[1]: Finished Create Static Device Nodes in /dev.1961worker2 # [ 1.999343] systemd[1]: Finished Apply Kernel Variables.1962lb # [ 1.867640] systemd[1]: Starting Rule-based Manager for Device Events and Files...1963client # [ 1.989318] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1964worker1 # [ 1.859079] systemd[1]: Reached target Preparation for Local File Systems.1965worker1 # [ 1.860049] systemd[1]: Reached target Local File Systems.1966worker1 # [ 1.863180] systemd[1]: Starting Create System Files and Directories...1967worker1 # [ 1.867810] systemd[1]: Starting Rule-based Manager for Device Events and Files...1968client # [ 1.999608] systemd[1]: Starting Create Static Device Nodes in /dev...1969worker2 # [ 2.014295] systemd[1]: Started Journal Service.1970worker2 # [ 1.882243] systemd-modules-load[68]: Inserted module 'dm_mod'1971worker2 # [ 1.883752] systemd-modules-load[68]: Inserted module 'virtio_balloon'1972worker2 # [ 1.887475] systemd-modules-load[68]: Inserted module 'virtio_gpu'1973lb # [ 1.896080] systemd[1]: Finished Create System Files and Directories.1974worker2 # [ 1.894880] systemd[1]: Finished Create Static Device Nodes in /dev.1975client # [ 2.019393] systemd[1]: Finished Apply Kernel Variables.1976worker2 # [ 1.897959] systemd[1]: Reached target Preparation for Local File Systems.1977worker2 # [ 1.901071] systemd[1]: Reached target Local File Systems.1978worker2 # [ 1.904094] systemd[1]: Starting Create System Files and Directories...1979client # [ 2.034305] systemd[1]: Started Journal Service.1980worker2 # [ 1.911072] systemd[1]: Starting Rule-based Manager for Device Events and Files...1981client # [ 1.902238] systemd-modules-load[68]: Inserted module 'dm_mod'1982worker1 # [ 1.907496] systemd[1]: Finished Create System Files and Directories.1983client # [ 1.904447] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984lb # [ 1.919846] systemd-udevd[83]: Using default interface naming scheme 'v261'.1985client # [ 1.907211] systemd-modules-load[68]: Inserted module 'virtio_gpu'1986client # [ 1.912155] systemd[1]: Finished Create Static Device Nodes in /dev.1987client # [ 1.918100] systemd[1]: Reached target Preparation for Local File Systems.1988client # [ 1.920092] systemd[1]: Reached target Local File Systems.1989client # [ 1.923075] systemd[1]: Starting Create System Files and Directories...1990worker1 # [ 1.927456] systemd-udevd[83]: Using default interface naming scheme 'v261'.1991client # [ 1.928148] systemd[1]: Starting Rule-based Manager for Device Events and Files...1992worker2 # [ 1.941576] systemd[1]: Finished Create System Files and Directories.1993lb # [ 1.944812] systemd[1]: Started Rule-based Manager for Device Events and Files.1994worker1 # [ 1.951923] systemd[1]: Started Rule-based Manager for Device Events and Files.1995client # [ 1.955280] systemd[1]: Finished Create System Files and Directories.1996worker2 # [ 1.970374] systemd-udevd[83]: Using default interface naming scheme 'v261'.1997lb # [ 1.991085] systemd[1]: Finished Coldplug All udev Devices.1998lb # [ 1.993417] systemd[1]: Reached target System Initialization.1999client # [ 1.980279] systemd-udevd[83]: Using default interface naming scheme 'v261'.2000lb # [ 1.994297] systemd[1]: Reached target Basic System.
loading 1,682 hidden lines…
3683lb # [ 10.178067] dhcpcd[703]: eth0: adding address fe80::5054:ff:fe12:34563684worker1 # [ 10.303110] EDAC MC: Ver: 3.0.03685worker2 # [ 10.322264] EDAC MC: Ver: 3.0.03686lb # [ 10.244663] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3687lb # [ 10.249891] systemd[1]: Stopped Virtual Console Setup.3688lb # [ 10.268365] systemd[1]: Starting Virtual Console Setup...3689lb # [ 10.341352] postgresql-pre-start[726]: selecting default "max_connections" ... 1003690worker1 # [ 10.402608] systemd-vconsole-setup[521]: Configuration of first virtual console was skipped, ignoring remaining ones.3691worker1 # [ 10.406101] systemd[1]: Finished Virtual Console Setup.3692worker1 # [ 10.407505] systemd[1]: Reached target System Initialization.3693worker1 # [ 10.408590] systemd[1]: Started Discard unused filesystem blocks once a week.3694worker1 # [ 10.409973] systemd[1]: Started Daily Cleanup of Temporary Directories.3695worker1 # [ 10.412226] systemd[1]: Reached target Timer Units.3696worker1 # [ 10.412903] systemd[1]: Listening on D-Bus System Message Bus Socket.3697worker1 # [ 10.413843] systemd[1]: Listening on Nix Daemon Socket.3698worker2 # [ 10.421544] systemd-vconsole-setup[521]: Configuration of first virtual console was skipped, ignoring remaining ones.3699worker1 # [ 10.416568] systemd[1]: Listening on Nix worker-protocol over gRPC.3700worker2 # [ 10.425271] systemd[1]: Finished Virtual Console Setup.3701worker1 # [ 10.417682] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3702worker1 # [ 10.418843] systemd[1]: Reached target Socket Units.3703worker2 # [ 10.426460] systemd[1]: Reached target System Initialization.3704worker1 # [ 10.420127] systemd[1]: Reached target Basic System.3705worker2 # [ 10.428077] systemd[1]: Started Discard unused filesystem blocks once a week.3706worker2 # [ 10.429144] systemd[1]: Started Daily Cleanup of Temporary Directories.3707worker1 # [ 10.423464] systemd[1]: Started backdoor.service.3708worker2 # [ 10.431343] systemd[1]: Reached target Timer Units.3709worker2 # [ 10.432105] systemd[1]: Listening on D-Bus System Message Bus Socket.3710worker2 # [ 10.433203] systemd[1]: Listening on Nix Daemon Socket.3711worker1 # [ 10.425841] systemd[1]: Starting Import lastlog data into lastlog2 database...3712worker2 # [ 10.436070] systemd[1]: Listening on Nix worker-protocol over gRPC.3713worker2 # [ 10.437053] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3714worker1 # [ 10.430080] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3715worker2 # [ 10.438921] systemd[1]: Reached target Socket Units.3716worker2 # [ 10.439768] systemd[1]: Reached target Basic System.3717worker2 # [ 10.442111] systemd[1]: Started backdoor.service.3718worker1 # [ 10.435060] systemd[1]: Starting Post-Boot Actions...3719worker2 # [ 10.445890] systemd[1]: Starting Import lastlog data into lastlog2 database...3720worker1 # [ 10.441860] systemd[1]: Started Reset console on configuration changes.3721worker2 # [ 10.449347] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3722worker2 # [ 10.452824] systemd[1]: Starting Post-Boot Actions...3723worker1 # [ 10.447902] systemd[1]: Starting resolvconf update...3724client # [ 10.446855] dhcpcd[567]: eth0: soliciting a DHCP lease3725worker2 # [ 10.459159] systemd[1]: Started Reset console on configuration changes.3726worker2 # [ 10.462506] systemd[1]: Starting resolvconf update...3727worker1 # [ 10.455755] systemd[1]: Starting D-Bus System Message Bus...3728worker2 # [ 10.474584] systemd[1]: Starting D-Bus System Message Bus...3729client # [ 10.600889] NET: Registered PF_PACKET protocol family3730client: (finished: waiting for unit network-addresses-eth1.service, in 11.18 seconds)3731client # [ 10.472565] dhcpcd[567]: eth0: offered 10.0.2.15 from 10.0.2.23732client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3733client # [ 10.475273] dhcpcd[567]: eth0: probing address 10.0.2.15/243734lb # [ 10.508497] postgresql-pre-start[726]: selecting default "shared_buffers" ... 128MB3735client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3736lb: waiting for unit network-addresses-eth1.service3737lb: waiting for the VM to finish booting3738lb: Guest shell says: b'Spawning backdoor root shell...\n'3739lb: connected to guest root shell3740lb: (connecting took 0.00 seconds)3741lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3742worker1 # [ 10.520312] systemd[1]: Finished Post-Boot Actions.3743worker2 # [ 10.542457] systemd[1]: Finished Post-Boot Actions.3744worker1 # connecting to host...3745worker1 # [ 10.558684] systemd[1]: Started Name Service Cache Daemon (nsncd).3746worker1 # [ 10.560154] systemd[1]: Reached target Host and Network Name Lookups.3747worker1 # [ 10.560936] systemd[1]: Reached target User and Group Name Lookups.3748worker1 # [ 10.568781] nsncd[529]: Sep 20 08:04:46.585 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3749worker2 # connecting to host...3750worker1 # [ 10.572481] systemd[1]: Starting User Login Management...3751worker1 # [ 10.573708] systemd[1]: Finished Import lastlog data into lastlog2 database.3752worker2 # [ 10.581257] systemd[1]: Started Name Service Cache Daemon (nsncd).3753worker2 # [ 10.583192] systemd[1]: Reached target Host and Network Name Lookups.3754worker2 # [ 10.584030] systemd[1]: Reached target User and Group Name Lookups.3755lb # [ 10.723345] kvm_amd: TSC scaling supported3756worker2 # [ 10.590524] systemd[1]: Starting User Login Management...3757lb # [ 10.729245] kvm_amd: Nested Virtualization enabled3758worker2 # [ 10.593202] nsncd[529]: Sep 20 08:04:46.575 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3759lb # [ 10.732495] kvm_amd: Nested Paging enabled3760lb # [ 10.735304] kvm_amd: LBR virtualization supported3761lb # [ 10.737119] kvm_amd: Virtual VMLOAD VMSAVE supported3762lb # [ 10.737662] kvm_amd: Virtual GIF supported3763worker2 # [ 10.603688] systemd[1]: Finished Import lastlog data into lastlog2 database.3764lb # [ 10.740950] kvm_amd: Virtual NMI enabled3765worker1 # [ 10.619959] dbus-broker-launch[533]: Looking up NSS user entry for 'systemd-timesync'...3766worker2 # [ 10.640655] dbus-broker-launch[533]: Looking up NSS user entry for 'systemd-timesync'...3767worker1 # [ 10.634653] dbus-broker-launch[533]: NSS returned no entry for 'systemd-timesync'3768worker1 # [ 10.635693] dbus-broker-launch[533]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3769worker2 # [ 10.653340] dbus-broker-launch[533]: NSS returned no entry for 'systemd-timesync'3770lb: (finished: waiting for unit network-addresses-eth1.service, in 0.13 seconds)3771worker2 # [ 10.655147] dbus-broker-launch[533]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3772lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3773worker1 # [ 10.657600] systemd[1]: Stopped target Host and Network Name Lookups.3774worker1 # [ 10.659081] systemd[1]: Stopping Host and Network Name Lookups...3775worker1 # [ 10.661150] systemd[1]: Stopped target User and Group Name Lookups.3776worker1 # [ 10.663504] systemd[1]: Stopping User and Group Name Lookups...3777worker1 # [ 10.664816] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3778worker1 # [ 10.666451] systemd[1]: nscd.service: Deactivated successfully.3779worker1 # [ 10.668083] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3780worker2 # [ 10.680820] systemd[1]: Stopped target Host and Network Name Lookups.3781worker2 # [ 10.682899] systemd[1]: Stopping Host and Network Name Lookups...3782worker2 # [ 10.685138] systemd[1]: Stopped target User and Group Name Lookups.3783worker2 # [ 10.685942] systemd[1]: Stopping User and Group Name Lookups...3784worker1 # [ 10.678534] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3785worker1 # [ 10.679740] systemd[1]: Started D-Bus System Message Bus.3786worker2 # [ 10.689395] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3787worker2 # [ 10.692980] systemd[1]: Started D-Bus System Message Bus.3788worker2 # [ 10.693868] systemd[1]: nscd.service: Deactivated successfully.3789worker2 # [ 10.695304] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3790worker1 # [ 10.693185] systemd-logind[554]: New seat seat0.3791lb # [ 10.839154] EDAC MC: Ver: 3.0.03792worker2 # [ 10.704118] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3793worker1 # [ 10.701991] systemd-logind[554]: Watching system buttons on /dev/input/event2 (Power Button)3794worker1 # [ 10.703340] systemd-logind[554]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3795worker1 # [ 10.705783] systemd-logind[554]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3796worker1 # [ 10.709108] systemd[1]: Started User Login Management.3797worker1 # [ 10.712625] systemd[1]: Starting linger-users.service...3798worker2 # [ 10.725668] systemd-logind[555]: New seat seat0.3799lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.08 seconds)3800worker2 # [ 10.734583] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button)3801worker1: waiting for unit network-addresses-eth1.service3802worker1: waiting for the VM to finish booting3803worker1: Guest shell says: b'Spawning backdoor root shell...\n'3804worker1: connected to guest root shell3805worker1: (connecting took 0.00 seconds)3806worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3807worker2 # [ 10.735801] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3808worker2 # [ 10.738119] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3809worker2 # [ 10.740786] systemd[1]: Started User Login Management.3810worker1 # [ 10.736797] dbus-broker-launch[533]: Ready3811worker2 # [ 10.747629] systemd[1]: Starting linger-users.service...3812worker2 # [ 10.748610] dbus-broker-launch[533]: Ready3813lb # [ 10.755636] systemd-vconsole-setup[746]: Configuration of first virtual console was skipped, ignoring remaining ones.3814lb # [ 10.761401] systemd[1]: Finished Virtual Console Setup.3815worker1 # [ 10.762389] nsncd[600]: Sep 20 08:04:46.789 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3816worker1 # [ 10.765783] systemd[1]: Started Name Service Cache Daemon (nsncd).3817worker1 # [ 10.767679] systemd[1]: Reached target Host and Network Name Lookups.3818worker1 # [ 10.769105] systemd[1]: Reached target User and Group Name Lookups.3819worker2 # [ 10.783390] systemd[1]: Started Name Service Cache Daemon (nsncd).3820worker2 # [ 10.784264] systemd[1]: Reached target Host and Network Name Lookups.3821worker2 # [ 10.785089] systemd[1]: Reached target User and Group Name Lookups.3822worker2 # [ 10.786690] nsncd[601]: Sep 20 08:04:46.776 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3823worker1 # [ 10.780449] systemd[1]: linger-users.service: Deactivated successfully.3824worker1 # [ 10.781830] systemd[1]: Finished linger-users.service.3825worker1 # [ 10.788963] systemd[1]: Finished resolvconf update.3826worker1 # [ 10.791141] systemd[1]: Reached target Preparation for Network.3827worker2 # [ 10.801597] systemd[1]: Finished resolvconf update.3828worker2 # [ 10.802685] systemd[1]: Reached target Preparation for Network.3829worker1 # [ 10.797178] systemd[1]: Starting DHCP Client...3830worker2 # [ 10.806108] systemd[1]: Starting DHCP Client...3831worker1 # [ 10.799289] systemd[1]: Starting Address configuration of eth1...3832worker2 # [ 10.808890] systemd[1]: Starting Address configuration of eth1...3833worker1 # [ 10.802296] systemd[1]: Starting Extra networking commands....3834worker2 # [ 10.816136] systemd[1]: Starting Extra networking commands....3835worker2 # [ 10.818498] systemd[1]: linger-users.service: Deactivated successfully.3836worker2 # [ 10.819540] systemd[1]: Finished linger-users.service.3837worker2 # [ 10.909887] network-addresses-eth1-start[628]: adding address 192.168.1.4/24... done3838worker1 # [ 10.909476] network-addresses-eth1-start[633]: adding address 192.168.1.3/24... done3839worker2 # [ 10.923290] network-addresses-eth1-start[628]: adding address 2001:db8:1::4/64... done3840worker1 # [ 10.924467] network-addresses-eth1-start[633]: adding address 2001:db8:1::3/64... done3841worker2 # [ 10.943214] systemd[1]: Finished Address configuration of eth1.3842worker1 # [ 10.943181] systemd[1]: Finished Address configuration of eth1.3843worker2 # [ 10.974267] dhcpcd[636]: dhcpcd-10.3.2 starting3844worker2 # [ 10.986432] dhcpcd[692]: dev: loaded udev3845worker2 # [ 10.987280] systemd[1]: Finished Extra networking commands..3846worker2 # [ 10.988476] systemd[1]: Reached target Network.3847worker1 # [ 10.982769] dhcpcd[644]: dhcpcd-10.3.2 starting3848worker2 # [ 10.990540] systemd[1]: Starting Permit User Sessions...3849worker1 # [ 10.986719] systemd[1]: Finished Extra networking commands..3850worker1 # [ 10.988497] systemd[1]: Reached target Network.3851worker1 # [ 10.992083] systemd[1]: Starting Permit User Sessions...3852worker1 # [ 10.996938] dhcpcd[697]: dev: loaded udev3853worker2 # [ 11.149511] 8021q: 802.1Q VLAN Support v1.83854worker2 # [ 11.149977] 8021q: adding VLAN 0 to HW filter on device eth13855worker2 # [ 11.020987] systemd[1]: Finished Permit User Sessions.3856worker2 # [ 11.026207] systemd[1]: Started Getty on tty1.3857worker2 # [ 11.027813] systemd[1]: Reached target Login Prompts.3858worker1 # [ 11.020947] systemd[1]: Finished Permit User Sessions.3859worker1 # [ 11.159900] 8021q: 802.1Q VLAN Support v1.83860worker1 # [ 11.160391] 8021q: adding VLAN 0 to HW filter on device eth13861worker1 # [ 11.029783] systemd[1]: Started Getty on tty1.3862worker1 # [ 11.030775] systemd[1]: Reached target Login Prompts.3863worker2 # [ 11.046233] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3864worker1 # [ 11.056954] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3865worker2 # [ 11.239562] cfg80211: Loading compiled-in X.509 certificates for regulatory database3866worker1 # [ 11.246497] cfg80211: Loading compiled-in X.509 certificates for regulatory database3867worker2 # [ 11.264100] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3868worker2 # [ 11.264831] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3869worker2 # [ 11.267870] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23870worker2 # [ 11.268761] cfg80211: failed to load regulatory.db3871worker1 # [ 11.272857] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3872worker1 # [ 11.273647] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3873worker1 # [ 11.276606] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23874worker1 # [ 11.277516] cfg80211: failed to load regulatory.db3875worker2 # [ 11.315202] 8021q: adding VLAN 0 to HW filter on device eth03876worker2 # [ 11.181161] dhcpcd[692]: eth0: waiting for carrier3877worker2 # [ 11.182071] dhcpcd[692]: eth0: carrier acquired3878worker2 # [ 11.190536] dhcpcd[692]: DUID 00:01:00:01:32:42:50:1f:52:54:00:12:34:563879worker2 # [ 11.191681] dhcpcd[692]: eth0: IAID 00:12:34:563880worker2 # [ 11.192461] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:34563881worker1 # [ 11.328444] 8021q: adding VLAN 0 to HW filter on device eth03882worker1 # [ 11.194565] dhcpcd[697]: eth0: waiting for carrier3883worker1 # [ 11.195513] dhcpcd[697]: eth0: carrier acquired3884worker1 # [ 11.205233] dhcpcd[697]: DUID 00:01:00:01:32:42:50:1f:52:54:00:12:34:563885worker1 # [ 11.206219] dhcpcd[697]: eth0: IAID 00:12:34:563886worker1 # [ 11.206883] dhcpcd[697]: eth0: adding address fe80::5054:ff:fe12:34563887lb # [ 11.418103] dhcpcd[703]: eth0: soliciting a DHCP lease3888lb # [ 11.566533] NET: Registered PF_PACKET protocol family3889lb # [ 11.437623] dhcpcd[703]: eth0: offered 10.0.2.15 from 10.0.2.23890lb # [ 11.440146] dhcpcd[703]: eth0: probing address 10.0.2.15/243891client # [ 11.494278] dhcpcd[567]: eth0: soliciting an IPv6 router3892client # [ 11.497522] dhcpcd[567]: eth0: Router Advertisement from fe80::23893client # [ 11.499966] dhcpcd[567]: eth0: adding address fec0::5054:ff:fe12:3456/643894client # [ 11.502417] dhcpcd[567]: eth0: adding route to fec0::/643895client # [ 11.504282] dhcpcd[567]: eth0: adding default route via fe80::23896worker2 # [ 11.689350] dhcpcd[692]: eth0: soliciting a DHCP lease3897worker2 # [ 11.844985] NET: Registered PF_PACKET protocol family3898worker2 # [ 11.715883] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.23899worker2 # [ 11.721146] dhcpcd[692]: eth0: probing address 10.0.2.15/243900worker1: (finished: waiting for unit network-addresses-eth1.service, in 1.15 seconds)3901worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3902worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3903lb # [ 11.918193] dhcpcd[703]: eth0: soliciting an IPv6 router3904worker2: waiting for unit network-addresses-eth1.service3905worker2: waiting for the VM to finish booting3906worker2: Guest shell says: b'Spawning backdoor root shell...\n'3907worker2: connected to guest root shell3908worker2: (connecting took 0.00 seconds)3909worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3910lb # [ 11.919571] dhcpcd[703]: eth0: Router Advertisement from fe80::23911lb # [ 11.920616] dhcpcd[703]: eth0: adding address fec0::5054:ff:fe12:3456/643912lb # [ 11.921597] dhcpcd[703]: eth0: adding route to fec0::/643913lb # [ 11.922450] dhcpcd[703]: eth0: adding default route via fe80::23914worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3915worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3916worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds)3917lb: waiting for unit niks3.service3918lb # [ 12.402378] postgresql-pre-start[726]: selecting default time zone ... UTC3919lb # [ 12.405676] postgresql-pre-start[726]: creating configuration files ... ok3920worker1 # [ 12.618576] dhcpcd[697]: eth0: soliciting a DHCP lease3921lb # [ 12.636670] postgresql-pre-start[726]: running bootstrap script ... ok3922worker1 # [ 12.775701] NET: Registered PF_PACKET protocol family3923worker1 # [ 12.646911] dhcpcd[697]: eth0: offered 10.0.2.15 from 10.0.2.23924worker1 # [ 12.650467] dhcpcd[697]: eth0: probing address 10.0.2.15/243925lb # [ 13.251154] postgresql-pre-start[726]: performing post-bootstrap initialization ... ok3926lb # [ 13.369887] postgresql-pre-start[726]: syncing data to disk ... ok3927lb # [ 13.371884] postgresql-pre-start[726]: initdb: warning: enabling "trust" authentication for local connections3928lb # [ 13.373125] postgresql-pre-start[726]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3929lb # [ 13.374977] postgresql-pre-start[726]: Success. You can now start the database server using:3930lb # [ 13.376031] postgresql-pre-start[726]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3931lb # [ 13.482190] postgres[795]: [795] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3932lb # [ 13.486625] postgres[795]: [795] LOG: listening on IPv6 address "::1", port 54323933lb # [ 13.487637] postgres[795]: [795] LOG: listening on IPv4 address "127.0.0.1", port 54323934lb # [ 13.491281] postgres[795]: [795] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3935lb # [ 13.503457] postgres[804]: [804] LOG: database system was shut down at 2026-09-20 08:04:49 GMT3936lb # [ 13.508451] postgres[795]: [795] LOG: database system is ready to accept connections3937lb # [ 13.514403] systemd[1]: Started PostgreSQL Server.3938lb # [ 13.519429] systemd[1]: Starting PostgreSQL Setup Scripts...3939worker1 # [ 13.574263] dhcpcd[697]: eth0: soliciting an IPv6 router3940worker1 # [ 13.576589] dhcpcd[697]: eth0: Router Advertisement from fe80::23941worker1 # [ 13.579367] dhcpcd[697]: eth0: adding address fec0::5054:ff:fe12:3456/643942worker1 # [ 13.581567] dhcpcd[697]: eth0: adding route to fec0::/643943worker1 # [ 13.583636] dhcpcd[697]: eth0: adding default route via fe80::23944lb # [ 13.694306] postgresql-setup-start[815]: CREATE DATABASE3945lb # [ 13.740500] postgresql-setup-start[820]: CREATE ROLE3946lb # [ 13.760725] postgresql-setup-start[822]: ALTER DATABASE3947lb # [ 13.765948] systemd[1]: Finished PostgreSQL Setup Scripts.3948lb # [ 13.767799] systemd[1]: Reached target PostgreSQL.3949worker2 # [ 13.799597] dhcpcd[692]: eth0: soliciting an IPv6 router3950worker2 # [ 13.802503] dhcpcd[692]: eth0: Router Advertisement from fe80::23951worker2 # [ 13.804658] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643952worker2 # [ 13.806837] dhcpcd[692]: eth0: adding route to fec0::/643953worker2 # [ 13.808742] dhcpcd[692]: eth0: adding default route via fe80::23954client # [ 14.797132] dhcpcd[567]: eth0: leased 10.0.2.15 for 86400 seconds3955client # [ 14.798032] dhcpcd[567]: eth0: adding route to 10.0.2.0/243956client # [ 14.798705] dhcpcd[567]: eth0: adding default route via 10.0.2.23957client # [ 14.882874] systemd[1]: Started DHCP Client.3958client # [ 14.885518] systemd[1]: Reached target Multi-User System.3959client # [ 14.887119] systemd[1]: Startup finished in 940ms (kernel) + 4.130s (initrd) + 9.815s (userspace) = 14.886s.3960lb # [ 16.552405] dhcpcd[703]: eth0: leased 10.0.2.15 for 86400 seconds3961lb # [ 16.553350] dhcpcd[703]: eth0: adding route to 10.0.2.0/243962lb # [ 16.554296] dhcpcd[703]: eth0: adding default route via 10.0.2.23963lb # [ 16.645256] systemd[1]: Started DHCP Client.3964lb # [ 16.647267] systemd[1]: Reached target Network is Online.3965lb # [ 16.651408] systemd[1]: Started Envoy reverse proxy.3966lb # [ 16.654944] systemd[1]: Started mock-oidc.service.3967lb # [ 16.744676] mock-oidc-server[914]: Mock OIDC Server running3968lb # [ 16.746290] mock-oidc-server[914]: OIDC Address: 192.168.1.2:80803969lb # [ 16.747346] mock-oidc-server[914]: Issue Address: 0.0.0.0:80813970lb # [ 16.748247] mock-oidc-server[914]: Issuer: http://192.168.1.2:8080/oidc3971lb # [ 16.749283] mock-oidc-server[914]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3972lb # [ 16.750466] mock-oidc-server[914]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3973lb # [ 16.751861] mock-oidc-server[914]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3974lb # [ 17.151560] envoy[913]: [2026-09-20 08:04:53.078][913][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3975lb # [ 17.153660] envoy[913]: [2026-09-20 08:04:53.080][913][info][main] [source/server/server.cc:469] statically linked extensions:3976lb # [ 17.155316] envoy[913]: [2026-09-20 08:04:53.080][913][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3977lb # [ 17.157933] envoy[913]: [2026-09-20 08:04:53.080][913][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3978lb # [ 17.159893] envoy[913]: [2026-09-20 08:04:53.080][913][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3979lb # [ 17.162907] envoy[913]: [2026-09-20 08:04:53.080][913][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3980lb # [ 17.165523] envoy[913]: [2026-09-20 08:04:53.080][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23981lb # [ 17.167301] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3982lb # [ 17.171403] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3983lb # [ 17.173781] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3984lb # [ 17.175585] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3985lb # [ 17.177574] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3986lb # [ 17.182035] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3987lb # [ 17.184947] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3988lb # [ 17.186902] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3989lb # [ 17.189320] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3990lb # [ 17.191286] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3991lb # [ 17.192975] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3992lb # [ 17.194707] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3993lb # [ 17.197693] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3994lb # [ 17.199451] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3995lb # [ 17.203750] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3996lb # [ 17.219091] envoy[913]: [2026-09-20 08:04:53.082][913][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3997lb # [ 17.222237] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3998lb # [ 17.225089] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3999lb # [ 17.227379] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4000lb # [ 17.229940] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24001lb # [ 17.231435] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4002lb # [ 17.233652] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4003lb # [ 17.237626] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4004lb # [ 17.239581] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4005lb # [ 17.242504] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4006lb # [ 17.247469] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14007lb # [ 17.249461] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4008lb # [ 17.251319] envoy[913]: [2026-09-20 08:04:53.084][913][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24009lb # [ 17.253459] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4010lb # [ 17.256193] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4011lb # [ 17.258232] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4012lb # [ 17.264175] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4013lb # [ 17.267041] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4014lb # [ 17.269698] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4015lb # [ 17.271559] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4016lb # [ 17.275389] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4017lb # [ 17.277196] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4018lb # [ 17.281510] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4019lb # [ 17.283504] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4020lb # [ 17.285260] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4021lb # [ 17.287858] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4022lb # [ 17.290816] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4023lb # [ 17.292449] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4024lb # [ 17.294722] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4025lb # [ 17.300876] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4026lb # [ 17.312394] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4027lb # [ 17.314509] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4028lb # [ 17.316500] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4029lb # [ 17.326192] envoy[913]: [2026-09-20 08:04:53.089][913][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4030lb # [ 17.332141] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4031lb # [ 17.334481] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4032lb # [ 17.336924] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4033lb # [ 17.339182] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4034lb # [ 17.341674] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4035lb # [ 17.344173] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4036lb # [ 17.346618] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4037lb # [ 17.348137] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4038lb # [ 17.349891] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4039lb # [ 17.356755] envoy[913]: [2026-09-20 08:04:53.094][913][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4040lb # [ 17.358413] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4041lb # [ 17.360124] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4042lb # [ 17.365321] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4043lb # [ 17.370056] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4044lb # [ 17.372824] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4045lb # [ 17.374815] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84046lb # [ 17.376511] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4047lb # [ 17.377950] envoy[913]: [2026-09-20 08:04:53.098][913][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4048worker1 # [ 17.368480] dhcpcd[697]: eth0: leased 10.0.2.15 for 86400 seconds4049lb # [ 17.380033] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4050lb # [ 17.381622] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4051worker1 # [ 17.371111] dhcpcd[697]: eth0: adding route to 10.0.2.0/244052worker1 # [ 17.373525] dhcpcd[697]: eth0: adding default route via 10.0.2.24053lb # [ 17.383429] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4054lb # [ 17.387644] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4055lb # [ 17.389280] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4056lb # [ 17.391313] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4057lb # [ 17.393684] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4058lb # [ 17.395593] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4059lb # [ 17.422362] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4060lb # [ 17.424889] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4061lb # [ 17.426839] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4062lb # [ 17.428718] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4063lb # [ 17.430888] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4064lb # [ 17.433040] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4065lb # [ 17.434823] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4066lb # [ 17.437069] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4067lb # [ 17.439621] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4068lb # [ 17.441585] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4069lb # [ 17.443372] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4070lb # [ 17.445209] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4071lb # [ 17.448082] envoy[913]: [2026-09-20 08:04:53.100][913][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4072lb # [ 17.450891] envoy[913]: [2026-09-20 08:04:53.111][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4073lb # [ 17.452907] envoy[913]: [2026-09-20 08:04:53.111][913][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4074lb # [ 17.455334] envoy[913]: [2026-09-20 08:04:53.111][913][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4075lb # [ 17.457922] envoy[913]: [2026-09-20 08:04:53.111][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4076lb # [ 17.460633] envoy[913]: [2026-09-20 08:04:53.111][913][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4077lb # [ 17.462499] envoy[913]: [2026-09-20 08:04:53.111][913][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4078lb # [ 17.465811] envoy[913]: [2026-09-20 08:04:53.113][913][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4079lb # [ 17.472849] envoy[913]: [2026-09-20 08:04:53.113][913][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4080lb # [ 17.474936] envoy[913]: [2026-09-20 08:04:53.113][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4081worker1 # [ 17.469548] systemd[1]: Started DHCP Client.4082lb # [ 17.476789] envoy[913]: [2026-09-20 08:04:53.113][913][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4083worker1 # [ 17.472236] systemd[1]: Reached target Multi-User System.4084lb # [ 17.481736] envoy[913]: [2026-09-20 08:04:53.113][913][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4085worker1 # [ 17.473355] systemd[1]: Startup finished in 885ms (kernel) + 5.125s (initrd) + 11.461s (userspace) = 17.471s.4086lb # [ 17.484248] envoy[913]: [2026-09-20 08:04:53.212][913][info][main] [source/server/server.cc:531] HTTP header map info:4087lb # [ 17.485552] envoy[913]: [2026-09-20 08:04:53.271][913][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4088lb # [ 17.498809] envoy[913]: [2026-09-20 08:04:53.271][913][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4089lb # [ 17.500574] envoy[913]: [2026-09-20 08:04:53.271][913][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4090lb # [ 17.508783] envoy[913]: [2026-09-20 08:04:53.271][913][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4091worker2 # [ 17.546186] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds4092worker2 # [ 17.547409] dhcpcd[692]: eth0: adding route to 10.0.2.0/244093worker2 # [ 17.548517] dhcpcd[692]: eth0: adding default route via 10.0.2.24094lb # [ 17.553457] envoy[913]: [2026-09-20 08:04:53.480][913][info][main] [source/server/server.cc:968] runtime: {}4095lb # [ 17.561322] envoy[913]: [2026-09-20 08:04:53.488][913][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4096lb # [ 17.563572] envoy[913]: [2026-09-20 08:04:53.490][913][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014097lb # [ 17.566377] envoy[913]: [2026-09-20 08:04:53.493][913][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014098lb # [ 17.569377] envoy[913]: [2026-09-20 08:04:53.496][913][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4099lb # [ 17.571052] envoy[913]: [2026-09-20 08:04:53.497][913][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4100lb # [ 17.572674] envoy[913]: [2026-09-20 08:04:53.497][913][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4101worker1 # [ 17.613345] systemd[1]: Starting Nix worker-protocol over gRPC...4102lb # [ 17.625206] envoy[913]: [2026-09-20 08:04:53.552][913][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4103worker2 # [ 17.626746] systemd[1]: Starting Nix worker-protocol over gRPC...4104lb # [ 17.647721] envoy[913]: [2026-09-20 08:04:53.574][913][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4105lb # [ 17.650062] envoy[913]: [2026-09-20 08:04:53.577][913][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4106lb # [ 17.652955] envoy[913]: [2026-09-20 08:04:53.579][913][info][main] [source/server/server.cc:1077] starting main dispatch loop4107worker2 # [ 17.670815] systemd[1]: Started DHCP Client.4108worker2 # [ 17.673154] systemd[1]: Reached target Multi-User System.4109worker1 # [ 17.820786] nix-grpc-daemon[787]: ts=2026-09-20T08:04:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4110worker1 # [ 17.833179] nix-grpc-daemon[787]: ts=2026-09-20T08:04:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14111worker2 # [ 17.844619] nix-grpc-daemon[772]: ts=2026-09-20T08:04:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4112worker2 # [ 17.859646] nix-grpc-daemon[772]: ts=2026-09-20T08:04:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14113worker1 # [ 17.871791] nix-grpc-daemon[787]: ts=2026-09-20T08:04:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4114worker1 # [ 17.875200] systemd[1]: Started Nix worker-protocol over gRPC.4115worker2 # [ 17.898705] nix-grpc-daemon[772]: ts=2026-09-20T08:04:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4116worker2 # [ 17.902496] systemd[1]: Started Nix worker-protocol over gRPC.4117worker2 # [ 17.905740] systemd[1]: Startup finished in 911ms (kernel) + 5.107s (initrd) + 11.885s (userspace) = 17.903s.4118worker1 # [ 17.907065] nix-grpc-daemon[787]: ts=2026-09-20T08:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4119lb # [ 17.936763] envoy[913]: [2026-09-20 08:04:53.863][913][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4120lb # [ 17.941816] envoy[913]: [2026-09-20 08:04:53.868][913][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4121worker2 # [ 17.940992] nix-grpc-daemon[772]: ts=2026-09-20T08:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4122lb # [ 17.946784] envoy[913]: [2026-09-20 08:04:53.868][913][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4123lb # [ 17.952111] envoy[913]: [2026-09-20 08:04:53.873][913][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4124worker1 # [ 18.108037] nix-grpc-daemon[787]: ts=2026-09-20T08:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4125worker2 # [ 18.142544] nix-grpc-daemon[772]: ts=2026-09-20T08:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4126worker1 # [ 18.508371] nix-grpc-daemon[787]: ts=2026-09-20T08:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4127worker2 # [ 18.543202] nix-grpc-daemon[772]: ts=2026-09-20T08:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4128worker1 # [ 19.311421] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514129worker1 # [ 19.334961] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4130worker2 # [ 19.346977] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514131worker2 # [ 19.360237] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4132worker1 # [ 19.535666] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514133worker1 # [ 19.538470] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4134worker2 # [ 19.561343] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514135worker2 # [ 19.566954] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker1 # [ 19.739580] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514137worker1 # [ 19.744418] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4138worker2 # [ 19.767739] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514139worker2 # [ 19.770286] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker1 # [ 19.945174] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 19.949903] nix-grpc-daemon[787]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4142worker2 # [ 19.971344] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_connected addr=lb:500514143worker2 # [ 19.976701] nix-grpc-daemon[772]: ts=2026-09-20T08:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker1 # [ 20.150545] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 20.153255] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker2 # [ 20.177901] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 20.182967] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 20.354792] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 20.359180] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker2 # [ 20.385614] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 20.389365] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 20.560194] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 20.565238] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker2 # [ 20.589901] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514155worker2 # [ 20.592526] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 20.765846] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 20.770214] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 20.793270] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 20.795712] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 20.970782] nix-grpc-daemon[787]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 20.975762] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker2 # [ 20.996777] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 21.001596] nix-grpc-daemon[772]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 21.176365] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 21.179123] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker2 # [ 21.202707] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 21.207645] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 21.380276] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 21.383072] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker2 # [ 21.408773] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 21.411196] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 21.583763] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 21.586687] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker2 # [ 21.611818] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 21.614540] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker1 # [ 21.787648] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 21.792447] nix-grpc-daemon[787]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker2 # [ 21.816595] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 21.820271] nix-grpc-daemon[772]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 21.993407] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514181worker1 # [ 21.998479] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker2 # [ 22.020578] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514183worker2 # [ 22.023210] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 22.199475] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 22.204288] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4186worker2 # [ 22.223951] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 22.226593] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 22.405163] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 22.407664] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4190worker2 # [ 22.427650] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 22.433220] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 22.608405] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 22.612753] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4194worker2 # [ 22.633966] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 22.636969] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 22.813349] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 22.817081] nix-grpc-daemon[787]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker2 # [ 22.837772] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 22.842733] nix-grpc-daemon[772]: ts=2026-09-20T08:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 23.018285] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 23.023408] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4202worker2 # [ 23.044337] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 23.048257] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 23.223879] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 23.226758] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4206worker2 # [ 23.248669] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 23.250978] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 23.429067] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 23.434608] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4210worker2 # [ 23.454376] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514211worker2 # [ 23.457461] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker1 # [ 23.635555] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 23.640264] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4214worker2 # [ 23.655365] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514215worker2 # [ 23.660210] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker1 # [ 23.841163] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 23.846211] nix-grpc-daemon[787]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218worker2 # [ 23.861245] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500514219worker2 # [ 23.866308] nix-grpc-daemon[772]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker1 # [ 24.047181] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514221worker1 # [ 24.050779] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4222worker2 # [ 24.066888] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514223worker2 # [ 24.069585] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker1 # [ 24.251831] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514225worker1 # [ 24.256848] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4226worker2 # [ 24.270925] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514227worker2 # [ 24.276175] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 24.459989] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514229worker1 # [ 24.463299] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4230worker2 # [ 24.477779] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514231worker2 # [ 24.479507] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232lb # [ 24.667872] rustfs-bucket-start[995]: mb s3://farm4233worker1 # [ 24.660887] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 24.665841] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235lb # [ 24.682952] systemd[1]: Finished rustfs-bucket.service.4236worker2 # [ 24.680544] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 24.685961] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4238lb # [ 24.698827] systemd[1]: Starting niks3 server...4239worker1 # [ 24.866454] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514240worker1 # [ 24.869079] nix-grpc-daemon[787]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4241worker2 # [ 24.886764] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_connected addr=lb:500514242worker2 # [ 24.889558] nix-grpc-daemon[772]: ts=2026-09-20T08:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243lb # [ 24.933915] postgres[1011]: [1011] ERROR: relation "goose_db_version" does not exist at character 364244lb # [ 24.935219] postgres[1011]: [1011] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4245lb # [ 24.974698] niks3-server[1005]: 2026/09/20 08:05:00 OK 20241026095416_initial_model.sql (20.77ms)4246lb # [ 24.978142] niks3-server[1005]: 2026/09/20 08:05:00 OK 20251210153512_drop_unused_gin_index.sql (4.01ms)4247lb # [ 24.983356] niks3-server[1005]: 2026/09/20 08:05:00 OK 20251218171726_add_pins.sql (3.64ms)4248lb # [ 24.988547] niks3-server[1005]: 2026/09/20 08:05:00 OK 20260628120000_add_object_size_and_stats.sql (3.9ms)4249lb # [ 24.993059] niks3-server[1005]: 2026/09/20 08:05:00 OK 20260905000000_add_claims.sql (4.49ms)4250lb # [ 24.997086] niks3-server[1005]: 2026/09/20 08:05:00 OK 20260920000000_drop_claims.sql (3.89ms)4251lb # [ 24.998230] niks3-server[1005]: 2026/09/20 08:05:00 goose: successfully migrated database to version: 202609200000004252lb # [ 25.003542] niks3-server[1005]: 2026/09/20 08:05:00 OK 1_commit_pending_closure.sql (6.56ms)4253lb # [ 25.006050] niks3-server[1005]: 2026/09/20 08:05:00 OK 2_object_stats_trigger.sql (1.23ms)4254lb # [ 25.007238] niks3-server[1005]: 2026/09/20 08:05:00 goose: up to current file version: 24255lb # [ 25.013344] niks3-server[1005]: 2026/09/20 08:05:00 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4256worker1 # [ 25.069655] nix-grpc-daemon[787]: ts=2026-09-20T08:05:01Z level=info event=scheduler_connected addr=lb:500514257worker1 # [ 25.071858] nix-grpc-daemon[787]: ts=2026-09-20T08:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4258lb # [ 25.091581] niks3-server[1005]: 2026/09/20 08:05:01 INFO Read proxy enabled — serving cache objects from S34259worker2 # [ 25.090301] nix-grpc-daemon[772]: ts=2026-09-20T08:05:01Z level=info event=scheduler_connected addr=lb:500514260lb # [ 25.094232] niks3-server[1005]: 2026/09/20 08:05:01 INFO Using socket-activated listener address=0.0.0.0:57514261worker2 # [ 25.093839] nix-grpc-daemon[772]: ts=2026-09-20T08:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262lb # [ 25.100241] systemd[1]: Started niks3 server.4263lb # [ 25.100985] niks3-server[1005]: 2026/09/20 08:05:01 INFO systemd watchdog enabled interval=15s4264lb # [ 25.104498] niks3-server[1005]: 2026/09/20 08:05:01 INFO Starting HTTP server address=0.0.0.0:57514265lb # [ 25.107725] systemd[1]: Reached target Multi-User System.4266lb # [ 25.109098] systemd[1]: Startup finished in 893ms (kernel) + 4.179s (initrd) + 20.035s (userspace) = 25.108s.4267lb # [ 25.118100] niks3-server[1005]: 2026/09/20 08:05:01 INFO lead: acquired remote=192.168.1.4:548964268worker2 # [ 25.121096] nix-grpc-daemon[772]: ts=2026-09-20T08:05:01Z level=info event=scheduler_take_over4269lb: (finished: waiting for unit niks3.service, in 13.18 seconds)4270lb: waiting for TCP port 5751 on localhost4271lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4272lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4273lb: waiting for unit envoy.service4274worker1 # [ 25.272820] nix-grpc-daemon[787]: ts=2026-09-20T08:05:01Z level=info event=scheduler_connected addr=lb:500514275worker1 # [ 25.277601] nix-grpc-daemon[787]: ts=2026-09-20T08:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker2 # [ 25.294499] nix-grpc-daemon[772]: ts=2026-09-20T08:05:01Z level=info event=scheduler_connected addr=lb:500514277worker2 # [ 25.297748] nix-grpc-daemon[772]: ts=2026-09-20T08:05:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04278lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4279lb: waiting for TCP port 50051 on localhost4280lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4281lb # [ 25.342059] envoy[913]: conn peer=[::1]:38404 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34282lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4283lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4284??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4285 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284286lb: must succeed: curl -sf localhost:9901/clusters4287worker1 # [ 25.479301] nix-grpc-daemon[787]: ts=2026-09-20T08:05:01Z level=info event=scheduler_connected addr=lb:500514288worker1 # [ 25.483904] nix-grpc-daemon[787]: ts=2026-09-20T08:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4289lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4290lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.08 seconds)4291subtest: one node schedules and both builders hold a WorkerSession on it4292lb: must succeed: curl -sf localhost:9901/clusters4293lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4294worker1 # [ 25.684917] nix-grpc-daemon[787]: ts=2026-09-20T08:05:01Z level=info event=scheduler_connected addr=lb:500514295worker2 # [ 25.695348] nix-grpc-daemon[772]: ts=2026-09-20T08:05:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04296lb: must succeed: curl -sf localhost:9901/clusters4297lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4298worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4299worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4300(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.18 seconds)4301subtest: balancer auth: client cert, bearer token, nothing, unknown CN4302worker2 # [ 27.005498] nix-grpc-daemon[772]: ts=2026-09-20T08:05:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:535084303worker2 # [ 27.017921] systemd[1]: Started Nix Daemon.4304worker2 # [ 27.244946] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4305worker2 # [ 27.301619] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)4306worker2 # [ 27.358399] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 2/5)4307worker2 # [ 27.494327] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 168 ms (attempt 3/5)4308worker2 # [ 27.668498] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 687 ms (attempt 4/5)4309worker2 # [ 28.368651] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4310worker2 # [ 28.396080] nix-grpc-daemon[772]: ts=2026-09-20T08:05:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:535084311worker2 # [ 28.414178] nix-grpc-daemon[772]: ts=2026-09-20T08:05:04Z level=debug event=path_info_miss path=0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test error="error: path '/nix/store/0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test' is required, but there is no substituter that can build it"4312worker1 # [ 28.424430] nix-grpc-daemon[787]: ts=2026-09-20T08:05:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554764313worker1 # [ 28.430942] systemd[1]: Started Nix Daemon.4314worker1 # [ 28.631369] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4315worker1 # [ 28.666129] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5)4316worker1 # [ 28.759088] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 2/5)4317worker1 # [ 28.793057] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 3/5)4318worker1 # [ 28.965970] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 321 ms (attempt 4/5)4319worker1 # [ 29.295790] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4320worker1 # [ 29.316805] nix-grpc-daemon[787]: ts=2026-09-20T08:05:05Z level=debug event=path_info_miss path=0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test error="error: path '/nix/store/0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test' is required, but there is no substituter that can build it"4321client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4322client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4323client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4324client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4325worker1 # [ 29.646835] nix-grpc-daemon[787]: ts=2026-09-20T08:05:05Z level=info event=oidc_jwks provider=mock keys=14326worker1 # [ 29.650679] nix-grpc-daemon[787]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:554764327worker2 # [ 29.692193] nix-grpc-daemon[772]: ts=2026-09-20T08:05:05Z level=info event=oidc_jwks provider=mock keys=14328worker2 # [ 29.695954] nix-grpc-daemon[772]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:535084329worker2 # [ 29.704693] nix-grpc-daemon[772]: ts=2026-09-20T08:05:05Z level=debug event=path_info_miss path=0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test error="error: path '/nix/store/0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test' is required, but there is no substituter that can build it"4330worker2 # [ 29.714091] nix-grpc-daemon[772]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:535084331worker2 # [ 29.723546] nix-grpc-daemon[772]: ts=2026-09-20T08:05:05Z level=debug event=path_info_miss path=0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test error="error: path '/nix/store/0xa55494i5pbb87kf8d1q6a723ynxfq1-nixos-system-client-test' is required, but there is no substituter that can build it"4332client: must succeed: rm -r /var/lib/nix-grpc-store4333client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4334worker1 # [ 29.957616] nix-grpc-daemon[787]: ts=2026-09-20T08:05:05Z level=info event=denied method=QueryMissing cn=- role=none4335worker2 # [ 30.168664] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=info event=denied method=QueryMissing cn=stranger role=none4336(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.46 seconds)4337subtest: DAG build is scheduled across workers and lands in the cache4338client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24339worker2 # [ 30.399695] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:535084340client # don't know how to build these paths:4341client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4342worker2 # [ 30.425432] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04343worker2 # [ 30.427576] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14344worker2 # [ 30.485449] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084345worker2 # [ 30.506709] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084346client # copying 1 paths to 'lb:50051'...4347worker2 # [ 30.517132] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084348client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4349worker2 # [ 30.544623] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4350worker2 # [ 30.566743] nix-grpc-daemon[772]: ts=2026-09-20T08:05:06Z level=info event=niks3_push_started pid=8574351worker2 # [ 31.024580] nix-daemon[844]: accepted connection from pid 870, user nix-grpc-daemon (trusted)4352worker2 # [ 31.040838] nix-daemon[844]: reaped child process 873, status = succeeded4353worker2 # [ 31.192483] nix-daemon[844]: accepted connection from pid 875, user nix-grpc-daemon (trusted)4354worker2 # [ 31.205774] nix-daemon[844]: reaped child process 878, status = succeeded4355lb # [ 31.218347] niks3-server[1005]: 2026/09/20 08:05:07 INFO Received uploads request method=POST path=/api/pending_closures4356worker2 # [ 31.229923] nix-grpc-daemon[857]: time=2026-09-20T08:05:07.224Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4357worker2 # [ 31.232887] nix-grpc-daemon[857]: time=2026-09-20T08:05:07.227Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4358lb # [ 31.260724] niks3-server[1005]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4359lb # [ 31.264058] niks3-server[1005]: 2026/09/20 08:05:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4360lb # [ 31.270718] niks3-server[1005]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4361lb # [ 31.281106] niks3-server[1005]: 2026/09/20 08:05:07 INFO Signed narinfos id=1 count=14362worker2 # [ 31.279913] nix-grpc-daemon[857]: time=2026-09-20T08:05:07.275Z level=INFO msg="Uploading 1 narinfos"4363lb # [ 31.289388] niks3-server[1005]: 2026/09/20 08:05:07 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4364lb # [ 31.295131] niks3-server[1005]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4365lb # [ 31.305586] niks3-server[1005]: 2026/09/20 08:05:07 INFO Completed upload id=14366worker2 # [ 31.302792] nix-grpc-daemon[857]: time=2026-09-20T08:05:07.298Z level=INFO msg="Upload complete. (450ms)"4367worker2 # [ 31.306821] nix-grpc-daemon[772]: ts=2026-09-20T08:05:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_in=5044368worker2 # [ 31.312793] nix-grpc-daemon[772]: ts=2026-09-20T08:05:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084369worker2 # [ 31.322078] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4370worker2 # [ 31.326300] nix-daemon[844]: reaped child process 855, status = succeeded4371worker2 # [ 31.331330] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4372client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4373client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4374client # farm-a> LOG-farm-a-t14375worker2 # [ 32.759483] nix-daemon[844]: reaped child process 882, status = succeeded4376worker2 # [ 32.909577] nix-daemon[844]: accepted connection from pid 897, user nix-grpc-daemon (trusted)4377worker2 # [ 32.921915] nix-daemon[844]: reaped child process 900, status = succeeded4378lb # [ 32.942057] niks3-server[1005]: 2026/09/20 08:05:08 INFO Received uploads request method=POST path=/api/pending_closures4379worker2 # [ 32.947580] nix-grpc-daemon[857]: time=2026-09-20T08:05:08.942Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4380worker2 # [ 32.949369] nix-grpc-daemon[857]: time=2026-09-20T08:05:08.944Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4381lb # [ 32.988847] niks3-server[1005]: 2026/09/20 08:05:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4382lb # [ 32.994127] niks3-server[1005]: 2026/09/20 08:05:08 INFO Signed narinfos id=2 count=14383worker2 # [ 32.994289] nix-grpc-daemon[857]: time=2026-09-20T08:05:08.989Z level=INFO msg="Uploading 1 narinfos"4384lb # [ 33.010757] niks3-server[1005]: 2026/09/20 08:05:08 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4385lb # [ 33.019792] niks3-server[1005]: 2026/09/20 08:05:08 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4386lb # [ 33.021873] niks3-server[1005]: 2026/09/20 08:05:08 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4387lb # [ 33.027632] niks3-server[1005]: 2026/09/20 08:05:08 INFO Completed upload id=24388worker2 # [ 33.025100] nix-grpc-daemon[857]: time=2026-09-20T08:05:09.019Z level=INFO msg="Upload complete. (283ms)"4389lb # [ 33.029500] niks3-server[1005]: 2026/09/20 08:05:08 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4390worker2 # [ 33.028617] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14391lb # [ 33.038858] niks3-server[1005]: 2026/09/20 08:05:08 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4392worker2 # [ 33.038278] nix-daemon[844]: reaped child process 880, status = succeeded4393worker2 # [ 33.042072] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04394worker2 # [ 33.044242] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14395worker2 # [ 33.087655] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084396worker2 # [ 33.100268] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084397worker2 # [ 33.114950] nix-grpc-daemon[857]: time=2026-09-20T08:05:09.110Z level=INFO msg="All 1 paths already cached"4398client # copying 1 paths to 'lb:50051'...4399client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4400worker2 # [ 33.122153] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084401worker2 # [ 33.134173] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4402worker2 # [ 33.294602] nix-daemon[844]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4403worker2 # [ 33.307933] nix-daemon[844]: reaped child process 909, status = succeeded4404worker2 # [ 33.450896] nix-daemon[844]: accepted connection from pid 911, user nix-grpc-daemon (trusted)4405worker2 # [ 33.464398] nix-daemon[844]: reaped child process 914, status = succeeded4406lb # [ 33.477136] niks3-server[1005]: 2026/09/20 08:05:09 INFO Received uploads request method=POST path=/api/pending_closures4407worker2 # [ 33.488813] nix-grpc-daemon[857]: time=2026-09-20T08:05:09.483Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4408worker2 # [ 33.490187] nix-grpc-daemon[857]: time=2026-09-20T08:05:09.483Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4409lb # [ 33.510393] niks3-server[1005]: 2026/09/20 08:05:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4410lb # [ 33.519123] niks3-server[1005]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4411lb # [ 33.523922] niks3-server[1005]: 2026/09/20 08:05:09 INFO Signed narinfos id=3 count=14412worker2 # [ 33.524265] nix-grpc-daemon[857]: time=2026-09-20T08:05:09.519Z level=INFO msg="Uploading 1 narinfos"4413lb # [ 33.535262] niks3-server[1005]: 2026/09/20 08:05:09 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4414lb # [ 33.538562] niks3-server[1005]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4415lb # [ 33.553161] niks3-server[1005]: 2026/09/20 08:05:09 INFO Completed upload id=34416worker2 # [ 33.550905] nix-grpc-daemon[857]: time=2026-09-20T08:05:09.545Z level=INFO msg="Upload complete. (403ms)"4417worker2 # [ 33.553258] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_in=6244418worker2 # [ 33.555826] nix-grpc-daemon[772]: ts=2026-09-20T08:05:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084419lb # [ 33.563624] niks3-server[1005]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4420worker2 # [ 33.564923] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4421worker2 # [ 33.574235] nix-daemon[844]: reaped child process 904, status = succeeded4422client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4423client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4424worker2 # [ 33.577816] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4425client # farm-b> LOG-farm-b-t14426worker2 # [ 34.404511] nix-daemon[844]: reaped child process 918, status = succeeded4427worker2 # [ 34.549822] nix-daemon[844]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4428worker2 # [ 34.562082] nix-daemon[844]: reaped child process 937, status = succeeded4429lb # [ 34.579821] niks3-server[1005]: 2026/09/20 08:05:10 INFO Received uploads request method=POST path=/api/pending_closures4430worker2 # [ 34.588122] nix-grpc-daemon[857]: time=2026-09-20T08:05:10.583Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4431worker2 # [ 34.590442] nix-grpc-daemon[857]: time=2026-09-20T08:05:10.585Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4432lb # [ 34.603603] niks3-server[1005]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4433lb # [ 34.612366] niks3-server[1005]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4434lb # [ 34.619965] niks3-server[1005]: 2026/09/20 08:05:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4435lb # [ 34.623316] niks3-server[1005]: 2026/09/20 08:05:10 INFO Signed narinfos id=4 count=14436worker2 # [ 34.622777] nix-grpc-daemon[857]: time=2026-09-20T08:05:10.618Z level=INFO msg="Uploading 1 narinfos"4437lb # [ 34.629672] niks3-server[1005]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4438lb # [ 34.634162] niks3-server[1005]: 2026/09/20 08:05:10 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4439lb # [ 34.637330] niks3-server[1005]: 2026/09/20 08:05:10 INFO Completed upload id=44440worker2 # [ 34.634382] nix-grpc-daemon[857]: time=2026-09-20T08:05:10.629Z level=INFO msg="Upload complete. (247ms)"4441lb # [ 34.638755] niks3-server[1005]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4442worker2 # [ 34.636885] nix-grpc-daemon[772]: ts=2026-09-20T08:05:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14443worker2 # [ 34.644485] nix-grpc-daemon[772]: ts=2026-09-20T08:05:10Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04444worker2 # [ 34.646711] nix-grpc-daemon[772]: ts=2026-09-20T08:05:10Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14445worker2 # [ 34.650410] nix-daemon[844]: reaped child process 916, status = succeeded4446worker2 # [ 34.687706] nix-grpc-daemon[772]: ts=2026-09-20T08:05:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084447worker2 # [ 34.694460] nix-grpc-daemon[772]: ts=2026-09-20T08:05:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084448worker2 # [ 34.962589] nix-grpc-daemon[857]: time=2026-09-20T08:05:10.958Z level=INFO msg="All 2 paths already cached"4449client # copying 1 paths to 'lb:50051'...4450worker2 # [ 34.969100] nix-grpc-daemon[772]: ts=2026-09-20T08:05:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084451client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4452worker2 # [ 34.987677] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4453worker2 # [ 35.133641] nix-daemon[844]: accepted connection from pid 943, user nix-grpc-daemon (trusted)4454worker2 # [ 35.147394] nix-daemon[844]: reaped child process 946, status = succeeded4455worker2 # [ 35.275081] nix-daemon[844]: accepted connection from pid 948, user nix-grpc-daemon (trusted)4456worker2 # [ 35.287733] nix-daemon[844]: reaped child process 951, status = succeeded4457lb # [ 35.299678] niks3-server[1005]: 2026/09/20 08:05:11 INFO Received uploads request method=POST path=/api/pending_closures4458worker2 # [ 35.305865] nix-grpc-daemon[857]: time=2026-09-20T08:05:11.301Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4459worker2 # [ 35.307741] nix-grpc-daemon[857]: time=2026-09-20T08:05:11.302Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4460lb # [ 35.332349] niks3-server[1005]: 2026/09/20 08:05:11 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4461lb # [ 35.342438] niks3-server[1005]: 2026/09/20 08:05:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4462worker2 # [ 35.346162] nix-grpc-daemon[857]: time=2026-09-20T08:05:11.341Z level=INFO msg="Uploading 1 narinfos"4463lb # [ 35.349292] niks3-server[1005]: 2026/09/20 08:05:11 INFO Signed narinfos id=5 count=14464lb # [ 35.353611] niks3-server[1005]: 2026/09/20 08:05:11 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4465lb # [ 35.363587] niks3-server[1005]: 2026/09/20 08:05:11 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4466lb # [ 35.372575] niks3-server[1005]: 2026/09/20 08:05:11 INFO Completed upload id=54467worker2 # [ 35.369680] nix-grpc-daemon[857]: time=2026-09-20T08:05:11.365Z level=INFO msg="Upload complete. (376ms)"4468lb # [ 35.374447] niks3-server[1005]: 2026/09/20 08:05:11 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4469worker2 # [ 35.371800] nix-grpc-daemon[772]: ts=2026-09-20T08:05:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_in=7524470worker2 # [ 35.375458] nix-grpc-daemon[772]: ts=2026-09-20T08:05:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084471worker2 # [ 35.382952] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4472worker2 # [ 35.385224] nix-daemon[844]: reaped child process 941, status = succeeded4473client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4474client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4475worker2 # [ 35.390832] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4476client # farm-top> LOG-farm-top-t14477worker2 # [ 36.204488] nix-daemon[844]: reaped child process 955, status = succeeded4478worker2 # [ 36.335099] nix-daemon[844]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4479worker2 # [ 36.346337] nix-daemon[844]: reaped child process 973, status = succeeded4480lb # [ 36.366400] niks3-server[1005]: 2026/09/20 08:05:12 INFO Received uploads request method=POST path=/api/pending_closures4481worker2 # [ 36.371898] nix-grpc-daemon[857]: time=2026-09-20T08:05:12.367Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4482worker2 # [ 36.374259] nix-grpc-daemon[857]: time=2026-09-20T08:05:12.368Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4483lb # [ 36.401945] niks3-server[1005]: 2026/09/20 08:05:12 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4484lb # [ 36.408177] niks3-server[1005]: 2026/09/20 08:05:12 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4485lb # [ 36.421145] niks3-server[1005]: 2026/09/20 08:05:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4486worker2 # [ 36.423483] nix-grpc-daemon[857]: time=2026-09-20T08:05:12.418Z level=INFO msg="Uploading 1 narinfos"4487lb # [ 36.426749] niks3-server[1005]: 2026/09/20 08:05:12 INFO Signed narinfos id=6 count=14488lb # [ 36.431797] niks3-server[1005]: 2026/09/20 08:05:12 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4489lb # [ 36.438265] niks3-server[1005]: 2026/09/20 08:05:12 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4490worker2 # [ 36.526898] nix-grpc-daemon[857]: time=2026-09-20T08:05:12.522Z level=INFO msg="Upload complete. (330ms)"4491lb # [ 36.529797] niks3-server[1005]: 2026/09/20 08:05:12 INFO Completed upload id=64492worker2 # [ 36.530772] nix-grpc-daemon[772]: ts=2026-09-20T08:05:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14493worker2 # [ 36.537393] nix-daemon[844]: reaped child process 953, status = succeeded4494lb # [ 36.543703] niks3-server[1005]: 2026/09/20 08:05:12 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4495client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.39 seconds)4496client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4497client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.17 seconds)4498client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4499client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4500client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4501client # copying 3 paths...4502client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4503client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4504client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4505client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4506(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.88 seconds)4507subtest: repeat is answered Cached by the scheduler without building4508worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4509worker1 # finding garbage collector roots...4510worker1 # deleting specified paths...4511worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4512worker1 # deleting unused links...4513worker1 # note: hard linking is currently saving 0.0 KiB4514worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4515worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4516worker2 # finding garbage collector roots...4517worker2 # deleting specified paths...4518worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4519worker2 # deleting unused links...4520worker2 # note: hard linking is currently saving 0.0 KiB4521worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.20 seconds)4522client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24523lb # [ 37.633358] envoy[913]: conn peer=[2001:db8:1::1]:34826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=422 ms=23654524lb # [ 37.635695] envoy[913]: conn peer=[2001:db8:1::1]:34840 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1004525lb # [ 37.637517] envoy[913]: conn peer=[2001:db8:1::1]:34854 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=114526lb # [ 37.639375] envoy[913]: conn peer=[2001:db8:1::1]:34866 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84527lb # [ 37.641286] envoy[913]: conn peer=[2001:db8:1::1]:34882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9355 tx=3809 ms=61794528worker2 # [ 37.756755] nix-grpc-daemon[772]: ts=2026-09-20T08:05:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:535084529client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4530client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4531worker2 # [ 37.795821] nix-grpc-daemon[772]: ts=2026-09-20T08:05:13Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14532worker2 # [ 37.810771] nix-grpc-daemon[772]: ts=2026-09-20T08:05:13Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14533worker2 # [ 37.827149] nix-grpc-daemon[772]: ts=2026-09-20T08:05:13Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14534client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.30 seconds)4535client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4536client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.17 seconds)4537lb: must succeed: curl -sf localhost:9901/clusters4538lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4539lb: must succeed: curl -sf localhost:9901/clusters4540lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4541worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4542worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.04 seconds)4543(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.16 seconds)4544subtest: two clients wanting the same drv build it once4545client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4546client # [ 38.261259] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4547client # Running as unit: dedup1.service; invocation ID: 5adf1a9d32bb468792bec4c1036281404548client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4549client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4550worker2 # [ 38.445903] nix-grpc-daemon[772]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:535084551client # [ 38.441584] nix[866]: don't know how to build these paths:4552client # [ 38.442531] nix[866]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4553worker2 # [ 38.459766] nix-grpc-daemon[772]: ts=2026-09-20T08:05:14Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04554worker2 # [ 38.464686] nix-grpc-daemon[772]: ts=2026-09-20T08:05:14Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14555worker1 # [ 38.498619] nix-grpc-daemon[787]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554764556worker1 # [ 38.514330] nix-grpc-daemon[787]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554764557client # [ 38.521458] nix[866]: copying 1 paths to 'lb:50051'...4558worker1 # [ 38.525438] nix-grpc-daemon[787]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:554764559client # [ 38.524159] nix[866]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4560worker1 # [ 38.534480] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4561worker1 # [ 38.550211] nix-grpc-daemon[787]: ts=2026-09-20T08:05:14Z level=info event=niks3_push_started pid=8694562worker1 # [ 38.968250] nix-daemon[844]: accepted connection from pid 880, user nix-grpc-daemon (trusted)4563worker1 # [ 38.985772] nix-daemon[844]: reaped child process 884, status = succeeded4564worker1 # [ 39.136495] nix-daemon[844]: accepted connection from pid 886, user nix-grpc-daemon (trusted)4565worker1 # [ 39.150633] nix-daemon[844]: reaped child process 889, status = succeeded4566lb # [ 39.171411] niks3-server[1005]: 2026/09/20 08:05:15 INFO Received uploads request method=POST path=/api/pending_closures4567worker1 # [ 39.173578] nix-grpc-daemon[869]: time=2026-09-20T08:05:15.200Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4568worker1 # [ 39.176686] nix-grpc-daemon[869]: time=2026-09-20T08:05:15.204Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4569lb # [ 39.212609] niks3-server[1005]: 2026/09/20 08:05:15 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4570lb # [ 39.222182] niks3-server[1005]: 2026/09/20 08:05:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4571lb # [ 39.226992] niks3-server[1005]: 2026/09/20 08:05:15 INFO Signed narinfos id=7 count=14572worker1 # [ 39.220027] nix-grpc-daemon[869]: time=2026-09-20T08:05:15.248Z level=INFO msg="Uploading 1 narinfos"4573lb # [ 39.240500] niks3-server[1005]: 2026/09/20 08:05:15 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4574lb # [ 39.249249] niks3-server[1005]: 2026/09/20 08:05:15 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4575lb # [ 39.254400] niks3-server[1005]: 2026/09/20 08:05:15 INFO Completed upload id=74576worker1 # [ 39.246778] nix-grpc-daemon[869]: time=2026-09-20T08:05:15.275Z level=INFO msg="Upload complete. (450ms)"4577lb # [ 39.257747] niks3-server[1005]: 2026/09/20 08:05:15 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4578worker1 # [ 39.248869] nix-grpc-daemon[787]: ts=2026-09-20T08:05:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=0 paths=1 nar_bytes_in=4324579worker1 # [ 39.254218] nix-grpc-daemon[787]: ts=2026-09-20T08:05:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554764580worker1 # [ 39.260299] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4581worker1 # [ 39.262690] nix-daemon[844]: reaped child process 867, status = succeeded4582worker1 # [ 39.268446] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4583client # [ 39.264478] nix[866]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4584client # [ 39.328557] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4585client # Running as unit: dedup2.service; invocation ID: 30228aebb81c44b1b2e6a7782f4fb63f4586client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4587worker1 # [ 39.563457] nix-grpc-daemon[787]: ts=2026-09-20T08:05:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:554764588client # [ 39.571990] nix[882]: this derivation will be built:4589worker2 # [ 39.583993] nix-grpc-daemon[772]: ts=2026-09-20T08:05:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:535084590worker2 # [ 39.591850] nix-grpc-daemon[772]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'...4591client # [ 39.594622] nix[882]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4592worker2 # [ 39.609413] nix-grpc-daemon[772]: ts=2026-09-20T08:05:15Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04593worker1 # [ 39.608747] nix-grpc-daemon[787]: ts=2026-09-20T08:05:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554764594client # [ 39.608413] nix[882]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4595client: must succeed: sleep 24596client: (finished: must succeed: sleep 2, in 2.03 seconds)4597??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4598 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394599client: waiting for success: ! systemctl is-active dedup1 dedup24600??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4601 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394602worker1 # [ 43.901713] nix-daemon[844]: reaped child process 893, status = succeeded4603worker1 # [ 44.057313] nix-daemon[844]: accepted connection from pid 929, user nix-grpc-daemon (trusted)4604worker1 # [ 44.073395] nix-daemon[844]: reaped child process 932, status = succeeded4605lb # [ 44.091783] niks3-server[1005]: 2026/09/20 08:05:20 INFO Received uploads request method=POST path=/api/pending_closures4606worker1 # [ 44.087623] nix-grpc-daemon[869]: time=2026-09-20T08:05:20.115Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4607worker1 # [ 44.089829] nix-grpc-daemon[869]: time=2026-09-20T08:05:20.117Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4608lb # [ 44.116904] niks3-server[1005]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4609lb # [ 44.124288] niks3-server[1005]: 2026/09/20 08:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4610lb # [ 44.127201] niks3-server[1005]: 2026/09/20 08:05:20 INFO Signed narinfos id=8 count=14611worker1 # [ 44.118980] nix-grpc-daemon[869]: time=2026-09-20T08:05:20.146Z level=INFO msg="Uploading 1 narinfos"4612lb # [ 44.131431] niks3-server[1005]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4613lb # [ 44.136132] niks3-server[1005]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4614lb # [ 44.138993] niks3-server[1005]: 2026/09/20 08:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4615lb # [ 44.143359] niks3-server[1005]: 2026/09/20 08:05:20 INFO Completed upload id=84616lb # [ 44.144928] niks3-server[1005]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4617worker1 # [ 44.135236] nix-grpc-daemon[869]: time=2026-09-20T08:05:20.162Z level=INFO msg="Upload complete. (253ms)"4618worker1 # [ 44.138754] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14619worker1 # [ 44.142268] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14620worker1 # [ 44.149476] nix-daemon[844]: reaped child process 891, status = succeeded4621client # [ 44.170168] systemd[1]: dedup1.service: Deactivated successfully.4622client # [ 44.173139] systemd[1]: dedup1.service: Consumed 99ms CPU time over 5.911s wall clock time, 39.3M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4623client # [ 44.175677] systemd[1]: dedup2.service: Deactivated successfully.4624client # [ 44.177574] systemd[1]: dedup2.service: Consumed 121ms CPU time over 4.848s wall clock time, 33.2M memory peak, 7.9K incoming IP traffic, 6.7K outgoing IP traffic.4625client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4626client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4627client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4628worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4629worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4630worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4631worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4632worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4633worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4634worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4635worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4636(finished: subtest: two clients wanting the same drv build it once, in 6.93 seconds)4637subtest: build hook: nix-daemon with builders = grpc://lb4638client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4639client # [ 45.332162] systemd[1]: Started Nix Daemon.4640client # [ 45.507065] nix-daemon[924]: accepted connection from pid 921, user root (trusted)4641worker2 # [ 45.715439] nix-grpc-daemon[772]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:535084642worker1 # [ 45.715877] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554764643worker2 # [ 45.737787] nix-grpc-daemon[772]: ts=2026-09-20T08:05:21Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04644worker2 # [ 45.743113] nix-grpc-daemon[772]: ts=2026-09-20T08:05:21Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14645worker2 # [ 45.748268] nix-grpc-daemon[772]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084646worker2 # [ 45.759818] nix-grpc-daemon[772]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084647worker2 # [ 45.771551] nix-grpc-daemon[772]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084648worker2 # [ 45.782720] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4649worker2 # [ 45.944784] nix-daemon[844]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4650worker2 # [ 45.959295] nix-daemon[844]: reaped child process 1041, status = succeeded4651worker2 # [ 46.117241] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4652worker2 # [ 46.130248] nix-daemon[844]: reaped child process 1046, status = succeeded4653lb # [ 46.148886] niks3-server[1005]: 2026/09/20 08:05:22 INFO Received uploads request method=POST path=/api/pending_closures4654worker2 # [ 46.158573] nix-grpc-daemon[857]: time=2026-09-20T08:05:22.153Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4655worker2 # [ 46.160407] nix-grpc-daemon[857]: time=2026-09-20T08:05:22.155Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4656lb # [ 46.183267] niks3-server[1005]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4657lb # [ 46.194302] niks3-server[1005]: 2026/09/20 08:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4658lb # [ 46.197861] niks3-server[1005]: 2026/09/20 08:05:22 INFO Signed narinfos id=9 count=14659worker2 # [ 46.197491] nix-grpc-daemon[857]: time=2026-09-20T08:05:22.192Z level=INFO msg="Uploading 1 narinfos"4660lb # [ 46.204231] niks3-server[1005]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4661lb # [ 46.215199] niks3-server[1005]: 2026/09/20 08:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4662lb # [ 46.219867] niks3-server[1005]: 2026/09/20 08:05:22 INFO Completed upload id=94663worker2 # [ 46.217064] nix-grpc-daemon[857]: time=2026-09-20T08:05:22.212Z level=INFO msg="Upload complete. (423ms)"4664lb # [ 46.222401] niks3-server[1005]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4665worker2 # [ 46.221124] nix-grpc-daemon[772]: ts=2026-09-20T08:05:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_in=5124666worker2 # [ 46.226282] nix-grpc-daemon[772]: ts=2026-09-20T08:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084667worker2 # [ 46.236746] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4668worker2 # [ 46.241884] nix-daemon[844]: reaped child process 1036, status = succeeded4669worker2 # [ 46.246291] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4670worker2 # [ 47.260359] nix-daemon[844]: reaped child process 1050, status = succeeded4671worker2 # [ 47.394084] nix-daemon[844]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4672worker2 # [ 47.408891] nix-daemon[844]: reaped child process 1068, status = succeeded4673lb # [ 47.424423] niks3-server[1005]: 2026/09/20 08:05:23 INFO Received uploads request method=POST path=/api/pending_closures4674worker2 # [ 47.427978] nix-grpc-daemon[857]: time=2026-09-20T08:05:23.423Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4675worker2 # [ 47.430548] nix-grpc-daemon[857]: time=2026-09-20T08:05:23.423Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4676lb # [ 47.455226] niks3-server[1005]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4677lb # [ 47.462644] niks3-server[1005]: 2026/09/20 08:05:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4678lb # [ 47.465499] niks3-server[1005]: 2026/09/20 08:05:23 INFO Signed narinfos id=10 count=14679worker2 # [ 47.464636] nix-grpc-daemon[857]: time=2026-09-20T08:05:23.459Z level=INFO msg="Uploading 1 narinfos"4680lb # [ 47.470346] niks3-server[1005]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4681lb # [ 47.478645] niks3-server[1005]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4682lb # [ 47.480794] niks3-server[1005]: 2026/09/20 08:05:23 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4683lb # [ 47.485249] niks3-server[1005]: 2026/09/20 08:05:23 INFO Completed upload id=104684worker2 # [ 47.482503] nix-grpc-daemon[857]: time=2026-09-20T08:05:23.477Z level=INFO msg="Upload complete. (229ms)"4685lb # [ 47.489147] niks3-server[1005]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4686worker2 # [ 47.486282] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14687worker2 # [ 47.492532] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:535084688worker2 # [ 47.495535] nix-daemon[844]: reaped child process 1048, status = succeeded4689worker2 # [ 47.508700] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:535084690worker2 # [ 47.511468] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_out=1284691lb # [ 47.634085] envoy[913]: conn peer=[2001:db8:1::1]:46770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=834692lb # [ 47.636164] envoy[913]: conn peer=[2001:db8:1::1]:46772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2985 tx=1369 ms=57144693lb # [ 47.638289] envoy[913]: conn peer=[2001:db8:1::1]:46786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1576 tx=1487 ms=45984694lb # [ 47.640436] envoy[913]: conn peer=[2001:db8:1::1]:37378 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=564695lb # [ 47.642455] envoy[913]: conn peer=[2001:db8:1::1]:37362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3381 tx=1645 ms=18504696worker2 # [ 47.786866] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:535084697worker2 # [ 47.793562] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084698worker2 # [ 47.797985] nix-grpc-daemon[857]: time=2026-09-20T08:05:23.793Z level=INFO msg="All 1 paths already cached"4699worker2 # [ 47.810600] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04700worker2 # [ 47.812908] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14701worker2 # [ 47.855897] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084702worker2 # [ 47.868412] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084703worker2 # [ 47.880232] nix-grpc-daemon[857]: time=2026-09-20T08:05:23.875Z level=INFO msg="All 1 paths already cached"4704worker2 # [ 47.888113] nix-grpc-daemon[772]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084705worker2 # [ 47.896910] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4706worker2 # [ 48.071243] nix-daemon[844]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4707worker2 # [ 48.086162] nix-daemon[844]: reaped child process 1077, status = succeeded4708worker2 # [ 48.234391] nix-daemon[844]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4709worker2 # [ 48.248466] nix-daemon[844]: reaped child process 1082, status = succeeded4710lb # [ 48.260174] niks3-server[1005]: 2026/09/20 08:05:24 INFO Received uploads request method=POST path=/api/pending_closures4711worker2 # [ 48.263176] nix-grpc-daemon[857]: time=2026-09-20T08:05:24.258Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4712worker2 # [ 48.264586] nix-grpc-daemon[857]: time=2026-09-20T08:05:24.258Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4713lb # [ 48.280574] niks3-server[1005]: 2026/09/20 08:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4714lb # [ 48.284476] niks3-server[1005]: 2026/09/20 08:05:24 INFO Signed narinfos id=11 count=14715worker2 # [ 48.281868] nix-grpc-daemon[857]: time=2026-09-20T08:05:24.277Z level=INFO msg="Uploading 1 narinfos"4716lb # [ 48.289426] niks3-server[1005]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4717lb # [ 48.293521] niks3-server[1005]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4718lb # [ 48.299969] niks3-server[1005]: 2026/09/20 08:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4719lb # [ 48.305159] niks3-server[1005]: 2026/09/20 08:05:24 INFO Completed upload id=114720lb # [ 48.306585] niks3-server[1005]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4721worker2 # [ 48.303660] nix-grpc-daemon[857]: time=2026-09-20T08:05:24.299Z level=INFO msg="Upload complete. (392ms)"4722worker2 # [ 48.306377] nix-grpc-daemon[772]: ts=2026-09-20T08:05:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_in=6244723worker2 # [ 48.309721] nix-grpc-daemon[772]: ts=2026-09-20T08:05:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084724worker2 # [ 48.318267] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4725worker2 # [ 48.322193] nix-daemon[844]: reaped child process 1072, status = succeeded4726worker2 # [ 48.325890] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4727worker2 # [ 49.540633] nix-daemon[844]: reaped child process 1086, status = succeeded4728worker2 # [ 49.663969] nix-daemon[844]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4729worker2 # [ 49.678151] nix-daemon[844]: reaped child process 1104, status = succeeded4730lb # [ 49.693901] niks3-server[1005]: 2026/09/20 08:05:25 INFO Received uploads request method=POST path=/api/pending_closures4731worker2 # [ 49.698461] nix-grpc-daemon[857]: time=2026-09-20T08:05:25.693Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4732worker2 # [ 49.701521] nix-grpc-daemon[857]: time=2026-09-20T08:05:25.695Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4733lb # [ 49.736108] niks3-server[1005]: 2026/09/20 08:05:25 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4734lb # [ 49.747622] niks3-server[1005]: 2026/09/20 08:05:25 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4735lb # [ 49.753784] niks3-server[1005]: 2026/09/20 08:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4736worker2 # [ 49.757352] nix-grpc-daemon[857]: time=2026-09-20T08:05:25.752Z level=INFO msg="Uploading 1 narinfos"4737lb # [ 49.759899] niks3-server[1005]: 2026/09/20 08:05:25 INFO Signed narinfos id=12 count=14738lb # [ 49.766283] niks3-server[1005]: 2026/09/20 08:05:25 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4739lb # [ 49.776501] niks3-server[1005]: 2026/09/20 08:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4740lb # [ 49.779728] niks3-server[1005]: 2026/09/20 08:05:25 INFO Completed upload id=124741worker2 # [ 49.776602] nix-grpc-daemon[857]: time=2026-09-20T08:05:25.772Z level=INFO msg="Upload complete. (242ms)"4742lb # [ 49.781916] niks3-server[1005]: 2026/09/20 08:05:25 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4743worker2 # [ 49.779523] nix-grpc-daemon[772]: ts=2026-09-20T08:05:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14744worker2 # [ 49.786360] nix-daemon[844]: reaped child process 1084, status = succeeded4745worker1 # [ 49.821823] nix-grpc-daemon[787]: ts=2026-09-20T08:05:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554764746worker1 # [ 49.846431] nix-grpc-daemon[787]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4747worker1 # [ 49.861439] nix-grpc-daemon[787]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4748worker2 # [ 49.891993] nix-grpc-daemon[772]: ts=2026-09-20T08:05:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:535084749worker2 # [ 49.894348] nix-grpc-daemon[772]: ts=2026-09-20T08:05:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_out=1764750worker2 # [ 50.103682] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:535084751worker2 # [ 50.106590] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084752worker2 # [ 50.110092] nix-grpc-daemon[857]: time=2026-09-20T08:05:26.105Z level=INFO msg="All 2 paths already cached"4753worker2 # [ 50.119254] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04754worker2 # [ 50.121788] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14755worker2 # [ 50.124669] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084756worker2 # [ 50.131622] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084757worker2 # [ 50.138682] nix-grpc-daemon[857]: time=2026-09-20T08:05:26.134Z level=INFO msg="All 2 paths already cached"4758worker2 # [ 50.142849] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084759worker2 # [ 50.147084] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4760worker2 # [ 50.291627] nix-daemon[844]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4761worker2 # [ 50.308226] nix-daemon[844]: reaped child process 1113, status = succeeded4762worker2 # [ 50.455216] nix-daemon[844]: accepted connection from pid 1115, user nix-grpc-daemon (trusted)4763worker2 # [ 50.469390] nix-daemon[844]: reaped child process 1118, status = succeeded4764lb # [ 50.486824] niks3-server[1005]: 2026/09/20 08:05:26 INFO Received uploads request method=POST path=/api/pending_closures4765worker2 # [ 50.489841] nix-grpc-daemon[857]: time=2026-09-20T08:05:26.485Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4766worker2 # [ 50.491750] nix-grpc-daemon[857]: time=2026-09-20T08:05:26.487Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4767lb # [ 50.508098] niks3-server[1005]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4768lb # [ 50.513814] niks3-server[1005]: 2026/09/20 08:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4769lb # [ 50.516260] niks3-server[1005]: 2026/09/20 08:05:26 INFO Signed narinfos id=13 count=14770worker2 # [ 50.515150] nix-grpc-daemon[857]: time=2026-09-20T08:05:26.510Z level=INFO msg="Uploading 1 narinfos"4771lb # [ 50.522343] niks3-server[1005]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4772lb # [ 50.527989] niks3-server[1005]: 2026/09/20 08:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4773lb # [ 50.531439] niks3-server[1005]: 2026/09/20 08:05:26 INFO Completed upload id=134774worker2 # [ 50.530132] nix-grpc-daemon[857]: time=2026-09-20T08:05:26.525Z level=INFO msg="Upload complete. (376ms)"4775lb # [ 50.534692] niks3-server[1005]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4776worker2 # [ 50.532476] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_in=7524777worker2 # [ 50.536513] nix-grpc-daemon[772]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084778worker2 # [ 50.543811] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4779worker2 # [ 50.546671] nix-daemon[844]: reaped child process 1108, status = succeeded4780worker2 # [ 50.552290] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4781worker2 # [ 51.385612] nix-daemon[844]: reaped child process 1122, status = succeeded4782worker2 # [ 51.511797] nix-daemon[844]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4783worker2 # [ 51.525903] nix-daemon[844]: reaped child process 1140, status = succeeded4784lb # [ 51.539106] niks3-server[1005]: 2026/09/20 08:05:27 INFO Received uploads request method=POST path=/api/pending_closures4785worker2 # [ 51.543345] nix-grpc-daemon[857]: time=2026-09-20T08:05:27.538Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4786worker2 # [ 51.546100] nix-grpc-daemon[857]: time=2026-09-20T08:05:27.540Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4787lb # [ 51.562356] niks3-server[1005]: 2026/09/20 08:05:27 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4788lb # [ 51.570612] niks3-server[1005]: 2026/09/20 08:05:27 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4789lb # [ 51.573782] niks3-server[1005]: 2026/09/20 08:05:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4790lb # [ 51.577937] niks3-server[1005]: 2026/09/20 08:05:27 INFO Signed narinfos id=14 count=14791worker2 # [ 51.575269] nix-grpc-daemon[857]: time=2026-09-20T08:05:27.570Z level=INFO msg="Uploading 1 narinfos"4792lb # [ 51.582181] niks3-server[1005]: 2026/09/20 08:05:27 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4793lb # [ 51.588760] niks3-server[1005]: 2026/09/20 08:05:27 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4794worker2 # [ 51.591136] nix-grpc-daemon[857]: time=2026-09-20T08:05:27.586Z level=INFO msg="Upload complete. (230ms)"4795lb # [ 51.594436] niks3-server[1005]: 2026/09/20 08:05:27 INFO Completed upload id=144796lb # [ 51.597165] niks3-server[1005]: 2026/09/20 08:05:27 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4797worker2 # [ 51.595142] nix-grpc-daemon[772]: ts=2026-09-20T08:05:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14798worker2 # [ 51.601980] nix-daemon[844]: reaped child process 1120, status = succeeded4799worker1 # [ 51.595497] nix-grpc-daemon[787]: ts=2026-09-20T08:05:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554764800worker1 # [ 51.605982] nix-grpc-daemon[787]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4801worker2 # [ 51.642281] nix-grpc-daemon[772]: ts=2026-09-20T08:05:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:535084802worker2 # [ 51.647343] nix-grpc-daemon[772]: ts=2026-09-20T08:05:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_out=2324803client # [ 51.708758] nix-daemon[924]: reaped child process 926, status = succeeded4804client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.56 seconds)4805client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4806client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4807client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4808client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4809client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4810client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4811(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.64 seconds)4812subtest: an input only one worker has still reaches the builder4813client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4814client # this derivation will be built:4815client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4816client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4817client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.36 seconds)4818client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4819client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4820worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4821worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)4822worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4823worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4824client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24825client # [ 52.700047] nix-daemon[924]: accepted connection from pid 1004, user root (trusted)4826client # this derivation will be built:4827client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4828worker1 # [ 52.863448] nix-grpc-daemon[787]: ts=2026-09-20T08:05:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:554764829client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4830worker2 # [ 52.876561] nix-grpc-daemon[772]: ts=2026-09-20T08:05:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084831client # copying 1 paths...4832client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4833worker2 # [ 52.889110] nix-grpc-daemon[772]: ts=2026-09-20T08:05:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084834worker2 # [ 52.899249] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4835worker2 # [ 53.049576] nix-daemon[844]: accepted connection from pid 1147, user nix-grpc-daemon (trusted)4836worker2 # [ 53.063773] nix-daemon[844]: reaped child process 1150, status = succeeded4837lb # [ 53.076680] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received uploads request method=POST path=/api/pending_closures4838worker2 # [ 53.082207] nix-grpc-daemon[857]: time=2026-09-20T08:05:29.077Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4839worker2 # [ 53.083736] nix-grpc-daemon[857]: time=2026-09-20T08:05:29.079Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4840lb # [ 53.115209] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4841lb # [ 53.126133] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4842lb # [ 53.133258] niks3-server[1005]: 2026/09/20 08:05:29 INFO Signed narinfos id=15 count=14843worker2 # [ 53.133176] nix-grpc-daemon[857]: time=2026-09-20T08:05:29.128Z level=INFO msg="Uploading 1 narinfos"4844lb # [ 53.136489] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4845lb # [ 53.148363] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4846lb # [ 53.154305] niks3-server[1005]: 2026/09/20 08:05:29 INFO Completed upload id=154847worker2 # [ 53.151637] nix-grpc-daemon[857]: time=2026-09-20T08:05:29.146Z level=INFO msg="Upload complete. (244ms)"4848lb # [ 53.156959] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4849worker2 # [ 53.156370] nix-grpc-daemon[772]: ts=2026-09-20T08:05:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_in=1204850worker2 # [ 53.166816] nix-grpc-daemon[772]: ts=2026-09-20T08:05:29Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04851worker2 # [ 53.170681] nix-grpc-daemon[772]: ts=2026-09-20T08:05:29Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14852worker2 # [ 53.179531] nix-daemon[844]: reaped child process 1145, status = succeeded4853worker1 # [ 53.203303] nix-grpc-daemon[787]: ts=2026-09-20T08:05:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554764854worker1 # [ 53.213075] nix-grpc-daemon[787]: ts=2026-09-20T08:05:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554764855client # copying 2 paths to 'lb:50051'...4856client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4857client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4858worker1 # [ 53.222525] nix-grpc-daemon[787]: ts=2026-09-20T08:05:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:554764859worker1 # [ 53.234740] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4860worker1 # [ 53.387385] nix-daemon[844]: accepted connection from pid 955, user nix-grpc-daemon (trusted)4861worker1 # [ 53.404857] nix-daemon[844]: reaped child process 958, status = succeeded4862worker1 # [ 53.561277] nix-daemon[844]: accepted connection from pid 960, user nix-grpc-daemon (trusted)4863worker1 # [ 53.578828] nix-daemon[844]: reaped child process 963, status = succeeded4864lb # [ 53.598068] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received uploads request method=POST path=/api/pending_closures4865lb # [ 53.603572] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received uploads request method=POST path=/api/pending_closures4866worker1 # [ 53.597648] nix-grpc-daemon[869]: time=2026-09-20T08:05:29.625Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4867worker1 # [ 53.600291] nix-grpc-daemon[869]: time=2026-09-20T08:05:29.627Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4868worker1 # [ 53.601965] nix-grpc-daemon[869]: time=2026-09-20T08:05:29.627Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4869lb # [ 53.632416] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4870lb # [ 53.638357] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4871lb # [ 53.650695] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4872lb # [ 53.653441] niks3-server[1005]: 2026/09/20 08:05:29 INFO Signed narinfos id=17 count=24873lb # [ 53.654891] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4874lb # [ 53.658659] niks3-server[1005]: 2026/09/20 08:05:29 INFO Signed narinfos id=16 count=14875worker1 # [ 53.648277] nix-grpc-daemon[869]: time=2026-09-20T08:05:29.676Z level=INFO msg="Uploading 3 narinfos"4876lb # [ 53.661880] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4877lb # [ 53.664629] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4878lb # [ 53.679063] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4879lb # [ 53.681725] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4880lb # [ 53.684729] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4881lb # [ 53.686550] niks3-server[1005]: 2026/09/20 08:05:29 INFO Completed upload id=164882lb # [ 53.688746] niks3-server[1005]: 2026/09/20 08:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4883lb # [ 53.691391] niks3-server[1005]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4884lb # [ 53.693736] niks3-server[1005]: 2026/09/20 08:05:29 INFO Completed upload id=174885worker1 # [ 53.683617] nix-grpc-daemon[869]: time=2026-09-20T08:05:29.711Z level=INFO msg="Upload complete. (436ms)"4886worker1 # [ 53.686433] nix-grpc-daemon[787]: ts=2026-09-20T08:05:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=0 paths=2 nar_bytes_in=9764887worker1 # [ 53.689903] nix-grpc-daemon[787]: ts=2026-09-20T08:05:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554764888worker1 # [ 53.695646] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4889worker1 # [ 53.702159] nix-daemon[844]: reaped child process 953, status = succeeded4890client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4891worker1 # [ 53.709657] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4892client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4893worker1 # [ 54.944871] nix-daemon[844]: reaped child process 967, status = succeeded4894worker1 # [ 55.079921] nix-daemon[844]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4895worker1 # [ 55.097898] nix-daemon[844]: reaped child process 985, status = succeeded4896lb # [ 55.116105] niks3-server[1005]: 2026/09/20 08:05:31 INFO Received uploads request method=POST path=/api/pending_closures4897worker1 # [ 55.110272] nix-grpc-daemon[869]: time=2026-09-20T08:05:31.138Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4898lb # [ 55.132594] niks3-server[1005]: 2026/09/20 08:05:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4899lb # [ 55.135398] niks3-server[1005]: 2026/09/20 08:05:31 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4900lb # [ 55.137602] niks3-server[1005]: 2026/09/20 08:05:31 INFO Signed narinfos id=18 count=14901worker1 # [ 55.127590] nix-grpc-daemon[869]: time=2026-09-20T08:05:31.155Z level=INFO msg="Uploading 1 narinfos"4902lb # [ 55.140514] niks3-server[1005]: 2026/09/20 08:05:31 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4903lb # [ 55.145056] niks3-server[1005]: 2026/09/20 08:05:31 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4904lb # [ 55.148660] niks3-server[1005]: 2026/09/20 08:05:31 INFO Completed upload id=184905worker1 # [ 55.138437] nix-grpc-daemon[869]: time=2026-09-20T08:05:31.166Z level=INFO msg="Upload complete. (216ms)"4906lb # [ 55.150902] niks3-server[1005]: 2026/09/20 08:05:31 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4907worker1 # [ 55.141611] nix-grpc-daemon[787]: ts=2026-09-20T08:05:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14908worker1 # [ 55.149856] nix-daemon[844]: reaped child process 965, status = succeeded4909client # copying 1 paths...4910worker1 # [ 55.187553] nix-grpc-daemon[787]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554764911client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4912worker1 # [ 55.201757] nix-grpc-daemon[787]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:554764913worker1 # [ 55.205664] nix-grpc-daemon[787]: ts=2026-09-20T08:05:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=0 paths=1 nar_bytes_out=1204914client # [ 55.305181] nix-daemon[924]: reaped child process 1007, status = succeeded4915client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.76 seconds)4916client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24917client # [ 55.492665] nix-daemon[924]: accepted connection from pid 1025, user root (trusted)4918client # this derivation will be built:4919client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4920worker2 # [ 55.787563] nix-grpc-daemon[772]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:535084921client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4922worker1 # [ 55.783714] nix-grpc-daemon[787]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554764923worker1 # [ 55.793678] nix-grpc-daemon[869]: time=2026-09-20T08:05:31.822Z level=INFO msg="All 1 paths already cached"4924worker2 # [ 55.813039] nix-grpc-daemon[772]: ts=2026-09-20T08:05:31Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04925worker2 # [ 55.815603] nix-grpc-daemon[772]: ts=2026-09-20T08:05:31Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14926worker2 # [ 55.818219] nix-grpc-daemon[772]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084927worker2 # [ 55.826476] nix-grpc-daemon[772]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084928client # copying 1 paths to 'lb:50051'...4929client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4930worker2 # [ 55.842659] nix-grpc-daemon[772]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:535084931worker2 # [ 55.854321] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4932worker2 # [ 55.870376] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5)4933worker2 # [ 55.947459] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5)4934worker2 # [ 56.018290] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 3/5)4935worker2 # [ 56.323882] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 320 ms (attempt 4/5)4936worker2 # [ 56.650316] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4937worker2 # [ 56.652695] nix-grpc-daemon[772]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4938worker2 # [ 56.833795] nix-daemon[844]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)4939worker2 # [ 56.849818] nix-daemon[844]: reaped child process 1165, status = succeeded4940worker2 # [ 56.995680] nix-daemon[844]: accepted connection from pid 1167, user nix-grpc-daemon (trusted)4941worker2 # [ 57.011640] nix-daemon[844]: reaped child process 1170, status = succeeded4942lb # [ 57.023454] niks3-server[1005]: 2026/09/20 08:05:32 INFO Received uploads request method=POST path=/api/pending_closures4943worker2 # [ 57.050449] nix-grpc-daemon[857]: time=2026-09-20T08:05:33.045Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4944worker2 # [ 57.051982] nix-grpc-daemon[857]: time=2026-09-20T08:05:33.045Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4945lb # [ 57.064200] niks3-server[1005]: 2026/09/20 08:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4946lb # [ 57.067879] niks3-server[1005]: 2026/09/20 08:05:32 INFO Signed narinfos id=19 count=14947worker2 # [ 57.065542] nix-grpc-daemon[857]: time=2026-09-20T08:05:33.060Z level=INFO msg="Uploading 1 narinfos"4948lb # [ 57.074321] niks3-server[1005]: 2026/09/20 08:05:33 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4949lb # [ 57.076770] niks3-server[1005]: 2026/09/20 08:05:33 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4950lb # [ 57.084894] niks3-server[1005]: 2026/09/20 08:05:33 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4951lb # [ 57.090028] niks3-server[1005]: 2026/09/20 08:05:33 INFO Completed upload id=194952worker2 # [ 57.087128] nix-grpc-daemon[857]: time=2026-09-20T08:05:33.082Z level=INFO msg="Upload complete. (420ms)"4953lb # [ 57.093926] niks3-server[1005]: 2026/09/20 08:05:33 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4954worker2 # [ 57.089983] nix-grpc-daemon[772]: ts=2026-09-20T08:05:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 paths=1 nar_bytes_in=5604955worker2 # [ 57.093848] nix-grpc-daemon[772]: ts=2026-09-20T08:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:535084956worker2 # [ 57.099208] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4957worker2 # [ 57.105629] nix-daemon[844]: reaped child process 1156, status = succeeded4958client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4959worker2 # [ 57.113695] nix-daemon[844]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4960client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4961lb # [ 57.634274] envoy[913]: conn peer=[2001:db8:1::1]:37390 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=144962lb # [ 57.635993] envoy[913]: conn peer=[2001:db8:1::1]:37382 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1993 ms=21194963lb # [ 57.637673] envoy[913]: conn peer=[2001:db8:1::1]:37404 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2221 ms=15544964lb # [ 57.639157] envoy[913]: conn peer=[2001:db8:1::1]:37412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=411 tx=410 ms=184965lb # [ 57.640632] envoy[913]: conn peer=[2001:db8:1::1]:52502 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4205 tx=1750 ms=23944966lb # [ 57.642112] envoy[913]: conn peer=[2001:db8:1::1]:52518 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=544967worker2 # [ 58.145831] nix-daemon[844]: reaped child process 1174, status = succeeded4968worker2 # [ 58.297658] nix-daemon[844]: accepted connection from pid 1189, user nix-grpc-daemon (trusted)4969worker2 # [ 58.310722] nix-daemon[844]: reaped child process 1192, status = succeeded4970lb # [ 58.324374] niks3-server[1005]: 2026/09/20 08:05:34 INFO Received uploads request method=POST path=/api/pending_closures4971worker2 # [ 58.326261] nix-grpc-daemon[857]: time=2026-09-20T08:05:34.321Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4972lb # [ 58.342252] niks3-server[1005]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4973lb # [ 58.347377] niks3-server[1005]: 2026/09/20 08:05:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4974lb # [ 58.350246] niks3-server[1005]: 2026/09/20 08:05:34 INFO Signed narinfos id=20 count=14975worker2 # [ 58.347310] nix-grpc-daemon[857]: time=2026-09-20T08:05:34.342Z level=INFO msg="Uploading 1 narinfos"4976lb # [ 58.353565] niks3-server[1005]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4977lb # [ 58.361549] niks3-server[1005]: 2026/09/20 08:05:34 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4978lb # [ 58.364633] niks3-server[1005]: 2026/09/20 08:05:34 INFO Completed upload id=204979worker2 # [ 58.361635] nix-grpc-daemon[857]: time=2026-09-20T08:05:34.357Z level=INFO msg="Upload complete. (239ms)"4980lb # [ 58.366652] niks3-server[1005]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4981worker2 # [ 58.365360] nix-grpc-daemon[772]: ts=2026-09-20T08:05:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=14982worker2 # [ 58.372671] nix-daemon[844]: reaped child process 1172, status = succeeded4983client # copying 1 paths...4984client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4985worker2 # [ 58.411238] nix-grpc-daemon[772]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:535084986worker1 # [ 58.419891] nix-grpc-daemon[787]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:554764987worker1 # [ 58.429696] nix-grpc-daemon[787]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...4988worker1 # [ 58.440800] nix-grpc-daemon[787]: ts=2026-09-20T08:05:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=0 paths=1 nar_bytes_out=1204989client # [ 58.537722] nix-daemon[924]: reaped child process 1028, status = succeeded4990client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.23 seconds)4991client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24992client # [ 58.739115] nix-daemon[924]: accepted connection from pid 1046, user root (trusted)4993client # this derivation will be built:4994client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4995worker2 # [ 58.924241] nix-grpc-daemon[772]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:535084996worker2 # [ 58.929199] nix-grpc-daemon[772]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:535084997client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4998worker2 # [ 58.934719] nix-grpc-daemon[857]: time=2026-09-20T08:05:34.930Z level=INFO msg="All 1 paths already cached"4999worker2 # [ 58.946543] nix-grpc-daemon[772]: ts=2026-09-20T08:05:34Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05000worker2 # [ 58.948846] nix-grpc-daemon[772]: ts=2026-09-20T08:05:34Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15001worker1 # [ 58.946985] nix-grpc-daemon[787]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554765002worker1 # [ 58.956636] nix-grpc-daemon[787]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554765003worker1 # [ 58.966593] nix-grpc-daemon[869]: time=2026-09-20T08:05:34.994Z level=INFO msg="All 1 paths already cached"5004client # copying 1 paths to 'lb:50051'...5005client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5006worker1 # [ 58.973953] nix-grpc-daemon[787]: ts=2026-09-20T08:05:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:554765007worker1 # [ 58.983262] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5008worker1 # [ 59.148564] nix-daemon[844]: accepted connection from pid 990, user nix-grpc-daemon (trusted)5009worker1 # [ 59.166339] nix-daemon[844]: reaped child process 993, status = succeeded5010worker1 # [ 59.332277] nix-daemon[844]: accepted connection from pid 995, user nix-grpc-daemon (trusted)5011worker1 # [ 59.350590] nix-daemon[844]: reaped child process 998, status = succeeded5012lb # [ 59.373395] niks3-server[1005]: 2026/09/20 08:05:35 INFO Received uploads request method=POST path=/api/pending_closures5013worker1 # [ 59.377611] nix-grpc-daemon[869]: time=2026-09-20T08:05:35.405Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5014worker1 # [ 59.379238] nix-grpc-daemon[869]: time=2026-09-20T08:05:35.407Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5015lb # [ 59.411698] niks3-server[1005]: 2026/09/20 08:05:35 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5016lb # [ 59.419968] niks3-server[1005]: 2026/09/20 08:05:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5017lb # [ 59.427315] niks3-server[1005]: 2026/09/20 08:05:35 INFO Signed narinfos id=21 count=15018worker1 # [ 59.420112] nix-grpc-daemon[869]: time=2026-09-20T08:05:35.448Z level=INFO msg="Uploading 1 narinfos"5019lb # [ 59.431796] niks3-server[1005]: 2026/09/20 08:05:35 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5020lb # [ 59.440830] niks3-server[1005]: 2026/09/20 08:05:35 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5021worker1 # [ 59.439730] nix-grpc-daemon[869]: time=2026-09-20T08:05:35.468Z level=INFO msg="Upload complete. (448ms)"5022lb # [ 59.449931] niks3-server[1005]: 2026/09/20 08:05:35 INFO Completed upload id=215023lb # [ 59.453873] niks3-server[1005]: 2026/09/20 08:05:35 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5024worker1 # [ 59.443492] nix-grpc-daemon[787]: ts=2026-09-20T08:05:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=0 paths=1 nar_bytes_in=5605025worker1 # [ 59.449569] nix-grpc-daemon[787]: ts=2026-09-20T08:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554765026worker1 # [ 59.460080] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5027worker1 # [ 59.466298] nix-daemon[844]: reaped child process 988, status = succeeded5028worker1 # [ 59.472222] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5029client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5030client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5031worker1 # [ 60.689356] nix-daemon[844]: reaped child process 1002, status = succeeded5032worker1 # [ 60.813185] nix-daemon[844]: accepted connection from pid 1017, user nix-grpc-daemon (trusted)5033worker1 # [ 60.826816] nix-daemon[844]: reaped child process 1020, status = succeeded5034lb # [ 60.846365] niks3-server[1005]: 2026/09/20 08:05:36 INFO Received uploads request method=POST path=/api/pending_closures5035worker1 # [ 60.840562] nix-grpc-daemon[869]: time=2026-09-20T08:05:36.868Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5036lb # [ 60.871435] niks3-server[1005]: 2026/09/20 08:05:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5037worker1 # [ 60.868493] nix-grpc-daemon[869]: time=2026-09-20T08:05:36.896Z level=INFO msg="Uploading 1 narinfos"5038lb # [ 60.878296] niks3-server[1005]: 2026/09/20 08:05:36 INFO Signed narinfos id=22 count=15039lb # [ 60.886561] niks3-server[1005]: 2026/09/20 08:05:36 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5040lb # [ 60.894436] niks3-server[1005]: 2026/09/20 08:05:36 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5041lb # [ 60.903252] niks3-server[1005]: 2026/09/20 08:05:36 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5042worker1 # [ 60.898728] nix-grpc-daemon[869]: time=2026-09-20T08:05:36.927Z level=INFO msg="Upload complete. (218ms)"5043lb # [ 60.909623] niks3-server[1005]: 2026/09/20 08:05:36 INFO Completed upload id=225044worker1 # [ 60.901359] nix-grpc-daemon[787]: ts=2026-09-20T08:05:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55476 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15045lb # [ 60.913440] niks3-server[1005]: 2026/09/20 08:05:36 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5046worker1 # [ 60.908523] nix-daemon[844]: reaped child process 1000, status = succeeded5047client # copying 1 paths...5048worker1 # [ 60.947111] nix-grpc-daemon[787]: ts=2026-09-20T08:05:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554765049client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5050worker2 # [ 60.973270] nix-grpc-daemon[772]: ts=2026-09-20T08:05:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:535085051worker2 # [ 60.981144] nix-grpc-daemon[772]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5052worker2 # [ 60.989288] nix-grpc-daemon[772]: ts=2026-09-20T08:05:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53508 duration_s=0 paths=1 nar_bytes_out=1205053client # [ 61.071529] nix-daemon[924]: reaped child process 1049, status = succeeded5054client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.53 seconds)5055(finished: subtest: an input only one worker has still reaches the builder, in 9.28 seconds)5056subtest: upload whose reference the worker lacks is completed from the cache5057client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5058client # this derivation will be built:5059client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5060client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5061client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.69 seconds)5062client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5063client # this derivation will be built:5064client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5065client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5066client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.38 seconds)5067client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5068client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.15 seconds)5069worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5070worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds)5071worker2 # [ 62.527949] systemd[1]: Stopping Nix worker-protocol over gRPC...5072worker2 # [ 62.917791] nix-grpc-daemon[772]: ts=2026-09-20T08:05:38Z level=info event=signal_exit5073worker2 # [ 63.165877] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_yield5074worker1 # [ 63.160741] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=info event=scheduler_restarting addr=lb:500515075lb # [ 63.172526] niks3-server[1005]: 2026/09/20 08:05:39 INFO lead: released remote=192.168.1.4:548965076worker2 # [ 63.169558] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:508685077worker2 # [ 63.171869] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=worker_gone addr=192.168.1.3:500515078worker2 # [ 63.173114] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:508685079worker2 # [ 63.174477] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=worker_gone addr=192.168.1.4:500515080worker2 # [ 63.175708] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_restarting addr=lb:500515081worker1 # [ 63.360872] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=info event=scheduler_connected addr=lb:500515082worker1 # [ 63.363771] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5083worker2 # [ 63.372821] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_connected addr=lb:500515084worker2 # [ 63.378063] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5085worker1 # [ 63.564920] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=info event=scheduler_connected addr=lb:500515086worker2 # [ 63.579045] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_connected addr=lb:500515087worker1 # [ 63.569810] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5088worker2 # [ 63.582574] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5089worker1 # [ 63.770889] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=info event=scheduler_connected addr=lb:500515090worker2 # [ 63.783388] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_connected addr=lb:500515091worker1 # [ 63.775831] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5092worker2 # [ 63.786557] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5093worker1 # [ 63.976690] nix-grpc-daemon[787]: ts=2026-09-20T08:05:40Z level=info event=scheduler_connected addr=lb:500515094worker2 # [ 63.988367] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_connected addr=lb:500515095worker2 # [ 63.989888] nix-grpc-daemon[772]: ts=2026-09-20T08:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5096worker1 # [ 63.981638] nix-grpc-daemon[787]: ts=2026-09-20T08:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5097worker2 # [ 64.166613] nix-grpc-daemon[772]: ts=2026-09-20T08:05:40Z level=info event=scheduler_restarting5098worker2 # [ 64.184147] nix-daemon[844]: reaped child process 847, status = succeeded5099worker1 # [ 64.182479] nix-grpc-daemon[787]: ts=2026-09-20T08:05:40Z level=info event=scheduler_connected addr=lb:500515100worker1 # [ 64.185560] nix-grpc-daemon[787]: ts=2026-09-20T08:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5101worker2 # [ 64.196618] nix-grpc-daemon[772]: ts=2026-09-20T08:05:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5102worker1 # [ 64.386383] nix-grpc-daemon[787]: ts=2026-09-20T08:05:40Z level=info event=scheduler_connected addr=lb:500515103worker2 # [ 64.396269] nix-grpc-daemon[772]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5104worker2 # [ 64.397710] nix-grpc-daemon[772]: E0000 00:00:1789891540.391161 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5105worker2 # [ 65.046202] nix-grpc-daemon[772]: E0000 00:00:1789891541.040953 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5106worker2 # [ 65.048287] nix-grpc-daemon[772]: E0000 00:00:1789891541.041102 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5107lb # [ 65.115162] niks3-server[1005]: 2026/09/20 08:05:41 INFO lead: acquired remote=192.168.1.3:473825108worker1 # [ 65.107646] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=info event=scheduler_take_over5109worker1 # [ 65.200108] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5110worker2 # [ 65.223407] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5111worker2 # [ 65.226605] systemd[1]: Stopped Nix worker-protocol over gRPC.5112worker2 # [ 65.231336] systemd[1]: nix-grpc-daemon.service: Consumed 2.399s CPU time over 47.596s wall clock time, 58.2M memory peak, 80.9K incoming IP traffic, 157.1K outgoing IP traffic.5113worker2 # [ 65.242866] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5114worker2 # [ 65.246511] systemd[1]: Closed Nix worker-protocol over gRPC.5115worker2 # [ 65.249534] systemd[1]: nix-grpc-daemon.socket: Consumed 312us CPU time over 54.814s wall clock time, 256K memory peak, 101.6K incoming IP traffic, 78.5K outgoing IP traffic.5116lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5117lb: must succeed: curl -sf localhost:9901/clusters5118lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5119lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5120client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25121worker1 # [ 65.401527] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=info event=scheduler_connected addr=lb:500515122worker1 # [ 65.406983] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05123worker1 # [ 65.532431] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:554765124worker1 # [ 65.538419] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554765125client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5126client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5127worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5128worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5129worker2 # [ 65.647711] systemd[1]: Listening on Nix worker-protocol over gRPC.5130worker1 # [ 65.695800] systemd[1]: Stopping Nix worker-protocol over gRPC...5131worker1 # [ 65.893564] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=info event=signal_exit5132worker1 # [ 66.146607] nix-grpc-daemon[787]: ts=2026-09-20T08:05:42Z level=info event=scheduler_yield5133worker1 # [ 66.149879] nix-grpc-daemon[787]: ts=2026-09-20T08:05:42Z level=info event=scheduler_restarting addr=lb:500515134lb # [ 66.159906] niks3-server[1005]: 2026/09/20 08:05:42 INFO lead: released remote=192.168.1.3:473825135worker1 # [ 66.152354] nix-grpc-daemon[787]: ts=2026-09-20T08:05:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:554665136worker1 # [ 66.153825] nix-grpc-daemon[787]: ts=2026-09-20T08:05:42Z level=info event=worker_gone addr=192.168.1.3:500515137worker2 # [ 66.209415] systemd[1]: Starting Nix worker-protocol over gRPC...5138worker2 # [ 66.353933] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5139worker1 # [ 66.351441] nix-grpc-daemon[787]: ts=2026-09-20T08:05:42Z level=info event=scheduler_connected addr=lb:500515140worker2 # [ 66.358142] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15141worker2 # [ 66.365920] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5142worker2 # [ 66.369380] systemd[1]: Started Nix worker-protocol over gRPC.5143worker2 # [ 66.378299] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:42Z level=info event=scheduler_take_over5144lb # [ 66.381253] niks3-server[1005]: 2026/09/20 08:05:42 INFO lead: acquired remote=192.168.1.4:606165145worker2 # [ 66.383104] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05146worker2 # [ 66.388609] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:42Z level=info event=scheduler_connected addr=lb:500515147worker2 # [ 66.390269] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05148worker1 # [ 67.147415] nix-grpc-daemon[787]: ts=2026-09-20T08:05:43Z level=info event=scheduler_restarting5149worker2 # [ 67.164299] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:341645150worker2 # [ 67.167864] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:43Z level=info event=worker_gone addr=192.168.1.3:500515151worker1 # [ 67.168753] nix-grpc-daemon[787]: ts=2026-09-20T08:05:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5152worker1 # [ 67.190881] nix-daemon[844]: reaped child process 846, status = succeeded5153lb # [ 67.634934] envoy[913]: conn peer=[2001:db8:1::1]:52520 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1803 ms=27135154lb # [ 67.636612] envoy[913]: conn peer=[2001:db8:1::1]:52522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=765155lb # [ 67.638173] envoy[913]: conn peer=[2001:db8:1::1]:52524 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1802 ms=21185156lb # [ 67.639606] envoy[913]: conn peer=[2001:db8:1::1]:52532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=675157lb # [ 67.640995] envoy[913]: conn peer=192.168.1.4:38606 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8318 tx=1902 ms=451725158lb # [ 67.642409] envoy[913]: conn peer=[2001:db8:1::1]:37738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=175159lb # [ 67.643835] envoy[913]: conn peer=192.168.1.3:59236 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9010 tx=1886 ms=483785160worker1 # [ 68.016652] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5161worker1 # [ 68.018301] nix-grpc-daemon[787]: E0000 00:00:1789891544.043788 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5162worker1 # [ 68.020335] nix-grpc-daemon[787]: E0000 00:00:1789891544.044537 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5163worker1 # [ 69.154848] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5164worker1 # [ 69.156938] systemd[1]: Stopped Nix worker-protocol over gRPC.5165worker1 # [ 69.158940] systemd[1]: nix-grpc-daemon.service: Consumed 1.389s CPU time over 51.541s wall clock time, 47.3M memory peak, 44K incoming IP traffic, 79.7K outgoing IP traffic.5166worker1 # [ 69.163214] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5167worker1 # [ 69.165071] systemd[1]: Closed Nix worker-protocol over gRPC.5168worker1 # [ 69.166499] systemd[1]: nix-grpc-daemon.socket: Consumed 296us CPU time over 58.753s wall clock time, 256K memory peak, 74.6K incoming IP traffic, 64.8K outgoing IP traffic.5169lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5170lb: must succeed: curl -sf localhost:9901/clusters5171lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5172lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5173client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25174worker2 # [ 69.423589] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341665175worker2 # [ 69.432286] nix-daemon[844]: accepted connection from pid 1216, user nix-grpc-daemon (trusted)5176worker2 # [ 69.442802] nix-grpc-daemon[1216]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5)5177worker2 # [ 69.505815] nix-grpc-daemon[1216]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5)5178worker2 # [ 69.556584] nix-grpc-daemon[1216]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 157 ms (attempt 3/5)5179worker2 # [ 69.714120] nix-grpc-daemon[1216]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 738 ms (attempt 4/5)5180worker2 # [ 70.458888] nix-grpc-daemon[1216]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5181client # copying 2 paths...5182worker2 # [ 70.472532] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:341665183client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5184client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5185worker2 # [ 70.484041] nix-daemon[844]: accepted connection from pid 1216, user nix-grpc-daemon (trusted)5186worker2 # [ 70.495101] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:46Z level=info event=niks3_push_started pid=12725187worker2 # [ 70.758630] nix-daemon[844]: accepted connection from pid 1285, user nix-grpc-daemon (trusted)5188worker2 # [ 70.773056] nix-daemon[844]: reaped child process 1288, status = succeeded5189lb # [ 70.789990] niks3-server[1005]: 2026/09/20 08:05:46 INFO Received uploads request method=POST path=/api/pending_closures5190lb # [ 70.800791] niks3-server[1005]: 2026/09/20 08:05:46 INFO Received uploads request method=POST path=/api/pending_closures5191worker2 # [ 70.809235] nix-grpc-daemon[1272]: time=2026-09-20T08:05:46.801Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5192worker2 # [ 70.810840] nix-grpc-daemon[1272]: time=2026-09-20T08:05:46.801Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5193worker2 # [ 70.812744] nix-grpc-daemon[1272]: time=2026-09-20T08:05:46.801Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5194lb # [ 70.855658] niks3-server[1005]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5195lb # [ 70.868689] niks3-server[1005]: 2026/09/20 08:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5196lb # [ 70.871219] niks3-server[1005]: 2026/09/20 08:05:46 INFO Signed narinfos id=24 count=25197lb # [ 70.875578] niks3-server[1005]: 2026/09/20 08:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5198lb # [ 70.880624] niks3-server[1005]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5199lb # [ 70.885356] niks3-server[1005]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5200lb # [ 70.889573] niks3-server[1005]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5201lb # [ 70.892072] niks3-server[1005]: 2026/09/20 08:05:46 INFO Signed narinfos id=23 count=15202worker2 # [ 70.890175] nix-grpc-daemon[1272]: time=2026-09-20T08:05:46.884Z level=INFO msg="Uploading 3 narinfos"5203lb # [ 70.917403] niks3-server[1005]: 2026/09/20 08:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5204lb # [ 70.924169] niks3-server[1005]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5205lb # [ 70.926451] niks3-server[1005]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5206lb # [ 70.929790] niks3-server[1005]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5207lb # [ 70.932674] niks3-server[1005]: 2026/09/20 08:05:46 INFO Completed upload id=235208lb # [ 70.934386] niks3-server[1005]: 2026/09/20 08:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5209lb # [ 70.937560] niks3-server[1005]: 2026/09/20 08:05:46 INFO Completed upload id=245210worker2 # [ 70.934922] nix-grpc-daemon[1272]: time=2026-09-20T08:05:46.930Z level=INFO msg="Upload complete. (292ms)"5211worker2 # [ 70.938941] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34166 duration_s=0 paths=2 nar_bytes_in=3125212worker2 # [ 70.949828] nix-daemon[844]: reaped child process 1270, status = succeeded5213client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.73 seconds)5214worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5215worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5216worker1 # [ 71.029464] systemd[1]: Listening on Nix worker-protocol over gRPC.5217worker1 # [ 71.033620] systemd[1]: Starting Nix worker-protocol over gRPC...5218worker1 # [ 71.185038] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5219worker1 # [ 71.189462] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15220worker1 # [ 71.196967] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5221worker1 # [ 71.205211] systemd[1]: Started Nix worker-protocol over gRPC.5222lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5223lb: must succeed: curl -sf localhost:9901/clusters5224worker1 # [ 71.233177] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:47Z level=info event=scheduler_connected addr=lb:500515225worker2 # [ 71.242664] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05226lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5227lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5228(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.20 seconds)5229subtest: scheduler down: the other node takes the lock and keeps it5230lb: must succeed: curl -sf localhost:9901/clusters5231lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5232lb: must succeed: curl -sf localhost:9901/clusters5233lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5234lb: must succeed: curl -sf localhost:9901/clusters5235lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5236lb: must succeed: curl -sf localhost:9901/clusters5237lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5238worker2 # [ 71.537832] systemd[1]: Stopping Nix worker-protocol over gRPC...5239worker2 # [ 72.371487] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=signal_exit5240worker2 # [ 72.582345] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=scheduler_yield5241lb # [ 72.589459] niks3-server[1005]: 2026/09/20 08:05:48 INFO lead: released remote=192.168.1.4:606165242worker2 # [ 72.588628] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:341645243worker1 # [ 72.580781] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:48Z level=info event=scheduler_restarting addr=lb:500515244worker2 # [ 72.590250] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=worker_gone addr=192.168.1.3:500515245worker2 # [ 72.592189] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=scheduler_restarting addr=lb:500515246worker2 # [ 72.594190] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:341645247worker2 # [ 72.595673] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=worker_gone addr=192.168.1.4:500515248worker1 # [ 72.781584] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500515249worker2 # [ 72.792960] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500515250worker2 # [ 72.800253] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5251worker1 # [ 72.791805] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5252worker1 # [ 72.993105] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_connected addr=lb:500515253worker2 # [ 73.001240] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500515254worker2 # [ 73.004522] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5255worker1 # [ 72.997268] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5256worker1 # [ 73.198148] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_connected addr=lb:500515257worker2 # [ 73.205651] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:49Z level=info event=scheduler_connected addr=lb:500515258worker1 # [ 73.201587] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5259worker2 # [ 73.209075] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5260worker1 # [ 73.402735] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_connected addr=lb:500515261worker2 # [ 73.410680] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:49Z level=info event=scheduler_connected addr=lb:500515262worker1 # [ 73.408983] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5263worker2 # [ 73.416305] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5264worker2 # [ 73.584091] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:49Z level=info event=scheduler_restarting5265worker2 # [ 73.606722] nix-daemon[844]: reaped child process 1265, status = succeeded5266worker1 # [ 73.611877] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_connected addr=lb:500515267worker2 # [ 73.620885] nix-grpc-daemon[1216]: ts=2026-09-20T08:05:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5268worker1 # [ 73.613825] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5269worker1 # [ 73.813261] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:49Z level=info event=scheduler_connected addr=lb:500515270worker2 # [ 73.822523] nix-grpc-daemon[1216]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5271worker2 # [ 73.824547] nix-grpc-daemon[1216]: E0000 00:00:1789891549.817771 1259 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5272worker1 # [ 74.368389] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5273worker2 # [ 74.386417] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5274worker2 # [ 74.387986] systemd[1]: Stopped Nix worker-protocol over gRPC.5275worker2 # [ 74.390374] systemd[1]: nix-grpc-daemon.service: Consumed 322ms CPU time over 8.176s wall clock time, 30.3M memory peak, 17.4K incoming IP traffic, 22.3K outgoing IP traffic.5276worker2 # [ 74.396949] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5277worker2 # [ 74.399731] systemd[1]: Closed Nix worker-protocol over gRPC.5278worker2 # [ 74.401384] systemd[1]: nix-grpc-daemon.socket: Consumed 304us CPU time over 8.757s wall clock time, 256K memory peak, 27.9K incoming IP traffic, 23.6K outgoing IP traffic.5279worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5280worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds)5281worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5282worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5283worker1 # [ 74.569475] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:50Z level=info event=scheduler_connected addr=lb:500515284worker1 # [ 74.573328] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5285worker1 # [ 74.775780] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:50Z level=info event=scheduler_connected addr=lb:500515286worker1 # [ 74.779963] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5287worker1 # [ 74.980889] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_connected addr=lb:500515288worker1 # [ 74.984553] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5289worker1 # [ 75.185492] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_connected addr=lb:500515290worker1 # [ 75.187735] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5291worker1 # [ 75.388982] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_connected addr=lb:500515292worker1 # [ 75.394520] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5293worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5294worker1 # [ 75.600548] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_connected addr=lb:500515295worker1 # [ 75.604454] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5296worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5297worker1 # [ 75.805100] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_connected addr=lb:500515298worker1 # [ 75.807774] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5299worker1 # [ 76.008985] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=info event=scheduler_connected addr=lb:500515300worker1 # [ 76.011672] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5301worker1 # [ 76.212965] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=info event=scheduler_take_over5302lb # [ 76.223908] niks3-server[1005]: 2026/09/20 08:05:52 INFO lead: acquired remote=192.168.1.3:608465303worker1 # [ 76.214751] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=info event=scheduler_connected addr=lb:500515304worker1 # [ 76.217337] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05305worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5306worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5307client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25308worker1 # [ 76.874541] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574725309worker1 # [ 76.879802] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5310client # don't know how to build these paths:5311client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5312worker1 # [ 76.897516] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05313worker1 # [ 76.900356] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15314worker1 # [ 76.944445] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725315worker1 # [ 76.951557] nix-grpc-daemon[1043]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)5316worker1 # [ 77.038621] nix-grpc-daemon[1043]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 2/5)5317worker1 # [ 77.094960] nix-grpc-daemon[1043]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 3/5)5318worker1 # [ 77.240185] nix-grpc-daemon[1043]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 4/5)5319worker1 # [ 77.256411] nix-grpc-daemon[1043]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5320worker1 # [ 77.269566] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574725321client # copying 1 paths to 'lb:50051'...5322client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5323worker1 # [ 77.279032] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574725324worker1 # [ 77.284103] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5325worker1 # [ 77.302403] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:53Z level=info event=niks3_push_started pid=11225326worker1 # [ 77.611041] nix-daemon[844]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)5327worker1 # [ 77.624988] nix-daemon[844]: reaped child process 1138, status = succeeded5328lb # [ 77.635760] envoy[913]: conn peer=[2001:db8:1::1]:37750 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=282 ms=15255329lb # [ 77.641982] envoy[913]: conn peer=[2001:db8:1::4]:37196 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1323 tx=362 ms=72345330worker1 # [ 77.747030] nix-daemon[844]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)5331worker1 # [ 77.760393] nix-daemon[844]: reaped child process 1143, status = succeeded5332lb # [ 77.781101] niks3-server[1005]: 2026/09/20 08:05:53 INFO Received uploads request method=POST path=/api/pending_closures5333worker1 # [ 77.788744] nix-grpc-daemon[1122]: time=2026-09-20T08:05:53.816Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5334worker1 # [ 77.790684] nix-grpc-daemon[1122]: time=2026-09-20T08:05:53.818Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5335lb # [ 77.820525] niks3-server[1005]: 2026/09/20 08:05:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5336lb # [ 77.827241] niks3-server[1005]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5337lb # [ 77.834637] niks3-server[1005]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5338lb # [ 77.839366] niks3-server[1005]: 2026/09/20 08:05:53 INFO Signed narinfos id=25 count=15339worker1 # [ 77.829633] nix-grpc-daemon[1122]: time=2026-09-20T08:05:53.857Z level=INFO msg="Uploading 1 narinfos"5340lb # [ 77.847246] niks3-server[1005]: 2026/09/20 08:05:53 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5341lb # [ 77.855385] niks3-server[1005]: 2026/09/20 08:05:53 INFO Completed upload id=255342worker1 # [ 77.845368] nix-grpc-daemon[1122]: time=2026-09-20T08:05:53.873Z level=INFO msg="Upload complete. (362ms)"5343worker1 # [ 77.847575] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=0 paths=1 nar_bytes_in=5205344lb # [ 77.860909] niks3-server[1005]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5345worker1 # [ 77.851119] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725346worker1 # [ 77.858343] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5347worker1 # [ 77.862038] nix-daemon[844]: reaped child process 1120, status = succeeded5348worker1 # [ 77.867631] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5349client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5350client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5351client # farm-a> LOG-farm-a-on-standby5352worker1 # [ 78.885285] nix-daemon[844]: reaped child process 1147, status = succeeded5353worker1 # [ 79.041116] nix-daemon[844]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)5354worker1 # [ 79.056646] nix-daemon[844]: reaped child process 1165, status = succeeded5355lb # [ 79.076929] niks3-server[1005]: 2026/09/20 08:05:55 INFO Received uploads request method=POST path=/api/pending_closures5356worker1 # [ 79.079244] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.107Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5357worker1 # [ 79.082571] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.109Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5358lb # [ 79.124204] niks3-server[1005]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5359lb # [ 79.138309] niks3-server[1005]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5360lb # [ 79.150327] niks3-server[1005]: 2026/09/20 08:05:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5361lb # [ 79.154343] niks3-server[1005]: 2026/09/20 08:05:55 INFO Signed narinfos id=26 count=15362worker1 # [ 79.147460] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.175Z level=INFO msg="Uploading 1 narinfos"5363lb # [ 79.164571] niks3-server[1005]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5364lb # [ 79.170583] niks3-server[1005]: 2026/09/20 08:05:55 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5365lb # [ 79.179054] niks3-server[1005]: 2026/09/20 08:05:55 INFO Completed upload id=265366worker1 # [ 79.169074] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.197Z level=INFO msg="Upload complete. (293ms)"5367lb # [ 79.181830] niks3-server[1005]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5368worker1 # [ 79.178940] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15369worker1 # [ 79.197330] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05370worker1 # [ 79.204220] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15371worker1 # [ 79.209605] nix-daemon[844]: reaped child process 1145, status = succeeded5372worker1 # [ 79.246956] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725373worker1 # [ 79.261494] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574725374worker1 # [ 79.276801] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.305Z level=INFO msg="All 1 paths already cached"5375client # copying 1 paths to 'lb:50051'...5376client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5377worker1 # [ 79.286844] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574725378worker1 # [ 79.298185] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5379worker1 # [ 79.472596] nix-daemon[844]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)5380worker1 # [ 79.493402] nix-daemon[844]: reaped child process 1174, status = succeeded5381worker1 # [ 79.660733] nix-daemon[844]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5382worker1 # [ 79.679053] nix-daemon[844]: reaped child process 1179, status = succeeded5383lb # [ 79.703201] niks3-server[1005]: 2026/09/20 08:05:55 INFO Received uploads request method=POST path=/api/pending_closures5384worker1 # [ 79.698244] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.726Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5385worker1 # [ 79.700089] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.728Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5386lb # [ 79.723778] niks3-server[1005]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5387lb # [ 79.730527] niks3-server[1005]: 2026/09/20 08:05:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5388lb # [ 79.733859] niks3-server[1005]: 2026/09/20 08:05:55 INFO Signed narinfos id=27 count=15389worker1 # [ 79.724066] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.752Z level=INFO msg="Uploading 1 narinfos"5390lb # [ 79.736099] niks3-server[1005]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5391lb # [ 79.743269] niks3-server[1005]: 2026/09/20 08:05:55 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5392lb # [ 79.748688] niks3-server[1005]: 2026/09/20 08:05:55 INFO Completed upload id=275393lb # [ 79.750637] niks3-server[1005]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5394worker1 # [ 79.740111] nix-grpc-daemon[1122]: time=2026-09-20T08:05:55.768Z level=INFO msg="Upload complete. (430ms)"5395worker1 # [ 79.743692] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=0 paths=1 nar_bytes_in=6405396worker1 # [ 79.748290] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725397worker1 # [ 79.755463] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5398worker1 # [ 79.764217] nix-daemon[844]: reaped child process 1169, status = succeeded5399client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5400worker1 # [ 79.769344] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5401client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5402worker1 # [ 81.191315] nix-daemon[844]: reaped child process 1183, status = succeeded5403client # farm-b> LOG-farm-b-on-standby5404worker1 # [ 81.350314] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)5405worker1 # [ 81.369778] nix-daemon[844]: reaped child process 1201, status = succeeded5406lb # [ 81.395323] niks3-server[1005]: 2026/09/20 08:05:57 INFO Received uploads request method=POST path=/api/pending_closures5407worker1 # [ 81.395189] nix-grpc-daemon[1122]: time=2026-09-20T08:05:57.423Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5408worker1 # [ 81.397968] nix-grpc-daemon[1122]: time=2026-09-20T08:05:57.425Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5409lb # [ 81.445607] niks3-server[1005]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5410lb # [ 81.452801] niks3-server[1005]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5411lb # [ 81.460688] niks3-server[1005]: 2026/09/20 08:05:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5412lb # [ 81.464654] niks3-server[1005]: 2026/09/20 08:05:57 INFO Signed narinfos id=28 count=15413worker1 # [ 81.457884] nix-grpc-daemon[1122]: time=2026-09-20T08:05:57.485Z level=INFO msg="Uploading 1 narinfos"5414lb # [ 81.477968] niks3-server[1005]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5415lb # [ 81.483682] niks3-server[1005]: 2026/09/20 08:05:57 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5416lb # [ 81.488311] niks3-server[1005]: 2026/09/20 08:05:57 INFO Completed upload id=285417worker1 # [ 81.478361] nix-grpc-daemon[1122]: time=2026-09-20T08:05:57.506Z level=INFO msg="Upload complete. (299ms)"5418lb # [ 81.491255] niks3-server[1005]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5419worker1 # [ 81.482757] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15420worker1 # [ 81.492533] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:57Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05421worker1 # [ 81.495480] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:57Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15422worker1 # [ 81.502655] nix-daemon[844]: reaped child process 1181, status = succeeded5423worker1 # [ 81.536981] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725424worker1 # [ 81.546367] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574725425worker1 # [ 81.555325] nix-grpc-daemon[1122]: time=2026-09-20T08:05:57.583Z level=INFO msg="All 2 paths already cached"5426client # copying 1 paths to 'lb:50051'...5427client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5428worker1 # [ 81.560953] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574725429worker1 # [ 81.568168] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5430worker1 # [ 81.748787] nix-daemon[844]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5431worker1 # [ 81.764867] nix-daemon[844]: reaped child process 1210, status = succeeded5432worker1 # [ 81.945341] nix-daemon[844]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)5433worker1 # [ 81.964057] nix-daemon[844]: reaped child process 1215, status = succeeded5434lb # [ 81.989211] niks3-server[1005]: 2026/09/20 08:05:57 INFO Received uploads request method=POST path=/api/pending_closures5435worker1 # [ 81.985628] nix-grpc-daemon[1122]: time=2026-09-20T08:05:58.013Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5436worker1 # [ 81.987334] nix-grpc-daemon[1122]: time=2026-09-20T08:05:58.013Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5437lb # [ 82.011896] niks3-server[1005]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5438lb # [ 82.016597] niks3-server[1005]: 2026/09/20 08:05:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5439lb # [ 82.019499] niks3-server[1005]: 2026/09/20 08:05:57 INFO Signed narinfos id=29 count=15440worker1 # [ 82.011147] nix-grpc-daemon[1122]: time=2026-09-20T08:05:58.039Z level=INFO msg="Uploading 1 narinfos"5441lb # [ 82.026969] niks3-server[1005]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5442lb # [ 82.035398] niks3-server[1005]: 2026/09/20 08:05:57 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5443lb # [ 82.042064] niks3-server[1005]: 2026/09/20 08:05:57 INFO Completed upload id=295444worker1 # [ 82.032245] nix-grpc-daemon[1122]: time=2026-09-20T08:05:58.060Z level=INFO msg="Upload complete. (455ms)"5445lb # [ 82.046088] niks3-server[1005]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5446worker1 # [ 82.035125] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=0 paths=1 nar_bytes_in=7685447worker1 # [ 82.039343] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725448worker1 # [ 82.045509] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5449worker1 # [ 82.054489] nix-daemon[844]: reaped child process 1205, status = succeeded5450client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5451client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5452worker1 # [ 82.060490] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5453client # farm-top> LOG-farm-top-on-standby5454worker1 # [ 82.885488] nix-daemon[844]: reaped child process 1219, status = succeeded5455worker1 # [ 83.023394] nix-daemon[844]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5456worker1 # [ 83.038822] nix-daemon[844]: reaped child process 1237, status = succeeded5457lb # [ 83.061042] niks3-server[1005]: 2026/09/20 08:05:58 INFO Received uploads request method=POST path=/api/pending_closures5458worker1 # [ 83.056325] nix-grpc-daemon[1122]: time=2026-09-20T08:05:59.084Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5459worker1 # [ 83.059656] nix-grpc-daemon[1122]: time=2026-09-20T08:05:59.086Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5460lb # [ 83.084661] niks3-server[1005]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5461lb # [ 83.088612] niks3-server[1005]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5462lb # [ 83.093959] niks3-server[1005]: 2026/09/20 08:05:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5463lb # [ 83.097406] niks3-server[1005]: 2026/09/20 08:05:59 INFO Signed narinfos id=30 count=15464worker1 # [ 83.087101] nix-grpc-daemon[1122]: time=2026-09-20T08:05:59.115Z level=INFO msg="Uploading 1 narinfos"5465lb # [ 83.100342] niks3-server[1005]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5466lb # [ 83.106560] niks3-server[1005]: 2026/09/20 08:05:59 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5467lb # [ 83.112023] niks3-server[1005]: 2026/09/20 08:05:59 INFO Completed upload id=305468worker1 # [ 83.101822] nix-grpc-daemon[1122]: time=2026-09-20T08:05:59.130Z level=INFO msg="Upload complete. (232ms)"5469lb # [ 83.113847] niks3-server[1005]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5470worker1 # [ 83.105420] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15471worker1 # [ 83.113672] nix-daemon[844]: reaped child process 1217, status = succeeded5472client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 6.47 seconds)5473client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5474client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.17 seconds)5475worker2 # [ 83.356378] systemd[1]: Listening on Nix worker-protocol over gRPC.5476worker2 # [ 83.361215] systemd[1]: Starting Nix worker-protocol over gRPC...5477worker2 # [ 83.508363] nix-grpc-daemon[1309]: ts=2026-09-20T08:05:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5478worker2 # [ 83.512069] nix-grpc-daemon[1309]: ts=2026-09-20T08:05:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15479worker2 # [ 83.519055] nix-grpc-daemon[1309]: ts=2026-09-20T08:05:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5480worker2 # [ 83.523921] systemd[1]: Started Nix worker-protocol over gRPC.5481lb: must succeed: curl -sf localhost:9901/clusters5482worker2 # [ 83.539795] nix-grpc-daemon[1309]: ts=2026-09-20T08:05:59Z level=info event=scheduler_connected addr=lb:500515483worker1 # [ 83.533829] nix-grpc-daemon[1043]: ts=2026-09-20T08:05:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05484lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5485worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5486worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5487lb: must succeed: curl -sf localhost:9901/clusters5488lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5489lb: must succeed: curl -sf localhost:9901/clusters5490lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5491worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5492worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5493(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.52 seconds)5494subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5495client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5496client # [ 83.852414] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5497client # Running as unit: rs.service; invocation ID: 2fb313e7550e4edeb1176051df0a0f995498client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5499worker1 # [ 84.066708] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574725500client # [ 84.070760] nix[1147]: don't know how to build these paths:5501client # [ 84.072977] nix[1147]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5502worker1 # [ 84.082158] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05503worker1 # [ 84.084876] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15504worker1 # [ 84.087893] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725505worker1 # [ 84.096212] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574725506client # [ 84.100176] nix[1147]: copying 1 paths to 'lb:50051'...5507client # [ 84.101481] nix[1147]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5508worker1 # [ 84.104438] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574725509worker1 # [ 84.111659] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5510worker1 # [ 84.265915] nix-daemon[844]: accepted connection from pid 1252, user nix-grpc-daemon (trusted)5511worker1 # [ 84.282688] nix-daemon[844]: reaped child process 1255, status = succeeded5512worker1 # [ 84.429877] nix-daemon[844]: accepted connection from pid 1257, user nix-grpc-daemon (trusted)5513worker1 # [ 84.444307] nix-daemon[844]: reaped child process 1260, status = succeeded5514lb # [ 84.467455] niks3-server[1005]: 2026/09/20 08:06:00 INFO Received uploads request method=POST path=/api/pending_closures5515worker1 # [ 84.463748] nix-grpc-daemon[1122]: time=2026-09-20T08:06:00.491Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5516worker1 # [ 84.466255] nix-grpc-daemon[1122]: time=2026-09-20T08:06:00.494Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5517lb # [ 84.490586] niks3-server[1005]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5518lb # [ 84.498715] niks3-server[1005]: 2026/09/20 08:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5519lb # [ 84.503290] niks3-server[1005]: 2026/09/20 08:06:00 INFO Signed narinfos id=31 count=15520worker1 # [ 84.493410] nix-grpc-daemon[1122]: time=2026-09-20T08:06:00.521Z level=INFO msg="Uploading 1 narinfos"5521lb # [ 84.508173] niks3-server[1005]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5522lb # [ 84.519329] niks3-server[1005]: 2026/09/20 08:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5523lb # [ 84.527041] niks3-server[1005]: 2026/09/20 08:06:00 INFO Completed upload id=315524worker1 # [ 84.516857] nix-grpc-daemon[1122]: time=2026-09-20T08:06:00.545Z level=INFO msg="Upload complete. (399ms)"5525lb # [ 84.529743] niks3-server[1005]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5526worker1 # [ 84.521673] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=0 paths=1 nar_bytes_in=4165527worker1 # [ 84.525117] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574725528worker1 # [ 84.532392] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5529worker1 # [ 84.535341] nix-daemon[844]: reaped child process 1250, status = succeeded5530worker1 # [ 84.541587] nix-daemon[844]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5531client # [ 84.538611] nix[1147]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5532lb: must succeed: curl -sf localhost:9901/clusters5533lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5534lb: must succeed: curl -sf localhost:9901/clusters5535lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5536lb: must succeed: curl -sf localhost:9901/clusters5537lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5538lb: must succeed: curl -sf localhost:9901/clusters5539lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5540worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5541worker2 # [ 86.706298] systemd-journald[287]: Received client request to rotate journal, rotating.5542worker2 # [ 86.720912] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/349fd32204a0448b8d91c60308689d33.5543worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds)5544worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5545worker1 # [ 86.633487] systemd[1]: Stopping Nix worker-protocol over gRPC...5546worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5547??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5548 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735549client: must succeed: sleep 5.05550worker1 # [ 87.205846] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:03Z level=info event=draining5551lb # [ 87.636138] envoy[913]: conn peer=[2001:db8:1::1]:59422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9451 tx=3781 ms=62515552client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5553worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5554worker1 # [ 91.968083] nix-daemon[844]: reaped child process 1264, status = succeeded5555worker1 # [ 92.106337] nix-daemon[844]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5556worker1 # [ 92.121933] nix-daemon[844]: reaped child process 1307, status = succeeded5557lb # [ 92.141777] niks3-server[1005]: 2026/09/20 08:06:08 INFO Received uploads request method=POST path=/api/pending_closures5558worker1 # [ 92.141800] nix-grpc-daemon[1122]: time=2026-09-20T08:06:08.170Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5559worker1 # [ 92.143328] nix-grpc-daemon[1122]: time=2026-09-20T08:06:08.171Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5560lb # [ 92.173312] niks3-server[1005]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5561lb # [ 92.176753] niks3-server[1005]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5562lb # [ 92.182927] niks3-server[1005]: 2026/09/20 08:06:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5563lb # [ 92.186360] niks3-server[1005]: 2026/09/20 08:06:08 INFO Signed narinfos id=32 count=15564worker1 # [ 92.176385] nix-grpc-daemon[1122]: time=2026-09-20T08:06:08.204Z level=INFO msg="Uploading 1 narinfos"5565lb # [ 92.189693] niks3-server[1005]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5566lb # [ 92.195430] niks3-server[1005]: 2026/09/20 08:06:08 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5567lb # [ 92.199519] niks3-server[1005]: 2026/09/20 08:06:08 INFO Completed upload id=325568worker1 # [ 92.189301] nix-grpc-daemon[1122]: time=2026-09-20T08:06:08.217Z level=INFO msg="Upload complete. (232ms)"5569lb # [ 92.201433] niks3-server[1005]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5570worker1 # [ 92.193147] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57472 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15571worker1 # [ 92.201592] nix-daemon[844]: reaped child process 1262, status = succeeded5572worker1 # [ 92.206215] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=signal_exit5573client # [ 92.222784] systemd[1]: rs.service: Deactivated successfully.5574worker1 # [ 92.232131] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_yield5575lb # [ 92.242763] niks3-server[1005]: 2026/09/20 08:06:08 INFO lead: released remote=192.168.1.3:608465576client # [ 92.227165] systemd[1]: rs.service: Consumed 128ms CPU time over 8.373s wall clock time, 39.1M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5577worker1 # [ 92.238828] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_restarting addr=lb:500515578worker2 # [ 92.247472] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:08Z level=info event=scheduler_restarting addr=lb:500515579worker1 # [ 92.240573] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:574705580worker1 # [ 92.241921] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=worker_gone addr=192.168.1.4:500515581worker1 # [ 92.243118] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:574705582worker1 # [ 92.244455] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=worker_gone addr=192.168.1.3:500515583worker1 # [ 92.440119] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_connected addr=lb:500515584worker2 # [ 92.448168] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:08Z level=info event=scheduler_connected addr=lb:500515585worker1 # [ 92.449645] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5586worker2 # [ 92.463715] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5587worker1 # [ 92.650615] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_connected addr=lb:500515588worker1 # [ 92.653226] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5589worker2 # [ 92.664377] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:08Z level=info event=scheduler_connected addr=lb:500515590worker2 # [ 92.666290] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5591worker1 # [ 92.854111] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_connected addr=lb:500515592worker1 # [ 92.856369] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5593worker2 # [ 92.866671] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:08Z level=info event=scheduler_connected addr=lb:500515594worker2 # [ 92.868662] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5595worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.08 seconds)5596client: waiting for success: ! systemctl is-active rs5597client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5598client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5599worker1 # [ 93.057796] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:09Z level=info event=scheduler_connected addr=lb:500515600worker2 # [ 93.068959] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_connected addr=lb:500515601worker2 # [ 93.071217] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5602worker1 # [ 93.063605] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5603client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5604client: must fail: journalctl -u rs | grep -q 'reconnecting'5605client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5606lb: must succeed: curl -sf localhost:9901/clusters5607lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5608worker1 # [ 93.237422] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:09Z level=info event=scheduler_restarting5609worker1 # [ 93.256567] nix-daemon[844]: reaped child process 1113, status = succeeded5610worker2 # [ 93.272504] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_connected addr=lb:500515611worker2 # [ 93.275567] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5612worker1 # [ 93.272648] nix-grpc-daemon[1043]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5613worker1 # [ 93.275183] nix-grpc-daemon[1043]: E0000 00:00:1789891569.300616 1086 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5614worker1 # [ 93.278247] nix-grpc-daemon[1043]: E0000 00:00:1789891569.300882 1086 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5615worker1 # [ 93.281165] nix-grpc-daemon[1043]: ts=2026-09-20T08:06:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5616worker2 # [ 93.476200] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_connected addr=lb:500515617worker1 # [ 93.470342] nix-grpc-daemon[1043]: E0000 00:00:1789891569.498695 1086 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5618worker2 # [ 93.534702] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_take_over5619lb # [ 93.538266] niks3-server[1005]: 2026/09/20 08:06:09 INFO lead: acquired remote=192.168.1.4:380105620worker2 # [ 93.665178] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5621worker1 # [ 93.670718] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5622worker1 # [ 93.672323] systemd[1]: Stopped Nix worker-protocol over gRPC.5623worker1 # [ 93.673789] systemd[1]: nix-grpc-daemon.service: Consumed 1.501s CPU time over 22.636s wall clock time, 33.4M memory peak, 47.4K incoming IP traffic, 90.5K outgoing IP traffic.5624worker1 # [ 93.682476] systemd[1]: Starting Nix worker-protocol over gRPC...5625worker1 # [ 93.811613] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5626worker1 # [ 93.813708] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15627worker1 # [ 93.820310] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5628worker1 # [ 93.823161] systemd[1]: Started Nix worker-protocol over gRPC.5629worker1 # [ 93.832538] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:09Z level=info event=scheduler_connected addr=lb:500515630worker2 # [ 93.841703] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05631worker2 # [ 93.865782] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=scheduler_connected addr=lb:500515632worker2 # [ 93.867838] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05633lb: must succeed: curl -sf localhost:9901/clusters5634lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5635worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5636worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5637(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.44 seconds)5638subtest: scheduler restart mid-build: build finishes, no double build5639client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5640client # [ 94.271960] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5641client # Running as unit: mid.service; invocation ID: 1c80ef314f384f27a66994b9795987835642client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.05 seconds)5643worker2 # [ 94.498554] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:480525644worker2 # [ 94.505659] nix-daemon[844]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5645client # [ 94.503633] nix[1181]: don't know how to build these paths:5646client # [ 94.504610] nix[1181]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5647worker2 # [ 94.523474] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:10Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05648worker2 # [ 94.525951] nix-grpc-daemon[1309]: ts=2026-09-20T08:06:10Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15649worker1 # [ 94.571615] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601965650worker1 # [ 94.576522] nix-daemon[844]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5651worker1 # [ 94.588073] nix-grpc-daemon[1314]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)5652worker1 # [ 94.630828] nix-grpc-daemon[1314]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 2/5)5653worker1 # [ 94.641476] nix-grpc-daemon[1314]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 3/5)5654worker1 # [ 94.703196] nix-grpc-daemon[1314]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 4/5)5655worker1 # [ 94.988882] nix-grpc-daemon[1314]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5656worker1 # [ 95.001870] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601965657client # [ 95.006265] nix[1181]: copying 1 paths to 'lb:50051'...5658worker1 # [ 95.010325] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601965659client # [ 95.007550] nix[1181]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5660worker1 # [ 95.015052] nix-daemon[844]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5661worker1 # [ 95.027303] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:11Z level=info event=niks3_push_started pid=13745662worker1 # [ 95.333270] nix-daemon[844]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5663worker1 # [ 95.349268] nix-daemon[844]: reaped child process 1390, status = succeeded5664worker1 # [ 95.502576] nix-daemon[844]: accepted connection from pid 1392, user nix-grpc-daemon (trusted)5665worker1 # [ 95.517175] nix-daemon[844]: reaped child process 1399, status = succeeded5666lb # [ 95.543627] niks3-server[1005]: 2026/09/20 08:06:11 INFO Received uploads request method=POST path=/api/pending_closures5667worker1 # [ 95.555417] nix-grpc-daemon[1374]: time=2026-09-20T08:06:11.583Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5668worker1 # [ 95.557467] nix-grpc-daemon[1374]: time=2026-09-20T08:06:11.585Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5669lb # [ 95.604915] niks3-server[1005]: 2026/09/20 08:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5670lb # [ 95.613969] niks3-server[1005]: 2026/09/20 08:06:11 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5671lb # [ 95.631828] niks3-server[1005]: 2026/09/20 08:06:11 INFO Signed narinfos id=33 count=15672worker1 # [ 95.622358] nix-grpc-daemon[1374]: time=2026-09-20T08:06:11.650Z level=INFO msg="Uploading 1 narinfos"5673lb # [ 95.637785] niks3-server[1005]: 2026/09/20 08:06:11 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5674lb # [ 95.644754] niks3-server[1005]: 2026/09/20 08:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5675lb # [ 95.660573] niks3-server[1005]: 2026/09/20 08:06:11 INFO Completed upload id=335676worker1 # [ 95.652070] nix-grpc-daemon[1374]: time=2026-09-20T08:06:11.680Z level=INFO msg="Upload complete. (463ms)"5677worker1 # [ 95.655102] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60196 duration_s=0 paths=1 nar_bytes_in=4245678lb # [ 95.666813] niks3-server[1005]: 2026/09/20 08:06:11 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5679worker1 # [ 95.659648] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601965680worker1 # [ 95.668515] nix-daemon[844]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5681worker1 # [ 95.671324] nix-daemon[844]: reaped child process 1372, status = succeeded5682worker1 # [ 95.677393] nix-daemon[844]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5683client # [ 95.674323] nix[1181]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5684lb # [ 97.636984] envoy[913]: conn peer=[2001:db8:1::1]:48546 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2930 tx=1326 ms=81425685lb # [ 97.640130] envoy[913]: conn peer=[2001:db8:1::3]:54230 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5243 tx=1459 ms=220495686lb: must succeed: curl -sf localhost:9901/clusters5687lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5688lb: must succeed: curl -sf localhost:9901/clusters5689lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5690worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5691worker2 # [ 97.901231] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1309 (nix-grpc-daemon) on client request.5692worker1 # [ 97.899750] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:13Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5693client # [ 97.898290] nix[1181]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5694lb # [ 97.912772] niks3-server[1005]: 2026/09/20 08:06:13 INFO lead: released remote=192.168.1.4:380105695worker2 # [ 97.906945] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5696worker2 # [ 97.925350] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5697worker2 # [ 97.928142] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5698worker2 # [ 97.929578] systemd[1]: nix-grpc-daemon.service: Consumed 176ms CPU time over 14.563s wall clock time, 10.8M memory peak, 9.4K incoming IP traffic, 12.7K outgoing IP traffic.5699worker2 # [ 97.940304] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5700worker2 # [ 97.943208] systemd[1]: Starting Nix worker-protocol over gRPC...5701worker2 # [ 97.950201] nix-daemon[844]: reaped child process 1413, status = succeeded5702worker2 # [ 98.088826] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5703worker2 # [ 98.093111] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15704worker2 # [ 98.099508] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5705worker2 # [ 98.101185] systemd[1]: Started Nix worker-protocol over gRPC.5706worker1 # [ 98.100426] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:14Z level=info event=scheduler_connected addr=lb:500515707worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.25 seconds)5708client: must succeed: sleep 5.05709worker2 # [ 98.112360] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:14Z level=info event=scheduler_take_over5710lb # [ 98.115438] niks3-server[1005]: 2026/09/20 08:06:14 INFO lead: acquired remote=192.168.1.4:571765711worker2 # [ 98.123631] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15712worker2 # [ 98.126814] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:14Z level=info event=scheduler_connected addr=lb:500515713worker2 # [ 98.128506] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05714client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5715client: waiting for success: ! systemctl is-active mid5716worker1 # [ 103.500792] nix-daemon[844]: reaped child process 1403, status = succeeded5717worker1 # [ 103.660601] nix-daemon[844]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5718worker1 # [ 103.674733] nix-daemon[844]: reaped child process 1442, status = succeeded5719lb # [ 103.697663] niks3-server[1005]: 2026/09/20 08:06:19 INFO Received uploads request method=POST path=/api/pending_closures5720worker1 # [ 103.700424] nix-grpc-daemon[1374]: time=2026-09-20T08:06:19.727Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5721worker1 # [ 103.701837] nix-grpc-daemon[1374]: time=2026-09-20T08:06:19.728Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5722lb # [ 103.747573] niks3-server[1005]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5723lb # [ 103.752237] niks3-server[1005]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5724lb # [ 103.763148] niks3-server[1005]: 2026/09/20 08:06:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5725lb # [ 103.770754] niks3-server[1005]: 2026/09/20 08:06:19 INFO Signed narinfos id=34 count=15726worker1 # [ 103.763775] nix-grpc-daemon[1374]: time=2026-09-20T08:06:19.791Z level=INFO msg="Uploading 1 narinfos"5727lb # [ 103.776785] niks3-server[1005]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5728lb # [ 103.782307] niks3-server[1005]: 2026/09/20 08:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5729lb # [ 103.788170] niks3-server[1005]: 2026/09/20 08:06:19 INFO Completed upload id=345730lb # [ 103.789756] niks3-server[1005]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5731worker1 # [ 103.779382] nix-grpc-daemon[1374]: time=2026-09-20T08:06:19.807Z level=INFO msg="Upload complete. (287ms)"5732worker1 # [ 103.786317] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60196 duration_s=8 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15733worker1 # [ 103.798421] nix-daemon[844]: reaped child process 1401, status = succeeded5734client # [ 103.807291] systemd[1]: mid.service: Deactivated successfully.5735client # [ 103.808977] systemd[1]: mid.service: Consumed 153ms CPU time over 9.537s wall clock time, 41.3M memory peak, 9K incoming IP traffic, 9.3K outgoing IP traffic.5736client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)5737client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5738client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5739(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.25 seconds)5740subtest: interrupting the client stops the build on the worker5741client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5742client # [ 104.515321] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5743client # Running as unit: intr.service; invocation ID: 02027dca45054b93999457c4366452a55744client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5745worker2 # [ 104.710766] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:527845746worker2 # [ 104.721556] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5747client # [ 104.724449] nix[1216]: don't know how to build these paths:5748client # [ 104.725356] nix[1216]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5749worker2 # [ 104.745413] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:20Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05750worker2 # [ 104.750728] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:20Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15751worker2 # [ 104.794705] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845752worker2 # [ 104.800782] nix-grpc-daemon[1441]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)5753worker2 # [ 104.886403] nix-grpc-daemon[1441]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5)5754worker2 # [ 105.042418] nix-grpc-daemon[1441]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 311 ms (attempt 3/5)5755worker2 # [ 105.359625] nix-grpc-daemon[1441]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 329 ms (attempt 4/5)5756worker2 # [ 105.694879] nix-grpc-daemon[1441]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5757worker2 # [ 105.706148] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527845758client # [ 105.702307] nix[1216]: copying 1 paths to 'lb:50051'...5759worker2 # [ 105.713199] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527845760client # [ 105.703725] nix[1216]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5761worker2 # [ 105.718503] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5762worker2 # [ 105.730191] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:21Z level=info event=niks3_push_started pid=15115763worker2 # [ 106.029495] nix-daemon[844]: accepted connection from pid 1528, user nix-grpc-daemon (trusted)5764worker2 # [ 106.042527] nix-daemon[844]: reaped child process 1531, status = succeeded5765worker2 # [ 106.179445] nix-daemon[844]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5766worker2 # [ 106.191275] nix-daemon[844]: reaped child process 1536, status = succeeded5767lb # [ 106.205147] niks3-server[1005]: 2026/09/20 08:06:22 INFO Received uploads request method=POST path=/api/pending_closures5768worker2 # [ 106.206975] nix-grpc-daemon[1511]: time=2026-09-20T08:06:22.202Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5769worker2 # [ 106.209236] nix-grpc-daemon[1511]: time=2026-09-20T08:06:22.203Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5770lb # [ 106.224201] niks3-server[1005]: 2026/09/20 08:06:22 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5771lb # [ 106.228597] niks3-server[1005]: 2026/09/20 08:06:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5772lb # [ 106.230611] niks3-server[1005]: 2026/09/20 08:06:22 INFO Signed narinfos id=35 count=15773worker2 # [ 106.229152] nix-grpc-daemon[1511]: time=2026-09-20T08:06:22.224Z level=INFO msg="Uploading 1 narinfos"5774lb # [ 106.234859] niks3-server[1005]: 2026/09/20 08:06:22 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5775lb # [ 106.238584] niks3-server[1005]: 2026/09/20 08:06:22 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5776lb # [ 106.242575] niks3-server[1005]: 2026/09/20 08:06:22 INFO Completed upload id=355777worker2 # [ 106.240907] nix-grpc-daemon[1511]: time=2026-09-20T08:06:22.236Z level=INFO msg="Upload complete. (346ms)"5778lb # [ 106.244314] niks3-server[1005]: 2026/09/20 08:06:22 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5779worker2 # [ 106.242968] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=0 paths=1 nar_bytes_in=4245780worker2 # [ 106.245865] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845781worker2 # [ 106.252511] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5782worker2 # [ 106.256121] nix-daemon[844]: reaped child process 1509, status = succeeded5783worker2 # [ 106.261044] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5784client # [ 106.250890] nix[1216]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5785lb # [ 107.636326] envoy[913]: conn peer=[2001:db8:1::4]:50198 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1905 tx=488 ms=143705786lb # [ 107.640576] envoy[913]: conn peer=[2001:db8:1::1]:41866 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3031 tx=1395 ms=93125787client: must succeed: systemctl kill -s INT intr5788client # [ 108.029995] systemd[1]: intr.service: Sent signal SIGINT to main process 1216 (nix) on client request.5789client # [ 108.038366] nix[1216]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5790client # [ 108.044327] nix[1216]: error: interrupted by the user5791client: (finished: must succeed: systemctl kill -s INT intr, in 0.06 seconds)5792worker2 # [ 108.080117] nix-daemon[844]: reaped child process 1538, status = succeeded5793worker2 # [ 108.084258] nix-daemon[1540]: unexpected Nix daemon error: error: interrupted by the user5794client # [ 108.077079] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5795worker2 # [ 108.088084] nix-daemon[844]: reaped child process 1540, status = failed with exit code 15796client # [ 108.078670] systemd[1]: intr.service: Failed with result 'exit-code'.5797client # [ 108.080736] systemd[1]: intr.service: Consumed 122ms CPU time over 3.564s wall clock time, 37.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5798(finished: subtest: interrupting the client stops the build on the worker, in 3.64 seconds)5799subtest: a deploy mid-build drains: the build finishes, the new generation takes over5800client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5801client # [ 108.157875] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5802client # Running as unit: sw.service; invocation ID: 479b8c50eb47443cb9b8e33aadd5dc955803client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5804client # [ 108.348245] nix[1236]: don't know how to build these paths:5805worker1 # [ 108.350262] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:601965806client # [ 108.349549] nix[1236]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5807worker2 # [ 108.367909] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:24Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05808worker2 # [ 108.372734] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:24Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=15809worker1 # [ 108.409433] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601965810worker1 # [ 108.417746] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601965811client # [ 108.420383] nix[1236]: copying 1 paths to 'lb:50051'...5812worker1 # [ 108.427086] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601965813client # [ 108.424158] nix[1236]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5814worker1 # [ 108.437360] nix-daemon[844]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5815worker1 # [ 108.575413] nix-daemon[844]: accepted connection from pid 1470, user nix-grpc-daemon (trusted)5816worker1 # [ 108.591860] nix-daemon[844]: reaped child process 1473, status = succeeded5817worker1 # [ 108.740441] nix-daemon[844]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5818worker1 # [ 108.755477] nix-daemon[844]: reaped child process 1478, status = succeeded5819lb # [ 108.781096] niks3-server[1005]: 2026/09/20 08:06:24 INFO Received uploads request method=POST path=/api/pending_closures5820worker1 # [ 108.779493] nix-grpc-daemon[1374]: time=2026-09-20T08:06:24.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5821worker1 # [ 108.780992] nix-grpc-daemon[1374]: time=2026-09-20T08:06:24.809Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5822lb # [ 108.800645] niks3-server[1005]: 2026/09/20 08:06:24 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5823lb # [ 108.805076] niks3-server[1005]: 2026/09/20 08:06:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5824lb # [ 108.807199] niks3-server[1005]: 2026/09/20 08:06:24 INFO Signed narinfos id=36 count=15825worker1 # [ 108.798398] nix-grpc-daemon[1374]: time=2026-09-20T08:06:24.826Z level=INFO msg="Uploading 1 narinfos"5826lb # [ 108.811702] niks3-server[1005]: 2026/09/20 08:06:24 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5827lb # [ 108.816203] niks3-server[1005]: 2026/09/20 08:06:24 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5828lb # [ 108.819105] niks3-server[1005]: 2026/09/20 08:06:24 INFO Completed upload id=365829worker1 # [ 108.808866] nix-grpc-daemon[1374]: time=2026-09-20T08:06:24.837Z level=INFO msg="Upload complete. (364ms)"5830worker1 # [ 108.810906] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60196 duration_s=0 paths=1 nar_bytes_in=4165831lb # [ 108.821810] niks3-server[1005]: 2026/09/20 08:06:24 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5832worker1 # [ 108.815258] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601965833worker1 # [ 108.821250] nix-daemon[844]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5834worker1 # [ 108.823599] nix-daemon[844]: reaped child process 1468, status = succeeded5835worker1 # [ 108.829068] nix-daemon[844]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5836client # [ 108.825361] nix[1236]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5837worker1: must succeed: systemctl reload nix-grpc-daemon.service5838worker1 # [ 110.645500] systemd[1]: Reloading Nix worker-protocol over gRPC...5839worker1 # [ 110.687169] systemd[1]: Reloaded Nix worker-protocol over gRPC.5840worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds)5841worker1: must succeed: pgrep -f 'read -t [9]0 x'5842worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds)5843client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25844worker1 # [ 110.829112] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:26Z level=info event=draining5845worker2 # [ 110.925773] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:527845846client # don't know how to build these paths:5847client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5848worker2 # [ 110.939817] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:26Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05849worker2 # [ 110.945281] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:26Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=15850worker2 # [ 110.987221] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845851worker2 # [ 110.999682] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527845852client # copying 1 paths to 'lb:50051'...5853worker2 # [ 111.013493] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527845854client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5855worker2 # [ 111.034738] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5856worker2 # [ 111.198201] nix-daemon[844]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)5857worker2 # [ 111.211988] nix-daemon[844]: reaped child process 1593, status = succeeded5858worker2 # [ 111.330262] nix-daemon[844]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)5859worker2 # [ 111.343481] nix-daemon[844]: reaped child process 1598, status = succeeded5860lb # [ 111.357358] niks3-server[1005]: 2026/09/20 08:06:27 INFO Received uploads request method=POST path=/api/pending_closures5861worker2 # [ 111.362280] nix-grpc-daemon[1511]: time=2026-09-20T08:06:27.357Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5862worker2 # [ 111.363779] nix-grpc-daemon[1511]: time=2026-09-20T08:06:27.359Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5863lb # [ 111.386285] niks3-server[1005]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5864lb # [ 111.403489] niks3-server[1005]: 2026/09/20 08:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5865worker2 # [ 111.404522] nix-grpc-daemon[1511]: time=2026-09-20T08:06:27.399Z level=INFO msg="Uploading 1 narinfos"5866lb # [ 111.407255] niks3-server[1005]: 2026/09/20 08:06:27 INFO Signed narinfos id=37 count=15867lb # [ 111.415355] niks3-server[1005]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5868lb # [ 111.426095] niks3-server[1005]: 2026/09/20 08:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5869lb # [ 111.431834] niks3-server[1005]: 2026/09/20 08:06:27 INFO Completed upload id=375870lb # [ 111.434654] niks3-server[1005]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5871worker2 # [ 111.430682] nix-grpc-daemon[1511]: time=2026-09-20T08:06:27.426Z level=INFO msg="Upload complete. (383ms)"5872worker2 # [ 111.434905] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=0 paths=1 nar_bytes_in=5285873worker2 # [ 111.441352] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845874worker2 # [ 111.450643] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5875worker2 # [ 111.461291] nix-daemon[844]: reaped child process 1588, status = succeeded5876client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5877worker2 # [ 111.465623] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5878client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5879client # farm-a> LOG-farm-a-during-drain5880worker2 # [ 112.479761] nix-daemon[844]: reaped child process 1602, status = succeeded5881worker2 # [ 112.601705] nix-daemon[844]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)5882worker2 # [ 112.614372] nix-daemon[844]: reaped child process 1620, status = succeeded5883lb # [ 112.628412] niks3-server[1005]: 2026/09/20 08:06:28 INFO Received uploads request method=POST path=/api/pending_closures5884worker2 # [ 112.675502] nix-grpc-daemon[1511]: time=2026-09-20T08:06:28.670Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5885worker2 # [ 112.680057] nix-grpc-daemon[1511]: time=2026-09-20T08:06:28.673Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5886lb # [ 112.710308] niks3-server[1005]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5887lb # [ 112.718829] niks3-server[1005]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5888lb # [ 112.725504] niks3-server[1005]: 2026/09/20 08:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5889lb # [ 112.732677] niks3-server[1005]: 2026/09/20 08:06:28 INFO Signed narinfos id=38 count=15890worker2 # [ 112.730238] nix-grpc-daemon[1511]: time=2026-09-20T08:06:28.724Z level=INFO msg="Uploading 1 narinfos"5891lb # [ 112.740124] niks3-server[1005]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5892lb # [ 112.749734] niks3-server[1005]: 2026/09/20 08:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5893lb # [ 112.755073] niks3-server[1005]: 2026/09/20 08:06:28 INFO Completed upload id=385894lb # [ 112.759021] niks3-server[1005]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5895worker2 # [ 112.754530] nix-grpc-daemon[1511]: time=2026-09-20T08:06:28.749Z level=INFO msg="Upload complete. (282ms)"5896worker2 # [ 112.761692] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=15897worker2 # [ 112.772681] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:28Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05898worker2 # [ 112.777235] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:28Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=15899worker2 # [ 112.787660] nix-daemon[844]: reaped child process 1600, status = succeeded5900worker2 # [ 112.822789] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845901worker2 # [ 112.834564] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527845902worker2 # [ 112.847483] nix-grpc-daemon[1511]: time=2026-09-20T08:06:28.842Z level=INFO msg="All 1 paths already cached"5903client # copying 1 paths to 'lb:50051'...5904worker2 # [ 112.855475] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527845905client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5906worker2 # [ 112.875208] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5907worker2 # [ 113.032200] nix-daemon[844]: accepted connection from pid 1626, user nix-grpc-daemon (trusted)5908worker2 # [ 113.044840] nix-daemon[844]: reaped child process 1629, status = succeeded5909worker2 # [ 113.193461] nix-daemon[844]: accepted connection from pid 1631, user nix-grpc-daemon (trusted)5910worker2 # [ 113.205595] nix-daemon[844]: reaped child process 1634, status = succeeded5911lb # [ 113.221374] niks3-server[1005]: 2026/09/20 08:06:29 INFO Received uploads request method=POST path=/api/pending_closures5912worker2 # [ 113.222635] nix-grpc-daemon[1511]: time=2026-09-20T08:06:29.218Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5913worker2 # [ 113.224358] nix-grpc-daemon[1511]: time=2026-09-20T08:06:29.219Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5914lb # [ 113.246238] niks3-server[1005]: 2026/09/20 08:06:29 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5915lb # [ 113.251980] niks3-server[1005]: 2026/09/20 08:06:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5916worker2 # [ 113.253118] nix-grpc-daemon[1511]: time=2026-09-20T08:06:29.248Z level=INFO msg="Uploading 1 narinfos"5917lb # [ 113.256097] niks3-server[1005]: 2026/09/20 08:06:29 INFO Signed narinfos id=39 count=15918lb # [ 113.264654] niks3-server[1005]: 2026/09/20 08:06:29 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5919lb # [ 113.276870] niks3-server[1005]: 2026/09/20 08:06:29 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5920lb # [ 113.279512] niks3-server[1005]: 2026/09/20 08:06:29 INFO Completed upload id=395921worker2 # [ 113.276562] nix-grpc-daemon[1511]: time=2026-09-20T08:06:29.271Z level=INFO msg="Upload complete. (389ms)"5922worker2 # [ 113.278478] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=0 paths=1 nar_bytes_in=6405923worker2 # [ 113.281523] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845924lb # [ 113.286742] niks3-server[1005]: 2026/09/20 08:06:29 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5925worker2 # [ 113.286853] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5926worker2 # [ 113.291898] nix-daemon[844]: reaped child process 1624, status = succeeded5927worker2 # [ 113.296594] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5928client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5929client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5930client # farm-b> LOG-farm-b-during-drain5931worker2 # [ 114.715129] nix-daemon[844]: reaped child process 1638, status = succeeded5932worker2 # [ 114.874197] nix-daemon[844]: accepted connection from pid 1653, user nix-grpc-daemon (trusted)5933worker2 # [ 114.888417] nix-daemon[844]: reaped child process 1656, status = succeeded5934lb # [ 114.909960] niks3-server[1005]: 2026/09/20 08:06:30 INFO Received uploads request method=POST path=/api/pending_closures5935worker2 # [ 114.918411] nix-grpc-daemon[1511]: time=2026-09-20T08:06:30.912Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5936worker2 # [ 114.919764] nix-grpc-daemon[1511]: time=2026-09-20T08:06:30.912Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5937lb # [ 114.953452] niks3-server[1005]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5938lb # [ 114.958164] niks3-server[1005]: 2026/09/20 08:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5939lb # [ 114.961664] niks3-server[1005]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5940lb # [ 114.965722] niks3-server[1005]: 2026/09/20 08:06:30 INFO Signed narinfos id=40 count=15941worker2 # [ 114.965441] nix-grpc-daemon[1511]: time=2026-09-20T08:06:30.960Z level=INFO msg="Uploading 1 narinfos"5942lb # [ 114.973281] niks3-server[1005]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5943lb # [ 114.980507] niks3-server[1005]: 2026/09/20 08:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5944lb # [ 114.986142] niks3-server[1005]: 2026/09/20 08:06:30 INFO Completed upload id=405945worker2 # [ 114.983314] nix-grpc-daemon[1511]: time=2026-09-20T08:06:30.978Z level=INFO msg="Upload complete. (279ms)"5946lb # [ 114.987908] niks3-server[1005]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5947worker2 # [ 114.986820] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=15948worker2 # [ 114.993675] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:30Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05949worker2 # [ 114.995670] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:30Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=15950worker2 # [ 115.000656] nix-daemon[844]: reaped child process 1636, status = succeeded5951worker2 # [ 115.036817] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845952worker2 # [ 115.045702] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527845953worker2 # [ 115.054349] nix-grpc-daemon[1511]: time=2026-09-20T08:06:31.049Z level=INFO msg="All 2 paths already cached"5954client # copying 1 paths to 'lb:50051'...5955client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5956worker2 # [ 115.058634] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527845957worker2 # [ 115.064509] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5958worker2 # [ 115.231507] nix-daemon[844]: accepted connection from pid 1662, user nix-grpc-daemon (trusted)5959worker2 # [ 115.249932] nix-daemon[844]: reaped child process 1665, status = succeeded5960worker2 # [ 115.401764] nix-daemon[844]: accepted connection from pid 1667, user nix-grpc-daemon (trusted)5961worker2 # [ 115.413942] nix-daemon[844]: reaped child process 1670, status = succeeded5962lb # [ 115.432237] niks3-server[1005]: 2026/09/20 08:06:31 INFO Received uploads request method=POST path=/api/pending_closures5963worker2 # [ 115.437328] nix-grpc-daemon[1511]: time=2026-09-20T08:06:31.432Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5964worker2 # [ 115.438776] nix-grpc-daemon[1511]: time=2026-09-20T08:06:31.432Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5965lb # [ 115.455081] niks3-server[1005]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5966lb # [ 115.467335] niks3-server[1005]: 2026/09/20 08:06:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5967worker2 # [ 115.469350] nix-grpc-daemon[1511]: time=2026-09-20T08:06:31.464Z level=INFO msg="Uploading 1 narinfos"5968lb # [ 115.472643] niks3-server[1005]: 2026/09/20 08:06:31 INFO Signed narinfos id=41 count=15969lb # [ 115.477942] niks3-server[1005]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5970lb # [ 115.489470] niks3-server[1005]: 2026/09/20 08:06:31 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5971worker2 # [ 115.493484] nix-grpc-daemon[1511]: time=2026-09-20T08:06:31.488Z level=INFO msg="Upload complete. (421ms)"5972lb # [ 115.496651] niks3-server[1005]: 2026/09/20 08:06:31 INFO Completed upload id=415973worker2 # [ 115.495614] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=0 paths=1 nar_bytes_in=7685974lb # [ 115.500337] niks3-server[1005]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5975worker2 # [ 115.501681] nix-daemon[844]: reaped child process 1660, status = succeeded5976worker2 # [ 115.503377] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527845977worker2 # [ 115.507531] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5978worker2 # [ 115.513236] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5979client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5980client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5981client # farm-top> LOG-farm-top-during-drain5982worker2 # [ 116.337288] nix-daemon[844]: reaped child process 1674, status = succeeded5983worker2 # [ 116.487604] nix-daemon[844]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)5984worker2 # [ 116.500379] nix-daemon[844]: reaped child process 1692, status = succeeded5985lb # [ 116.518704] niks3-server[1005]: 2026/09/20 08:06:32 INFO Received uploads request method=POST path=/api/pending_closures5986worker2 # [ 116.713639] nix-grpc-daemon[1511]: time=2026-09-20T08:06:32.708Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5987worker2 # [ 116.722081] nix-grpc-daemon[1511]: time=2026-09-20T08:06:32.708Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5988lb # [ 116.736893] niks3-server[1005]: 2026/09/20 08:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5989lb # [ 116.739054] niks3-server[1005]: 2026/09/20 08:06:32 INFO Signed narinfos id=42 count=15990lb # [ 116.740805] niks3-server[1005]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5991worker2 # [ 116.736660] nix-grpc-daemon[1511]: time=2026-09-20T08:06:32.731Z level=INFO msg="Uploading 1 narinfos"5992lb # [ 116.747603] niks3-server[1005]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5993lb # [ 116.754851] niks3-server[1005]: 2026/09/20 08:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5994lb # [ 116.760781] niks3-server[1005]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5995lb # [ 116.766140] niks3-server[1005]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo5996lb # [ 116.770954] niks3-server[1005]: 2026/09/20 08:06:32 INFO Completed upload id=425997worker2 # [ 116.767960] nix-grpc-daemon[1511]: time=2026-09-20T08:06:32.763Z level=INFO msg="Upload complete. (445ms)"5998worker2 # [ 116.771123] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=15999worker2 # [ 116.778207] nix-daemon[844]: reaped child process 1672, status = succeeded6000client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 6.07 seconds)6001client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6002client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6003worker1: must succeed: pkill -f 'read -t [9]0 x'6004worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6005client: waiting for success: ! systemctl is-active sw6006worker1 # [ 117.050765] nix-daemon[844]: reaped child process 1482, status = succeeded6007worker1 # [ 117.173399] nix-daemon[844]: accepted connection from pid 1522, user nix-grpc-daemon (trusted)6008worker1 # [ 117.187127] nix-daemon[844]: reaped child process 1525, status = succeeded6009lb # [ 117.207593] niks3-server[1005]: 2026/09/20 08:06:33 INFO Received uploads request method=POST path=/api/pending_closures6010worker1 # [ 117.207416] nix-grpc-daemon[1374]: time=2026-09-20T08:06:33.235Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6011worker1 # [ 117.209839] nix-grpc-daemon[1374]: time=2026-09-20T08:06:33.237Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6012lb # [ 117.243577] niks3-server[1005]: 2026/09/20 08:06:33 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6013lb # [ 117.249609] niks3-server[1005]: 2026/09/20 08:06:33 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6014lb # [ 117.259852] niks3-server[1005]: 2026/09/20 08:06:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6015worker1 # [ 117.255419] nix-grpc-daemon[1374]: time=2026-09-20T08:06:33.283Z level=INFO msg="Uploading 1 narinfos"6016lb # [ 117.265584] niks3-server[1005]: 2026/09/20 08:06:33 INFO Signed narinfos id=43 count=16017lb # [ 117.267866] niks3-server[1005]: 2026/09/20 08:06:33 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6018lb # [ 117.273950] niks3-server[1005]: 2026/09/20 08:06:33 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6019lb # [ 117.276706] niks3-server[1005]: 2026/09/20 08:06:33 INFO Completed upload id=436020worker1 # [ 117.266585] nix-grpc-daemon[1374]: time=2026-09-20T08:06:33.294Z level=INFO msg="Upload complete. (224ms)"6021lb # [ 117.278382] niks3-server[1005]: 2026/09/20 08:06:33 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6022worker1 # [ 117.272849] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60196 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=16023worker1 # [ 117.283234] nix-daemon[844]: reaped child process 1480, status = succeeded6024client # [ 117.295951] systemd[1]: sw.service: Deactivated successfully.6025client # [ 117.297568] systemd[1]: sw.service: Consumed 103ms CPU time over 9.139s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.6026lb # [ 117.636262] envoy[913]: conn peer=[2001:db8:1::1]:41318 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=757 ms=33626027lb # [ 117.637826] envoy[913]: conn peer=[2001:db8:1::1]:41336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9416 tx=3811 ms=58656028lb # [ 117.639171] envoy[913]: conn peer=[2001:db8:1::1]:41320 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1307 ms=89336029worker1 # [ 117.831803] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:33Z level=info event=signal_exit6030client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6031client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6032client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6033worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6034worker2 # [ 119.062948] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:480686035worker2 # [ 119.066687] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:35Z level=info event=worker_gone addr=192.168.1.3:500516036worker1 # [ 119.055817] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:35Z level=info event=scheduler_restarting6037worker1 # [ 119.068619] nix-grpc-daemon[1314]: ts=2026-09-20T08:06:35Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6038worker1 # [ 119.087690] nix-daemon[844]: reaped child process 1367, status = succeeded6039worker1 # [ 119.714337] nix-grpc-daemon[1314]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6040worker1 # [ 119.716093] nix-grpc-daemon[1314]: E0000 00:00:1789891595.742629 1357 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true6041worker1 # [ 119.718026] nix-grpc-daemon[1314]: E0000 00:00:1789891595.744313 1357 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6042worker1 # [ 119.857495] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6043worker1 # [ 119.859264] systemd[1]: nix-grpc-daemon.service: Consumed 777ms CPU time over 26.174s wall clock time, 30.6M memory peak, 23.8K incoming IP traffic, 32.8K outgoing IP traffic.6044worker1 # [ 119.866610] systemd[1]: Starting Nix worker-protocol over gRPC...6045worker1 # [ 120.001839] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6046worker1 # [ 120.005038] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16047worker1 # [ 120.011092] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6048worker1 # [ 120.012637] systemd[1]: Started Nix worker-protocol over gRPC.6049worker1 # [ 120.024921] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500516050worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.90 seconds)6051lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6052lb: must succeed: curl -sf localhost:9901/clusters6053worker2 # [ 120.033350] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06054lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6055lb: must succeed: curl -sf localhost:9901/clusters6056lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6057lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds)6058lb: must succeed: curl -sf localhost:9901/clusters6059lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6060worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6061worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)6062(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.07 seconds)6063subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6064client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16065worker2 # [ 121.362403] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:527846066worker2 # [ 121.378099] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:37Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06067worker2 # [ 121.382668] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:37Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16068worker2 # [ 121.387158] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:37Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06069worker2 # [ 121.391565] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:37Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06070worker1 # [ 121.420295] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446071worker1 # [ 121.431106] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6072worker1 # [ 121.448222] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)6073worker1 # [ 121.453864] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)6074worker1 # [ 121.595807] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 132 ms (attempt 3/5)6075worker1 # [ 121.730693] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 4/5)6076worker1 # [ 121.772445] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6077worker1 # [ 121.783048] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446078worker1 # [ 121.789539] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446079worker1 # [ 121.794850] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6080worker1 # [ 121.804079] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:37Z level=info event=niks3_push_started pid=15956081worker1 # [ 122.095057] nix-daemon[844]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6082worker1 # [ 122.108890] nix-daemon[844]: reaped child process 1611, status = succeeded6083worker1 # [ 122.257074] nix-daemon[844]: accepted connection from pid 1613, user nix-grpc-daemon (trusted)6084worker1 # [ 122.273062] nix-daemon[844]: reaped child process 1616, status = succeeded6085lb # [ 122.289585] niks3-server[1005]: 2026/09/20 08:06:38 INFO Received uploads request method=POST path=/api/pending_closures6086worker1 # [ 122.293369] nix-grpc-daemon[1595]: time=2026-09-20T08:06:38.320Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6087worker1 # [ 122.294768] nix-grpc-daemon[1595]: time=2026-09-20T08:06:38.320Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6088lb # [ 122.330186] niks3-server[1005]: 2026/09/20 08:06:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6089lb # [ 122.334720] niks3-server[1005]: 2026/09/20 08:06:38 INFO Signed narinfos id=44 count=16090worker1 # [ 122.324606] nix-grpc-daemon[1595]: time=2026-09-20T08:06:38.352Z level=INFO msg="Uploading 1 narinfos"6091lb # [ 122.337195] niks3-server[1005]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6092lb # [ 122.340896] niks3-server[1005]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6093lb # [ 122.346414] niks3-server[1005]: 2026/09/20 08:06:38 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6094lb # [ 122.350445] niks3-server[1005]: 2026/09/20 08:06:38 INFO Completed upload id=446095worker1 # [ 122.341576] nix-grpc-daemon[1595]: time=2026-09-20T08:06:38.369Z level=INFO msg="Upload complete. (393ms)"6096lb # [ 122.353366] niks3-server[1005]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6097worker1 # [ 122.345049] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=5046098worker1 # [ 122.348147] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446099worker1 # [ 122.353148] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6100worker1 # [ 122.359150] nix-daemon[844]: reaped child process 1593, status = succeeded6101worker1 # [ 122.363353] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6102worker1 # [ 123.177523] nix-daemon[844]: reaped child process 1620, status = succeeded6103worker1 # [ 123.319087] nix-daemon[844]: accepted connection from pid 1635, user nix-grpc-daemon (trusted)6104worker1 # [ 123.330793] nix-daemon[844]: reaped child process 1638, status = succeeded6105lb # [ 123.354138] niks3-server[1005]: 2026/09/20 08:06:39 INFO Received uploads request method=POST path=/api/pending_closures6106worker1 # [ 123.348587] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.376Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6107worker1 # [ 123.350616] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.378Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6108lb # [ 123.378025] niks3-server[1005]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6109lb # [ 123.381586] niks3-server[1005]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6110lb # [ 123.385732] niks3-server[1005]: 2026/09/20 08:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6111lb # [ 123.388199] niks3-server[1005]: 2026/09/20 08:06:39 INFO Signed narinfos id=45 count=16112worker1 # [ 123.380078] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.407Z level=INFO msg="Uploading 1 narinfos"6113lb # [ 123.391769] niks3-server[1005]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6114lb # [ 123.397557] niks3-server[1005]: 2026/09/20 08:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6115lb # [ 123.401476] niks3-server[1005]: 2026/09/20 08:06:39 INFO Completed upload id=456116worker1 # [ 123.392437] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.420Z level=INFO msg="Upload complete. (223ms)"6117lb # [ 123.403062] niks3-server[1005]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6118worker1 # [ 123.395576] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=16119worker2 # [ 123.404715] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:39Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16120worker1 # [ 123.402709] nix-daemon[844]: reaped child process 1618, status = succeeded6121worker2 # [ 123.414511] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:39Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06122worker1 # [ 123.440028] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446123worker1 # [ 123.448707] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446124worker1 # [ 123.457860] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446125worker1 # [ 123.466152] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6126worker1 # [ 123.601929] nix-daemon[844]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6127worker1 # [ 123.614679] nix-daemon[844]: reaped child process 1645, status = succeeded6128worker1 # [ 123.746706] nix-daemon[844]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)6129worker1 # [ 123.759491] nix-daemon[844]: reaped child process 1650, status = succeeded6130lb # [ 123.779096] niks3-server[1005]: 2026/09/20 08:06:39 INFO Received uploads request method=POST path=/api/pending_closures6131worker1 # [ 123.777022] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.805Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6132worker1 # [ 123.779000] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.806Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6133lb # [ 123.804651] niks3-server[1005]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6134lb # [ 123.817842] niks3-server[1005]: 2026/09/20 08:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6135lb # [ 123.823397] niks3-server[1005]: 2026/09/20 08:06:39 INFO Signed narinfos id=46 count=16136worker1 # [ 123.816385] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.844Z level=INFO msg="Uploading 1 narinfos"6137lb # [ 123.830376] niks3-server[1005]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6138lb # [ 123.840165] niks3-server[1005]: 2026/09/20 08:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6139worker1 # [ 123.835579] nix-grpc-daemon[1595]: time=2026-09-20T08:06:39.864Z level=INFO msg="Upload complete. (363ms)"6140lb # [ 123.845834] niks3-server[1005]: 2026/09/20 08:06:39 INFO Completed upload id=466141worker1 # [ 123.837726] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=5046142lb # [ 123.851408] niks3-server[1005]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6143worker1 # [ 123.843458] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446144worker1 # [ 123.851505] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6145worker1 # [ 123.856837] nix-daemon[844]: reaped child process 1640, status = succeeded6146worker1 # [ 123.862514] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6147worker1 # [ 125.090195] nix-daemon[844]: reaped child process 1654, status = succeeded6148worker1 # [ 125.244217] nix-daemon[844]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6149worker1 # [ 125.255786] nix-daemon[844]: reaped child process 1672, status = succeeded6150lb # [ 125.281734] niks3-server[1005]: 2026/09/20 08:06:41 INFO Received uploads request method=POST path=/api/pending_closures6151worker1 # [ 125.279405] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.307Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6152worker1 # [ 125.281742] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.309Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6153lb # [ 125.322647] niks3-server[1005]: 2026/09/20 08:06:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6154lb # [ 125.328265] niks3-server[1005]: 2026/09/20 08:06:41 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6155lb # [ 125.334392] niks3-server[1005]: 2026/09/20 08:06:41 INFO Signed narinfos id=47 count=16156worker1 # [ 125.327427] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.355Z level=INFO msg="Uploading 1 narinfos"6157lb # [ 125.340597] niks3-server[1005]: 2026/09/20 08:06:41 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6158lb # [ 125.348712] niks3-server[1005]: 2026/09/20 08:06:41 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6159lb # [ 125.355860] niks3-server[1005]: 2026/09/20 08:06:41 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6160lb # [ 125.382488] niks3-server[1005]: 2026/09/20 08:06:41 INFO Completed upload id=476161worker1 # [ 125.372651] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.400Z level=INFO msg="Upload complete. (302ms)"6162lb # [ 125.386325] niks3-server[1005]: 2026/09/20 08:06:41 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6163worker1 # [ 125.378679] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16164worker2 # [ 125.388742] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:41Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16165worker1 # [ 125.389553] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446166worker2 # [ 125.399195] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:41Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06167worker1 # [ 125.401950] nix-daemon[844]: reaped child process 1652, status = succeeded6168worker1 # [ 125.404457] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446169worker1 # [ 125.414540] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446170worker1 # [ 125.422829] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6171worker1 # [ 125.565789] nix-daemon[844]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)6172worker1 # [ 125.577869] nix-daemon[844]: reaped child process 1679, status = succeeded6173worker1 # [ 125.737252] nix-daemon[844]: accepted connection from pid 1681, user nix-grpc-daemon (trusted)6174worker1 # [ 125.747940] nix-daemon[844]: reaped child process 1684, status = succeeded6175lb # [ 125.773494] niks3-server[1005]: 2026/09/20 08:06:41 INFO Received uploads request method=POST path=/api/pending_closures6176worker1 # [ 125.771022] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.799Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6177worker1 # [ 125.772619] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.801Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6178lb # [ 125.806853] niks3-server[1005]: 2026/09/20 08:06:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6179lb # [ 125.811099] niks3-server[1005]: 2026/09/20 08:06:41 INFO Signed narinfos id=48 count=16180worker1 # [ 125.803743] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.832Z level=INFO msg="Uploading 1 narinfos"6181lb # [ 125.820077] niks3-server[1005]: 2026/09/20 08:06:41 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6182lb # [ 125.875637] niks3-server[1005]: 2026/09/20 08:06:41 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6183lb # [ 125.880907] niks3-server[1005]: 2026/09/20 08:06:41 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6184lb # [ 125.885965] niks3-server[1005]: 2026/09/20 08:06:41 INFO Completed upload id=486185lb # [ 125.888520] niks3-server[1005]: 2026/09/20 08:06:41 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6186worker1 # [ 125.877366] nix-grpc-daemon[1595]: time=2026-09-20T08:06:41.905Z level=INFO msg="Upload complete. (446ms)"6187worker1 # [ 125.881929] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=5046188worker1 # [ 125.888338] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446189worker1 # [ 125.901157] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6190worker1 # [ 125.911348] nix-daemon[844]: reaped child process 1674, status = succeeded6191worker1 # [ 125.919964] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6192worker1 # [ 127.539315] nix-daemon[844]: reaped child process 1688, status = succeeded6193lb # [ 127.637917] envoy[913]: conn peer=[2001:db8:1::3]:33560 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1165 tx=359 ms=252316194worker1 # [ 127.664786] nix-daemon[844]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)6195worker1 # [ 127.677878] nix-daemon[844]: reaped child process 1706, status = succeeded6196lb # [ 127.703665] niks3-server[1005]: 2026/09/20 08:06:43 INFO Received uploads request method=POST path=/api/pending_closures6197worker1 # [ 127.698948] nix-grpc-daemon[1595]: time=2026-09-20T08:06:43.727Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6198worker1 # [ 127.702058] nix-grpc-daemon[1595]: time=2026-09-20T08:06:43.729Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6199lb # [ 127.727358] niks3-server[1005]: 2026/09/20 08:06:43 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6200lb # [ 127.732861] niks3-server[1005]: 2026/09/20 08:06:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6201lb # [ 127.737441] niks3-server[1005]: 2026/09/20 08:06:43 INFO Signed narinfos id=49 count=16202worker1 # [ 127.726953] nix-grpc-daemon[1595]: time=2026-09-20T08:06:43.755Z level=INFO msg="Uploading 1 narinfos"6203lb # [ 127.739609] niks3-server[1005]: 2026/09/20 08:06:43 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6204lb # [ 127.742640] niks3-server[1005]: 2026/09/20 08:06:43 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6205lb # [ 127.750380] niks3-server[1005]: 2026/09/20 08:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6206lb # [ 127.754213] niks3-server[1005]: 2026/09/20 08:06:43 INFO Completed upload id=496207lb # [ 127.756205] niks3-server[1005]: 2026/09/20 08:06:43 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6208worker1 # [ 127.745752] nix-grpc-daemon[1595]: time=2026-09-20T08:06:43.774Z level=INFO msg="Upload complete. (214ms)"6209worker1 # [ 127.749274] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16210worker1 # [ 127.754419] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446211worker2 # [ 127.758965] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:43Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16212worker2 # [ 127.766798] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:43Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06213worker1 # [ 127.762965] nix-daemon[844]: reaped child process 1686, status = succeeded6214worker1 # [ 127.764735] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446215worker1 # [ 127.771498] nix-grpc-daemon[1595]: time=2026-09-20T08:06:43.799Z level=INFO msg="All 1 paths already cached"6216worker1 # [ 127.775260] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446217worker1 # [ 127.781089] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6218worker1 # [ 127.916333] nix-daemon[844]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)6219worker1 # [ 127.929654] nix-daemon[844]: reaped child process 1713, status = succeeded6220worker1 # [ 128.077100] nix-daemon[844]: accepted connection from pid 1715, user nix-grpc-daemon (trusted)6221worker1 # [ 128.090231] nix-daemon[844]: reaped child process 1718, status = succeeded6222lb # [ 128.112825] niks3-server[1005]: 2026/09/20 08:06:44 INFO Received uploads request method=POST path=/api/pending_closures6223worker1 # [ 128.107559] nix-grpc-daemon[1595]: time=2026-09-20T08:06:44.135Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6224worker1 # [ 128.109219] nix-grpc-daemon[1595]: time=2026-09-20T08:06:44.135Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6225lb # [ 128.127097] niks3-server[1005]: 2026/09/20 08:06:44 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6226lb # [ 128.132914] niks3-server[1005]: 2026/09/20 08:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6227lb # [ 128.135330] niks3-server[1005]: 2026/09/20 08:06:44 INFO Signed narinfos id=50 count=16228worker1 # [ 128.124915] nix-grpc-daemon[1595]: time=2026-09-20T08:06:44.153Z level=INFO msg="Uploading 1 narinfos"6229lb # [ 128.137873] niks3-server[1005]: 2026/09/20 08:06:44 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6230lb # [ 128.144764] niks3-server[1005]: 2026/09/20 08:06:44 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6231lb # [ 128.148134] niks3-server[1005]: 2026/09/20 08:06:44 INFO Completed upload id=506232worker1 # [ 128.137719] nix-grpc-daemon[1595]: time=2026-09-20T08:06:44.166Z level=INFO msg="Upload complete. (349ms)"6233lb # [ 128.149728] niks3-server[1005]: 2026/09/20 08:06:44 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6234worker1 # [ 128.140063] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=6246235worker1 # [ 128.143882] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446236worker1 # [ 128.150350] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6237worker1 # [ 128.152938] nix-daemon[844]: reaped child process 1708, status = succeeded6238worker1 # [ 128.158881] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6239worker1 # [ 129.173399] nix-daemon[844]: reaped child process 1722, status = succeeded6240worker1 # [ 129.291782] nix-daemon[844]: accepted connection from pid 1737, user nix-grpc-daemon (trusted)6241worker1 # [ 129.305074] nix-daemon[844]: reaped child process 1740, status = succeeded6242lb # [ 129.326526] niks3-server[1005]: 2026/09/20 08:06:45 INFO Received uploads request method=POST path=/api/pending_closures6243worker1 # [ 129.326317] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.352Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6244worker1 # [ 129.327667] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.353Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6245lb # [ 129.367313] niks3-server[1005]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6246lb # [ 129.382572] niks3-server[1005]: 2026/09/20 08:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6247lb # [ 129.387825] niks3-server[1005]: 2026/09/20 08:06:45 INFO Signed narinfos id=51 count=16248worker1 # [ 129.380760] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.408Z level=INFO msg="Uploading 1 narinfos"6249lb # [ 129.395896] niks3-server[1005]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6250lb # [ 129.399098] niks3-server[1005]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6251lb # [ 129.404164] niks3-server[1005]: 2026/09/20 08:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6252lb # [ 129.407636] niks3-server[1005]: 2026/09/20 08:06:45 INFO Completed upload id=516253lb # [ 129.409133] niks3-server[1005]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6254worker1 # [ 129.397585] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.425Z level=INFO msg="Upload complete. (233ms)"6255worker1 # [ 129.402890] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16256worker2 # [ 129.414864] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:45Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16257worker1 # [ 129.410881] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446258worker2 # [ 129.420551] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:45Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06259worker1 # [ 129.421539] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446260worker1 # [ 129.424535] nix-daemon[844]: reaped child process 1720, status = succeeded6261worker1 # [ 129.428566] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.457Z level=INFO msg="All 1 paths already cached"6262worker1 # [ 129.432460] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446263worker1 # [ 129.436365] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6264worker1 # [ 129.592332] nix-daemon[844]: accepted connection from pid 1744, user nix-grpc-daemon (trusted)6265worker1 # [ 129.606167] nix-daemon[844]: reaped child process 1747, status = succeeded6266worker1 # [ 129.754379] nix-daemon[844]: accepted connection from pid 1749, user nix-grpc-daemon (trusted)6267worker1 # [ 129.766301] nix-daemon[844]: reaped child process 1752, status = succeeded6268lb # [ 129.791560] niks3-server[1005]: 2026/09/20 08:06:45 INFO Received uploads request method=POST path=/api/pending_closures6269worker1 # [ 129.786365] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.814Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6270worker1 # [ 129.787905] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.816Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6271lb # [ 129.810813] niks3-server[1005]: 2026/09/20 08:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6272lb # [ 129.813266] niks3-server[1005]: 2026/09/20 08:06:45 INFO Signed narinfos id=52 count=16273worker1 # [ 129.803151] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.831Z level=INFO msg="Uploading 1 narinfos"6274lb # [ 129.814798] niks3-server[1005]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6275lb # [ 129.823277] niks3-server[1005]: 2026/09/20 08:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6276lb # [ 129.853058] niks3-server[1005]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6277lb # [ 129.856508] niks3-server[1005]: 2026/09/20 08:06:45 INFO Completed upload id=526278worker1 # [ 129.846510] nix-grpc-daemon[1595]: time=2026-09-20T08:06:45.874Z level=INFO msg="Upload complete. (404ms)"6279lb # [ 129.859910] niks3-server[1005]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6280worker1 # [ 129.849074] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=6246281worker1 # [ 129.852346] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446282worker1 # [ 129.860499] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6283worker1 # [ 129.863796] nix-daemon[844]: reaped child process 1742, status = succeeded6284worker1 # [ 129.868621] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6285worker1 # [ 130.899823] nix-daemon[844]: reaped child process 1756, status = succeeded6286worker1 # [ 131.027419] nix-daemon[844]: accepted connection from pid 1771, user nix-grpc-daemon (trusted)6287worker1 # [ 131.039513] nix-daemon[844]: reaped child process 1774, status = succeeded6288lb # [ 131.062641] niks3-server[1005]: 2026/09/20 08:06:46 INFO Received uploads request method=POST path=/api/pending_closures6289worker1 # [ 131.056954] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.085Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6290worker1 # [ 131.058543] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.086Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6291lb # [ 131.088409] niks3-server[1005]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6292lb # [ 131.091097] niks3-server[1005]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6293lb # [ 131.094152] niks3-server[1005]: 2026/09/20 08:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6294lb # [ 131.096828] niks3-server[1005]: 2026/09/20 08:06:47 INFO Signed narinfos id=53 count=16295worker1 # [ 131.088043] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.116Z level=INFO msg="Uploading 1 narinfos"6296lb # [ 131.100208] niks3-server[1005]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6297lb # [ 131.104907] niks3-server[1005]: 2026/09/20 08:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6298lb # [ 131.108513] niks3-server[1005]: 2026/09/20 08:06:47 INFO Completed upload id=536299worker1 # [ 131.099539] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.127Z level=INFO msg="Upload complete. (224ms)"6300lb # [ 131.110045] niks3-server[1005]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6301worker1 # [ 131.102364] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16302worker2 # [ 131.111993] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:47Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16303worker1 # [ 131.107182] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446304worker2 # [ 131.116595] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:47Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06305worker1 # [ 131.114398] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446306worker1 # [ 131.116898] nix-daemon[844]: reaped child process 1754, status = succeeded6307worker1 # [ 131.120626] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.149Z level=INFO msg="All 1 paths already cached"6308worker1 # [ 131.123957] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446309worker1 # [ 131.127785] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6310worker1 # [ 131.280409] nix-daemon[844]: accepted connection from pid 1778, user nix-grpc-daemon (trusted)6311worker1 # [ 131.292402] nix-daemon[844]: reaped child process 1781, status = succeeded6312worker1 # [ 131.450594] nix-daemon[844]: accepted connection from pid 1783, user nix-grpc-daemon (trusted)6313worker1 # [ 131.463241] nix-daemon[844]: reaped child process 1786, status = succeeded6314lb # [ 131.486960] niks3-server[1005]: 2026/09/20 08:06:47 INFO Received uploads request method=POST path=/api/pending_closures6315worker1 # [ 131.484680] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.513Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6316worker1 # [ 131.486662] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.514Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6317lb # [ 131.517206] niks3-server[1005]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6318lb # [ 131.526326] niks3-server[1005]: 2026/09/20 08:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6319lb # [ 131.532952] niks3-server[1005]: 2026/09/20 08:06:47 INFO Signed narinfos id=54 count=16320worker1 # [ 131.525903] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.554Z level=INFO msg="Uploading 1 narinfos"6321lb # [ 131.538225] niks3-server[1005]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6322lb # [ 131.550182] niks3-server[1005]: 2026/09/20 08:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6323worker1 # [ 131.546611] nix-grpc-daemon[1595]: time=2026-09-20T08:06:47.574Z level=INFO msg="Upload complete. (412ms)"6324lb # [ 131.556892] niks3-server[1005]: 2026/09/20 08:06:47 INFO Completed upload id=546325worker1 # [ 131.549809] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=6246326lb # [ 131.560153] niks3-server[1005]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6327worker1 # [ 131.554091] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446328worker1 # [ 131.560124] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6329worker1 # [ 131.562503] nix-daemon[844]: reaped child process 1776, status = succeeded6330worker1 # [ 131.569092] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6331worker1 # [ 132.183171] nix-daemon[844]: reaped child process 1790, status = succeeded6332worker1 # [ 132.323666] nix-daemon[844]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6333worker1 # [ 132.337407] nix-daemon[844]: reaped child process 1808, status = succeeded6334lb # [ 132.363464] niks3-server[1005]: 2026/09/20 08:06:48 INFO Received uploads request method=POST path=/api/pending_closures6335worker1 # [ 132.410838] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.438Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6336worker1 # [ 132.412391] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.438Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6337lb # [ 132.447046] niks3-server[1005]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6338lb # [ 132.452154] niks3-server[1005]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6339lb # [ 132.458088] niks3-server[1005]: 2026/09/20 08:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6340lb # [ 132.464443] niks3-server[1005]: 2026/09/20 08:06:48 INFO Signed narinfos id=55 count=16341worker1 # [ 132.455078] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.482Z level=INFO msg="Uploading 1 narinfos"6342lb # [ 132.469575] niks3-server[1005]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6343lb # [ 132.479258] niks3-server[1005]: 2026/09/20 08:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6344lb # [ 132.501437] niks3-server[1005]: 2026/09/20 08:06:48 INFO Completed upload id=556345worker1 # [ 132.493793] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.522Z level=INFO msg="Upload complete. (319ms)"6346lb # [ 132.504801] niks3-server[1005]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6347worker1 # [ 132.496494] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16348worker2 # [ 132.507359] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:48Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16349worker1 # [ 132.504119] nix-daemon[844]: reaped child process 1788, status = succeeded6350worker1 # [ 132.541839] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446351worker2 # [ 132.552695] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:48Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06352worker1 # [ 132.554428] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446353worker1 # [ 132.562610] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.591Z level=INFO msg="All 2 paths already cached"6354worker1 # [ 132.567101] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446355worker1 # [ 132.572078] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6356worker1 # [ 132.728630] nix-daemon[844]: accepted connection from pid 1812, user nix-grpc-daemon (trusted)6357worker1 # [ 132.741736] nix-daemon[844]: reaped child process 1815, status = succeeded6358worker1 # [ 132.888103] nix-daemon[844]: accepted connection from pid 1817, user nix-grpc-daemon (trusted)6359worker1 # [ 132.902747] nix-daemon[844]: reaped child process 1820, status = succeeded6360lb # [ 132.922857] niks3-server[1005]: 2026/09/20 08:06:48 INFO Received uploads request method=POST path=/api/pending_closures6361worker1 # [ 132.920778] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.948Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6362worker1 # [ 132.922164] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.948Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6363lb # [ 132.954754] niks3-server[1005]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6364lb # [ 132.965449] niks3-server[1005]: 2026/09/20 08:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6365lb # [ 132.970251] niks3-server[1005]: 2026/09/20 08:06:48 INFO Signed narinfos id=56 count=16366worker1 # [ 132.962700] nix-grpc-daemon[1595]: time=2026-09-20T08:06:48.990Z level=INFO msg="Uploading 1 narinfos"6367lb # [ 132.976044] niks3-server[1005]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6368lb # [ 132.986547] niks3-server[1005]: 2026/09/20 08:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6369lb # [ 132.991334] niks3-server[1005]: 2026/09/20 08:06:48 INFO Completed upload id=566370worker1 # [ 132.980888] nix-grpc-daemon[1595]: time=2026-09-20T08:06:49.009Z level=INFO msg="Upload complete. (403ms)"6371lb # [ 132.996815] niks3-server[1005]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6372worker1 # [ 132.984378] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=7526373worker1 # [ 132.990530] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446374worker1 # [ 132.998324] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6375worker1 # [ 133.004341] nix-daemon[844]: reaped child process 1810, status = succeeded6376worker1 # [ 133.009670] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6377worker1 # [ 134.237273] nix-daemon[844]: reaped child process 1824, status = succeeded6378worker1 # [ 134.389893] nix-daemon[844]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6379worker1 # [ 134.403076] nix-daemon[844]: reaped child process 1842, status = succeeded6380lb # [ 134.423276] niks3-server[1005]: 2026/09/20 08:06:50 INFO Received uploads request method=POST path=/api/pending_closures6381worker1 # [ 134.420974] nix-grpc-daemon[1595]: time=2026-09-20T08:06:50.449Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6382worker1 # [ 134.422907] nix-grpc-daemon[1595]: time=2026-09-20T08:06:50.451Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6383lb # [ 134.460203] niks3-server[1005]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6384lb # [ 134.467878] niks3-server[1005]: 2026/09/20 08:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6385lb # [ 134.474682] niks3-server[1005]: 2026/09/20 08:06:50 INFO Signed narinfos id=57 count=16386worker1 # [ 134.467412] nix-grpc-daemon[1595]: time=2026-09-20T08:06:50.495Z level=INFO msg="Uploading 1 narinfos"6387lb # [ 134.479141] niks3-server[1005]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6388lb # [ 134.484265] niks3-server[1005]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6389lb # [ 134.493152] niks3-server[1005]: 2026/09/20 08:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6390lb # [ 134.495867] niks3-server[1005]: 2026/09/20 08:06:50 INFO Completed upload id=576391worker1 # [ 134.485693] nix-grpc-daemon[1595]: time=2026-09-20T08:06:50.514Z level=INFO msg="Upload complete. (269ms)"6392lb # [ 134.498033] niks3-server[1005]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6393worker2 # [ 134.498370] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:50Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16394worker1 # [ 134.491554] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16395worker1 # [ 134.501794] nix-daemon[844]: reaped child process 1822, status = succeeded6396worker1 # [ 134.535822] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446397worker1 # [ 134.547645] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446398worker1 # [ 134.559758] nix-grpc-daemon[1595]: time=2026-09-20T08:06:50.588Z level=INFO msg="All 2 paths already cached"6399worker1 # [ 134.567234] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446400worker1 # [ 134.576150] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6401worker1 # [ 134.734853] nix-daemon[844]: accepted connection from pid 1846, user nix-grpc-daemon (trusted)6402worker1 # [ 134.751927] nix-daemon[844]: reaped child process 1849, status = succeeded6403worker1 # [ 134.916276] nix-daemon[844]: accepted connection from pid 1851, user nix-grpc-daemon (trusted)6404worker1 # [ 134.929325] nix-daemon[844]: reaped child process 1854, status = succeeded6405lb # [ 134.953390] niks3-server[1005]: 2026/09/20 08:06:50 INFO Received uploads request method=POST path=/api/pending_closures6406worker1 # [ 134.950796] nix-grpc-daemon[1595]: time=2026-09-20T08:06:50.979Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6407worker1 # [ 134.952702] nix-grpc-daemon[1595]: time=2026-09-20T08:06:50.980Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6408lb # [ 134.974565] niks3-server[1005]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6409lb # [ 134.978855] niks3-server[1005]: 2026/09/20 08:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6410lb # [ 134.980853] niks3-server[1005]: 2026/09/20 08:06:50 INFO Signed narinfos id=58 count=16411worker1 # [ 134.972113] nix-grpc-daemon[1595]: time=2026-09-20T08:06:51.000Z level=INFO msg="Uploading 1 narinfos"6412lb # [ 134.984696] niks3-server[1005]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6413lb # [ 134.989064] niks3-server[1005]: 2026/09/20 08:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6414lb # [ 134.992391] niks3-server[1005]: 2026/09/20 08:06:50 INFO Completed upload id=586415worker1 # [ 134.982292] nix-grpc-daemon[1595]: time=2026-09-20T08:06:51.010Z level=INFO msg="Upload complete. (396ms)"6416lb # [ 134.995265] niks3-server[1005]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6417worker1 # [ 134.984391] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=7526418worker1 # [ 134.987409] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446419worker1 # [ 134.993841] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6420worker1 # [ 134.997300] nix-daemon[844]: reaped child process 1844, status = succeeded6421worker1 # [ 135.002453] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6422worker1 # [ 135.816402] nix-daemon[844]: reaped child process 1858, status = succeeded6423worker1 # [ 135.947484] nix-daemon[844]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)6424worker1 # [ 135.959974] nix-daemon[844]: reaped child process 1876, status = succeeded6425lb # [ 135.984818] niks3-server[1005]: 2026/09/20 08:06:51 INFO Received uploads request method=POST path=/api/pending_closures6426worker1 # [ 135.979084] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.007Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6427worker1 # [ 135.981761] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.009Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6428lb # [ 136.000770] niks3-server[1005]: 2026/09/20 08:06:51 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6429lb # [ 136.006614] niks3-server[1005]: 2026/09/20 08:06:51 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6430lb # [ 136.009506] niks3-server[1005]: 2026/09/20 08:06:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6431lb # [ 136.011138] niks3-server[1005]: 2026/09/20 08:06:51 INFO Signed narinfos id=59 count=16432worker1 # [ 136.002265] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.030Z level=INFO msg="Uploading 1 narinfos"6433lb # [ 136.015806] niks3-server[1005]: 2026/09/20 08:06:51 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6434lb # [ 136.019713] niks3-server[1005]: 2026/09/20 08:06:51 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6435lb # [ 136.022550] niks3-server[1005]: 2026/09/20 08:06:51 INFO Completed upload id=596436worker1 # [ 136.012310] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.040Z level=INFO msg="Upload complete. (203ms)"6437lb # [ 136.024944] niks3-server[1005]: 2026/09/20 08:06:51 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6438worker1 # [ 136.014690] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16439worker2 # [ 136.023604] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:52Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16440worker1 # [ 136.022081] nix-daemon[844]: reaped child process 1856, status = succeeded6441worker1 # [ 136.059179] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446442worker1 # [ 136.067709] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608446443worker1 # [ 136.190247] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.218Z level=INFO msg="All 2 paths already cached"6444worker1 # [ 136.198422] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608446445worker1 # [ 136.210226] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6446worker1 # [ 136.367727] nix-daemon[844]: accepted connection from pid 1880, user nix-grpc-daemon (trusted)6447worker1 # [ 136.381178] nix-daemon[844]: reaped child process 1883, status = succeeded6448worker1 # [ 136.512306] nix-daemon[844]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)6449worker1 # [ 136.525591] nix-daemon[844]: reaped child process 1888, status = succeeded6450lb # [ 136.544415] niks3-server[1005]: 2026/09/20 08:06:52 INFO Received uploads request method=POST path=/api/pending_closures6451worker1 # [ 136.538502] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.566Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6452worker1 # [ 136.540230] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.568Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6453lb # [ 136.561109] niks3-server[1005]: 2026/09/20 08:06:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6454lb # [ 136.563202] niks3-server[1005]: 2026/09/20 08:06:52 INFO Signed narinfos id=60 count=16455worker1 # [ 136.553206] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.581Z level=INFO msg="Uploading 1 narinfos"6456lb # [ 136.566587] niks3-server[1005]: 2026/09/20 08:06:52 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6457lb # [ 136.570740] niks3-server[1005]: 2026/09/20 08:06:52 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6458lb # [ 136.573884] niks3-server[1005]: 2026/09/20 08:06:52 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6459lb # [ 136.577752] niks3-server[1005]: 2026/09/20 08:06:52 INFO Completed upload id=606460worker1 # [ 136.567397] nix-grpc-daemon[1595]: time=2026-09-20T08:06:52.595Z level=INFO msg="Upload complete. (350ms)"6461lb # [ 136.579242] niks3-server[1005]: 2026/09/20 08:06:52 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6462worker1 # [ 136.569315] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=0 paths=1 nar_bytes_in=7526463worker1 # [ 136.573413] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608446464worker1 # [ 136.578984] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6465worker1 # [ 136.581205] nix-daemon[844]: reaped child process 1878, status = succeeded6466worker1 # [ 136.587417] nix-daemon[844]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6467worker1 # [ 137.613656] nix-daemon[844]: reaped child process 1892, status = succeeded6468worker1 # [ 137.751788] nix-daemon[844]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)6469worker1 # [ 137.764219] nix-daemon[844]: reaped child process 1910, status = succeeded6470lb # [ 137.789835] niks3-server[1005]: 2026/09/20 08:06:53 INFO Received uploads request method=POST path=/api/pending_closures6471worker1 # [ 137.783793] nix-grpc-daemon[1595]: time=2026-09-20T08:06:53.811Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6472worker1 # [ 137.787064] nix-grpc-daemon[1595]: time=2026-09-20T08:06:53.813Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6473lb # [ 137.807555] niks3-server[1005]: 2026/09/20 08:06:53 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6474lb # [ 137.812712] niks3-server[1005]: 2026/09/20 08:06:53 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6475lb # [ 137.814248] niks3-server[1005]: 2026/09/20 08:06:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6476lb # [ 137.816051] niks3-server[1005]: 2026/09/20 08:06:53 INFO Signed narinfos id=61 count=16477worker1 # [ 137.805920] nix-grpc-daemon[1595]: time=2026-09-20T08:06:53.834Z level=INFO msg="Uploading 1 narinfos"6478lb # [ 137.819703] niks3-server[1005]: 2026/09/20 08:06:53 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6479lb # [ 137.824289] niks3-server[1005]: 2026/09/20 08:06:53 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6480lb # [ 137.931774] niks3-server[1005]: 2026/09/20 08:06:53 INFO Completed upload id=616481worker1 # [ 137.921705] nix-grpc-daemon[1595]: time=2026-09-20T08:06:53.950Z level=INFO msg="Upload complete. (328ms)"6482worker1 # [ 137.927541] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60844 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16483lb # [ 137.942066] niks3-server[1005]: 2026/09/20 08:06:53 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6484worker1 # [ 137.938851] nix-daemon[844]: reaped child process 1890, status = succeeded6485client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.77 seconds)6486worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6487worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.05 seconds)6488client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16489worker2 # [ 138.231598] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:527846490worker2 # [ 138.244648] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:54Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06491client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.24 seconds)6492(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 17.06 seconds)6493subtest: low disk drains a worker and builds go to the other6494worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6495worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds)6496worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6497worker1 # [ 140.020598] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:56Z level=info event=unhealthy reason=min_free6498worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6499client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26500worker1 # [ 140.573827] nix-grpc-daemon[1539]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:608446501client # don't know how to build these paths:6502client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6503worker2 # [ 140.593683] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:56Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06504worker2 # [ 140.595452] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:56Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16505worker2 # [ 140.636888] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527846506worker2 # [ 140.642910] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527846507client # copying 1 paths to 'lb:50051'...6508client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6509worker2 # [ 140.650683] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527846510worker2 # [ 140.660217] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6511worker2 # [ 140.822656] nix-daemon[844]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)6512worker2 # [ 140.834925] nix-daemon[844]: reaped child process 1722, status = succeeded6513worker2 # [ 140.960953] nix-daemon[844]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6514worker2 # [ 140.973645] nix-daemon[844]: reaped child process 1727, status = succeeded6515lb # [ 140.984561] niks3-server[1005]: 2026/09/20 08:06:56 INFO Received uploads request method=POST path=/api/pending_closures6516worker2 # [ 140.985616] nix-grpc-daemon[1511]: time=2026-09-20T08:06:56.980Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6517worker2 # [ 140.987451] nix-grpc-daemon[1511]: time=2026-09-20T08:06:56.982Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6518lb # [ 140.998470] niks3-server[1005]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6519lb # [ 141.002511] niks3-server[1005]: 2026/09/20 08:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6520worker2 # [ 141.001707] nix-grpc-daemon[1511]: time=2026-09-20T08:06:56.997Z level=INFO msg="Uploading 1 narinfos"6521lb # [ 141.004961] niks3-server[1005]: 2026/09/20 08:06:56 INFO Signed narinfos id=62 count=16522lb # [ 141.012609] niks3-server[1005]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6523lb # [ 141.021203] niks3-server[1005]: 2026/09/20 08:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6524lb # [ 141.023900] niks3-server[1005]: 2026/09/20 08:06:56 INFO Completed upload id=626525worker2 # [ 141.022133] nix-grpc-daemon[1511]: time=2026-09-20T08:06:57.017Z level=INFO msg="Upload complete. (350ms)"6526lb # [ 141.025507] niks3-server[1005]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6527worker2 # [ 141.024057] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=0 paths=1 nar_bytes_in=5126528worker2 # [ 141.026818] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527846529worker2 # [ 141.031780] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6530worker2 # [ 141.037913] nix-daemon[844]: reaped child process 1717, status = succeeded6531client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6532worker2 # [ 141.040654] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6533client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6534client # farm-a> LOG-farm-a-drain6535worker2 # [ 141.865293] nix-daemon[844]: reaped child process 1731, status = succeeded6536worker2 # [ 142.004725] nix-daemon[844]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)6537worker2 # [ 142.016695] nix-daemon[844]: reaped child process 1749, status = succeeded6538lb # [ 142.035113] niks3-server[1005]: 2026/09/20 08:06:57 INFO Received uploads request method=POST path=/api/pending_closures6539worker2 # [ 142.038751] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.033Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6540worker2 # [ 142.040655] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.035Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6541lb # [ 142.070788] niks3-server[1005]: 2026/09/20 08:06:57 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6542lb # [ 142.081519] niks3-server[1005]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6543lb # [ 142.093904] niks3-server[1005]: 2026/09/20 08:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6544lb # [ 142.097699] niks3-server[1005]: 2026/09/20 08:06:58 INFO Signed narinfos id=63 count=16545worker2 # [ 142.098379] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.093Z level=INFO msg="Uploading 1 narinfos"6546lb # [ 142.103074] niks3-server[1005]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6547lb # [ 142.113481] niks3-server[1005]: 2026/09/20 08:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6548lb # [ 142.117163] niks3-server[1005]: 2026/09/20 08:06:58 INFO Completed upload id=636549worker2 # [ 142.114170] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.109Z level=INFO msg="Upload complete. (266ms)"6550lb # [ 142.118723] niks3-server[1005]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6551worker2 # [ 142.117028] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16552worker2 # [ 142.125561] nix-daemon[844]: reaped child process 1729, status = succeeded6553worker2 # [ 142.163779] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06554worker2 # [ 142.168538] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16555worker2 # [ 142.174534] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527846556worker2 # [ 142.184680] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527846557worker2 # [ 142.194657] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.190Z level=INFO msg="All 1 paths already cached"6558client # copying 1 paths to 'lb:50051'...6559client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6560worker2 # [ 142.201685] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527846561worker2 # [ 142.209056] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6562worker2 # [ 142.356322] nix-daemon[844]: accepted connection from pid 1755, user nix-grpc-daemon (trusted)6563worker2 # [ 142.369860] nix-daemon[844]: reaped child process 1758, status = succeeded6564worker2 # [ 142.525268] nix-daemon[844]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)6565worker2 # [ 142.537749] nix-daemon[844]: reaped child process 1763, status = succeeded6566lb # [ 142.550469] niks3-server[1005]: 2026/09/20 08:06:58 INFO Received uploads request method=POST path=/api/pending_closures6567worker2 # [ 142.555975] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.551Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6568worker2 # [ 142.557554] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.552Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6569lb # [ 142.582139] niks3-server[1005]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6570lb # [ 142.594225] niks3-server[1005]: 2026/09/20 08:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6571worker2 # [ 142.597671] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.592Z level=INFO msg="Uploading 1 narinfos"6572lb # [ 142.600456] niks3-server[1005]: 2026/09/20 08:06:58 INFO Signed narinfos id=64 count=16573lb # [ 142.605126] niks3-server[1005]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6574lb # [ 142.617709] niks3-server[1005]: 2026/09/20 08:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6575lb # [ 142.622762] niks3-server[1005]: 2026/09/20 08:06:58 INFO Completed upload id=646576worker2 # [ 142.620118] nix-grpc-daemon[1511]: time=2026-09-20T08:06:58.615Z level=INFO msg="Upload complete. (402ms)"6577lb # [ 142.627615] niks3-server[1005]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6578worker2 # [ 142.623862] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=0 paths=1 nar_bytes_in=6246579worker2 # [ 142.629256] nix-grpc-daemon[1441]: ts=2026-09-20T08:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527846580worker2 # [ 142.639117] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6581worker2 # [ 142.649320] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6582client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6583worker2 # [ 142.651614] nix-daemon[844]: reaped child process 1753, status = succeeded6584client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6585client # farm-b> LOG-farm-b-drain6586worker2 # [ 144.076589] nix-daemon[844]: reaped child process 1767, status = succeeded6587worker2 # [ 144.230150] nix-daemon[844]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)6588worker2 # [ 144.244162] nix-daemon[844]: reaped child process 1785, status = succeeded6589lb # [ 144.260911] niks3-server[1005]: 2026/09/20 08:07:00 INFO Received uploads request method=POST path=/api/pending_closures6590worker2 # [ 144.267344] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.262Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6591worker2 # [ 144.268768] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.262Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6592lb # [ 144.302262] niks3-server[1005]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6593lb # [ 144.312661] niks3-server[1005]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6594lb # [ 144.320098] niks3-server[1005]: 2026/09/20 08:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6595lb # [ 144.324357] niks3-server[1005]: 2026/09/20 08:07:00 INFO Signed narinfos id=65 count=16596worker2 # [ 144.324475] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.319Z level=INFO msg="Uploading 1 narinfos"6597lb # [ 144.332226] niks3-server[1005]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6598lb # [ 144.342314] niks3-server[1005]: 2026/09/20 08:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6599lb # [ 144.347925] niks3-server[1005]: 2026/09/20 08:07:00 INFO Completed upload id=656600lb # [ 144.350722] niks3-server[1005]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6601worker2 # [ 144.345253] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.340Z level=INFO msg="Upload complete. (287ms)"6602worker2 # [ 144.351874] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16603worker2 # [ 144.364066] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06604worker2 # [ 144.368176] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16605worker2 # [ 144.377266] nix-daemon[844]: reaped child process 1765, status = succeeded6606worker2 # [ 144.408266] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527846607worker2 # [ 144.421693] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527846608worker2 # [ 144.435337] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.430Z level=INFO msg="All 2 paths already cached"6609client # copying 1 paths to 'lb:50051'...6610client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6611worker2 # [ 144.443618] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527846612worker2 # [ 144.454176] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6613worker2 # [ 144.625716] nix-daemon[844]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)6614worker2 # [ 144.641968] nix-daemon[844]: reaped child process 1794, status = succeeded6615worker2 # [ 144.802556] nix-daemon[844]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)6616worker2 # [ 144.815471] nix-daemon[844]: reaped child process 1799, status = succeeded6617lb # [ 144.833186] niks3-server[1005]: 2026/09/20 08:07:00 INFO Received uploads request method=POST path=/api/pending_closures6618worker2 # [ 144.839531] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.834Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6619worker2 # [ 144.841563] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.836Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6620lb # [ 144.864460] niks3-server[1005]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6621lb # [ 144.873782] niks3-server[1005]: 2026/09/20 08:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6622worker2 # [ 144.878134] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.873Z level=INFO msg="Uploading 1 narinfos"6623lb # [ 144.880598] niks3-server[1005]: 2026/09/20 08:07:00 INFO Signed narinfos id=66 count=16624lb # [ 144.888568] niks3-server[1005]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6625lb # [ 144.897653] niks3-server[1005]: 2026/09/20 08:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6626lb # [ 144.902873] niks3-server[1005]: 2026/09/20 08:07:00 INFO Completed upload id=666627worker2 # [ 144.902355] nix-grpc-daemon[1511]: time=2026-09-20T08:07:00.897Z level=INFO msg="Upload complete. (437ms)"6628lb # [ 144.907865] niks3-server[1005]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6629worker2 # [ 144.905720] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=0 paths=1 nar_bytes_in=7526630worker2 # [ 144.911318] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527846631worker2 # [ 144.919343] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6632worker2 # [ 144.928607] nix-daemon[844]: reaped child process 1789, status = succeeded6633client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6634client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6635worker2 # [ 144.933313] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)6636client # farm-top> LOG-farm-top-drain6637worker2 # [ 146.564580] nix-daemon[844]: reaped child process 1803, status = succeeded6638worker2 # [ 146.708934] nix-daemon[844]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6639worker2 # [ 146.722636] nix-daemon[844]: reaped child process 1821, status = succeeded6640lb # [ 146.737653] niks3-server[1005]: 2026/09/20 08:07:02 INFO Received uploads request method=POST path=/api/pending_closures6641worker2 # [ 146.742164] nix-grpc-daemon[1511]: time=2026-09-20T08:07:02.737Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6642worker2 # [ 146.743991] nix-grpc-daemon[1511]: time=2026-09-20T08:07:02.739Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6643lb # [ 146.764331] niks3-server[1005]: 2026/09/20 08:07:02 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6644lb # [ 146.768725] niks3-server[1005]: 2026/09/20 08:07:02 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6645lb # [ 146.773994] niks3-server[1005]: 2026/09/20 08:07:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6646lb # [ 146.776195] niks3-server[1005]: 2026/09/20 08:07:02 INFO Signed narinfos id=67 count=16647worker2 # [ 146.773798] nix-grpc-daemon[1511]: time=2026-09-20T08:07:02.769Z level=INFO msg="Uploading 1 narinfos"6648lb # [ 146.783067] niks3-server[1005]: 2026/09/20 08:07:02 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6649lb # [ 146.788429] niks3-server[1005]: 2026/09/20 08:07:02 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6650lb # [ 146.792604] niks3-server[1005]: 2026/09/20 08:07:02 INFO Completed upload id=676651worker2 # [ 146.789779] nix-grpc-daemon[1511]: time=2026-09-20T08:07:02.785Z level=INFO msg="Upload complete. (249ms)"6652lb # [ 146.795682] niks3-server[1005]: 2026/09/20 08:07:02 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6653worker2 # [ 146.793176] nix-grpc-daemon[1441]: ts=2026-09-20T08:07:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52784 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16654worker2 # [ 146.800312] nix-daemon[844]: reaped child process 1801, status = succeeded6655client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.45 seconds)6656client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6657client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.18 seconds)6658worker1: must succeed: rm /nix/.rw-store/fill6659worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6660worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6661lb # [ 147.639348] envoy[913]: conn peer=[2001:db8:1::1]:53746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26834 tx=10572 ms=165896662lb # [ 147.641140] envoy[913]: conn peer=[2001:db8:1::1]:36638 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=708 tx=461 ms=316663lb # [ 147.642601] envoy[913]: conn peer=[2001:db8:1::1]:36652 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9390 tx=3762 ms=62256664worker1 # [ 148.029597] nix-grpc-daemon[1539]: ts=2026-09-20T08:07:04Z level=info event=healthy reason=min_free6665worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6666(finished: subtest: low disk drains a worker and builds go to the other, in 10.07 seconds)6667(finished: run the VM test script, in 149.28 seconds)6668test script finished in 149.53s6669cleanup6670kill QemuMachine (pid 49)6671client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6672kill QemuMachine (pid 50)6673lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6674kill QemuMachine (pid 52)6675worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6676kill QemuMachine (pid 51)6677worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6678(finished: cleanup, in 1.01 seconds)6679additionally exposed symbols:6680 client, lb, worker1, worker2,6681 vlan1,6682 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh