vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #221
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.Y4ru6K2zd8', fmt=raw size=107374182414worker2: QEMU running (pid 51)15worker2 # mke2fs 1.47.4 (6-Mar-2025)16worker2 # Discarding device blocks: 0/262144 done17worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes18worker2 # Filesystem UUID: 1c363068-7133-46ee-9115-f79e90240af719worker2 # Superblock backups stored on blocks:20worker2 # 32768, 98304, 163840, 22937621worker2 # 22worker2 # Allocating group tables: 0/8 done23worker1 # Disk image does not exist, creating the virtualisation disk image...24worker2 # Writing inode tables: 0/8 done25worker1 # Formatting '/build/vm-state-worker1/tmp.LwIjDUCX7O', fmt=raw size=107374182426worker2 # Creating journal (8192 blocks): done27lb # Disk image does not exist, creating the virtualisation disk image...28lb: QEMU running (pid 50)29worker2 # Writing superblocks and filesystem accounting information: 0/8 done30lb # Formatting '/build/vm-state-lb/tmp.cP1Hxjtuol', fmt=raw size=107374182431worker1 # mke2fs 1.47.4 (6-Mar-2025)32worker1: QEMU running (pid 52)33worker2 # 34lb # mke2fs 1.47.4 (6-Mar-2025)35worker2 # Virtualisation disk image created.36lb # Discarding device blocks: 0/262144 done37worker1 # Discarding device blocks: 0/262144 done38lb # Creating filesystem with 262144 4k blocks and 65536 inodes39worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes40lb # Filesystem UUID: aab8a9cb-b572-4e69-bb5b-e9ffce9522f541worker1 # Filesystem UUID: fb720012-ddf0-4e3b-83cc-62a861ca6f5b42lb # Superblock backups stored on blocks:43worker1 # Superblock backups stored on blocks:44lb # 32768, 98304, 163840, 22937645worker1 # 32768, 98304, 163840, 22937646lb # 47worker1 # 48lb # Allocating group tables: 0/8 done49worker1 # Allocating group tables: 0/8 done50lb # Writing inode tables: 0/8 done51worker1 # Writing inode tables: 0/8 done52lb # Creating journal (8192 blocks): done53lb # Writing superblocks and filesystem accounting information: 0/8 done54worker1 # Creating journal (8192 blocks): done55lb # 56worker1 # Writing superblocks and filesystem accounting information: 0/8 done57lb # Virtualisation disk image created.58client: QEMU running (pid 49)59worker1 # 60client # Disk image does not exist, creating the virtualisation disk image...61worker1 # Virtualisation disk image created.62(finished: start all VMs, in 0.31 seconds)63client # Formatting '/build/vm-state-client/tmp.jC4CqsbWus', fmt=raw size=107374182464client: waiting for unit network-addresses-eth1.service65client # mke2fs 1.47.4 (6-Mar-2025)66client: waiting for the VM to finish booting67client # Discarding device blocks: 0/262144 done68client # Creating filesystem with 262144 4k blocks and 65536 inodes69client # Filesystem UUID: 07c1d9d2-ce87-4161-ae3c-1fc0264a07e770client # Superblock backups stored on blocks:71client # 32768, 98304, 163840, 22937672client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086lb # 87lb # 88lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089client # 90client # 91worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...92worker2 # 93worker2 # 94worker2 # 95worker2 # 96client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0097worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0098lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99lb # 100lb # 101lb # 102lb # 103client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...104client # 105client # 106client # 107client # 108worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...109worker2 # 110worker2 # 111lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00112client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00113lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114lb # 115lb # 116client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117client # 118client # 119worker1 # 120worker1 # 121worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123worker1 # 124worker1 # 125worker1 # 126worker1 # 127worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker1 # 130worker1 # 131worker2 # Booting from ROM...132lb # Booting from ROM...133client # Booting from ROM...134worker1 # Booting from ROM...135client # Probing EDD (edd=off to disable)... ok136worker1 # Probing EDD (edd=off to disable)... ok137lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026138worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026139lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0140lb # [ 0.000000] BIOS-provided physical RAM map:141lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable142lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved143lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved144worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/24bj5klpiq603f5r4anb8fgirj501nj5-nixos-system-worker2-test/init regInfo=/nix/store/xn11lzr16q974jq38iwgxwjsfyi2rrj6-closure-info/registration console=ttyS0,115200n8 console=tty0145lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable146worker2 # [ 0.000000] BIOS-provided physical RAM map:147lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved148worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable149lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved150client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026151worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved152lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved153worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved154lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved155worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable156lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved157worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved158lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved159client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test/init regInfo=/nix/store/6kgfl2iqfvz961zp6fi4ckdwfp6lx06q-closure-info/registration console=ttyS0,115200n8 console=tty0160worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved161lb # [ 0.000000] NX (Execute Disable) protection: active162client # [ 0.000000] BIOS-provided physical RAM map:163lb # [ 0.000000] APIC: Static calls initialized164worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved165lb # [ 0.000000] SMBIOS 2.8 present.166client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable167worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved168client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved169lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014170worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved171lb # [ 0.000000] DMI: Memory slots populated: 1/1172client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved173lb # [ 0.000000] Hypervisor detected: KVM174worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved175client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable176lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000177worker2 # [ 0.000000] NX (Execute Disable) protection: active178client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved179lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00180worker2 # [ 0.000000] APIC: Static calls initialized181worker2 # [ 0.000000] SMBIOS 2.8 present.182lb # [ 0.000000] kvm-clock: using sched offset of 474713996 cycles183client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved184client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved185worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014186worker2 # [ 0.000000] DMI: Memory slots populated: 1/1187lb # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns188worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026189client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved190worker2 # [ 0.000000] Hypervisor detected: KVM191lb # [ 0.000006] tsc: Detected 2400.012 MHz processor192lb # [ 0.000849] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000193client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved194worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000195worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00196client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved197lb # [ 0.000879] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs198worker2 # [ 0.000000] kvm-clock: using sched offset of 489464792 cycles199client # [ 0.000000] NX (Execute Disable) protection: active200lb # [ 0.000882] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT201client # [ 0.000000] APIC: Static calls initialized202client # [ 0.000000] SMBIOS 2.8 present.203lb # [ 0.002857] found SMP MP-table at [mem 0x000f5450-0x000f545f]204worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns205lb # [ 0.002872] Using GB pages for direct mapping206worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0m0synxj7cnm2qgsfvjzm9pmmycgj9s6-nixos-system-worker1-test/init regInfo=/nix/store/drn0bn3cd0p6bqw1v1r0ramnh3x7qb3w-closure-info/registration console=ttyS0,115200n8 console=tty0207worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor208worker1 # [ 0.000000] BIOS-provided physical RAM map:209client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014210lb # [ 0.003001] RAMDISK: [mem 0x5e367000-0x5ffcffff]211worker2 # [ 0.000883] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000212client # [ 0.000000] DMI: Memory slots populated: 1/1213lb # [ 0.003010] ACPI: Early table checksum verification disabled214worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable215client # [ 0.000000] Hypervisor detected: KVM216lb # [ 0.003015] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )217worker2 # [ 0.000914] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs218worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved219client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000220worker2 # [ 0.000917] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT221client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00222lb # [ 0.003019] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)223worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved224client # [ 0.000001] kvm-clock: using sched offset of 484644857 cycles225worker2 # [ 0.002947] found SMP MP-table at [mem 0x000f5450-0x000f545f]226worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable227lb # [ 0.003024] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)228worker2 # [ 0.002963] Using GB pages for direct mapping229worker2 # [ 0.003088] RAMDISK: [mem 0x5e367000-0x5ffcffff]230client # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns231worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved232lb # [ 0.003033] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)233client # [ 0.000006] tsc: Detected 2400.012 MHz processor234worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved235worker2 # [ 0.003099] ACPI: Early table checksum verification disabled236lb # [ 0.003035] ACPI: FACS 0x000000005FFE0000 000040237worker2 # [ 0.003103] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )238client # [ 0.000843] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000239worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved240lb # [ 0.003036] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)241worker2 # [ 0.003108] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)242client # [ 0.000872] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs243worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved244lb # [ 0.003038] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)245client # [ 0.000875] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT246worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved247worker2 # [ 0.003113] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)248client # [ 0.002837] found SMP MP-table at [mem 0x000f5450-0x000f545f]249lb # [ 0.003040] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)250client # [ 0.002850] Using GB pages for direct mapping251worker2 # [ 0.003121] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)252worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved253client # [ 0.002944] RAMDISK: [mem 0x5e366000-0x5ffcffff]254worker1 # [ 0.000000] NX (Execute Disable) protection: active255lb # [ 0.003041] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)256worker2 # [ 0.003123] ACPI: FACS 0x000000005FFE0000 000040257worker1 # [ 0.000000] APIC: Static calls initialized258client # [ 0.002953] ACPI: Early table checksum verification disabled259worker1 # [ 0.000000] SMBIOS 2.8 present.260lb # [ 0.003043] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]261worker2 # [ 0.003125] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)262client # [ 0.002957] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )263lb # [ 0.003044] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]264worker2 # [ 0.003127] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)265worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014266client # [ 0.002961] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)267worker1 # [ 0.000000] DMI: Memory slots populated: 1/1268lb # [ 0.003044] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]269worker1 # [ 0.000000] Hypervisor detected: KVM270worker2 # [ 0.003128] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)271client # [ 0.002966] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)272lb # [ 0.003045] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]273worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000274worker2 # [ 0.003130] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)275client # [ 0.002974] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)276worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00277lb # [ 0.003045] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]278client # [ 0.002976] ACPI: FACS 0x000000005FFE0000 000040279worker2 # [ 0.003131] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]280worker1 # [ 0.000001] kvm-clock: using sched offset of 505854840 cycles281lb # [ 0.003046] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]282worker2 # [ 0.003132] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]283client # [ 0.002977] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)284lb # [ 0.003046] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]285worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns286lb # [ 0.003303] No NUMA configuration found287worker2 # [ 0.003133] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]288client # [ 0.002979] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)289worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor290lb # [ 0.003304] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]291worker2 # [ 0.003133] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]292worker1 # [ 0.000868] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000293client # [ 0.002980] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)294lb # [ 0.003306] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]295lb # [ 0.005565] Zone ranges:296worker2 # [ 0.003134] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]297worker1 # [ 0.000898] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs298client # [ 0.002982] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)299lb # [ 0.005566] DMA [mem 0x0000000000001000-0x0000000000ffffff]300worker2 # [ 0.003134] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]301worker1 # [ 0.000901] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT302lb # [ 0.005568] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]303client # [ 0.002983] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]304lb # [ 0.005569] Normal empty305worker2 # [ 0.003135] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]306worker1 # [ 0.002931] found SMP MP-table at [mem 0x000f5450-0x000f545f]307lb # [ 0.005570] Device empty308client # [ 0.002985] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]309worker1 # [ 0.002945] Using GB pages for direct mapping310lb # [ 0.005570] Movable zone start for each node311worker2 # [ 0.003392] No NUMA configuration found312worker1 # [ 0.003022] RAMDISK: [mem 0x5e367000-0x5ffcffff]313client # [ 0.002985] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]314lb # [ 0.005571] Early memory node ranges315worker2 # [ 0.003393] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]316worker1 # [ 0.003032] ACPI: Early table checksum verification disabled317lb # [ 0.005572] node 0: [mem 0x0000000000001000-0x000000000009efff]318worker2 # [ 0.003396] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]319client # [ 0.002986] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]320worker2 # [ 0.005641] Zone ranges:321worker1 # [ 0.003036] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )322lb # [ 0.005573] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]323client # [ 0.002986] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]324worker2 # [ 0.005642] DMA [mem 0x0000000000001000-0x0000000000ffffff]325worker1 # [ 0.003041] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)326lb # [ 0.005574] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]327client # [ 0.002987] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]328worker2 # [ 0.005643] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]329lb # [ 0.005594] On node 0, zone DMA: 1 pages in unavailable ranges330worker2 # [ 0.005645] Normal empty331worker2 # [ 0.005645] Device empty332client # [ 0.002987] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]333worker1 # [ 0.003045] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)334lb # [ 0.005868] On node 0, zone DMA: 97 pages in unavailable ranges335client # [ 0.003218] No NUMA configuration found336worker2 # [ 0.005646] Movable zone start for each node337worker2 # [ 0.005647] Early memory node ranges338worker1 # [ 0.003053] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)339lb # [ 0.032697] On node 0, zone DMA32: 40 pages in unavailable ranges340client # [ 0.003219] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]341lb # [ 0.033190] ACPI: PM-Timer IO Port: 0x608342worker1 # [ 0.003055] ACPI: FACS 0x000000005FFE0000 000040343worker2 # [ 0.005647] node 0: [mem 0x0000000000001000-0x000000000009efff]344client # [ 0.003221] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]345client # [ 0.005441] Zone ranges:346lb # [ 0.033207] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])347worker2 # [ 0.005649] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]348worker1 # [ 0.003057] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)349client # [ 0.005442] DMA [mem 0x0000000000001000-0x0000000000ffffff]350lb # [ 0.033252] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23351worker2 # [ 0.005650] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]352worker1 # [ 0.003058] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)353client # [ 0.005444] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]354lb # [ 0.033254] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)355client # [ 0.005445] Normal empty356worker2 # [ 0.005671] On node 0, zone DMA: 1 pages in unavailable ranges357client # [ 0.005446] Device empty358lb # [ 0.033256] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)359worker2 # [ 0.005930] On node 0, zone DMA: 97 pages in unavailable ranges360worker1 # [ 0.003060] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)361client # [ 0.005447] Movable zone start for each node362client # [ 0.005448] Early memory node ranges363lb # [ 0.033257] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)364worker2 # [ 0.032293] On node 0, zone DMA32: 40 pages in unavailable ranges365worker1 # [ 0.003062] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)366worker2 # [ 0.032801] ACPI: PM-Timer IO Port: 0x608367client # [ 0.005448] node 0: [mem 0x0000000000001000-0x000000000009efff]368lb # [ 0.033258] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)369worker2 # [ 0.032817] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])370worker1 # [ 0.003063] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]371client # [ 0.005449] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]372lb # [ 0.033259] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)373worker2 # [ 0.032852] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23374worker1 # [ 0.003064] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]375client # [ 0.005451] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]376lb # [ 0.033262] ACPI: Using ACPI (MADT) for SMP configuration information377worker2 # [ 0.032855] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)378worker1 # [ 0.003065] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]379lb # [ 0.033263] ACPI: HPET id: 0x8086a201 base: 0xfed00000380client # [ 0.005471] On node 0, zone DMA: 1 pages in unavailable ranges381lb # [ 0.033268] TSC deadline timer available382worker2 # [ 0.032857] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)383client # [ 0.005746] On node 0, zone DMA: 97 pages in unavailable ranges384worker1 # [ 0.003065] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]385lb # [ 0.033272] CPU topo: Max. logical packages: 1386client # [ 0.033526] On node 0, zone DMA32: 40 pages in unavailable ranges387worker2 # [ 0.032858] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)388lb # [ 0.033273] CPU topo: Max. logical dies: 1389worker1 # [ 0.003066] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]390client # [ 0.034018] ACPI: PM-Timer IO Port: 0x608391lb # [ 0.033273] CPU topo: Max. dies per package: 1392worker2 # [ 0.032859] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)393client # [ 0.034033] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])394worker1 # [ 0.003066] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]395lb # [ 0.033277] CPU topo: Max. threads per core: 1396worker2 # [ 0.032860] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)397lb # [ 0.033278] CPU topo: Num. cores per package: 1398client # [ 0.034063] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23399worker1 # [ 0.003067] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]400worker1 # [ 0.003308] No NUMA configuration found401worker2 # [ 0.032863] ACPI: Using ACPI (MADT) for SMP configuration information402lb # [ 0.033278] CPU topo: Num. threads per package: 1403client # [ 0.034066] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)404worker2 # [ 0.032864] ACPI: HPET id: 0x8086a201 base: 0xfed00000405lb # [ 0.033279] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs406worker1 # [ 0.003309] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]407client # [ 0.034068] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)408worker2 # [ 0.032869] TSC deadline timer available409lb # [ 0.033305] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()410worker1 # [ 0.003312] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]411client # [ 0.034069] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)412worker1 # [ 0.005808] Zone ranges:413worker2 # [ 0.032874] CPU topo: Max. logical packages: 1414worker2 # [ 0.032875] CPU topo: Max. logical dies: 1415lb # [ 0.033344] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]416client # [ 0.034070] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)417worker2 # [ 0.032875] CPU topo: Max. dies per package: 1418worker1 # [ 0.005809] DMA [mem 0x0000000000001000-0x0000000000ffffff]419client # [ 0.034071] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)420lb # [ 0.033346] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]421worker2 # [ 0.032879] CPU topo: Max. threads per core: 1422worker1 # [ 0.005811] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]423worker1 # [ 0.005812] Normal empty424worker2 # [ 0.032880] CPU topo: Num. cores per package: 1425lb # [ 0.033347] [mem 0x60000000-0xafffffff] available for PCI devices426worker1 # [ 0.005813] Device empty427client # [ 0.034074] ACPI: Using ACPI (MADT) for SMP configuration information428lb # [ 0.033350] Booting paravirtualized kernel on KVM429worker2 # [ 0.032880] CPU topo: Num. threads per package: 1430client # [ 0.034075] ACPI: HPET id: 0x8086a201 base: 0xfed00000431worker1 # [ 0.005814] Movable zone start for each node432client # [ 0.034081] TSC deadline timer available433worker1 # [ 0.005815] Early memory node ranges434worker2 # [ 0.032880] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs435client # [ 0.034086] CPU topo: Max. logical packages: 1436worker1 # [ 0.005815] node 0: [mem 0x0000000000001000-0x000000000009efff]437lb # [ 0.033354] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns438worker2 # [ 0.032904] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()439client # [ 0.034086] CPU topo: Max. logical dies: 1440worker1 # [ 0.005816] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]441client # [ 0.034087] CPU topo: Max. dies per package: 1442lb # [ 0.037968] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1443worker2 # [ 0.032940] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]444client # [ 0.034091] CPU topo: Max. threads per core: 1445lb # [ 0.040149] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152446worker1 # [ 0.005818] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]447client # [ 0.034092] CPU topo: Num. cores per package: 1448worker2 # [ 0.032942] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]449lb # [ 0.040201] kvm-guest: PV spinlocks disabled, single CPU450worker1 # [ 0.005840] On node 0, zone DMA: 1 pages in unavailable ranges451client # [ 0.034092] CPU topo: Num. threads per package: 1452worker2 # [ 0.032943] [mem 0x60000000-0xafffffff] available for PCI devices453worker1 # [ 0.006130] On node 0, zone DMA: 97 pages in unavailable ranges454client # [ 0.034093] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs455worker2 # [ 0.032945] Booting paravirtualized kernel on KVM456worker1 # [ 0.032962] On node 0, zone DMA32: 40 pages in unavailable ranges457client # [ 0.034119] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()458worker1 # [ 0.033463] ACPI: PM-Timer IO Port: 0x608459worker2 # [ 0.032949] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns460client # [ 0.034158] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]461worker1 # [ 0.033490] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])462worker2 # [ 0.037697] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1463client # [ 0.034160] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]464worker1 # [ 0.033524] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23465lb # [ 0.040203] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0466worker2 # [ 0.039873] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152467client # [ 0.034161] [mem 0x60000000-0xafffffff] available for PCI devices468worker1 # [ 0.033527] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)469worker2 # [ 0.039925] kvm-guest: PV spinlocks disabled, single CPU470client # [ 0.034163] Booting paravirtualized kernel on KVM471worker1 # [ 0.033529] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)472lb # [ 0.040317] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.473lb # [ 0.040332] random: crng init done474worker1 # [ 0.033530] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)475client # [ 0.034168] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns476lb # [ 0.040333] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes477worker1 # [ 0.033531] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)478client # [ 0.038807] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1479worker1 # [ 0.033532] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)480client # [ 0.041138] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152481lb # [ 0.042496] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)482client # [ 0.041192] kvm-guest: PV spinlocks disabled, single CPU483worker2 # [ 0.039927] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/24bj5klpiq603f5r4anb8fgirj501nj5-nixos-system-worker2-test/init regInfo=/nix/store/xn11lzr16q974jq38iwgxwjsfyi2rrj6-closure-info/registration console=ttyS0,115200n8 console=tty0484worker1 # [ 0.033535] ACPI: Using ACPI (MADT) for SMP configuration information485lb # [ 0.043769] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)486worker1 # [ 0.033536] ACPI: HPET id: 0x8086a201 base: 0xfed00000487lb # [ 0.043806] Fallback order for Node 0: 0488worker1 # [ 0.033541] TSC deadline timer available489lb # [ 0.043810] Built 1 zonelists, mobility grouping on. Total pages: 393078490worker2 # [ 0.040027] Unknown kernel command line parameters "regInfo=/nix/store/xn11lzr16q974jq38iwgxwjsfyi2rrj6-closure-info/registration", will be passed to user space.491worker1 # [ 0.033545] CPU topo: Max. logical packages: 1492lb # [ 0.043811] Policy zone: DMA32493worker2 # [ 0.040050] random: crng init done494worker1 # [ 0.033546] CPU topo: Max. logical dies: 1495lb # [ 0.046347] mem auto-init: stack:all(zero), heap alloc:on, heap free:off496worker1 # [ 0.033547] CPU topo: Max. dies per package: 1497worker2 # [ 0.040051] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes498worker1 # [ 0.033550] CPU topo: Max. threads per core: 1499lb # [ 0.049765] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1500client # [ 0.041194] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test/init regInfo=/nix/store/6kgfl2iqfvz961zp6fi4ckdwfp6lx06q-closure-info/registration console=ttyS0,115200n8 console=tty0501lb # [ 0.053108] allocated 3145728 bytes of page_ext502worker2 # [ 0.042191] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)503worker1 # [ 0.033551] CPU topo: Num. cores per package: 1504lb # [ 0.064154] ftrace: allocating 48731 entries in 192 pages505worker1 # [ 0.033551] CPU topo: Num. threads per package: 1506worker2 # [ 0.043417] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)507lb # [ 0.064159] ftrace: allocated 192 pages with 2 groups508client # [ 0.041299] Unknown kernel command line parameters "regInfo=/nix/store/6kgfl2iqfvz961zp6fi4ckdwfp6lx06q-closure-info/registration", will be passed to user space.509worker1 # [ 0.033552] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs510worker2 # [ 0.043458] Fallback order for Node 0: 0511lb # [ 0.065137] Dynamic Preempt: lazy512client # [ 0.041314] random: crng init done513lb # [ 0.065271] rcu: Preemptible hierarchical RCU implementation.514worker2 # [ 0.043461] Built 1 zonelists, mobility grouping on. Total pages: 393078515worker1 # [ 0.033576] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()516client # [ 0.041315] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes517worker2 # [ 0.043462] Policy zone: DMA32518lb # [ 0.065272] rcu: RCU event tracing is enabled.519worker1 # [ 0.033612] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]520worker2 # [ 0.045965] mem auto-init: stack:all(zero), heap alloc:on, heap free:off521client # [ 0.043577] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)522lb # [ 0.065272] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.523lb # [ 0.065274] Trampoline variant of Tasks RCU enabled.524worker1 # [ 0.033614] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]525worker2 # [ 0.049249] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1526client # [ 0.045084] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)527lb # [ 0.065274] Rude variant of Tasks RCU enabled.528worker2 # [ 0.052671] allocated 3145728 bytes of page_ext529client # [ 0.045127] Fallback order for Node 0: 0530worker1 # [ 0.033616] [mem 0x60000000-0xafffffff] available for PCI devices531worker2 # [ 0.063111] ftrace: allocating 48731 entries in 192 pages532lb # [ 0.065275] Tracing variant of Tasks RCU enabled.533worker1 # [ 0.033617] Booting paravirtualized kernel on KVM534client # [ 0.045132] Built 1 zonelists, mobility grouping on. Total pages: 393078535client # [ 0.045132] Policy zone: DMA32536worker2 # [ 0.063114] ftrace: allocated 192 pages with 2 groups537lb # [ 0.065276] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.538worker2 # [ 0.064070] Dynamic Preempt: lazy539client # [ 0.047936] mem auto-init: stack:all(zero), heap alloc:on, heap free:off540lb # [ 0.065276] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1541worker1 # [ 0.033621] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns542worker2 # [ 0.064216] rcu: Preemptible hierarchical RCU implementation.543client # [ 0.051462] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1544worker2 # [ 0.064217] rcu: RCU event tracing is enabled.545client # [ 0.055239] allocated 3145728 bytes of page_ext546lb # [ 0.065304] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.547worker1 # [ 0.038323] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1548worker2 # [ 0.064217] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.549client # [ 0.066037] ftrace: allocating 48731 entries in 192 pages550worker2 # [ 0.064219] Trampoline variant of Tasks RCU enabled.551lb # [ 0.065306] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.552worker1 # [ 0.040487] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152553client # [ 0.066042] ftrace: allocated 192 pages with 2 groups554worker2 # [ 0.064219] Rude variant of Tasks RCU enabled.555client # [ 0.067044] Dynamic Preempt: lazy556worker1 # [ 0.040535] kvm-guest: PV spinlocks disabled, single CPU557worker2 # [ 0.064219] Tracing variant of Tasks RCU enabled.558lb # [ 0.065307] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.559client # [ 0.067185] rcu: Preemptible hierarchical RCU implementation.560client # [ 0.067186] rcu: RCU event tracing is enabled.561lb # [ 0.069992] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16562worker2 # [ 0.064220] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.563client # [ 0.067186] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.564lb # [ 0.070299] rcu: srcu_init: Setting srcu_struct sizes based on contention.565worker2 # [ 0.064221] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1566client # [ 0.067188] Trampoline variant of Tasks RCU enabled.567client # [ 0.067188] Rude variant of Tasks RCU enabled.568lb # [ 0.070310] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns569worker2 # [ 0.064278] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570client # [ 0.067189] Tracing variant of Tasks RCU enabled.571worker2 # [ 0.064279] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.572lb # [ 0.070428] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)573client # [ 0.067190] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.574worker1 # [ 0.040536] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0m0synxj7cnm2qgsfvjzm9pmmycgj9s6-nixos-system-worker1-test/init regInfo=/nix/store/drn0bn3cd0p6bqw1v1r0ramnh3x7qb3w-closure-info/registration console=ttyS0,115200n8 console=tty0575lb # [ 0.074036] Console: colour VGA+ 80x25576client # [ 0.067190] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1577lb # [ 0.074040] printk: legacy console [tty0] enabled578worker2 # [ 0.064280] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.579lb # [ 0.104242] printk: legacy console [ttyS0] enabled580worker2 # [ 0.069047] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16581client # [ 0.067258] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.582worker1 # [ 0.040632] Unknown kernel command line parameters "regInfo=/nix/store/drn0bn3cd0p6bqw1v1r0ramnh3x7qb3w-closure-info/registration", will be passed to user space.583lb # [ 0.206872] ACPI: Core revision 20250807584worker2 # [ 0.069344] rcu: srcu_init: Setting srcu_struct sizes based on contention.585worker1 # [ 0.040646] random: crng init done586client # [ 0.067260] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.587worker1 # [ 0.040647] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes588worker2 # [ 0.069353] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns589lb # [ 0.207846] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns590client # [ 0.067261] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.591worker1 # [ 0.042809] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)592lb # [ 0.209553] APIC: Switch to symmetric I/O mode setup593worker2 # [ 0.069468] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)594worker2 # [ 0.073234] Console: colour VGA+ 80x25595client # [ 0.072019] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16596lb # [ 0.210592] x2apic enabled597worker1 # [ 0.044093] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)598worker2 # [ 0.073237] printk: legacy console [tty0] enabled599client # [ 0.072316] rcu: srcu_init: Setting srcu_struct sizes based on contention.600worker1 # [ 0.044130] Fallback order for Node 0: 0601worker2 # [ 0.104894] printk: legacy console [ttyS0] enabled602lb # [ 0.211496] APIC: Switched APIC routing to: physical x2apic603worker2 # [ 0.209086] ACPI: Core revision 20250807604worker1 # [ 0.044133] Built 1 zonelists, mobility grouping on. Total pages: 393078605client # [ 0.072324] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns606worker1 # [ 0.044135] Policy zone: DMA32607client # [ 0.072449] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)608worker1 # [ 0.046607] mem auto-init: stack:all(zero), heap alloc:on, heap free:off609lb # [ 0.213552] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1610client # [ 0.076104] Console: colour VGA+ 80x25611worker2 # [ 0.210052] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns612client # [ 0.076107] printk: legacy console [tty0] enabled613worker1 # [ 0.049954] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1614worker2 # [ 0.211759] APIC: Switch to symmetric I/O mode setup615client # [ 0.106324] printk: legacy console [ttyS0] enabled616worker1 # [ 0.053263] allocated 3145728 bytes of page_ext617worker2 # [ 0.212797] x2apic enabled618lb # [ 0.214612] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns619client # [ 0.208564] ACPI: Core revision 20250807620worker1 # [ 0.063627] ftrace: allocating 48731 entries in 192 pages621worker2 # [ 0.213592] APIC: Switched APIC routing to: physical x2apic622worker1 # [ 0.063630] ftrace: allocated 192 pages with 2 groups623lb # [ 0.216555] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)624worker1 # [ 0.064555] Dynamic Preempt: lazy625client # [ 0.209468] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns626worker1 # [ 0.064739] rcu: Preemptible hierarchical RCU implementation.627lb # [ 0.217648] x86/cpu: User Mode Instruction Prevention (UMIP) activated628client # [ 0.211110] APIC: Switch to symmetric I/O mode setup629worker2 # [ 0.215571] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1630worker1 # [ 0.064740] rcu: RCU event tracing is enabled.631client # [ 0.212113] x2apic enabled632lb # [ 0.218702] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127633worker1 # [ 0.064740] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.634client # [ 0.212884] APIC: Switched APIC routing to: physical x2apic635worker2 # [ 0.216595] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns636lb # [ 0.220318] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0637worker1 # [ 0.064742] Trampoline variant of Tasks RCU enabled.638worker1 # [ 0.064743] Rude variant of Tasks RCU enabled.639worker2 # [ 0.218374] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)640worker1 # [ 0.064743] Tracing variant of Tasks RCU enabled.641client # [ 0.214764] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1642lb # [ 0.221557] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto643worker2 # [ 0.220466] x86/cpu: User Mode Instruction Prevention (UMIP) activated644worker1 # [ 0.064744] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.645client # [ 0.215782] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns646lb # [ 0.222554] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl647worker1 # [ 0.064745] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1648worker2 # [ 0.221507] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127649lb # [ 0.223551] Transient Scheduler Attacks: Vulnerable: No microcode650worker1 # [ 0.064768] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.651client # [ 0.217466] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)652worker2 # [ 0.222371] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0653lb # [ 0.224551] Spectre V2 : Mitigation: Enhanced / Automatic IBRS654worker1 # [ 0.064769] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.655client # [ 0.218553] x86/cpu: User Mode Instruction Prevention (UMIP) activated656worker2 # [ 0.223375] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto657lb # [ 0.225551] Speculative Return Stack Overflow: Mitigation: Safe RET658client # [ 0.220510] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127659worker1 # [ 0.064771] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.660worker1 # [ 0.069451] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16661worker2 # [ 0.224371] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl662client # [ 0.221462] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0663worker1 # [ 0.069759] rcu: srcu_init: Setting srcu_struct sizes based on contention.664worker2 # [ 0.225371] Transient Scheduler Attacks: Vulnerable: No microcode665client # [ 0.222467] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto666worker1 # [ 0.069768] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns667worker2 # [ 0.227148] Spectre V2 : Mitigation: Enhanced / Automatic IBRS668lb # [ 0.226551] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization669worker2 # [ 0.228120] Speculative Return Stack Overflow: Mitigation: Safe RET670worker1 # [ 0.069877] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)671client # [ 0.223462] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl672worker1 # [ 0.073618] Console: colour VGA+ 80x25673lb # [ 0.228565] Spectre V2 : Enabling IBPB for BPF674client # [ 0.225462] Transient Scheduler Attacks: Vulnerable: No microcode675worker1 # [ 0.073621] printk: legacy console [tty0] enabled676worker1 # [ 0.105034] printk: legacy console [ttyS0] enabled677client # [ 0.226462] Spectre V2 : Mitigation: Enhanced / Automatic IBRS678lb # [ 0.229555] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier679worker1 # [ 0.215014] ACPI: Core revision 20250807680client # [ 0.227462] Speculative Return Stack Overflow: Mitigation: Safe RET681lb # [ 0.230552] active return thunk: srso_alias_return_thunk682worker1 # [ 0.216005] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns683lb # [ 0.231575] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'684worker2 # [ 0.229155] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization685worker1 # [ 0.217775] APIC: Switch to symmetric I/O mode setup686lb # [ 0.233551] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'687worker2 # [ 0.230386] Spectre V2 : Enabling IBPB for BPF688worker1 # [ 0.218847] x2apic enabled689lb # [ 0.234551] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'690client # [ 0.228462] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization691worker1 # [ 0.219650] APIC: Switched APIC routing to: physical x2apic692worker2 # [ 0.232088] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier693lb # [ 0.235551] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'694client # [ 0.230469] Spectre V2 : Enabling IBPB for BPF695worker2 # [ 0.233374] active return thunk: srso_alias_return_thunk696lb # [ 0.236551] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'697client # [ 0.231463] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier698worker1 # [ 0.221624] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1699worker2 # [ 0.234397] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'700lb # [ 0.237551] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'701client # [ 0.232462] active return thunk: srso_alias_return_thunk702worker2 # [ 0.235370] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'703worker1 # [ 0.222656] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns704lb # [ 0.238551] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'705client # [ 0.233485] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'706worker2 # [ 0.237161] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'707lb # [ 0.239551] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256708worker1 # [ 0.224423] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)709client # [ 0.235402] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'710worker2 # [ 0.238178] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'711lb # [ 0.241342] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64712client # [ 0.236462] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'713worker1 # [ 0.226516] x86/cpu: User Mode Instruction Prevention (UMIP) activated714worker2 # [ 0.239178] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'715lb # [ 0.242336] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512716client # [ 0.237462] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'717worker2 # [ 0.240370] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'718worker1 # [ 0.227597] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127719client # [ 0.238462] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'720lb # [ 0.243554] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024721worker1 # [ 0.228421] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0722worker2 # [ 0.241370] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'723lb # [ 0.244553] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8724client # [ 0.239462] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'725worker2 # [ 0.242371] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256726worker1 # [ 0.229425] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto727client # [ 0.240462] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'728lb # [ 0.245551] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.729worker2 # [ 0.243371] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64730client # [ 0.241462] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256731worker2 # [ 0.244370] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512732worker1 # [ 0.231421] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl733client # [ 0.242462] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64734worker2 # [ 0.245370] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024735worker1 # [ 0.232422] Transient Scheduler Attacks: Vulnerable: No microcode736client # [ 0.243462] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512737worker1 # [ 0.233420] Spectre V2 : Mitigation: Enhanced / Automatic IBRS738worker2 # [ 0.246370] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8739client # [ 0.244462] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024740worker1 # [ 0.234421] Speculative Return Stack Overflow: Mitigation: Safe RET741worker2 # [ 0.247370] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.742client # [ 0.245462] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8743client # [ 0.246462] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.744worker1 # [ 0.235420] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization745worker1 # [ 0.237434] Spectre V2 : Enabling IBPB for BPF746worker1 # [ 0.239187] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier747worker1 # [ 0.240423] active return thunk: srso_alias_return_thunk748worker1 # [ 0.241451] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'749worker1 # [ 0.243421] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'750worker1 # [ 0.244421] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'751worker1 # [ 0.245422] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'752worker1 # [ 0.247421] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'753worker1 # [ 0.248421] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'754worker1 # [ 0.249421] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'755worker1 # [ 0.251421] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256756worker1 # [ 0.252422] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64757worker1 # [ 0.253421] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512758worker1 # [ 0.254421] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024759worker1 # [ 0.256318] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8760worker1 # [ 0.257421] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.761lb # [ 0.284750] Freeing SMP alternatives memory: 44K762lb # [ 0.285555] pid_max: default: 32768 minimum: 301763lb # [ 0.286586] LSM: initializing lsm=capability,landlock,yama,bpf,ima764lb # [ 0.287677] landlock: Up and running.765lb # [ 0.288362] Yama: becoming mindful.766lb # [ 0.289250] LSM support for eBPF active767worker2 # [ 0.286812] Freeing SMP alternatives memory: 44K768client # [ 0.284001] Freeing SMP alternatives memory: 44K769worker2 # [ 0.287376] pid_max: default: 32768 minimum: 301770lb # [ 0.290169] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)771client # [ 0.284467] pid_max: default: 32768 minimum: 301772worker2 # [ 0.288471] LSM: initializing lsm=capability,landlock,yama,bpf,ima773client # [ 0.285564] LSM: initializing lsm=capability,landlock,yama,bpf,ima774lb # [ 0.291506] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)775worker2 # [ 0.289490] landlock: Up and running.776worker2 # [ 0.290371] Yama: becoming mindful.777client # [ 0.286580] landlock: Up and running.778client # [ 0.287462] Yama: becoming mindful.779worker2 # [ 0.291217] LSM support for eBPF active780client # [ 0.288290] LSM support for eBPF active781lb # [ 0.293938] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)782worker2 # [ 0.291951] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)783client # [ 0.289034] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)784worker2 # [ 0.292406] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)785lb # [ 0.295136] Performance Events: Fam17h+ core perfctr, AMD PMU driver.786client # [ 0.289505] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)787lb # [ 0.295574] ... version: 2788lb # [ 0.296332] ... bit width: 48789lb # [ 0.296554] ... generic counters: 6790worker2 # [ 0.295696] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)791client # [ 0.292672] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)792lb # [ 0.297302] ... generic bitmap: 000000000000003f793lb # [ 0.297553] ... fixed-purpose counters: 0794worker2 # [ 0.296945] Performance Events: Fam17h+ core perfctr, AMD PMU driver.795client # [ 0.294029] Performance Events: Fam17h+ core perfctr, AMD PMU driver.796lb # [ 0.298315] ... fixed-purpose bitmap: 0000000000000000797worker2 # [ 0.297379] ... version: 2798client # [ 0.294471] ... version: 2799worker2 # [ 0.298105] ... bit width: 48800lb # [ 0.298553] ... value mask: 0000ffffffffffff801client # [ 0.295177] ... bit width: 48802worker2 # [ 0.298373] ... generic counters: 6803lb # [ 0.299446] ... max period: 00007fffffffffff804client # [ 0.295464] ... generic counters: 6805worker2 # [ 0.299085] ... generic bitmap: 000000000000003f806lb # [ 0.300251] ... global_ctrl mask: 000000000000003f807client # [ 0.296174] ... generic bitmap: 000000000000003f808worker2 # [ 0.299372] ... fixed-purpose counters: 0809client # [ 0.296464] ... fixed-purpose counters: 0810lb # [ 0.300675] signal: max sigframe size: 3376811worker2 # [ 0.300108] ... fixed-purpose bitmap: 0000000000000000812client # [ 0.297175] ... fixed-purpose bitmap: 0000000000000000813lb # [ 0.301545] rcu: Hierarchical SRCU implementation.814worker2 # [ 0.300372] ... value mask: 0000ffffffffffff815client # [ 0.297464] ... value mask: 0000ffffffffffff816lb # [ 0.302185] rcu: Max phase no-delay instances is 400.817worker2 # [ 0.301296] ... max period: 00007fffffffffff818client # [ 0.298331] ... max period: 00007fffffffffff819worker2 # [ 0.302100] ... global_ctrl mask: 000000000000003f820client # [ 0.299129] ... global_ctrl mask: 000000000000003f821worker2 # [ 0.302487] signal: max sigframe size: 3376822client # [ 0.299594] signal: max sigframe size: 3376823worker2 # [ 0.303369] rcu: Hierarchical SRCU implementation.824client # [ 0.300376] rcu: Hierarchical SRCU implementation.825client # [ 0.301044] rcu: Max phase no-delay instances is 400.826worker2 # [ 0.304177] rcu: Max phase no-delay instances is 400.827lb # [ 0.307331] smp: Bringing up secondary CPUs ...828lb # [ 0.307581] smp: Brought up 1 node, 1 CPU829worker1 # [ 0.294881] Freeing SMP alternatives memory: 44K830lb # [ 0.308289] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)831worker1 # [ 0.295427] pid_max: default: 32768 minimum: 301832worker1 # [ 0.296519] LSM: initializing lsm=capability,landlock,yama,bpf,ima833client # [ 0.306251] smp: Bringing up secondary CPUs ...834lb # [ 0.308723] Memory: 1454592K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)835worker1 # [ 0.297534] landlock: Up and running.836worker2 # [ 0.309820] smp: Bringing up secondary CPUs ...837client # [ 0.306479] smp: Brought up 1 node, 1 CPU838worker2 # [ 0.310392] smp: Brought up 1 node, 1 CPU839lb # [ 0.309843] devtmpfs: initialized840worker1 # [ 0.298421] Yama: becoming mindful.841client # [ 0.307135] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)842worker1 # [ 0.299266] LSM support for eBPF active843worker2 # [ 0.311077] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)844lb # [ 0.310728] x86/mm: Memory block size: 128MB845worker1 # [ 0.300048] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)846client # [ 0.307667] Memory: 1454544K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)847lb # [ 0.312495] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)848worker2 # [ 0.311547] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)849worker1 # [ 0.301463] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)850client # [ 0.308743] devtmpfs: initialized851worker2 # [ 0.312640] devtmpfs: initialized852lb # [ 0.313439] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).853client # [ 0.309569] x86/mm: Memory block size: 128MB854worker2 # [ 0.313526] x86/mm: Memory block size: 128MB855lb # [ 0.314633] pinctrl core: initialized pinctrl subsystem856worker1 # [ 0.303900] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)857lb # [ 0.315790] PM: RTC time: 08:03:41, date: 2026-09-20858client # [ 0.311287] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)859worker2 # [ 0.315403] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)860worker1 # [ 0.304958] Performance Events: Fam17h+ core perfctr, AMD PMU driver.861client # [ 0.312355] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).862worker1 # [ 0.305426] ... version: 2863worker2 # [ 0.316398] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).864client # [ 0.313562] pinctrl core: initialized pinctrl subsystem865worker1 # [ 0.306169] ... bit width: 48866worker2 # [ 0.317483] pinctrl core: initialized pinctrl subsystem867worker1 # [ 0.306423] ... generic counters: 6868client # [ 0.314694] PM: RTC time: 08:03:41, date: 2026-09-20869lb # [ 0.319292] NET: Registered PF_NETLINK/PF_ROUTE protocol family870worker2 # [ 0.318687] PM: RTC time: 08:03:41, date: 2026-09-20871worker1 # [ 0.307218] ... generic bitmap: 000000000000003f872lb # [ 0.320093] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations873worker1 # [ 0.308261] ... fixed-purpose counters: 0874worker1 # [ 0.309040] ... fixed-purpose bitmap: 0000000000000000875lb # [ 0.320577] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations876client # [ 0.318276] NET: Registered PF_NETLINK/PF_ROUTE protocol family877worker1 # [ 0.309423] ... value mask: 0000ffffffffffff878worker2 # [ 0.322238] NET: Registered PF_NETLINK/PF_ROUTE protocol family879lb # [ 0.321826] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations880worker1 # [ 0.310409] ... max period: 00007fffffffffff881client # [ 0.319685] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations882lb # [ 0.322565] audit: initializing netlink subsys (disabled)883worker1 # [ 0.311170] ... global_ctrl mask: 000000000000003f884worker2 # [ 0.323683] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations885client # [ 0.320492] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations886worker1 # [ 0.311578] signal: max sigframe size: 3376887lb # [ 0.323794] thermal_sys: Registered thermal governor 'fair_share'888worker2 # [ 0.324392] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations889lb # [ 0.323796] thermal_sys: Registered thermal governor 'bang_bang'890worker1 # [ 0.312534] rcu: Hierarchical SRCU implementation.891client # [ 0.321742] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations892lb # [ 0.324555] thermal_sys: Registered thermal governor 'step_wise'893worker1 # [ 0.313428] rcu: Max phase no-delay instances is 400.894client # [ 0.322475] audit: initializing netlink subsys (disabled)895worker2 # [ 0.325657] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations896lb # [ 0.325523] thermal_sys: Registered thermal governor 'user_space'897worker2 # [ 0.326389] audit: initializing netlink subsys (disabled)898client # [ 0.323678] thermal_sys: Registered thermal governor 'fair_share'899lb # [ 0.326311] audit: type=2000 audit(1789891422.099:1): state=initialized audit_enabled=0 res=1900client # [ 0.323688] thermal_sys: Registered thermal governor 'bang_bang'901worker2 # [ 0.327639] thermal_sys: Registered thermal governor 'fair_share'902client # [ 0.324466] thermal_sys: Registered thermal governor 'step_wise'903lb # [ 0.327557] thermal_sys: Registered thermal governor 'power_allocator'904worker2 # [ 0.327641] thermal_sys: Registered thermal governor 'bang_bang'905lb # [ 0.327575] cpuidle: using governor menu906client # [ 0.325430] thermal_sys: Registered thermal governor 'user_space'907worker2 # [ 0.328375] thermal_sys: Registered thermal governor 'step_wise'908client # [ 0.326192] audit: type=2000 audit(1789891422.107:1): state=initialized audit_enabled=0 res=1909lb # [ 0.329846] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5910worker2 # [ 0.329378] audit: type=2000 audit(1789891422.103:1): state=initialized audit_enabled=0 res=1911worker1 # [ 0.320082] smp: Bringing up secondary CPUs ...912client # [ 0.327467] thermal_sys: Registered thermal governor 'power_allocator'913worker2 # [ 0.331376] thermal_sys: Registered thermal governor 'user_space'914worker1 # [ 0.320442] smp: Brought up 1 node, 1 CPU915client # [ 0.327484] cpuidle: using governor menu916lb # [ 0.330795] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]917worker2 # [ 0.331377] thermal_sys: Registered thermal governor 'power_allocator'918worker1 # [ 0.321157] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)919lb # [ 0.331558] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry920worker2 # [ 0.332391] cpuidle: using governor menu921client # [ 0.329759] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5922lb # [ 0.332569] PCI: Using configuration type 1 for base access923worker2 # [ 0.334696] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5924client # [ 0.330714] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]925worker1 # [ 0.321680] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)926lb # [ 0.333719] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.927client # [ 0.331468] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry928worker1 # [ 0.322723] devtmpfs: initialized929worker2 # [ 0.335646] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]930client # [ 0.332478] PCI: Using configuration type 1 for base access931worker1 # [ 0.323646] x86/mm: Memory block size: 128MB932worker2 # [ 0.336378] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry933worker2 # [ 0.337389] PCI: Using configuration type 1 for base access934client # [ 0.333593] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.935worker1 # [ 0.325562] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)936worker2 # [ 0.338573] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.937lb # [ 0.338832] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages938worker1 # [ 0.326454] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).939lb # [ 0.339555] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page940worker1 # [ 0.327514] pinctrl core: initialized pinctrl subsystem941worker1 # [ 0.328751] PM: RTC time: 08:03:41, date: 2026-09-20942client # [ 0.338757] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages943client # [ 0.339466] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page944worker2 # [ 0.343710] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages945worker2 # [ 0.344375] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page946lb # [ 0.344555] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages947worker1 # [ 0.332202] NET: Registered PF_NETLINK/PF_ROUTE protocol family948worker2 # [ 0.345374] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages949lb # [ 0.345554] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page950worker1 # [ 0.333758] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations951client # [ 0.344465] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages952worker1 # [ 0.334443] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations953client # [ 0.345464] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page954worker1 # [ 0.335690] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations955worker1 # [ 0.336436] audit: initializing netlink subsys (disabled)956worker1 # [ 0.337751] thermal_sys: Registered thermal governor 'fair_share'957worker2 # [ 0.352376] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page958worker1 # [ 0.337754] thermal_sys: Registered thermal governor 'bang_bang'959worker1 # [ 0.338428] audit: type=2000 audit(1789891422.124:1): state=initialized audit_enabled=0 res=1960lb # [ 0.355984] ACPI: Added _OSI(Module Device)961worker1 # [ 0.340424] thermal_sys: Registered thermal governor 'step_wise'962lb # [ 0.356555] ACPI: Added _OSI(Processor Device)963worker1 # [ 0.340426] thermal_sys: Registered thermal governor 'user_space'964lb # [ 0.357335] ACPI: Added _OSI(Processor Aggregator Device)965worker1 # [ 0.341423] thermal_sys: Registered thermal governor 'power_allocator'966worker1 # [ 0.342453] cpuidle: using governor menu967client # [ 0.355868] ACPI: Added _OSI(Module Device)968client # [ 0.356466] ACPI: Added _OSI(Processor Device)969client # [ 0.357200] ACPI: Added _OSI(Processor Aggregator Device)970worker1 # [ 0.344764] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5971worker2 # [ 0.360770] ACPI: Added _OSI(Module Device)972worker2 # [ 0.361374] ACPI: Added _OSI(Processor Device)973worker1 # [ 0.345680] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]974worker2 # [ 0.362118] ACPI: Added _OSI(Processor Aggregator Device)975worker1 # [ 0.346427] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry976worker1 # [ 0.347437] PCI: Using configuration type 1 for base access977worker1 # [ 0.348652] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.978lb # [ 0.366159] ACPI: 1 ACPI AML tables successfully acquired and loaded979client # [ 0.366098] ACPI: 1 ACPI AML tables successfully acquired and loaded980lb # [ 0.369974] ACPI: Interpreter enabled981lb # [ 0.370571] ACPI: PM: (supports S0 S3 S4 S5)982lb # [ 0.371302] ACPI: Using IOAPIC for interrupt routing983worker2 # [ 0.372107] ACPI: 1 ACPI AML tables successfully acquired and loaded984worker1 # [ 0.355564] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages985client # [ 0.369890] ACPI: Interpreter enabled986worker1 # [ 0.356425] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page987client # [ 0.370483] ACPI: PM: (supports S0 S3 S4 S5)988client # [ 0.371187] ACPI: Using IOAPIC for interrupt routing989lb # [ 0.373596] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug990worker2 # [ 0.376383] ACPI: Interpreter enabled991worker2 # [ 0.377068] ACPI: PM: (supports S0 S3 S4 S5)992lb # [ 0.374554] PCI: Using E820 reservations for host bridge windows993client # [ 0.371521] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug994client # [ 0.372465] PCI: Using E820 reservations for host bridge windows995worker2 # [ 0.377374] ACPI: Using IOAPIC for interrupt routing996worker1 # [ 0.361425] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages997worker2 # [ 0.378273] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug998lb # [ 0.377652] ACPI: Enabled 2 GPEs in block 00 to 3F999worker1 # [ 0.362424] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1000client # [ 0.375515] ACPI: Enabled 2 GPEs in block 00 to 3F1001worker2 # [ 0.383373] PCI: Using E820 reservations for host bridge windows1002worker2 # [ 0.384532] ACPI: Enabled 2 GPEs in block 00 to 3F1003lb # [ 0.385830] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1004client # [ 0.384238] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1005lb # [ 0.386561] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1006worker1 # [ 0.372842] ACPI: Added _OSI(Module Device)1007client # [ 0.385217] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1008lb # [ 0.387663] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1009worker1 # [ 0.373425] ACPI: Added _OSI(Processor Device)1010lb # [ 0.388679] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1011worker1 # [ 0.374189] ACPI: Added _OSI(Processor Aggregator Device)1012lb # [ 0.389929] PCI host bridge to bus 0000:001013client # [ 0.387903] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1014lb # [ 0.390559] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1015client # [ 0.388597] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1016worker2 # [ 0.393595] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1017lb # [ 0.391554] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1018client # [ 0.389853] PCI host bridge to bus 0000:001019worker2 # [ 0.394381] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1020lb # [ 0.392554] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1021client # [ 0.390469] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1022worker2 # [ 0.395462] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1023client # [ 0.391465] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1024lb # [ 0.393554] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1025client # [ 0.392464] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1026worker2 # [ 0.396505] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1027lb # [ 0.394554] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1028worker2 # [ 0.397824] PCI host bridge to bus 0000:001029client # [ 0.393465] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1030lb # [ 0.395560] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1031lb # [ 0.396555] pci_bus 0000:00: root bus resource [bus 00-ff]1032worker2 # [ 0.398418] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1033client # [ 0.394464] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1034worker1 # [ 0.382804] ACPI: 1 ACPI AML tables successfully acquired and loaded1035worker2 # [ 0.399375] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1036lb # [ 0.397543] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1037client # [ 0.395466] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1038client # [ 0.396471] pci_bus 0000:00: root bus resource [bus 00-ff]1039worker2 # [ 0.400373] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1040lb # [ 0.399087] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1041worker2 # [ 0.401373] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1042client # [ 0.397447] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1043worker1 # [ 0.386871] ACPI: Interpreter enabled1044worker2 # [ 0.402373] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1045worker1 # [ 0.387441] ACPI: PM: (supports S0 S3 S4 S5)1046client # [ 0.398973] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1047worker2 # [ 0.403373] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1048worker1 # [ 0.388208] ACPI: Using IOAPIC for interrupt routing1049worker2 # [ 0.404375] pci_bus 0000:00: root bus resource [bus 00-ff]1050worker2 # [ 0.405438] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1051worker1 # [ 0.390489] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1052worker2 # [ 0.406884] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1053worker1 # [ 0.391424] PCI: Using E820 reservations for host bridge windows1054lb # [ 0.401626] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1055lb # [ 0.402567] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1056lb # [ 0.403564] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1057client # [ 0.401542] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1058worker1 # [ 0.394574] ACPI: Enabled 2 GPEs in block 00 to 3F1059client # [ 0.402477] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1060lb # [ 0.404812] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1061client # [ 0.403421] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1062client # [ 0.404390] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1063lb # [ 0.406350] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1064worker2 # [ 0.409455] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1065worker2 # [ 0.410387] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1066client # [ 0.406241] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1067worker2 # [ 0.411379] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1068lb # [ 0.409565] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1069lb # [ 0.410478] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1070worker2 # [ 0.412587] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1071client # [ 0.409474] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1072worker1 # [ 0.402652] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1073lb # [ 0.411306] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1074client # [ 0.410334] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1075lb # [ 0.411559] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1076worker1 # [ 0.403431] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1077worker2 # [ 0.414198] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1078client # [ 0.411201] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1079client # [ 0.411471] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1080worker1 # [ 0.404504] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1081lb # [ 0.413135] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1082worker1 # [ 0.405553] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1083client # [ 0.413051] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1084worker2 # [ 0.417416] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1085worker1 # [ 0.406787] PCI host bridge to bus 0000:001086worker2 # [ 0.418314] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1087lb # [ 0.416452] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1088worker1 # [ 0.407429] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1089worker2 # [ 0.419145] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1090lb # [ 0.417262] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1091worker1 # [ 0.408423] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1092client # [ 0.414472] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1093worker2 # [ 0.420253] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1094lb # [ 0.417577] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1095client # [ 0.415329] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1096worker1 # [ 0.409423] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1097client # [ 0.416182] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1098worker1 # [ 0.410423] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1099lb # [ 0.419251] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1100worker2 # [ 0.421856] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1101worker1 # [ 0.411430] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1102client # [ 0.417878] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1103worker1 # [ 0.412423] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1104worker2 # [ 0.425406] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1105worker1 # [ 0.413452] pci_bus 0000:00: root bus resource [bus 00-ff]1106worker2 # [ 0.426306] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1107lb # [ 0.422562] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1108worker1 # [ 0.414488] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1109client # [ 0.420484] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1110lb # [ 0.424263] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1111worker2 # [ 0.427146] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1112client # [ 0.421471] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1113lb # [ 0.424586] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1114worker1 # [ 0.415908] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1115client # [ 0.422435] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1116worker2 # [ 0.428939] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117lb # [ 0.426277] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118client # [ 0.423956] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1119client # [ 0.425495] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1120lb # [ 0.429247] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1121worker2 # [ 0.431409] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1122client # [ 0.426354] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1123lb # [ 0.429561] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1124worker2 # [ 0.432382] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1125client # [ 0.427235] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1126worker2 # [ 0.433396] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1127lb # [ 0.430577] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1128worker1 # [ 0.418520] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1129worker1 # [ 0.419437] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1130client # [ 0.428880] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1131worker2 # [ 0.435023] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1132lb # [ 0.432171] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133worker1 # [ 0.420446] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1134client # [ 0.430472] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1135lb # [ 0.433562] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1136worker1 # [ 0.421678] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1137worker2 # [ 0.436403] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1138client # [ 0.431317] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1139lb # [ 0.434422] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1140worker2 # [ 0.437320] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1141client # [ 0.432187] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1142worker2 # [ 0.438136] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1143lb # [ 0.435295] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1144worker1 # [ 0.423239] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1145client # [ 0.433066] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1146lb # [ 0.436197] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1147worker2 # [ 0.440543] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1148worker1 # [ 0.426458] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1149client # [ 0.435482] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1150worker1 # [ 0.427376] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1151lb # [ 0.438585] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1152worker2 # [ 0.442382] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1153client # [ 0.436354] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1154worker1 # [ 0.428220] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1155lb # [ 0.439427] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1156worker2 # [ 0.443280] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1157client # [ 0.437199] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1158worker1 # [ 0.429268] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1159lb # [ 0.440274] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1160worker2 # [ 0.444109] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1161client # [ 0.438080] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1162lb # [ 0.441246] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1163worker1 # [ 0.430846] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1164worker2 # [ 0.445899] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1165client # [ 0.439491] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1166client # [ 0.440394] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1167lb # [ 0.443607] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1168worker1 # [ 0.434395] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1169client # [ 0.441212] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1170lb # [ 0.444500] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1171worker2 # [ 0.448341] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1172worker1 # [ 0.435149] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1173client # [ 0.441470] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1174worker2 # [ 0.449040] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1175lb # [ 0.445300] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1176worker1 # [ 0.435447] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1177lb # [ 0.446561] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1178worker2 # [ 0.449396] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1179client # [ 0.443032] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1180worker1 # [ 0.437114] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1181lb # [ 0.448165] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1182worker2 # [ 0.451038] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1183client # [ 0.444356] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1184client # [ 0.445218] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1185lb # [ 0.449492] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1186worker2 # [ 0.453381] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1187lb # [ 0.450326] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1188worker2 # [ 0.454277] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1189client # [ 0.446868] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1190worker1 # [ 0.441400] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1191worker2 # [ 0.455126] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1192lb # [ 0.452006] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1193worker1 # [ 0.442111] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1194client # [ 0.448474] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1195worker2 # [ 0.456242] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1196worker1 # [ 0.442447] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1197client # [ 0.449368] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1198worker2 # [ 0.458002] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1199client # [ 0.450196] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1200worker1 # [ 0.444064] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1201lb # [ 0.454396] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1202worker2 # [ 0.459335] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1203lb # [ 0.455387] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1204client # [ 0.451059] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1205worker2 # [ 0.460129] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1206lb # [ 0.456466] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1207worker1 # [ 0.446460] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1208client # [ 0.452473] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1209worker2 # [ 0.460999] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1210client # [ 0.453355] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1211lb # [ 0.458273] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1212worker1 # [ 0.447371] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1213client # [ 0.454200] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1214worker1 # [ 0.448448] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1215worker2 # [ 0.462403] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1216lb # [ 0.460594] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1217client # [ 0.455082] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1218worker1 # [ 0.450035] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1219worker2 # [ 0.463297] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1220lb # [ 0.461564] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1221client # [ 0.456175] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1222worker2 # [ 0.464122] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1223lb # [ 0.462585] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1224client # [ 0.456674] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1225worker1 # [ 0.452384] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1226worker2 # [ 0.465015] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1227worker1 # [ 0.453154] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1228client # [ 0.458047] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1229lb # [ 0.464250] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1230worker1 # [ 0.453447] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1231worker2 # [ 0.466403] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1232lb # [ 0.466278] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1233worker2 # [ 0.467297] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1234worker2 # [ 0.468171] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1235lb # [ 0.466795] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1236worker1 # [ 0.455083] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1237lb # [ 0.468207] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1238worker2 # [ 0.469961] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1239worker1 # [ 0.457291] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1240worker2 # [ 0.471019] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1241worker1 # [ 0.458153] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1242worker1 # [ 0.458446] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1243worker2 # [ 0.471611] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1244worker2 # [ 0.472993] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1245worker1 # [ 0.460072] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1246client # [ 0.458667] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1247client # [ 0.461105] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1248worker1 # [ 0.462807] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1249client # [ 0.461758] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1250worker1 # [ 0.464175] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1251client # [ 0.463044] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1252worker1 # [ 0.464446] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1253worker1 # [ 0.465429] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1254lb # [ 0.468791] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1255client # [ 0.463944] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1256worker1 # [ 0.467039] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1257client # [ 0.464787] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1258client # [ 0.465757] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1259lb # [ 0.472099] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1260worker1 # [ 0.468437] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1261worker2 # [ 0.473601] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1262worker1 # [ 0.469446] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1263client # [ 0.467377] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1264lb # [ 0.472900] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1265client # [ 0.468095] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1266worker2 # [ 0.476084] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1267client # [ 0.468833] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1268worker1 # [ 0.471707] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1269lb # [ 0.474564] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1270worker2 # [ 0.476811] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1271client # [ 0.470089] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1272worker2 # [ 0.478022] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1273lb # [ 0.475939] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1274worker1 # [ 0.474223] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1275worker2 # [ 0.478737] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1276worker1 # [ 0.475109] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1277lb # [ 0.476914] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1278worker1 # [ 0.475446] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1279worker2 # [ 0.479705] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1280client # [ 0.474230] ACPI: PCI: Interrupt link LNKA configured for IRQ 101281lb # [ 0.477920] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1282client # [ 0.475305] ACPI: PCI: Interrupt link LNKB configured for IRQ 101283worker1 # [ 0.477032] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1284client # [ 0.476312] ACPI: PCI: Interrupt link LNKC configured for IRQ 111285lb # [ 0.479620] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1286client # [ 0.477326] ACPI: PCI: Interrupt link LNKD configured for IRQ 111287lb # [ 0.480564] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1288client # [ 0.478369] ACPI: PCI: Interrupt link LNKE configured for IRQ 101289worker2 # [ 0.480657] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1290worker1 # [ 0.478670] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1291client # [ 0.479294] ACPI: PCI: Interrupt link LNKF configured for IRQ 101292lb # [ 0.481989] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1293worker1 # [ 0.480079] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1294client # [ 0.480420] ACPI: PCI: Interrupt link LNKG configured for IRQ 111295worker1 # [ 0.480447] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1296worker2 # [ 0.484351] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1297client # [ 0.481362] ACPI: PCI: Interrupt link LNKH configured for IRQ 111298lb # [ 0.483600] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1299worker2 # [ 0.485024] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1300client # [ 0.482232] ACPI: PCI: Interrupt link GSIA configured for IRQ 161301worker1 # [ 0.482047] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1302client # [ 0.482482] ACPI: PCI: Interrupt link GSIB configured for IRQ 171303worker2 # [ 0.485809] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1304client # [ 0.483464] ACPI: PCI: Interrupt link GSIC configured for IRQ 181305worker1 # [ 0.483257] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1306client # [ 0.484480] ACPI: PCI: Interrupt link GSID configured for IRQ 191307worker2 # [ 0.487333] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1308lb # [ 0.488186] ACPI: PCI: Interrupt link LNKA configured for IRQ 101309worker1 # [ 0.484487] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1310client # [ 0.485482] ACPI: PCI: Interrupt link GSIE configured for IRQ 201311lb # [ 0.488688] ACPI: PCI: Interrupt link LNKB configured for IRQ 101312client # [ 0.486573] ACPI: PCI: Interrupt link GSIF configured for IRQ 211313lb # [ 0.489689] ACPI: PCI: Interrupt link LNKC configured for IRQ 111314worker1 # [ 0.486159] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1315client # [ 0.487480] ACPI: PCI: Interrupt link GSIG configured for IRQ 221316lb # [ 0.490680] ACPI: PCI: Interrupt link LNKD configured for IRQ 111317client # [ 0.488480] ACPI: PCI: Interrupt link GSIH configured for IRQ 231318worker2 # [ 0.492109] ACPI: PCI: Interrupt link LNKA configured for IRQ 101319worker2 # [ 0.492495] ACPI: PCI: Interrupt link LNKB configured for IRQ 101320client # [ 0.490720] iommu: Default domain type: Translated1321worker2 # [ 0.493483] ACPI: PCI: Interrupt link LNKC configured for IRQ 111322client # [ 0.491478] iommu: DMA domain TLB invalidation policy: lazy mode1323lb # [ 0.491685] ACPI: PCI: Interrupt link LNKE configured for IRQ 101324client # [ 0.492736] ACPI: bus type USB registered1325worker2 # [ 0.494478] ACPI: PCI: Interrupt link LNKD configured for IRQ 111326client # [ 0.493494] usbcore: registered new interface driver usbfs1327lb # [ 0.492728] ACPI: PCI: Interrupt link LNKF configured for IRQ 101328worker2 # [ 0.495481] ACPI: PCI: Interrupt link LNKE configured for IRQ 101329client # [ 0.494405] usbcore: registered new interface driver hub1330worker2 # [ 0.496484] ACPI: PCI: Interrupt link LNKF configured for IRQ 101331lb # [ 0.493760] ACPI: PCI: Interrupt link LNKG configured for IRQ 111332client # [ 0.495120] usbcore: registered new device driver usb1333worker2 # [ 0.497482] ACPI: PCI: Interrupt link LNKG configured for IRQ 111334lb # [ 0.494676] ACPI: PCI: Interrupt link LNKH configured for IRQ 111335client # [ 0.496408] NetLabel: Initializing1336worker2 # [ 0.498485] ACPI: PCI: Interrupt link LNKH configured for IRQ 111337lb # [ 0.495608] ACPI: PCI: Interrupt link GSIA configured for IRQ 161338client # [ 0.496912] NetLabel: domain hash size = 1281339worker2 # [ 0.499412] ACPI: PCI: Interrupt link GSIA configured for IRQ 161340client # [ 0.497464] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1341lb # [ 0.496583] ACPI: PCI: Interrupt link GSIB configured for IRQ 171342client # [ 0.498403] NetLabel: unlabeled traffic allowed by default1343worker2 # [ 0.500389] ACPI: PCI: Interrupt link GSIB configured for IRQ 171344lb # [ 0.497577] ACPI: PCI: Interrupt link GSIC configured for IRQ 181345client # [ 0.499157] PCI: Using ACPI for IRQ routing1346worker2 # [ 0.501467] ACPI: PCI: Interrupt link GSIC configured for IRQ 181347lb # [ 0.498577] ACPI: PCI: Interrupt link GSID configured for IRQ 191348worker2 # [ 0.502605] ACPI: PCI: Interrupt link GSID configured for IRQ 191349lb # [ 0.499673] ACPI: PCI: Interrupt link GSIE configured for IRQ 201350worker2 # [ 0.503390] ACPI: PCI: Interrupt link GSIE configured for IRQ 201351lb # [ 0.500851] ACPI: PCI: Interrupt link GSIF configured for IRQ 211352worker2 # [ 0.504386] ACPI: PCI: Interrupt link GSIF configured for IRQ 211353lb # [ 0.501583] ACPI: PCI: Interrupt link GSIG configured for IRQ 221354worker1 # [ 0.486646] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1355worker2 # [ 0.505386] ACPI: PCI: Interrupt link GSIG configured for IRQ 221356lb # [ 0.502576] ACPI: PCI: Interrupt link GSIH configured for IRQ 231357worker2 # [ 0.506350] ACPI: PCI: Interrupt link GSIH configured for IRQ 231358worker2 # [ 0.508396] iommu: Default domain type: Translated1359lb # [ 0.504833] iommu: Default domain type: Translated1360worker1 # [ 0.490171] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1361worker2 # [ 0.509298] iommu: DMA domain TLB invalidation policy: lazy mode1362lb # [ 0.505567] iommu: DMA domain TLB invalidation policy: lazy mode1363worker2 # [ 0.510445] ACPI: bus type USB registered1364lb # [ 0.506906] ACPI: bus type USB registered1365worker1 # [ 0.490912] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1366worker2 # [ 0.511257] usbcore: registered new interface driver usbfs1367lb # [ 0.507650] usbcore: registered new interface driver usbfs1368worker2 # [ 0.512120] usbcore: registered new interface driver hub1369lb # [ 0.508583] usbcore: registered new interface driver hub1370worker1 # [ 0.492470] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1371worker2 # [ 0.512386] usbcore: registered new device driver usb1372lb # [ 0.509576] usbcore: registered new device driver usb1373worker2 # [ 0.514245] NetLabel: Initializing1374worker1 # [ 0.493792] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1375worker2 # [ 0.514828] NetLabel: domain hash size = 1281376lb # [ 0.511623] NetLabel: Initializing1377lb # [ 0.512315] NetLabel: domain hash size = 1281378worker2 # [ 0.515373] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1379worker1 # [ 0.494750] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1380lb # [ 0.512556] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1381worker2 # [ 0.516394] NetLabel: unlabeled traffic allowed by default1382worker2 # [ 0.517385] PCI: Using ACPI for IRQ routing1383lb # [ 0.513613] NetLabel: unlabeled traffic allowed by default1384worker1 # [ 0.495773] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1385lb # [ 0.514573] PCI: Using ACPI for IRQ routing1386worker1 # [ 0.498456] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1387worker1 # [ 0.499314] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1388worker1 # [ 0.500601] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1389worker1 # [ 0.502455] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1390worker1 # [ 0.507287] ACPI: PCI: Interrupt link LNKA configured for IRQ 101391worker1 # [ 0.508372] ACPI: PCI: Interrupt link LNKB configured for IRQ 101392worker1 # [ 0.509286] ACPI: PCI: Interrupt link LNKC configured for IRQ 111393worker1 # [ 0.510300] ACPI: PCI: Interrupt link LNKD configured for IRQ 111394worker1 # [ 0.511307] ACPI: PCI: Interrupt link LNKE configured for IRQ 101395worker1 # [ 0.512314] ACPI: PCI: Interrupt link LNKF configured for IRQ 101396worker1 # [ 0.513299] ACPI: PCI: Interrupt link LNKG configured for IRQ 111397worker1 # [ 0.514290] ACPI: PCI: Interrupt link LNKH configured for IRQ 111398worker1 # [ 0.515245] ACPI: PCI: Interrupt link GSIA configured for IRQ 161399worker1 # [ 0.516288] ACPI: PCI: Interrupt link GSIB configured for IRQ 171400worker1 # [ 0.517473] ACPI: PCI: Interrupt link GSIC configured for IRQ 181401worker1 # [ 0.518448] ACPI: PCI: Interrupt link GSID configured for IRQ 191402worker1 # [ 0.519438] ACPI: PCI: Interrupt link GSIE configured for IRQ 201403worker1 # [ 0.520437] ACPI: PCI: Interrupt link GSIF configured for IRQ 211404client # [ 0.544562] pci 0000:00:01.0: vgaarb: setting as boot VGA device1405worker1 # [ 0.521438] ACPI: PCI: Interrupt link GSIG configured for IRQ 221406client # [ 0.545461] pci 0000:00:01.0: vgaarb: bridge control possible1407worker1 # [ 0.522438] ACPI: PCI: Interrupt link GSIH configured for IRQ 231408client # [ 0.545461] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1409client # [ 0.545469] vgaarb: loaded1410worker1 # [ 0.524833] iommu: Default domain type: Translated1411client # [ 0.546217] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01412worker1 # [ 0.525432] iommu: DMA domain TLB invalidation policy: lazy mode1413client # [ 0.546470] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1414worker1 # [ 0.526798] ACPI: bus type USB registered1415worker1 # [ 0.527512] usbcore: registered new interface driver usbfs1416worker1 # [ 0.528433] usbcore: registered new interface driver hub1417worker1 # [ 0.529314] usbcore: registered new device driver usb1418client # [ 0.550557] clocksource: Switched to clocksource kvm-clock1419worker1 # [ 0.531137] NetLabel: Initializing1420worker1 # [ 0.531424] NetLabel: domain hash size = 1281421worker1 # [ 0.532207] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1422client # [ 0.554094] VFS: Disk quotas dquot_6.6.01423worker1 # [ 0.533196] NetLabel: unlabeled traffic allowed by default1424client # [ 0.554830] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1425worker1 # [ 0.533438] PCI: Using ACPI for IRQ routing1426client # [ 0.556252] pnp: PnP ACPI init1427client # [ 0.557084] ACPI: IRQ 4 override to edge(!), high(!)1428client # [ 0.558176] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1429client # [ 0.559737] pnp: PnP ACPI: found 6 devices1430worker2 # [ 0.564072] pci 0000:00:01.0: vgaarb: setting as boot VGA device1431lb # [ 0.560485] pci 0000:00:01.0: vgaarb: setting as boot VGA device1432worker2 # [ 0.564369] pci 0000:00:01.0: vgaarb: bridge control possible1433lb # [ 0.560550] pci 0000:00:01.0: vgaarb: bridge control possible1434worker2 # [ 0.564369] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435lb # [ 0.560550] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1436worker2 # [ 0.564381] vgaarb: loaded1437lb # [ 0.560569] vgaarb: loaded1438worker2 # [ 0.565166] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01439lb # [ 0.561438] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01440worker2 # [ 0.566054] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1441lb # [ 0.562261] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1442client # [ 0.567441] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1443client # [ 0.568916] clocksource: Switched to clocksource acpi_pm1444client # [ 0.569911] NET: Registered PF_INET protocol family1445worker2 # [ 0.569483] clocksource: Switched to clocksource kvm-clock1446lb # [ 0.565675] clocksource: Switched to clocksource kvm-clock1447client # [ 0.571107] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1448worker2 # [ 0.573239] VFS: Disk quotas dquot_6.6.01449lb # [ 0.569591] VFS: Disk quotas dquot_6.6.01450worker2 # [ 0.574042] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1451worker2 # [ 0.575508] pnp: PnP ACPI init1452lb # [ 0.570480] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1453worker2 # [ 0.576423] ACPI: IRQ 4 override to edge(!), high(!)1454lb # [ 0.572156] pnp: PnP ACPI init1455lb # [ 0.573121] ACPI: IRQ 4 override to edge(!), high(!)1456worker2 # [ 0.577472] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1457worker2 # [ 0.579109] pnp: PnP ACPI: found 6 devices1458lb # [ 0.574306] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1459lb # [ 0.576028] pnp: PnP ACPI: found 6 devices1460worker2 # [ 0.586877] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1461client # [ 0.588270] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1462worker2 # [ 0.588459] clocksource: Switched to clocksource acpi_pm1463lb # [ 0.584043] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1464worker2 # [ 0.589454] NET: Registered PF_INET protocol family1465client # [ 0.589840] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1466lb # [ 0.585712] clocksource: Switched to clocksource acpi_pm1467worker2 # [ 0.590659] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1468client # [ 0.591179] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1469lb # [ 0.586904] NET: Registered PF_INET protocol family1470client # [ 0.592536] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1471client # [ 0.593793] TCP: Hash tables configured (established 16384 bind 16384)1472lb # [ 0.588805] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1473client # [ 0.594936] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1474client # [ 0.596237] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1475client # [ 0.597321] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1476client # [ 0.598499] NET: Registered PF_UNIX/PF_LOCAL protocol family1477client # [ 0.599463] NET: Registered PF_XDP protocol family1478client # [ 0.600303] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1479client # [ 0.601286] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1480worker1 # [ 0.579158] pci 0000:00:01.0: vgaarb: setting as boot VGA device1481client # [ 0.602270] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1482worker1 # [ 0.579419] pci 0000:00:01.0: vgaarb: bridge control possible1483client # [ 0.603345] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1484worker1 # [ 0.579419] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1485worker1 # [ 0.579432] vgaarb: loaded1486client # [ 0.604411] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1487worker1 # [ 0.580212] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01488client # [ 0.605515] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1489worker1 # [ 0.581051] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1490client # [ 0.607364] ACPI: \_SB_.GSIA: Enabled at IRQ 161491client # [ 0.609631] ACPI: \_SB_.GSIB: Enabled at IRQ 171492worker2 # [ 0.608472] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1493worker1 # [ 0.584558] clocksource: Switched to clocksource kvm-clock1494worker2 # [ 0.610269] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1495client # [ 0.611648] ACPI: \_SB_.GSIC: Enabled at IRQ 181496lb # [ 0.606394] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1497worker2 # [ 0.611732] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1498client # [ 0.613609] ACPI: \_SB_.GSID: Enabled at IRQ 191499lb # [ 0.608282] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1500worker2 # [ 0.613195] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1501worker1 # [ 0.588632] VFS: Disk quotas dquot_6.6.01502worker2 # [ 0.614470] TCP: Hash tables configured (established 16384 bind 16384)1503client # [ 0.615328] PCI: CLS 0 bytes, default 641504lb # [ 0.609813] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1505worker1 # [ 0.589454] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1506client # [ 0.616290] Trying to unpack rootfs image as initramfs...1507worker2 # [ 0.615622] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1508worker1 # [ 0.590953] pnp: PnP ACPI init1509lb # [ 0.611357] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1510worker2 # [ 0.616943] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1511worker1 # [ 0.591871] ACPI: IRQ 4 override to edge(!), high(!)1512lb # [ 0.612787] TCP: Hash tables configured (established 16384 bind 16384)1513worker2 # [ 0.618078] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1514worker1 # [ 0.592956] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1515lb # [ 0.614147] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1516worker2 # [ 0.619388] NET: Registered PF_UNIX/PF_LOCAL protocol family1517worker1 # [ 0.594538] pnp: PnP ACPI: found 6 devices1518worker2 # [ 0.620373] NET: Registered PF_XDP protocol family1519lb # [ 0.615645] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1520client # [ 0.620657] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1521worker2 # [ 0.621225] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1522lb # [ 0.616878] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1523worker2 # [ 0.622244] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1524lb # [ 0.618365] NET: Registered PF_UNIX/PF_LOCAL protocol family1525worker2 # [ 0.623260] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1526lb # [ 0.619537] NET: Registered PF_XDP protocol family1527worker2 # [ 0.624385] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1528lb # [ 0.620534] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1529worker2 # [ 0.625513] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1530lb # [ 0.621681] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1531worker2 # [ 0.626645] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1532lb # [ 0.622851] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1533worker2 # [ 0.628435] ACPI: \_SB_.GSIA: Enabled at IRQ 161534worker1 # [ 0.602389] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1535lb # [ 0.624111] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1536worker1 # [ 0.603851] clocksource: Switched to clocksource acpi_pm1537lb # [ 0.625349] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1538worker2 # [ 0.630607] ACPI: \_SB_.GSIB: Enabled at IRQ 171539worker1 # [ 0.604885] NET: Registered PF_INET protocol family1540lb # [ 0.626592] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1541worker1 # [ 0.606091] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1542worker2 # [ 0.632655] ACPI: \_SB_.GSIC: Enabled at IRQ 181543lb # [ 0.628537] ACPI: \_SB_.GSIA: Enabled at IRQ 161544worker2 # [ 0.634672] ACPI: \_SB_.GSID: Enabled at IRQ 191545lb # [ 0.631097] ACPI: \_SB_.GSIB: Enabled at IRQ 171546worker2 # [ 0.636513] PCI: CLS 0 bytes, default 641547lb # [ 0.633291] ACPI: \_SB_.GSIC: Enabled at IRQ 181548worker2 # [ 0.637463] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1549worker2 # [ 0.639252] Trying to unpack rootfs image as initramfs...1550lb # [ 0.635432] ACPI: \_SB_.GSID: Enabled at IRQ 191551lb # [ 0.637272] PCI: CLS 0 bytes, default 641552lb # [ 0.638390] Trying to unpack rootfs image as initramfs...1553lb # [ 0.644654] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1554worker1 # [ 0.624017] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1555worker1 # [ 0.625729] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1556worker1 # [ 0.627105] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1557worker1 # [ 0.628477] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1558worker1 # [ 0.629759] TCP: Hash tables configured (established 16384 bind 16384)1559worker1 # [ 0.630943] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1560worker1 # [ 0.632283] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1561worker1 # [ 0.633381] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1562worker1 # [ 0.634621] NET: Registered PF_UNIX/PF_LOCAL protocol family1563worker1 # [ 0.635626] NET: Registered PF_XDP protocol family1564client # [ 0.662037] Initialise system trusted keyrings1565worker1 # [ 0.636528] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1566worker1 # [ 0.637547] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1567worker1 # [ 0.638579] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1568client # [ 0.665214] workingset: timestamp_bits=40 max_order=19 bucket_order=01569worker1 # [ 0.639712] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1570worker1 # [ 0.640821] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1571worker1 # [ 0.641944] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1572worker1 # [ 0.643886] ACPI: \_SB_.GSIA: Enabled at IRQ 161573worker1 # [ 0.646116] ACPI: \_SB_.GSIB: Enabled at IRQ 171574worker1 # [ 0.648336] ACPI: \_SB_.GSIC: Enabled at IRQ 181575worker1 # [ 0.650401] ACPI: \_SB_.GSID: Enabled at IRQ 191576worker1 # [ 0.652232] PCI: CLS 0 bytes, default 641577worker1 # [ 0.653239] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1578worker1 # [ 0.655331] Trying to unpack rootfs image as initramfs...1579worker2 # [ 0.688113] Initialise system trusted keyrings1580client # [ 0.690016] Key type asymmetric registered1581client # [ 0.690904] Asymmetric key parser 'x509' registered1582worker2 # [ 0.691094] workingset: timestamp_bits=40 max_order=19 bucket_order=01583client # [ 0.693246] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584lb # [ 0.689739] Initialise system trusted keyrings1585client # [ 0.696218] io scheduler mq-deadline registered1586client # [ 0.697004] io scheduler kyber registered1587lb # [ 0.693317] workingset: timestamp_bits=40 max_order=19 bucket_order=01588client # [ 0.700819] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1589client # [ 0.704352] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1590client # [ 0.709551] Linux agpgart interface v0.1031591client # [ 0.710327] ACPI: bus type drm_connector registered1592client # [ 0.713809] usbcore: registered new interface driver usbserial_generic1593worker2 # [ 0.714115] Key type asymmetric registered1594client # [ 0.715004] usbserial: USB Serial support registered for generic1595worker2 # [ 0.714897] Asymmetric key parser 'x509' registered1596client # [ 0.718171] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1597worker2 # [ 0.718109] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1598client # [ 0.718171] Please enable it if your BIOS has the CPPC option.1599lb # [ 0.715296] Key type asymmetric registered1600client # [ 0.720437] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1601lb # [ 0.716143] Asymmetric key parser 'x509' registered1602worker2 # [ 0.721118] io scheduler mq-deadline registered1603worker2 # [ 0.721923] io scheduler kyber registered1604lb # [ 0.717213] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1605client # [ 0.723321] drop_monitor: Initializing network drop monitor service1606client # [ 0.724521] NET: Registered PF_INET6 protocol family1607worker2 # [ 0.726083] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1608worker2 # [ 0.727433] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1609lb # [ 0.723429] io scheduler mq-deadline registered1610client # [ 0.729279] Segment Routing with IPv61611lb # [ 0.724362] io scheduler kyber registered1612client # [ 0.730014] In-situ OAM (IOAM) with IPv61613client # [ 0.732465] IPI shorthand broadcast: enabled1614lb # [ 0.727958] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1615worker2 # [ 0.734131] Linux agpgart interface v0.1031616worker1 # [ 0.708534] Initialise system trusted keyrings1617worker2 # [ 0.734934] ACPI: bus type drm_connector registered1618lb # [ 0.731514] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1619worker1 # [ 0.711740] workingset: timestamp_bits=40 max_order=19 bucket_order=01620worker2 # [ 0.738304] usbcore: registered new interface driver usbserial_generic1621worker2 # [ 0.739449] usbserial: USB Serial support registered for generic1622client # [ 0.741003] sched_clock: Marking stable (600017294, 140137614)->(812779095, -72624187)1623lb # [ 0.737145] Linux agpgart interface v0.1031624lb # [ 0.738036] ACPI: bus type drm_connector registered1625worker2 # [ 0.742063] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1626worker2 # [ 0.742063] Please enable it if your BIOS has the CPPC option.1627client # [ 0.744394] registered taskstats version 11628worker2 # [ 0.744329] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1629client # [ 0.745384] Loading compiled-in X.509 certificates1630lb # [ 0.742805] usbcore: registered new interface driver usbserial_generic1631lb # [ 0.744167] usbserial: USB Serial support registered for generic1632worker2 # [ 0.749228] drop_monitor: Initializing network drop monitor service1633worker2 # [ 0.750440] NET: Registered PF_INET6 protocol family1634lb # [ 0.747277] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1635worker2 # [ 0.753546] Segment Routing with IPv61636lb # [ 0.747277] Please enable it if your BIOS has the CPPC option.1637lb # [ 0.749832] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1638worker2 # [ 0.756076] In-situ OAM (IOAM) with IPv61639worker2 # [ 0.757251] IPI shorthand broadcast: enabled1640lb # [ 0.754473] drop_monitor: Initializing network drop monitor service1641worker1 # [ 0.734367] Key type asymmetric registered1642lb # [ 0.755920] NET: Registered PF_INET6 protocol family1643worker1 # [ 0.735350] Asymmetric key parser 'x509' registered1644worker1 # [ 0.737770] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1645client # [ 0.764559] Demotion targets for Node 0: null1646lb # [ 0.759831] Segment Routing with IPv61647worker2 # [ 0.765821] sched_clock: Marking stable (621017525, 144017085)->(842426188, -77391578)1648worker1 # [ 0.740758] io scheduler mq-deadline registered1649lb # [ 0.762290] In-situ OAM (IOAM) with IPv61650client # [ 0.767221] Key type .fscrypt registered1651worker1 # [ 0.741539] io scheduler kyber registered1652client # [ 0.767900] Key type fscrypt-provisioning registered1653lb # [ 0.763470] IPI shorthand broadcast: enabled1654client # [ 0.768939] ima: No TPM chip found, activating TPM-bypass!1655worker2 # [ 0.769281] registered taskstats version 11656worker2 # [ 0.770302] Loading compiled-in X.509 certificates1657worker1 # [ 0.745915] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1658client # [ 0.773181] ima: Allocated hash algorithm: sha11659worker1 # [ 0.747282] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1660client # [ 0.773975] ima: No architecture policies found1661client # [ 0.776174] PM: Magic number: 10:880:681662worker1 # [ 0.752608] Linux agpgart interface v0.1031663lb # [ 0.773934] sched_clock: Marking stable (632015698, 141240159)->(858401398, -85145541)1664worker1 # [ 0.753436] ACPI: bus type drm_connector registered1665client # [ 0.780622] RAS: Correctable Errors collector initialized.1666lb # [ 0.777515] registered taskstats version 11667lb # [ 0.778557] Loading compiled-in X.509 certificates1668worker1 # [ 0.758273] usbcore: registered new interface driver usbserial_generic1669worker1 # [ 0.759375] usbserial: USB Serial support registered for generic1670worker1 # [ 0.762692] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1671client # [ 0.789815] clk: Disabling unused clocks1672worker1 # [ 0.762692] Please enable it if your BIOS has the CPPC option.1673worker1 # [ 0.764909] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1674worker2 # [ 0.791262] Demotion targets for Node 0: null1675client # [ 0.792172] PM: genpd: Disabling unused power domains1676worker2 # [ 0.792311] Key type .fscrypt registered1677worker1 # [ 0.768923] drop_monitor: Initializing network drop monitor service1678worker2 # [ 0.795060] Key type fscrypt-provisioning registered1679worker1 # [ 0.770171] NET: Registered PF_INET6 protocol family1680worker2 # [ 0.796052] ima: No TPM chip found, activating TPM-bypass!1681worker2 # [ 0.796983] ima: Allocated hash algorithm: sha11682worker1 # [ 0.773272] Segment Routing with IPv61683worker2 # [ 0.799085] ima: No architecture policies found1684lb # [ 0.797283] Demotion targets for Node 0: null1685worker2 # [ 0.802065] PM: Magic number: 10:880:681686worker1 # [ 0.776713] In-situ OAM (IOAM) with IPv61687lb # [ 0.798338] Key type .fscrypt registered1688lb # [ 0.799003] Key type fscrypt-provisioning registered1689worker1 # [ 0.777901] IPI shorthand broadcast: enabled1690worker2 # [ 0.803963] RAS: Correctable Errors collector initialized.1691lb # [ 0.802405] ima: No TPM chip found, activating TPM-bypass!1692lb # [ 0.803309] ima: Allocated hash algorithm: sha11693lb # [ 0.804125] ima: No architecture policies found1694worker1 # [ 0.786335] sched_clock: Marking stable (636016227, 149651887)->(872262169, -86594055)1695lb # [ 0.808497] PM: Magic number: 10:880:681696lb # [ 0.810141] RAS: Correctable Errors collector initialized.1697worker2 # [ 0.815350] clk: Disabling unused clocks1698worker1 # [ 0.789941] registered taskstats version 11699worker1 # [ 0.791029] Loading compiled-in X.509 certificates1700worker2 # [ 0.818060] PM: genpd: Disabling unused power domains1701lb # [ 0.818104] clk: Disabling unused clocks1702lb # [ 0.822289] PM: genpd: Disabling unused power domains1703worker1 # [ 0.809893] Demotion targets for Node 0: null1704worker1 # [ 0.812743] Key type .fscrypt registered1705worker1 # [ 0.813473] Key type fscrypt-provisioning registered1706worker1 # [ 0.816848] ima: No TPM chip found, activating TPM-bypass!1707worker1 # [ 0.817834] ima: Allocated hash algorithm: sha11708worker1 # [ 0.820701] ima: No architecture policies found1709worker1 # [ 0.821787] PM: Magic number: 10:880:681710worker1 # [ 0.823636] RAS: Correctable Errors collector initialized.1711worker1 # [ 0.836901] clk: Disabling unused clocks1712worker1 # [ 0.837692] PM: genpd: Disabling unused power domains1713client # [ 0.984466] Freeing initrd memory: 29096K1714client # [ 0.987713] Freeing unused decrypted memory: 2028K1715client # [ 0.990483] Freeing unused kernel image (initmem) memory: 3644K1716client # [ 0.991561] Write protecting the kernel read-only data: 32768k1717client # [ 0.993438] Freeing unused kernel image (text/rodata gap) memory: 1208K1718client # [ 0.994972] Freeing unused kernel image (rodata/data gap) memory: 752K1719worker2 # [ 1.040416] Freeing initrd memory: 29092K1720worker2 # [ 1.043763] Freeing unused decrypted memory: 2028K1721worker2 # [ 1.046474] Freeing unused kernel image (initmem) memory: 3644K1722client # [ 1.047394] x86/mm: Checked W+X mappings: passed, no W+X pages found.1723worker2 # [ 1.047659] Write protecting the kernel read-only data: 32768k1724client # [ 1.048700] Run /init as init process1725worker2 # [ 1.049604] Freeing unused kernel image (text/rodata gap) memory: 1208K1726worker2 # [ 1.051172] Freeing unused kernel image (rodata/data gap) memory: 752K1727worker1 # [ 1.029324] Freeing initrd memory: 29092K1728worker1 # [ 1.032890] Freeing unused decrypted memory: 2028K1729client # [ 1.059406] systemd[1]: Inserted module 'autofs4'1730worker1 # [ 1.035788] Freeing unused kernel image (initmem) memory: 3644K1731worker1 # [ 1.036907] Write protecting the kernel read-only data: 32768k1732worker1 # [ 1.038894] Freeing unused kernel image (text/rodata gap) memory: 1208K1733worker1 # [ 1.040449] Freeing unused kernel image (rodata/data gap) memory: 752K1734lb # [ 1.069460] Freeing initrd memory: 29092K1735client # [ 1.076309] fuse: init (API version 7.45)1736lb # [ 1.073065] Freeing unused decrypted memory: 2028K1737lb # [ 1.076198] Freeing unused kernel image (initmem) memory: 3644K1738lb # [ 1.077393] Write protecting the kernel read-only data: 32768k1739client # [ 1.082613] ACPI: \_SB_.GSIG: Enabled at IRQ 221740lb # [ 1.079608] Freeing unused kernel image (text/rodata gap) memory: 1208K1741client # [ 1.085183] ACPI: \_SB_.GSIH: Enabled at IRQ 231742lb # [ 1.081295] Freeing unused kernel image (rodata/data gap) memory: 752K1743client # [ 1.088559] ACPI: \_SB_.GSIE: Enabled at IRQ 201744client # [ 1.090928] ACPI: \_SB_.GSIF: Enabled at IRQ 211745worker2 # [ 1.105606] x86/mm: Checked W+X mappings: passed, no W+X pages found.1746worker2 # [ 1.106775] Run /init as init process1747worker2 # [ 1.117745] systemd[1]: Inserted module 'autofs4'1748client # [ 1.118030] systemd[1]: Successfully made /usr/ read-only.1749worker1 # [ 1.093065] x86/mm: Checked W+X mappings: passed, no W+X pages found.1750worker1 # [ 1.094253] Run /init as init process1751worker1 # [ 1.105498] systemd[1]: Inserted module 'autofs4'1752worker2 # [ 1.135390] fuse: init (API version 7.45)1753lb # [ 1.135341] x86/mm: Checked W+X mappings: passed, no W+X pages found.1754lb # [ 1.136602] Run /init as init process1755worker2 # [ 1.141873] ACPI: \_SB_.GSIG: Enabled at IRQ 221756worker2 # [ 1.144670] ACPI: \_SB_.GSIH: Enabled at IRQ 231757worker1 # [ 1.122893] fuse: init (API version 7.45)1758worker2 # [ 1.148671] ACPI: \_SB_.GSIE: Enabled at IRQ 201759worker2 # [ 1.151487] ACPI: \_SB_.GSIF: Enabled at IRQ 211760lb # [ 1.148412] systemd[1]: Inserted module 'autofs4'1761worker1 # [ 1.129306] ACPI: \_SB_.GSIG: Enabled at IRQ 221762worker1 # [ 1.132097] ACPI: \_SB_.GSIH: Enabled at IRQ 231763worker1 # [ 1.135415] ACPI: \_SB_.GSIE: Enabled at IRQ 201764worker1 # [ 1.137820] ACPI: \_SB_.GSIF: Enabled at IRQ 211765lb # [ 1.166590] fuse: init (API version 7.45)1766lb # [ 1.173638] ACPI: \_SB_.GSIG: Enabled at IRQ 221767worker2 # [ 1.179385] systemd[1]: Successfully made /usr/ read-only.1768lb # [ 1.176726] ACPI: \_SB_.GSIH: Enabled at IRQ 231769lb # [ 1.180665] ACPI: \_SB_.GSIE: Enabled at IRQ 201770lb # [ 1.183220] ACPI: \_SB_.GSIF: Enabled at IRQ 211771worker1 # [ 1.165763] systemd[1]: Successfully made /usr/ read-only.1772lb # [ 1.213287] systemd[1]: Successfully made /usr/ read-only.1773client # [ 1.454696] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1774client # [ 1.466896] systemd[1]: Detected virtualization kvm.1775client # [ 1.469100] systemd[1]: Detected architecture x86-64.1776client # [ 1.471245] systemd[1]: Running in initrd.1777client # [ 1.473777] systemd[1]: Initializing machine ID from random generator.1778client # [ 1.476663] systemd[1]: Hostname set to <client>.1779worker2 # [ 1.515301] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1780worker2 # [ 1.520826] systemd[1]: Detected virtualization kvm.1781worker2 # [ 1.521879] systemd[1]: Detected architecture x86-64.1782worker2 # [ 1.522898] systemd[1]: Running in initrd.1783worker2 # [ 1.524473] systemd[1]: Initializing machine ID from random generator.1784worker2 # [ 1.525801] systemd[1]: Hostname set to <worker2>.1785worker1 # [ 1.501681] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1786worker1 # [ 1.507845] systemd[1]: Detected virtualization kvm.1787worker1 # [ 1.509221] systemd[1]: Detected architecture x86-64.1788worker1 # [ 1.510539] systemd[1]: Running in initrd.1789worker1 # [ 1.512306] systemd[1]: Initializing machine ID from random generator.1790worker1 # [ 1.514083] systemd[1]: Hostname set to <worker1>.1791lb # [ 1.549212] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1792lb # [ 1.555815] systemd[1]: Detected virtualization kvm.1793lb # [ 1.557058] systemd[1]: Detected architecture x86-64.1794lb # [ 1.558413] systemd[1]: Running in initrd.1795lb # [ 1.559954] systemd[1]: Initializing machine ID from random generator.1796lb # [ 1.561587] systemd[1]: Hostname set to <lb>.1797client # [ 1.687841] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798client # [ 1.727429] systemd[1]: Queued start job for default target Initrd Default Target.1799client # [ 1.731491] systemd[1]: Created slice Slice /system/modprobe.1800client # [ 1.732619] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801client # [ 1.733974] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802client # [ 1.735127] systemd[1]: Reached target Path Units.1803client # [ 1.736037] systemd[1]: Reached target Slice Units.1804client # [ 1.736968] systemd[1]: Reached target Swaps.1805client # [ 1.737821] systemd[1]: Reached target Timer Units.1806client # [ 1.738776] systemd[1]: Listening on D-Bus System Message Bus Socket.1807client # [ 1.739952] systemd[1]: Listening on Journal Socket (/dev/log).1808client # [ 1.741107] systemd[1]: Listening on Journal Sockets.1809client # [ 1.742109] systemd[1]: Listening on udev Control Socket.1810client # [ 1.743108] systemd[1]: Listening on udev Kernel Socket.1811client # [ 1.744036] systemd[1]: Reached target Socket Units.1812worker2 # [ 1.742258] systemd[1]: bpf-restrict-fs: LSM BPF program attached1813client # [ 1.745842] systemd[1]: Starting Create List of Static Device Nodes...1814client # [ 1.750222] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1815client # [ 1.756873] systemd[1]: Starting Load Kernel Module configfs...1816worker1 # [ 1.734194] systemd[1]: bpf-restrict-fs: LSM BPF program attached1817client # [ 1.770949] systemd[1]: Starting Journal Service...1818client # [ 1.786224] systemd[1]: Starting Load Kernel Modules...1819worker2 # [ 1.797393] systemd[1]: Queued start job for default target Initrd Default Target.1820worker2 # [ 1.801528] systemd[1]: Created slice Slice /system/modprobe.1821lb # [ 1.796183] systemd[1]: bpf-restrict-fs: LSM BPF program attached1822worker1 # [ 1.776372] systemd[1]: Queued start job for default target Initrd Default Target.1823client # [ 1.791227] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1824worker2 # [ 1.802848] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1825worker2 # [ 1.804348] systemd[1]: Expecting device /dev/disk/by-label/nixos...1826worker2 # [ 1.805574] systemd[1]: Reached target Path Units.1827worker2 # [ 1.806544] systemd[1]: Reached target Slice Units.1828worker1 # [ 1.781170] systemd[1]: Created slice Slice /system/modprobe.1829worker2 # [ 1.807517] systemd[1]: Reached target Swaps.1830client # [ 1.808892] netfs: FS-Cache loaded1831worker2 # [ 1.808380] systemd[1]: Reached target Timer Units.1832worker1 # [ 1.782351] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1833worker1 # [ 1.783736] systemd[1]: Expecting device /dev/disk/by-label/nixos...1834worker2 # [ 1.809482] systemd[1]: Listening on D-Bus System Message Bus Socket.1835worker1 # [ 1.784824] systemd[1]: Reached target Path Units.1836worker2 # [ 1.810838] systemd[1]: Listening on Journal Socket (/dev/log).1837worker1 # [ 1.785693] systemd[1]: Reached target Slice Units.1838worker1 # [ 1.786534] systemd[1]: Reached target Swaps.1839worker2 # [ 1.812147] systemd[1]: Listening on Journal Sockets.1840worker1 # [ 1.787327] systemd[1]: Reached target Timer Units.1841worker2 # [ 1.813251] systemd[1]: Listening on udev Control Socket.1842client # [ 1.813903] 9pnet: Installing 9P2000 support1843worker1 # [ 1.788315] systemd[1]: Listening on D-Bus System Message Bus Socket.1844worker2 # [ 1.814372] systemd[1]: Listening on udev Kernel Socket.1845worker1 # [ 1.789511] systemd[1]: Listening on Journal Socket (/dev/log).1846worker2 # [ 1.815409] systemd[1]: Reached target Socket Units.1847worker1 # [ 1.790701] systemd[1]: Listening on Journal Sockets.1848worker1 # [ 1.791715] systemd[1]: Listening on udev Control Socket.1849worker2 # [ 1.817774] systemd[1]: Starting Create List of Static Device Nodes...1850worker1 # [ 1.792731] systemd[1]: Listening on udev Kernel Socket.1851worker1 # [ 1.793668] systemd[1]: Reached target Socket Units.1852worker1 # [ 1.795742] systemd[1]: Starting Create List of Static Device Nodes...1853worker2 # [ 1.823146] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1854client # [ 1.825233] systemd[1]: Starting Coldplug All udev Devices...1855worker1 # [ 1.801771] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1856worker2 # [ 1.832111] systemd[1]: Starting Load Kernel Module configfs...1857worker1 # [ 1.807760] systemd[1]: Starting Load Kernel Module configfs...1858client # [ 1.840302] systemd[1]: Finished Create List of Static Device Nodes.1859client # [ 1.845752] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1860worker2 # [ 1.849125] systemd[1]: Starting Journal Service...1861worker1 # [ 1.823847] systemd[1]: Starting Journal Service...1862client # [ 1.853612] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1863lb # [ 1.850638] systemd[1]: Queued start job for default target Initrd Default Target.1864client # [ 1.858594] systemd[1]: modprobe@configfs.service: Deactivated successfully.1865lb # [ 1.854628] systemd[1]: Created slice Slice /system/modprobe.1866client # [ 1.860373] systemd-journald[67]: Collecting audit messages is disabled.1867lb # [ 1.855863] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1868lb # [ 1.857383] systemd[1]: Expecting device /dev/disk/by-label/nixos...1869worker1 # [ 1.837065] systemd[1]: Starting Load Kernel Modules...1870lb # [ 1.858540] systemd[1]: Reached target Path Units.1871lb # [ 1.859428] systemd[1]: Reached target Slice Units.1872lb # [ 1.860325] systemd[1]: Reached target Swaps.1873client # [ 1.865543] systemd[1]: Finished Load Kernel Module configfs.1874worker2 # [ 1.865156] systemd[1]: Starting Load Kernel Modules...1875lb # [ 1.861110] systemd[1]: Reached target Timer Units.1876lb # [ 1.862117] systemd[1]: Listening on D-Bus System Message Bus Socket.1877lb # [ 1.863403] systemd[1]: Listening on Journal Socket (/dev/log).1878lb # [ 1.864597] systemd[1]: Listening on Journal Sockets.1879lb # [ 1.865630] systemd[1]: Listening on udev Control Socket.1880lb # [ 1.866701] systemd[1]: Listening on udev Kernel Socket.1881lb # [ 1.867709] systemd[1]: Reached target Socket Units.1882client # [ 1.872619] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1883lb # [ 1.869805] systemd[1]: Starting Create List of Static Device Nodes...1884client # [ 1.877765] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1885lb # [ 1.875351] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1886client # [ 1.885479] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1887lb # [ 1.881225] systemd[1]: Starting Load Kernel Module configfs...1888worker2 # [ 1.874114] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1889client # [ 1.889338] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1890worker1 # [ 1.848142] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1891worker2 # [ 1.892122] netfs: FS-Cache loaded1892worker2 # [ 1.897951] 9pnet: Installing 9P2000 support1893worker1 # [ 1.876611] netfs: FS-Cache loaded1894lb # [ 1.898358] systemd[1]: Starting Journal Service...1895worker1 # [ 1.883989] 9pnet: Installing 9P2000 support1896worker2 # [ 1.912186] systemd[1]: Starting Coldplug All udev Devices...1897lb # [ 1.912355] systemd[1]: Starting Load Kernel Modules...1898client # [ 1.921754] systemd[1]: Finished Load Kernel Modules.1899worker1 # [ 1.900790] systemd[1]: Starting Coldplug All udev Devices...1900worker2 # [ 1.929148] systemd[1]: Finished Create List of Static Device Nodes.1901client # [ 1.930392] systemd[1]: Starting Apply Kernel Variables...1902worker2 # [ 1.932959] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1903lb # [ 1.919369] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1904lb # [ 1.936258] netfs: FS-Cache loaded1905worker2 # [ 1.942141] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1906worker1 # [ 1.916767] systemd[1]: Finished Create List of Static Device Nodes.1907client # [ 1.943292] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1908lb # [ 1.941514] 9pnet: Installing 9P2000 support1909worker1 # [ 1.922479] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1910worker2 # [ 1.949542] systemd[1]: modprobe@configfs.service: Deactivated successfully.1911worker2 # [ 1.952494] systemd-journald[67]: Collecting audit messages is disabled.1912client # [ 1.954254] systemd[1]: Starting Create Static Device Nodes in /dev...1913worker2 # [ 1.955522] systemd[1]: Finished Load Kernel Module configfs.1914lb # [ 1.953487] systemd[1]: Starting Coldplug All udev Devices...1915worker1 # [ 1.932293] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1916worker1 # [ 1.937275] systemd[1]: modprobe@configfs.service: Deactivated successfully.1917worker2 # [ 1.962610] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1918worker1 # [ 1.941825] systemd-journald[67]: Collecting audit messages is disabled.1919worker2 # [ 1.967319] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1920worker1 # [ 1.947142] systemd[1]: Finished Load Kernel Module configfs.1921worker2 # [ 1.974087] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1922lb # [ 1.970334] systemd[1]: Finished Create List of Static Device Nodes.1923worker2 # [ 1.975988] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1924worker1 # [ 1.951322] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1925client # [ 1.980271] systemd[1]: Finished Apply Kernel Variables.1926worker1 # [ 1.954101] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1927lb # [ 1.978363] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1928client # [ 1.987947] systemd[1]: Started Journal Service.1929lb # [ 1.983800] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1930worker1 # [ 1.963709] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1931client # [ 1.851260] systemd-modules-load[68]: Inserted module 'dm_mod'1932worker1 # [ 1.965782] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1933client # [ 1.854126] systemd-modules-load[68]: Inserted module 'virtio_balloon'1934lb # [ 1.989140] systemd[1]: modprobe@configfs.service: Deactivated successfully.1935client # [ 1.856331] systemd-modules-load[68]: Inserted module 'virtio_gpu'1936lb # [ 1.993646] systemd-journald[67]: Collecting audit messages is disabled.1937client # [ 1.861829] systemd[1]: Finished Create Static Device Nodes in /dev.1938lb # [ 2.000746] systemd[1]: Finished Load Kernel Module configfs.1939client # [ 1.866893] systemd[1]: Reached target Preparation for Local File Systems.1940worker2 # [ 2.008685] systemd[1]: Finished Load Kernel Modules.1941lb # [ 2.003828] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1942client # [ 1.869991] systemd[1]: Reached target Local File Systems.1943client # [ 1.873076] systemd[1]: Starting Create System Files and Directories...1944lb # [ 2.007648] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1945worker2 # [ 2.017275] systemd[1]: Starting Apply Kernel Variables...1946client # [ 1.878169] systemd[1]: Starting Rule-based Manager for Device Events and Files...1947lb # [ 2.015306] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1948lb # [ 2.017134] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1949worker1 # [ 2.000348] systemd[1]: Finished Load Kernel Modules.1950worker2 # [ 2.033154] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1951worker1 # [ 2.008924] systemd[1]: Starting Apply Kernel Variables...1952worker2 # [ 2.042511] systemd[1]: Starting Create Static Device Nodes in /dev...1953client # [ 1.910202] systemd[1]: Finished Create System Files and Directories.1954lb # [ 2.045933] systemd[1]: Finished Load Kernel Modules.1955worker1 # [ 2.026788] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1956lb # [ 2.055473] systemd[1]: Starting Apply Kernel Variables...1957worker1 # [ 2.037762] systemd[1]: Starting Create Static Device Nodes in /dev...1958worker2 # [ 2.067397] systemd[1]: Finished Apply Kernel Variables.1959client # [ 1.933352] systemd-udevd[84]: Using default interface naming scheme 'v261'.1960lb # [ 2.071913] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1961worker2 # [ 1.932577] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.078242] systemd[1]: Started Journal Service.1962worker1 # [ 2.053822] systemd[1]: Finished Apply Kernel Variables.1963worker2 # 1964worker2 # [ 1.937365] systemd-modules-load[68]: Inserted module 'virtio_balloon'1965worker2 # [ 1.938560] systemd-modules-load[68]: Inserted module 'virtio_gpu'1966lb # [ 2.081914] systemd[1]: Starting Create Static Device Nodes in /dev...1967worker1 # [ 1.916532] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.068836] systemd[1]: Started Journal Service.1968worker2 # [ 1.951308] systemd[1]: Finished Create Static Device Nodes in /dev.1969worker1 # 1970worker1 # [ 1.921386] systemd-modules-load[68]: Inserted module 'virtio_balloon'1971worker1 # [ 1.922518] systemd-modules-load[68]: Inserted module 'virtio_gpu'1972worker2 # [ 1.954086] systemd[1]: Reached target Preparation for Local File Systems.1973client # [ 1.959470] systemd[1]: Started Rule-based Manager for Device Events and Files.1974worker2 # [ 1.955962] systemd[1]: Reached target Local File Systems.1975worker2 # [ 1.959071] systemd[1]: Starting Create System Files and Directories...1976worker2 # [ 1.963476] systemd[1]: Starting Rule-based Manager for Device Events and Files...1977lb # [ 2.104888] systemd[1]: Finished Apply Kernel Variables.1978worker1 # [ 1.939139] systemd[1]: Finished Create Static Device Nodes in /dev.1979worker1 # [ 1.940832] systemd[1]: Reached target Preparation for Local File Systems.1980lb # [ 1.972245] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.114697] systemd[1]: Started Journal Service.1981lb # 1982worker1 # [ 1.944076] systemd[1]: Reached target Local File Systems.1983lb # [ 1.974442] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984lb # [ 1.976347] systemd-modules-load[68]: Inserted module 'virtio_gpu'1985worker1 # [ 1.947070] systemd[1]: Starting Create System Files and Directories...1986worker1 # [ 1.951578] systemd[1]: Starting Rule-based Manager for Device Events and Files...1987lb # [ 1.996174] systemd[1]: Finished Create Static Device Nodes in /dev.1988worker2 # [ 1.998268] systemd[1]: Finished Create System Files and Directories.1989lb # [ 1.997322] systemd[1]: Reached target Preparation for Local File Systems.1990client # [ 2.004103] systemd[1]: Finished Coldplug All udev Devices.1991lb # [ 1.998394] systemd[1]: Reached target Local File Systems.1992client # [ 2.005109] systemd[1]: Reached target System Initialization.1993client # [ 2.007267] systemd[1]: Reached target Basic System.1994lb # [ 2.002084] systemd[1]: Starting Create System Files and Directories...1995lb # [ 2.006391] systemd[1]: Starting Rule-based Manager for Device Events and Files...1996worker1 # [ 1.992915] systemd[1]: Finished Create System Files and Directories.1997worker2 # [ 2.028409] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998lb # [ 2.048826] systemd[1]: Finished Create System Files and Directories.1999worker1 # [ 2.019390] systemd-udevd[84]: Using default interface naming scheme 'v261'.2000worker2 # [ 2.057087] systemd[1]: Started Rule-based Manager for Device Events and Files.
loading 1,815 hidden lines…
3816worker2 # [ 11.214083] dhcpcd[747]: eth0: IAID 00:12:34:563817worker2 # [ 11.214852] dhcpcd[747]: eth0: adding address fe80::5054:ff:fe12:34563818worker1 # [ 11.343922] 8021q: 802.1Q VLAN Support v1.83819worker2 # [ 11.369900] EDAC MC: Ver: 3.0.03820worker1 # [ 11.344511] 8021q: adding VLAN 0 to HW filter on device eth13821worker1 # [ 11.223371] systemd[1]: Finished Permit User Sessions.3822lb # [ 11.257714] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3823worker1 # [ 11.229202] systemd[1]: Started Getty on tty1.3824lb # [ 11.400898] cfg80211: Loading compiled-in X.509 certificates for regulatory database3825worker1 # [ 11.231149] systemd[1]: Reached target Login Prompts.3826lb # [ 11.427496] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3827lb # [ 11.428606] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3828lb # [ 11.432744] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23829lb # [ 11.433853] cfg80211: failed to load regulatory.db3830worker1 # [ 11.303674] systemd-logind[601]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3831lb # [ 11.342383] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".3832lb # [ 11.343909] postgresql-pre-start[792]: This user must also own the server process.3833lb # [ 11.353105] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".3834lb # [ 11.355146] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".3835lb # [ 11.356333] postgresql-pre-start[792]: The default text search configuration will be set to "english".3836lb # [ 11.357511] postgresql-pre-start[792]: Data page checksums are enabled.3837lb # [ 11.360039] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3838lb # [ 11.361225] postgresql-pre-start[792]: creating subdirectories ... ok3839lb # [ 11.362761] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix3840worker1 # [ 11.499710] cfg80211: Loading compiled-in X.509 certificates for regulatory database3841lb # [ 11.525013] 8021q: adding VLAN 0 to HW filter on device eth03842worker1 # [ 11.355565] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3843lb # [ 11.385618] dhcpcd[774]: eth0: waiting for carrier3844lb # [ 11.386855] dhcpcd[774]: eth0: carrier acquired3845worker2 # [ 11.388559] systemd-vconsole-setup[755]: Configuration of first virtual console was skipped, ignoring remaining ones.3846worker1 # [ 11.358767] systemd[1]: Stopped Virtual Console Setup.3847worker2 # [ 11.394100] systemd[1]: Finished Virtual Console Setup.3848worker1 # [ 11.365283] systemd[1]: Starting Virtual Console Setup...3849lb # [ 11.400652] dhcpcd[774]: DUID 00:01:00:01:32:42:4f:e9:52:54:00:12:34:563850lb # [ 11.401968] dhcpcd[774]: eth0: IAID 00:12:34:563851lb # [ 11.402806] dhcpcd[774]: eth0: adding address fe80::5054:ff:fe12:34563852worker1 # [ 11.530432] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3853worker1 # [ 11.531448] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3854worker1 # [ 11.535252] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23855worker1 # [ 11.536214] cfg80211: failed to load regulatory.db3856worker1 # [ 11.404500] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3857lb # [ 11.477470] postgresql-pre-start[792]: selecting default "max_connections" ... 1003858worker1 # [ 11.644180] 8021q: adding VLAN 0 to HW filter on device eth03859worker1 # [ 11.496855] dhcpcd[748]: eth0: waiting for carrier3860worker1 # [ 11.499472] dhcpcd[748]: libudev: received NULL device3861worker1 # [ 11.501083] dhcpcd[748]: libudev: received NULL device3862worker1 # [ 11.501940] dhcpcd[748]: eth0: carrier acquired3863worker1 # [ 11.656845] kvm_amd: TSC scaling supported3864worker1 # [ 11.657337] kvm_amd: Nested Virtualization enabled3865worker1 # [ 11.658323] kvm_amd: Nested Paging enabled3866worker1 # [ 11.659125] kvm_amd: LBR virtualization supported3867worker1 # [ 11.660899] kvm_amd: Virtual VMLOAD VMSAVE supported3868worker1 # [ 11.661544] kvm_amd: Virtual GIF supported3869worker1 # [ 11.662738] kvm_amd: Virtual NMI enabled3870worker1 # [ 11.519497] dhcpcd[748]: DUID 00:01:00:01:32:42:4f:e8:52:54:00:12:34:563871worker1 # [ 11.520616] dhcpcd[748]: eth0: IAID 00:12:34:563872worker1 # [ 11.521469] dhcpcd[748]: eth0: adding address fe80::5054:ff:fe12:34563873lb # [ 11.565218] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB3874worker1 # [ 11.717575] EDAC MC: Ver: 3.0.03875client: (finished: waiting for unit network-addresses-eth1.service, in 12.32 seconds)3876client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3877client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3878lb: waiting for unit network-addresses-eth1.service3879lb: waiting for the VM to finish booting3880lb: Guest shell says: b'Spawning backdoor root shell...\n'3881lb: connected to guest root shell3882lb: (connecting took 0.00 seconds)3883lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3884worker2 # [ 11.723474] dhcpcd[747]: eth0: soliciting a DHCP lease3885worker2 # [ 11.882303] NET: Registered PF_PACKET protocol family3886worker2 # [ 11.743547] dhcpcd[747]: eth0: offered 10.0.2.15 from 10.0.2.23887worker2 # [ 11.747239] dhcpcd[747]: eth0: probing address 10.0.2.15/243888lb: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3889lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3890worker1 # [ 11.739584] systemd-vconsole-setup[756]: Configuration of first virtual console was skipped, ignoring remaining ones.3891worker1 # [ 11.743545] systemd[1]: Finished Virtual Console Setup.3892lb # [ 11.788412] dhcpcd[774]: eth0: soliciting a DHCP lease3893lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3894worker1: waiting for unit network-addresses-eth1.service3895worker1: waiting for the VM to finish booting3896worker1: Guest shell says: b'Spawning backdoor root shell...\n'3897worker1: connected to guest root shell3898worker1: (connecting took 0.00 seconds)3899worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3900lb # [ 11.949582] NET: Registered PF_PACKET protocol family3901lb # [ 11.813610] dhcpcd[774]: eth0: offered 10.0.2.15 from 10.0.2.23902lb # [ 11.816234] dhcpcd[774]: eth0: probing address 10.0.2.15/243903worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds)3904worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3905worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3906worker2: waiting for unit network-addresses-eth1.service3907worker2: waiting for the VM to finish booting3908worker2: Guest shell says: b'Spawning backdoor root shell...\n'3909worker2: connected to guest root shell3910worker2: (connecting took 0.00 seconds)3911worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3912worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3913worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3914worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds)3915lb: waiting for unit niks3.service3916client # [ 12.555650] dhcpcd[566]: eth0: soliciting a DHCP lease3917client # [ 12.709535] NET: Registered PF_PACKET protocol family3918client # [ 12.573517] dhcpcd[566]: eth0: offered 10.0.2.15 from 10.0.2.23919client # [ 12.576246] dhcpcd[566]: eth0: probing address 10.0.2.15/243920worker1 # [ 12.690966] dhcpcd[748]: eth0: soliciting a DHCP lease3921worker1 # [ 12.857743] NET: Registered PF_PACKET protocol family3922worker1 # [ 12.713542] dhcpcd[748]: eth0: offered 10.0.2.15 from 10.0.2.23923worker1 # [ 12.715170] dhcpcd[748]: eth0: probing address 10.0.2.15/243924worker2 # [ 12.946546] dhcpcd[747]: eth0: soliciting an IPv6 router3925worker2 # [ 12.949532] dhcpcd[747]: eth0: Router Advertisement from fe80::23926worker2 # [ 12.952176] dhcpcd[747]: eth0: adding address fec0::5054:ff:fe12:3456/643927worker2 # [ 12.954406] dhcpcd[747]: eth0: adding route to fec0::/643928worker2 # [ 12.956356] dhcpcd[747]: eth0: adding default route via fe80::23929worker1 # [ 13.009101] dhcpcd[748]: eth0: soliciting an IPv6 router3930worker1 # [ 13.010504] dhcpcd[748]: eth0: Router Advertisement from fe80::23931worker1 # [ 13.011391] dhcpcd[748]: eth0: adding address fec0::5054:ff:fe12:3456/643932worker1 # [ 13.012302] dhcpcd[748]: eth0: adding route to fec0::/643933worker1 # [ 13.013127] dhcpcd[748]: eth0: adding default route via fe80::23934lb # [ 13.421627] postgresql-pre-start[792]: selecting default time zone ... UTC3935lb # [ 13.425158] postgresql-pre-start[792]: creating configuration files ... ok3936lb # [ 13.495367] dhcpcd[774]: eth0: soliciting an IPv6 router3937lb # [ 13.497571] dhcpcd[774]: eth0: Router Advertisement from fe80::23938lb # [ 13.498427] dhcpcd[774]: eth0: adding address fec0::5054:ff:fe12:3456/643939lb # [ 13.499320] dhcpcd[774]: eth0: adding route to fec0::/643940lb # [ 13.500116] dhcpcd[774]: eth0: adding default route via fe80::23941lb # [ 13.673173] postgresql-pre-start[792]: running bootstrap script ... ok3942client # [ 13.689822] dhcpcd[566]: eth0: soliciting an IPv6 router3943client # [ 13.691368] dhcpcd[566]: eth0: Router Advertisement from fe80::23944client # [ 13.692251] dhcpcd[566]: eth0: adding address fec0::5054:ff:fe12:3456/643945client # [ 13.693169] dhcpcd[566]: eth0: adding route to fec0::/643946client # [ 13.693875] dhcpcd[566]: eth0: adding default route via fe80::23947lb # [ 14.306579] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok3948lb # [ 14.428910] postgresql-pre-start[792]: syncing data to disk ... ok3949lb # [ 14.430050] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections3950lb # [ 14.431264] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3951lb # [ 14.433106] postgresql-pre-start[792]: Success. You can now start the database server using:3952lb # [ 14.434160] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3953lb # [ 14.571412] postgres[869]: [869] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3954lb # [ 14.575644] postgres[869]: [869] LOG: listening on IPv6 address "::1", port 54323955lb # [ 14.576695] postgres[869]: [869] LOG: listening on IPv4 address "127.0.0.1", port 54323956lb # [ 14.581208] postgres[869]: [869] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3957lb # [ 14.593582] postgres[879]: [879] LOG: database system was shut down at 2026-09-20 08:03:56 GMT3958lb # [ 14.598073] postgres[869]: [869] LOG: database system is ready to accept connections3959lb # [ 14.603326] systemd[1]: Started PostgreSQL Server.3960lb # [ 14.611297] systemd[1]: Starting PostgreSQL Setup Scripts...3961lb # [ 14.799576] postgresql-setup-start[890]: CREATE DATABASE3962lb # [ 14.851501] postgresql-setup-start[895]: CREATE ROLE3963lb # [ 14.888254] postgresql-setup-start[897]: ALTER DATABASE3964lb # [ 14.895536] systemd[1]: Finished PostgreSQL Setup Scripts.3965lb # [ 14.897745] systemd[1]: Reached target PostgreSQL.3966worker2 # [ 16.514223] dhcpcd[747]: eth0: leased 10.0.2.15 for 86400 seconds3967worker2 # [ 16.515146] dhcpcd[747]: eth0: adding route to 10.0.2.0/243968worker2 # [ 16.515882] dhcpcd[747]: eth0: adding default route via 10.0.2.23969worker2 # [ 16.603509] systemd[1]: Started DHCP Client.3970worker2 # [ 16.605369] systemd[1]: Reached target Multi-User System.3971worker2 # [ 16.606375] systemd[1]: Startup finished in 966ms (kernel) + 5.008s (initrd) + 10.630s (userspace) = 16.605s.3972lb # [ 17.071286] dhcpcd[774]: eth0: leased 10.0.2.15 for 86400 seconds3973lb # [ 17.072249] dhcpcd[774]: eth0: adding route to 10.0.2.0/243974lb # [ 17.072937] dhcpcd[774]: eth0: adding default route via 10.0.2.23975lb # [ 17.166400] systemd[1]: Started DHCP Client.3976lb # [ 17.168920] systemd[1]: Reached target Network is Online.3977lb # [ 17.173543] systemd[1]: Started Envoy reverse proxy.3978lb # [ 17.177180] systemd[1]: Started mock-oidc.service.3979lb # [ 17.284886] mock-oidc-server[979]: Mock OIDC Server running3980lb # [ 17.286087] mock-oidc-server[979]: OIDC Address: 192.168.1.2:80803981lb # [ 17.287456] mock-oidc-server[979]: Issue Address: 0.0.0.0:80813982lb # [ 17.288344] mock-oidc-server[979]: Issuer: http://192.168.1.2:8080/oidc3983lb # [ 17.290089] mock-oidc-server[979]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3984lb # [ 17.291442] mock-oidc-server[979]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3985lb # [ 17.292819] mock-oidc-server[979]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3986client # [ 17.402909] dhcpcd[566]: eth0: leased 10.0.2.15 for 86400 seconds3987client # [ 17.404991] dhcpcd[566]: eth0: adding route to 10.0.2.0/243988client # [ 17.406276] dhcpcd[566]: eth0: adding default route via 10.0.2.23989client # [ 17.499050] systemd[1]: Started DHCP Client.3990client # [ 17.501212] systemd[1]: Reached target Multi-User System.3991client # [ 17.502293] systemd[1]: Startup finished in 912ms (kernel) + 5.006s (initrd) + 11.583s (userspace) = 17.502s.3992worker1 # [ 17.565376] dhcpcd[748]: eth0: leased 10.0.2.15 for 86400 seconds3993worker1 # [ 17.568532] dhcpcd[748]: eth0: adding route to 10.0.2.0/243994worker1 # [ 17.570487] dhcpcd[748]: eth0: adding default route via 10.0.2.23995worker1 # [ 17.658652] systemd[1]: Started DHCP Client.3996worker1 # [ 17.660659] systemd[1]: Reached target Multi-User System.3997worker1 # [ 17.661731] systemd[1]: Startup finished in 948ms (kernel) + 4.993s (initrd) + 11.719s (userspace) = 17.661s.3998lb # [ 17.755916] envoy[978]: [2026-09-20 08:03:59.975][978][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3999lb # [ 17.757784] envoy[978]: [2026-09-20 08:03:59.975][978][info][main] [source/server/server.cc:469] statically linked extensions:4000lb # [ 17.759508] envoy[978]: [2026-09-20 08:03:59.975][978][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4001lb # [ 17.761942] envoy[978]: [2026-09-20 08:03:59.975][978][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4002lb # [ 17.763952] envoy[978]: [2026-09-20 08:03:59.975][978][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4003lb # [ 17.766609] envoy[978]: [2026-09-20 08:03:59.975][978][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4004lb # [ 17.769458] envoy[978]: [2026-09-20 08:03:59.975][978][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24005lb # [ 17.771232] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4006lb # [ 17.775172] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4007lb # [ 17.777109] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4008lb # [ 17.778891] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4009lb # [ 17.780738] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4010lb # [ 17.785225] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4011lb # [ 17.788190] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4012lb # [ 17.790069] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4013lb # [ 17.792601] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4014lb # [ 17.794537] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4015lb # [ 17.796163] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4016lb # [ 17.798137] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4017lb # [ 17.801180] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4018lb # [ 17.802852] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4019lb # [ 17.807102] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4020lb # [ 17.821183] envoy[978]: [2026-09-20 08:03:59.979][978][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4021lb # [ 17.824568] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4022lb # [ 17.827412] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4023lb # [ 17.829651] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4024lb # [ 17.832157] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24025lb # [ 17.833859] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4026lb # [ 17.836372] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4027lb # [ 17.840098] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4028lb # [ 17.841917] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4029lb # [ 17.844589] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4030lb # [ 17.848329] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14031lb # [ 17.850869] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4032lb # [ 17.852666] envoy[978]: [2026-09-20 08:03:59.982][978][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24033lb # [ 17.854715] envoy[978]: [2026-09-20 08:03:59.983][978][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4034lb # [ 17.857244] envoy[978]: [2026-09-20 08:03:59.983][978][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4035lb # [ 17.859469] envoy[978]: [2026-09-20 08:03:59.983][978][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4036lb # [ 17.865258] envoy[978]: [2026-09-20 08:03:59.983][978][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4037lb # [ 17.869101] envoy[978]: [2026-09-20 08:03:59.983][978][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4038lb # [ 17.871440] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4039lb # [ 17.873099] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4040lb # [ 17.876808] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4041lb # [ 17.878552] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4042lb # [ 17.882616] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4043lb # [ 17.884242] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4044lb # [ 17.886664] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4045lb # [ 17.888996] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4046lb # [ 17.891824] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4047lb # [ 17.893307] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4048lb # [ 17.895520] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4049lb # [ 17.901920] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4050lb # [ 17.913070] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4051lb # [ 17.914996] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4052lb # [ 17.917073] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4053lb # [ 17.926072] envoy[978]: [2026-09-20 08:03:59.984][978][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4054lb # [ 17.931619] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4055lb # [ 17.933930] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4056lb # [ 17.936395] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4057lb # [ 17.938558] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4058lb # [ 17.940980] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4059lb # [ 17.942771] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4060lb # [ 17.945320] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4061lb # [ 17.946961] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4062lb # [ 17.948722] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4063lb # [ 17.955461] envoy[978]: [2026-09-20 08:03:59.989][978][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4064lb # [ 17.957175] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4065lb # [ 17.958986] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4066lb # [ 17.964771] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4067lb # [ 17.969104] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4068lb # [ 17.971133] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4069lb # [ 17.972897] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84070lb # [ 17.974562] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4071lb # [ 17.976079] envoy[978]: [2026-09-20 08:03:59.991][978][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4072lb # [ 17.978034] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4073lb # [ 17.979398] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4074lb # [ 17.980937] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4075lb # [ 17.984944] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4076lb # [ 17.986571] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4077lb # [ 17.988481] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4078lb # [ 17.990756] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4079lb # [ 17.992613] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4080lb # [ 18.019604] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4081lb # [ 18.022105] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4082lb # [ 18.023995] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4083lb # [ 18.025816] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4084lb # [ 18.028058] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4085lb # [ 18.030273] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4086lb # [ 18.031929] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4087lb # [ 18.034132] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4088lb # [ 18.036364] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4089lb # [ 18.038215] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4090lb # [ 18.040129] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4091lb # [ 18.041970] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4092lb # [ 18.044409] envoy[978]: [2026-09-20 08:04:00.008][978][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4093lb # [ 18.046670] envoy[978]: [2026-09-20 08:04:00.010][978][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4094lb # [ 18.048685] envoy[978]: [2026-09-20 08:04:00.010][978][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4095lb # [ 18.051226] envoy[978]: [2026-09-20 08:04:00.010][978][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4096lb # [ 18.053730] envoy[978]: [2026-09-20 08:04:00.010][978][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4097lb # [ 18.056527] envoy[978]: [2026-09-20 08:04:00.010][978][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4098lb # [ 18.058128] envoy[978]: [2026-09-20 08:04:00.010][978][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4099lb # [ 18.061405] envoy[978]: [2026-09-20 08:04:00.012][978][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4100lb # [ 18.067523] envoy[978]: [2026-09-20 08:04:00.012][978][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4101lb # [ 18.069282] envoy[978]: [2026-09-20 08:04:00.012][978][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4102lb # [ 18.071079] envoy[978]: [2026-09-20 08:04:00.012][978][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4103lb # [ 18.075610] envoy[978]: [2026-09-20 08:04:00.012][978][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4104lb # [ 18.077328] envoy[978]: [2026-09-20 08:04:00.133][978][info][main] [source/server/server.cc:531] HTTP header map info:4105lb # [ 18.078592] envoy[978]: [2026-09-20 08:04:00.168][978][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4106lb # [ 18.091650] envoy[978]: [2026-09-20 08:04:00.168][978][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4107lb # [ 18.093197] envoy[978]: [2026-09-20 08:04:00.168][978][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4108lb # [ 18.100787] envoy[978]: [2026-09-20 08:04:00.168][978][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4109lb # [ 18.134856] envoy[978]: [2026-09-20 08:04:00.354][978][info][main] [source/server/server.cc:968] runtime: {}4110lb # [ 18.141534] envoy[978]: [2026-09-20 08:04:00.361][978][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4111lb # [ 18.143498] envoy[978]: [2026-09-20 08:04:00.363][978][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014112lb # [ 18.146164] envoy[978]: [2026-09-20 08:04:00.366][978][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014113lb # [ 18.149177] envoy[978]: [2026-09-20 08:04:00.369][978][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4114lb # [ 18.150770] envoy[978]: [2026-09-20 08:04:00.370][978][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4115lb # [ 18.152478] envoy[978]: [2026-09-20 08:04:00.370][978][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4116lb # [ 18.205687] envoy[978]: [2026-09-20 08:04:00.425][978][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4117worker1 # [ 18.176257] systemd[1]: Starting Nix worker-protocol over gRPC...4118worker2 # [ 18.215433] systemd[1]: Starting Nix worker-protocol over gRPC...4119lb # [ 18.231410] envoy[978]: [2026-09-20 08:04:00.451][978][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4120lb # [ 18.234143] envoy[978]: [2026-09-20 08:04:00.454][978][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4121lb # [ 18.237120] envoy[978]: [2026-09-20 08:04:00.454][978][info][main] [source/server/server.cc:1077] starting main dispatch loop4122worker1 # [ 18.386109] nix-grpc-daemon[847]: ts=2026-09-20T08:03:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4123worker2 # [ 18.424942] nix-grpc-daemon[845]: ts=2026-09-20T08:04:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4124worker1 # [ 18.399329] nix-grpc-daemon[847]: ts=2026-09-20T08:03:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14125worker2 # [ 18.436494] nix-grpc-daemon[845]: ts=2026-09-20T08:04:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14126worker1 # [ 18.434693] nix-grpc-daemon[847]: ts=2026-09-20T08:03:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4127worker1 # [ 18.438363] systemd[1]: Started Nix worker-protocol over gRPC.4128worker2 # [ 18.476479] nix-grpc-daemon[845]: ts=2026-09-20T08:04:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4129worker2 # [ 18.480934] systemd[1]: Started Nix worker-protocol over gRPC.4130worker1 # [ 18.469136] nix-grpc-daemon[847]: ts=2026-09-20T08:03:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4131worker2 # [ 18.521662] nix-grpc-daemon[845]: ts=2026-09-20T08:04:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4132lb # [ 18.519984] envoy[978]: [2026-09-20 08:04:00.740][978][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4133lb # [ 18.524322] envoy[978]: [2026-09-20 08:04:00.740][978][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4134lb # [ 18.529428] envoy[978]: [2026-09-20 08:04:00.740][978][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4135lb # [ 18.532585] envoy[978]: [2026-09-20 08:04:00.744][978][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4136worker1 # [ 18.670636] nix-grpc-daemon[847]: ts=2026-09-20T08:04:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4137worker2 # [ 18.722982] nix-grpc-daemon[845]: ts=2026-09-20T08:04:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4138worker1 # [ 19.071327] nix-grpc-daemon[847]: ts=2026-09-20T08:04:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4139worker2 # [ 19.123760] nix-grpc-daemon[845]: ts=2026-09-20T08:04:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4140worker1 # [ 19.875611] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 19.928298] nix-grpc-daemon[845]: ts=2026-09-20T08:04:01Z level=info event=scheduler_connected addr=lb:500514142worker1 # [ 19.902568] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker2 # [ 19.945591] nix-grpc-daemon[845]: ts=2026-09-20T08:04:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker1 # [ 20.103416] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 20.107496] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker2 # [ 20.146878] nix-grpc-daemon[845]: ts=2026-09-20T08:04:01Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 20.149962] nix-grpc-daemon[845]: ts=2026-09-20T08:04:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 20.308547] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 20.312296] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker2 # [ 20.350901] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 20.353882] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 20.513373] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 20.518178] nix-grpc-daemon[847]: ts=2026-09-20T08:04:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker2 # [ 20.554490] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514155worker2 # [ 20.556537] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 20.718813] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 20.722377] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 20.757536] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 20.760505] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 20.923756] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 20.927420] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker2 # [ 20.962355] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 20.965551] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 21.128326] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 21.132243] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker2 # [ 21.166643] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 21.169899] nix-grpc-daemon[845]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 21.333185] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 21.336251] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker2 # [ 21.370114] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 21.372464] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 21.537053] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 21.540050] nix-grpc-daemon[847]: ts=2026-09-20T08:04:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker2 # [ 21.573111] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 21.575910] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker1 # [ 21.741472] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 21.776043] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514178worker1 # [ 21.744720] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4179worker2 # [ 21.780761] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 21.946673] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 21.981823] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 21.949510] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4183worker2 # [ 21.985904] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 22.150715] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514185worker2 # [ 22.186672] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514186worker1 # [ 22.154729] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4187worker2 # [ 22.190615] nix-grpc-daemon[845]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 22.356284] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514189worker2 # [ 22.391684] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 22.360683] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4191worker2 # [ 22.396826] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 22.561702] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 22.565405] nix-grpc-daemon[847]: ts=2026-09-20T08:04:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4194worker2 # [ 22.597614] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 22.601853] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 22.766733] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 22.769785] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker2 # [ 22.802479] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 22.805264] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 22.971630] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 23.006838] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 22.974418] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4203worker2 # [ 23.010091] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 23.175707] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 23.179057] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4206worker2 # [ 23.213793] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 23.216645] nix-grpc-daemon[845]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 23.380372] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514209worker2 # [ 23.417420] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514210worker1 # [ 23.385816] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4211worker2 # [ 23.424497] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker1 # [ 23.586459] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 23.589236] nix-grpc-daemon[847]: ts=2026-09-20T08:04:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4214worker2 # [ 23.625195] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514215worker2 # [ 23.627666] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker1 # [ 23.790253] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 23.793688] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218worker2 # [ 23.828193] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514219worker2 # [ 23.830551] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker1 # [ 23.995503] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514221worker1 # [ 23.998112] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4222worker2 # [ 24.031753] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514223worker2 # [ 24.034197] nix-grpc-daemon[845]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker1 # [ 24.199468] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 24.234549] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 24.203512] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4227worker2 # [ 24.238967] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 24.404127] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514229worker1 # [ 24.407365] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4230worker2 # [ 24.439793] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514231worker2 # [ 24.442874] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker1 # [ 24.608373] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 24.611140] nix-grpc-daemon[847]: ts=2026-09-20T08:04:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4234worker2 # [ 24.643327] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514235worker2 # [ 24.645868] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker1 # [ 24.812437] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 24.846409] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514238worker1 # [ 24.815311] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4239worker2 # [ 24.850493] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker1 # [ 25.016410] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 25.051350] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 25.018811] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243worker2 # [ 25.056170] nix-grpc-daemon[845]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker1 # [ 25.220082] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514245worker1 # [ 25.223085] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4246worker2 # [ 25.256901] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514247worker2 # [ 25.259343] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 25.424277] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_connected addr=lb:500514249worker1 # [ 25.426812] nix-grpc-daemon[847]: ts=2026-09-20T08:04:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4250worker2 # [ 25.459721] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514251worker2 # [ 25.462430] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker1 # [ 25.628214] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514253worker2 # [ 25.663043] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514254worker2 # [ 25.665505] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4255worker1 # [ 25.634431] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker1 # [ 25.834647] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514257worker2 # [ 25.866408] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 25.838705] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4259worker2 # [ 25.870186] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker2 # [ 26.071615] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 26.074493] nix-grpc-daemon[845]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262worker1 # [ 26.041845] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514263worker1 # [ 26.046478] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker2 # [ 26.275450] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514265worker1 # [ 26.247112] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514266worker2 # [ 26.279304] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4267worker1 # [ 26.250423] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker2 # [ 26.480286] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514269worker1 # [ 26.451348] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_connected addr=lb:500514270worker2 # [ 26.484055] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4271worker1 # [ 26.454069] nix-grpc-daemon[847]: ts=2026-09-20T08:04:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker2 # [ 26.684950] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514273worker1 # [ 26.655420] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514274worker2 # [ 26.688466] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4275worker1 # [ 26.658793] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker2 # [ 26.889459] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514277worker1 # [ 26.859585] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514278worker2 # [ 26.892506] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4279worker1 # [ 26.862246] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4280worker2 # [ 27.093860] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514281worker1 # [ 27.065288] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514282worker2 # [ 27.097315] nix-grpc-daemon[845]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4283worker1 # [ 27.067203] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4284worker1 # [ 27.266565] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514285worker2 # [ 27.298286] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 27.270471] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287worker2 # [ 27.301775] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4288worker2 # [ 27.502539] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514289worker1 # [ 27.471520] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_connected addr=lb:500514290worker2 # [ 27.506440] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4291worker1 # [ 27.475134] nix-grpc-daemon[847]: ts=2026-09-20T08:04:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4292worker2 # [ 27.707550] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514293worker1 # [ 27.676315] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514294worker1 # [ 27.680139] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4295worker2 # [ 27.711270] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4296worker1 # [ 27.880978] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514297worker2 # [ 27.916314] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514298worker1 # [ 27.884461] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4299worker2 # [ 27.919488] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4300worker1 # [ 28.087416] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514301worker2 # [ 28.123448] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514302worker1 # [ 28.094307] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4303worker2 # [ 28.128802] nix-grpc-daemon[845]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304worker1 # [ 28.295603] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514305worker2 # [ 28.329772] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514306worker1 # [ 28.304489] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4307worker2 # [ 28.336195] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4308worker2 # [ 28.536853] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514309worker1 # [ 28.506451] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500514310worker2 # [ 28.540815] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4311worker1 # [ 28.512715] nix-grpc-daemon[847]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4312lb # [ 28.692483] rustfs-bucket-start[1098]: mb s3://farm4313lb # [ 28.704981] systemd[1]: Finished rustfs-bucket.service.4314lb # [ 28.715466] systemd[1]: Starting niks3 server...4315worker2 # [ 28.742239] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514316worker1 # [ 28.713601] nix-grpc-daemon[847]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514317worker2 # [ 28.747279] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4318worker1 # [ 28.717484] nix-grpc-daemon[847]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4319worker2 # [ 28.949040] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514320worker1 # [ 28.918880] nix-grpc-daemon[847]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514321worker2 # [ 28.953404] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4322worker1 # [ 28.922500] nix-grpc-daemon[847]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4323lb # [ 29.022937] postgres[1114]: [1114] ERROR: relation "goose_db_version" does not exist at character 364324lb # [ 29.025193] postgres[1114]: [1114] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4325lb # [ 29.076728] niks3-server[1108]: 2026/09/20 08:04:11 OK 20241026095416_initial_model.sql (26.85ms)4326lb # [ 29.081213] niks3-server[1108]: 2026/09/20 08:04:11 OK 20251210153512_drop_unused_gin_index.sql (4.23ms)4327lb # [ 29.087090] niks3-server[1108]: 2026/09/20 08:04:11 OK 20251218171726_add_pins.sql (5.73ms)4328lb # [ 29.093027] niks3-server[1108]: 2026/09/20 08:04:11 OK 20260628120000_add_object_size_and_stats.sql (5.83ms)4329lb # [ 29.097812] niks3-server[1108]: 2026/09/20 08:04:11 OK 20260905000000_add_claims.sql (4.83ms)4330lb # [ 29.102942] niks3-server[1108]: 2026/09/20 08:04:11 OK 20260920000000_drop_claims.sql (5.18ms)4331lb # [ 29.104487] niks3-server[1108]: 2026/09/20 08:04:11 goose: successfully migrated database to version: 202609200000004332lb # [ 29.111169] niks3-server[1108]: 2026/09/20 08:04:11 OK 1_commit_pending_closure.sql (6.49ms)4333lb # [ 29.113899] niks3-server[1108]: 2026/09/20 08:04:11 OK 2_object_stats_trigger.sql (2.84ms)4334lb # [ 29.115255] niks3-server[1108]: 2026/09/20 08:04:11 goose: up to current file version: 24335lb # [ 29.121719] niks3-server[1108]: 2026/09/20 08:04:11 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4336worker2 # [ 29.155756] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514337worker1 # [ 29.124514] nix-grpc-daemon[847]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514338worker1 # [ 29.128700] nix-grpc-daemon[847]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4339worker2 # [ 29.160282] nix-grpc-daemon[845]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4340lb # [ 29.203819] niks3-server[1108]: 2026/09/20 08:04:11 INFO Read proxy enabled — serving cache objects from S34341lb # [ 29.206098] niks3-server[1108]: 2026/09/20 08:04:11 INFO Using socket-activated listener address=0.0.0.0:57514342lb # [ 29.212092] systemd[1]: Started niks3 server.4343lb # [ 29.212856] niks3-server[1108]: 2026/09/20 08:04:11 INFO systemd watchdog enabled interval=15s4344lb # [ 29.217122] niks3-server[1108]: 2026/09/20 08:04:11 INFO Starting HTTP server address=0.0.0.0:57514345lb # [ 29.218663] systemd[1]: Reached target Multi-User System.4346lb # [ 29.220410] systemd[1]: Startup finished in 999ms (kernel) + 4.150s (initrd) + 24.068s (userspace) = 29.218s.4347lb # [ 29.228198] niks3-server[1108]: 2026/09/20 08:04:11 INFO lead: acquired remote=192.168.1.4:391644348worker2 # [ 29.236800] nix-grpc-daemon[845]: ts=2026-09-20T08:04:11Z level=info event=scheduler_take_over4349worker1 # [ 29.329917] nix-grpc-daemon[847]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500514350worker2 # [ 29.361433] nix-grpc-daemon[845]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500514351worker2 # [ 29.366167] nix-grpc-daemon[845]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4352worker2 # [ 29.371447] nix-grpc-daemon[845]: ts=2026-09-20T08:04:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04353lb: (finished: waiting for unit niks3.service, in 17.51 seconds)4354lb: waiting for TCP port 5751 on localhost4355lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4356lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4357worker2 # [ 29.566784] nix-grpc-daemon[845]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500514358lb: waiting for unit envoy.service4359worker2 # [ 29.570220] nix-grpc-daemon[845]: ts=2026-09-20T08:04:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04360lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4361lb: waiting for TCP port 50051 on localhost4362lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4363lb # [ 29.669381] envoy[978]: conn peer=[::1]:33458 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34364lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4365lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4366lb: must succeed: curl -sf localhost:9901/clusters4367lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4368lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.08 seconds)4369subtest: one node schedules and both builders hold a WorkerSession on it4370lb: must succeed: curl -sf localhost:9901/clusters4371lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4372worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4373worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4374(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.11 seconds)4375subtest: balancer auth: client cert, bearer token, nothing, unknown CN4376worker2 # [ 30.312586] nix-grpc-daemon[845]: ts=2026-09-20T08:04:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425744377worker2 # [ 30.321900] systemd[1]: Started Nix Daemon.4378worker2 # [ 30.555815] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4379worker2 # [ 30.609367] nix-grpc-daemon[845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 1/5)4380worker2 # [ 30.670824] nix-grpc-daemon[845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 2/5)4381worker2 # [ 30.875414] nix-grpc-daemon[845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 249 ms (attempt 3/5)4382worker2 # [ 31.128519] nix-grpc-daemon[845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 401 ms (attempt 4/5)4383worker2 # [ 31.537861] nix-grpc-daemon[845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4384worker2 # [ 31.565079] nix-grpc-daemon[845]: ts=2026-09-20T08:04:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425744385worker2 # [ 31.579233] nix-grpc-daemon[845]: ts=2026-09-20T08:04:13Z level=debug event=path_info_miss path=pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test error="error: path '/nix/store/pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test' is required, but there is no substituter that can build it"4386worker1 # [ 31.564650] nix-grpc-daemon[847]: ts=2026-09-20T08:04:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:462104387worker1 # [ 31.572716] systemd[1]: Started Nix Daemon.4388worker1 # [ 31.800296] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4389worker1 # [ 31.835419] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)4390worker1 # [ 31.899795] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 125 ms (attempt 2/5)4391worker1 # [ 32.028810] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 3/5)4392worker1 # [ 32.350100] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 327 ms (attempt 4/5)4393worker1 # [ 32.690716] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4394worker1 # [ 32.709140] nix-grpc-daemon[847]: ts=2026-09-20T08:04:14Z level=debug event=path_info_miss path=pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test error="error: path '/nix/store/pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test' is required, but there is no substituter that can build it"4395client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4396client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)4397client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4398client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4399worker1 # [ 33.083511] nix-grpc-daemon[847]: ts=2026-09-20T08:04:14Z level=info event=oidc_jwks provider=mock keys=14400worker1 # [ 33.087101] nix-grpc-daemon[847]: ts=2026-09-20T08:04:14Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:462104401worker1 # [ 33.106902] nix-grpc-daemon[847]: ts=2026-09-20T08:04:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:462104402worker1 # [ 33.115121] nix-grpc-daemon[847]: ts=2026-09-20T08:04:14Z level=debug event=path_info_miss path=pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test error="error: path '/nix/store/pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test' is required, but there is no substituter that can build it"4403worker1 # [ 33.120998] nix-grpc-daemon[847]: ts=2026-09-20T08:04:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:462104404worker1 # [ 33.128156] nix-grpc-daemon[847]: ts=2026-09-20T08:04:14Z level=debug event=path_info_miss path=pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test error="error: path '/nix/store/pkvyx00qdzg2xbr96azisdpjk46xfshp-nixos-system-client-test' is required, but there is no substituter that can build it"4405client: must succeed: rm -r /var/lib/nix-grpc-store4406client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4407worker2 # [ 33.454486] nix-grpc-daemon[845]: ts=2026-09-20T08:04:15Z level=info event=denied method=QueryMissing cn=- role=none4408worker1 # [ 33.649565] nix-grpc-daemon[847]: ts=2026-09-20T08:04:15Z level=info event=denied method=QueryMissing cn=stranger role=none4409(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.74 seconds)4410subtest: DAG build is scheduled across workers and lands in the cache4411client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24412worker2 # [ 33.900846] nix-grpc-daemon[845]: ts=2026-09-20T08:04:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425744413client # don't know how to build these paths:4414client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4415worker2 # [ 33.930222] nix-grpc-daemon[845]: ts=2026-09-20T08:04:15Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04416worker2 # [ 33.935340] nix-grpc-daemon[845]: ts=2026-09-20T08:04:15Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14417worker1 # [ 33.956147] nix-grpc-daemon[847]: ts=2026-09-20T08:04:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104418worker1 # [ 33.972816] nix-grpc-daemon[847]: ts=2026-09-20T08:04:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104419client # copying 1 paths to 'lb:50051'...4420worker1 # [ 33.983396] nix-grpc-daemon[847]: ts=2026-09-20T08:04:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462104421client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4422worker1 # [ 34.008735] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4423worker1 # [ 34.030815] nix-grpc-daemon[847]: ts=2026-09-20T08:04:15Z level=info event=niks3_push_started pid=9154424worker1 # [ 34.528112] nix-daemon[905]: accepted connection from pid 926, user nix-grpc-daemon (trusted)4425worker1 # [ 34.548459] nix-daemon[905]: reaped child process 930, status = succeeded4426worker1 # [ 34.715684] nix-daemon[905]: accepted connection from pid 933, user nix-grpc-daemon (trusted)4427worker1 # [ 34.731189] nix-daemon[905]: reaped child process 936, status = succeeded4428lb # [ 34.771920] niks3-server[1108]: 2026/09/20 08:04:16 INFO Received uploads request method=POST path=/api/pending_closures4429worker1 # [ 34.762648] nix-grpc-daemon[915]: time=2026-09-20T08:04:16.140Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4430worker1 # [ 34.766077] nix-grpc-daemon[915]: time=2026-09-20T08:04:16.143Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4431lb # [ 34.827424] niks3-server[1108]: 2026/09/20 08:04:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4432lb # [ 34.832716] niks3-server[1108]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4433lb # [ 34.853347] niks3-server[1108]: 2026/09/20 08:04:17 INFO Signed narinfos id=1 count=14434worker1 # [ 34.825928] nix-grpc-daemon[915]: time=2026-09-20T08:04:16.204Z level=INFO msg="Uploading 1 narinfos"4435lb # [ 34.863461] niks3-server[1108]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4436lb # [ 34.870051] niks3-server[1108]: 2026/09/20 08:04:17 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4437lb # [ 34.882555] niks3-server[1108]: 2026/09/20 08:04:17 INFO Completed upload id=14438worker1 # [ 34.853622] nix-grpc-daemon[915]: time=2026-09-20T08:04:16.232Z level=INFO msg="Upload complete. (532ms)"4439worker1 # [ 34.856424] nix-grpc-daemon[847]: ts=2026-09-20T08:04:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=0 paths=1 nar_bytes_in=5044440lb # [ 34.888862] niks3-server[1108]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4441worker1 # [ 34.861842] nix-grpc-daemon[847]: ts=2026-09-20T08:04:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104442worker1 # [ 34.868158] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4443worker1 # [ 34.870611] nix-daemon[905]: reaped child process 913, status = succeeded4444client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4445worker1 # [ 34.876630] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4446client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4447client # farm-a> LOG-farm-a-t14448worker1 # [ 35.695318] nix-daemon[905]: reaped child process 940, status = succeeded4449worker1 # [ 35.827804] nix-daemon[905]: accepted connection from pid 955, user nix-grpc-daemon (trusted)4450worker1 # [ 35.842465] nix-daemon[905]: reaped child process 958, status = succeeded4451lb # [ 35.883452] niks3-server[1108]: 2026/09/20 08:04:18 INFO Received uploads request method=POST path=/api/pending_closures4452worker1 # [ 35.860652] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.239Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4453worker1 # [ 35.862534] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.241Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4454lb # [ 35.911143] niks3-server[1108]: 2026/09/20 08:04:18 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4455lb # [ 35.916278] niks3-server[1108]: 2026/09/20 08:04:18 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4456lb # [ 35.923065] niks3-server[1108]: 2026/09/20 08:04:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4457lb # [ 35.925230] niks3-server[1108]: 2026/09/20 08:04:18 INFO Signed narinfos id=2 count=14458worker1 # [ 35.897628] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.275Z level=INFO msg="Uploading 1 narinfos"4459lb # [ 35.929635] niks3-server[1108]: 2026/09/20 08:04:18 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4460lb # [ 35.935676] niks3-server[1108]: 2026/09/20 08:04:18 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4461lb # [ 35.941464] niks3-server[1108]: 2026/09/20 08:04:18 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4462lb # [ 35.943588] niks3-server[1108]: 2026/09/20 08:04:18 INFO Completed upload id=24463worker1 # [ 35.914149] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.293Z level=INFO msg="Upload complete. (228ms)"4464worker1 # [ 35.917688] nix-grpc-daemon[847]: ts=2026-09-20T08:04:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14465worker1 # [ 35.925042] nix-daemon[905]: reaped child process 938, status = succeeded4466worker2 # [ 35.960564] nix-grpc-daemon[845]: ts=2026-09-20T08:04:17Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04467worker2 # [ 35.962441] nix-grpc-daemon[845]: ts=2026-09-20T08:04:17Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14468worker1 # [ 35.975982] nix-grpc-daemon[847]: ts=2026-09-20T08:04:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104469worker1 # [ 35.983846] nix-grpc-daemon[847]: ts=2026-09-20T08:04:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104470worker1 # [ 35.992276] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.371Z level=INFO msg="All 1 paths already cached"4471client # copying 1 paths to 'lb:50051'...4472worker1 # [ 35.997234] nix-grpc-daemon[847]: ts=2026-09-20T08:04:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462104473client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4474worker1 # [ 36.007635] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4475worker1 # [ 36.158178] nix-daemon[905]: accepted connection from pid 962, user nix-grpc-daemon (trusted)4476worker1 # [ 36.174408] nix-daemon[905]: reaped child process 965, status = succeeded4477worker1 # [ 36.339201] nix-daemon[905]: accepted connection from pid 967, user nix-grpc-daemon (trusted)4478worker1 # [ 36.353783] nix-daemon[905]: reaped child process 970, status = succeeded4479lb # [ 36.399075] niks3-server[1108]: 2026/09/20 08:04:18 INFO Received uploads request method=POST path=/api/pending_closures4480worker1 # [ 36.375166] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.754Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4481worker1 # [ 36.376960] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.755Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4482lb # [ 36.418331] niks3-server[1108]: 2026/09/20 08:04:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4483lb # [ 36.420859] niks3-server[1108]: 2026/09/20 08:04:18 INFO Signed narinfos id=3 count=14484worker1 # [ 36.392707] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.771Z level=INFO msg="Uploading 1 narinfos"4485lb # [ 36.424397] niks3-server[1108]: 2026/09/20 08:04:18 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4486lb # [ 36.431099] niks3-server[1108]: 2026/09/20 08:04:18 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4487lb # [ 36.436675] niks3-server[1108]: 2026/09/20 08:04:18 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4488lb # [ 36.441608] niks3-server[1108]: 2026/09/20 08:04:18 INFO Completed upload id=34489worker1 # [ 36.412164] nix-grpc-daemon[915]: time=2026-09-20T08:04:17.791Z level=INFO msg="Upload complete. (395ms)"4490lb # [ 36.444509] niks3-server[1108]: 2026/09/20 08:04:18 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4491worker1 # [ 36.414475] nix-grpc-daemon[847]: ts=2026-09-20T08:04:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=0 paths=1 nar_bytes_in=6244492worker1 # [ 36.417606] nix-grpc-daemon[847]: ts=2026-09-20T08:04:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104493worker1 # [ 36.426410] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4494worker1 # [ 36.429189] nix-daemon[905]: reaped child process 960, status = succeeded4495worker1 # [ 36.434576] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4496client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4497client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4498client # farm-b> LOG-farm-b-t14499worker1 # [ 37.450756] nix-daemon[905]: reaped child process 974, status = succeeded4500worker1 # [ 37.572853] nix-daemon[905]: accepted connection from pid 990, user nix-grpc-daemon (trusted)4501worker1 # [ 37.588033] nix-daemon[905]: reaped child process 993, status = succeeded4502lb # [ 37.627879] niks3-server[1108]: 2026/09/20 08:04:19 INFO Received uploads request method=POST path=/api/pending_closures4503worker1 # [ 37.603471] nix-grpc-daemon[915]: time=2026-09-20T08:04:18.982Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4504worker1 # [ 37.605146] nix-grpc-daemon[915]: time=2026-09-20T08:04:18.984Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4505lb # [ 37.648478] niks3-server[1108]: 2026/09/20 08:04:19 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4506lb # [ 37.653203] niks3-server[1108]: 2026/09/20 08:04:19 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4507lb # [ 37.655177] niks3-server[1108]: 2026/09/20 08:04:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4508lb # [ 37.657116] niks3-server[1108]: 2026/09/20 08:04:19 INFO Signed narinfos id=4 count=14509worker1 # [ 37.629168] nix-grpc-daemon[915]: time=2026-09-20T08:04:19.007Z level=INFO msg="Uploading 1 narinfos"4510lb # [ 37.662205] niks3-server[1108]: 2026/09/20 08:04:19 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4511lb # [ 37.665056] niks3-server[1108]: 2026/09/20 08:04:19 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4512lb # [ 37.669179] niks3-server[1108]: 2026/09/20 08:04:19 INFO Completed upload id=44513worker1 # [ 37.639681] nix-grpc-daemon[915]: time=2026-09-20T08:04:19.018Z level=INFO msg="Upload complete. (198ms)"4514lb # [ 37.670744] niks3-server[1108]: 2026/09/20 08:04:19 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4515worker1 # [ 37.642444] nix-grpc-daemon[847]: ts=2026-09-20T08:04:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14516worker1 # [ 37.649924] nix-daemon[905]: reaped child process 972, status = succeeded4517worker2 # [ 37.682245] nix-grpc-daemon[845]: ts=2026-09-20T08:04:19Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04518worker2 # [ 37.684752] nix-grpc-daemon[845]: ts=2026-09-20T08:04:19Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14519worker1 # [ 37.693736] nix-grpc-daemon[847]: ts=2026-09-20T08:04:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104520worker1 # [ 37.703624] nix-grpc-daemon[847]: ts=2026-09-20T08:04:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104521worker1 # [ 37.713432] nix-grpc-daemon[915]: time=2026-09-20T08:04:19.092Z level=INFO msg="All 2 paths already cached"4522client # copying 1 paths to 'lb:50051'...4523worker1 # [ 37.719346] nix-grpc-daemon[847]: ts=2026-09-20T08:04:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462104524client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4525worker1 # [ 37.728926] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4526worker1 # [ 37.870168] nix-daemon[905]: accepted connection from pid 997, user nix-grpc-daemon (trusted)4527worker1 # [ 37.885193] nix-daemon[905]: reaped child process 1000, status = succeeded4528worker1 # [ 38.019814] nix-daemon[905]: accepted connection from pid 1002, user nix-grpc-daemon (trusted)4529worker1 # [ 38.033983] nix-daemon[905]: reaped child process 1005, status = succeeded4530lb # [ 38.075658] niks3-server[1108]: 2026/09/20 08:04:20 INFO Received uploads request method=POST path=/api/pending_closures4531worker1 # [ 38.056824] nix-grpc-daemon[915]: time=2026-09-20T08:04:19.435Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4532worker1 # [ 38.058433] nix-grpc-daemon[915]: time=2026-09-20T08:04:19.437Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4533lb # [ 38.107386] niks3-server[1108]: 2026/09/20 08:04:20 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4534lb # [ 38.119974] niks3-server[1108]: 2026/09/20 08:04:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4535worker1 # [ 38.096957] nix-grpc-daemon[915]: time=2026-09-20T08:04:19.475Z level=INFO msg="Uploading 1 narinfos"4536lb # [ 38.126459] niks3-server[1108]: 2026/09/20 08:04:20 INFO Signed narinfos id=5 count=14537lb # [ 38.130739] niks3-server[1108]: 2026/09/20 08:04:20 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4538lb # [ 38.140371] niks3-server[1108]: 2026/09/20 08:04:20 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4539worker1 # [ 38.117182] nix-grpc-daemon[915]: time=2026-09-20T08:04:19.496Z level=INFO msg="Upload complete. (376ms)"4540lb # [ 38.146710] niks3-server[1108]: 2026/09/20 08:04:20 INFO Completed upload id=54541worker1 # [ 38.119632] nix-grpc-daemon[847]: ts=2026-09-20T08:04:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=0 paths=1 nar_bytes_in=7524542lb # [ 38.151311] niks3-server[1108]: 2026/09/20 08:04:20 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4543worker1 # [ 38.125625] nix-grpc-daemon[847]: ts=2026-09-20T08:04:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104544worker1 # [ 38.137614] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4545worker1 # [ 38.139933] nix-daemon[905]: reaped child process 995, status = succeeded4546client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4547worker1 # [ 38.145288] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4548client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4549lb # [ 38.216334] envoy[978]: conn peer=[2001:db8:1::1]:58294 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=24914550lb # [ 38.220117] envoy[978]: conn peer=[2001:db8:1::1]:37740 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=360 ms=734551lb # [ 38.223407] envoy[978]: conn peer=[2001:db8:1::1]:37750 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94552lb # [ 38.226643] envoy[978]: conn peer=[2001:db8:1::1]:37762 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=124553client # farm-top> LOG-farm-top-t14554worker1 # [ 38.971313] nix-daemon[905]: reaped child process 1009, status = succeeded4555worker1 # [ 39.108108] nix-daemon[905]: accepted connection from pid 1024, user nix-grpc-daemon (trusted)4556worker1 # [ 39.123738] nix-daemon[905]: reaped child process 1027, status = succeeded4557lb # [ 39.163361] niks3-server[1108]: 2026/09/20 08:04:21 INFO Received uploads request method=POST path=/api/pending_closures4558worker1 # [ 39.141751] nix-grpc-daemon[915]: time=2026-09-20T08:04:20.520Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4559worker1 # [ 39.145501] nix-grpc-daemon[915]: time=2026-09-20T08:04:20.522Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4560lb # [ 39.189700] niks3-server[1108]: 2026/09/20 08:04:21 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4561lb # [ 39.191624] niks3-server[1108]: 2026/09/20 08:04:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4562lb # [ 39.195055] niks3-server[1108]: 2026/09/20 08:04:21 INFO Signed narinfos id=6 count=14563worker1 # [ 39.165838] nix-grpc-daemon[915]: time=2026-09-20T08:04:20.544Z level=INFO msg="Uploading 1 narinfos"4564lb # [ 39.197458] niks3-server[1108]: 2026/09/20 08:04:21 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4565lb # [ 39.200322] niks3-server[1108]: 2026/09/20 08:04:21 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4566lb # [ 39.205177] niks3-server[1108]: 2026/09/20 08:04:21 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4567lb # [ 39.209479] niks3-server[1108]: 2026/09/20 08:04:21 INFO Completed upload id=64568worker1 # [ 39.180138] nix-grpc-daemon[915]: time=2026-09-20T08:04:20.559Z level=INFO msg="Upload complete. (226ms)"4569lb # [ 39.210688] niks3-server[1108]: 2026/09/20 08:04:21 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4570worker1 # [ 39.183364] nix-grpc-daemon[847]: ts=2026-09-20T08:04:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14571worker1 # [ 39.190742] nix-daemon[905]: reaped child process 1007, status = succeeded4572client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 5.54 seconds)4573client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4574client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.17 seconds)4575client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4576client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4577client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4578client # copying 3 paths...4579client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4580client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4581client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4582client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4583(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.06 seconds)4584subtest: repeat is answered Cached by the scheduler without building4585worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4586worker1 # finding garbage collector roots...4587worker1 # deleting specified paths...4588worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4589worker1 # deleting unused links...4590worker1 # note: hard linking is currently saving 0.0 KiB4591worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4592worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4593worker2 # finding garbage collector roots...4594worker2 # deleting specified paths...4595worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4596worker2 # deleting unused links...4597worker2 # note: hard linking is currently saving 0.0 KiB4598worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4599client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24600worker1 # [ 40.393093] nix-grpc-daemon[847]: ts=2026-09-20T08:04:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462104601client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4602client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4603worker2 # [ 40.443393] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14604worker2 # [ 40.449379] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14605worker2 # [ 40.458347] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14606client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.23 seconds)4607client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4608client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.16 seconds)4609lb: must succeed: curl -sf localhost:9901/clusters4610lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4611lb: must succeed: curl -sf localhost:9901/clusters4612lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4613worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4614worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.05 seconds)4615(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.10 seconds)4616subtest: two clients wanting the same drv build it once4617client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4618client # [ 40.911477] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4619client # Running as unit: dedup1.service; invocation ID: 20cd1d23d2744ad7909a3702dc61f8614620client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.05 seconds)4621client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4622worker1 # [ 41.062608] nix-grpc-daemon[847]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462104623client # [ 41.102083] nix[872]: don't know how to build these paths:4624client # [ 41.103615] nix[872]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4625worker2 # [ 41.105453] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04626worker2 # [ 41.108088] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14627worker2 # [ 41.111441] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425744628worker2 # [ 41.121837] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425744629client # [ 41.133065] nix[872]: copying 1 paths to 'lb:50051'...4630worker2 # [ 41.129056] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425744631client # [ 41.133871] nix[872]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4632worker2 # [ 41.139148] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4633worker2 # [ 41.153213] nix-grpc-daemon[845]: ts=2026-09-20T08:04:22Z level=info event=niks3_push_started pid=9524634worker2 # [ 41.629176] nix-daemon[907]: accepted connection from pid 964, user nix-grpc-daemon (trusted)4635worker2 # [ 41.650294] nix-daemon[907]: reaped child process 967, status = succeeded4636worker2 # [ 41.796689] nix-daemon[907]: accepted connection from pid 969, user nix-grpc-daemon (trusted)4637worker2 # [ 41.812970] nix-daemon[907]: reaped child process 972, status = succeeded4638lb # [ 41.824710] niks3-server[1108]: 2026/09/20 08:04:24 INFO Received uploads request method=POST path=/api/pending_closures4639worker2 # [ 41.843831] nix-grpc-daemon[952]: time=2026-09-20T08:04:23.609Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4640worker2 # [ 41.848400] nix-grpc-daemon[952]: time=2026-09-20T08:04:23.614Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4641lb # [ 41.876403] niks3-server[1108]: 2026/09/20 08:04:24 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4642lb # [ 41.887060] niks3-server[1108]: 2026/09/20 08:04:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4643lb # [ 41.892236] niks3-server[1108]: 2026/09/20 08:04:24 INFO Signed narinfos id=7 count=14644worker2 # [ 41.898639] nix-grpc-daemon[952]: time=2026-09-20T08:04:23.665Z level=INFO msg="Uploading 1 narinfos"4645lb # [ 41.901959] niks3-server[1108]: 2026/09/20 08:04:24 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4646lb # [ 41.910951] niks3-server[1108]: 2026/09/20 08:04:24 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4647lb # [ 41.918958] niks3-server[1108]: 2026/09/20 08:04:24 INFO Completed upload id=74648worker2 # [ 41.921042] nix-grpc-daemon[952]: time=2026-09-20T08:04:23.688Z level=INFO msg="Upload complete. (492ms)"4649lb # [ 41.921091] niks3-server[1108]: 2026/09/20 08:04:24 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4650worker2 # [ 41.926265] nix-grpc-daemon[845]: ts=2026-09-20T08:04:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_in=4324651worker2 # [ 41.930463] nix-grpc-daemon[845]: ts=2026-09-20T08:04:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425744652worker2 # [ 41.938574] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4653worker2 # [ 41.941526] nix-daemon[907]: reaped child process 950, status = succeeded4654worker2 # [ 41.948421] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4655client # [ 41.951492] nix[872]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4656client # [ 41.982602] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4657client # Running as unit: dedup2.service; invocation ID: 831bdbdcdbee473f83757ffcd68667de4658client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4659client # [ 42.262135] nix[888]: don't know how to build these paths:4660client # [ 42.263551] nix[888]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4661worker1 # [ 42.226729] nix-grpc-daemon[847]: ts=2026-09-20T08:04:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462104662worker2 # [ 42.265427] nix-grpc-daemon[845]: ts=2026-09-20T08:04:24Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04663worker2 # [ 42.269645] nix-grpc-daemon[845]: ts=2026-09-20T08:04:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425744664client # [ 42.276629] nix[888]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4665client: must succeed: sleep 24666client: (finished: must succeed: sleep 2, in 2.05 seconds)4667client: waiting for success: ! systemctl is-active dedup1 dedup24668worker2 # [ 45.566748] nix-daemon[907]: reaped child process 976, status = succeeded4669worker2 # [ 45.715312] nix-daemon[907]: accepted connection from pid 1008, user nix-grpc-daemon (trusted)4670worker2 # [ 45.728973] nix-daemon[907]: reaped child process 1011, status = succeeded4671lb # [ 45.736516] niks3-server[1108]: 2026/09/20 08:04:27 INFO Received uploads request method=POST path=/api/pending_closures4672worker2 # [ 45.743953] nix-grpc-daemon[952]: time=2026-09-20T08:04:27.510Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4673worker2 # [ 45.745564] nix-grpc-daemon[952]: time=2026-09-20T08:04:27.512Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4674lb # [ 45.784284] niks3-server[1108]: 2026/09/20 08:04:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4675lb # [ 45.792081] niks3-server[1108]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4676lb # [ 45.797309] niks3-server[1108]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4677lb # [ 45.801327] niks3-server[1108]: 2026/09/20 08:04:28 INFO Signed narinfos id=8 count=14678worker2 # [ 45.806281] nix-grpc-daemon[952]: time=2026-09-20T08:04:27.572Z level=INFO msg="Uploading 1 narinfos"4679lb # [ 45.807099] niks3-server[1108]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4680lb # [ 45.813525] niks3-server[1108]: 2026/09/20 08:04:28 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4681lb # [ 45.817751] niks3-server[1108]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4682lb # [ 45.821195] niks3-server[1108]: 2026/09/20 08:04:28 INFO Completed upload id=84683worker2 # [ 45.823169] nix-grpc-daemon[952]: time=2026-09-20T08:04:27.590Z level=INFO msg="Upload complete. (261ms)"4684worker2 # [ 45.826634] nix-grpc-daemon[845]: ts=2026-09-20T08:04:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14685worker2 # [ 45.830167] nix-grpc-daemon[845]: ts=2026-09-20T08:04:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14686worker2 # [ 45.835899] nix-daemon[907]: reaped child process 974, status = succeeded4687client # [ 45.858912] systemd[1]: dedup1.service: Deactivated successfully.4688client # [ 45.860555] systemd[1]: dedup1.service: Consumed 106ms CPU time over 4.949s wall clock time, 39.4M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.4689client # [ 45.898945] systemd[1]: dedup2.service: Deactivated successfully.4690client # [ 45.900675] systemd[1]: dedup2.service: Consumed 141ms CPU time over 3.918s wall clock time, 33.2M memory peak, 7.5K incoming IP traffic, 6.6K outgoing IP traffic.4691client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4692client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4693client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds)4694worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4695worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4696worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4697worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4698worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4699worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4700worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4701worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.04 seconds)4702(finished: subtest: two clients wanting the same drv build it once, in 5.88 seconds)4703subtest: build hook: nix-daemon with builders = grpc://lb4704client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4705client # [ 46.907063] systemd[1]: Started Nix Daemon.4706client # [ 47.060134] nix-daemon[931]: accepted connection from pid 928, user root (trusted)4707worker1 # [ 47.221290] nix-grpc-daemon[847]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:462104708worker1 # [ 47.225317] nix-grpc-daemon[847]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104709worker1 # [ 47.243865] nix-grpc-daemon[847]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104710worker2 # [ 47.273187] nix-grpc-daemon[845]: ts=2026-09-20T08:04:29Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04711worker2 # [ 47.277603] nix-grpc-daemon[845]: ts=2026-09-20T08:04:29Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14712worker1 # [ 47.252251] nix-grpc-daemon[847]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104713worker1 # [ 47.262094] nix-grpc-daemon[847]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462104714worker1 # [ 47.271668] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4715worker1 # [ 47.423181] nix-daemon[905]: accepted connection from pid 1069, user nix-grpc-daemon (trusted)4716worker1 # [ 47.438086] nix-daemon[905]: reaped child process 1072, status = succeeded4717worker1 # [ 47.604283] nix-daemon[905]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4718worker1 # [ 47.619965] nix-daemon[905]: reaped child process 1077, status = succeeded4719lb # [ 47.666207] niks3-server[1108]: 2026/09/20 08:04:29 INFO Received uploads request method=POST path=/api/pending_closures4720worker1 # [ 47.642693] nix-grpc-daemon[915]: time=2026-09-20T08:04:29.021Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4721worker1 # [ 47.644767] nix-grpc-daemon[915]: time=2026-09-20T08:04:29.023Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4722lb # [ 47.693588] niks3-server[1108]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4723lb # [ 47.699086] niks3-server[1108]: 2026/09/20 08:04:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4724lb # [ 47.701675] niks3-server[1108]: 2026/09/20 08:04:29 INFO Signed narinfos id=9 count=14725worker1 # [ 47.672179] nix-grpc-daemon[915]: time=2026-09-20T08:04:29.050Z level=INFO msg="Uploading 1 narinfos"4726lb # [ 47.705076] niks3-server[1108]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4727lb # [ 47.711043] niks3-server[1108]: 2026/09/20 08:04:29 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4728lb # [ 47.715572] niks3-server[1108]: 2026/09/20 08:04:29 INFO Completed upload id=94729worker1 # [ 47.686132] nix-grpc-daemon[915]: time=2026-09-20T08:04:29.065Z level=INFO msg="Upload complete. (405ms)"4730lb # [ 47.717742] niks3-server[1108]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4731worker1 # [ 47.688491] nix-grpc-daemon[847]: ts=2026-09-20T08:04:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=0 paths=1 nar_bytes_in=5124732worker1 # [ 47.693130] nix-grpc-daemon[847]: ts=2026-09-20T08:04:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104733worker1 # [ 47.699773] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4734worker1 # [ 47.702267] nix-daemon[905]: reaped child process 1067, status = succeeded4735worker1 # [ 47.709971] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4736lb # [ 48.215875] envoy[978]: conn peer=[2001:db8:1::1]:37770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9312 tx=3758 ms=53554737lb # [ 48.217468] envoy[978]: conn peer=[2001:db8:1::1]:37774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=480 ms=494738lb # [ 48.218894] envoy[978]: conn peer=[2001:db8:1::1]:37786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1355 ms=47514739lb # [ 48.220412] envoy[978]: conn peer=[2001:db8:1::1]:37794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1082 ms=36304740worker1 # [ 48.527498] nix-daemon[905]: reaped child process 1081, status = succeeded4741worker1 # [ 48.652444] nix-daemon[905]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)4742worker1 # [ 48.668108] nix-daemon[905]: reaped child process 1099, status = succeeded4743lb # [ 48.709707] niks3-server[1108]: 2026/09/20 08:04:30 INFO Received uploads request method=POST path=/api/pending_closures4744worker1 # [ 48.691649] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4745worker1 # [ 48.696614] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.072Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4746lb # [ 48.740730] niks3-server[1108]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4747lb # [ 48.743989] niks3-server[1108]: 2026/09/20 08:04:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4748lb # [ 48.745972] niks3-server[1108]: 2026/09/20 08:04:30 INFO Signed narinfos id=10 count=14749worker1 # [ 48.717875] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.096Z level=INFO msg="Uploading 1 narinfos"4750lb # [ 48.752199] niks3-server[1108]: 2026/09/20 08:04:30 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4751lb # [ 48.755072] niks3-server[1108]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4752lb # [ 48.758542] niks3-server[1108]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4753lb # [ 48.760993] niks3-server[1108]: 2026/09/20 08:04:30 INFO Completed upload id=104754worker1 # [ 48.731557] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.110Z level=INFO msg="Upload complete. (213ms)"4755lb # [ 48.762410] niks3-server[1108]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4756worker1 # [ 48.734212] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14757worker1 # [ 48.741407] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:462104758worker1 # [ 48.748085] nix-daemon[905]: reaped child process 1079, status = succeeded4759worker2 # [ 48.790518] nix-grpc-daemon[845]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425744760worker2 # [ 48.800171] nix-grpc-daemon[845]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4761worker2 # [ 48.811243] nix-grpc-daemon[845]: ts=2026-09-20T08:04:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_out=1284762worker2 # [ 49.061220] nix-grpc-daemon[845]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:425744763worker1 # [ 49.032920] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104764worker1 # [ 49.042520] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.421Z level=INFO msg="All 1 paths already cached"4765worker2 # [ 49.087690] nix-grpc-daemon[845]: ts=2026-09-20T08:04:30Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04766worker2 # [ 49.090301] nix-grpc-daemon[845]: ts=2026-09-20T08:04:30Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14767worker1 # [ 49.059711] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104768worker1 # [ 49.073890] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104769worker1 # [ 49.086878] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.465Z level=INFO msg="All 1 paths already cached"4770worker1 # [ 49.092964] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462104771worker1 # [ 49.100120] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4772worker1 # [ 49.269756] nix-daemon[905]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4773worker1 # [ 49.286963] nix-daemon[905]: reaped child process 1106, status = succeeded4774worker1 # [ 49.423835] nix-daemon[905]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4775worker1 # [ 49.442512] nix-daemon[905]: reaped child process 1111, status = succeeded4776lb # [ 49.486881] niks3-server[1108]: 2026/09/20 08:04:31 INFO Received uploads request method=POST path=/api/pending_closures4777worker1 # [ 49.465638] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.844Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4778worker1 # [ 49.467252] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.844Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4779lb # [ 49.514438] niks3-server[1108]: 2026/09/20 08:04:31 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4780lb # [ 49.522261] niks3-server[1108]: 2026/09/20 08:04:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4781lb # [ 49.527794] niks3-server[1108]: 2026/09/20 08:04:31 INFO Signed narinfos id=11 count=14782worker1 # [ 49.502447] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.881Z level=INFO msg="Uploading 1 narinfos"4783lb # [ 49.532403] niks3-server[1108]: 2026/09/20 08:04:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4784lb # [ 49.545201] niks3-server[1108]: 2026/09/20 08:04:31 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4785lb # [ 49.551884] niks3-server[1108]: 2026/09/20 08:04:31 INFO Completed upload id=114786worker1 # [ 49.522555] nix-grpc-daemon[915]: time=2026-09-20T08:04:30.901Z level=INFO msg="Upload complete. (414ms)"4787lb # [ 49.554722] niks3-server[1108]: 2026/09/20 08:04:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4788worker1 # [ 49.527145] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=0 paths=1 nar_bytes_in=6244789worker1 # [ 49.531844] nix-grpc-daemon[847]: ts=2026-09-20T08:04:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104790worker1 # [ 49.539464] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4791worker1 # [ 49.546267] nix-daemon[905]: reaped child process 1101, status = succeeded4792worker1 # [ 49.551307] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4793worker1 # [ 50.773874] nix-daemon[905]: reaped child process 1115, status = succeeded4794worker1 # [ 50.894328] nix-daemon[905]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)4795worker1 # [ 50.908579] nix-daemon[905]: reaped child process 1133, status = succeeded4796lb # [ 50.953153] niks3-server[1108]: 2026/09/20 08:04:33 INFO Received uploads request method=POST path=/api/pending_closures4797worker1 # [ 50.927860] nix-grpc-daemon[915]: time=2026-09-20T08:04:32.306Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4798worker1 # [ 50.931069] nix-grpc-daemon[915]: time=2026-09-20T08:04:32.308Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4799lb # [ 50.976584] niks3-server[1108]: 2026/09/20 08:04:33 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4800lb # [ 50.979212] niks3-server[1108]: 2026/09/20 08:04:33 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4801lb # [ 50.984238] niks3-server[1108]: 2026/09/20 08:04:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4802lb # [ 50.986494] niks3-server[1108]: 2026/09/20 08:04:33 INFO Signed narinfos id=12 count=14803worker1 # [ 50.957237] nix-grpc-daemon[915]: time=2026-09-20T08:04:32.335Z level=INFO msg="Uploading 1 narinfos"4804lb # [ 50.989151] niks3-server[1108]: 2026/09/20 08:04:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4805lb # [ 50.993881] niks3-server[1108]: 2026/09/20 08:04:33 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4806lb # [ 50.996813] niks3-server[1108]: 2026/09/20 08:04:33 INFO Completed upload id=124807worker1 # [ 50.967388] nix-grpc-daemon[915]: time=2026-09-20T08:04:32.346Z level=INFO msg="Upload complete. (207ms)"4808lb # [ 50.998170] niks3-server[1108]: 2026/09/20 08:04:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4809worker1 # [ 50.971202] nix-grpc-daemon[847]: ts=2026-09-20T08:04:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14810worker1 # [ 50.977606] nix-daemon[905]: reaped child process 1113, status = succeeded4811worker2 # [ 51.008539] nix-grpc-daemon[845]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425744812worker2 # [ 51.017133] nix-grpc-daemon[845]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4813worker2 # [ 51.041888] nix-grpc-daemon[845]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425744814worker2 # [ 51.047257] nix-grpc-daemon[845]: ts=2026-09-20T08:04:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_out=1764815worker1 # [ 51.261184] nix-grpc-daemon[847]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:462104816worker2 # [ 51.300610] nix-grpc-daemon[845]: ts=2026-09-20T08:04:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425744817worker2 # [ 51.307045] nix-grpc-daemon[952]: time=2026-09-20T08:04:33.073Z level=INFO msg="All 2 paths already cached"4818worker2 # [ 51.317664] nix-grpc-daemon[845]: ts=2026-09-20T08:04:33Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04819worker2 # [ 51.319603] nix-grpc-daemon[845]: ts=2026-09-20T08:04:33Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14820worker1 # [ 51.290304] nix-grpc-daemon[847]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104821worker1 # [ 51.299045] nix-grpc-daemon[847]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104822worker1 # [ 51.307648] nix-grpc-daemon[915]: time=2026-09-20T08:04:32.686Z level=INFO msg="All 2 paths already cached"4823worker1 # [ 51.311850] nix-grpc-daemon[847]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462104824worker1 # [ 51.315781] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4825worker1 # [ 51.468425] nix-daemon[905]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4826worker1 # [ 51.485271] nix-daemon[905]: reaped child process 1140, status = succeeded4827worker1 # [ 51.615645] nix-daemon[905]: accepted connection from pid 1142, user nix-grpc-daemon (trusted)4828worker1 # [ 51.629772] nix-daemon[905]: reaped child process 1145, status = succeeded4829lb # [ 51.675192] niks3-server[1108]: 2026/09/20 08:04:33 INFO Received uploads request method=POST path=/api/pending_closures4830worker1 # [ 51.654595] nix-grpc-daemon[915]: time=2026-09-20T08:04:33.033Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4831worker1 # [ 51.657106] nix-grpc-daemon[915]: time=2026-09-20T08:04:33.035Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4832lb # [ 51.708135] niks3-server[1108]: 2026/09/20 08:04:33 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4833lb # [ 51.717074] niks3-server[1108]: 2026/09/20 08:04:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4834lb # [ 51.721482] niks3-server[1108]: 2026/09/20 08:04:33 INFO Signed narinfos id=13 count=14835worker1 # [ 51.697127] nix-grpc-daemon[915]: time=2026-09-20T08:04:33.075Z level=INFO msg="Uploading 1 narinfos"4836lb # [ 51.728487] niks3-server[1108]: 2026/09/20 08:04:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4837lb # [ 51.739116] niks3-server[1108]: 2026/09/20 08:04:33 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4838lb # [ 51.743867] niks3-server[1108]: 2026/09/20 08:04:33 INFO Completed upload id=134839worker1 # [ 51.716990] nix-grpc-daemon[915]: time=2026-09-20T08:04:33.095Z level=WARN msg="Failed to register uploaded object" key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo error="server returned 404: object is not pending upload\n"4840worker1 # [ 51.719455] nix-grpc-daemon[915]: time=2026-09-20T08:04:33.095Z level=INFO msg="Upload complete. (394ms)"4841worker1 # [ 51.722136] nix-grpc-daemon[847]: ts=2026-09-20T08:04:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=0 paths=1 nar_bytes_in=7524842worker1 # [ 51.726730] nix-grpc-daemon[847]: ts=2026-09-20T08:04:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104843worker1 # [ 51.734148] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4844worker1 # [ 51.739123] nix-daemon[905]: reaped child process 1135, status = succeeded4845worker1 # [ 51.744543] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4846worker1 # [ 52.558272] nix-daemon[905]: reaped child process 1149, status = succeeded4847worker1 # [ 52.700184] nix-daemon[905]: accepted connection from pid 1164, user nix-grpc-daemon (trusted)4848worker1 # [ 52.713488] nix-daemon[905]: reaped child process 1167, status = succeeded4849lb # [ 52.760517] niks3-server[1108]: 2026/09/20 08:04:34 INFO Received uploads request method=POST path=/api/pending_closures4850worker1 # [ 52.740746] nix-grpc-daemon[915]: time=2026-09-20T08:04:34.119Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4851worker1 # [ 52.743057] nix-grpc-daemon[915]: time=2026-09-20T08:04:34.121Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4852lb # [ 52.806149] niks3-server[1108]: 2026/09/20 08:04:35 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4853lb # [ 52.812682] niks3-server[1108]: 2026/09/20 08:04:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4854worker1 # [ 52.790805] nix-grpc-daemon[915]: time=2026-09-20T08:04:34.169Z level=INFO msg="Uploading 1 narinfos"4855lb # [ 52.820140] niks3-server[1108]: 2026/09/20 08:04:35 INFO Signed narinfos id=14 count=14856lb # [ 52.822911] niks3-server[1108]: 2026/09/20 08:04:35 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4857lb # [ 52.829625] niks3-server[1108]: 2026/09/20 08:04:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4858lb # [ 52.839818] niks3-server[1108]: 2026/09/20 08:04:35 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4859lb # [ 52.844076] niks3-server[1108]: 2026/09/20 08:04:35 INFO Completed upload id=144860worker1 # [ 52.814560] nix-grpc-daemon[915]: time=2026-09-20T08:04:34.193Z level=INFO msg="Upload complete. (261ms)"4861lb # [ 52.846578] niks3-server[1108]: 2026/09/20 08:04:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4862worker1 # [ 52.819803] nix-grpc-daemon[847]: ts=2026-09-20T08:04:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14863worker1 # [ 52.831490] nix-daemon[905]: reaped child process 1147, status = succeeded4864worker2 # [ 52.897955] nix-grpc-daemon[845]: ts=2026-09-20T08:04:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425744865worker2 # [ 52.911882] nix-grpc-daemon[845]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4866worker2 # [ 52.939425] nix-grpc-daemon[845]: ts=2026-09-20T08:04:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425744867worker2 # [ 52.944702] nix-grpc-daemon[845]: ts=2026-09-20T08:04:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_out=2324868client # [ 53.044116] nix-daemon[931]: reaped child process 933, status = succeeded4869client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.30 seconds)4870client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4871client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4872client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4873client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4874client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4875client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4876(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.39 seconds)4877subtest: an input only one worker has still reaches the builder4878client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4879client # this derivation will be built:4880client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4881client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4882client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.39 seconds)4883client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4884client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4885worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4886worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.18 seconds)4887worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4888worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4889client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24890client # [ 54.095385] nix-daemon[931]: accepted connection from pid 1014, user root (trusted)4891client # this derivation will be built:4892client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4893worker2 # [ 54.268291] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:425744894client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4895worker2 # [ 54.274109] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425744896client # copying 1 paths...4897client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4898worker2 # [ 54.282569] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425744899worker2 # [ 54.293708] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4900worker2 # [ 54.445519] nix-daemon[907]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4901worker2 # [ 54.459325] nix-daemon[907]: reaped child process 1041, status = succeeded4902lb # [ 54.473347] niks3-server[1108]: 2026/09/20 08:04:36 INFO Received uploads request method=POST path=/api/pending_closures4903worker2 # [ 54.484345] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.251Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4904worker2 # [ 54.486286] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.253Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4905lb # [ 54.507147] niks3-server[1108]: 2026/09/20 08:04:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4906lb # [ 54.515317] niks3-server[1108]: 2026/09/20 08:04:36 INFO Signed narinfos id=15 count=14907worker2 # [ 54.520788] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.287Z level=INFO msg="Uploading 1 narinfos"4908lb # [ 54.523516] niks3-server[1108]: 2026/09/20 08:04:36 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4909lb # [ 54.528431] niks3-server[1108]: 2026/09/20 08:04:36 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4910lb # [ 54.542096] niks3-server[1108]: 2026/09/20 08:04:36 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4911worker2 # [ 54.550912] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.318Z level=INFO msg="Upload complete. (246ms)"4912lb # [ 54.548976] niks3-server[1108]: 2026/09/20 08:04:36 INFO Completed upload id=154913lb # [ 54.553183] niks3-server[1108]: 2026/09/20 08:04:36 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4914worker2 # [ 54.553192] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_in=1204915worker2 # [ 54.566701] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04916worker2 # [ 54.570366] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14917worker2 # [ 54.575481] nix-daemon[907]: reaped child process 1036, status = succeeded4918worker2 # [ 54.610353] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425744919worker2 # [ 54.621465] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425744920client # copying 2 paths to 'lb:50051'...4921client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4922worker2 # [ 54.635422] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425744923client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4924worker2 # [ 54.648244] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4925worker2 # [ 54.826051] nix-daemon[907]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4926worker2 # [ 54.841075] nix-daemon[907]: reaped child process 1050, status = succeeded4927worker2 # [ 54.983086] nix-daemon[907]: accepted connection from pid 1052, user nix-grpc-daemon (trusted)4928worker2 # [ 54.995516] nix-daemon[907]: reaped child process 1055, status = succeeded4929lb # [ 55.007182] niks3-server[1108]: 2026/09/20 08:04:37 INFO Received uploads request method=POST path=/api/pending_closures4930lb # [ 55.081984] niks3-server[1108]: 2026/09/20 08:04:37 INFO Received uploads request method=POST path=/api/pending_closures4931worker2 # [ 55.094372] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.861Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4932worker2 # [ 55.100702] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.865Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4933worker2 # [ 55.104713] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.865Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4934lb # [ 55.129112] niks3-server[1108]: 2026/09/20 08:04:37 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4935lb # [ 55.141953] niks3-server[1108]: 2026/09/20 08:04:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4936lb # [ 55.146558] niks3-server[1108]: 2026/09/20 08:04:37 INFO Signed narinfos id=16 count=14937lb # [ 55.152044] niks3-server[1108]: 2026/09/20 08:04:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4938lb # [ 55.156731] niks3-server[1108]: 2026/09/20 08:04:37 INFO Signed narinfos id=17 count=24939lb # [ 55.159212] niks3-server[1108]: 2026/09/20 08:04:37 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4940worker2 # [ 55.162169] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.928Z level=INFO msg="Uploading 3 narinfos"4941lb # [ 55.163048] niks3-server[1108]: 2026/09/20 08:04:37 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4942lb # [ 55.165823] niks3-server[1108]: 2026/09/20 08:04:37 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4943lb # [ 55.178719] niks3-server[1108]: 2026/09/20 08:04:37 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4944lb # [ 55.183218] niks3-server[1108]: 2026/09/20 08:04:37 INFO Completed upload id=164945lb # [ 55.184445] niks3-server[1108]: 2026/09/20 08:04:37 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4946lb # [ 55.186307] niks3-server[1108]: 2026/09/20 08:04:37 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4947lb # [ 55.188783] niks3-server[1108]: 2026/09/20 08:04:37 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4948lb # [ 55.190509] niks3-server[1108]: 2026/09/20 08:04:37 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4949lb # [ 55.193128] niks3-server[1108]: 2026/09/20 08:04:37 INFO Completed upload id=174950worker2 # [ 55.195331] nix-grpc-daemon[952]: time=2026-09-20T08:04:36.962Z level=INFO msg="Upload complete. (535ms)"4951worker2 # [ 55.201168] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=2 nar_bytes_in=9764952worker2 # [ 55.206798] nix-grpc-daemon[845]: ts=2026-09-20T08:04:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425744953worker2 # [ 55.218699] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4954worker2 # [ 55.228319] nix-daemon[907]: reaped child process 1045, status = succeeded4955client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4956client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4957worker2 # [ 55.240147] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)4958worker2 # [ 56.262308] nix-daemon[907]: reaped child process 1059, status = succeeded4959worker2 # [ 56.419534] nix-daemon[907]: accepted connection from pid 1075, user nix-grpc-daemon (trusted)4960worker2 # [ 56.432704] nix-daemon[907]: reaped child process 1078, status = succeeded4961lb # [ 56.445314] niks3-server[1108]: 2026/09/20 08:04:38 INFO Received uploads request method=POST path=/api/pending_closures4962worker2 # [ 56.455279] nix-grpc-daemon[952]: time=2026-09-20T08:04:38.222Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4963lb # [ 56.475387] niks3-server[1108]: 2026/09/20 08:04:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4964worker2 # [ 56.485612] nix-grpc-daemon[952]: time=2026-09-20T08:04:38.252Z level=INFO msg="Uploading 1 narinfos"4965lb # [ 56.484143] niks3-server[1108]: 2026/09/20 08:04:38 INFO Signed narinfos id=18 count=14966lb # [ 56.492985] niks3-server[1108]: 2026/09/20 08:04:38 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4967lb # [ 56.501253] niks3-server[1108]: 2026/09/20 08:04:38 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4968lb # [ 56.513112] niks3-server[1108]: 2026/09/20 08:04:38 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4969lb # [ 56.521293] niks3-server[1108]: 2026/09/20 08:04:38 INFO Completed upload id=184970worker2 # [ 56.523444] nix-grpc-daemon[952]: time=2026-09-20T08:04:38.290Z level=INFO msg="Upload complete. (273ms)"4971lb # [ 56.523048] niks3-server[1108]: 2026/09/20 08:04:38 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4972worker2 # [ 56.528298] nix-grpc-daemon[845]: ts=2026-09-20T08:04:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14973worker2 # [ 56.539137] nix-daemon[907]: reaped child process 1057, status = succeeded4974client # copying 1 paths...4975worker2 # [ 56.574514] nix-grpc-daemon[845]: ts=2026-09-20T08:04:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425744976client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4977worker2 # [ 56.596145] nix-grpc-daemon[845]: ts=2026-09-20T08:04:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425744978worker2 # [ 56.601080] nix-grpc-daemon[845]: ts=2026-09-20T08:04:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_out=1204979client # [ 56.706179] nix-daemon[931]: reaped child process 1017, status = succeeded4980client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.82 seconds)4981client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24982client # [ 56.880022] nix-daemon[931]: accepted connection from pid 1036, user root (trusted)4983client # this derivation will be built:4984client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4985worker2 # [ 57.056567] nix-grpc-daemon[845]: ts=2026-09-20T08:04:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:425744986client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4987worker1 # [ 57.028966] nix-grpc-daemon[847]: ts=2026-09-20T08:04:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104988worker1 # [ 57.142694] nix-grpc-daemon[915]: time=2026-09-20T08:04:38.520Z level=INFO msg="All 1 paths already cached"4989worker2 # [ 57.189682] nix-grpc-daemon[845]: ts=2026-09-20T08:04:38Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04990worker2 # [ 57.191754] nix-grpc-daemon[845]: ts=2026-09-20T08:04:38Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14991worker1 # [ 57.165329] nix-grpc-daemon[847]: ts=2026-09-20T08:04:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462104992worker1 # [ 57.176701] nix-grpc-daemon[847]: ts=2026-09-20T08:04:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462104993client # copying 1 paths to 'lb:50051'...4994client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4995worker1 # [ 57.193455] nix-grpc-daemon[847]: ts=2026-09-20T08:04:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462104996worker1 # [ 57.205674] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4997worker1 # [ 57.218740] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5)4998worker1 # [ 57.268869] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 2/5)4999worker1 # [ 57.360271] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 285 ms (attempt 3/5)5000worker1 # [ 57.645597] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 4/5)5001worker1 # [ 57.941496] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5002worker1 # [ 57.947676] nix-grpc-daemon[847]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5003worker1 # [ 58.145679] nix-daemon[905]: accepted connection from pid 1180, user nix-grpc-daemon (trusted)5004worker1 # [ 58.161976] nix-daemon[905]: reaped child process 1183, status = succeeded5005lb # [ 58.216605] envoy[978]: conn peer=[2001:db8:1::1]:40054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=735006lb # [ 58.220548] envoy[978]: conn peer=[2001:db8:1::1]:40048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3367 tx=1618 ms=16095007lb # [ 58.224195] envoy[978]: conn peer=[2001:db8:1::1]:40070 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=555008lb # [ 58.227586] envoy[978]: conn peer=[2001:db8:1::1]:40058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1974 ms=20385009lb # [ 58.231282] envoy[978]: conn peer=[2001:db8:1::1]:40074 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4298 tx=2179 ms=17015010lb # [ 58.234974] envoy[978]: conn peer=[2001:db8:1::1]:59024 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=565011lb # [ 58.238493] envoy[978]: conn peer=[2001:db8:1::1]:59044 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=555012lb # [ 58.242596] envoy[978]: conn peer=[2001:db8:1::1]:59034 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4246 tx=1744 ms=23855013worker1 # [ 58.329363] nix-daemon[905]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)5014worker1 # [ 58.342400] nix-daemon[905]: reaped child process 1188, status = succeeded5015lb # [ 58.388517] niks3-server[1108]: 2026/09/20 08:04:40 INFO Received uploads request method=POST path=/api/pending_closures5016worker1 # [ 58.367449] nix-grpc-daemon[915]: time=2026-09-20T08:04:39.746Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5017worker1 # [ 58.369140] nix-grpc-daemon[915]: time=2026-09-20T08:04:39.747Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5018lb # [ 58.424105] niks3-server[1108]: 2026/09/20 08:04:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5019lb # [ 58.429262] niks3-server[1108]: 2026/09/20 08:04:40 INFO Signed narinfos id=19 count=15020worker1 # [ 58.403120] nix-grpc-daemon[915]: time=2026-09-20T08:04:39.781Z level=INFO msg="Uploading 1 narinfos"5021lb # [ 58.435101] niks3-server[1108]: 2026/09/20 08:04:40 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5022lb # [ 58.443773] niks3-server[1108]: 2026/09/20 08:04:40 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5023lb # [ 58.454734] niks3-server[1108]: 2026/09/20 08:04:40 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5024worker1 # [ 58.431959] nix-grpc-daemon[915]: time=2026-09-20T08:04:39.810Z level=INFO msg="Upload complete. (463ms)"5025lb # [ 58.461656] niks3-server[1108]: 2026/09/20 08:04:40 INFO Completed upload id=195026worker1 # [ 58.434646] nix-grpc-daemon[847]: ts=2026-09-20T08:04:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 paths=1 nar_bytes_in=5605027lb # [ 58.465222] niks3-server[1108]: 2026/09/20 08:04:40 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5028worker1 # [ 58.439965] nix-grpc-daemon[847]: ts=2026-09-20T08:04:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462105029worker1 # [ 58.446670] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)5030worker1 # [ 58.453096] nix-daemon[905]: reaped child process 1174, status = succeeded5031client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5032worker1 # [ 58.457250] nix-daemon[905]: accepted connection from pid 847, user nix-grpc-daemon (trusted)5033client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5034worker1 # [ 59.671704] nix-daemon[905]: reaped child process 1192, status = succeeded5035worker1 # [ 59.839831] nix-daemon[905]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5036worker1 # [ 59.854509] nix-daemon[905]: reaped child process 1210, status = succeeded5037lb # [ 59.902665] niks3-server[1108]: 2026/09/20 08:04:42 INFO Received uploads request method=POST path=/api/pending_closures5038worker1 # [ 59.882056] nix-grpc-daemon[915]: time=2026-09-20T08:04:41.258Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5039lb # [ 59.931486] niks3-server[1108]: 2026/09/20 08:04:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5040lb # [ 59.935594] niks3-server[1108]: 2026/09/20 08:04:42 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5041worker1 # [ 59.912456] nix-grpc-daemon[915]: time=2026-09-20T08:04:41.291Z level=INFO msg="Uploading 1 narinfos"5042lb # [ 59.941940] niks3-server[1108]: 2026/09/20 08:04:42 INFO Signed narinfos id=20 count=15043lb # [ 59.952100] niks3-server[1108]: 2026/09/20 08:04:42 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5044lb # [ 59.959300] niks3-server[1108]: 2026/09/20 08:04:42 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5045lb # [ 59.961083] niks3-server[1108]: 2026/09/20 08:04:42 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5046lb # [ 59.964793] niks3-server[1108]: 2026/09/20 08:04:42 INFO Completed upload id=205047worker1 # [ 59.935613] nix-grpc-daemon[915]: time=2026-09-20T08:04:41.314Z level=INFO msg="Upload complete. (271ms)"5048worker1 # [ 59.940618] nix-grpc-daemon[847]: ts=2026-09-20T08:04:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15049worker1 # [ 59.951734] nix-daemon[905]: reaped child process 1190, status = succeeded5050client # copying 1 paths...5051worker1 # [ 59.985079] nix-grpc-daemon[847]: ts=2026-09-20T08:04:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:462105052client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5053worker2 # [ 60.037983] nix-grpc-daemon[845]: ts=2026-09-20T08:04:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425745054worker2 # [ 60.048756] nix-grpc-daemon[845]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5055worker2 # [ 60.064694] nix-grpc-daemon[845]: ts=2026-09-20T08:04:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_out=1205056client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.45 seconds)5057client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25058client # [ 60.241495] nix-daemon[931]: reaped child process 1039, status = succeeded5059client # [ 60.328267] nix-daemon[931]: accepted connection from pid 1058, user root (trusted)5060client # this derivation will be built:5061client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5062worker2 # [ 60.546950] nix-grpc-daemon[845]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:425745063worker1 # [ 60.519883] nix-grpc-daemon[847]: ts=2026-09-20T08:04:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462105064client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5065worker1 # [ 60.541174] nix-grpc-daemon[915]: time=2026-09-20T08:04:41.920Z level=INFO msg="All 1 paths already cached"5066worker2 # [ 60.585689] nix-grpc-daemon[845]: ts=2026-09-20T08:04:42Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05067worker2 # [ 60.591793] nix-grpc-daemon[845]: ts=2026-09-20T08:04:42Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15068worker2 # [ 60.629529] nix-grpc-daemon[845]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425745069worker2 # [ 60.643936] nix-grpc-daemon[845]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425745070worker2 # [ 60.845077] nix-grpc-daemon[952]: time=2026-09-20T08:04:42.611Z level=INFO msg="All 1 paths already cached"5071client # copying 1 paths to 'lb:50051'...5072client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5073worker2 # [ 60.851582] nix-grpc-daemon[845]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425745074worker2 # [ 60.860802] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)5075worker2 # [ 61.035517] nix-daemon[907]: accepted connection from pid 1087, user nix-grpc-daemon (trusted)5076worker2 # [ 61.048476] nix-daemon[907]: reaped child process 1090, status = succeeded5077worker2 # [ 61.201498] nix-daemon[907]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)5078worker2 # [ 61.214265] nix-daemon[907]: reaped child process 1095, status = succeeded5079lb # [ 61.225629] niks3-server[1108]: 2026/09/20 08:04:43 INFO Received uploads request method=POST path=/api/pending_closures5080worker2 # [ 61.235373] nix-grpc-daemon[952]: time=2026-09-20T08:04:43.002Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5081worker2 # [ 61.236774] nix-grpc-daemon[952]: time=2026-09-20T08:04:43.002Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5082lb # [ 61.253157] niks3-server[1108]: 2026/09/20 08:04:43 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5083lb # [ 61.264120] niks3-server[1108]: 2026/09/20 08:04:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5084worker2 # [ 61.272044] nix-grpc-daemon[952]: time=2026-09-20T08:04:43.039Z level=INFO msg="Uploading 1 narinfos"5085lb # [ 61.269888] niks3-server[1108]: 2026/09/20 08:04:43 INFO Signed narinfos id=21 count=15086lb # [ 61.275664] niks3-server[1108]: 2026/09/20 08:04:43 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5087lb # [ 61.286101] niks3-server[1108]: 2026/09/20 08:04:43 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5088worker2 # [ 61.294670] nix-grpc-daemon[952]: time=2026-09-20T08:04:43.061Z level=INFO msg="Upload complete. (420ms)"5089lb # [ 61.293176] niks3-server[1108]: 2026/09/20 08:04:43 INFO Completed upload id=215090worker2 # [ 61.297574] nix-grpc-daemon[845]: ts=2026-09-20T08:04:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_in=5605091lb # [ 61.296953] niks3-server[1108]: 2026/09/20 08:04:43 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5092worker2 # [ 61.303445] nix-grpc-daemon[845]: ts=2026-09-20T08:04:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425745093worker2 # [ 61.313551] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)5094worker2 # [ 61.316124] nix-daemon[907]: reaped child process 1085, status = succeeded5095worker2 # [ 61.321348] nix-daemon[907]: accepted connection from pid 845, user nix-grpc-daemon (trusted)5096client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5097client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5098worker2 # [ 62.535208] nix-daemon[907]: reaped child process 1099, status = succeeded5099worker2 # [ 62.673293] nix-daemon[907]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)5100worker2 # [ 62.684708] nix-daemon[907]: reaped child process 1117, status = succeeded5101lb # [ 62.700161] niks3-server[1108]: 2026/09/20 08:04:44 INFO Received uploads request method=POST path=/api/pending_closures5102worker2 # [ 62.709898] nix-grpc-daemon[952]: time=2026-09-20T08:04:44.476Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5103lb # [ 62.734973] niks3-server[1108]: 2026/09/20 08:04:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5104worker2 # [ 62.744492] nix-grpc-daemon[952]: time=2026-09-20T08:04:44.511Z level=INFO msg="Uploading 1 narinfos"5105lb # [ 62.742457] niks3-server[1108]: 2026/09/20 08:04:44 INFO Signed narinfos id=22 count=15106lb # [ 62.747574] niks3-server[1108]: 2026/09/20 08:04:44 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5107lb # [ 62.753150] niks3-server[1108]: 2026/09/20 08:04:44 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5108lb # [ 62.764134] niks3-server[1108]: 2026/09/20 08:04:44 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5109worker2 # [ 62.770545] nix-grpc-daemon[952]: time=2026-09-20T08:04:44.537Z level=INFO msg="Upload complete. (242ms)"5110lb # [ 62.769205] niks3-server[1108]: 2026/09/20 08:04:44 INFO Completed upload id=225111lb # [ 62.773926] niks3-server[1108]: 2026/09/20 08:04:44 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5112worker2 # [ 62.774941] nix-grpc-daemon[845]: ts=2026-09-20T08:04:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15113worker2 # [ 62.786519] nix-daemon[907]: reaped child process 1097, status = succeeded5114client # copying 1 paths...5115worker1 # [ 62.790664] nix-grpc-daemon[847]: ts=2026-09-20T08:04:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:462105116worker1 # [ 62.805721] nix-grpc-daemon[847]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5117client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5118worker2 # [ 62.871399] nix-grpc-daemon[845]: ts=2026-09-20T08:04:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425745119worker2 # [ 62.873570] nix-grpc-daemon[845]: ts=2026-09-20T08:04:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42574 duration_s=0 paths=1 nar_bytes_out=1205120client # [ 62.939195] nix-daemon[931]: reaped child process 1061, status = succeeded5121client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.78 seconds)5122(finished: subtest: an input only one worker has still reaches the builder, in 9.81 seconds)5123subtest: upload whose reference the worker lacks is completed from the cache5124client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5125client # this derivation will be built:5126client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5127client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5128client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.52 seconds)5129client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5130client # this derivation will be built:5131client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5132client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5133client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds)5134client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5135client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds)5136worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5137worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.21 seconds)5138worker2 # [ 64.255056] systemd[1]: Stopping Nix worker-protocol over gRPC...5139worker2 # [ 64.497841] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=signal_exit5140worker2 # [ 64.746811] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=scheduler_yield5141worker2 # [ 64.748567] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=scheduler_restarting addr=lb:500515142worker2 # [ 64.750910] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:461785143worker2 # [ 64.752390] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=worker_gone addr=192.168.1.4:500515144lb # [ 64.749779] niks3-server[1108]: 2026/09/20 08:04:46 INFO lead: released remote=192.168.1.4:391645145worker2 # [ 64.756428] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:461785146worker2 # [ 64.757788] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=worker_gone addr=192.168.1.3:500515147worker1 # [ 64.725065] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_restarting addr=lb:500515148worker2 # [ 64.949215] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=scheduler_connected addr=lb:500515149worker2 # [ 64.952191] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5150worker1 # [ 64.926479] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_connected addr=lb:500515151worker1 # [ 64.933853] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5152worker2 # [ 65.152848] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=scheduler_connected addr=lb:500515153worker2 # [ 65.156131] nix-grpc-daemon[845]: ts=2026-09-20T08:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5154worker1 # [ 65.134644] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_connected addr=lb:500515155worker1 # [ 65.138618] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5156worker2 # [ 65.356962] nix-grpc-daemon[845]: ts=2026-09-20T08:04:47Z level=info event=scheduler_connected addr=lb:500515157worker2 # [ 65.360188] nix-grpc-daemon[845]: ts=2026-09-20T08:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5158worker1 # [ 65.339185] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_connected addr=lb:500515159worker1 # [ 65.343241] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5160worker2 # [ 65.560916] nix-grpc-daemon[845]: ts=2026-09-20T08:04:47Z level=info event=scheduler_connected addr=lb:500515161worker2 # [ 65.563761] nix-grpc-daemon[845]: ts=2026-09-20T08:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5162worker1 # [ 65.543887] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_connected addr=lb:500515163worker1 # [ 65.548729] nix-grpc-daemon[847]: ts=2026-09-20T08:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5164worker2 # [ 65.747738] nix-grpc-daemon[845]: ts=2026-09-20T08:04:47Z level=info event=scheduler_restarting5165worker2 # [ 65.776814] nix-grpc-daemon[845]: ts=2026-09-20T08:04:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5166worker1 # [ 65.751347] nix-grpc-daemon[847]: ts=2026-09-20T08:04:47Z level=info event=scheduler_connected addr=lb:500515167worker2 # [ 65.787837] nix-daemon[907]: reaped child process 910, status = succeeded5168worker1 # [ 65.755300] nix-grpc-daemon[847]: ts=2026-09-20T08:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5169worker1 # [ 65.956383] nix-grpc-daemon[847]: ts=2026-09-20T08:04:47Z level=info event=scheduler_connected addr=lb:500515170worker2 # [ 65.989742] nix-grpc-daemon[845]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5171worker2 # [ 65.991358] nix-grpc-daemon[845]: E0000 00:00:1789891487.756464 888 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5172worker2 # [ 66.641720] nix-grpc-daemon[845]: E0000 00:00:1789891488.408383 888 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5173worker2 # [ 66.644155] nix-grpc-daemon[845]: E0000 00:00:1789891488.411342 888 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5174worker1 # [ 66.750796] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5175worker2 # [ 66.797701] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5176worker2 # [ 66.800434] systemd[1]: Stopped Nix worker-protocol over gRPC.5177worker2 # [ 66.801351] systemd[1]: nix-grpc-daemon.service: Consumed 1.554s CPU time over 48.580s wall clock time, 50.3M memory peak, 56.6K incoming IP traffic, 104.9K outgoing IP traffic.5178worker2 # [ 66.805655] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5179worker2 # [ 66.807746] systemd[1]: Closed Nix worker-protocol over gRPC.5180worker2 # [ 66.809187] systemd[1]: nix-grpc-daemon.socket: Consumed 368us CPU time over 56.804s wall clock time, 256K memory peak, 94.4K incoming IP traffic, 75.6K outgoing IP traffic.5181lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5182lb: must succeed: curl -sf localhost:9901/clusters5183lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5184lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5185client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25186worker1 # [ 66.951443] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_connected addr=lb:500515187worker1 # [ 66.956589] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5188worker1 # [ 67.067991] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462105189client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5190worker1 # [ 67.073604] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:462105191client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5192worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5193worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5194worker1 # [ 67.157560] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_connected addr=lb:500515195worker1 # [ 67.161646] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5196worker2 # [ 67.211796] systemd[1]: Listening on Nix worker-protocol over gRPC.5197worker1 # [ 67.219153] systemd[1]: Stopping Nix worker-protocol over gRPC...5198worker1 # [ 67.362287] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_connected addr=lb:500515199worker1 # [ 67.364989] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5200worker1 # [ 67.460544] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=signal_exit5201worker1 # [ 67.565798] nix-grpc-daemon[847]: ts=2026-09-20T08:04:48Z level=info event=scheduler_connected addr=lb:500515202worker2 # [ 67.602344] systemd[1]: Starting Nix worker-protocol over gRPC...5203worker2 # [ 67.750416] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5204worker2 # [ 67.754954] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15205worker2 # [ 67.761935] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5206worker2 # [ 67.765547] systemd[1]: Started Nix worker-protocol over gRPC.5207worker2 # [ 67.773208] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=scheduler_take_over5208lb # [ 67.773427] niks3-server[1108]: 2026/09/20 08:04:49 INFO lead: acquired remote=192.168.1.4:361385209worker2 # [ 67.783459] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05210worker2 # [ 67.787457] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5211worker2 # [ 67.988278] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=scheduler_connected addr=lb:500515212worker2 # [ 67.992404] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05213lb # [ 68.217174] envoy[978]: conn peer=[2001:db8:1::1]:59058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3715 tx=1821 ms=30595214lb # [ 68.220829] envoy[978]: conn peer=[2001:db8:1::1]:59068 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=815215lb # [ 68.224755] envoy[978]: conn peer=[2001:db8:1::1]:42214 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=145216lb # [ 68.228630] envoy[978]: conn peer=[2001:db8:1::1]:59078 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=1936 ms=23375217lb # [ 68.232291] envoy[978]: conn peer=[2001:db8:1::4]:44906 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11069 tx=2228 ms=462145218lb # [ 68.235960] envoy[978]: conn peer=[2001:db8:1::1]:42218 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=165219worker1 # [ 68.710552] nix-grpc-daemon[847]: ts=2026-09-20T08:04:50Z level=info event=scheduler_restarting5220worker2 # [ 68.747170] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:376825221worker2 # [ 68.748711] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:50Z level=info event=worker_gone addr=192.168.1.3:500515222worker1 # [ 68.728903] nix-grpc-daemon[847]: ts=2026-09-20T08:04:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5223worker1 # [ 68.748381] nix-daemon[905]: reaped child process 907, status = succeeded5224worker1 # [ 69.581040] nix-grpc-daemon[847]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5225worker1 # [ 69.582796] nix-grpc-daemon[847]: E0000 00:00:1789891490.959499 890 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5226worker1 # [ 69.585336] nix-grpc-daemon[847]: E0000 00:00:1789891490.964093 890 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5227worker1 # [ 70.733727] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5228worker1 # [ 70.737216] systemd[1]: Stopped Nix worker-protocol over gRPC.5229worker1 # [ 70.740883] systemd[1]: nix-grpc-daemon.service: Consumed 2.481s CPU time over 52.556s wall clock time, 58.1M memory peak, 74.7K incoming IP traffic, 139.2K outgoing IP traffic.5230worker1 # [ 70.753166] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5231worker1 # [ 70.756726] systemd[1]: Closed Nix worker-protocol over gRPC.5232worker1 # [ 70.759668] systemd[1]: nix-grpc-daemon.socket: Consumed 341us CPU time over 1min 420ms wall clock time, 256K memory peak, 97.9K incoming IP traffic, 78.2K outgoing IP traffic.5233lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5234lb: must succeed: curl -sf localhost:9901/clusters5235lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5236lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.04 seconds)5237client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25238worker2 # [ 71.010733] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:377145239worker2 # [ 71.021537] nix-daemon[907]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)5240worker2 # [ 71.038378] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 1/5)5241worker2 # [ 71.107147] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 2/5)5242worker2 # [ 71.235950] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 377 ms (attempt 3/5)5243worker2 # [ 71.619078] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 255 ms (attempt 4/5)5244worker2 # [ 71.880432] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5245client # copying 2 paths...5246client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5247client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5248worker2 # [ 71.902163] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:377145249worker2 # [ 71.912174] nix-daemon[907]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)5250worker2 # [ 71.968937] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:53Z level=info event=niks3_push_started pid=11945251worker2 # [ 72.341257] nix-daemon[907]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5252worker2 # [ 72.354170] nix-daemon[907]: reaped child process 1210, status = succeeded5253lb # [ 72.368627] niks3-server[1108]: 2026/09/20 08:04:54 INFO Received uploads request method=POST path=/api/pending_closures5254lb # [ 72.377265] niks3-server[1108]: 2026/09/20 08:04:54 INFO Received uploads request method=POST path=/api/pending_closures5255worker2 # [ 72.386451] nix-grpc-daemon[1194]: time=2026-09-20T08:04:54.153Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5256worker2 # [ 72.388047] nix-grpc-daemon[1194]: time=2026-09-20T08:04:54.155Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5257worker2 # [ 72.390247] nix-grpc-daemon[1194]: time=2026-09-20T08:04:54.156Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5258lb # [ 72.435181] niks3-server[1108]: 2026/09/20 08:04:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5259lb # [ 72.440529] niks3-server[1108]: 2026/09/20 08:04:54 INFO Signed narinfos id=24 count=25260lb # [ 72.442420] niks3-server[1108]: 2026/09/20 08:04:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5261lb # [ 72.451702] niks3-server[1108]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5262lb # [ 72.456929] niks3-server[1108]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5263lb # [ 72.458741] niks3-server[1108]: 2026/09/20 08:04:54 INFO Signed narinfos id=23 count=15264lb # [ 72.460892] niks3-server[1108]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5265worker2 # [ 72.463186] nix-grpc-daemon[1194]: time=2026-09-20T08:04:54.229Z level=INFO msg="Uploading 3 narinfos"5266lb # [ 72.465090] niks3-server[1108]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5267lb # [ 72.477598] niks3-server[1108]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5268lb # [ 72.481167] niks3-server[1108]: 2026/09/20 08:04:54 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5269lb # [ 72.486143] niks3-server[1108]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5270lb # [ 72.517084] niks3-server[1108]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5271lb # [ 72.690701] niks3-server[1108]: 2026/09/20 08:04:54 INFO Completed upload id=235272lb # [ 72.695460] niks3-server[1108]: 2026/09/20 08:04:54 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5273lb # [ 72.710254] niks3-server[1108]: 2026/09/20 08:04:54 INFO Completed upload id=245274worker2 # [ 72.712945] nix-grpc-daemon[1194]: time=2026-09-20T08:04:54.479Z level=INFO msg="Upload complete. (537ms)"5275worker2 # [ 72.719697] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37714 duration_s=0 paths=2 nar_bytes_in=3125276worker2 # [ 72.737189] nix-daemon[907]: reaped child process 1192, status = succeeded5277client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.91 seconds)5278worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5279worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5280worker1 # [ 72.792915] systemd[1]: Listening on Nix worker-protocol over gRPC.5281worker1 # [ 72.796916] systemd[1]: Starting Nix worker-protocol over gRPC...5282worker1 # [ 72.942779] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5283worker1 # [ 72.946479] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15284worker1 # [ 72.952561] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5285worker1 # [ 72.958149] systemd[1]: Started Nix worker-protocol over gRPC.5286lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5287lb: must succeed: curl -sf localhost:9901/clusters5288worker1 # [ 72.971131] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:54Z level=info event=scheduler_connected addr=lb:500515289worker2 # [ 73.005350] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05290lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5291lb: must succeed: curl -sf localhost:9901/clusters5292lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5293lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.12 seconds)5294(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.16 seconds)5295subtest: scheduler down: the other node takes the lock and keeps it5296lb: must succeed: curl -sf localhost:9901/clusters5297lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5298lb: must succeed: curl -sf localhost:9901/clusters5299lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5300lb: must succeed: curl -sf localhost:9901/clusters5301lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5302lb: must succeed: curl -sf localhost:9901/clusters5303lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5304worker2 # [ 74.334967] systemd[1]: Stopping Nix worker-protocol over gRPC...5305worker2 # [ 74.768270] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=signal_exit5306worker2 # [ 74.979107] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=scheduler_yield5307lb # [ 74.980848] niks3-server[1108]: 2026/09/20 08:04:57 INFO lead: released remote=192.168.1.4:361385308worker1 # [ 74.951867] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:56Z level=info event=scheduler_restarting addr=lb:500515309worker2 # [ 74.985911] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:376825310worker2 # [ 74.988272] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=worker_gone addr=192.168.1.3:500515311worker2 # [ 74.990094] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=scheduler_restarting addr=lb:500515312worker2 # [ 74.991994] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:376825313worker2 # [ 74.993346] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=worker_gone addr=192.168.1.4:500515314worker1 # [ 75.151812] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500515315worker2 # [ 75.190646] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500515316worker1 # [ 75.159736] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5317worker2 # [ 75.203535] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5318worker1 # [ 75.360353] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500515319worker1 # [ 75.363284] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5320worker2 # [ 75.404429] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500515321worker2 # [ 75.408222] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5322worker1 # [ 75.564529] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:56Z level=info event=scheduler_connected addr=lb:500515323worker1 # [ 75.568617] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5324worker2 # [ 75.608304] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500515325worker2 # [ 75.610476] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5326worker1 # [ 75.769527] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500515327worker1 # [ 75.773595] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5328worker2 # [ 75.811942] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500515329worker2 # [ 75.815752] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5330worker2 # [ 75.981671] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=scheduler_restarting5331worker2 # [ 76.001141] nix-daemon[907]: reaped child process 1187, status = succeeded5332worker1 # [ 75.975139] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:57Z level=info event=scheduler_connected addr=lb:500515333worker2 # [ 76.006732] nix-grpc-daemon[1138]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5334worker2 # [ 76.010071] nix-grpc-daemon[1138]: E0000 00:00:1789891497.773794 1181 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5335worker2 # [ 76.025303] nix-grpc-daemon[1138]: ts=2026-09-20T08:04:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5336worker2 # [ 76.810080] nix-grpc-daemon[1138]: E0000 00:00:1789891498.577020 1181 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5337worker2 # [ 76.816798] nix-grpc-daemon[1138]: E0000 00:00:1789891498.577169 1181 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5338worker1 # [ 77.741483] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5339worker2 # [ 77.782908] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5340worker2 # [ 77.784949] systemd[1]: Stopped Nix worker-protocol over gRPC.5341worker2 # [ 77.785981] systemd[1]: nix-grpc-daemon.service: Consumed 348ms CPU time over 10.180s wall clock time, 30.3M memory peak, 18.1K incoming IP traffic, 22.9K outgoing IP traffic.5342worker2 # [ 77.789985] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5343worker2 # [ 77.791683] systemd[1]: Closed Nix worker-protocol over gRPC.5344worker2 # [ 77.793406] systemd[1]: nix-grpc-daemon.socket: Consumed 288us CPU time over 10.584s wall clock time, 256K memory peak, 28.1K incoming IP traffic, 23.6K outgoing IP traffic.5345worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5346worker1 # [ 77.941465] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500515347worker1 # [ 77.946796] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5348lb # [ 77.991431] niks3-server[1108]: 2026/09/20 08:05:00 INFO lead: acquired remote=192.168.1.3:553705349worker1 # [ 77.965119] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=scheduler_take_over5350worker1 # [ 78.147365] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500515351worker1 # [ 78.150724] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5352lb # [ 78.217548] envoy[978]: conn peer=192.168.1.3:42826 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=13078 tx=2749 ms=493965353lb # [ 78.222166] envoy[978]: conn peer=[2001:db8:1::1]:42230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=17225354lb # [ 78.226102] envoy[978]: conn peer=[2001:db8:1::4]:49862 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1340 tx=413 ms=82425355worker1 # [ 78.351834] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=scheduler_connected addr=lb:500515356worker1 # [ 78.357095] nix-grpc-daemon[1234]: ts=2026-09-20T08:04:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05357worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.13 seconds)5358worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5359worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5360client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25361worker1 # [ 79.159768] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457565362worker1 # [ 79.165492] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5363client # don't know how to build these paths:5364client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5365worker1 # [ 79.178895] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:00Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05366worker1 # [ 79.181098] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:00Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15367worker1 # [ 79.226685] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565368worker1 # [ 79.238427] nix-grpc-daemon[1234]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)5369worker1 # [ 79.329199] nix-grpc-daemon[1234]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 2/5)5370worker1 # [ 79.395776] nix-grpc-daemon[1234]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 318 ms (attempt 3/5)5371worker1 # [ 79.716816] nix-grpc-daemon[1234]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 331 ms (attempt 4/5)5372worker1 # [ 80.048386] nix-grpc-daemon[1234]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5373worker1 # [ 80.059031] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457565374client # copying 1 paths to 'lb:50051'...5375client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5376worker1 # [ 80.067180] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457565377worker1 # [ 80.077154] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5378worker1 # [ 80.094503] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:01Z level=info event=niks3_push_started pid=13095379worker1 # [ 80.439876] nix-daemon[905]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)5380worker1 # [ 80.453174] nix-daemon[905]: reaped child process 1325, status = succeeded5381worker1 # [ 80.615190] nix-daemon[905]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5382worker1 # [ 80.628397] nix-daemon[905]: reaped child process 1330, status = succeeded5383lb # [ 80.675299] niks3-server[1108]: 2026/09/20 08:05:02 INFO Received uploads request method=POST path=/api/pending_closures5384worker1 # [ 80.653744] nix-grpc-daemon[1309]: time=2026-09-20T08:05:02.032Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5385worker1 # [ 80.657211] nix-grpc-daemon[1309]: time=2026-09-20T08:05:02.034Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5386lb # [ 80.708301] niks3-server[1108]: 2026/09/20 08:05:02 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5387lb # [ 80.717877] niks3-server[1108]: 2026/09/20 08:05:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5388worker1 # [ 80.694712] nix-grpc-daemon[1309]: time=2026-09-20T08:05:02.073Z level=INFO msg="Uploading 1 narinfos"5389lb # [ 80.725301] niks3-server[1108]: 2026/09/20 08:05:02 INFO Signed narinfos id=25 count=15390lb # [ 80.738204] niks3-server[1108]: 2026/09/20 08:05:02 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5391lb # [ 80.745278] niks3-server[1108]: 2026/09/20 08:05:02 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5392lb # [ 80.749801] niks3-server[1108]: 2026/09/20 08:05:02 INFO Completed upload id=255393worker1 # [ 80.722481] nix-grpc-daemon[1309]: time=2026-09-20T08:05:02.101Z level=INFO msg="Upload complete. (437ms)"5394worker1 # [ 80.727127] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=0 paths=1 nar_bytes_in=5205395worker1 # [ 80.732315] nix-grpc-daemon[1309]: time=2026-09-20T08:05:02.110Z level=WARN msg="Failed to register uploaded object" key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo error="server returned 404: object is not pending upload\n"5396worker1 # [ 80.734985] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565397worker1 # [ 80.744607] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5398worker1 # [ 80.746535] nix-daemon[905]: reaped child process 1307, status = succeeded5399worker1 # [ 80.751494] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5400client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5401client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5402client # farm-a> LOG-farm-a-on-standby5403worker1 # [ 81.576212] nix-daemon[905]: reaped child process 1334, status = succeeded5404worker1 # [ 81.722456] nix-daemon[905]: accepted connection from pid 1349, user nix-grpc-daemon (trusted)5405worker1 # [ 81.734390] nix-daemon[905]: reaped child process 1352, status = succeeded5406lb # [ 81.776973] niks3-server[1108]: 2026/09/20 08:05:03 INFO Received uploads request method=POST path=/api/pending_closures5407worker1 # [ 81.758916] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.137Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5408worker1 # [ 81.762033] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.139Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5409lb # [ 81.823205] niks3-server[1108]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5410lb # [ 81.829522] niks3-server[1108]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5411lb # [ 81.837502] niks3-server[1108]: 2026/09/20 08:05:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5412worker1 # [ 81.812583] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.190Z level=INFO msg="Uploading 1 narinfos"5413lb # [ 81.841461] niks3-server[1108]: 2026/09/20 08:05:04 INFO Signed narinfos id=26 count=15414lb # [ 81.846466] niks3-server[1108]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5415lb # [ 81.854279] niks3-server[1108]: 2026/09/20 08:05:04 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5416lb # [ 81.858061] niks3-server[1108]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5417lb # [ 81.861063] niks3-server[1108]: 2026/09/20 08:05:04 INFO Completed upload id=265418worker1 # [ 81.831624] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.210Z level=INFO msg="Upload complete. (272ms)"5419worker1 # [ 81.835279] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15420worker1 # [ 81.845372] nix-daemon[905]: reaped child process 1332, status = succeeded5421worker1 # [ 81.848066] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05422worker1 # [ 81.849740] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15423worker1 # [ 81.896071] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565424worker1 # [ 81.906124] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457565425worker1 # [ 81.917505] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.296Z level=INFO msg="All 1 paths already cached"5426client # copying 1 paths to 'lb:50051'...5427client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5428worker1 # [ 81.923613] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457565429worker1 # [ 81.931889] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5430worker1 # [ 82.096470] nix-daemon[905]: accepted connection from pid 1358, user nix-grpc-daemon (trusted)5431worker1 # [ 82.109772] nix-daemon[905]: reaped child process 1361, status = succeeded5432worker1 # [ 82.250987] nix-daemon[905]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5433worker1 # [ 82.263678] nix-daemon[905]: reaped child process 1366, status = succeeded5434lb # [ 82.303556] niks3-server[1108]: 2026/09/20 08:05:04 INFO Received uploads request method=POST path=/api/pending_closures5435worker1 # [ 82.279429] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.658Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5436worker1 # [ 82.280919] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.659Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5437lb # [ 82.322074] niks3-server[1108]: 2026/09/20 08:05:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5438lb # [ 82.324540] niks3-server[1108]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5439lb # [ 82.326779] niks3-server[1108]: 2026/09/20 08:05:04 INFO Signed narinfos id=27 count=15440worker1 # [ 82.297536] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.676Z level=INFO msg="Uploading 1 narinfos"5441lb # [ 82.329889] niks3-server[1108]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5442lb # [ 82.333620] niks3-server[1108]: 2026/09/20 08:05:04 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5443lb # [ 82.336363] niks3-server[1108]: 2026/09/20 08:05:04 INFO Completed upload id=275444worker1 # [ 82.306896] nix-grpc-daemon[1309]: time=2026-09-20T08:05:03.685Z level=INFO msg="Upload complete. (363ms)"5445lb # [ 82.338817] niks3-server[1108]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5446worker1 # [ 82.308922] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=0 paths=1 nar_bytes_in=6405447worker1 # [ 82.311637] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565448worker1 # [ 82.318297] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5449worker1 # [ 82.321579] nix-daemon[905]: reaped child process 1356, status = succeeded5450client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5451client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5452worker1 # [ 82.326526] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5453worker1 # [ 83.541571] nix-daemon[905]: reaped child process 1370, status = succeeded5454client # farm-b> LOG-farm-b-on-standby5455worker1 # [ 83.682325] nix-daemon[905]: accepted connection from pid 1385, user nix-grpc-daemon (trusted)5456worker1 # [ 83.695132] nix-daemon[905]: reaped child process 1388, status = succeeded5457lb # [ 83.740234] niks3-server[1108]: 2026/09/20 08:05:05 INFO Received uploads request method=POST path=/api/pending_closures5458worker1 # [ 83.715249] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.093Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5459worker1 # [ 83.716747] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.095Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5460lb # [ 83.777510] niks3-server[1108]: 2026/09/20 08:05:05 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5461lb # [ 83.783527] niks3-server[1108]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5462lb # [ 83.791870] niks3-server[1108]: 2026/09/20 08:05:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5463worker1 # [ 83.766520] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.145Z level=INFO msg="Uploading 1 narinfos"5464lb # [ 83.796148] niks3-server[1108]: 2026/09/20 08:05:06 INFO Signed narinfos id=28 count=15465lb # [ 83.801269] niks3-server[1108]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5466lb # [ 83.810638] niks3-server[1108]: 2026/09/20 08:05:06 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5467lb # [ 83.815819] niks3-server[1108]: 2026/09/20 08:05:06 INFO Completed upload id=285468lb # [ 83.817580] niks3-server[1108]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5469worker1 # [ 83.787804] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.166Z level=INFO msg="Upload complete. (254ms)"5470worker1 # [ 83.796886] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15471worker1 # [ 83.804406] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05472worker1 # [ 83.808369] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15473worker1 # [ 83.816652] nix-daemon[905]: reaped child process 1368, status = succeeded5474worker1 # [ 83.848080] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565475worker1 # [ 83.859797] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457565476worker1 # [ 83.872695] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.251Z level=INFO msg="All 2 paths already cached"5477client # copying 1 paths to 'lb:50051'...5478client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5479worker1 # [ 83.880619] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457565480worker1 # [ 83.888871] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5481worker1 # [ 84.048859] nix-daemon[905]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5482worker1 # [ 84.062073] nix-daemon[905]: reaped child process 1397, status = succeeded5483worker1 # [ 84.220620] nix-daemon[905]: accepted connection from pid 1399, user nix-grpc-daemon (trusted)5484worker1 # [ 84.233256] nix-daemon[905]: reaped child process 1402, status = succeeded5485lb # [ 84.277594] niks3-server[1108]: 2026/09/20 08:05:06 INFO Received uploads request method=POST path=/api/pending_closures5486worker1 # [ 84.256063] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.634Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5487worker1 # [ 84.258096] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.636Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5488lb # [ 84.306187] niks3-server[1108]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5489lb # [ 84.321889] niks3-server[1108]: 2026/09/20 08:05:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5490worker1 # [ 84.297167] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.675Z level=INFO msg="Uploading 1 narinfos"5491lb # [ 84.327130] niks3-server[1108]: 2026/09/20 08:05:06 INFO Signed narinfos id=29 count=15492lb # [ 84.333551] niks3-server[1108]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5493lb # [ 84.343130] niks3-server[1108]: 2026/09/20 08:05:06 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5494lb # [ 84.350055] niks3-server[1108]: 2026/09/20 08:05:06 INFO Completed upload id=295495worker1 # [ 84.320752] nix-grpc-daemon[1309]: time=2026-09-20T08:05:05.699Z level=INFO msg="Upload complete. (419ms)"5496lb # [ 84.354845] niks3-server[1108]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5497worker1 # [ 84.325182] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=0 paths=1 nar_bytes_in=7685498worker1 # [ 84.330369] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565499worker1 # [ 84.338136] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5500worker1 # [ 84.345852] nix-daemon[905]: reaped child process 1392, status = succeeded5501worker1 # [ 84.350956] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5502client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5503client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5504worker1 # [ 85.163188] nix-daemon[905]: reaped child process 1406, status = succeeded5505client # farm-top> LOG-farm-top-on-standby5506worker1 # [ 85.284549] nix-daemon[905]: accepted connection from pid 1421, user nix-grpc-daemon (trusted)5507worker1 # [ 85.297506] nix-daemon[905]: reaped child process 1424, status = succeeded5508lb # [ 85.337757] niks3-server[1108]: 2026/09/20 08:05:07 INFO Received uploads request method=POST path=/api/pending_closures5509worker1 # [ 85.316301] nix-grpc-daemon[1309]: time=2026-09-20T08:05:06.694Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5510worker1 # [ 85.319250] nix-grpc-daemon[1309]: time=2026-09-20T08:05:06.696Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5511lb # [ 85.369907] niks3-server[1108]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5512lb # [ 85.381602] niks3-server[1108]: 2026/09/20 08:05:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5513lb # [ 85.389436] niks3-server[1108]: 2026/09/20 08:05:07 INFO Signed narinfos id=30 count=15514worker1 # [ 85.363712] nix-grpc-daemon[1309]: time=2026-09-20T08:05:06.742Z level=INFO msg="Uploading 1 narinfos"5515lb # [ 85.392730] niks3-server[1108]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5516lb # [ 85.398692] niks3-server[1108]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5517lb # [ 85.407229] niks3-server[1108]: 2026/09/20 08:05:07 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5518lb # [ 85.413485] niks3-server[1108]: 2026/09/20 08:05:07 INFO Completed upload id=305519worker1 # [ 85.384144] nix-grpc-daemon[1309]: time=2026-09-20T08:05:06.763Z level=INFO msg="Upload complete. (225ms)"5520lb # [ 85.416305] niks3-server[1108]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5521worker1 # [ 85.390143] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15522worker1 # [ 85.401488] nix-daemon[905]: reaped child process 1404, status = succeeded5523client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 6.50 seconds)5524client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5525client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.17 seconds)5526worker2 # [ 85.673330] systemd[1]: Listening on Nix worker-protocol over gRPC.5527worker2 # [ 85.676581] systemd[1]: Starting Nix worker-protocol over gRPC...5528worker2 # [ 85.826465] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5529worker2 # [ 85.829814] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15530worker2 # [ 85.836786] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5531worker2 # [ 85.838383] systemd[1]: Started Nix worker-protocol over gRPC.5532worker2 # [ 85.853955] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:07Z level=info event=scheduler_connected addr=lb:500515533lb: must succeed: curl -sf localhost:9901/clusters5534worker1 # [ 85.823848] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05535lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5536worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5537worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5538lb: must succeed: curl -sf localhost:9901/clusters5539lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5540lb: must succeed: curl -sf localhost:9901/clusters5541lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5542worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5543worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5544(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.98 seconds)5545subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5546client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5547client # [ 86.148431] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5548client # Running as unit: rs.service; invocation ID: d7b01ae97f1a49ba8a92a6f86af55ed85549client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5550worker2 # [ 86.351985] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:350445551worker2 # [ 86.363321] nix-daemon[907]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5552client # [ 86.379386] nix[1162]: don't know how to build these paths:5553client # [ 86.380306] nix[1162]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5554worker1 # [ 86.353524] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:07Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05555worker1 # [ 86.358670] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:07Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15556worker1 # [ 86.399909] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565557worker1 # [ 86.411790] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457565558client # [ 86.456156] nix[1162]: copying 1 paths to 'lb:50051'...5559worker1 # [ 86.421524] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457565560client # [ 86.459137] nix[1162]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5561worker1 # [ 86.434832] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5562worker1 # [ 86.603861] nix-daemon[905]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5563worker1 # [ 86.618145] nix-daemon[905]: reaped child process 1442, status = succeeded5564worker1 # [ 86.759374] nix-daemon[905]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5565worker1 # [ 86.772533] nix-daemon[905]: reaped child process 1447, status = succeeded5566lb # [ 86.817733] niks3-server[1108]: 2026/09/20 08:05:09 INFO Received uploads request method=POST path=/api/pending_closures5567worker1 # [ 86.797261] nix-grpc-daemon[1309]: time=2026-09-20T08:05:08.175Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5568worker1 # [ 86.798933] nix-grpc-daemon[1309]: time=2026-09-20T08:05:08.177Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5569lb # [ 86.850525] niks3-server[1108]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5570lb # [ 86.861134] niks3-server[1108]: 2026/09/20 08:05:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5571lb # [ 86.865672] niks3-server[1108]: 2026/09/20 08:05:09 INFO Signed narinfos id=31 count=15572worker1 # [ 86.838773] nix-grpc-daemon[1309]: time=2026-09-20T08:05:08.217Z level=INFO msg="Uploading 1 narinfos"5573lb # [ 86.870860] niks3-server[1108]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5574lb # [ 86.879487] niks3-server[1108]: 2026/09/20 08:05:09 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5575lb # [ 86.885304] niks3-server[1108]: 2026/09/20 08:05:09 INFO Completed upload id=315576worker1 # [ 86.856021] nix-grpc-daemon[1309]: time=2026-09-20T08:05:08.234Z level=INFO msg="Upload complete. (408ms)"5577lb # [ 86.887856] niks3-server[1108]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5578worker1 # [ 86.859340] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=0 paths=1 nar_bytes_in=4165579worker1 # [ 86.864243] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457565580worker1 # [ 86.871978] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5581worker1 # [ 86.877388] nix-daemon[905]: reaped child process 1437, status = succeeded5582worker1 # [ 86.883207] nix-daemon[905]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5583client # [ 86.917729] nix[1162]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5584lb # [ 88.216785] envoy[978]: conn peer=[2001:db8:1::1]:55470 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9421 tx=3812 ms=62495585lb: must succeed: curl -sf localhost:9901/clusters5586lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5587lb: must succeed: curl -sf localhost:9901/clusters5588lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5589lb: must succeed: curl -sf localhost:9901/clusters5590lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5591lb: must succeed: curl -sf localhost:9901/clusters5592lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5593worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5594worker2 # [ 88.940040] systemd-journald[286]: Received client request to rotate journal, rotating.5595worker2 # [ 88.950389] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/18dd7d17b8494735bb0d49204216b3e1.5596worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5597worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5598worker1 # [ 88.820203] systemd[1]: Stopping Nix worker-protocol over gRPC...5599worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5600client: must succeed: sleep 5.05601worker1 # [ 88.963332] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:10Z level=info event=draining5602client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5603worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5604worker1 # [ 94.103673] nix-daemon[905]: reaped child process 1451, status = succeeded5605worker1 # [ 94.243324] nix-daemon[905]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5606worker1 # [ 94.256256] nix-daemon[905]: reaped child process 1494, status = succeeded5607lb # [ 94.303585] niks3-server[1108]: 2026/09/20 08:05:16 INFO Received uploads request method=POST path=/api/pending_closures5608worker1 # [ 94.282487] nix-grpc-daemon[1309]: time=2026-09-20T08:05:15.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5609worker1 # [ 94.284050] nix-grpc-daemon[1309]: time=2026-09-20T08:05:15.662Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5610lb # [ 94.329831] niks3-server[1108]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5611lb # [ 94.332310] niks3-server[1108]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5612lb # [ 94.341711] niks3-server[1108]: 2026/09/20 08:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5613worker1 # [ 94.316784] nix-grpc-daemon[1309]: time=2026-09-20T08:05:15.695Z level=INFO msg="Uploading 1 narinfos"5614lb # [ 94.345936] niks3-server[1108]: 2026/09/20 08:05:16 INFO Signed narinfos id=32 count=15615lb # [ 94.351297] niks3-server[1108]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5616lb # [ 94.355347] niks3-server[1108]: 2026/09/20 08:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5617lb # [ 94.358666] niks3-server[1108]: 2026/09/20 08:05:16 INFO Completed upload id=325618worker1 # [ 94.329261] nix-grpc-daemon[1309]: time=2026-09-20T08:05:15.708Z level=INFO msg="Upload complete. (234ms)"5619lb # [ 94.361632] niks3-server[1108]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5620worker1 # [ 94.332931] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45756 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15621worker1 # [ 94.340640] nix-daemon[905]: reaped child process 1449, status = succeeded5622client # [ 94.404224] systemd[1]: rs.service: Deactivated successfully.5623client # [ 94.407076] systemd[1]: rs.service: Consumed 110ms CPU time over 8.255s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5624worker1 # [ 94.964768] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=signal_exit5625worker1 # [ 95.189087] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=scheduler_yield5626lb # [ 95.220456] niks3-server[1108]: 2026/09/20 08:05:17 INFO lead: released remote=192.168.1.3:553705627worker1 # [ 95.193282] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=scheduler_restarting addr=lb:500515628worker2 # [ 95.223370] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:16Z level=info event=scheduler_restarting addr=lb:500515629worker1 # [ 95.195185] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:457445630worker1 # [ 95.196532] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=worker_gone addr=192.168.1.4:500515631worker1 # [ 95.197776] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:457445632worker1 # [ 95.199130] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=worker_gone addr=192.168.1.3:500515633worker2 # [ 95.423663] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500515634worker1 # [ 95.397612] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=scheduler_connected addr=lb:500515635worker2 # [ 95.428960] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5636worker1 # [ 95.400841] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5637worker2 # [ 95.629570] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500515638worker1 # [ 95.597992] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=scheduler_connected addr=lb:500515639worker2 # [ 95.634044] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5640worker1 # [ 95.603839] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5641worker2 # [ 95.834763] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500515642worker2 # [ 95.838321] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5643worker1 # [ 95.804810] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500515644worker2 # [ 95.848634] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_take_over5645lb # [ 95.847144] niks3-server[1108]: 2026/09/20 08:05:18 INFO lead: acquired remote=192.168.1.4:480325646worker1 # [ 95.815578] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5647worker2 # [ 96.039312] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500515648worker2 # [ 96.043819] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05649worker1 # [ 96.016607] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500515650worker1 # [ 96.021949] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5651worker1 # [ 96.192371] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:17Z level=info event=scheduler_restarting5652worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.13 seconds)5653client: waiting for success: ! systemctl is-active rs5654worker1 # [ 96.217305] nix-daemon[905]: reaped child process 1300, status = succeeded5655worker1 # [ 96.233259] nix-grpc-daemon[1234]: ts=2026-09-20T08:05:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5656client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds)5657client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5658client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5659client: must fail: journalctl -u rs | grep -q 'reconnecting'5660client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5661lb: must succeed: curl -sf localhost:9901/clusters5662lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5663worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5664worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5665worker1 # [ 96.766254] nix-grpc-daemon[1234]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5666worker1 # [ 96.767724] nix-grpc-daemon[1234]: E0000 00:00:1789891518.144428 1277 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5667worker1 # [ 96.769602] nix-grpc-daemon[1234]: E0000 00:00:1789891518.144644 1277 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5668lb: must succeed: curl -sf localhost:9901/clusters5669lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5670worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5671worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5672worker1 # [ 97.968051] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5673worker1 # [ 97.969141] systemd[1]: Stopped Nix worker-protocol over gRPC.5674worker1 # [ 97.969951] systemd[1]: nix-grpc-daemon.service: Consumed 1.265s CPU time over 25.170s wall clock time, 33.5M memory peak, 44.8K incoming IP traffic, 83.2K outgoing IP traffic.5675worker1 # [ 97.980331] systemd[1]: Starting Nix worker-protocol over gRPC...5676worker1 # [ 98.125795] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5677worker1 # [ 98.127808] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15678worker1 # [ 98.133859] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5679worker1 # [ 98.135555] systemd[1]: Started Nix worker-protocol over gRPC.5680worker1 # [ 98.147085] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500515681worker2 # [ 98.180317] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05682lb # [ 98.216961] envoy[978]: conn peer=[2001:db8:1::1]:49568 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1332 ms=80275683lb # [ 98.218787] envoy[978]: conn peer=[2001:db8:1::3]:41842 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3777 tx=1100 ms=232605684lb: must succeed: curl -sf localhost:9901/clusters5685lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5686worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5687worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5688(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.57 seconds)5689subtest: scheduler restart mid-build: build finishes, no double build5690client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5691client # [ 98.723624] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5692client # Running as unit: mid.service; invocation ID: bf733b4a28194e68a6ac411e9f6ba7065693client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5694worker2 # [ 98.923389] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:350445695client # [ 98.931200] nix[1198]: don't know how to build these paths:5696client # [ 98.932155] nix[1198]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5697worker2 # [ 98.932534] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:20Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05698worker2 # [ 98.934695] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:20Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15699worker2 # [ 98.976748] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350445700worker2 # [ 98.983162] nix-grpc-daemon[1231]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5)5701worker2 # [ 98.988500] nix-grpc-daemon[1231]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5)5702worker2 # [ 99.150571] nix-grpc-daemon[1231]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 3/5)5703worker2 # [ 99.163271] nix-grpc-daemon[1231]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 412 ms (attempt 4/5)5704worker2 # [ 99.581536] nix-grpc-daemon[1231]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5705worker2 # [ 99.595052] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350445706client # [ 99.607159] nix[1198]: copying 1 paths to 'lb:50051'...5707worker2 # [ 99.603195] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350445708client # [ 99.609084] nix[1198]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5709worker2 # [ 99.613408] nix-daemon[907]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5710worker2 # [ 99.622666] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:21Z level=info event=niks3_push_started pid=13605711worker2 # [ 99.964710] nix-daemon[907]: accepted connection from pid 1373, user nix-grpc-daemon (trusted)5712worker2 # [ 99.977288] nix-daemon[907]: reaped child process 1380, status = succeeded5713worker2 # [ 100.153841] nix-daemon[907]: accepted connection from pid 1382, user nix-grpc-daemon (trusted)5714worker2 # [ 100.166208] nix-daemon[907]: reaped child process 1385, status = succeeded5715lb # [ 100.176786] niks3-server[1108]: 2026/09/20 08:05:22 INFO Received uploads request method=POST path=/api/pending_closures5716worker2 # [ 100.188329] nix-grpc-daemon[1360]: time=2026-09-20T08:05:21.955Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5717worker2 # [ 100.190753] nix-grpc-daemon[1360]: time=2026-09-20T08:05:21.957Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5718lb # [ 100.219861] niks3-server[1108]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5719lb # [ 100.226481] niks3-server[1108]: 2026/09/20 08:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5720lb # [ 100.232430] niks3-server[1108]: 2026/09/20 08:05:22 INFO Signed narinfos id=33 count=15721worker2 # [ 100.237654] nix-grpc-daemon[1360]: time=2026-09-20T08:05:22.004Z level=INFO msg="Uploading 1 narinfos"5722lb # [ 100.248262] niks3-server[1108]: 2026/09/20 08:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5723worker2 # [ 100.257196] nix-grpc-daemon[1360]: time=2026-09-20T08:05:22.024Z level=INFO msg="Upload complete. (461ms)"5724lb # [ 100.255989] niks3-server[1108]: 2026/09/20 08:05:22 INFO Completed upload id=335725worker2 # [ 100.260770] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35044 duration_s=0 paths=1 nar_bytes_in=4245726worker2 # [ 100.267277] nix-grpc-daemon[1360]: time=2026-09-20T08:05:22.032Z level=WARN msg="Failed to register uploaded object" key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo error="server returned 404: object is not pending upload\n"5727lb # [ 100.270450] niks3-server[1108]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5728worker2 # [ 100.271618] nix-grpc-daemon[1231]: ts=2026-09-20T08:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350445729worker2 # [ 100.278272] nix-daemon[907]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5730worker2 # [ 100.283218] nix-daemon[907]: reaped child process 1358, status = succeeded5731worker2 # [ 100.288301] nix-daemon[907]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5732client # [ 100.292732] nix[1198]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5733lb: must succeed: curl -sf localhost:9901/clusters5734lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5735lb: must succeed: curl -sf localhost:9901/clusters5736lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5737worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5738worker2 # [ 102.402932] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1231 (nix-grpc-daemon) on client request.5739worker2 # [ 102.406456] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5740worker1 # [ 102.383530] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5741lb # [ 102.413642] niks3-server[1108]: 2026/09/20 08:05:24 INFO lead: released remote=192.168.1.4:480325742client # [ 102.420396] nix[1198]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5743client # [ 102.425191] nix[1198]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5744worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5745client: must succeed: sleep 5.05746worker2 # [ 102.442338] nix-daemon[907]: reaped child process 1387, status = succeeded5747worker2 # [ 102.443694] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5748worker2 # [ 102.446193] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5749worker2 # [ 102.448225] nix-daemon[907]: reaped child process 1289, status = succeeded5750worker2 # [ 102.449363] systemd[1]: nix-grpc-daemon.service: Consumed 382ms CPU time over 16.764s wall clock time, 30.8M memory peak, 14.6K incoming IP traffic, 22.6K outgoing IP traffic.5751worker2 # [ 102.458287] nix-daemon[1389]: unexpected Nix daemon error: error: interrupted by the user5752worker2 # [ 102.463836] nix-daemon[907]: reaped child process 1389, status = failed with exit code 15753worker1 # [ 102.583897] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500515754worker2 # [ 102.618814] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5755worker2 # [ 102.628192] systemd[1]: Starting Nix worker-protocol over gRPC...5756worker2 # [ 102.792475] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5757worker2 # [ 102.796255] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15758worker2 # [ 102.802825] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5759worker2 # [ 102.804402] systemd[1]: Started Nix worker-protocol over gRPC.5760lb # [ 102.810591] niks3-server[1108]: 2026/09/20 08:05:25 INFO lead: acquired remote=192.168.1.4:376345761worker2 # [ 102.814238] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=info event=scheduler_take_over5762worker1 # [ 102.784919] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5763worker2 # [ 102.817989] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500515764worker2 # [ 102.819587] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05765worker2 # [ 102.929219] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05766worker2 # [ 102.934843] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15767worker2 # [ 102.981690] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:522045768worker2 # [ 102.992165] nix-daemon[907]: accepted connection from pid 1425, user nix-grpc-daemon (trusted)5769worker2 # [ 103.006360] nix-daemon[907]: accepted connection from pid 1425, user nix-grpc-daemon (trusted)5770worker1 # [ 102.985426] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500515771worker2 # [ 103.018210] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05772client # [ 103.032217] nix[1198]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5773worker2 # [ 103.032089] nix-daemon[907]: accepted connection from pid 1425, user nix-grpc-daemon (trusted)5774client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5775client: waiting for success: ! systemctl is-active mid5776worker2 # [ 107.848907] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:29Z level=info event=niks3_push_started pid=15045777worker2 # [ 107.878715] nix-daemon[907]: reaped child process 1480, status = succeeded5778worker2 # [ 108.179297] nix-daemon[907]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5779worker2 # [ 108.192367] nix-daemon[907]: reaped child process 1520, status = succeeded5780lb # [ 108.202051] niks3-server[1108]: 2026/09/20 08:05:30 INFO Received uploads request method=POST path=/api/pending_closures5781worker2 # [ 108.209256] nix-grpc-daemon[1504]: time=2026-09-20T08:05:29.976Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5782worker2 # [ 108.211066] nix-grpc-daemon[1504]: time=2026-09-20T08:05:29.977Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5783lb # [ 108.217876] envoy[978]: conn peer=[2001:db8:1::4]:53532 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1366 tx=468 ms=165635784lb # [ 108.232172] niks3-server[1108]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5785lb # [ 108.238919] niks3-server[1108]: 2026/09/20 08:05:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5786lb # [ 108.242591] niks3-server[1108]: 2026/09/20 08:05:30 INFO Signed narinfos id=34 count=15787worker2 # [ 108.246657] nix-grpc-daemon[1504]: time=2026-09-20T08:05:30.013Z level=INFO msg="Uploading 1 narinfos"5788lb # [ 108.245918] niks3-server[1108]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5789lb # [ 108.250621] niks3-server[1108]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5790lb # [ 108.256178] niks3-server[1108]: 2026/09/20 08:05:30 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5791lb # [ 108.259963] niks3-server[1108]: 2026/09/20 08:05:30 INFO Completed upload id=345792worker2 # [ 108.262162] nix-grpc-daemon[1504]: time=2026-09-20T08:05:30.029Z level=INFO msg="Upload complete. (230ms)"5793lb # [ 108.263317] niks3-server[1108]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5794worker2 # [ 108.267367] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52204 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15795worker2 # [ 108.273965] nix-daemon[907]: reaped child process 1478, status = succeeded5796client # [ 108.296820] systemd[1]: mid.service: Deactivated successfully.5797client # [ 108.298574] systemd[1]: mid.service: Consumed 120ms CPU time over 9.576s wall clock time, 37.3M memory peak, 9.8K incoming IP traffic, 10.7K outgoing IP traffic.5798client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds)5799client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5800client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5801(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.13 seconds)5802subtest: interrupting the client stops the build on the worker5803client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5804client # [ 108.838887] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5805client # Running as unit: intr.service; invocation ID: cbec391e55ab4e2b8b434b30a4e621175806client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5807client # [ 109.035381] nix[1234]: don't know how to build these paths:5808worker2 # [ 109.029350] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:522045809client # [ 109.037224] nix[1234]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5810worker2 # [ 109.040923] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:30Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05811worker2 # [ 109.045301] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:30Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15812worker1 # [ 109.061751] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392385813worker1 # [ 109.070712] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5814worker1 # [ 109.083378] nix-grpc-daemon[1501]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5)5815worker1 # [ 109.098949] nix-grpc-daemon[1501]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 2/5)5816worker1 # [ 109.178976] nix-grpc-daemon[1501]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 210 ms (attempt 3/5)5817worker1 # [ 109.392883] nix-grpc-daemon[1501]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 4/5)5818worker1 # [ 109.408980] nix-grpc-daemon[1501]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5819worker1 # [ 109.423581] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392385820client # [ 109.467263] nix[1234]: copying 1 paths to 'lb:50051'...5821worker1 # [ 109.436342] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392385822client # [ 109.472175] nix[1234]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5823worker1 # [ 109.445116] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5824worker1 # [ 109.461261] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:30Z level=info event=niks3_push_started pid=15895825worker1 # [ 109.804570] nix-daemon[905]: accepted connection from pid 1602, user nix-grpc-daemon (trusted)5826worker1 # [ 109.820111] nix-daemon[905]: reaped child process 1605, status = succeeded5827worker1 # [ 110.001552] nix-daemon[905]: accepted connection from pid 1607, user nix-grpc-daemon (trusted)5828worker1 # [ 110.016521] nix-daemon[905]: reaped child process 1614, status = succeeded5829lb # [ 110.062450] niks3-server[1108]: 2026/09/20 08:05:32 INFO Received uploads request method=POST path=/api/pending_closures5830worker1 # [ 110.041451] nix-grpc-daemon[1589]: time=2026-09-20T08:05:31.418Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5831worker1 # [ 110.042994] nix-grpc-daemon[1589]: time=2026-09-20T08:05:31.418Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5832lb # [ 110.093694] niks3-server[1108]: 2026/09/20 08:05:32 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5833lb # [ 110.096214] niks3-server[1108]: 2026/09/20 08:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5834lb # [ 110.099134] niks3-server[1108]: 2026/09/20 08:05:32 INFO Signed narinfos id=35 count=15835worker1 # [ 110.072236] nix-grpc-daemon[1589]: time=2026-09-20T08:05:31.450Z level=INFO msg="Uploading 1 narinfos"5836lb # [ 110.109533] niks3-server[1108]: 2026/09/20 08:05:32 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5837lb # [ 110.113887] niks3-server[1108]: 2026/09/20 08:05:32 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5838lb # [ 110.118488] niks3-server[1108]: 2026/09/20 08:05:32 INFO Completed upload id=355839worker1 # [ 110.089098] nix-grpc-daemon[1589]: time=2026-09-20T08:05:31.467Z level=INFO msg="Upload complete. (447ms)"5840worker1 # [ 110.092407] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=4245841worker1 # [ 110.095833] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392385842worker1 # [ 110.099110] nix-grpc-daemon[1589]: time=2026-09-20T08:05:31.476Z level=WARN msg="Failed to register uploaded object" key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo error="server returned 404: object is not pending upload\n"5843worker1 # [ 110.107655] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5844worker1 # [ 110.110324] nix-daemon[905]: reaped child process 1587, status = succeeded5845client # [ 110.151886] nix[1234]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5846worker1 # [ 110.116527] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5847client: must succeed: systemctl kill -s INT intr5848client # [ 111.231752] systemd[1]: intr.service: Sent signal SIGINT to main process 1234 (nix) on client request.5849worker1 # [ 111.198453] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:32Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5850client # [ 111.235537] nix[1234]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5851client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds)5852client # [ 111.240807] nix[1234]: error: interrupted by the user5853client # [ 111.271272] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5854client # [ 111.272961] systemd[1]: intr.service: Failed with result 'exit-code'.5855client # [ 111.275284] systemd[1]: intr.service: Consumed 126ms CPU time over 2.435s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5856worker1 # [ 111.337633] nix-daemon[905]: reaped child process 1616, status = succeeded5857worker1 # [ 111.342390] nix-daemon[1618]: unexpected Nix daemon error: error: interrupted by the user5858worker1 # [ 111.347617] nix-daemon[905]: reaped child process 1618, status = failed with exit code 15859(finished: subtest: interrupting the client stops the build on the worker, in 3.64 seconds)5860subtest: a deploy mid-build drains: the build finishes, the new generation takes over5861client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5862client # [ 112.485585] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5863client # Running as unit: sw.service; invocation ID: 21bd2c6328e444649cf132fa582a71525864client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5865client # [ 112.714249] nix[1254]: don't know how to build these paths:5866worker2 # [ 112.708890] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:522045867client # [ 112.715286] nix[1254]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5868worker2 # [ 112.720806] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:34Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05869worker2 # [ 112.723902] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:34Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15870worker2 # [ 112.765061] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:522045871worker2 # [ 112.772582] nix-grpc-daemon[1425]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5)5872worker2 # [ 112.812985] nix-grpc-daemon[1425]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 2/5)5873worker2 # [ 112.888563] nix-grpc-daemon[1425]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 3/5)5874worker2 # [ 113.027813] nix-grpc-daemon[1425]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 514 ms (attempt 4/5)5875worker2 # [ 113.545464] nix-grpc-daemon[1425]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5876worker2 # [ 113.559286] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:522045877client # [ 113.572122] nix[1254]: copying 1 paths to 'lb:50051'...5878worker2 # [ 113.568660] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:522045879client # [ 113.573953] nix[1254]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5880worker2 # [ 113.577057] nix-daemon[907]: accepted connection from pid 1425, user nix-grpc-daemon (trusted)5881worker2 # [ 113.769135] nix-daemon[907]: accepted connection from pid 1555, user nix-grpc-daemon (trusted)5882worker2 # [ 113.786676] nix-daemon[907]: reaped child process 1562, status = succeeded5883worker2 # [ 113.949175] nix-daemon[907]: accepted connection from pid 1564, user nix-grpc-daemon (trusted)5884worker2 # [ 113.964220] nix-daemon[907]: reaped child process 1567, status = succeeded5885lb # [ 113.970890] niks3-server[1108]: 2026/09/20 08:05:36 INFO Received uploads request method=POST path=/api/pending_closures5886worker2 # [ 113.982688] nix-grpc-daemon[1504]: time=2026-09-20T08:05:35.748Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5887worker2 # [ 113.984233] nix-grpc-daemon[1504]: time=2026-09-20T08:05:35.749Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5888lb # [ 113.999081] niks3-server[1108]: 2026/09/20 08:05:36 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5889lb # [ 114.001542] niks3-server[1108]: 2026/09/20 08:05:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5890lb # [ 114.004606] niks3-server[1108]: 2026/09/20 08:05:36 INFO Signed narinfos id=36 count=15891worker2 # [ 114.008703] nix-grpc-daemon[1504]: time=2026-09-20T08:05:35.775Z level=INFO msg="Uploading 1 narinfos"5892lb # [ 114.015159] niks3-server[1108]: 2026/09/20 08:05:36 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5893lb # [ 114.020750] niks3-server[1108]: 2026/09/20 08:05:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5894lb # [ 114.024150] niks3-server[1108]: 2026/09/20 08:05:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5895lb # [ 114.029660] niks3-server[1108]: 2026/09/20 08:05:36 INFO Completed upload id=365896worker2 # [ 114.031778] nix-grpc-daemon[1504]: time=2026-09-20T08:05:35.798Z level=INFO msg="Upload complete. (447ms)"5897worker2 # [ 114.035414] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52204 duration_s=0 paths=1 nar_bytes_in=4165898worker2 # [ 114.038498] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:522045899worker2 # [ 114.049065] nix-daemon[907]: accepted connection from pid 1425, user nix-grpc-daemon (trusted)5900worker2 # [ 114.051808] nix-daemon[907]: reaped child process 1553, status = succeeded5901client # [ 114.062808] nix[1254]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5902worker2 # [ 114.058939] nix-daemon[907]: accepted connection from pid 1425, user nix-grpc-daemon (trusted)5903worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25904worker2 # Checking switch inhibitors... done5905worker2 # [ 116.686299] nixos[1602]: switching to system configuration /nix/store/5b0jnp4s12lkrp1p488h19rpqmjis2zq-nixos-system-worker2-test5906worker2 # [ 116.689856] systemd[1]: Stopped target Remote File Systems.5907worker2 # activating the configuration...5908worker2 # [ 116.692320] systemd[1]: Stopped target Local File Systems.5909worker2 # setting up /etc...5910worker2 # [ 117.388670] systemd[1]: Reload requested from client PID 1602 ('.switch-to-conf') (unit backdoor.service)...5911worker2 # [ 117.390401] systemd[1]: Reloading...5912worker2 # [ 118.090283] systemd[1]: Reloading finished in 697 ms.5913worker2 # restarting sysinit-reactivation.target5914worker2 # [ 118.147597] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5915lb # [ 118.218362] envoy[978]: conn peer=[2001:db8:1::1]:45188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1637 ms=93515916lb # [ 118.220692] envoy[978]: conn peer=[2001:db8:1::1]:48090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=730 ms=22205917worker2 # [ 118.269397] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5918worker2 # [ 118.271552] systemd[1]: Reached target Reactivate sysinit units.5919worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5920worker2 # [ 118.276420] dbus-broker-launch[579]: Caught SIGHUP, trigger reload.5921worker2 # [ 118.278397] systemd[1]: Reloading D-Bus System Message Bus...5922worker2 # [ 118.282047] systemd[1]: Reloading Nix worker-protocol over gRPC...5923worker2 # [ 118.310792] dbus-broker-launch[579]: Looking up NSS user entry for 'systemd-timesync'...5924worker2 # [ 118.313421] dbus-broker-launch[579]: NSS returned no entry for 'systemd-timesync'5925worker2 # [ 118.314410] dbus-broker-launch[579]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5926worker2 # [ 118.325427] systemd[1]: Reloaded Nix worker-protocol over gRPC.5927worker2 # [ 118.344652] systemd[1]: Reloaded D-Bus System Message Bus.5928worker2 # [ 118.351986] systemd[1]: Reached target Remote File Systems.5929worker2 # [ 118.358066] systemd[1]: Starting linger-users.service...5930worker2 # [ 118.364859] systemd[1]: Reached target Local File Systems.5931worker2 # [ 118.368371] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5932worker2 # [ 118.369657] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5933worker2 # [ 118.375203] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5934worker2 # [ 118.382549] systemd[1]: Starting Create SUID/SGID Wrappers...5935worker2 # [ 118.383593] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5936worker2 # [ 118.384809] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675937worker2 # [ 118.387421] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5938worker2 # [ 118.389226] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5939worker2 # [ 118.392331] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5940worker2 # [ 118.432424] systemd[1]: linger-users.service: Deactivated successfully.5941worker2 # [ 118.433407] systemd[1]: Finished linger-users.service.5942worker2 # [ 118.780500] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5943worker2 # [ 118.785144] systemd[1]: Finished Create SUID/SGID Wrappers.5944worker2 # [ 118.807665] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:40Z level=info event=draining5945worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5946worker2 # [ 119.038960] nixos[1602]: finished switching to system configuration /nix/store/5b0jnp4s12lkrp1p488h19rpqmjis2zq-nixos-system-worker2-test5947worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.03 seconds)5948worker2: must succeed: pgrep -f 'read -t [9]0 x'5949worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5950client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25951client # don't know how to build these paths:5952client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5953worker1 # [ 119.272465] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:392385954worker2 # [ 119.313568] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:41Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05955worker2 # [ 119.315346] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:41Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15956worker1 # [ 119.326681] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392385957worker1 # [ 119.335636] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392385958client # copying 1 paths to 'lb:50051'...5959worker1 # [ 119.343402] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392385960client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5961worker1 # [ 119.354058] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5962worker1 # [ 119.501147] nix-daemon[905]: accepted connection from pid 1668, user nix-grpc-daemon (trusted)5963worker1 # [ 119.516070] nix-daemon[905]: reaped child process 1671, status = succeeded5964worker1 # [ 119.661304] nix-daemon[905]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)5965worker1 # [ 119.676900] nix-daemon[905]: reaped child process 1676, status = succeeded5966lb # [ 119.720091] niks3-server[1108]: 2026/09/20 08:05:41 INFO Received uploads request method=POST path=/api/pending_closures5967worker1 # [ 119.698091] nix-grpc-daemon[1589]: time=2026-09-20T08:05:41.076Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5968worker1 # [ 119.699702] nix-grpc-daemon[1589]: time=2026-09-20T08:05:41.076Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5969lb # [ 119.737545] niks3-server[1108]: 2026/09/20 08:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5970lb # [ 119.740376] niks3-server[1108]: 2026/09/20 08:05:41 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5971lb # [ 119.742763] niks3-server[1108]: 2026/09/20 08:05:41 INFO Signed narinfos id=37 count=15972worker1 # [ 119.713251] nix-grpc-daemon[1589]: time=2026-09-20T08:05:41.091Z level=INFO msg="Uploading 1 narinfos"5973lb # [ 119.746036] niks3-server[1108]: 2026/09/20 08:05:41 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5974lb # [ 119.750704] niks3-server[1108]: 2026/09/20 08:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5975lb # [ 119.753850] niks3-server[1108]: 2026/09/20 08:05:41 INFO Completed upload id=375976worker1 # [ 119.724447] nix-grpc-daemon[1589]: time=2026-09-20T08:05:41.103Z level=INFO msg="Upload complete. (364ms)"5977lb # [ 119.756889] niks3-server[1108]: 2026/09/20 08:05:41 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5978worker1 # [ 119.727073] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=5285979worker1 # [ 119.729893] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392385980worker1 # [ 119.739463] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5981worker1 # [ 119.741379] nix-daemon[905]: reaped child process 1666, status = succeeded5982worker1 # [ 119.746926] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5983client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5984client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5985client # farm-a> LOG-farm-a-during-drain5986worker1 # [ 121.177946] nix-daemon[905]: reaped child process 1680, status = succeeded5987worker1 # [ 121.322668] nix-daemon[905]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)5988worker1 # [ 121.338562] nix-daemon[905]: reaped child process 1698, status = succeeded5989lb # [ 121.381522] niks3-server[1108]: 2026/09/20 08:05:43 INFO Received uploads request method=POST path=/api/pending_closures5990worker1 # [ 121.366617] nix-grpc-daemon[1589]: time=2026-09-20T08:05:42.745Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5991worker1 # [ 121.371474] nix-grpc-daemon[1589]: time=2026-09-20T08:05:42.747Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5992lb # [ 121.414338] niks3-server[1108]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5993lb # [ 121.422620] niks3-server[1108]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5994lb # [ 121.427797] niks3-server[1108]: 2026/09/20 08:05:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5995lb # [ 121.430933] niks3-server[1108]: 2026/09/20 08:05:43 INFO Signed narinfos id=38 count=15996worker1 # [ 121.402267] nix-grpc-daemon[1589]: time=2026-09-20T08:05:42.780Z level=INFO msg="Uploading 1 narinfos"5997lb # [ 121.432609] niks3-server[1108]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5998lb # [ 121.438609] niks3-server[1108]: 2026/09/20 08:05:43 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5999lb # [ 121.441272] niks3-server[1108]: 2026/09/20 08:05:43 INFO Completed upload id=386000worker1 # [ 121.411843] nix-grpc-daemon[1589]: time=2026-09-20T08:05:42.790Z level=INFO msg="Upload complete. (255ms)"6001lb # [ 121.444361] niks3-server[1108]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6002worker1 # [ 121.414541] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16003worker1 # [ 121.422270] nix-daemon[905]: reaped child process 1678, status = succeeded6004worker2 # [ 121.453122] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:43Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06005worker2 # [ 121.454915] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:43Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16006worker1 # [ 121.465143] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386007worker1 # [ 121.475405] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386008worker1 # [ 121.486137] nix-grpc-daemon[1589]: time=2026-09-20T08:05:42.864Z level=INFO msg="All 1 paths already cached"6009client # copying 1 paths to 'lb:50051'...6010client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6011worker1 # [ 121.495164] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386012worker1 # [ 121.506305] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6013worker1 # [ 121.657164] nix-daemon[905]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)6014worker1 # [ 121.671658] nix-daemon[905]: reaped child process 1705, status = succeeded6015worker1 # [ 121.795913] nix-daemon[905]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)6016worker1 # [ 121.809871] nix-daemon[905]: reaped child process 1710, status = succeeded6017lb # [ 121.849258] niks3-server[1108]: 2026/09/20 08:05:44 INFO Received uploads request method=POST path=/api/pending_closures6018worker1 # [ 121.825070] nix-grpc-daemon[1589]: time=2026-09-20T08:05:43.203Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6019worker1 # [ 121.826544] nix-grpc-daemon[1589]: time=2026-09-20T08:05:43.205Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6020lb # [ 121.867938] niks3-server[1108]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6021lb # [ 121.875579] niks3-server[1108]: 2026/09/20 08:05:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6022lb # [ 121.879600] niks3-server[1108]: 2026/09/20 08:05:44 INFO Signed narinfos id=39 count=16023worker1 # [ 121.850348] nix-grpc-daemon[1589]: time=2026-09-20T08:05:43.229Z level=INFO msg="Uploading 1 narinfos"6024lb # [ 121.881865] niks3-server[1108]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6025lb # [ 121.889471] niks3-server[1108]: 2026/09/20 08:05:44 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6026lb # [ 121.897144] niks3-server[1108]: 2026/09/20 08:05:44 INFO Completed upload id=396027lb # [ 121.898688] niks3-server[1108]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6028worker1 # [ 121.867666] nix-grpc-daemon[1589]: time=2026-09-20T08:05:43.246Z level=INFO msg="Upload complete. (350ms)"6029worker1 # [ 121.870858] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=6406030worker1 # [ 121.873302] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386031worker1 # [ 121.880240] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6032worker1 # [ 121.883476] nix-daemon[905]: reaped child process 1700, status = succeeded6033client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6034client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6035worker1 # [ 121.889037] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6036client # farm-b> LOG-farm-b-during-drain6037worker1 # [ 122.506354] nix-daemon[905]: reaped child process 1714, status = succeeded6038worker1 # [ 122.635377] nix-daemon[905]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)6039worker1 # [ 122.651855] nix-daemon[905]: reaped child process 1732, status = succeeded6040lb # [ 122.692814] niks3-server[1108]: 2026/09/20 08:05:44 INFO Received uploads request method=POST path=/api/pending_closures6041worker1 # [ 122.668281] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.046Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6042worker1 # [ 122.670965] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.048Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6043lb # [ 122.724778] niks3-server[1108]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6044lb # [ 122.736138] niks3-server[1108]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6045lb # [ 122.743718] niks3-server[1108]: 2026/09/20 08:05:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6046worker1 # [ 122.719826] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.098Z level=INFO msg="Uploading 1 narinfos"6047lb # [ 122.749442] niks3-server[1108]: 2026/09/20 08:05:44 INFO Signed narinfos id=40 count=16048lb # [ 122.753484] niks3-server[1108]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6049lb # [ 122.765603] niks3-server[1108]: 2026/09/20 08:05:44 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6050lb # [ 122.768852] niks3-server[1108]: 2026/09/20 08:05:44 INFO Completed upload id=406051lb # [ 122.770850] niks3-server[1108]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6052worker1 # [ 122.740762] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.119Z level=INFO msg="Upload complete. (244ms)"6053worker1 # [ 122.744762] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16054worker2 # [ 122.780480] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:44Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06055worker2 # [ 122.783269] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:44Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16056worker1 # [ 122.757136] nix-daemon[905]: reaped child process 1712, status = succeeded6057worker1 # [ 122.793205] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386058worker1 # [ 122.808128] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386059worker1 # [ 122.840736] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.219Z level=INFO msg="All 2 paths already cached"6060client # copying 1 paths to 'lb:50051'...6061worker1 # [ 122.848674] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386062client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6063worker1 # [ 122.868194] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6064worker1 # [ 123.039040] nix-daemon[905]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6065worker1 # [ 123.054507] nix-daemon[905]: reaped child process 1739, status = succeeded6066worker1 # [ 123.215645] nix-daemon[905]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)6067worker1 # [ 123.232078] nix-daemon[905]: reaped child process 1744, status = succeeded6068lb # [ 123.273679] niks3-server[1108]: 2026/09/20 08:05:45 INFO Received uploads request method=POST path=/api/pending_closures6069worker1 # [ 123.252350] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.631Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6070worker1 # [ 123.255284] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.633Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6071lb # [ 123.302295] niks3-server[1108]: 2026/09/20 08:05:45 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6072lb # [ 123.313605] niks3-server[1108]: 2026/09/20 08:05:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6073worker1 # [ 123.291626] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.670Z level=INFO msg="Uploading 1 narinfos"6074lb # [ 123.320586] niks3-server[1108]: 2026/09/20 08:05:45 INFO Signed narinfos id=41 count=16075lb # [ 123.333487] niks3-server[1108]: 2026/09/20 08:05:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6076lb # [ 123.337089] niks3-server[1108]: 2026/09/20 08:05:45 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6077worker1 # [ 123.315365] nix-grpc-daemon[1589]: time=2026-09-20T08:05:44.694Z level=INFO msg="Upload complete. (434ms)"6078lb # [ 123.344803] niks3-server[1108]: 2026/09/20 08:05:45 INFO Completed upload id=416079worker1 # [ 123.317982] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=7686080lb # [ 123.348450] niks3-server[1108]: 2026/09/20 08:05:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6081worker1 # [ 123.325594] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386082worker1 # [ 123.330745] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6083worker1 # [ 123.333746] nix-daemon[905]: reaped child process 1734, status = succeeded6084client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6085worker1 # [ 123.340125] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6086client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6087client # farm-top> LOG-farm-top-during-drain6088worker1 # [ 124.358398] nix-daemon[905]: reaped child process 1748, status = succeeded6089worker1 # [ 124.491845] nix-daemon[905]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)6090worker1 # [ 124.506655] nix-daemon[905]: reaped child process 1766, status = succeeded6091lb # [ 124.549125] niks3-server[1108]: 2026/09/20 08:05:46 INFO Received uploads request method=POST path=/api/pending_closures6092worker1 # [ 124.539199] nix-grpc-daemon[1589]: time=2026-09-20T08:05:45.917Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6093worker1 # [ 124.542060] nix-grpc-daemon[1589]: time=2026-09-20T08:05:45.919Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6094lb # [ 124.589688] niks3-server[1108]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6095lb # [ 124.598977] niks3-server[1108]: 2026/09/20 08:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6096lb # [ 124.602308] niks3-server[1108]: 2026/09/20 08:05:46 INFO Signed narinfos id=42 count=16097worker1 # [ 124.572844] nix-grpc-daemon[1589]: time=2026-09-20T08:05:45.951Z level=INFO msg="Uploading 1 narinfos"6098lb # [ 124.605822] niks3-server[1108]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6099lb # [ 124.613310] niks3-server[1108]: 2026/09/20 08:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6100lb # [ 124.618630] niks3-server[1108]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6101lb # [ 124.622117] niks3-server[1108]: 2026/09/20 08:05:46 INFO Completed upload id=426102lb # [ 124.623951] niks3-server[1108]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6103worker1 # [ 124.595544] nix-grpc-daemon[1589]: time=2026-09-20T08:05:45.973Z level=INFO msg="Upload complete. (246ms)"6104worker1 # [ 124.597609] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16105worker1 # [ 124.605113] nix-daemon[905]: reaped child process 1746, status = succeeded6106client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 5.57 seconds)6107client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6108client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6109worker2: must succeed: pkill -f 'read -t [9]0 x'6110worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6111client: waiting for success: ! systemctl is-active sw6112worker2 # [ 125.091481] nix-daemon[907]: reaped child process 1571, status = succeeded6113worker2 # [ 125.207799] nix-daemon[907]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)6114worker2 # [ 125.221989] nix-daemon[907]: reaped child process 1751, status = succeeded6115lb # [ 125.228384] niks3-server[1108]: 2026/09/20 08:05:47 INFO Received uploads request method=POST path=/api/pending_closures6116worker2 # [ 125.236585] nix-grpc-daemon[1504]: time=2026-09-20T08:05:47.003Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6117worker2 # [ 125.238540] nix-grpc-daemon[1504]: time=2026-09-20T08:05:47.005Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6118lb # [ 125.255496] niks3-server[1108]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6119lb # [ 125.258682] niks3-server[1108]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6120lb # [ 125.264065] niks3-server[1108]: 2026/09/20 08:05:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6121lb # [ 125.267551] niks3-server[1108]: 2026/09/20 08:05:47 INFO Signed narinfos id=43 count=16122worker2 # [ 125.269788] nix-grpc-daemon[1504]: time=2026-09-20T08:05:47.036Z level=INFO msg="Uploading 1 narinfos"6123lb # [ 125.271571] niks3-server[1108]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6124lb # [ 125.279982] niks3-server[1108]: 2026/09/20 08:05:47 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6125lb # [ 125.283114] niks3-server[1108]: 2026/09/20 08:05:47 INFO Completed upload id=436126worker2 # [ 125.286550] nix-grpc-daemon[1504]: time=2026-09-20T08:05:47.053Z level=INFO msg="Upload complete. (205ms)"6127lb # [ 125.285110] niks3-server[1108]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6128worker2 # [ 125.290208] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52204 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16129worker2 # [ 125.297452] nix-daemon[907]: reaped child process 1569, status = succeeded6130client # [ 125.335914] systemd[1]: sw.service: Deactivated successfully.6131client # [ 125.340129] systemd[1]: sw.service: Consumed 144ms CPU time over 12.853s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.6132worker2 # [ 125.809439] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=signal_exit6133worker2 # [ 125.834731] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=scheduler_yield6134lb # [ 125.836399] niks3-server[1108]: 2026/09/20 08:05:48 INFO lead: released remote=192.168.1.4:376346135worker1 # [ 125.808171] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:47Z level=info event=scheduler_restarting addr=lb:500516136worker2 # [ 125.843268] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:333186137worker2 # [ 125.847195] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=worker_gone addr=192.168.1.3:500516138worker2 # [ 125.849147] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=scheduler_restarting addr=lb:500516139worker2 # [ 125.850903] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:333186140worker2 # [ 125.852858] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=worker_gone addr=192.168.1.4:500516141client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6142client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6143client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6144worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6145worker1 # [ 126.008667] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:47Z level=info event=scheduler_connected addr=lb:500516146worker2 # [ 126.049591] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=scheduler_connected addr=lb:500516147worker1 # [ 126.019377] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6148worker2 # [ 126.062724] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6149worker1 # [ 126.220416] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:47Z level=info event=scheduler_connected addr=lb:500516150worker1 # [ 126.224324] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6151worker2 # [ 126.263569] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500516152worker2 # [ 126.268676] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6153worker1 # [ 126.425163] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:47Z level=info event=scheduler_connected addr=lb:500516154worker1 # [ 126.428820] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6155worker2 # [ 126.469703] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500516156worker2 # [ 126.471845] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6157worker1 # [ 126.629710] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500516158worker1 # [ 126.632859] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6159worker2 # [ 126.672706] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500516160worker2 # [ 126.677379] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6161worker2 # [ 126.835929] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=scheduler_restarting6162worker1 # [ 126.834595] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:48Z level=info event=scheduler_connected addr=lb:500516163worker2 # [ 126.866872] nix-grpc-daemon[1425]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6164worker2 # [ 126.868428] nix-grpc-daemon[1425]: E0000 00:00:1789891548.633883 1468 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6165worker2 # [ 126.883927] nix-grpc-daemon[1425]: ts=2026-09-20T08:05:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6166worker2 # [ 126.919669] nix-grpc-daemon[1425]: E0000 00:00:1789891548.686318 1468 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true6167worker2 # [ 126.922891] nix-grpc-daemon[1425]: E0000 00:00:1789891548.686618 1468 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6168worker2 # [ 126.947411] nix-daemon[907]: reaped child process 1476, status = succeeded6169lb # [ 128.173151] niks3-server[1108]: 2026/09/20 08:05:50 INFO lead: acquired remote=192.168.1.3:521486170worker1 # [ 128.144169] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:49Z level=info event=scheduler_take_over6171lb # [ 128.218395] envoy[978]: conn peer=[2001:db8:1::1]:54186 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9485 tx=3781 ms=53366172lb # [ 128.220529] envoy[978]: conn peer=[2001:db8:1::1]:48098 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1376 ms=125966173lb # [ 128.222457] envoy[978]: conn peer=[2001:db8:1::4]:49264 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1721 tx=529 ms=240636174worker1 # [ 128.802201] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"6175worker2 # [ 128.852934] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6176worker2 # [ 128.858476] systemd[1]: nix-grpc-daemon.service: Consumed 718ms CPU time over 26.410s wall clock time, 31M memory peak, 23.8K incoming IP traffic, 32.5K outgoing IP traffic.6177worker2 # [ 128.882480] systemd[1]: Starting Nix worker-protocol over gRPC...6178worker1 # [ 129.003097] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:50Z level=info event=scheduler_connected addr=lb:500516179worker1 # [ 129.006094] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06180worker2 # [ 129.049287] nix-grpc-daemon[1765]: ts=2026-09-20T08:05:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6181worker2 # [ 129.052790] nix-grpc-daemon[1765]: ts=2026-09-20T08:05:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16182worker2 # [ 129.059721] nix-grpc-daemon[1765]: ts=2026-09-20T08:05:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6183worker2 # [ 129.061360] systemd[1]: Started Nix worker-protocol over gRPC.6184worker2 # [ 129.076228] nix-grpc-daemon[1765]: ts=2026-09-20T08:05:50Z level=info event=scheduler_connected addr=lb:500516185worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.05 seconds)6186worker1 # [ 129.045533] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06187lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6188lb: must succeed: curl -sf localhost:9901/clusters6189lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6190lb: must succeed: curl -sf localhost:9901/clusters6191lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6192lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds)6193lb: must succeed: curl -sf localhost:9901/clusters6194lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6195worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6196worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)6197(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.83 seconds)6198subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6199client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16200worker2 # [ 130.501699] nix-grpc-daemon[1765]: ts=2026-09-20T08:05:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:531326201worker2 # [ 130.513361] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6202worker1 # [ 130.503216] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:51Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06203worker1 # [ 130.505306] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:51Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16204worker1 # [ 130.507463] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:51Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06205worker1 # [ 130.509343] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:51Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06206worker1 # [ 130.546084] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386207worker1 # [ 130.554864] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386208worker1 # [ 130.561627] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386209worker1 # [ 130.568105] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6210worker1 # [ 130.722638] nix-daemon[905]: accepted connection from pid 1777, user nix-grpc-daemon (trusted)6211worker1 # [ 130.737867] nix-daemon[905]: reaped child process 1780, status = succeeded6212worker1 # [ 130.884195] nix-daemon[905]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)6213worker1 # [ 130.898941] nix-daemon[905]: reaped child process 1785, status = succeeded6214lb # [ 130.944139] niks3-server[1108]: 2026/09/20 08:05:53 INFO Received uploads request method=POST path=/api/pending_closures6215worker1 # [ 130.921182] nix-grpc-daemon[1589]: time=2026-09-20T08:05:52.299Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6216worker1 # [ 130.922709] nix-grpc-daemon[1589]: time=2026-09-20T08:05:52.299Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6217lb # [ 130.959053] niks3-server[1108]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6218lb # [ 130.963056] niks3-server[1108]: 2026/09/20 08:05:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6219lb # [ 130.964880] niks3-server[1108]: 2026/09/20 08:05:53 INFO Signed narinfos id=44 count=16220worker1 # [ 130.936899] nix-grpc-daemon[1589]: time=2026-09-20T08:05:52.315Z level=INFO msg="Uploading 1 narinfos"6221lb # [ 130.969132] niks3-server[1108]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6222lb # [ 130.973147] niks3-server[1108]: 2026/09/20 08:05:53 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6223lb # [ 130.976437] niks3-server[1108]: 2026/09/20 08:05:53 INFO Completed upload id=446224worker1 # [ 130.946992] nix-grpc-daemon[1589]: time=2026-09-20T08:05:52.325Z level=INFO msg="Upload complete. (373ms)"6225lb # [ 130.979211] niks3-server[1108]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6226worker1 # [ 130.949298] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=5046227worker1 # [ 130.952337] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386228worker1 # [ 130.958259] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6229worker1 # [ 130.964570] nix-daemon[905]: reaped child process 1775, status = succeeded6230worker1 # [ 130.969132] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6231worker1 # [ 131.785608] nix-daemon[905]: reaped child process 1789, status = succeeded6232worker1 # [ 131.942216] nix-daemon[905]: accepted connection from pid 1804, user nix-grpc-daemon (trusted)6233worker1 # [ 131.956977] nix-daemon[905]: reaped child process 1807, status = succeeded6234lb # [ 131.997671] niks3-server[1108]: 2026/09/20 08:05:54 INFO Received uploads request method=POST path=/api/pending_closures6235worker1 # [ 131.973557] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.352Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6236worker1 # [ 131.975616] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.353Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6237lb # [ 132.024645] niks3-server[1108]: 2026/09/20 08:05:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6238worker1 # [ 132.000443] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.379Z level=INFO msg="Uploading 1 narinfos"6239lb # [ 132.030317] niks3-server[1108]: 2026/09/20 08:05:54 INFO Signed narinfos id=45 count=16240lb # [ 132.034914] niks3-server[1108]: 2026/09/20 08:05:54 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6241lb # [ 132.040196] niks3-server[1108]: 2026/09/20 08:05:54 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6242lb # [ 132.047807] niks3-server[1108]: 2026/09/20 08:05:54 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6243lb # [ 132.053545] niks3-server[1108]: 2026/09/20 08:05:54 INFO Completed upload id=456244worker1 # [ 132.024128] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.402Z level=INFO msg="Upload complete. (248ms)"6245lb # [ 132.055140] niks3-server[1108]: 2026/09/20 08:05:54 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6246worker1 # [ 132.027504] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16247lb # [ 132.060923] niks3-server[1108]: 2026/09/20 08:05:54 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6248worker1 # [ 132.034888] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16249worker1 # [ 132.038265] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06250worker1 # [ 132.044521] nix-daemon[905]: reaped child process 1787, status = succeeded6251worker1 # [ 132.077407] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386252worker1 # [ 132.085136] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386253worker1 # [ 132.091757] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386254worker1 # [ 132.095989] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6255worker1 # [ 132.284237] nix-daemon[905]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)6256worker1 # [ 132.300743] nix-daemon[905]: reaped child process 1816, status = succeeded6257worker1 # [ 132.475253] nix-daemon[905]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6258worker1 # [ 132.498738] nix-daemon[905]: reaped child process 1821, status = succeeded6259lb # [ 132.543528] niks3-server[1108]: 2026/09/20 08:05:54 INFO Received uploads request method=POST path=/api/pending_closures6260worker1 # [ 132.522429] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.901Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6261worker1 # [ 132.524569] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.903Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6262lb # [ 132.571067] niks3-server[1108]: 2026/09/20 08:05:54 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6263lb # [ 132.579317] niks3-server[1108]: 2026/09/20 08:05:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6264lb # [ 132.582672] niks3-server[1108]: 2026/09/20 08:05:54 INFO Signed narinfos id=46 count=16265worker1 # [ 132.553551] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.932Z level=INFO msg="Uploading 1 narinfos"6266lb # [ 132.586861] niks3-server[1108]: 2026/09/20 08:05:54 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6267lb # [ 132.596548] niks3-server[1108]: 2026/09/20 08:05:54 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6268lb # [ 132.602758] niks3-server[1108]: 2026/09/20 08:05:54 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6269lb # [ 132.607065] niks3-server[1108]: 2026/09/20 08:05:54 INFO Completed upload id=466270worker1 # [ 132.577776] nix-grpc-daemon[1589]: time=2026-09-20T08:05:53.956Z level=INFO msg="Upload complete. (474ms)"6271worker1 # [ 132.582132] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=5046272worker1 # [ 132.585767] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386273worker1 # [ 132.593606] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6274worker1 # [ 132.601775] nix-daemon[905]: reaped child process 1811, status = succeeded6275worker1 # [ 132.610140] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6276worker1 # [ 133.237852] nix-daemon[905]: reaped child process 1825, status = succeeded6277worker1 # [ 133.376245] nix-daemon[905]: accepted connection from pid 1840, user nix-grpc-daemon (trusted)6278worker1 # [ 133.392427] nix-daemon[905]: reaped child process 1843, status = succeeded6279lb # [ 133.435925] niks3-server[1108]: 2026/09/20 08:05:55 INFO Received uploads request method=POST path=/api/pending_closures6280worker1 # [ 133.415782] nix-grpc-daemon[1589]: time=2026-09-20T08:05:54.794Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6281worker1 # [ 133.419604] nix-grpc-daemon[1589]: time=2026-09-20T08:05:54.796Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6282lb # [ 133.486390] niks3-server[1108]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6283lb # [ 133.492385] niks3-server[1108]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6284lb # [ 133.502283] niks3-server[1108]: 2026/09/20 08:05:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6285worker1 # [ 133.480750] nix-grpc-daemon[1589]: time=2026-09-20T08:05:54.859Z level=INFO msg="Uploading 1 narinfos"6286lb # [ 133.509612] niks3-server[1108]: 2026/09/20 08:05:55 INFO Signed narinfos id=47 count=16287lb # [ 133.513896] niks3-server[1108]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6288lb # [ 133.526490] niks3-server[1108]: 2026/09/20 08:05:55 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6289lb # [ 133.530221] niks3-server[1108]: 2026/09/20 08:05:55 INFO Completed upload id=476290worker1 # [ 133.500984] nix-grpc-daemon[1589]: time=2026-09-20T08:05:54.879Z level=INFO msg="Upload complete. (280ms)"6291lb # [ 133.532503] niks3-server[1108]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6292worker1 # [ 133.505462] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16293worker1 # [ 133.509894] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:54Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16294worker1 # [ 133.513372] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386295worker1 # [ 133.516167] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:54Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06296worker1 # [ 133.523487] nix-daemon[905]: reaped child process 1823, status = succeeded6297worker1 # [ 133.525098] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386298worker1 # [ 133.532948] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386299worker1 # [ 133.537531] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6300worker1 # [ 133.691612] nix-daemon[905]: accepted connection from pid 1849, user nix-grpc-daemon (trusted)6301worker1 # [ 133.707729] nix-daemon[905]: reaped child process 1852, status = succeeded6302worker1 # [ 133.861975] nix-daemon[905]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6303worker1 # [ 133.877246] nix-daemon[905]: reaped child process 1857, status = succeeded6304lb # [ 133.919279] niks3-server[1108]: 2026/09/20 08:05:56 INFO Received uploads request method=POST path=/api/pending_closures6305worker1 # [ 133.896976] nix-grpc-daemon[1589]: time=2026-09-20T08:05:55.275Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6306worker1 # [ 133.898662] nix-grpc-daemon[1589]: time=2026-09-20T08:05:55.277Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6307lb # [ 133.946370] niks3-server[1108]: 2026/09/20 08:05:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6308lb # [ 133.951424] niks3-server[1108]: 2026/09/20 08:05:56 INFO Signed narinfos id=48 count=16309worker1 # [ 133.922277] nix-grpc-daemon[1589]: time=2026-09-20T08:05:55.300Z level=INFO msg="Uploading 1 narinfos"6310lb # [ 133.955523] niks3-server[1108]: 2026/09/20 08:05:56 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6311lb # [ 133.959354] niks3-server[1108]: 2026/09/20 08:05:56 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6312lb # [ 133.969050] niks3-server[1108]: 2026/09/20 08:05:56 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6313lb # [ 133.973599] niks3-server[1108]: 2026/09/20 08:05:56 INFO Completed upload id=486314worker1 # [ 133.944293] nix-grpc-daemon[1589]: time=2026-09-20T08:05:55.323Z level=INFO msg="Upload complete. (399ms)"6315lb # [ 133.976634] niks3-server[1108]: 2026/09/20 08:05:56 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6316worker1 # [ 133.947920] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=5046317worker1 # [ 133.950774] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386318worker1 # [ 133.956337] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6319worker1 # [ 133.963745] nix-daemon[905]: reaped child process 1847, status = succeeded6320worker1 # [ 133.968840] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6321worker1 # [ 135.393346] nix-daemon[905]: reaped child process 1861, status = succeeded6322worker1 # [ 135.530694] nix-daemon[905]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)6323worker1 # [ 135.546906] nix-daemon[905]: reaped child process 1879, status = succeeded6324lb # [ 135.589929] niks3-server[1108]: 2026/09/20 08:05:57 INFO Received uploads request method=POST path=/api/pending_closures6325worker1 # [ 135.567373] nix-grpc-daemon[1589]: time=2026-09-20T08:05:56.945Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6326worker1 # [ 135.571114] nix-grpc-daemon[1589]: time=2026-09-20T08:05:56.948Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6327lb # [ 135.618797] niks3-server[1108]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6328lb # [ 135.623645] niks3-server[1108]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6329lb # [ 135.626357] niks3-server[1108]: 2026/09/20 08:05:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6330lb # [ 135.629036] niks3-server[1108]: 2026/09/20 08:05:57 INFO Signed narinfos id=49 count=16331worker1 # [ 135.601590] nix-grpc-daemon[1589]: time=2026-09-20T08:05:56.980Z level=INFO msg="Uploading 1 narinfos"6332lb # [ 135.634683] niks3-server[1108]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6333lb # [ 135.643185] niks3-server[1108]: 2026/09/20 08:05:57 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6334lb # [ 135.647875] niks3-server[1108]: 2026/09/20 08:05:57 INFO Completed upload id=496335worker1 # [ 135.618494] nix-grpc-daemon[1589]: time=2026-09-20T08:05:56.997Z level=INFO msg="Upload complete. (240ms)"6336lb # [ 135.651767] niks3-server[1108]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6337worker1 # [ 135.622880] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16338worker1 # [ 135.628853] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:57Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16339worker1 # [ 135.631948] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386340worker1 # [ 135.636345] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:57Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06341worker1 # [ 135.644044] nix-daemon[905]: reaped child process 1859, status = succeeded6342worker1 # [ 135.646287] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386343worker1 # [ 135.654460] nix-grpc-daemon[1589]: time=2026-09-20T08:05:57.033Z level=INFO msg="All 1 paths already cached"6344worker1 # [ 135.660901] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386345worker1 # [ 135.667122] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6346worker1 # [ 135.859561] nix-daemon[905]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)6347worker1 # [ 135.878866] nix-daemon[905]: reaped child process 1888, status = succeeded6348worker1 # [ 136.028683] nix-daemon[905]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)6349worker1 # [ 136.046166] nix-daemon[905]: reaped child process 1893, status = succeeded6350lb # [ 136.088384] niks3-server[1108]: 2026/09/20 08:05:58 INFO Received uploads request method=POST path=/api/pending_closures6351worker1 # [ 136.068529] nix-grpc-daemon[1589]: time=2026-09-20T08:05:57.447Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6352worker1 # [ 136.070514] nix-grpc-daemon[1589]: time=2026-09-20T08:05:57.449Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6353lb # [ 136.122711] niks3-server[1108]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6354lb # [ 136.137396] niks3-server[1108]: 2026/09/20 08:05:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6355lb # [ 136.143816] niks3-server[1108]: 2026/09/20 08:05:58 INFO Signed narinfos id=50 count=16356worker1 # [ 136.120468] nix-grpc-daemon[1589]: time=2026-09-20T08:05:57.499Z level=INFO msg="Uploading 1 narinfos"6357lb # [ 136.152517] niks3-server[1108]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6358lb # [ 136.167376] niks3-server[1108]: 2026/09/20 08:05:58 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6359worker1 # [ 136.143710] nix-grpc-daemon[1589]: time=2026-09-20T08:05:57.522Z level=INFO msg="Upload complete. (469ms)"6360lb # [ 136.173453] niks3-server[1108]: 2026/09/20 08:05:58 INFO Completed upload id=506361lb # [ 136.177062] niks3-server[1108]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6362worker1 # [ 136.147098] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=6246363worker1 # [ 136.150557] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386364worker1 # [ 136.157372] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6365worker1 # [ 136.161158] nix-daemon[905]: reaped child process 1883, status = succeeded6366worker1 # [ 136.168548] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6367worker1 # [ 137.189758] nix-daemon[905]: reaped child process 1897, status = succeeded6368worker1 # [ 137.362146] nix-daemon[905]: accepted connection from pid 1912, user nix-grpc-daemon (trusted)6369worker1 # [ 137.379879] nix-daemon[905]: reaped child process 1915, status = succeeded6370lb # [ 137.421804] niks3-server[1108]: 2026/09/20 08:05:59 INFO Received uploads request method=POST path=/api/pending_closures6371worker1 # [ 137.398294] nix-grpc-daemon[1589]: time=2026-09-20T08:05:58.776Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6372worker1 # [ 137.405284] nix-grpc-daemon[1589]: time=2026-09-20T08:05:58.778Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6373lb # [ 137.448668] niks3-server[1108]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6374lb # [ 137.453232] niks3-server[1108]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6375lb # [ 137.457754] niks3-server[1108]: 2026/09/20 08:05:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6376lb # [ 137.459650] niks3-server[1108]: 2026/09/20 08:05:59 INFO Signed narinfos id=51 count=16377worker1 # [ 137.432080] nix-grpc-daemon[1589]: time=2026-09-20T08:05:58.810Z level=INFO msg="Uploading 1 narinfos"6378lb # [ 137.463963] niks3-server[1108]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6379lb # [ 137.470337] niks3-server[1108]: 2026/09/20 08:05:59 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6380lb # [ 137.473992] niks3-server[1108]: 2026/09/20 08:05:59 INFO Completed upload id=516381worker1 # [ 137.444841] nix-grpc-daemon[1589]: time=2026-09-20T08:05:58.823Z level=INFO msg="Upload complete. (268ms)"6382lb # [ 137.475648] niks3-server[1108]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6383worker1 # [ 137.453668] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16384worker1 # [ 137.458343] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:58Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16385worker1 # [ 137.460767] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386386worker1 # [ 137.462799] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:58Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06387worker1 # [ 137.473566] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386388worker1 # [ 137.476919] nix-daemon[905]: reaped child process 1895, status = succeeded6389worker1 # [ 137.482058] nix-grpc-daemon[1589]: time=2026-09-20T08:05:58.860Z level=INFO msg="All 1 paths already cached"6390worker1 # [ 137.487724] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386391worker1 # [ 137.495118] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6392worker1 # [ 137.655460] nix-daemon[905]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)6393worker1 # [ 137.673117] nix-daemon[905]: reaped child process 1924, status = succeeded6394worker1 # [ 137.848136] nix-daemon[905]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)6395worker1 # [ 137.864435] nix-daemon[905]: reaped child process 1929, status = succeeded6396lb # [ 137.908863] niks3-server[1108]: 2026/09/20 08:06:00 INFO Received uploads request method=POST path=/api/pending_closures6397worker1 # [ 137.886206] nix-grpc-daemon[1589]: time=2026-09-20T08:05:59.265Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6398worker1 # [ 137.888934] nix-grpc-daemon[1589]: time=2026-09-20T08:05:59.267Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6399lb # [ 137.936513] niks3-server[1108]: 2026/09/20 08:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6400lb # [ 137.941450] niks3-server[1108]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6401worker1 # [ 137.917841] nix-grpc-daemon[1589]: time=2026-09-20T08:05:59.296Z level=INFO msg="Uploading 1 narinfos"6402lb # [ 137.946967] niks3-server[1108]: 2026/09/20 08:06:00 INFO Signed narinfos id=52 count=16403lb # [ 137.951600] niks3-server[1108]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6404lb # [ 137.960750] niks3-server[1108]: 2026/09/20 08:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6405lb # [ 137.964360] niks3-server[1108]: 2026/09/20 08:06:00 INFO Completed upload id=526406worker1 # [ 137.934995] nix-grpc-daemon[1589]: time=2026-09-20T08:05:59.313Z level=INFO msg="Upload complete. (431ms)"6407lb # [ 137.967954] niks3-server[1108]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6408worker1 # [ 137.938094] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=6246409worker1 # [ 137.941268] nix-grpc-daemon[1501]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386410worker1 # [ 137.949376] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6411worker1 # [ 137.952535] nix-daemon[905]: reaped child process 1919, status = succeeded6412worker1 # [ 137.959272] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6413worker1 # [ 138.977383] nix-daemon[905]: reaped child process 1933, status = succeeded6414worker1 # [ 139.155588] nix-daemon[905]: accepted connection from pid 1948, user nix-grpc-daemon (trusted)6415worker1 # [ 139.171983] nix-daemon[905]: reaped child process 1951, status = succeeded6416lb # [ 139.215679] niks3-server[1108]: 2026/09/20 08:06:01 INFO Received uploads request method=POST path=/api/pending_closures6417worker1 # [ 139.194933] nix-grpc-daemon[1589]: time=2026-09-20T08:06:00.573Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6418worker1 # [ 139.198081] nix-grpc-daemon[1589]: time=2026-09-20T08:06:00.575Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6419lb # [ 139.261181] niks3-server[1108]: 2026/09/20 08:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6420worker1 # [ 139.239767] nix-grpc-daemon[1589]: time=2026-09-20T08:06:00.618Z level=INFO msg="Uploading 1 narinfos"6421lb # [ 139.268874] niks3-server[1108]: 2026/09/20 08:06:01 INFO Signed narinfos id=53 count=16422lb # [ 139.282554] niks3-server[1108]: 2026/09/20 08:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6423lb # [ 139.287148] niks3-server[1108]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6424lb # [ 139.294719] niks3-server[1108]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6425lb # [ 139.300538] niks3-server[1108]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6426lb # [ 139.302377] niks3-server[1108]: 2026/09/20 08:06:01 INFO Completed upload id=536427worker1 # [ 139.273100] nix-grpc-daemon[1589]: time=2026-09-20T08:06:00.651Z level=INFO msg="Upload complete. (305ms)"6428lb # [ 139.308105] niks3-server[1108]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6429worker1 # [ 139.283277] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16430worker1 # [ 139.289567] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:00Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16431worker1 # [ 139.295452] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386432worker1 # [ 139.298783] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:00Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06433worker1 # [ 139.308065] nix-daemon[905]: reaped child process 1931, status = succeeded6434worker1 # [ 139.309926] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386435worker1 # [ 139.318747] nix-grpc-daemon[1589]: time=2026-09-20T08:06:00.697Z level=INFO msg="All 1 paths already cached"6436worker1 # [ 139.323723] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386437worker1 # [ 139.329488] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6438worker1 # [ 139.513254] nix-daemon[905]: accepted connection from pid 1957, user nix-grpc-daemon (trusted)6439worker1 # [ 139.538856] nix-daemon[905]: reaped child process 1960, status = succeeded6440worker1 # [ 139.692367] nix-daemon[905]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)6441worker1 # [ 139.708800] nix-daemon[905]: reaped child process 1965, status = succeeded6442lb # [ 139.749821] niks3-server[1108]: 2026/09/20 08:06:01 INFO Received uploads request method=POST path=/api/pending_closures6443worker1 # [ 139.725051] nix-grpc-daemon[1589]: time=2026-09-20T08:06:01.103Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6444worker1 # [ 139.726751] nix-grpc-daemon[1589]: time=2026-09-20T08:06:01.105Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6445lb # [ 139.768914] niks3-server[1108]: 2026/09/20 08:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6446lb # [ 139.771687] niks3-server[1108]: 2026/09/20 08:06:01 INFO Signed narinfos id=54 count=16447worker1 # [ 139.742638] nix-grpc-daemon[1589]: time=2026-09-20T08:06:01.121Z level=INFO msg="Uploading 1 narinfos"6448lb # [ 139.776310] niks3-server[1108]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6449lb # [ 139.778723] niks3-server[1108]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6450lb # [ 139.783827] niks3-server[1108]: 2026/09/20 08:06:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6451lb # [ 139.786926] niks3-server[1108]: 2026/09/20 08:06:02 INFO Completed upload id=546452worker1 # [ 139.757570] nix-grpc-daemon[1589]: time=2026-09-20T08:06:01.136Z level=INFO msg="Upload complete. (420ms)"6453lb # [ 139.789896] niks3-server[1108]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6454worker1 # [ 139.760093] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=6246455worker1 # [ 139.763188] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386456worker1 # [ 139.772955] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6457worker1 # [ 139.775193] nix-daemon[905]: reaped child process 1955, status = succeeded6458worker1 # [ 139.781481] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6459worker1 # [ 140.801793] nix-daemon[905]: reaped child process 1969, status = succeeded6460worker1 # [ 140.939300] nix-daemon[905]: accepted connection from pid 1984, user nix-grpc-daemon (trusted)6461worker1 # [ 140.954907] nix-daemon[905]: reaped child process 1987, status = succeeded6462lb # [ 140.996930] niks3-server[1108]: 2026/09/20 08:06:03 INFO Received uploads request method=POST path=/api/pending_closures6463worker1 # [ 140.973846] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.352Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6464worker1 # [ 140.978343] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.354Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6465lb # [ 141.029358] niks3-server[1108]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6466lb # [ 141.037806] niks3-server[1108]: 2026/09/20 08:06:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6467lb # [ 141.040956] niks3-server[1108]: 2026/09/20 08:06:03 INFO Signed narinfos id=55 count=16468worker1 # [ 141.013701] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.392Z level=INFO msg="Uploading 1 narinfos"6469lb # [ 141.048475] niks3-server[1108]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6470lb # [ 141.055399] niks3-server[1108]: 2026/09/20 08:06:03 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6471lb # [ 141.076350] niks3-server[1108]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6472lb # [ 141.081808] niks3-server[1108]: 2026/09/20 08:06:03 INFO Completed upload id=556473worker1 # [ 141.052442] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.431Z level=INFO msg="Upload complete. (262ms)"6474lb # [ 141.086121] niks3-server[1108]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6475worker1 # [ 141.057210] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16476worker1 # [ 141.061247] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16477worker1 # [ 141.063889] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386478worker1 # [ 141.071581] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06479worker1 # [ 141.074616] nix-daemon[905]: reaped child process 1967, status = succeeded6480worker1 # [ 141.104777] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386481worker1 # [ 141.114280] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.493Z level=INFO msg="All 2 paths already cached"6482worker1 # [ 141.121164] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386483worker1 # [ 141.130231] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6484worker1 # [ 141.269767] nix-daemon[905]: accepted connection from pid 1993, user nix-grpc-daemon (trusted)6485worker1 # [ 141.285283] nix-daemon[905]: reaped child process 1996, status = succeeded6486worker1 # [ 141.421101] nix-daemon[905]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)6487worker1 # [ 141.434576] nix-daemon[905]: reaped child process 2001, status = succeeded6488lb # [ 141.475751] niks3-server[1108]: 2026/09/20 08:06:03 INFO Received uploads request method=POST path=/api/pending_closures6489worker1 # [ 141.451740] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.830Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6490worker1 # [ 141.453594] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.832Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6491lb # [ 141.496438] niks3-server[1108]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6492lb # [ 141.503578] niks3-server[1108]: 2026/09/20 08:06:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6493lb # [ 141.506634] niks3-server[1108]: 2026/09/20 08:06:03 INFO Signed narinfos id=56 count=16494worker1 # [ 141.477133] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.855Z level=INFO msg="Uploading 1 narinfos"6495lb # [ 141.510649] niks3-server[1108]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6496lb # [ 141.516783] niks3-server[1108]: 2026/09/20 08:06:03 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6497lb # [ 141.521378] niks3-server[1108]: 2026/09/20 08:06:03 INFO Completed upload id=566498worker1 # [ 141.493613] nix-grpc-daemon[1589]: time=2026-09-20T08:06:02.872Z level=INFO msg="Upload complete. (357ms)"6499worker1 # [ 141.496335] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=7526500lb # [ 141.527899] niks3-server[1108]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6501worker1 # [ 141.501773] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386502worker1 # [ 141.511253] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6503worker1 # [ 141.513242] nix-daemon[905]: reaped child process 1991, status = succeeded6504worker1 # [ 141.520113] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6505worker1 # [ 142.543886] nix-daemon[905]: reaped child process 2005, status = succeeded6506worker1 # [ 142.674568] nix-daemon[905]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)6507worker1 # [ 142.691302] nix-daemon[905]: reaped child process 2023, status = succeeded6508lb # [ 142.731352] niks3-server[1108]: 2026/09/20 08:06:04 INFO Received uploads request method=POST path=/api/pending_closures6509worker1 # [ 142.721059] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.099Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6510worker1 # [ 142.724104] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.101Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6511lb # [ 142.777361] niks3-server[1108]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6512lb # [ 142.792898] niks3-server[1108]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6513lb # [ 142.801798] niks3-server[1108]: 2026/09/20 08:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6514worker1 # [ 142.778041] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.156Z level=INFO msg="Uploading 1 narinfos"6515lb # [ 142.807094] niks3-server[1108]: 2026/09/20 08:06:05 INFO Signed narinfos id=57 count=16516lb # [ 142.814388] niks3-server[1108]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6517lb # [ 142.823936] niks3-server[1108]: 2026/09/20 08:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6518lb # [ 142.827653] niks3-server[1108]: 2026/09/20 08:06:05 INFO Completed upload id=576519worker1 # [ 142.798198] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.176Z level=INFO msg="Upload complete. (268ms)"6520lb # [ 142.829320] niks3-server[1108]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6521worker1 # [ 142.801427] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16522worker1 # [ 142.805417] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:04Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16523worker1 # [ 142.812161] nix-daemon[905]: reaped child process 2003, status = succeeded6524worker1 # [ 142.848950] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386525worker1 # [ 142.858297] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386526worker1 # [ 142.870505] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.249Z level=INFO msg="All 2 paths already cached"6527worker1 # [ 142.876588] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386528worker1 # [ 142.882919] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6529worker1 # [ 143.026708] nix-daemon[905]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)6530worker1 # [ 143.041592] nix-daemon[905]: reaped child process 2030, status = succeeded6531worker1 # [ 143.178250] nix-daemon[905]: accepted connection from pid 2032, user nix-grpc-daemon (trusted)6532worker1 # [ 143.193448] nix-daemon[905]: reaped child process 2035, status = succeeded6533lb # [ 143.232822] niks3-server[1108]: 2026/09/20 08:06:05 INFO Received uploads request method=POST path=/api/pending_closures6534worker1 # [ 143.209461] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.587Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6535worker1 # [ 143.210989] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.588Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6536lb # [ 143.251283] niks3-server[1108]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6537lb # [ 143.253323] niks3-server[1108]: 2026/09/20 08:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6538lb # [ 143.255570] niks3-server[1108]: 2026/09/20 08:06:05 INFO Signed narinfos id=58 count=16539worker1 # [ 143.228066] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.606Z level=INFO msg="Uploading 1 narinfos"6540lb # [ 143.264120] niks3-server[1108]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6541lb # [ 143.270499] niks3-server[1108]: 2026/09/20 08:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6542lb # [ 143.274507] niks3-server[1108]: 2026/09/20 08:06:05 INFO Completed upload id=586543worker1 # [ 143.245175] nix-grpc-daemon[1589]: time=2026-09-20T08:06:04.624Z level=INFO msg="Upload complete. (355ms)"6544lb # [ 143.276246] niks3-server[1108]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6545worker1 # [ 143.248078] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=7526546worker1 # [ 143.251153] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386547worker1 # [ 143.257496] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6548worker1 # [ 143.262653] nix-daemon[905]: reaped child process 2025, status = succeeded6549worker1 # [ 143.268977] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6550worker1 # [ 144.485713] nix-daemon[905]: reaped child process 2039, status = succeeded6551worker1 # [ 144.608620] nix-daemon[905]: accepted connection from pid 2054, user nix-grpc-daemon (trusted)6552worker1 # [ 144.622477] nix-daemon[905]: reaped child process 2057, status = succeeded6553lb # [ 144.663605] niks3-server[1108]: 2026/09/20 08:06:06 INFO Received uploads request method=POST path=/api/pending_closures6554worker1 # [ 144.638919] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.017Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6555worker1 # [ 144.642078] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.019Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6556lb # [ 144.685902] niks3-server[1108]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6557lb # [ 144.698513] niks3-server[1108]: 2026/09/20 08:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6558worker1 # [ 144.673886] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.052Z level=INFO msg="Uploading 1 narinfos"6559lb # [ 144.703426] niks3-server[1108]: 2026/09/20 08:06:06 INFO Signed narinfos id=59 count=16560lb # [ 144.709149] niks3-server[1108]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6561lb # [ 144.716892] niks3-server[1108]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6562lb # [ 144.722030] niks3-server[1108]: 2026/09/20 08:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6563lb # [ 144.725025] niks3-server[1108]: 2026/09/20 08:06:06 INFO Completed upload id=596564worker1 # [ 144.695727] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.074Z level=INFO msg="Upload complete. (220ms)"6565lb # [ 144.728227] niks3-server[1108]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6566worker1 # [ 144.700376] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16567worker1 # [ 144.703187] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:06Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16568worker1 # [ 144.709431] nix-daemon[905]: reaped child process 2037, status = succeeded6569worker1 # [ 144.743796] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386570worker1 # [ 144.751447] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:392386571worker1 # [ 144.758611] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.137Z level=INFO msg="All 2 paths already cached"6572worker1 # [ 144.762751] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:392386573worker1 # [ 144.768080] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6574worker1 # [ 144.901837] nix-daemon[905]: accepted connection from pid 2061, user nix-grpc-daemon (trusted)6575worker1 # [ 144.917584] nix-daemon[905]: reaped child process 2064, status = succeeded6576worker1 # [ 145.073669] nix-daemon[905]: accepted connection from pid 2066, user nix-grpc-daemon (trusted)6577worker1 # [ 145.091342] nix-daemon[905]: reaped child process 2069, status = succeeded6578lb # [ 145.131266] niks3-server[1108]: 2026/09/20 08:06:07 INFO Received uploads request method=POST path=/api/pending_closures6579worker1 # [ 145.106208] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.485Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6580worker1 # [ 145.108456] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.486Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6581lb # [ 145.147503] niks3-server[1108]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6582lb # [ 145.152570] niks3-server[1108]: 2026/09/20 08:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6583lb # [ 145.154869] niks3-server[1108]: 2026/09/20 08:06:07 INFO Signed narinfos id=60 count=16584worker1 # [ 145.125709] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.504Z level=INFO msg="Uploading 1 narinfos"6585lb # [ 145.158331] niks3-server[1108]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6586lb # [ 145.163451] niks3-server[1108]: 2026/09/20 08:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6587lb # [ 145.166514] niks3-server[1108]: 2026/09/20 08:06:07 INFO Completed upload id=606588worker1 # [ 145.137272] nix-grpc-daemon[1589]: time=2026-09-20T08:06:06.516Z level=INFO msg="Upload complete. (363ms)"6589lb # [ 145.169140] niks3-server[1108]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6590worker1 # [ 145.141112] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=0 paths=1 nar_bytes_in=7526591worker1 # [ 145.144507] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:392386592worker1 # [ 145.153082] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6593worker1 # [ 145.162182] nix-daemon[905]: reaped child process 2059, status = succeeded6594worker1 # [ 145.168467] nix-daemon[905]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6595worker1 # [ 146.391904] nix-daemon[905]: reaped child process 2073, status = succeeded6596worker1 # [ 146.517670] nix-daemon[905]: accepted connection from pid 2088, user nix-grpc-daemon (trusted)6597worker1 # [ 146.533347] nix-daemon[905]: reaped child process 2091, status = succeeded6598lb # [ 146.572715] niks3-server[1108]: 2026/09/20 08:06:08 INFO Received uploads request method=POST path=/api/pending_closures6599worker1 # [ 146.548207] nix-grpc-daemon[1589]: time=2026-09-20T08:06:07.926Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6600worker1 # [ 146.551367] nix-grpc-daemon[1589]: time=2026-09-20T08:06:07.928Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6601lb # [ 146.591245] niks3-server[1108]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6602lb # [ 146.597639] niks3-server[1108]: 2026/09/20 08:06:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6603lb # [ 146.600173] niks3-server[1108]: 2026/09/20 08:06:08 INFO Signed narinfos id=61 count=16604worker1 # [ 146.572041] nix-grpc-daemon[1589]: time=2026-09-20T08:06:07.950Z level=INFO msg="Uploading 1 narinfos"6605lb # [ 146.603932] niks3-server[1108]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6606lb # [ 146.608631] niks3-server[1108]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6607lb # [ 146.612810] niks3-server[1108]: 2026/09/20 08:06:08 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6608lb # [ 146.615241] niks3-server[1108]: 2026/09/20 08:06:08 INFO Completed upload id=616609worker1 # [ 146.586972] nix-grpc-daemon[1589]: time=2026-09-20T08:06:07.965Z level=INFO msg="Upload complete. (208ms)"6610lb # [ 146.618688] niks3-server[1108]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6611worker1 # [ 146.590384] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39238 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16612worker1 # [ 146.599776] nix-daemon[905]: reaped child process 2071, status = succeeded6613client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.38 seconds)6614worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6615worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.04 seconds)6616client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16617worker2 # [ 146.884679] nix-grpc-daemon[1765]: ts=2026-09-20T08:06:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:531326618worker1 # [ 146.860081] nix-grpc-daemon[1501]: ts=2026-09-20T08:06:08Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06619lb # [ 148.220196] envoy[978]: conn peer=[2001:db8:1::1]:46298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26821 tx=10635 ms=161456620client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.22 seconds)6621(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 136.65 seconds)6622subtest: low disk drains a worker and builds go to the other6623worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6624worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds)6625worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6626lb # [ 268.227209] envoy[978]: conn peer=[2001:db8:1::1]:47940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=725 tx=455 ms=1200236627worker1 # [ 268.199466] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:09Z level=info event=unhealthy reason=min_free6628worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)6629client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26630worker2 # [ 269.159602] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:531326631client # don't know how to build these paths:6632client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6633worker1 # [ 269.145579] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:10Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06634worker1 # [ 269.147691] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:10Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16635worker2 # [ 269.222150] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:531326636worker2 # [ 269.233962] nix-grpc-daemon[1765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 1/5)6637worker2 # [ 269.266325] nix-grpc-daemon[1765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 168 ms (attempt 2/5)6638worker2 # [ 269.437857] nix-grpc-daemon[1765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 3/5)6639worker2 # [ 269.566605] nix-grpc-daemon[1765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 4/5)6640worker2 # [ 269.687462] nix-grpc-daemon[1765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6641worker2 # [ 269.705750] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:531326642client # copying 1 paths to 'lb:50051'...6643client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6644worker2 # [ 269.715858] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:531326645worker2 # [ 269.729392] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6646worker2 # [ 269.749408] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:11Z level=info event=niks3_push_started pid=18216647worker2 # [ 270.099065] nix-daemon[907]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6648worker2 # [ 270.113638] nix-daemon[907]: reaped child process 1837, status = succeeded6649worker2 # [ 270.245692] nix-daemon[907]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6650worker2 # [ 270.258812] nix-daemon[907]: reaped child process 1842, status = succeeded6651lb # [ 270.269866] niks3-server[1108]: 2026/09/20 08:08:12 INFO Received uploads request method=POST path=/api/pending_closures6652worker2 # [ 270.282916] nix-grpc-daemon[1821]: time=2026-09-20T08:08:12.049Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6653worker2 # [ 270.286235] nix-grpc-daemon[1821]: time=2026-09-20T08:08:12.051Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6654lb # [ 270.318605] niks3-server[1108]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6655lb # [ 270.324699] niks3-server[1108]: 2026/09/20 08:08:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6656lb # [ 270.334506] niks3-server[1108]: 2026/09/20 08:08:12 INFO Signed narinfos id=62 count=16657worker2 # [ 270.339307] nix-grpc-daemon[1821]: time=2026-09-20T08:08:12.106Z level=INFO msg="Uploading 1 narinfos"6658lb # [ 270.343102] niks3-server[1108]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6659lb # [ 270.351590] niks3-server[1108]: 2026/09/20 08:08:12 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6660lb # [ 270.354740] niks3-server[1108]: 2026/09/20 08:08:12 INFO Completed upload id=626661lb # [ 270.356656] niks3-server[1108]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6662worker2 # [ 270.358536] nix-grpc-daemon[1821]: time=2026-09-20T08:08:12.125Z level=INFO msg="Upload complete. (434ms)"6663worker2 # [ 270.364209] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53132 duration_s=0 paths=1 nar_bytes_in=5126664worker2 # [ 270.368982] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:531326665worker2 # [ 270.377906] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6666worker2 # [ 270.385652] nix-daemon[907]: reaped child process 1819, status = succeeded6667worker2 # [ 270.388770] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6668client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6669client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6670client # farm-a> LOG-farm-a-drain6671worker2 # [ 271.016446] nix-daemon[907]: reaped child process 1846, status = succeeded6672worker2 # [ 271.169726] nix-daemon[907]: accepted connection from pid 1861, user nix-grpc-daemon (trusted)6673worker2 # [ 271.180822] nix-daemon[907]: reaped child process 1864, status = succeeded6674lb # [ 271.193574] niks3-server[1108]: 2026/09/20 08:08:13 INFO Received uploads request method=POST path=/api/pending_closures6675worker2 # [ 271.204834] nix-grpc-daemon[1821]: time=2026-09-20T08:08:12.972Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6676worker2 # [ 271.206397] nix-grpc-daemon[1821]: time=2026-09-20T08:08:12.973Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6677lb # [ 271.236120] niks3-server[1108]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6678lb # [ 271.244233] niks3-server[1108]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6679lb # [ 271.254717] niks3-server[1108]: 2026/09/20 08:08:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6680worker2 # [ 271.261574] nix-grpc-daemon[1821]: time=2026-09-20T08:08:13.028Z level=INFO msg="Uploading 1 narinfos"6681lb # [ 271.260174] niks3-server[1108]: 2026/09/20 08:08:13 INFO Signed narinfos id=63 count=16682lb # [ 271.261682] niks3-server[1108]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6683lb # [ 271.266542] niks3-server[1108]: 2026/09/20 08:08:13 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6684lb # [ 271.270881] niks3-server[1108]: 2026/09/20 08:08:13 INFO Completed upload id=636685worker2 # [ 271.273978] nix-grpc-daemon[1821]: time=2026-09-20T08:08:13.041Z level=INFO msg="Upload complete. (278ms)"6686lb # [ 271.273205] niks3-server[1108]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6687worker2 # [ 271.276408] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53132 duration_s=0 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16688worker2 # [ 271.284527] nix-daemon[907]: reaped child process 1844, status = succeeded6689worker1 # [ 271.252484] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:12Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06690worker1 # [ 271.254602] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:12Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16691worker2 # [ 271.327375] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:531326692worker2 # [ 271.337340] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:531326693worker2 # [ 271.357402] nix-grpc-daemon[1821]: time=2026-09-20T08:08:13.124Z level=INFO msg="All 1 paths already cached"6694client # copying 1 paths to 'lb:50051'...6695client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6696worker2 # [ 271.366137] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:531326697worker2 # [ 271.377188] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6698worker2 # [ 271.511947] nix-daemon[907]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6699worker2 # [ 271.525203] nix-daemon[907]: reaped child process 1871, status = succeeded6700worker2 # [ 271.668216] nix-daemon[907]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)6701worker2 # [ 271.681595] nix-daemon[907]: reaped child process 1876, status = succeeded6702lb # [ 271.693346] niks3-server[1108]: 2026/09/20 08:08:13 INFO Received uploads request method=POST path=/api/pending_closures6703worker2 # [ 271.704256] nix-grpc-daemon[1821]: time=2026-09-20T08:08:13.471Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6704worker2 # [ 271.706364] nix-grpc-daemon[1821]: time=2026-09-20T08:08:13.473Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6705lb # [ 271.717431] niks3-server[1108]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6706lb # [ 271.722211] niks3-server[1108]: 2026/09/20 08:08:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6707worker2 # [ 271.726993] nix-grpc-daemon[1821]: time=2026-09-20T08:08:13.494Z level=INFO msg="Uploading 1 narinfos"6708lb # [ 271.725306] niks3-server[1108]: 2026/09/20 08:08:13 INFO Signed narinfos id=64 count=16709lb # [ 271.729322] niks3-server[1108]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6710lb # [ 271.736429] niks3-server[1108]: 2026/09/20 08:08:13 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6711lb # [ 271.739437] niks3-server[1108]: 2026/09/20 08:08:13 INFO Completed upload id=646712worker2 # [ 271.741179] nix-grpc-daemon[1821]: time=2026-09-20T08:08:13.508Z level=INFO msg="Upload complete. (352ms)"6713lb # [ 271.741102] niks3-server[1108]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6714worker2 # [ 271.743282] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53132 duration_s=0 paths=1 nar_bytes_in=6246715worker2 # [ 271.748469] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:531326716worker2 # [ 271.754188] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6717worker2 # [ 271.756710] nix-daemon[907]: reaped child process 1866, status = succeeded6718client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6719worker2 # [ 271.762421] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6720client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6721client # farm-b> LOG-farm-b-drain6722worker2 # [ 272.789565] nix-daemon[907]: reaped child process 1880, status = succeeded6723worker2 # [ 272.934925] nix-daemon[907]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6724worker2 # [ 272.947371] nix-daemon[907]: reaped child process 1898, status = succeeded6725lb # [ 272.955665] niks3-server[1108]: 2026/09/20 08:08:15 INFO Received uploads request method=POST path=/api/pending_closures6726worker2 # [ 272.978322] nix-grpc-daemon[1821]: time=2026-09-20T08:08:14.745Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6727worker2 # [ 272.979963] nix-grpc-daemon[1821]: time=2026-09-20T08:08:14.747Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6728lb # [ 273.014089] niks3-server[1108]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6729lb # [ 273.018782] niks3-server[1108]: 2026/09/20 08:08:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6730worker2 # [ 273.025690] nix-grpc-daemon[1821]: time=2026-09-20T08:08:14.792Z level=INFO msg="Uploading 1 narinfos"6731lb # [ 273.023998] niks3-server[1108]: 2026/09/20 08:08:15 INFO Signed narinfos id=65 count=16732lb # [ 273.026497] niks3-server[1108]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6733lb # [ 273.039765] niks3-server[1108]: 2026/09/20 08:08:15 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6734lb # [ 273.047691] niks3-server[1108]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6735lb # [ 273.050554] niks3-server[1108]: 2026/09/20 08:08:15 INFO Completed upload id=656736lb # [ 273.051750] niks3-server[1108]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6737worker2 # [ 273.052796] nix-grpc-daemon[1821]: time=2026-09-20T08:08:14.819Z level=INFO msg="Upload complete. (282ms)"6738worker2 # [ 273.058419] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53132 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16739worker1 # [ 273.033909] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:14Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06740worker1 # [ 273.038701] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:14Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16741worker2 # [ 273.072992] nix-daemon[907]: reaped child process 1878, status = succeeded6742worker2 # [ 273.109420] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:531326743worker2 # [ 273.123146] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:531326744worker2 # [ 273.135561] nix-grpc-daemon[1821]: time=2026-09-20T08:08:14.902Z level=INFO msg="All 2 paths already cached"6745client # copying 1 paths to 'lb:50051'...6746worker2 # [ 273.143130] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:531326747client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6748worker2 # [ 273.151292] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6749worker2 # [ 273.318113] nix-daemon[907]: accepted connection from pid 1902, user nix-grpc-daemon (trusted)6750worker2 # [ 273.330788] nix-daemon[907]: reaped child process 1905, status = succeeded6751worker2 # [ 273.472344] nix-daemon[907]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)6752worker2 # [ 273.484283] nix-daemon[907]: reaped child process 1910, status = succeeded6753lb # [ 273.495396] niks3-server[1108]: 2026/09/20 08:08:15 INFO Received uploads request method=POST path=/api/pending_closures6754worker2 # [ 273.504892] nix-grpc-daemon[1821]: time=2026-09-20T08:08:15.271Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6755worker2 # [ 273.506243] nix-grpc-daemon[1821]: time=2026-09-20T08:08:15.271Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6756lb # [ 273.519208] niks3-server[1108]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6757lb # [ 273.530676] niks3-server[1108]: 2026/09/20 08:08:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6758worker2 # [ 273.538689] nix-grpc-daemon[1821]: time=2026-09-20T08:08:15.305Z level=INFO msg="Uploading 1 narinfos"6759lb # [ 273.536789] niks3-server[1108]: 2026/09/20 08:08:15 INFO Signed narinfos id=66 count=16760lb # [ 273.544361] niks3-server[1108]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6761lb # [ 273.554452] niks3-server[1108]: 2026/09/20 08:08:15 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6762lb # [ 273.559614] niks3-server[1108]: 2026/09/20 08:08:15 INFO Completed upload id=666763worker2 # [ 273.561300] nix-grpc-daemon[1821]: time=2026-09-20T08:08:15.328Z level=INFO msg="Upload complete. (397ms)"6764lb # [ 273.563741] niks3-server[1108]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6765worker2 # [ 273.565780] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53132 duration_s=0 paths=1 nar_bytes_in=7526766worker2 # [ 273.570454] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:531326767worker2 # [ 273.578736] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6768worker2 # [ 273.582955] nix-daemon[907]: reaped child process 1900, status = succeeded6769worker2 # [ 273.587849] nix-daemon[907]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6770client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6771client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6772client # farm-top> LOG-farm-top-drain6773worker2 # [ 275.016313] nix-daemon[907]: reaped child process 1914, status = succeeded6774worker2 # [ 275.172462] nix-daemon[907]: accepted connection from pid 1929, user nix-grpc-daemon (trusted)6775worker2 # [ 275.185639] nix-daemon[907]: reaped child process 1932, status = succeeded6776lb # [ 275.199093] niks3-server[1108]: 2026/09/20 08:08:17 INFO Received uploads request method=POST path=/api/pending_closures6777worker2 # [ 275.213678] nix-grpc-daemon[1821]: time=2026-09-20T08:08:16.980Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6778worker2 # [ 275.217249] nix-grpc-daemon[1821]: time=2026-09-20T08:08:16.982Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6779lb # [ 275.228423] niks3-server[1108]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6780lb # [ 275.231717] niks3-server[1108]: 2026/09/20 08:08:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6781lb # [ 275.233624] niks3-server[1108]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6782lb # [ 275.235816] niks3-server[1108]: 2026/09/20 08:08:17 INFO Signed narinfos id=67 count=16783worker2 # [ 275.239596] nix-grpc-daemon[1821]: time=2026-09-20T08:08:17.006Z level=INFO msg="Uploading 1 narinfos"6784lb # [ 275.239533] niks3-server[1108]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6785lb # [ 275.243247] niks3-server[1108]: 2026/09/20 08:08:17 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6786lb # [ 275.247307] niks3-server[1108]: 2026/09/20 08:08:17 INFO Completed upload id=676787worker2 # [ 275.249273] nix-grpc-daemon[1821]: time=2026-09-20T08:08:17.016Z level=INFO msg="Upload complete. (252ms)"6788lb # [ 275.248413] niks3-server[1108]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6789worker2 # [ 275.251738] nix-grpc-daemon[1765]: ts=2026-09-20T08:08:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53132 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16790worker2 # [ 275.259639] nix-daemon[907]: reaped child process 1912, status = succeeded6791client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.28 seconds)6792client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6793client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.15 seconds)6794worker1: must succeed: rm /nix/.rw-store/fill6795worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6796worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6797worker1 # [ 276.207861] nix-grpc-daemon[1501]: ts=2026-09-20T08:08:17Z level=info event=healthy reason=min_free6798worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6799(finished: subtest: low disk drains a worker and builds go to the other, in 9.77 seconds)6800(finished: run the VM test script, in 277.70 seconds)6801test script finished in 277.91s6802cleanup6803kill QemuMachine (pid 49)6804client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6805kill QemuMachine (pid 50)6806lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6807kill QemuMachine (pid 52)6808worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6809kill QemuMachine (pid 51)6810worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6811(finished: cleanup, in 0.94 seconds)6812additionally exposed symbols:6813 client, lb, worker1, worker2,6814 vlan1,6815 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh