vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #229
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.QhnVH6U8QV', fmt=raw size=107374182414worker2 # mke2fs 1.47.4 (6-Mar-2025)15worker2: QEMU running (pid 52)16worker2 # Discarding device blocks: 0/262144 done17lb # Disk image does not exist, creating the virtualisation disk image...18lb: QEMU running (pid 49)19lb # Formatting '/build/vm-state-lb/tmp.3QQ2gh0166', fmt=raw size=107374182420client # Disk image does not exist, creating the virtualisation disk image...21lb # mke2fs 1.47.4 (6-Mar-2025)22lb # Discarding device blocks: 0/262144 done23client: QEMU running (pid 50)24client # Formatting '/build/vm-state-client/tmp.o0bQ5MRSTv', fmt=raw size=107374182425client # mke2fs 1.47.4 (6-Mar-2025)26worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes27worker1 # Disk image does not exist, creating the virtualisation disk image...28worker1: QEMU running (pid 51)29worker2 # Filesystem UUID: 1da86981-30fb-4070-8bae-d775f84f0eee30worker1 # Formatting '/build/vm-state-worker1/tmp.EfI55F4yJW', fmt=raw size=107374182431worker2 # Superblock backups stored on blocks:32worker1 # mke2fs 1.47.4 (6-Mar-2025)33lb # Creating filesystem with 262144 4k blocks and 65536 inodes34client # Discarding device blocks: 0/262144 done35client # Creating filesystem with 262144 4k blocks and 65536 inodes36(finished: start all VMs, in 0.41 seconds)37worker1 # Discarding device blocks: 0/262144 done38worker2 # 32768, 98304, 163840, 22937639client: waiting for unit network-addresses-eth1.service40worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes41worker2 # 42client: waiting for the VM to finish booting43worker1 # Filesystem UUID: a8c86282-933f-44f6-ba89-c2c53c97689d44worker2 # Allocating group tables: 0/8 done45worker1 # Superblock backups stored on blocks:46worker2 # Writing inode tables: 0/8 done47lb # Filesystem UUID: 002cb860-bd49-449e-88fa-89a0c1d3f1d848client # Filesystem UUID: 5e658b8a-79e7-44f9-a9d4-761e547faa1749worker1 # 32768, 98304, 163840, 22937650worker2 # Creating journal (8192 blocks): done51lb # Superblock backups stored on blocks:52client # Superblock backups stored on blocks:53client # 32768, 98304, 163840, 22937654worker1 # 55lb # 32768, 98304, 163840, 22937656lb # 57worker2 # Writing superblocks and filesystem accounting information: 0/8 done58worker2 # 59worker2 # Virtualisation disk image created.60worker1 # Allocating group tables: 0/8 done61client # 62lb # Allocating group tables: 0/8 done63lb # Writing inode tables: 0/8 done64client # Allocating group tables: 0/8 done65lb # Creating journal (8192 blocks): done66lb # Writing superblocks and filesystem accounting information: 0/8 done67client # Writing inode tables: 0/8 done68client # Creating journal (8192 blocks): done69client # Writing superblocks and filesystem accounting information: 0/8 done70client # 71worker1 # Writing inode tables: 0/8 done72lb # 73client # Virtualisation disk image created.74lb # Virtualisation disk image created.75worker1 # Creating journal (8192 blocks): done76worker1 # Writing superblocks and filesystem accounting information: 0/8 done77worker1 # 78worker1 # Virtualisation disk image created.79client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83client # 84lb # 85client # 86lb # 87client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0088lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker2 # 90worker2 # 91client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...92lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...93client # 94lb # 95client # 96lb # 97worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0098lb # 99client # 100lb # 101client # 102lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...105worker2 # 106worker2 # 107worker2 # 108worker2 # 109worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00110lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...111client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...112lb # 113client # 114lb # 115client # 116worker1 # 117worker1 # 118worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...119worker2 # 120worker2 # 121worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123worker1 # 124worker1 # 125worker1 # 126worker1 # 127worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker1 # 130worker1 # 131lb # Booting from ROM...132client # Booting from ROM...133worker2 # Booting from ROM...134worker1 # Booting from ROM...135client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test/init regInfo=/nix/store/3fy1dwqgz5m91imwnbcqvmkdfrgdm2h3-closure-info/registration console=ttyS0,115200n8 console=tty0138client # [ 0.000000] BIOS-provided physical RAM map:139client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable140client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved141client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved142worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8vjjgpbz1havxba4l420vrr3plciqifn-nixos-system-worker2-test/init regInfo=/nix/store/xaldjid5qcw69ml4n17xcb096v9anydf-closure-info/registration console=ttyS0,115200n8 console=tty0143worker2 # [ 0.000000] BIOS-provided physical RAM map:144client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable145worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable146client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved148client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved149lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026150worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved151client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved152worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable153client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved154worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved155client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved156worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved157client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved158client # [ 0.000000] NX (Execute Disable) protection: active159lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0160worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved161client # [ 0.000000] APIC: Static calls initialized162lb # [ 0.000000] BIOS-provided physical RAM map:163client # [ 0.000000] SMBIOS 2.8 present.164worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved165lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable166worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved167client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014168lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved169client # [ 0.000000] DMI: Memory slots populated: 1/1170worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved171client # [ 0.000000] Hypervisor detected: KVM172lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved173worker2 # [ 0.000000] NX (Execute Disable) protection: active174client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000175worker2 # [ 0.000000] APIC: Static calls initialized176lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable177worker2 # [ 0.000000] SMBIOS 2.8 present.178client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00179lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved180client # [ 0.000001] kvm-clock: using sched offset of 456862745 cycles181worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014182lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved183worker2 # [ 0.000000] DMI: Memory slots populated: 1/1184client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns185lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved186worker2 # [ 0.000000] Hypervisor detected: KVM187client # [ 0.000005] tsc: Detected 2400.012 MHz processor188worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000189lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved190client # [ 0.000817] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000191worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00192lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved193worker2 # [ 0.000000] kvm-clock: using sched offset of 467142463 cycles194client # [ 0.000844] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs195lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved196client # [ 0.000847] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT197lb # [ 0.000000] NX (Execute Disable) protection: active198worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns199lb # [ 0.000000] APIC: Static calls initialized200client # [ 0.002748] found SMP MP-table at [mem 0x000f5450-0x000f545f]201worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor202lb # [ 0.000000] SMBIOS 2.8 present.203client # [ 0.002760] Using GB pages for direct mapping204worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000205client # [ 0.002853] RAMDISK: [mem 0x5e366000-0x5ffcffff]206client # [ 0.002860] ACPI: Early table checksum verification disabled207lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014208worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs209lb # [ 0.000000] DMI: Memory slots populated: 1/1210client # [ 0.002863] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )211worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT212lb # [ 0.000000] Hypervisor detected: KVM213worker2 # [ 0.002742] found SMP MP-table at [mem 0x000f5450-0x000f545f]214lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000215client # [ 0.002867] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)216worker2 # [ 0.002754] Using GB pages for direct mapping217lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00218worker2 # [ 0.002836] RAMDISK: [mem 0x5e367000-0x5ffcffff]219client # [ 0.002870] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)220lb # [ 0.000000] kvm-clock: using sched offset of 467610331 cycles221worker2 # [ 0.002844] ACPI: Early table checksum verification disabled222client # [ 0.002877] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)223worker2 # [ 0.002847] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )224lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns225client # [ 0.002879] ACPI: FACS 0x000000005FFE0000 000040226lb # [ 0.000005] tsc: Detected 2400.012 MHz processor227worker2 # [ 0.002850] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)228lb # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000229client # [ 0.002881] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)230worker2 # [ 0.002855] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)231lb # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs232client # [ 0.002882] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)233worker2 # [ 0.002862] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)234lb # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT235client # [ 0.002884] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)236worker2 # [ 0.002864] ACPI: FACS 0x000000005FFE0000 000040237lb # [ 0.002762] found SMP MP-table at [mem 0x000f5450-0x000f545f]238lb # [ 0.002774] Using GB pages for direct mapping239client # [ 0.002885] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)240worker2 # [ 0.002865] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)241lb # [ 0.002922] RAMDISK: [mem 0x5e367000-0x5ffcffff]242client # [ 0.002887] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]243lb # [ 0.002930] ACPI: Early table checksum verification disabled244worker2 # [ 0.002867] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)245client # [ 0.002888] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]246lb # [ 0.002932] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )247worker2 # [ 0.002868] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)248client # [ 0.002888] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]249lb # [ 0.002936] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)250worker2 # [ 0.002870] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)251client # [ 0.002889] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]252lb # [ 0.002941] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)253worker2 # [ 0.002871] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]254client # [ 0.002889] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]255worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026256worker2 # [ 0.002872] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]257client # [ 0.002889] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]258lb # [ 0.002948] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)259lb # [ 0.002950] ACPI: FACS 0x000000005FFE0000 000040260client # [ 0.002890] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]261worker2 # [ 0.002873] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]262client # [ 0.003113] No NUMA configuration found263lb # [ 0.002952] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)264worker2 # [ 0.002873] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]265client # [ 0.003114] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]266worker2 # [ 0.002874] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]267lb # [ 0.002953] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)268client # [ 0.003116] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]269client # [ 0.005411] Zone ranges:270worker2 # [ 0.002874] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]271lb # [ 0.002955] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)272client # [ 0.005412] DMA [mem 0x0000000000001000-0x0000000000ffffff]273worker2 # [ 0.002875] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]274worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nmrs1qkqdpscwkw92ic135mvqvj3mqx2-nixos-system-worker1-test/init regInfo=/nix/store/zqn6bx9b4q58qjv2mnzxccira9x9brmc-closure-info/registration console=ttyS0,115200n8 console=tty0275client # [ 0.005414] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]276lb # [ 0.002957] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)277worker2 # [ 0.003104] No NUMA configuration found278client # [ 0.005415] Normal empty279worker1 # [ 0.000000] BIOS-provided physical RAM map:280client # [ 0.005416] Device empty281worker2 # [ 0.003105] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]282lb # [ 0.002958] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]283client # [ 0.005416] Movable zone start for each node284worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable285worker2 # [ 0.003108] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]286client # [ 0.005417] Early memory node ranges287lb # [ 0.002959] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]288worker2 # [ 0.005404] Zone ranges:289client # [ 0.005418] node 0: [mem 0x0000000000001000-0x000000000009efff]290lb # [ 0.002960] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]291worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved292worker2 # [ 0.005404] DMA [mem 0x0000000000001000-0x0000000000ffffff]293client # [ 0.005419] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]294worker2 # [ 0.005406] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]295lb # [ 0.002960] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]296worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved297worker2 # [ 0.005408] Normal empty298client # [ 0.005420] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]299worker2 # [ 0.005409] Device empty300lb # [ 0.002961] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]301worker2 # [ 0.005409] Movable zone start for each node302worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable303client # [ 0.005439] On node 0, zone DMA: 1 pages in unavailable ranges304worker2 # [ 0.005410] Early memory node ranges305lb # [ 0.002961] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]306client # [ 0.005708] On node 0, zone DMA: 97 pages in unavailable ranges307worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved308worker2 # [ 0.005410] node 0: [mem 0x0000000000001000-0x000000000009efff]309lb # [ 0.002962] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]310client # [ 0.033566] On node 0, zone DMA32: 40 pages in unavailable ranges311lb # [ 0.003180] No NUMA configuration found312worker2 # [ 0.005412] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]313client # [ 0.034017] ACPI: PM-Timer IO Port: 0x608314worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved315lb # [ 0.003181] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]316worker2 # [ 0.005413] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]317client # [ 0.034027] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])318worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved319lb # [ 0.003183] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]320worker2 # [ 0.005433] On node 0, zone DMA: 1 pages in unavailable ranges321client # [ 0.034051] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23322lb # [ 0.005510] Zone ranges:323worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved324worker2 # [ 0.005700] On node 0, zone DMA: 97 pages in unavailable ranges325client # [ 0.034054] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)326lb # [ 0.005511] DMA [mem 0x0000000000001000-0x0000000000ffffff]327worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved328worker2 # [ 0.033410] On node 0, zone DMA32: 40 pages in unavailable ranges329lb # [ 0.005513] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]330client # [ 0.034055] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)331worker2 # [ 0.033862] ACPI: PM-Timer IO Port: 0x608332lb # [ 0.005514] Normal empty333worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved334lb # [ 0.005515] Device empty335client # [ 0.034057] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)336worker2 # [ 0.033872] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])337worker1 # [ 0.000000] NX (Execute Disable) protection: active338lb # [ 0.005516] Movable zone start for each node339lb # [ 0.005516] Early memory node ranges340client # [ 0.034058] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)341worker1 # [ 0.000000] APIC: Static calls initialized342worker2 # [ 0.033898] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23343worker1 # [ 0.000000] SMBIOS 2.8 present.344lb # [ 0.005517] node 0: [mem 0x0000000000001000-0x000000000009efff]345client # [ 0.034058] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)346worker2 # [ 0.033900] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)347lb # [ 0.005518] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]348client # [ 0.034061] ACPI: Using ACPI (MADT) for SMP configuration information349worker2 # [ 0.033902] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)350worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014351worker1 # [ 0.000000] DMI: Memory slots populated: 1/1352client # [ 0.034062] ACPI: HPET id: 0x8086a201 base: 0xfed00000353lb # [ 0.005519] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]354worker2 # [ 0.033903] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)355worker1 # [ 0.000000] Hypervisor detected: KVM356client # [ 0.034065] TSC deadline timer available357lb # [ 0.005541] On node 0, zone DMA: 1 pages in unavailable ranges358client # [ 0.034069] CPU topo: Max. logical packages: 1359worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000360worker2 # [ 0.033904] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)361client # [ 0.034070] CPU topo: Max. logical dies: 1362lb # [ 0.005815] On node 0, zone DMA: 97 pages in unavailable ranges363worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00364worker2 # [ 0.033905] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)365client # [ 0.034070] CPU topo: Max. dies per package: 1366lb # [ 0.033648] On node 0, zone DMA32: 40 pages in unavailable ranges367worker1 # [ 0.000001] kvm-clock: using sched offset of 462140609 cycles368worker2 # [ 0.033907] ACPI: Using ACPI (MADT) for SMP configuration information369client # [ 0.034074] CPU topo: Max. threads per core: 1370lb # [ 0.034120] ACPI: PM-Timer IO Port: 0x608371worker2 # [ 0.033908] ACPI: HPET id: 0x8086a201 base: 0xfed00000372client # [ 0.034074] CPU topo: Num. cores per package: 1373lb # [ 0.034132] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])374worker1 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns375worker2 # [ 0.033911] TSC deadline timer available376client # [ 0.034075] CPU topo: Num. threads per package: 1377worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor378worker2 # [ 0.033916] CPU topo: Max. logical packages: 1379lb # [ 0.034157] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23380client # [ 0.034075] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs381worker1 # [ 0.000985] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000382worker2 # [ 0.033916] CPU topo: Max. logical dies: 1383lb # [ 0.034160] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)384worker2 # [ 0.033917] CPU topo: Max. dies per package: 1385client # [ 0.034092] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()386worker1 # [ 0.001019] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs387lb # [ 0.034162] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)388worker2 # [ 0.033920] CPU topo: Max. threads per core: 1389client # [ 0.034123] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]390worker2 # [ 0.033921] CPU topo: Num. cores per package: 1391worker1 # [ 0.001022] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT392lb # [ 0.034163] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)393worker2 # [ 0.033921] CPU topo: Num. threads per package: 1394client # [ 0.034124] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]395worker1 # [ 0.003207] found SMP MP-table at [mem 0x000f5450-0x000f545f]396lb # [ 0.034164] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)397worker1 # [ 0.003222] Using GB pages for direct mapping398worker2 # [ 0.033922] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs399client # [ 0.034125] [mem 0x60000000-0xafffffff] available for PCI devices400lb # [ 0.034165] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)401worker1 # [ 0.003365] RAMDISK: [mem 0x5e367000-0x5ffcffff]402client # [ 0.034127] Booting paravirtualized kernel on KVM403worker2 # [ 0.033940] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()404lb # [ 0.034167] ACPI: Using ACPI (MADT) for SMP configuration information405worker1 # [ 0.003376] ACPI: Early table checksum verification disabled406worker2 # [ 0.033970] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]407lb # [ 0.034168] ACPI: HPET id: 0x8086a201 base: 0xfed00000408client # [ 0.034129] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns409worker1 # [ 0.003380] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )410lb # [ 0.034172] TSC deadline timer available411worker2 # [ 0.033972] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]412lb # [ 0.034176] CPU topo: Max. logical packages: 1413client # [ 0.038621] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1414worker1 # [ 0.003385] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)415lb # [ 0.034177] CPU topo: Max. logical dies: 1416worker2 # [ 0.033973] [mem 0x60000000-0xafffffff] available for PCI devices417client # [ 0.041122] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152418lb # [ 0.034177] CPU topo: Max. dies per package: 1419worker2 # [ 0.033975] Booting paravirtualized kernel on KVM420worker1 # [ 0.003391] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)421client # [ 0.041172] kvm-guest: PV spinlocks disabled, single CPU422lb # [ 0.034181] CPU topo: Max. threads per core: 1423worker1 # [ 0.003401] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)424lb # [ 0.034181] CPU topo: Num. cores per package: 1425worker2 # [ 0.033978] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns426worker1 # [ 0.003404] ACPI: FACS 0x000000005FFE0000 000040427lb # [ 0.034182] CPU topo: Num. threads per package: 1428worker2 # [ 0.038491] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1429lb # [ 0.034182] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs430worker1 # [ 0.003406] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)431worker2 # [ 0.040723] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152432lb # [ 0.034201] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()433worker2 # [ 0.040764] kvm-guest: PV spinlocks disabled, single CPU434worker1 # [ 0.003408] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)435lb # [ 0.034236] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]436client # [ 0.041174] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test/init regInfo=/nix/store/3fy1dwqgz5m91imwnbcqvmkdfrgdm2h3-closure-info/registration console=ttyS0,115200n8 console=tty0437worker1 # [ 0.003410] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)438lb # [ 0.034237] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]439worker1 # [ 0.003413] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)440lb # [ 0.034239] [mem 0x60000000-0xafffffff] available for PCI devices441client # [ 0.041271] Unknown kernel command line parameters "regInfo=/nix/store/3fy1dwqgz5m91imwnbcqvmkdfrgdm2h3-closure-info/registration", will be passed to user space.442worker1 # [ 0.003415] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]443lb # [ 0.034240] Booting paravirtualized kernel on KVM444client # [ 0.041286] random: crng init done445worker1 # [ 0.003416] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]446worker2 # [ 0.040765] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8vjjgpbz1havxba4l420vrr3plciqifn-nixos-system-worker2-test/init regInfo=/nix/store/xaldjid5qcw69ml4n17xcb096v9anydf-closure-info/registration console=ttyS0,115200n8 console=tty0447client # [ 0.041287] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes448lb # [ 0.034243] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns449worker1 # [ 0.003417] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]450client # [ 0.043489] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)451lb # [ 0.038874] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1452worker1 # [ 0.003418] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]453worker2 # [ 0.040858] Unknown kernel command line parameters "regInfo=/nix/store/xaldjid5qcw69ml4n17xcb096v9anydf-closure-info/registration", will be passed to user space.454worker2 # [ 0.040871] random: crng init done455client # [ 0.044602] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)456lb # [ 0.041406] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152457worker1 # [ 0.003419] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]458client # [ 0.044633] Fallback order for Node 0: 0459lb # [ 0.041451] kvm-guest: PV spinlocks disabled, single CPU460worker2 # [ 0.040871] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes461worker1 # [ 0.003419] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]462client # [ 0.044635] Built 1 zonelists, mobility grouping on. Total pages: 393078463client # [ 0.044636] Policy zone: DMA32464worker2 # [ 0.043106] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)465worker1 # [ 0.003420] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]466worker1 # [ 0.003688] No NUMA configuration found467client # [ 0.047237] mem auto-init: stack:all(zero), heap alloc:on, heap free:off468worker2 # [ 0.044487] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)469worker2 # [ 0.044520] Fallback order for Node 0: 0470worker1 # [ 0.003689] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]471client # [ 0.050454] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1472worker2 # [ 0.044523] Built 1 zonelists, mobility grouping on. Total pages: 393078473client # [ 0.054180] allocated 3145728 bytes of page_ext474worker1 # [ 0.003692] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]475worker1 # [ 0.006379] Zone ranges:476worker2 # [ 0.044524] Policy zone: DMA32477lb # [ 0.041453] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0478client # [ 0.064530] ftrace: allocating 48731 entries in 192 pages479worker1 # [ 0.006381] DMA [mem 0x0000000000001000-0x0000000000ffffff]480worker2 # [ 0.047086] mem auto-init: stack:all(zero), heap alloc:on, heap free:off481client # [ 0.064532] ftrace: allocated 192 pages with 2 groups482client # [ 0.065402] Dynamic Preempt: lazy483worker1 # [ 0.006384] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]484worker2 # [ 0.050355] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1485worker1 # [ 0.006385] Normal empty486client # [ 0.065590] rcu: Preemptible hierarchical RCU implementation.487lb # [ 0.041547] Unknown kernel command line parameters "regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration", will be passed to user space.488worker2 # [ 0.053752] allocated 3145728 bytes of page_ext489worker1 # [ 0.006387] Device empty490lb # [ 0.041561] random: crng init done491client # [ 0.065590] rcu: RCU event tracing is enabled.492worker1 # [ 0.006387] Movable zone start for each node493worker2 # [ 0.064011] ftrace: allocating 48731 entries in 192 pages494worker1 # [ 0.006388] Early memory node ranges495client # [ 0.065591] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.496worker2 # [ 0.064013] ftrace: allocated 192 pages with 2 groups497lb # [ 0.041561] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes498worker2 # [ 0.064864] Dynamic Preempt: lazy499worker1 # [ 0.006389] node 0: [mem 0x0000000000001000-0x000000000009efff]500client # [ 0.065593] Trampoline variant of Tasks RCU enabled.501lb # [ 0.043840] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)502worker2 # [ 0.065028] rcu: Preemptible hierarchical RCU implementation.503client # [ 0.065593] Rude variant of Tasks RCU enabled.504worker1 # [ 0.006390] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]505worker2 # [ 0.065028] rcu: RCU event tracing is enabled.506client # [ 0.065593] Tracing variant of Tasks RCU enabled.507lb # [ 0.044940] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)508worker1 # [ 0.006392] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]509worker2 # [ 0.065029] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.510lb # [ 0.044974] Fallback order for Node 0: 0511worker1 # [ 0.006415] On node 0, zone DMA: 1 pages in unavailable ranges512client # [ 0.065594] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.513worker2 # [ 0.065030] Trampoline variant of Tasks RCU enabled.514lb # [ 0.044977] Built 1 zonelists, mobility grouping on. Total pages: 393078515worker1 # [ 0.006712] On node 0, zone DMA: 97 pages in unavailable ranges516worker2 # [ 0.065031] Rude variant of Tasks RCU enabled.517lb # [ 0.044979] Policy zone: DMA32518client # [ 0.065595] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1519worker1 # [ 0.040755] On node 0, zone DMA32: 40 pages in unavailable ranges520worker2 # [ 0.065031] Tracing variant of Tasks RCU enabled.521lb # [ 0.047625] mem auto-init: stack:all(zero), heap alloc:on, heap free:off522worker1 # [ 0.041323] ACPI: PM-Timer IO Port: 0x608523client # [ 0.065610] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.524worker2 # [ 0.065032] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.525lb # [ 0.051024] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1526worker1 # [ 0.041342] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])527lb # [ 0.054674] allocated 3145728 bytes of page_ext528worker2 # [ 0.065032] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1529client # [ 0.065611] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.530worker1 # [ 0.041372] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23531lb # [ 0.064984] ftrace: allocating 48731 entries in 192 pages532worker1 # [ 0.041376] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)533worker2 # [ 0.065049] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.534client # [ 0.065612] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.535lb # [ 0.064987] ftrace: allocated 192 pages with 2 groups536lb # [ 0.066083] Dynamic Preempt: lazy537worker1 # [ 0.041378] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)538client # [ 0.070003] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16539worker2 # [ 0.065051] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.540lb # [ 0.066285] rcu: Preemptible hierarchical RCU implementation.541worker1 # [ 0.041380] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)542client # [ 0.070291] rcu: srcu_init: Setting srcu_struct sizes based on contention.543lb # [ 0.066287] rcu: RCU event tracing is enabled.544worker2 # [ 0.065052] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.545worker1 # [ 0.041381] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)546lb # [ 0.066287] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.547worker2 # [ 0.069442] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16548client # [ 0.070296] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns549worker1 # [ 0.041382] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)550lb # [ 0.066290] Trampoline variant of Tasks RCU enabled.551worker2 # [ 0.069992] rcu: srcu_init: Setting srcu_struct sizes based on contention.552lb # [ 0.066290] Rude variant of Tasks RCU enabled.553worker1 # [ 0.041385] ACPI: Using ACPI (MADT) for SMP configuration information554client # [ 0.070402] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)555lb # [ 0.066291] Tracing variant of Tasks RCU enabled.556worker1 # [ 0.041386] ACPI: HPET id: 0x8086a201 base: 0xfed00000557client # [ 0.073972] Console: colour VGA+ 80x25558worker2 # [ 0.069998] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns559worker1 # [ 0.041393] TSC deadline timer available560client # [ 0.073976] printk: legacy console [tty0] enabled561lb # [ 0.066292] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.562worker1 # [ 0.041399] CPU topo: Max. logical packages: 1563client # [ 0.103694] printk: legacy console [ttyS0] enabled564lb # [ 0.066292] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1565worker2 # [ 0.070113] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)566worker1 # [ 0.041400] CPU topo: Max. logical dies: 1567worker2 # [ 0.073684] Console: colour VGA+ 80x25568client # [ 0.201911] ACPI: Core revision 20250807569worker1 # [ 0.041400] CPU topo: Max. dies per package: 1570worker2 # [ 0.073688] printk: legacy console [tty0] enabled571lb # [ 0.066319] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.572worker1 # [ 0.041405] CPU topo: Max. threads per core: 1573worker2 # [ 0.103329] printk: legacy console [ttyS0] enabled574worker1 # [ 0.041406] CPU topo: Num. cores per package: 1575lb # [ 0.066322] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.576worker1 # [ 0.041406] CPU topo: Num. threads per package: 1577worker2 # [ 0.200664] ACPI: Core revision 20250807578client # [ 0.202910] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns579worker1 # [ 0.041407] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs580lb # [ 0.066323] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.581client # [ 0.204608] APIC: Switch to symmetric I/O mode setup582worker1 # [ 0.041432] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()583lb # [ 0.071107] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16584worker2 # [ 0.201522] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns585client # [ 0.205560] x2apic enabled586lb # [ 0.071387] rcu: srcu_init: Setting srcu_struct sizes based on contention.587worker1 # [ 0.041478] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]588worker2 # [ 0.203011] APIC: Switch to symmetric I/O mode setup589client # [ 0.206340] APIC: Switched APIC routing to: physical x2apic590worker2 # [ 0.203942] x2apic enabled591worker1 # [ 0.041480] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]592lb # [ 0.071393] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns593worker1 # [ 0.041482] [mem 0x60000000-0xafffffff] available for PCI devices594worker2 # [ 0.204697] APIC: Switched APIC routing to: physical x2apic595worker1 # [ 0.041484] Booting paravirtualized kernel on KVM596client # [ 0.208142] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1597lb # [ 0.071504] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)598lb # [ 0.075137] Console: colour VGA+ 80x25599lb # [ 0.075141] printk: legacy console [tty0] enabled600worker1 # [ 0.041489] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns601worker2 # [ 0.206514] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1602lb # [ 0.105732] printk: legacy console [ttyS0] enabled603client # [ 0.209118] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns604worker1 # [ 0.046275] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1605lb # [ 0.203404] ACPI: Core revision 20250807606worker1 # [ 0.049196] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152607worker2 # [ 0.207489] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns608client # [ 0.210869] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)609worker1 # [ 0.049254] kvm-guest: PV spinlocks disabled, single CPU610lb # [ 0.204329] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns611client # [ 0.211954] x86/cpu: User Mode Instruction Prevention (UMIP) activated612worker2 # [ 0.209163] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)613lb # [ 0.205897] APIC: Switch to symmetric I/O mode setup614client # [ 0.213742] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127615worker2 # [ 0.210244] x86/cpu: User Mode Instruction Prevention (UMIP) activated616lb # [ 0.206971] x2apic enabled617client # [ 0.214548] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0618worker2 # [ 0.211314] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127619lb # [ 0.207722] APIC: Switched APIC routing to: physical x2apic620worker1 # [ 0.049257] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nmrs1qkqdpscwkw92ic135mvqvj3mqx2-nixos-system-worker1-test/init regInfo=/nix/store/zqn6bx9b4q58qjv2mnzxccira9x9brmc-closure-info/registration console=ttyS0,115200n8 console=tty0621worker2 # [ 0.212161] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0622client # [ 0.215703] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto623worker1 # [ 0.049393] Unknown kernel command line parameters "regInfo=/nix/store/zqn6bx9b4q58qjv2mnzxccira9x9brmc-closure-info/registration", will be passed to user space.624lb # [ 0.209624] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1625worker1 # [ 0.049414] random: crng init done626worker2 # [ 0.213163] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto627client # [ 0.216867] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl628worker1 # [ 0.049415] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes629lb # [ 0.210631] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns630client # [ 0.218867] Transient Scheduler Attacks: Vulnerable: No microcode631worker2 # [ 0.215160] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl632worker1 # [ 0.051977] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)633client # [ 0.219865] Spectre V2 : Mitigation: Enhanced / Automatic IBRS634worker2 # [ 0.216161] Transient Scheduler Attacks: Vulnerable: No microcode635worker1 # [ 0.053283] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)636lb # [ 0.212323] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)637worker1 # [ 0.053329] Fallback order for Node 0: 0638client # [ 0.220865] Speculative Return Stack Overflow: Mitigation: Safe RET639worker2 # [ 0.217160] Spectre V2 : Mitigation: Enhanced / Automatic IBRS640lb # [ 0.213416] x86/cpu: User Mode Instruction Prevention (UMIP) activated641worker1 # [ 0.053333] Built 1 zonelists, mobility grouping on. Total pages: 393078642worker1 # [ 0.053335] Policy zone: DMA32643worker2 # [ 0.218160] Speculative Return Stack Overflow: Mitigation: Safe RET644lb # [ 0.215334] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127645worker1 # [ 0.056344] mem auto-init: stack:all(zero), heap alloc:on, heap free:off646worker1 # [ 0.060400] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1647lb # [ 0.216233] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0648worker1 # [ 0.064825] allocated 3145728 bytes of page_ext649worker1 # [ 0.076036] ftrace: allocating 48731 entries in 192 pages650client # [ 0.221865] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization651worker1 # [ 0.076040] ftrace: allocated 192 pages with 2 groups652lb # [ 0.217073] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto653client # [ 0.223874] Spectre V2 : Enabling IBPB for BPF654worker1 # [ 0.077206] Dynamic Preempt: lazy655worker2 # [ 0.219160] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization656worker1 # [ 0.077418] rcu: Preemptible hierarchical RCU implementation.657lb # [ 0.218321] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl658worker2 # [ 0.221168] Spectre V2 : Enabling IBPB for BPF659worker1 # [ 0.077419] rcu: RCU event tracing is enabled.660client # [ 0.225379] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier661worker1 # [ 0.077419] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.662lb # [ 0.219322] Transient Scheduler Attacks: Vulnerable: No microcode663client # [ 0.226866] active return thunk: srso_alias_return_thunk664worker2 # [ 0.222160] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier665worker1 # [ 0.077422] Trampoline variant of Tasks RCU enabled.666lb # [ 0.220274] Spectre V2 : Mitigation: Enhanced / Automatic IBRS667worker1 # [ 0.077422] Rude variant of Tasks RCU enabled.668client # [ 0.227706] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'669worker2 # [ 0.223161] active return thunk: srso_alias_return_thunk670worker1 # [ 0.077423] Tracing variant of Tasks RCU enabled.671lb # [ 0.221034] Speculative Return Stack Overflow: Mitigation: Safe RET672client # [ 0.228865] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'673worker1 # [ 0.077423] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.674worker2 # [ 0.224181] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'675client # [ 0.229865] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'676worker1 # [ 0.077424] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1677worker2 # [ 0.225160] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'678client # [ 0.230865] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'679worker1 # [ 0.077447] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.680worker2 # [ 0.226933] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'681client # [ 0.231825] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'682worker1 # [ 0.077450] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.683worker2 # [ 0.227899] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'684lb # [ 0.222320] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization685client # [ 0.232595] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'686worker2 # [ 0.228899] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'687worker1 # [ 0.077451] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.688lb # [ 0.224329] Spectre V2 : Enabling IBPB for BPF689worker1 # [ 0.083021] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16690client # [ 0.233630] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'691worker2 # [ 0.229878] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'692worker1 # [ 0.083325] rcu: srcu_init: Setting srcu_struct sizes based on contention.693lb # [ 0.225824] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier694client # [ 0.234865] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256695worker2 # [ 0.230926] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'696lb # [ 0.226321] active return thunk: srso_alias_return_thunk697worker1 # [ 0.083332] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns698client # [ 0.235865] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64699worker2 # [ 0.232160] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256700client # [ 0.236865] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512701lb # [ 0.228205] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'702worker1 # [ 0.083447] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)703worker2 # [ 0.233083] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64704worker1 # [ 0.087547] Console: colour VGA+ 80x25705client # [ 0.237781] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024706lb # [ 0.229321] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'707worker1 # [ 0.087552] printk: legacy console [tty0] enabled708worker2 # [ 0.233873] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512709worker1 # [ 0.125761] printk: legacy console [ttyS0] enabled710client # [ 0.238565] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8711lb # [ 0.230320] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'712worker1 # [ 0.225119] ACPI: Core revision 20250807713worker2 # [ 0.234858] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024714lb # [ 0.231321] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'715client # [ 0.239566] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.716worker2 # [ 0.235885] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8717worker1 # [ 0.225942] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns718lb # [ 0.232320] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'719worker1 # [ 0.227437] APIC: Switch to symmetric I/O mode setup720worker2 # [ 0.236887] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.721lb # [ 0.233321] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'722worker1 # [ 0.228370] x2apic enabled723lb # [ 0.234320] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'724worker1 # [ 0.229119] APIC: Switched APIC routing to: physical x2apic725lb # [ 0.235321] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256726lb # [ 0.236320] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64727worker1 # [ 0.230962] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1728lb # [ 0.237321] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512729worker1 # [ 0.231942] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns730lb # [ 0.238319] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024731lb # [ 0.239321] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8732worker1 # [ 0.233615] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)733worker1 # [ 0.234704] x86/cpu: User Mode Instruction Prevention (UMIP) activated734lb # [ 0.240320] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.735worker1 # [ 0.235748] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127736worker1 # [ 0.236613] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0737worker1 # [ 0.237616] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto738worker1 # [ 0.239613] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl739worker1 # [ 0.240613] Transient Scheduler Attacks: Vulnerable: No microcode740worker1 # [ 0.241612] Spectre V2 : Mitigation: Enhanced / Automatic IBRS741worker1 # [ 0.242612] Speculative Return Stack Overflow: Mitigation: Safe RET742worker1 # [ 0.243613] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization743worker1 # [ 0.245627] Spectre V2 : Enabling IBPB for BPF744worker1 # [ 0.246613] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745worker1 # [ 0.247613] active return thunk: srso_alias_return_thunk746worker1 # [ 0.249262] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747worker1 # [ 0.250499] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748worker1 # [ 0.251351] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749worker1 # [ 0.252347] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750worker1 # [ 0.253361] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker1 # [ 0.254351] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752worker1 # [ 0.255404] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753worker1 # [ 0.256613] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754worker1 # [ 0.257613] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755client # [ 0.274386] Freeing SMP alternatives memory: 44K756worker1 # [ 0.258612] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512757client # [ 0.274867] pid_max: default: 32768 minimum: 301758worker2 # [ 0.271732] Freeing SMP alternatives memory: 44K759worker1 # [ 0.259535] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024760client # [ 0.275963] LSM: initializing lsm=capability,landlock,yama,bpf,ima761worker2 # [ 0.272163] pid_max: default: 32768 minimum: 301762client # [ 0.276960] landlock: Up and running.763worker1 # [ 0.260324] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8764client # [ 0.277578] Yama: becoming mindful.765worker2 # [ 0.273242] LSM: initializing lsm=capability,landlock,yama,bpf,ima766client # [ 0.278498] LSM support for eBPF active767worker1 # [ 0.261328] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.768worker2 # [ 0.274254] landlock: Up and running.769worker2 # [ 0.274869] Yama: becoming mindful.770client # [ 0.278988] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)771worker2 # [ 0.275815] LSM support for eBPF active772client # [ 0.279910] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)773worker2 # [ 0.276273] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)774worker2 # [ 0.277203] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)775client # [ 0.282859] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)776client # [ 0.283415] Performance Events: Fam17h+ core perfctr, AMD PMU driver.777worker2 # [ 0.280412] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)778lb # [ 0.276350] Freeing SMP alternatives memory: 44K779client # [ 0.283870] ... version: 2780lb # [ 0.277114] pid_max: default: 32768 minimum: 301781client # [ 0.284579] ... bit width: 48782worker2 # [ 0.281758] Performance Events: Fam17h+ core perfctr, AMD PMU driver.783client # [ 0.284867] ... generic counters: 6784lb # [ 0.277407] LSM: initializing lsm=capability,landlock,yama,bpf,ima785worker2 # [ 0.282169] ... version: 2786client # [ 0.285554] ... generic bitmap: 000000000000003f787lb # [ 0.278431] landlock: Up and running.788worker2 # [ 0.282885] ... bit width: 48789client # [ 0.285879] ... fixed-purpose counters: 0790lb # [ 0.279321] Yama: becoming mindful.791worker2 # [ 0.283162] ... generic counters: 6792client # [ 0.286591] ... fixed-purpose bitmap: 0000000000000000793lb # [ 0.280541] LSM support for eBPF active794worker2 # [ 0.283873] ... generic bitmap: 000000000000003f795client # [ 0.286868] ... value mask: 0000ffffffffffff796worker2 # [ 0.284163] ... fixed-purpose counters: 0797lb # [ 0.281367] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)798client # [ 0.287739] ... max period: 00007fffffffffff799worker2 # [ 0.284876] ... fixed-purpose bitmap: 0000000000000000800lb # [ 0.282357] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)801client # [ 0.288534] ... global_ctrl mask: 000000000000003f802worker2 # [ 0.285162] ... value mask: 0000ffffffffffff803client # [ 0.288984] signal: max sigframe size: 3376804worker2 # [ 0.286031] ... max period: 00007fffffffffff805client # [ 0.289755] rcu: Hierarchical SRCU implementation.806worker2 # [ 0.286838] ... global_ctrl mask: 000000000000003f807lb # [ 0.284772] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)808client # [ 0.290460] rcu: Max phase no-delay instances is 400.809worker2 # [ 0.287260] signal: max sigframe size: 3376810worker2 # [ 0.288120] rcu: Hierarchical SRCU implementation.811lb # [ 0.285865] Performance Events: Fam17h+ core perfctr, AMD PMU driver.812worker2 # [ 0.288795] rcu: Max phase no-delay instances is 400.813lb # [ 0.286325] ... version: 2814lb # [ 0.287059] ... bit width: 48815lb # [ 0.287323] ... generic counters: 6816lb # [ 0.288028] ... generic bitmap: 000000000000003f817lb # [ 0.288379] ... fixed-purpose counters: 0818client # [ 0.295469] smp: Bringing up secondary CPUs ...819client # [ 0.295882] smp: Brought up 1 node, 1 CPU820lb # [ 0.289091] ... fixed-purpose bitmap: 0000000000000000821client # [ 0.296537] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)822lb # [ 0.289323] ... value mask: 0000ffffffffffff823worker2 # [ 0.293747] smp: Bringing up secondary CPUs ...824lb # [ 0.290197] ... max period: 00007fffffffffff825worker2 # [ 0.294177] smp: Brought up 1 node, 1 CPU826lb # [ 0.290966] ... global_ctrl mask: 000000000000003f827worker2 # [ 0.294909] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)828client # [ 0.297018] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)829lb # [ 0.291434] signal: max sigframe size: 3376830client # [ 0.298155] devtmpfs: initialized831lb # [ 0.292186] rcu: Hierarchical SRCU implementation.832lb # [ 0.292907] rcu: Max phase no-delay instances is 400.833client # [ 0.298944] x86/mm: Memory block size: 128MB834worker2 # [ 0.295377] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)835worker2 # [ 0.296425] devtmpfs: initialized836worker2 # [ 0.297187] x86/mm: Memory block size: 128MB837client # [ 0.300766] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)838client # [ 0.301770] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).839worker2 # [ 0.299012] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)840client # [ 0.302955] pinctrl core: initialized pinctrl subsystem841lb # [ 0.297933] smp: Bringing up secondary CPUs ...842client # [ 0.304083] PM: RTC time: 08:07:01, date: 2026-09-20843worker2 # [ 0.300115] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).844lb # [ 0.298336] smp: Brought up 1 node, 1 CPU845worker1 # [ 0.296182] Freeing SMP alternatives memory: 44K846worker2 # [ 0.301261] pinctrl core: initialized pinctrl subsystem847worker1 # [ 0.296615] pid_max: default: 32768 minimum: 301848lb # [ 0.299009] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)849worker2 # [ 0.302355] PM: RTC time: 08:07:01, date: 2026-09-20850worker1 # [ 0.297702] LSM: initializing lsm=capability,landlock,yama,bpf,ima851worker1 # [ 0.298714] landlock: Up and running.852lb # [ 0.299456] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)853worker1 # [ 0.299343] Yama: becoming mindful.854client # [ 0.307704] NET: Registered PF_NETLINK/PF_ROUTE protocol family855lb # [ 0.300623] devtmpfs: initialized856worker1 # [ 0.300246] LSM support for eBPF active857lb # [ 0.301428] x86/mm: Memory block size: 128MB858client # [ 0.309103] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations859worker2 # [ 0.305997] NET: Registered PF_NETLINK/PF_ROUTE protocol family860worker1 # [ 0.300751] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)861client # [ 0.309900] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations862worker1 # [ 0.301650] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)863worker2 # [ 0.307379] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations864lb # [ 0.303235] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)865client # [ 0.311151] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations866worker2 # [ 0.308185] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations867lb # [ 0.304260] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).868client # [ 0.311878] audit: initializing netlink subsys (disabled)869worker1 # [ 0.304692] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)870lb # [ 0.305413] pinctrl core: initialized pinctrl subsystem871worker2 # [ 0.309443] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations872client # [ 0.312976] thermal_sys: Registered thermal governor 'fair_share'873lb # [ 0.306507] PM: RTC time: 08:07:01, date: 2026-09-20874worker2 # [ 0.310174] audit: initializing netlink subsys (disabled)875worker1 # [ 0.306208] Performance Events: Fam17h+ core perfctr, AMD PMU driver.876client # [ 0.312979] thermal_sys: Registered thermal governor 'bang_bang'877worker1 # [ 0.306621] ... version: 2878client # [ 0.313868] thermal_sys: Registered thermal governor 'step_wise'879worker2 # [ 0.311321] thermal_sys: Registered thermal governor 'fair_share'880worker1 # [ 0.307323] ... bit width: 48881client # [ 0.314760] thermal_sys: Registered thermal governor 'user_space'882worker1 # [ 0.307615] ... generic counters: 6883worker2 # [ 0.311323] thermal_sys: Registered thermal governor 'bang_bang'884worker1 # [ 0.308317] ... generic bitmap: 000000000000003f885worker2 # [ 0.312164] thermal_sys: Registered thermal governor 'step_wise'886client # [ 0.315584] audit: type=2000 audit(1789891622.305:1): state=initialized audit_enabled=0 res=1887worker1 # [ 0.308615] ... fixed-purpose counters: 0888lb # [ 0.310439] NET: Registered PF_NETLINK/PF_ROUTE protocol family889worker2 # [ 0.313084] thermal_sys: Registered thermal governor 'user_space'890client # [ 0.316872] thermal_sys: Registered thermal governor 'power_allocator'891worker1 # [ 0.309288] ... fixed-purpose bitmap: 0000000000000000892client # [ 0.316896] cpuidle: using governor menu893worker2 # [ 0.313881] audit: type=2000 audit(1789891622.308:1): state=initialized audit_enabled=0 res=1894worker1 # [ 0.309614] ... value mask: 0000ffffffffffff895lb # [ 0.311885] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations896worker1 # [ 0.310464] ... max period: 00007fffffffffff897worker2 # [ 0.315167] thermal_sys: Registered thermal governor 'power_allocator'898client # [ 0.319060] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5899lb # [ 0.312347] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations900worker2 # [ 0.315191] cpuidle: using governor menu901worker1 # [ 0.311275] ... global_ctrl mask: 000000000000003f902worker1 # [ 0.311716] signal: max sigframe size: 3376903client # [ 0.320173] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]904lb # [ 0.313604] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations905worker2 # [ 0.317369] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5906worker1 # [ 0.312511] rcu: Hierarchical SRCU implementation.907lb # [ 0.314338] audit: initializing netlink subsys (disabled)908client # [ 0.320871] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry909worker1 # [ 0.313217] rcu: Max phase no-delay instances is 400.910client # [ 0.321880] PCI: Using configuration type 1 for base access911worker2 # [ 0.318470] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]912lb # [ 0.315325] audit: type=2000 audit(1789891622.316:1): state=initialized audit_enabled=0 res=1913worker2 # [ 0.319166] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry914client # [ 0.322996] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.915lb # [ 0.316474] thermal_sys: Registered thermal governor 'fair_share'916worker2 # [ 0.320175] PCI: Using configuration type 1 for base access917lb # [ 0.316476] thermal_sys: Registered thermal governor 'bang_bang'918lb # [ 0.317324] thermal_sys: Registered thermal governor 'step_wise'919worker2 # [ 0.321317] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.920lb # [ 0.318284] thermal_sys: Registered thermal governor 'user_space'921worker1 # [ 0.318126] smp: Bringing up secondary CPUs ...922worker1 # [ 0.318628] smp: Brought up 1 node, 1 CPU923lb # [ 0.319073] thermal_sys: Registered thermal governor 'power_allocator'924lb # [ 0.319341] cpuidle: using governor menu925worker1 # [ 0.319294] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)926lb # [ 0.321591] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5927worker1 # [ 0.319770] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)928client # [ 0.330146] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages929worker2 # [ 0.326428] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages930lb # [ 0.322566] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]931worker1 # [ 0.320890] devtmpfs: initialized932client # [ 0.330868] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page933worker2 # [ 0.327164] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page934lb # [ 0.323325] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry935worker1 # [ 0.321676] x86/mm: Memory block size: 128MB936lb # [ 0.324336] PCI: Using configuration type 1 for base access937worker1 # [ 0.323533] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)938lb # [ 0.325483] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.939worker1 # [ 0.324534] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).940client # [ 0.335869] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages941worker1 # [ 0.325712] pinctrl core: initialized pinctrl subsystem942worker2 # [ 0.332164] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages943client # [ 0.336868] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page944worker2 # [ 0.333162] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page945worker1 # [ 0.326827] PM: RTC time: 08:07:01, date: 2026-09-20946worker1 # [ 0.330712] NET: Registered PF_NETLINK/PF_ROUTE protocol family947lb # [ 0.333344] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages948lb # [ 0.334323] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page949worker1 # [ 0.332106] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations950lb # [ 0.335292] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages951worker1 # [ 0.332637] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations952client # [ 0.345462] ACPI: Added _OSI(Module Device)953worker1 # [ 0.333884] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations954client # [ 0.345869] ACPI: Added _OSI(Processor Device)955worker1 # [ 0.334630] audit: initializing netlink subsys (disabled)956client # [ 0.346577] ACPI: Added _OSI(Processor Aggregator Device)957worker2 # [ 0.343514] ACPI: Added _OSI(Module Device)958worker2 # [ 0.344164] ACPI: Added _OSI(Processor Device)959worker1 # [ 0.335830] thermal_sys: Registered thermal governor 'fair_share'960worker2 # [ 0.344918] ACPI: Added _OSI(Processor Aggregator Device)961worker1 # [ 0.335833] thermal_sys: Registered thermal governor 'bang_bang'962lb # [ 0.340323] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page963worker1 # [ 0.336616] thermal_sys: Registered thermal governor 'step_wise'964worker1 # [ 0.337548] thermal_sys: Registered thermal governor 'user_space'965worker1 # [ 0.338438] audit: type=2000 audit(1789891622.333:1): state=initialized audit_enabled=0 res=1966worker1 # [ 0.340619] thermal_sys: Registered thermal governor 'power_allocator'967worker1 # [ 0.340634] cpuidle: using governor menu968client # [ 0.353443] ACPI: 1 ACPI AML tables successfully acquired and loaded969worker1 # [ 0.342900] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5970lb # [ 0.348719] ACPI: Added _OSI(Module Device)971worker1 # [ 0.343826] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]972lb # [ 0.349324] ACPI: Added _OSI(Processor Device)973worker2 # [ 0.353775] ACPI: 1 ACPI AML tables successfully acquired and loaded974client # [ 0.356813] ACPI: Interpreter enabled975worker1 # [ 0.344617] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry976lb # [ 0.350058] ACPI: Added _OSI(Processor Aggregator Device)977client # [ 0.357311] ACPI: PM: (supports S0 S3 S4 S5)978worker1 # [ 0.345626] PCI: Using configuration type 1 for base access979client # [ 0.357869] ACPI: Using IOAPIC for interrupt routing980worker1 # [ 0.346751] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.981client # [ 0.358739] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug982worker2 # [ 0.357436] ACPI: Interpreter enabled983worker2 # [ 0.358077] ACPI: PM: (supports S0 S3 S4 S5)984worker2 # [ 0.358749] ACPI: Using IOAPIC for interrupt routing985worker2 # [ 0.359200] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug986client # [ 0.363869] PCI: Using E820 reservations for host bridge windows987worker2 # [ 0.360164] PCI: Using E820 reservations for host bridge windows988worker1 # [ 0.351862] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages989client # [ 0.364940] ACPI: Enabled 2 GPEs in block 00 to 3F990worker1 # [ 0.352616] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page991lb # [ 0.358887] ACPI: 1 ACPI AML tables successfully acquired and loaded992worker2 # [ 0.363245] ACPI: Enabled 2 GPEs in block 00 to 3F993lb # [ 0.362588] ACPI: Interpreter enabled994worker1 # [ 0.357617] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages995lb # [ 0.363282] ACPI: PM: (supports S0 S3 S4 S5)996worker1 # [ 0.358614] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page997lb # [ 0.363861] ACPI: Using IOAPIC for interrupt routing998lb # [ 0.364374] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug999client # [ 0.373566] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1000lb # [ 0.365323] PCI: Using E820 reservations for host bridge windows1001client # [ 0.374508] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1002worker2 # [ 0.371922] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1003lb # [ 0.368426] ACPI: Enabled 2 GPEs in block 00 to 3F1004client # [ 0.374946] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1005worker2 # [ 0.372171] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1006client # [ 0.375997] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1007client # [ 0.377232] PCI host bridge to bus 0000:001008worker2 # [ 0.374221] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1009client # [ 0.377872] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1010worker2 # [ 0.375288] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1011worker1 # [ 0.368992] ACPI: Added _OSI(Module Device)1012client # [ 0.378868] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1013worker2 # [ 0.376552] PCI host bridge to bus 0000:001014worker1 # [ 0.369617] ACPI: Added _OSI(Processor Device)1015client # [ 0.379868] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1016worker2 # [ 0.377167] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1017worker1 # [ 0.370338] ACPI: Added _OSI(Processor Aggregator Device)1018client # [ 0.380868] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1019worker2 # [ 0.378163] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1020client # [ 0.381868] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1021worker2 # [ 0.379162] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1022lb # [ 0.377298] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1023client # [ 0.382868] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1024worker2 # [ 0.380165] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1025lb # [ 0.378078] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1026client # [ 0.383869] pci_bus 0000:00: root bus resource [bus 00-ff]1027worker2 # [ 0.381163] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1028lb # [ 0.379564] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1029client # [ 0.384809] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1030worker2 # [ 0.382163] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1031lb # [ 0.380444] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1032worker2 # [ 0.383163] pci_bus 0000:00: root bus resource [bus 00-ff]1033client # [ 0.386286] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1034lb # [ 0.381684] PCI host bridge to bus 0000:001035worker2 # [ 0.384164] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1036lb # [ 0.382327] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1037worker1 # [ 0.379163] ACPI: 1 ACPI AML tables successfully acquired and loaded1038lb # [ 0.383323] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1039worker2 # [ 0.385602] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1040lb # [ 0.384322] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1041lb # [ 0.385322] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1042worker1 # [ 0.383018] ACPI: Interpreter enabled1043lb # [ 0.386323] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1044worker1 # [ 0.383629] ACPI: PM: (supports S0 S3 S4 S5)1045lb # [ 0.387323] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1046worker1 # [ 0.384357] ACPI: Using IOAPIC for interrupt routing1047lb # [ 0.388323] pci_bus 0000:00: root bus resource [bus 00-ff]1048client # [ 0.388938] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1049worker1 # [ 0.384673] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1050client # [ 0.389880] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1051lb # [ 0.389334] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1052worker1 # [ 0.385616] PCI: Using E820 reservations for host bridge windows1053client # [ 0.390813] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1054lb # [ 0.390760] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1055worker2 # [ 0.388282] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1056client # [ 0.392222] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1057worker2 # [ 0.389240] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1058worker1 # [ 0.388728] ACPI: Enabled 2 GPEs in block 00 to 3F1059worker2 # [ 0.390228] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1060client # [ 0.393563] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1061worker2 # [ 0.391474] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1062client # [ 0.396876] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1063worker2 # [ 0.392852] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1064client # [ 0.397739] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1065client # [ 0.398657] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1066lb # [ 0.393382] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1067client # [ 0.399753] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1068worker2 # [ 0.396193] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1069lb # [ 0.394335] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1070worker2 # [ 0.397048] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1071worker1 # [ 0.397417] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1072worker2 # [ 0.397930] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1073lb # [ 0.395290] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1074client # [ 0.401410] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1075worker1 # [ 0.398430] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1076worker2 # [ 0.398169] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1077lb # [ 0.396636] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1078worker1 # [ 0.400271] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1079client # [ 0.403748] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1080worker1 # [ 0.400739] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1081worker2 # [ 0.399707] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1082client # [ 0.404512] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1083lb # [ 0.398081] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1084worker1 # [ 0.401981] PCI host bridge to bus 0000:001085client # [ 0.404890] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1086worker1 # [ 0.402619] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1087worker2 # [ 0.402119] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1088client # [ 0.406426] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1089worker1 # [ 0.403616] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1090lb # [ 0.400330] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1091worker2 # [ 0.402766] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1092lb # [ 0.401169] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1093worker1 # [ 0.404615] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1094worker2 # [ 0.403184] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1095lb # [ 0.402048] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1096worker1 # [ 0.405615] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1097worker2 # [ 0.404756] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1098worker1 # [ 0.406616] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1099lb # [ 0.402330] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1100client # [ 0.409098] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1101worker1 # [ 0.407615] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1102client # [ 0.410521] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1103lb # [ 0.403910] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1104worker1 # [ 0.408616] pci_bus 0000:00: root bus resource [bus 00-ff]1105client # [ 0.410889] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1106worker1 # [ 0.409617] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1107worker2 # [ 0.408083] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1108client # [ 0.412417] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109lb # [ 0.406189] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1110worker2 # [ 0.408780] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1111worker1 # [ 0.411070] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1112lb # [ 0.406954] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1113worker2 # [ 0.409185] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1114lb # [ 0.407346] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1115client # [ 0.414759] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1116worker2 # [ 0.410727] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117client # [ 0.415526] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1118lb # [ 0.408950] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1119client # [ 0.415889] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1120worker2 # [ 0.413192] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1121worker2 # [ 0.414092] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1122client # [ 0.417910] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1123lb # [ 0.411331] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1124lb # [ 0.412228] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1125worker2 # [ 0.414907] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1126worker1 # [ 0.413797] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1127client # [ 0.420598] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1128lb # [ 0.413098] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1129client # [ 0.420875] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1130worker1 # [ 0.414700] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1131worker2 # [ 0.415732] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1132lb # [ 0.414680] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133client # [ 0.421798] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1134worker1 # [ 0.415615] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1135client # [ 0.423277] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1136worker2 # [ 0.417935] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1137worker1 # [ 0.416969] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1138lb # [ 0.417263] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1139worker2 # [ 0.418822] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1140lb # [ 0.418016] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1141worker2 # [ 0.419184] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1142worker1 # [ 0.418343] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1143lb # [ 0.418344] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1144client # [ 0.426106] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1145worker2 # [ 0.420745] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1146client # [ 0.427499] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1147worker1 # [ 0.421652] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1148lb # [ 0.419876] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1149client # [ 0.427889] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1150worker1 # [ 0.422547] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1151worker1 # [ 0.423411] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1152client # [ 0.429468] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1153worker2 # [ 0.424194] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1154lb # [ 0.421340] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1155lb # [ 0.422161] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1156worker2 # [ 0.425034] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1157worker1 # [ 0.424504] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1158worker2 # [ 0.425927] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1159lb # [ 0.423072] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1160client # [ 0.430875] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1161worker1 # [ 0.426183] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1162client # [ 0.431715] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1163worker2 # [ 0.426751] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1164lb # [ 0.423909] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1165client # [ 0.432614] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1166client # [ 0.432873] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1167worker1 # [ 0.428653] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1168worker2 # [ 0.428191] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1169worker1 # [ 0.429535] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1170worker2 # [ 0.429076] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1171client # [ 0.434407] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1172lb # [ 0.425617] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1173worker1 # [ 0.430408] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1174lb # [ 0.426953] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1175worker2 # [ 0.429927] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1176client # [ 0.435880] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1177lb # [ 0.427344] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1178worker1 # [ 0.432017] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1179worker2 # [ 0.430170] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1180client # [ 0.436799] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1181lb # [ 0.428931] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1182worker2 # [ 0.431693] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1183client # [ 0.438261] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1184worker1 # [ 0.435553] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1185lb # [ 0.430330] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1186worker2 # [ 0.433195] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1187worker1 # [ 0.436261] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1188lb # [ 0.431183] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1189client # [ 0.440799] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1190worker2 # [ 0.434162] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1191worker1 # [ 0.436637] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1192lb # [ 0.432047] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1193client # [ 0.441488] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1194worker2 # [ 0.435686] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1195lb # [ 0.432330] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1196worker1 # [ 0.438165] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1197client # [ 0.442604] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1198lb # [ 0.433906] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1199client # [ 0.443453] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1200worker1 # [ 0.440634] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1201worker2 # [ 0.437171] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1202lb # [ 0.435338] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1203worker1 # [ 0.441573] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1204worker2 # [ 0.438803] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1205client # [ 0.444875] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1206lb # [ 0.436312] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1207client # [ 0.445721] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1208worker2 # [ 0.439185] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1209worker1 # [ 0.442386] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1210client # [ 0.446618] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1211lb # [ 0.437822] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1212worker2 # [ 0.440707] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1213worker1 # [ 0.444188] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1214client # [ 0.447425] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1215worker2 # [ 0.442923] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1216lb # [ 0.440085] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1217worker1 # [ 0.446433] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1218client # [ 0.448665] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1219worker2 # [ 0.443171] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1220lb # [ 0.440331] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1221worker1 # [ 0.447256] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1222worker2 # [ 0.444095] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1223lb # [ 0.441334] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1224client # [ 0.449669] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1225worker1 # [ 0.447638] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1226client # [ 0.451527] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1227lb # [ 0.442889] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1228worker1 # [ 0.449195] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1229worker2 # [ 0.446212] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1230lb # [ 0.444344] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1231worker2 # [ 0.447968] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1232lb # [ 0.445189] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1233worker2 # [ 0.449081] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1234lb # [ 0.446102] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1235worker1 # [ 0.452624] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1236worker2 # [ 0.450834] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1237worker1 # [ 0.453622] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1238lb # [ 0.447778] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1239worker1 # [ 0.454561] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1240lb # [ 0.449010] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1241worker1 # [ 0.456126] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1242lb # [ 0.449524] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1243lb # [ 0.450967] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1244worker1 # [ 0.457622] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1245client # [ 0.452055] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1246worker1 # [ 0.458469] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1247client # [ 0.454688] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1248worker1 # [ 0.459638] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1249client # [ 0.455756] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1250worker1 # [ 0.460621] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1251client # [ 0.457574] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1252worker1 # [ 0.462153] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1253worker2 # [ 0.451376] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1254client # [ 0.458129] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1255worker1 # [ 0.463628] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1256worker2 # [ 0.453962] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1257client # [ 0.459153] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1258worker1 # [ 0.464603] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1259worker2 # [ 0.455271] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1260client # [ 0.460111] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1261worker1 # [ 0.466022] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1262worker2 # [ 0.456887] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1263client # [ 0.461898] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1264lb # [ 0.451529] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1265client # [ 0.462746] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1266worker2 # [ 0.457457] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1267lb # [ 0.454033] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1268worker1 # [ 0.468644] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1269worker2 # [ 0.458450] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1270client # [ 0.463895] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1271worker1 # [ 0.469490] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1272lb # [ 0.454579] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1273worker2 # [ 0.459406] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1274client # [ 0.465656] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1275worker1 # [ 0.470356] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1276lb # [ 0.455966] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1277worker1 # [ 0.471192] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1278lb # [ 0.456659] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1279worker2 # [ 0.461191] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1280worker2 # [ 0.462169] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1281client # [ 0.469394] ACPI: PCI: Interrupt link LNKA configured for IRQ 101282lb # [ 0.457608] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1283worker1 # [ 0.472625] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1284client # [ 0.469973] ACPI: PCI: Interrupt link LNKB configured for IRQ 101285worker2 # [ 0.463484] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1286worker1 # [ 0.473458] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1287lb # [ 0.458618] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1288client # [ 0.470964] ACPI: PCI: Interrupt link LNKC configured for IRQ 111289worker2 # [ 0.464988] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1290client # [ 0.471965] ACPI: PCI: Interrupt link LNKD configured for IRQ 111291worker1 # [ 0.474322] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1292lb # [ 0.460352] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1293client # [ 0.472972] ACPI: PCI: Interrupt link LNKE configured for IRQ 101294worker1 # [ 0.475188] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1295client # [ 0.473969] ACPI: PCI: Interrupt link LNKF configured for IRQ 101296lb # [ 0.461257] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1297client # [ 0.474969] ACPI: PCI: Interrupt link LNKG configured for IRQ 111298worker2 # [ 0.468823] ACPI: PCI: Interrupt link LNKA configured for IRQ 101299worker1 # [ 0.476488] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1300lb # [ 0.462674] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1301client # [ 0.475965] ACPI: PCI: Interrupt link LNKH configured for IRQ 111302worker2 # [ 0.469277] ACPI: PCI: Interrupt link LNKB configured for IRQ 101303client # [ 0.476901] ACPI: PCI: Interrupt link GSIA configured for IRQ 161304worker1 # [ 0.477445] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1305lb # [ 0.464050] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1306worker2 # [ 0.470294] ACPI: PCI: Interrupt link LNKC configured for IRQ 111307client # [ 0.477843] ACPI: PCI: Interrupt link GSIB configured for IRQ 171308worker1 # [ 0.479320] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1309client # [ 0.478614] ACPI: PCI: Interrupt link GSIC configured for IRQ 181310worker2 # [ 0.471262] ACPI: PCI: Interrupt link LNKD configured for IRQ 111311client # [ 0.478882] ACPI: PCI: Interrupt link GSID configured for IRQ 191312worker2 # [ 0.472272] ACPI: PCI: Interrupt link LNKE configured for IRQ 101313client # [ 0.479882] ACPI: PCI: Interrupt link GSIE configured for IRQ 201314worker2 # [ 0.473260] ACPI: PCI: Interrupt link LNKF configured for IRQ 101315lb # [ 0.467393] ACPI: PCI: Interrupt link LNKA configured for IRQ 101316client # [ 0.480859] ACPI: PCI: Interrupt link GSIF configured for IRQ 211317worker2 # [ 0.474265] ACPI: PCI: Interrupt link LNKG configured for IRQ 111318lb # [ 0.468440] ACPI: PCI: Interrupt link LNKB configured for IRQ 101319client # [ 0.481828] ACPI: PCI: Interrupt link GSIG configured for IRQ 221320worker2 # [ 0.475262] ACPI: PCI: Interrupt link LNKH configured for IRQ 111321lb # [ 0.469420] ACPI: PCI: Interrupt link LNKC configured for IRQ 111322client # [ 0.482764] ACPI: PCI: Interrupt link GSIH configured for IRQ 231323worker2 # [ 0.476196] ACPI: PCI: Interrupt link GSIA configured for IRQ 161324lb # [ 0.470431] ACPI: PCI: Interrupt link LNKD configured for IRQ 111325worker2 # [ 0.477179] ACPI: PCI: Interrupt link GSIB configured for IRQ 171326client # [ 0.484637] iommu: Default domain type: Translated1327lb # [ 0.471433] ACPI: PCI: Interrupt link LNKE configured for IRQ 101328worker2 # [ 0.478177] ACPI: PCI: Interrupt link GSIC configured for IRQ 181329client # [ 0.484875] iommu: DMA domain TLB invalidation policy: lazy mode1330lb # [ 0.472418] ACPI: PCI: Interrupt link LNKF configured for IRQ 101331worker2 # [ 0.479149] ACPI: PCI: Interrupt link GSID configured for IRQ 191332client # [ 0.486068] ACPI: bus type USB registered1333lb # [ 0.473423] ACPI: PCI: Interrupt link LNKG configured for IRQ 111334worker2 # [ 0.479899] ACPI: PCI: Interrupt link GSIE configured for IRQ 201335client # [ 0.486815] usbcore: registered new interface driver usbfs1336worker2 # [ 0.480898] ACPI: PCI: Interrupt link GSIF configured for IRQ 211337lb # [ 0.474427] ACPI: PCI: Interrupt link LNKH configured for IRQ 111338client # [ 0.487541] usbcore: registered new interface driver hub1339client # [ 0.487885] usbcore: registered new device driver usb1340worker2 # [ 0.481178] ACPI: PCI: Interrupt link GSIG configured for IRQ 221341lb # [ 0.475364] ACPI: PCI: Interrupt link GSIA configured for IRQ 161342worker2 # [ 0.482131] ACPI: PCI: Interrupt link GSIH configured for IRQ 231343lb # [ 0.476348] ACPI: PCI: Interrupt link GSIB configured for IRQ 171344client # [ 0.489563] NetLabel: Initializing1345worker1 # [ 0.479807] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1346lb # [ 0.477340] ACPI: PCI: Interrupt link GSIC configured for IRQ 181347client # [ 0.489873] NetLabel: domain hash size = 1281348worker2 # [ 0.483902] iommu: Default domain type: Translated1349lb # [ 0.478353] ACPI: PCI: Interrupt link GSID configured for IRQ 191350client # [ 0.490728] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1351worker1 # [ 0.482680] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1352worker2 # [ 0.484172] iommu: DMA domain TLB invalidation policy: lazy mode1353client # [ 0.491703] NetLabel: unlabeled traffic allowed by default1354lb # [ 0.479341] ACPI: PCI: Interrupt link GSIE configured for IRQ 201355worker2 # [ 0.485335] ACPI: bus type USB registered1356client # [ 0.492565] PCI: Using ACPI for IRQ routing1357worker1 # [ 0.483799] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1358lb # [ 0.480340] ACPI: PCI: Interrupt link GSIF configured for IRQ 211359worker2 # [ 0.486082] usbcore: registered new interface driver usbfs1360lb # [ 0.481298] ACPI: PCI: Interrupt link GSIG configured for IRQ 221361worker2 # [ 0.486858] usbcore: registered new interface driver hub1362worker1 # [ 0.485373] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1363lb # [ 0.482082] ACPI: PCI: Interrupt link GSIH configured for IRQ 231364worker2 # [ 0.487174] usbcore: registered new device driver usb1365worker1 # [ 0.485894] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1366lb # [ 0.483425] iommu: Default domain type: Translated1367worker2 # [ 0.489196] NetLabel: Initializing1368worker2 # [ 0.489938] NetLabel: domain hash size = 1281369lb # [ 0.484268] iommu: DMA domain TLB invalidation policy: lazy mode1370worker1 # [ 0.486940] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1371worker2 # [ 0.490163] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1372lb # [ 0.485326] ACPI: bus type USB registered1373worker1 # [ 0.487874] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1374worker2 # [ 0.491190] NetLabel: unlabeled traffic allowed by default1375lb # [ 0.486070] usbcore: registered new interface driver usbfs1376worker2 # [ 0.492168] PCI: Using ACPI for IRQ routing1377lb # [ 0.486340] usbcore: registered new interface driver hub1378lb # [ 0.487254] usbcore: registered new device driver usb1379worker1 # [ 0.490413] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1380worker1 # [ 0.491287] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1381lb # [ 0.489004] NetLabel: Initializing1382lb # [ 0.489324] NetLabel: domain hash size = 1281383worker1 # [ 0.491947] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1384lb # [ 0.490129] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1385lb # [ 0.491164] NetLabel: unlabeled traffic allowed by default1386worker1 # [ 0.493283] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1387lb # [ 0.492130] PCI: Using ACPI for IRQ routing1388worker1 # [ 0.496693] ACPI: PCI: Interrupt link LNKA configured for IRQ 101389worker1 # [ 0.497729] ACPI: PCI: Interrupt link LNKB configured for IRQ 101390worker1 # [ 0.498729] ACPI: PCI: Interrupt link LNKC configured for IRQ 111391worker1 # [ 0.499718] ACPI: PCI: Interrupt link LNKD configured for IRQ 111392worker1 # [ 0.500711] ACPI: PCI: Interrupt link LNKE configured for IRQ 101393worker1 # [ 0.501719] ACPI: PCI: Interrupt link LNKF configured for IRQ 101394worker1 # [ 0.502715] ACPI: PCI: Interrupt link LNKG configured for IRQ 111395worker1 # [ 0.503713] ACPI: PCI: Interrupt link LNKH configured for IRQ 111396worker1 # [ 0.504652] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397worker1 # [ 0.505629] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398worker1 # [ 0.506629] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399worker1 # [ 0.507649] ACPI: PCI: Interrupt link GSID configured for IRQ 191400worker1 # [ 0.508629] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401worker1 # [ 0.509623] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402worker1 # [ 0.510591] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403worker1 # [ 0.511634] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404worker1 # [ 0.513605] iommu: Default domain type: Translated1405worker1 # [ 0.514415] iommu: DMA domain TLB invalidation policy: lazy mode1406worker1 # [ 0.515590] ACPI: bus type USB registered1407worker1 # [ 0.516180] usbcore: registered new interface driver usbfs1408worker1 # [ 0.516629] usbcore: registered new interface driver hub1409worker1 # [ 0.517532] usbcore: registered new device driver usb1410worker1 # [ 0.519201] NetLabel: Initializing1411client # [ 0.535993] pci 0000:00:01.0: vgaarb: setting as boot VGA device1412worker1 # [ 0.519616] NetLabel: domain hash size = 1281413client # [ 0.536864] pci 0000:00:01.0: vgaarb: bridge control possible1414worker1 # [ 0.520333] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1415client # [ 0.536864] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1416worker1 # [ 0.521393] NetLabel: unlabeled traffic allowed by default1417client # [ 0.536871] vgaarb: loaded1418worker1 # [ 0.522293] PCI: Using ACPI for IRQ routing1419client # [ 0.537609] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420client # [ 0.537869] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.540951] clocksource: Switched to clocksource kvm-clock1422worker2 # [ 0.537040] pci 0000:00:01.0: vgaarb: setting as boot VGA device1423worker2 # [ 0.537159] pci 0000:00:01.0: vgaarb: bridge control possible1424client # [ 0.544462] VFS: Disk quotas dquot_6.6.01425worker2 # [ 0.537159] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1426worker2 # [ 0.537168] vgaarb: loaded1427client # [ 0.545158] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1428worker2 # [ 0.537929] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01429client # [ 0.546508] pnp: PnP ACPI init1430worker2 # [ 0.538163] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1431client # [ 0.547262] ACPI: IRQ 4 override to edge(!), high(!)1432lb # [ 0.535782] pci 0000:00:01.0: vgaarb: setting as boot VGA device1433lb # [ 0.536318] pci 0000:00:01.0: vgaarb: bridge control possible1434client # [ 0.548212] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1435client # [ 0.549726] pnp: PnP ACPI: found 6 devices1436lb # [ 0.536318] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1437lb # [ 0.536326] vgaarb: loaded1438lb # [ 0.537039] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01439worker2 # [ 0.542250] clocksource: Switched to clocksource kvm-clock1440lb # [ 0.537322] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1441worker2 # [ 0.543964] VFS: Disk quotas dquot_6.6.01442lb # [ 0.540410] clocksource: Switched to clocksource kvm-clock1443worker2 # [ 0.546555] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1444worker2 # [ 0.547900] pnp: PnP ACPI init1445client # [ 0.557360] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1446worker2 # [ 0.548734] ACPI: IRQ 4 override to edge(!), high(!)1447client # [ 0.558827] clocksource: Switched to clocksource acpi_pm1448client # [ 0.559779] NET: Registered PF_INET protocol family1449lb # [ 0.543985] VFS: Disk quotas dquot_6.6.01450worker2 # [ 0.549751] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1451lb # [ 0.544691] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1452worker2 # [ 0.551290] pnp: PnP ACPI: found 6 devices1453client # [ 0.560932] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1454lb # [ 0.546020] pnp: PnP ACPI init1455lb # [ 0.546776] ACPI: IRQ 4 override to edge(!), high(!)1456lb # [ 0.547754] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1457lb # [ 0.549253] pnp: PnP ACPI: found 6 devices1458worker2 # [ 0.559239] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1459worker2 # [ 0.560767] clocksource: Switched to clocksource acpi_pm1460worker2 # [ 0.561785] NET: Registered PF_INET protocol family1461worker2 # [ 0.563012] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1462lb # [ 0.556912] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1463lb # [ 0.558333] clocksource: Switched to clocksource acpi_pm1464lb # [ 0.559321] NET: Registered PF_INET protocol family1465lb # [ 0.560496] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1466client # [ 0.578510] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1467worker1 # [ 0.566240] pci 0000:00:01.0: vgaarb: setting as boot VGA device1468client # [ 0.580108] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1469worker1 # [ 0.566611] pci 0000:00:01.0: vgaarb: bridge control possible1470client # [ 0.581382] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1471worker1 # [ 0.566611] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1472worker1 # [ 0.566619] vgaarb: loaded1473client # [ 0.582734] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1474worker1 # [ 0.567318] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01475client # [ 0.583976] TCP: Hash tables configured (established 16384 bind 16384)1476worker1 # [ 0.567616] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1477client # [ 0.585088] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1478client # [ 0.586362] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1479client # [ 0.587472] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1480client # [ 0.588722] NET: Registered PF_UNIX/PF_LOCAL protocol family1481worker1 # [ 0.570704] clocksource: Switched to clocksource kvm-clock1482client # [ 0.589685] NET: Registered PF_XDP protocol family1483worker2 # [ 0.579623] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1484client # [ 0.590507] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1485worker2 # [ 0.581187] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1486client # [ 0.591539] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1487worker1 # [ 0.574232] VFS: Disk quotas dquot_6.6.01488client # [ 0.592523] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1489worker2 # [ 0.582502] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1490lb # [ 0.576785] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1491worker1 # [ 0.574956] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1492client # [ 0.593599] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1493worker2 # [ 0.583808] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1494worker1 # [ 0.576249] pnp: PnP ACPI init1495lb # [ 0.578292] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1496client # [ 0.594669] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1497worker2 # [ 0.585026] TCP: Hash tables configured (established 16384 bind 16384)1498worker1 # [ 0.577021] ACPI: IRQ 4 override to edge(!), high(!)1499client # [ 0.595729] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1500lb # [ 0.579553] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1501worker2 # [ 0.586120] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1502worker1 # [ 0.578047] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1503lb # [ 0.580842] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1504client # [ 0.597336] ACPI: \_SB_.GSIA: Enabled at IRQ 161505worker2 # [ 0.587401] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1506worker1 # [ 0.579596] pnp: PnP ACPI: found 6 devices1507lb # [ 0.582057] TCP: Hash tables configured (established 16384 bind 16384)1508worker2 # [ 0.588501] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1509client # [ 0.599637] ACPI: \_SB_.GSIB: Enabled at IRQ 171510lb # [ 0.583221] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1511worker2 # [ 0.589757] NET: Registered PF_UNIX/PF_LOCAL protocol family1512worker2 # [ 0.590702] NET: Registered PF_XDP protocol family1513lb # [ 0.584515] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1514client # [ 0.601538] ACPI: \_SB_.GSIC: Enabled at IRQ 181515worker2 # [ 0.591561] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1516lb # [ 0.585607] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1517worker2 # [ 0.592569] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1518lb # [ 0.586761] NET: Registered PF_UNIX/PF_LOCAL protocol family1519client # [ 0.603471] ACPI: \_SB_.GSID: Enabled at IRQ 191520lb # [ 0.587684] NET: Registered PF_XDP protocol family1521worker2 # [ 0.593591] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1522lb # [ 0.588486] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1523worker2 # [ 0.594685] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1524client # [ 0.605089] PCI: CLS 0 bytes, default 641525lb # [ 0.589436] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1526worker1 # [ 0.587140] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1527worker2 # [ 0.595779] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1528client # [ 0.605941] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1529lb # [ 0.590379] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1530worker1 # [ 0.588528] clocksource: Switched to clocksource acpi_pm1531worker2 # [ 0.596838] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1532client # [ 0.607594] Trying to unpack rootfs image as initramfs...1533lb # [ 0.591416] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1534worker1 # [ 0.589457] NET: Registered PF_INET protocol family1535worker2 # [ 0.598615] ACPI: \_SB_.GSIA: Enabled at IRQ 161536lb # [ 0.592445] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1537worker1 # [ 0.590642] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1538lb # [ 0.593480] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1539worker2 # [ 0.600975] ACPI: \_SB_.GSIB: Enabled at IRQ 171540lb # [ 0.595122] ACPI: \_SB_.GSIA: Enabled at IRQ 161541worker2 # [ 0.602997] ACPI: \_SB_.GSIC: Enabled at IRQ 181542lb # [ 0.597755] ACPI: \_SB_.GSIB: Enabled at IRQ 171543worker2 # [ 0.605573] ACPI: \_SB_.GSID: Enabled at IRQ 191544lb # [ 0.599773] ACPI: \_SB_.GSIC: Enabled at IRQ 181545worker2 # [ 0.607276] PCI: CLS 0 bytes, default 641546lb # [ 0.601814] ACPI: \_SB_.GSID: Enabled at IRQ 191547worker2 # [ 0.608152] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1548lb # [ 0.603498] PCI: CLS 0 bytes, default 641549worker2 # [ 0.609940] Trying to unpack rootfs image as initramfs...1550lb # [ 0.604417] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1551lb # [ 0.606061] Trying to unpack rootfs image as initramfs...1552worker1 # [ 0.607496] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1553worker1 # [ 0.608924] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1554worker1 # [ 0.610539] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1555worker1 # [ 0.611938] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1556worker1 # [ 0.613251] TCP: Hash tables configured (established 16384 bind 16384)1557worker1 # [ 0.614443] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1558worker1 # [ 0.615765] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559worker1 # [ 0.616901] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560worker1 # [ 0.618181] NET: Registered PF_UNIX/PF_LOCAL protocol family1561worker1 # [ 0.619203] NET: Registered PF_XDP protocol family1562worker1 # [ 0.620076] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563worker1 # [ 0.621227] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564worker1 # [ 0.622314] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565worker1 # [ 0.623538] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566worker1 # [ 0.624669] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567worker1 # [ 0.625854] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568worker1 # [ 0.627670] ACPI: \_SB_.GSIA: Enabled at IRQ 161569worker1 # [ 0.630138] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker1 # [ 0.632134] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker1 # [ 0.634092] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker1 # [ 0.635794] PCI: CLS 0 bytes, default 641573client # [ 0.655054] Initialise system trusted keyrings1574worker1 # [ 0.636710] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575client # [ 0.655975] workingset: timestamp_bits=40 max_order=19 bucket_order=01576worker1 # [ 0.638646] Trying to unpack rootfs image as initramfs...1577worker2 # [ 0.656786] Initialise system trusted keyrings1578lb # [ 0.651392] Initialise system trusted keyrings1579worker2 # [ 0.660231] workingset: timestamp_bits=40 max_order=19 bucket_order=01580lb # [ 0.655001] workingset: timestamp_bits=40 max_order=19 bucket_order=01581client # [ 0.677743] Key type asymmetric registered1582client # [ 0.678422] Asymmetric key parser 'x509' registered1583client # [ 0.679247] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584client # [ 0.684748] io scheduler mq-deadline registered1585client # [ 0.685497] io scheduler kyber registered1586client # [ 0.689171] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1587client # [ 0.690393] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1588worker2 # [ 0.682402] Key type asymmetric registered1589lb # [ 0.676404] Key type asymmetric registered1590worker2 # [ 0.683117] Asymmetric key parser 'x509' registered1591lb # [ 0.677142] Asymmetric key parser 'x509' registered1592client # [ 0.694397] Linux agpgart interface v0.1031593worker2 # [ 0.683996] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1594client # [ 0.695144] ACPI: bus type drm_connector registered1595lb # [ 0.680086] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1596client # [ 0.698097] usbcore: registered new interface driver usbserial_generic1597lb # [ 0.683017] io scheduler mq-deadline registered1598worker2 # [ 0.689319] io scheduler mq-deadline registered1599client # [ 0.699146] usbserial: USB Serial support registered for generic1600lb # [ 0.683784] io scheduler kyber registered1601worker2 # [ 0.690110] io scheduler kyber registered1602lb # [ 0.686517] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1603worker2 # [ 0.693706] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1604worker1 # [ 0.685717] Initialise system trusted keyrings1605client # [ 0.703610] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1606lb # [ 0.687739] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1607client # [ 0.703610] Please enable it if your BIOS has the CPPC option.1608worker1 # [ 0.686619] workingset: timestamp_bits=40 max_order=19 bucket_order=01609worker2 # [ 0.694968] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1610client # [ 0.705709] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1611worker2 # [ 0.698980] Linux agpgart interface v0.1031612client # [ 0.708713] drop_monitor: Initializing network drop monitor service1613lb # [ 0.693364] Linux agpgart interface v0.1031614worker2 # [ 0.699766] ACPI: bus type drm_connector registered1615client # [ 0.709886] NET: Registered PF_INET6 protocol family1616lb # [ 0.694160] ACPI: bus type drm_connector registered1617client # [ 0.713042] Segment Routing with IPv61618lb # [ 0.697497] usbcore: registered new interface driver usbserial_generic1619lb # [ 0.698575] usbserial: USB Serial support registered for generic1620worker2 # [ 0.704624] usbcore: registered new interface driver usbserial_generic1621client # [ 0.715624] In-situ OAM (IOAM) with IPv61622worker2 # [ 0.705781] usbserial: USB Serial support registered for generic1623client # [ 0.716696] IPI shorthand broadcast: enabled1624lb # [ 0.700960] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1625lb # [ 0.700960] Please enable it if your BIOS has the CPPC option.1626lb # [ 0.703311] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1627worker2 # [ 0.709238] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1628worker2 # [ 0.709238] Please enable it if your BIOS has the CPPC option.1629worker2 # [ 0.711465] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1630lb # [ 0.708093] drop_monitor: Initializing network drop monitor service1631lb # [ 0.709417] NET: Registered PF_INET6 protocol family1632client # [ 0.725033] sched_clock: Marking stable (588015509, 136567807)->(796278949, -71695633)1633worker2 # [ 0.715494] drop_monitor: Initializing network drop monitor service1634worker2 # [ 0.716716] NET: Registered PF_INET6 protocol family1635worker1 # [ 0.709561] Key type asymmetric registered1636lb # [ 0.712414] Segment Routing with IPv61637worker1 # [ 0.710347] Asymmetric key parser 'x509' registered1638client # [ 0.729819] registered taskstats version 11639worker1 # [ 0.711247] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1640client # [ 0.730756] Loading compiled-in X.509 certificates1641worker2 # [ 0.720813] Segment Routing with IPv61642lb # [ 0.714978] In-situ OAM (IOAM) with IPv61643lb # [ 0.716036] IPI shorthand broadcast: enabled1644worker2 # [ 0.724220] In-situ OAM (IOAM) with IPv61645worker1 # [ 0.716468] io scheduler mq-deadline registered1646worker2 # [ 0.725487] IPI shorthand broadcast: enabled1647worker1 # [ 0.717261] io scheduler kyber registered1648worker1 # [ 0.719929] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1649worker1 # [ 0.721254] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1650lb # [ 0.724350] sched_clock: Marking stable (588013861, 135926345)->(804234709, -80294503)1651lb # [ 0.728039] registered taskstats version 11652worker2 # [ 0.733975] sched_clock: Marking stable (598015524, 135161655)->(811757012, -78579833)1653lb # [ 0.728987] Loading compiled-in X.509 certificates1654worker1 # [ 0.727071] Linux agpgart interface v0.1031655worker1 # [ 0.727848] ACPI: bus type drm_connector registered1656worker2 # [ 0.737521] registered taskstats version 11657worker2 # [ 0.738576] Loading compiled-in X.509 certificates1658worker1 # [ 0.730828] usbcore: registered new interface driver usbserial_generic1659client # [ 0.749600] Demotion targets for Node 0: null1660client # [ 0.750455] Key type .fscrypt registered1661worker1 # [ 0.731964] usbserial: USB Serial support registered for generic1662client # [ 0.751146] Key type fscrypt-provisioning registered1663client # [ 0.752110] ima: No TPM chip found, activating TPM-bypass!1664worker1 # [ 0.735324] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1665worker1 # [ 0.735324] Please enable it if your BIOS has the CPPC option.1666worker1 # [ 0.737640] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1667client # [ 0.756602] ima: Allocated hash algorithm: sha11668client # [ 0.757379] ima: No architecture policies found1669client # [ 0.759604] PM: Magic number: 10:433:1191670worker1 # [ 0.741453] drop_monitor: Initializing network drop monitor service1671worker1 # [ 0.742652] NET: Registered PF_INET6 protocol family1672client # [ 0.761206] RAS: Correctable Errors collector initialized.1673lb # [ 0.747954] Demotion targets for Node 0: null1674lb # [ 0.748808] Key type .fscrypt registered1675worker1 # [ 0.746814] Segment Routing with IPv61676worker1 # [ 0.747508] In-situ OAM (IOAM) with IPv61677lb # [ 0.749956] Key type fscrypt-provisioning registered1678lb # [ 0.750909] ima: No TPM chip found, activating TPM-bypass!1679lb # [ 0.751870] ima: Allocated hash algorithm: sha11680worker2 # [ 0.758405] Demotion targets for Node 0: null1681worker1 # [ 0.750593] IPI shorthand broadcast: enabled1682client # [ 0.769305] clk: Disabling unused clocks1683worker2 # [ 0.761240] Key type .fscrypt registered1684lb # [ 0.755201] ima: No architecture policies found1685worker2 # [ 0.762025] Key type fscrypt-provisioning registered1686client # [ 0.772602] PM: genpd: Disabling unused power domains1687worker2 # [ 0.763030] ima: No TPM chip found, activating TPM-bypass!1688lb # [ 0.757960] PM: Magic number: 10:433:1191689worker2 # [ 0.765206] ima: Allocated hash algorithm: sha11690lb # [ 0.759594] RAS: Correctable Errors collector initialized.1691worker2 # [ 0.766022] ima: No architecture policies found1692worker1 # [ 0.758910] sched_clock: Marking stable (612015995, 146280189)->(833061125, -74764941)1693worker2 # [ 0.770201] PM: Magic number: 10:433:1191694worker1 # [ 0.762480] registered taskstats version 11695worker1 # [ 0.763525] Loading compiled-in X.509 certificates1696worker2 # [ 0.774267] RAS: Correctable Errors collector initialized.1697lb # [ 0.769643] clk: Disabling unused clocks1698lb # [ 0.771962] PM: genpd: Disabling unused power domains1699worker2 # [ 0.783556] clk: Disabling unused clocks1700worker2 # [ 0.786195] PM: genpd: Disabling unused power domains1701worker1 # [ 0.782306] Demotion targets for Node 0: null1702worker1 # [ 0.784359] Key type .fscrypt registered1703worker1 # [ 0.785115] Key type fscrypt-provisioning registered1704worker1 # [ 0.786143] ima: No TPM chip found, activating TPM-bypass!1705worker1 # [ 0.789315] ima: Allocated hash algorithm: sha11706worker1 # [ 0.790178] ima: No architecture policies found1707worker1 # [ 0.794310] PM: Magic number: 10:433:1191708worker1 # [ 0.796039] RAS: Correctable Errors collector initialized.1709worker1 # [ 0.805208] clk: Disabling unused clocks1710worker1 # [ 0.809319] PM: genpd: Disabling unused power domains1711client # [ 0.942245] Freeing initrd memory: 29096K1712client # [ 0.945420] Freeing unused decrypted memory: 2028K1713client # [ 0.948079] Freeing unused kernel image (initmem) memory: 3644K1714client # [ 0.949169] Write protecting the kernel read-only data: 32768k1715client # [ 0.951074] Freeing unused kernel image (text/rodata gap) memory: 1208K1716client # [ 0.952632] Freeing unused kernel image (rodata/data gap) memory: 752K1717lb # [ 0.943439] Freeing initrd memory: 29092K1718lb # [ 0.946605] Freeing unused decrypted memory: 2028K1719lb # [ 0.949260] Freeing unused kernel image (initmem) memory: 3644K1720lb # [ 0.950395] Write protecting the kernel read-only data: 32768k1721lb # [ 0.952309] Freeing unused kernel image (text/rodata gap) memory: 1208K1722lb # [ 0.953878] Freeing unused kernel image (rodata/data gap) memory: 752K1723worker2 # [ 0.974490] Freeing initrd memory: 29092K1724worker2 # [ 0.977644] Freeing unused decrypted memory: 2028K1725worker2 # [ 0.980273] Freeing unused kernel image (initmem) memory: 3644K1726worker2 # [ 0.981386] Write protecting the kernel read-only data: 32768k1727worker2 # [ 0.983299] Freeing unused kernel image (text/rodata gap) memory: 1208K1728worker2 # [ 0.984833] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker1 # [ 0.984607] Freeing initrd memory: 29092K1730client # [ 1.004111] x86/mm: Checked W+X mappings: passed, no W+X pages found.1731client # [ 1.005200] Run /init as init process1732worker1 # [ 0.987780] Freeing unused decrypted memory: 2028K1733worker1 # [ 0.990454] Freeing unused kernel image (initmem) memory: 3644K1734worker1 # [ 0.991597] Write protecting the kernel read-only data: 32768k1735worker1 # [ 0.993505] Freeing unused kernel image (text/rodata gap) memory: 1208K1736worker1 # [ 0.995063] Freeing unused kernel image (rodata/data gap) memory: 752K1737client # [ 1.015491] systemd[1]: Inserted module 'autofs4'1738lb # [ 1.005264] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739lb # [ 1.006375] Run /init as init process1740client # [ 1.031857] fuse: init (API version 7.45)1741lb # [ 1.016916] systemd[1]: Inserted module 'autofs4'1742client # [ 1.037801] ACPI: \_SB_.GSIG: Enabled at IRQ 221743client # [ 1.040384] ACPI: \_SB_.GSIH: Enabled at IRQ 231744client # [ 1.043876] ACPI: \_SB_.GSIE: Enabled at IRQ 201745client # [ 1.046139] ACPI: \_SB_.GSIF: Enabled at IRQ 211746worker2 # [ 1.036347] x86/mm: Checked W+X mappings: passed, no W+X pages found.1747worker2 # [ 1.037417] Run /init as init process1748lb # [ 1.033682] fuse: init (API version 7.45)1749lb # [ 1.039449] ACPI: \_SB_.GSIG: Enabled at IRQ 221750worker2 # [ 1.047971] systemd[1]: Inserted module 'autofs4'1751lb # [ 1.042068] ACPI: \_SB_.GSIH: Enabled at IRQ 231752lb # [ 1.045248] ACPI: \_SB_.GSIE: Enabled at IRQ 201753lb # [ 1.047633] ACPI: \_SB_.GSIF: Enabled at IRQ 211754worker1 # [ 1.046565] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755worker1 # [ 1.047735] Run /init as init process1756worker2 # [ 1.064498] fuse: init (API version 7.45)1757client # [ 1.075445] systemd[1]: Successfully made /usr/ read-only.1758worker1 # [ 1.058447] systemd[1]: Inserted module 'autofs4'1759worker2 # [ 1.070295] ACPI: \_SB_.GSIG: Enabled at IRQ 221760worker2 # [ 1.072770] ACPI: \_SB_.GSIH: Enabled at IRQ 231761worker2 # [ 1.076531] ACPI: \_SB_.GSIE: Enabled at IRQ 201762worker2 # [ 1.079277] ACPI: \_SB_.GSIF: Enabled at IRQ 211763worker1 # [ 1.074885] fuse: init (API version 7.45)1764lb # [ 1.076886] systemd[1]: Successfully made /usr/ read-only.1765worker1 # [ 1.080768] ACPI: \_SB_.GSIG: Enabled at IRQ 221766worker1 # [ 1.083271] ACPI: \_SB_.GSIH: Enabled at IRQ 231767worker1 # [ 1.087249] ACPI: \_SB_.GSIE: Enabled at IRQ 201768worker1 # [ 1.090262] ACPI: \_SB_.GSIF: Enabled at IRQ 211769worker2 # [ 1.113246] systemd[1]: Successfully made /usr/ read-only.1770worker1 # [ 1.123408] systemd[1]: Successfully made /usr/ read-only.1771client # [ 1.412143] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772client # [ 1.424210] systemd[1]: Detected virtualization kvm.1773client # [ 1.426395] systemd[1]: Detected architecture x86-64.1774client # [ 1.428561] systemd[1]: Running in initrd.1775client # [ 1.431149] systemd[1]: Initializing machine ID from random generator.1776client # [ 1.434172] systemd[1]: Hostname set to <client>.1777lb # [ 1.413430] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778lb # [ 1.425879] systemd[1]: Detected virtualization kvm.1779lb # [ 1.428041] systemd[1]: Detected architecture x86-64.1780lb # [ 1.430235] systemd[1]: Running in initrd.1781lb # [ 1.432854] systemd[1]: Initializing machine ID from random generator.1782lb # [ 1.436069] systemd[1]: Hostname set to <lb>.1783worker2 # [ 1.448828] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784worker2 # [ 1.453705] systemd[1]: Detected virtualization kvm.1785worker2 # [ 1.454561] systemd[1]: Detected architecture x86-64.1786worker2 # [ 1.455381] systemd[1]: Running in initrd.1787worker2 # [ 1.456490] systemd[1]: Initializing machine ID from random generator.1788worker2 # [ 1.457670] systemd[1]: Hostname set to <worker2>.1789worker1 # [ 1.460637] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker1 # [ 1.471139] systemd[1]: Detected virtualization kvm.1791worker1 # [ 1.473047] systemd[1]: Detected architecture x86-64.1792worker1 # [ 1.475799] systemd[1]: Running in initrd.1793worker1 # [ 1.479078] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.482217] systemd[1]: Hostname set to <worker1>.1795client # [ 1.549912] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796client # [ 1.590373] systemd[1]: Queued start job for default target Initrd Default Target.1797client # [ 1.595529] systemd[1]: Created slice Slice /system/modprobe.1798client # [ 1.596804] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1799client # [ 1.598174] systemd[1]: Expecting device /dev/disk/by-label/nixos...1800client # [ 1.599254] systemd[1]: Reached target Path Units.1801client # [ 1.600114] systemd[1]: Reached target Slice Units.1802client # [ 1.600968] systemd[1]: Reached target Swaps.1803client # [ 1.601761] systemd[1]: Reached target Timer Units.1804client # [ 1.602718] systemd[1]: Listening on D-Bus System Message Bus Socket.1805client # [ 1.603896] systemd[1]: Listening on Journal Socket (/dev/log).1806client # [ 1.605035] systemd[1]: Listening on Journal Sockets.1807client # [ 1.606021] systemd[1]: Listening on udev Control Socket.1808client # [ 1.607015] systemd[1]: Listening on udev Kernel Socket.1809client # [ 1.607975] systemd[1]: Reached target Socket Units.1810client # [ 1.609763] systemd[1]: Starting Create List of Static Device Nodes...1811client # [ 1.617795] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1812client # [ 1.625551] systemd[1]: Starting Load Kernel Module configfs...1813client # [ 1.635677] systemd[1]: Starting Journal Service...1814client # [ 1.647668] systemd[1]: Starting Load Kernel Modules...1815lb # [ 1.650405] systemd[1]: bpf-restrict-fs: LSM BPF program attached1816client # [ 1.654657] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1817worker2 # [ 1.662794] systemd[1]: bpf-restrict-fs: LSM BPF program attached1818client # [ 1.675103] netfs: FS-Cache loaded1819client # [ 1.679803] 9pnet: Installing 9P2000 support1820client # [ 1.689933] systemd[1]: Starting Coldplug All udev Devices...1821lb # [ 1.690831] systemd[1]: Queued start job for default target Initrd Default Target.1822client # [ 1.708672] systemd[1]: Finished Create List of Static Device Nodes.1823lb # [ 1.695975] systemd[1]: Created slice Slice /system/modprobe.1824lb # [ 1.697171] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1825lb # [ 1.698545] systemd[1]: Expecting device /dev/disk/by-label/nixos...1826lb # [ 1.699627] systemd[1]: Reached target Path Units.1827client # [ 1.715258] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1828lb # [ 1.700458] systemd[1]: Reached target Slice Units.1829lb # [ 1.701291] systemd[1]: Reached target Swaps.1830lb # [ 1.702088] systemd[1]: Reached target Timer Units.1831lb # [ 1.703056] systemd[1]: Listening on D-Bus System Message Bus Socket.1832lb # [ 1.704259] systemd[1]: Listening on Journal Socket (/dev/log).1833lb # [ 1.705430] systemd[1]: Listening on Journal Sockets.1834worker2 # [ 1.711768] systemd[1]: Queued start job for default target Initrd Default Target.1835lb # [ 1.706439] systemd[1]: Listening on udev Control Socket.1836lb # [ 1.707431] systemd[1]: Listening on udev Kernel Socket.1837lb # [ 1.708380] systemd[1]: Reached target Socket Units.1838client # [ 1.725058] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1839worker2 # [ 1.716143] systemd[1]: Created slice Slice /system/modprobe.1840lb # [ 1.710197] systemd[1]: Starting Create List of Static Device Nodes...1841worker2 # [ 1.717444] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1842worker2 # [ 1.718901] systemd[1]: Expecting device /dev/disk/by-label/nixos...1843worker2 # [ 1.720074] systemd[1]: Reached target Path Units.1844client # [ 1.730142] systemd[1]: modprobe@configfs.service: Deactivated successfully.1845worker2 # [ 1.721009] systemd[1]: Reached target Slice Units.1846lb # [ 1.715010] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1847worker2 # [ 1.721910] systemd[1]: Reached target Swaps.1848worker1 # [ 1.713758] systemd[1]: bpf-restrict-fs: LSM BPF program attached1849worker2 # [ 1.722776] systemd[1]: Reached target Timer Units.1850worker2 # [ 1.723843] systemd[1]: Listening on D-Bus System Message Bus Socket.1851client # [ 1.733817] systemd-journald[67]: Collecting audit messages is disabled.1852worker2 # [ 1.725079] systemd[1]: Listening on Journal Socket (/dev/log).1853worker2 # [ 1.726317] systemd[1]: Listening on Journal Sockets.1854client # [ 1.737007] systemd[1]: Finished Load Kernel Module configfs.1855worker2 # [ 1.727365] systemd[1]: Listening on udev Control Socket.1856lb # [ 1.722028] systemd[1]: Starting Load Kernel Module configfs...1857worker2 # [ 1.728388] systemd[1]: Listening on udev Kernel Socket.1858worker2 # [ 1.729364] systemd[1]: Reached target Socket Units.1859worker2 # [ 1.731200] systemd[1]: Starting Create List of Static Device Nodes...1860client # [ 1.744160] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1861worker2 # [ 1.735246] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1862lb # [ 1.732569] systemd[1]: Starting Journal Service...1863client # [ 1.749719] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1864worker2 # [ 1.742267] systemd[1]: Starting Load Kernel Module configfs...1865client # [ 1.755828] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1866lb # [ 1.744072] systemd[1]: Starting Load Kernel Modules...1867client # [ 1.759796] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1868worker2 # [ 1.755824] systemd[1]: Starting Journal Service...1869worker1 # [ 1.758242] systemd[1]: Queued start job for default target Initrd Default Target.1870lb # [ 1.750011] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1871worker2 # [ 1.770260] systemd[1]: Starting Load Kernel Modules...1872worker1 # [ 1.762808] systemd[1]: Created slice Slice /system/modprobe.1873worker1 # [ 1.764018] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1874worker1 # [ 1.765508] systemd[1]: Expecting device /dev/disk/by-label/nixos...1875worker1 # [ 1.766653] systemd[1]: Reached target Path Units.1876worker1 # [ 1.767530] systemd[1]: Reached target Slice Units.1877worker1 # [ 1.768373] systemd[1]: Reached target Swaps.1878worker1 # [ 1.769150] systemd[1]: Reached target Timer Units.1879lb # [ 1.772507] netfs: FS-Cache loaded1880worker1 # [ 1.770178] systemd[1]: Listening on D-Bus System Message Bus Socket.1881worker1 # [ 1.771427] systemd[1]: Listening on Journal Socket (/dev/log).1882worker1 # [ 1.772600] systemd[1]: Listening on Journal Sockets.1883worker1 # [ 1.773658] systemd[1]: Listening on udev Control Socket.1884worker1 # [ 1.774656] systemd[1]: Listening on udev Kernel Socket.1885worker1 # [ 1.775592] systemd[1]: Reached target Socket Units.1886lb # [ 1.778439] 9pnet: Installing 9P2000 support1887client # [ 1.795221] systemd[1]: Finished Load Kernel Modules.1888worker1 # [ 1.777616] systemd[1]: Starting Create List of Static Device Nodes...1889worker2 # [ 1.777253] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1890worker1 # [ 1.783384] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1891worker2 # [ 1.793533] netfs: FS-Cache loaded1892client # [ 1.803809] systemd[1]: Starting Apply Kernel Variables...1893lb # [ 1.789355] systemd[1]: Starting Coldplug All udev Devices...1894worker1 # [ 1.788862] systemd[1]: Starting Load Kernel Module configfs...1895worker2 # [ 1.798745] 9pnet: Installing 9P2000 support1896client # [ 1.814716] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1897worker2 # [ 1.809364] systemd[1]: Starting Coldplug All udev Devices...1898worker1 # [ 1.806425] systemd[1]: Starting Journal Service...1899client # [ 1.825005] systemd[1]: Starting Create Static Device Nodes in /dev...1900lb # [ 1.809127] systemd[1]: Finished Create List of Static Device Nodes.1901lb # [ 1.815605] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1902worker2 # [ 1.823956] systemd[1]: Finished Create List of Static Device Nodes.1903worker1 # [ 1.818383] systemd[1]: Starting Load Kernel Modules...1904worker2 # [ 1.828592] systemd-journald[67]: Collecting audit messages is disabled.1905lb # [ 1.824341] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1906worker2 # [ 1.832797] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1907lb # [ 1.827829] systemd-journald[67]: Collecting audit messages is disabled.1908lb # [ 1.830379] systemd[1]: modprobe@configfs.service: Deactivated successfully.1909worker2 # [ 1.839233] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1910lb # [ 1.837274] systemd[1]: Finished Load Kernel Module configfs.1911client # [ 1.855198] systemd[1]: Finished Apply Kernel Variables.1912worker1 # [ 1.826402] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1913worker2 # [ 1.847580] systemd[1]: modprobe@configfs.service: Deactivated successfully.1914lb # [ 1.842426] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1915client # [ 1.859549] systemd[1]: Started Journal Service.1916client # [ 1.726067] systemd-modules-load[68]: Inserted module 'dm_mod'1917worker2 # [ 1.853249] systemd[1]: Finished Load Kernel Module configfs.1918client # [ 1.727442] systemd-modules-load[68]: Inserted module 'virtio_balloon'1919worker1 # [ 1.847267] netfs: FS-Cache loaded1920lb # [ 1.848269] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1921client # [ 1.730306] systemd-modules-load[68]: Inserted module 'virtio_gpu'1922client # [ 1.731435] systemd[1]: Finished Create Static Device Nodes in /dev.1923worker2 # [ 1.858704] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1924client # [ 1.733380] systemd[1]: Reached target Preparation for Local File Systems.1925lb # [ 1.853848] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1926worker1 # [ 1.852585] 9pnet: Installing 9P2000 support1927client # [ 1.735347] systemd[1]: Reached target Local File Systems.1928worker2 # [ 1.861569] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1929lb # [ 1.857976] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1930client # [ 1.738290] systemd[1]: Starting Create System Files and Directories...1931worker1 # [ 1.862408] systemd[1]: Starting Coldplug All udev Devices...1932worker2 # [ 1.871209] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1933client # [ 1.746066] systemd[1]: Starting Rule-based Manager for Device Events and Files...1934worker2 # [ 1.872888] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1935worker1 # [ 1.878479] systemd[1]: Finished Create List of Static Device Nodes.1936worker1 # [ 1.885082] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1937lb # [ 1.889548] systemd[1]: Finished Load Kernel Modules.1938worker2 # [ 1.900789] systemd[1]: Finished Load Kernel Modules.1939lb # [ 1.895517] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1940worker1 # [ 1.893783] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1941client # [ 1.778437] systemd[1]: Finished Create System Files and Directories.1942worker1 # [ 1.899805] systemd[1]: modprobe@configfs.service: Deactivated successfully.1943worker2 # [ 1.909383] systemd[1]: Starting Apply Kernel Variables...1944worker1 # [ 1.901653] systemd-journald[67]: Collecting audit messages is disabled.1945lb # [ 1.904176] systemd[1]: Starting Apply Kernel Variables...1946worker1 # [ 1.906756] systemd[1]: Finished Load Kernel Module configfs.1947worker2 # [ 1.919356] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1948lb # [ 1.916017] systemd[1]: Starting Create Static Device Nodes in /dev...1949worker1 # [ 1.913884] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1950worker1 # [ 1.919008] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1951worker2 # [ 1.932401] systemd[1]: Starting Create Static Device Nodes in /dev...1952client # [ 1.807283] systemd-udevd[76]: Using default interface naming scheme 'v261'.1953worker1 # [ 1.926565] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1954worker1 # [ 1.930611] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1955worker2 # [ 1.950290] systemd[1]: Finished Apply Kernel Variables.1956lb # [ 1.947499] systemd[1]: Finished Apply Kernel Variables.1957worker2 # [ 1.817835] systemd-modules-load[68]: Inserted module 'dm_mod'1958worker2 # [ 1.819914] systemd-modules-load[68]: Inserted module 'virtio_balloon'1959worker2 # [ 1.822281] systemd-modules-load[68]: Inserted module 'virtio_gpu'1960client # [ 1.831541] systemd[1]: Started Rule-based Manager for Device Events and Files.1961worker2 # [ 1.958411] systemd[1]: Started Journal Service.1962lb # [ 1.815588] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.952626] systemd[1]: Finished Create Static Device Nodes in /dev.1963lb # 1964lb # [ 1.819320] systemd-modules-load[68]: Inserted module 'virtio_balloon'1965lb # [ 1.820461] systemd-modules-load[68]: Inserted module 'virtio_gpu'1966lb # [ 1.957412] systemd[1]: Started Journal Service.1967worker2 # [ 1.837150] systemd[1]: Finished Create Static Device Nodes in /dev.1968lb # [ 1.830924] systemd[1]: Reached target Preparation for Local File Systems.1969worker2 # [ 1.838196] systemd[1]: Reached target Preparation for Local File Systems.1970worker1 # [ 1.965415] systemd[1]: Finished Load Kernel Modules.1971worker2 # [ 1.839153] systemd[1]: Reached target Local File Systems.1972lb # [ 1.833944] systemd[1]: Reached target Local File Systems.1973lb # [ 1.835060] systemd[1]: Starting Create System Files and Directories...1974worker2 # [ 1.842062] systemd[1]: Starting Create System Files and Directories...1975worker1 # [ 1.975704] systemd[1]: Starting Apply Kernel Variables...1976lb # [ 1.842422] systemd[1]: Starting Rule-based Manager for Device Events and Files...1977worker2 # [ 1.851066] systemd[1]: Starting Rule-based Manager for Device Events and Files...1978worker1 # [ 1.988437] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1979client # [ 1.876150] systemd[1]: Finished Coldplug All udev Devices.1980client # [ 1.876960] systemd[1]: Reached target System Initialization.1981client # [ 1.877744] systemd[1]: Reached target Basic System.1982worker1 # [ 1.999830] systemd[1]: Starting Create Static Device Nodes in /dev...1983lb # [ 1.867593] systemd[1]: Finished Create System Files and Directories.1984worker2 # [ 1.878518] systemd[1]: Finished Create System Files and Directories.1985worker2 # [ 1.897362] systemd-udevd[83]: Using default interface naming scheme 'v261'.1986lb # [ 1.891309] systemd-udevd[83]: Using default interface naming scheme 'v261'.1987worker1 # [ 2.027047] systemd[1]: Started Journal Service.1988worker1 # [ 1.884114] systemd-modules-load[68]: Inserted module 'dm_mod'1989worker1 # [ 1.885557] systemd-modules-load[68]: Inserted module 'virtio_balloon'1990worker1 # [ 1.888698] systemd-modules-load[68]: Inserted module 'virtio_gpu'1991worker1 # [ 1.891852] systemd[1]: Finished Apply Kernel Variables.1992worker2 # [ 1.923070] systemd[1]: Started Rule-based Manager for Device Events and Files.1993lb # [ 1.917068] systemd[1]: Started Rule-based Manager for Device Events and Files.1994worker1 # [ 1.909158] systemd[1]: Finished Create Static Device Nodes in /dev.1995worker1 # [ 1.910457] systemd[1]: Reached target Preparation for Local File Systems.1996worker1 # [ 1.911466] systemd[1]: Reached target Local File Systems.1997worker1 # [ 1.913732] systemd[1]: Starting Create System Files and Directories...1998worker1 # [ 1.921369] systemd[1]: Starting Rule-based Manager for Device Events and Files...1999lb # [ 1.957726] systemd[1]: Finished Coldplug All udev Devices.2000lb # [ 1.959658] systemd[1]: Reached target System Initialization.
loading 1,533 hidden lines…
3534worker1 # [ 9.658723] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'...3535worker2 # [ 9.679647] systemd[1]: Finished resolvconf update.3536worker2 # [ 9.680605] systemd[1]: Reached target Preparation for Network.3537worker2 # [ 9.684915] systemd[1]: Starting DHCP Client...3538worker2 # [ 9.688066] systemd[1]: Starting Address configuration of eth1...3539worker2 # [ 9.692115] systemd[1]: Starting Extra networking commands....3540worker2 # [ 9.693663] systemd[1]: linger-users.service: Deactivated successfully.3541worker1 # [ 9.675314] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync'3542worker1 # [ 9.676432] dbus-broker-launch[534]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3543worker2 # [ 9.696801] systemd[1]: Finished linger-users.service.3544client # [ 9.852347] kvm_amd: TSC scaling supported3545client # [ 9.852980] kvm_amd: Nested Virtualization enabled3546client # [ 9.853497] kvm_amd: Nested Paging enabled3547client # [ 9.854278] kvm_amd: LBR virtualization supported3548client # [ 9.855072] kvm_amd: Virtual VMLOAD VMSAVE supported3549client # [ 9.855984] kvm_amd: Virtual GIF supported3550client # [ 9.856400] kvm_amd: Virtual NMI enabled3551worker1 # [ 9.693951] systemd[1]: Stopped target Host and Network Name Lookups.3552worker1 # [ 9.696134] systemd[1]: Stopping Host and Network Name Lookups...3553worker1 # [ 9.697443] systemd[1]: Stopped target User and Group Name Lookups.3554worker1 # [ 9.699129] systemd[1]: Stopping User and Group Name Lookups...3555worker1 # [ 9.699917] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3556worker1 # [ 9.701650] systemd[1]: nscd.service: Deactivated successfully.3557worker1 # [ 9.703422] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3558worker2 # [ 9.860039] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3559lb # [ 9.764376] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input43560worker1 # [ 9.712566] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3561worker1 # [ 9.720280] systemd[1]: Started D-Bus System Message Bus.3562worker1 # [ 9.725200] systemd-logind[555]: New seat seat0.3563worker1 # [ 9.731747] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button)3564client # [ 9.896921] EDAC MC: Ver: 3.0.03565worker1 # [ 9.733681] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3566worker1 # [ 9.735479] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3567worker1 # [ 9.739299] systemd[1]: Started User Login Management.3568worker1 # [ 9.744083] systemd[1]: Starting linger-users.service...3569lb # [ 9.782428] ACPI: button: Power Button [PWRF]3570lb # [ 9.827756] rtc_cmos 00:04: RTC can wake from S43571lb # [ 9.846219] rtc_cmos 00:04: registered as rtc03572lb # [ 9.846283] rtc_cmos 00:04: setting system clock to 2026-09-20T08:07:11 UTC (1789891631)3573worker1 # [ 9.783503] dbus-broker-launch[534]: Ready3574lb # [ 9.846370] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs3575lb # [ 9.847240] systemd-journald[287]: Time jumped backwards, rotating.3576lb # [ 9.860972] Console: switching to colour dummy device 80x253577worker2 # [ 9.948031] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3578worker1 # [ 9.796503] systemd[1]: Started Name Service Cache Daemon (nsncd).3579worker1 # [ 9.799050] systemd[1]: Reached target Host and Network Name Lookups.3580worker1 # [ 9.800652] nsncd[601]: Sep 20 08:07:11.827 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3581worker1 # [ 9.802922] systemd[1]: Reached target User and Group Name Lookups.3582worker1 # [ 9.809695] systemd[1]: linger-users.service: Deactivated successfully.3583worker1 # [ 9.810685] systemd[1]: Finished linger-users.service.3584worker2 # [ 9.832605] network-addresses-eth1-start[683]: adding address 192.168.1.4/24... done3585worker1 # [ 9.819299] systemd[1]: Finished resolvconf update.3586worker1 # [ 9.820168] systemd[1]: Reached target Preparation for Network.3587worker2 # [ 9.841220] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3588client # [ 9.850934] systemd[1]: Finished register-nix-paths.service.3589worker1 # [ 9.824097] systemd[1]: Starting DHCP Client...3590lb # [ 9.837635] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.3591lb # [ 9.838782] systemd[1]: Finished Create SUID/SGID Wrappers.3592worker1 # [ 9.826493] systemd[1]: Starting Address configuration of eth1...3593worker2 # [ 9.846195] systemd[1]: Stopped Virtual Console Setup.3594lb # [ 9.876253] parport_pc 00:02: reported by Plug and Play ACPI3595lb # [ 9.876349] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]3596lb # [ 9.888794] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized3597lb # [ 9.842212] systemd[1]: Reached target System Initialization.3598worker1 # [ 9.830071] systemd[1]: Starting Extra networking commands....3599lb # [ 9.843079] systemd[1]: Started Discard unused filesystem blocks once a week.3600worker2 # [ 9.850160] systemd[1]: Starting Virtual Console Setup...3601lb # [ 9.845137] systemd[1]: Started niks3 garbage collection timer.3602lb # [ 9.845990] systemd[1]: Started Daily Cleanup of Temporary Directories.3603lb # [ 9.846913] systemd[1]: Reached target Timer Units.3604lb # [ 9.848166] systemd[1]: Listening on D-Bus System Message Bus Socket.3605lb # [ 9.852047] systemd[1]: Listening on niks3 server socket.3606lb # [ 9.852837] systemd[1]: Listening on Nix Daemon Socket.3607lb # [ 9.853546] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3608lb # [ 9.855129] systemd[1]: Reached target Socket Units.3609lb # [ 9.855839] systemd[1]: Reached target Basic System.3610lb # [ 9.860070] systemd[1]: Started backdoor.service.3611worker2 # [ 9.868463] network-addresses-eth1-start[683]: adding address 2001:db8:1::4/64... done3612lb # [ 9.866274] systemd[1]: Starting Import lastlog data into lastlog2 database...3613lb # [ 9.875149] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3614lb # [ 9.967372] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt3615lb # [ 9.967477] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD3616worker2 # [ 9.887491] systemd-logind[601]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3617lb # [ 9.885736] systemd[1]: Starting Post-Boot Actions...3618worker2 # [ 9.900455] systemd[1]: Finished Address configuration of eth1.3619lb # [ 9.900616] systemd[1]: Started Reset console on configuration changes.3620lb # [ 9.923139] systemd[1]: Starting resolvconf update...3621lb # [ 10.073088] [drm] Found bochs VGA, ID 0xb0c5.3622lb # [ 10.073597] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.3623worker1 # [ 9.926521] network-addresses-eth1-start[630]: adding address 192.168.1.3/24... done3624lb # [ 9.940722] systemd[1]: Started rustfs.service.3625worker1 # [ 9.943472] network-addresses-eth1-start[630]: adding address 2001:db8:1::3/64... done3626lb # connecting to host...3627lb # [ 9.965964] systemd[1]: Starting rustfs-bucket.service...3628client # [ 9.988240] systemd-vconsole-setup[422]: Configuration of first virtual console was skipped, ignoring remaining ones.3629worker1 # [ 9.962323] systemd[1]: Finished Address configuration of eth1.3630client # [ 9.991849] systemd[1]: Finished Virtual Console Setup.3631client # [ 9.993855] systemd[1]: Reached target System Initialization.3632client # [ 9.995089] systemd[1]: Started Discard unused filesystem blocks once a week.3633client # [ 9.996288] systemd[1]: Started Daily Cleanup of Temporary Directories.3634client # [ 9.998170] systemd[1]: Reached target Timer Units.3635lb # [ 10.118812] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input63636client # [ 9.998921] systemd[1]: Listening on D-Bus System Message Bus Socket.3637client # [ 9.999758] systemd[1]: Listening on Nix Daemon Socket.3638lb # [ 10.120129] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input53639client # [ 10.000602] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3640client # [ 10.001690] systemd[1]: Reached target Socket Units.3641client # [ 10.002738] systemd[1]: Reached target Basic System.3642client # [ 10.005142] systemd[1]: Started backdoor.service.3643worker2 # [ 9.997346] dhcpcd[693]: dhcpcd-10.3.2 starting3644client # [ 10.008896] systemd[1]: Starting Import lastlog data into lastlog2 database...3645worker2 # [ 10.000777] systemd[1]: Finished Extra networking commands..3646worker2 # [ 10.002271] systemd[1]: Reached target Network.3647client # [ 10.011714] systemd[1]: Starting nftables firewall...3648lb # [ 9.996387] nsncd[584]: Sep 20 08:07:11.783 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3649worker2 # [ 10.003036] systemd[1]: Starting Permit User Sessions...3650worker1 # [ 9.990877] dhcpcd[637]: dhcpcd-10.3.2 starting3651lb # [ 10.004098] systemd[1]: Started Name Service Cache Daemon (nsncd).3652client # [ 10.020077] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3653lb # [ 10.004938] systemd[1]: Finished Post-Boot Actions.3654lb # [ 10.141781] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic3655lb # [ 10.142550] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 03656worker1 # [ 10.000783] dhcpcd[693]: dev: loaded udev3657worker1 # [ 10.003570] systemd[1]: Finished Extra networking commands..3658client # [ 10.031689] systemd[1]: Starting Post-Boot Actions...3659worker1 # [ 10.004435] systemd[1]: Reached target Network.3660worker2 # [ 10.025177] dhcpcd[752]: dev: loaded udev3661worker1 # [ 10.006866] systemd[1]: Starting Permit User Sessions...3662client # [ 10.039493] systemd[1]: Started Reset console on configuration changes.3663worker1 # [ 10.175466] 8021q: 802.1Q VLAN Support v1.83664worker1 # [ 10.176068] 8021q: adding VLAN 0 to HW filter on device eth13665lb # [ 10.042631] systemd[1]: Reached target Host and Network Name Lookups.3666client # [ 10.058200] systemd[1]: Starting resolvconf update...3667lb # [ 10.046281] systemd[1]: Reached target User and Group Name Lookups.3668worker1 # [ 10.038153] systemd[1]: Finished Permit User Sessions.3669worker1 # [ 10.041162] systemd[1]: Started Getty on tty1.3670worker1 # [ 10.043104] systemd[1]: Reached target Login Prompts.3671lb # [ 10.060702] systemd[1]: Starting D-Bus System Message Bus...3672worker2 # [ 10.070852] systemd[1]: Finished Permit User Sessions.3673worker2 # [ 10.209863] 8021q: 802.1Q VLAN Support v1.83674worker2 # [ 10.212560] 8021q: adding VLAN 0 to HW filter on device eth13675worker1 # [ 10.057743] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3676worker2 # [ 10.078192] systemd[1]: Started Getty on tty1.3677worker2 # [ 10.078972] systemd[1]: Reached target Login Prompts.3678lb # [ 10.087285] systemd[1]: Starting User Login Management...3679client # connecting to host...3680client # [ 10.109731] nsncd[430]: Sep 20 08:07:11.607 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3681lb # [ 10.096541] systemd[1]: Finished Import lastlog data into lastlog2 database.3682client # [ 10.113156] systemd[1]: Finished Post-Boot Actions.3683client # [ 10.117818] systemd[1]: Started Name Service Cache Daemon (nsncd).3684worker2 # [ 10.119325] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3685client: Guest shell says: b'Spawning backdoor root shell...\n'3686client # [ 10.138730] systemd[1]: Reached target Host and Network Name Lookups.3687worker1 # [ 10.259837] cfg80211: Loading compiled-in X.509 certificates for regulatory database3688worker2 # [ 10.268815] kvm_amd: TSC scaling supported3689client # [ 10.141338] systemd[1]: Reached target User and Group Name Lookups.3690lb # [ 10.137074] systemd[1]: Starting Virtual Console Setup...3691client: connected to guest root shell3692client # [ 10.149549] systemd[1]: Starting D-Bus System Message Bus...3693worker1 # [ 10.281111] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3694worker2 # [ 10.269949] kvm_amd: Nested Virtualization enabled3695client: (connecting took 10.83 seconds)3696client # [ 10.165570] systemd[1]: Starting User Login Management...3697worker1 # [ 10.281868] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3698worker2 # [ 10.272231] kvm_amd: Nested Paging enabled3699client: (finished: waiting for the VM to finish booting, in 10.83 seconds)3700client # [ 10.169627] systemd[1]: Finished Import lastlog data into lastlog2 database.3701worker1 # [ 10.284581] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23702worker2 # [ 10.272708] kvm_amd: LBR virtualization supported3703worker1 # [ 10.285375] cfg80211: failed to load regulatory.db3704worker2 # [ 10.275345] kvm_amd: Virtual VMLOAD VMSAVE supported3705worker2 # [ 10.275859] kvm_amd: Virtual GIF supported3706worker2 # [ 10.277846] kvm_amd: Virtual NMI enabled3707worker2 # [ 10.335627] cfg80211: Loading compiled-in X.509 certificates for regulatory database3708worker1 # [ 10.331168] 8021q: adding VLAN 0 to HW filter on device eth03709worker1 # [ 10.186295] dhcpcd[693]: eth0: waiting for carrier3710worker1 # [ 10.187084] dhcpcd[693]: eth0: carrier acquired3711worker1 # [ 10.194787] dhcpcd[693]: DUID 00:01:00:01:32:42:50:b0:52:54:00:12:34:563712worker1 # [ 10.195666] dhcpcd[693]: eth0: IAID 00:12:34:563713worker1 # [ 10.196344] dhcpcd[693]: eth0: adding address fe80::5054:ff:fe12:34563714worker2 # [ 10.358606] EDAC MC: Ver: 3.0.03715worker2 # [ 10.368271] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3716worker2 # [ 10.368966] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3717worker2 # [ 10.373482] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23718worker2 # [ 10.374348] cfg80211: failed to load regulatory.db3719lb # [ 10.289205] dbus-broker-launch[613]: Looking up NSS user entry for 'systemd-timesync'...3720client # [ 10.306304] dbus-broker-launch[459]: Looking up NSS user entry for 'systemd-timesync'...3721client # [ 10.310324] systemd[1]: Stopped target Host and Network Name Lookups.3722client # [ 10.311250] systemd[1]: Stopping Host and Network Name Lookups...3723client # [ 10.312283] systemd[1]: Stopped target User and Group Name Lookups.3724client # [ 10.313241] systemd[1]: Stopping User and Group Name Lookups...3725client # [ 10.315630] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3726worker2 # [ 10.442489] 8021q: adding VLAN 0 to HW filter on device eth03727worker2 # [ 10.310672] dhcpcd[752]: eth0: waiting for carrier3728worker2 # [ 10.311681] dhcpcd[752]: eth0: carrier acquired3729client # [ 10.322496] systemd[1]: nscd.service: Deactivated successfully.3730client # [ 10.324839] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3731client # [ 10.330437] dbus-broker-launch[459]: NSS returned no entry for 'systemd-timesync'3732client # [ 10.331463] dbus-broker-launch[459]: Invalid user-name in /nix/store/i187syzbavbkjz7z897lklr60jwf2ymx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3733lb # [ 10.317201] dbus-broker-launch[613]: NSS returned no entry for 'systemd-timesync'3734worker2 # [ 10.324900] dhcpcd[752]: DUID 00:01:00:01:32:42:50:b0:52:54:00:12:34:563735worker2 # [ 10.326128] dhcpcd[752]: eth0: IAID 00:12:34:563736worker2 # [ 10.326923] dhcpcd[752]: eth0: adding address fe80::5054:ff:fe12:34563737lb # [ 10.319916] dbus-broker-launch[613]: Invalid user-name in /nix/store/0vgm8r903b3kyr8fcdjkv3g9zyy4h8rn-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3738lb # [ 10.323620] systemd[1]: Stopped target Host and Network Name Lookups.3739lb # [ 10.326825] systemd[1]: Stopping Host and Network Name Lookups...3740lb # [ 10.329713] systemd[1]: Stopped target User and Group Name Lookups.3741lb # [ 10.331229] systemd[1]: Stopping User and Group Name Lookups...3742client # [ 10.344175] systemd-logind[460]: New seat seat0.3743lb # [ 10.333202] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3744lb # [ 10.336026] systemd[1]: nscd.service: Deactivated successfully.3745lb # [ 10.339266] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3746client # [ 10.355967] systemd-logind[460]: Watching system buttons on /dev/input/event2 (Power Button)3747client # [ 10.358497] systemd-logind[460]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3748client # [ 10.359909] systemd-logind[460]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3749client # [ 10.364186] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3750client # [ 10.367405] systemd[1]: Started User Login Management.3751client # [ 10.392652] systemd[1]: Starting linger-users.service...3752client # [ 10.393579] systemd[1]: Started D-Bus System Message Bus.3753worker2 # [ 10.395346] systemd-vconsole-setup[707]: Configuration of first virtual console was skipped, ignoring remaining ones.3754worker2 # [ 10.399229] systemd[1]: Finished Virtual Console Setup.3755client # [ 10.439730] dbus-broker-launch[459]: Ready3756client # [ 10.450972] systemd[1]: Finished resolvconf update.3757client # [ 10.457365] nsncd[522]: Sep 20 08:07:11.958 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3758client # [ 10.462526] systemd[1]: Starting DHCP Client...3759client # [ 10.463320] systemd[1]: Started Name Service Cache Daemon (nsncd).3760client # [ 10.466353] systemd[1]: Reached target Host and Network Name Lookups.3761client # [ 10.468267] systemd[1]: Reached target User and Group Name Lookups.3762client # [ 10.471277] systemd[1]: linger-users.service: Deactivated successfully.3763client # [ 10.473800] systemd[1]: Finished linger-users.service.3764lb # [ 10.643870] Console: switching to colour frame buffer device 160x503765lb # [ 10.696313] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device3766lb # [ 10.371764] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3767lb # [ 10.563192] systemd[1]: Started D-Bus System Message Bus.3768lb # [ 10.571191] dbus-broker-launch[613]: Ready3769lb # [ 10.574566] nsncd[667]: Sep 20 08:07:12.265 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3770lb # [ 10.578838] systemd[1]: Started Name Service Cache Daemon (nsncd).3771lb # [ 10.581306] systemd[1]: Reached target Host and Network Name Lookups.3772lb # [ 10.583819] systemd[1]: Reached target User and Group Name Lookups.3773lb # [ 10.585258] systemd[1]: Finished resolvconf update.3774client # [ 10.601506] dhcpcd[557]: dhcpcd-10.3.2 starting3775lb # [ 10.585982] systemd[1]: Reached target Preparation for Network.3776lb # [ 10.589082] systemd[1]: Starting DHCP Client...3777lb # [ 10.589784] systemd[1]: Starting Address configuration of eth1...3778lb # [ 10.590623] systemd[1]: Starting Extra networking commands....3779lb # [ 10.591423] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3780lb # [ 10.592612] systemd-logind[617]: New seat seat0.3781client # [ 10.609554] dhcpcd[566]: dev: loaded udev3782lb # [ 10.599179] systemd-logind[617]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3783lb # [ 10.600530] systemd[1]: Stopped Virtual Console Setup.3784lb # [ 10.602662] systemd-logind[617]: Watching system buttons on /dev/input/event3 (Power Button)3785lb # [ 10.604715] systemd-logind[617]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard)3786lb # [ 10.606714] systemd[1]: Started User Login Management.3787lb # [ 10.745356] ppdev: user-space parallel port driver3788client # [ 10.762636] 8021q: 802.1Q VLAN Support v1.83789lb # [ 10.611674] systemd[1]: Starting linger-users.service...3790lb # [ 10.628223] systemd[1]: Starting Virtual Console Setup...3791client # [ 10.654838] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3792client # [ 10.857259] cfg80211: Loading compiled-in X.509 certificates for regulatory database3793client # [ 10.728147] systemd[1]: Finished nftables firewall.3794client # [ 10.730158] systemd[1]: Reached target Preparation for Network.3795client # [ 10.733595] systemd[1]: Starting Address configuration of eth1...3796lb # [ 10.718505] systemd[1]: linger-users.service: Deactivated successfully.3797lb # [ 10.855844] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3798client # [ 10.737131] systemd[1]: Starting Extra networking commands....3799lb # [ 10.723394] systemd[1]: Finished linger-users.service.3800lb # [ 10.727545] network-addresses-eth1-start[696]: adding address 192.168.1.2/24... done3801client # [ 10.888876] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3802client # [ 10.889874] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3803client # [ 10.893091] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23804client # [ 10.894051] cfg80211: failed to load regulatory.db3805lb # [ 10.746132] network-addresses-eth1-start[696]: adding address 2001:db8:1::2/64... done3806lb # [ 10.777930] systemd[1]: Finished Address configuration of eth1.3807client # [ 10.952677] 8021q: adding VLAN 0 to HW filter on device eth13808client # [ 10.961090] 8021q: adding VLAN 0 to HW filter on device eth03809client # [ 10.825711] dhcpcd[566]: eth0: waiting for carrier3810client # [ 10.826704] dhcpcd[566]: eth0: carrier acquired3811client # [ 10.833453] network-addresses-eth1-start[578]: adding address 192.168.1.1/24... done3812client # [ 10.838567] dhcpcd[566]: DUID 00:01:00:01:32:42:50:b0:52:54:00:12:34:563813client # [ 10.839625] dhcpcd[566]: eth0: IAID 00:12:34:563814client # [ 10.840371] dhcpcd[566]: eth0: adding address fe80::5054:ff:fe12:34563815client # [ 10.848097] network-addresses-eth1-start[578]: adding address 2001:db8:1::1/64... done3816client # [ 10.861380] systemd[1]: Finished Address configuration of eth1.3817lb # [ 10.989376] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3818lb # [ 10.907585] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3819lb # [ 10.911454] systemd[1]: Stopped Virtual Console Setup.3820lb # [ 10.920430] systemd[1]: Finished Extra networking commands..3821lb # [ 10.925104] systemd[1]: Reached target Network.3822lb # [ 10.936941] systemd[1]: Starting PostgreSQL Server...3823lb # [ 10.942914] systemd[1]: Starting Permit User Sessions...3824lb # [ 10.955424] dhcpcd[725]: dhcpcd-10.3.2 starting3825lb # [ 10.959323] systemd[1]: Starting Virtual Console Setup...3826lb # [ 10.970907] dhcpcd[779]: dev: loaded udev3827lb # [ 11.157578] 8021q: 802.1Q VLAN Support v1.83828lb # [ 11.158328] 8021q: adding VLAN 0 to HW filter on device eth13829lb # [ 11.032769] systemd[1]: Finished Permit User Sessions.3830lb # [ 11.042774] systemd[1]: Started Getty on tty1.3831lb # [ 11.043612] systemd[1]: Reached target Login Prompts.3832lb # [ 11.136099] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3833lb # [ 11.344340] kvm_amd: TSC scaling supported3834lb # [ 11.344793] kvm_amd: Nested Virtualization enabled3835lb # [ 11.348786] kvm_amd: Nested Paging enabled3836lb # [ 11.350945] kvm_amd: LBR virtualization supported3837lb # [ 11.351523] kvm_amd: Virtual VMLOAD VMSAVE supported3838lb # [ 11.356284] kvm_amd: Virtual GIF supported3839lb # [ 11.356771] kvm_amd: Virtual NMI enabled3840lb # [ 11.456442] cfg80211: Loading compiled-in X.509 certificates for regulatory database3841lb # [ 11.491216] EDAC MC: Ver: 3.0.03842lb # [ 11.494384] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3843lb # [ 11.495269] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3844lb # [ 11.500113] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23845lb # [ 11.501170] cfg80211: failed to load regulatory.db3846worker1 # [ 11.354518] dhcpcd[693]: eth0: soliciting a DHCP lease3847worker1 # [ 11.517542] NET: Registered PF_PACKET protocol family3848worker1 # [ 11.375428] dhcpcd[693]: eth0: offered 10.0.2.15 from 10.0.2.23849worker1 # [ 11.378164] dhcpcd[693]: eth0: probing address 10.0.2.15/243850lb # [ 11.435736] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".3851lb # [ 11.437508] postgresql-pre-start[792]: This user must also own the server process.3852lb # [ 11.449670] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".3853lb # [ 11.451102] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".3854lb # [ 11.452313] postgresql-pre-start[792]: The default text search configuration will be set to "english".3855lb # [ 11.453472] postgresql-pre-start[792]: Data page checksums are enabled.3856lb # [ 11.454316] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3857client: (finished: waiting for unit network-addresses-eth1.service, in 12.13 seconds)3858lb # [ 11.458380] postgresql-pre-start[792]: creating subdirectories ... ok3859client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3860lb # [ 11.460241] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix3861lb # [ 11.623134] 8021q: adding VLAN 0 to HW filter on device eth03862lb # [ 11.488848] dhcpcd[779]: eth0: waiting for carrier3863client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3864lb: waiting for unit network-addresses-eth1.service3865lb: waiting for the VM to finish booting3866lb: Guest shell says: b'Spawning backdoor root shell...\n'3867lb: connected to guest root shell3868lb: (connecting took 0.00 seconds)3869lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3870lb # [ 11.492122] systemd-vconsole-setup[777]: Configuration of first virtual console was skipped, ignoring remaining ones.3871lb # [ 11.496324] dhcpcd[779]: eth0: carrier acquired3872lb # [ 11.499069] systemd[1]: Finished Virtual Console Setup.3873lb # [ 11.522656] dhcpcd[779]: DUID 00:01:00:01:32:42:50:b1:52:54:00:12:34:563874lb # [ 11.523761] dhcpcd[779]: eth0: IAID 00:12:34:563875lb # [ 11.526153] dhcpcd[779]: eth0: adding address fe80::5054:ff:fe12:34563876lb: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3877lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3878lb # [ 11.596747] postgresql-pre-start[792]: selecting default "max_connections" ... 1003879lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3880worker2 # [ 11.638846] dhcpcd[752]: eth0: soliciting a DHCP lease3881worker1: waiting for unit network-addresses-eth1.service3882worker1: waiting for the VM to finish booting3883worker1: Guest shell says: b'Spawning backdoor root shell...\n'3884worker1: connected to guest root shell3885worker1: (connecting took 0.00 seconds)3886worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3887worker2 # [ 11.799750] NET: Registered PF_PACKET protocol family3888worker2 # [ 11.671764] dhcpcd[752]: eth0: offered 10.0.2.15 from 10.0.2.23889worker2 # [ 11.675371] dhcpcd[752]: eth0: probing address 10.0.2.15/243890lb # [ 11.679977] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB3891worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3892worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3893worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3894worker2: waiting for unit network-addresses-eth1.service3895worker2: waiting for the VM to finish booting3896worker2: Guest shell says: b'Spawning backdoor root shell...\n'3897worker2: connected to guest root shell3898worker2: (connecting took 0.00 seconds)3899worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3900worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3901worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3902worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3903lb: waiting for unit niks3.service3904client # [ 11.913317] systemd[1]: Finished Extra networking commands..3905client # [ 11.915464] systemd[1]: Reached target Network.3906client # [ 11.918163] systemd[1]: Starting Permit User Sessions...3907client # [ 11.943767] systemd[1]: Finished Permit User Sessions.3908client # [ 11.947637] systemd[1]: Started Getty on tty1.3909client # [ 11.948972] systemd[1]: Reached target Login Prompts.3910client # [ 11.994521] dhcpcd[566]: eth0: soliciting a DHCP lease3911client # [ 12.146369] NET: Registered PF_PACKET protocol family3912client # [ 12.013420] dhcpcd[566]: eth0: offered 10.0.2.15 from 10.0.2.23913client # [ 12.016238] dhcpcd[566]: eth0: probing address 10.0.2.15/243914worker1 # [ 12.522683] dhcpcd[693]: eth0: soliciting an IPv6 router3915worker1 # [ 12.525258] dhcpcd[693]: eth0: Router Advertisement from fe80::23916worker1 # [ 12.527342] dhcpcd[693]: eth0: adding address fec0::5054:ff:fe12:3456/643917worker1 # [ 12.529448] dhcpcd[693]: eth0: adding route to fec0::/643918worker1 # [ 12.531311] dhcpcd[693]: eth0: adding default route via fe80::23919worker2 # [ 12.588720] dhcpcd[752]: eth0: soliciting an IPv6 router3920worker2 # [ 12.590131] dhcpcd[752]: eth0: Router Advertisement from fe80::23921worker2 # [ 12.590980] dhcpcd[752]: eth0: adding address fec0::5054:ff:fe12:3456/643922worker2 # [ 12.591897] dhcpcd[752]: eth0: adding route to fec0::/643923worker2 # [ 12.592647] dhcpcd[752]: eth0: adding default route via fe80::23924lb # [ 12.614259] dhcpcd[779]: eth0: soliciting a DHCP lease3925lb # [ 12.765544] NET: Registered PF_PACKET protocol family3926lb # [ 12.634377] dhcpcd[779]: eth0: offered 10.0.2.15 from 10.0.2.23927lb # [ 12.637127] dhcpcd[779]: eth0: probing address 10.0.2.15/243928client # [ 12.674636] dhcpcd[566]: eth0: soliciting an IPv6 router3929client # [ 12.677226] dhcpcd[566]: eth0: Router Advertisement from fe80::23930client # [ 12.679867] dhcpcd[566]: eth0: adding address fec0::5054:ff:fe12:3456/643931client # [ 12.682195] dhcpcd[566]: eth0: adding route to fec0::/643932client # [ 12.684218] dhcpcd[566]: eth0: adding default route via fe80::23933lb # [ 13.134722] dhcpcd[779]: eth0: soliciting an IPv6 router3934lb # [ 13.135734] dhcpcd[779]: eth0: Router Advertisement from fe80::23935lb # [ 13.136840] dhcpcd[779]: eth0: adding address fec0::5054:ff:fe12:3456/643936lb # [ 13.137709] dhcpcd[779]: eth0: adding route to fec0::/643937lb # [ 13.138478] dhcpcd[779]: eth0: adding default route via fe80::23938lb # [ 13.380804] postgresql-pre-start[792]: selecting default time zone ... UTC3939lb # [ 13.384042] postgresql-pre-start[792]: creating configuration files ... ok3940lb # [ 13.610356] postgresql-pre-start[792]: running bootstrap script ... ok3941lb # [ 14.176082] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok3942lb # [ 14.305542] postgresql-pre-start[792]: syncing data to disk ... ok3943lb # [ 14.307510] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections3944lb # [ 14.308951] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3945lb # [ 14.311143] postgresql-pre-start[792]: Success. You can now start the database server using:3946lb # [ 14.312322] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3947lb # [ 14.430398] postgres[866]: [866] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3948lb # [ 14.434643] postgres[866]: [866] LOG: listening on IPv6 address "::1", port 54323949lb # [ 14.435829] postgres[866]: [866] LOG: listening on IPv4 address "127.0.0.1", port 54323950lb # [ 14.439290] postgres[866]: [866] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3951lb # [ 14.451179] postgres[880]: [880] LOG: database system was shut down at 2026-09-20 08:07:15 GMT3952lb # [ 14.455953] postgres[866]: [866] LOG: database system is ready to accept connections3953lb # [ 14.460367] systemd[1]: Started PostgreSQL Server.3954lb # [ 14.467808] systemd[1]: Starting PostgreSQL Setup Scripts...3955lb # [ 14.671724] postgresql-setup-start[891]: CREATE DATABASE3956lb # [ 14.714748] postgresql-setup-start[897]: CREATE ROLE3957lb # [ 14.733925] postgresql-setup-start[899]: ALTER DATABASE3958lb # [ 14.739295] systemd[1]: Finished PostgreSQL Setup Scripts.3959lb # [ 14.740931] systemd[1]: Reached target PostgreSQL.3960worker1 # [ 16.512979] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds3961worker1 # [ 16.516326] dhcpcd[693]: eth0: adding route to 10.0.2.0/243962worker1 # [ 16.518287] dhcpcd[693]: eth0: adding default route via 10.0.2.23963worker1 # [ 16.633785] systemd[1]: Started DHCP Client.3964worker1 # [ 16.635776] systemd[1]: Reached target Multi-User System.3965worker1 # [ 16.636690] systemd[1]: Startup finished in 904ms (kernel) + 4.123s (initrd) + 11.607s (userspace) = 16.635s.3966worker2 # [ 16.916326] dhcpcd[752]: eth0: leased 10.0.2.15 for 86400 seconds3967worker2 # [ 16.917565] dhcpcd[752]: eth0: adding route to 10.0.2.0/243968worker2 # [ 16.918409] dhcpcd[752]: eth0: adding default route via 10.0.2.23969worker2 # [ 17.012773] systemd[1]: Started DHCP Client.3970worker2 # [ 17.014932] systemd[1]: Reached target Multi-User System.3971worker2 # [ 17.015777] systemd[1]: Startup finished in 905ms (kernel) + 3.993s (initrd) + 12.115s (userspace) = 17.014s.3972lb # [ 17.233725] dhcpcd[779]: eth0: leased 10.0.2.15 for 86400 seconds3973lb # [ 17.234606] dhcpcd[779]: eth0: adding route to 10.0.2.0/243974lb # [ 17.235339] dhcpcd[779]: eth0: adding default route via 10.0.2.23975client # [ 17.254297] dhcpcd[566]: eth0: leased 10.0.2.15 for 86400 seconds3976client # [ 17.256367] dhcpcd[566]: eth0: adding route to 10.0.2.0/243977client # [ 17.258228] dhcpcd[566]: eth0: adding default route via 10.0.2.23978lb # [ 17.337660] systemd[1]: Started DHCP Client.3979lb # [ 17.339977] systemd[1]: Reached target Network is Online.3980client # [ 17.356905] systemd[1]: Started DHCP Client.3981client # [ 17.359104] systemd[1]: Reached target Multi-User System.3982lb # [ 17.343807] systemd[1]: Started Envoy reverse proxy.3983client # [ 17.360254] systemd[1]: Startup finished in 872ms (kernel) + 5.016s (initrd) + 11.471s (userspace) = 17.360s.3984lb # [ 17.347901] systemd[1]: Started mock-oidc.service.3985lb # [ 17.437351] mock-oidc-server[985]: Mock OIDC Server running3986lb # [ 17.438417] mock-oidc-server[985]: OIDC Address: 192.168.1.2:80803987lb # [ 17.440086] mock-oidc-server[985]: Issue Address: 0.0.0.0:80813988lb # [ 17.441163] mock-oidc-server[985]: Issuer: http://192.168.1.2:8080/oidc3989lb # [ 17.442353] mock-oidc-server[985]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3990lb # [ 17.443649] mock-oidc-server[985]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3991lb # [ 17.445186] mock-oidc-server[985]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3992lb # [ 17.820187] envoy[984]: [2026-09-20 08:07:19.609][984][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3993lb # [ 17.821939] envoy[984]: [2026-09-20 08:07:19.609][984][info][main] [source/server/server.cc:469] statically linked extensions:3994lb # [ 17.823321] envoy[984]: [2026-09-20 08:07:19.609][984][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3995lb # [ 17.827346] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3996lb # [ 17.829181] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3997lb # [ 17.831622] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3998lb # [ 17.833569] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3999lb # [ 17.835525] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24000lb # [ 17.837367] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4001lb # [ 17.841620] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4002lb # [ 17.856615] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4003lb # [ 17.858264] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4004lb # [ 17.860117] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4005lb # [ 17.861781] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4006lb # [ 17.865422] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4007lb # [ 17.867192] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4008lb # [ 17.873942] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84009lb # [ 17.875607] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4010lb # [ 17.877262] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4011lb # [ 17.880204] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4012lb # [ 17.882218] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4013lb # [ 17.884816] envoy[984]: [2026-09-20 08:07:19.616][984][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4014lb # [ 17.886411] envoy[984]: [2026-09-20 08:07:19.618][984][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4015lb # [ 17.887942] envoy[984]: [2026-09-20 08:07:19.618][984][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4016lb # [ 17.890537] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4017lb # [ 17.893235] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4018lb # [ 17.896078] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4019lb # [ 17.899056] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4020lb # [ 17.901299] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4021lb # [ 17.903390] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4022lb # [ 17.907791] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4023lb # [ 17.909890] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24024lb # [ 17.912023] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4025lb # [ 17.913964] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4026lb # [ 17.915535] envoy[984]: [2026-09-20 08:07:19.621][984][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4027lb # [ 17.919500] envoy[984]: [2026-09-20 08:07:19.622][984][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4028lb # [ 17.921395] envoy[984]: [2026-09-20 08:07:19.623][984][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4029lb # [ 17.924933] envoy[984]: [2026-09-20 08:07:19.623][984][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4030lb # [ 17.926570] envoy[984]: [2026-09-20 08:07:19.623][984][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4031lb # [ 17.929037] envoy[984]: [2026-09-20 08:07:19.623][984][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4032lb # [ 17.931733] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4033lb # [ 17.933891] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4034lb # [ 17.935378] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4035lb # [ 17.937694] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4036lb # [ 17.946736] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4037lb # [ 17.952392] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4038lb # [ 17.954480] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4039lb # [ 17.960200] envoy[984]: [2026-09-20 08:07:19.624][984][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4040lb # [ 17.962108] envoy[984]: [2026-09-20 08:07:19.625][984][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4041lb # [ 17.965087] envoy[984]: [2026-09-20 08:07:19.626][984][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4042lb # [ 17.967422] envoy[984]: [2026-09-20 08:07:19.626][984][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4043lb # [ 17.969252] envoy[984]: [2026-09-20 08:07:19.626][984][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4044lb # [ 17.970789] envoy[984]: [2026-09-20 08:07:19.626][984][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4045lb # [ 17.972950] envoy[984]: [2026-09-20 08:07:19.626][984][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4046lb # [ 17.978936] envoy[984]: [2026-09-20 08:07:19.631][984][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4047lb # [ 17.980643] envoy[984]: [2026-09-20 08:07:19.631][984][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4048lb # [ 17.982425] envoy[984]: [2026-09-20 08:07:19.631][984][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4049lb # [ 17.984264] envoy[984]: [2026-09-20 08:07:19.631][984][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4050lb # [ 17.986267] envoy[984]: [2026-09-20 08:07:19.631][984][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4051lb # [ 17.988351] envoy[984]: [2026-09-20 08:07:19.631][984][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4052lb # [ 17.990062] envoy[984]: [2026-09-20 08:07:19.631][984][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4053lb # [ 17.991950] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4054lb # [ 17.997921] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4055lb # [ 18.001960] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4056lb # [ 18.004439] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4057lb # [ 18.006709] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4058lb # [ 18.009060] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4059lb # [ 18.013322] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14060lb # [ 18.015803] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4061lb # [ 18.017491] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4062lb # [ 18.019345] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4063lb # [ 18.021218] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4064lb # [ 18.023122] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4065lb # [ 18.024885] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4066lb # [ 18.035847] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4067lb # [ 18.038361] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4068lb # [ 18.040309] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4069lb # [ 18.041957] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4070lb # [ 18.044374] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4071lb # [ 18.046836] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4072lb # [ 18.051187] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4073lb # [ 18.053797] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4074lb # [ 18.055667] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4075lb # [ 18.057281] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4076lb # [ 18.061933] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4077lb # [ 18.086398] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4078lb # [ 18.089277] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4079lb # [ 18.092206] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4080lb # [ 18.095365] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4081lb # [ 18.097681] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4082lb # [ 18.100302] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4083lb # [ 18.102497] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4084lb # [ 18.104414] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4085lb # [ 18.106204] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4086lb # [ 18.108848] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4087lb # [ 18.115096] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4088lb # [ 18.117456] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4089lb # [ 18.119223] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4090lb # [ 18.121547] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4091lb # [ 18.125081] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4092lb # [ 18.126530] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4093lb # [ 18.128348] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4094lb # [ 18.130272] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4095lb # [ 18.132887] envoy[984]: [2026-09-20 08:07:19.637][984][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4096lb # [ 18.134472] envoy[984]: [2026-09-20 08:07:19.638][984][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24097lb # [ 18.135944] envoy[984]: [2026-09-20 08:07:19.638][984][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4098lb # [ 18.138745] envoy[984]: [2026-09-20 08:07:19.743][984][info][main] [source/server/server.cc:531] HTTP header map info:4099lb # [ 18.139956] envoy[984]: [2026-09-20 08:07:19.796][984][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4100lb # [ 18.152630] envoy[984]: [2026-09-20 08:07:19.796][984][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4101lb # [ 18.154066] envoy[984]: [2026-09-20 08:07:19.796][984][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4102lb # [ 18.161334] envoy[984]: [2026-09-20 08:07:19.796][984][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4103lb # [ 18.188492] envoy[984]: [2026-09-20 08:07:19.977][984][info][main] [source/server/server.cc:968] runtime: {}4104lb # [ 18.193389] envoy[984]: [2026-09-20 08:07:19.982][984][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4105lb # [ 18.195280] envoy[984]: [2026-09-20 08:07:19.984][984][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014106lb # [ 18.197567] envoy[984]: [2026-09-20 08:07:19.987][984][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014107lb # [ 18.200051] envoy[984]: [2026-09-20 08:07:19.989][984][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4108lb # [ 18.201588] envoy[984]: [2026-09-20 08:07:19.991][984][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4109lb # [ 18.203207] envoy[984]: [2026-09-20 08:07:19.991][984][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4110worker1 # [ 18.226641] systemd[1]: Starting Nix worker-protocol over gRPC...4111lb # [ 18.238652] envoy[984]: [2026-09-20 08:07:20.028][984][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4112worker2 # [ 18.251201] systemd[1]: Starting Nix worker-protocol over gRPC...4113lb # [ 18.257210] envoy[984]: [2026-09-20 08:07:20.046][984][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4114lb # [ 18.259499] envoy[984]: [2026-09-20 08:07:20.049][984][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4115lb # [ 18.262321] envoy[984]: [2026-09-20 08:07:20.049][984][info][main] [source/server/server.cc:1077] starting main dispatch loop4116worker1 # [ 18.408471] nix-grpc-daemon[784]: ts=2026-09-20T08:07:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4117worker1 # [ 18.419294] nix-grpc-daemon[784]: ts=2026-09-20T08:07:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14118worker2 # [ 18.444305] nix-grpc-daemon[848]: ts=2026-09-20T08:07:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4119worker2 # [ 18.453550] nix-grpc-daemon[848]: ts=2026-09-20T08:07:20Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14120worker1 # [ 18.457936] nix-grpc-daemon[784]: ts=2026-09-20T08:07:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4121worker1 # [ 18.461207] systemd[1]: Started Nix worker-protocol over gRPC.4122worker2 # [ 18.495839] nix-grpc-daemon[848]: ts=2026-09-20T08:07:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4123worker2 # [ 18.501754] systemd[1]: Started Nix worker-protocol over gRPC.4124worker1 # [ 18.499774] nix-grpc-daemon[784]: ts=2026-09-20T08:07:20Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4125lb # [ 18.513255] envoy[984]: [2026-09-20 08:07:20.302][984][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4126lb # [ 18.515110] envoy[984]: [2026-09-20 08:07:20.302][984][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4127lb # [ 18.516961] envoy[984]: [2026-09-20 08:07:20.302][984][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4128lb # [ 18.518837] envoy[984]: [2026-09-20 08:07:20.304][984][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4129worker2 # [ 18.549334] nix-grpc-daemon[848]: ts=2026-09-20T08:07:20Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 18.544984] nix-grpc-daemon[784]: ts=2026-09-20T08:07:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04131worker1 # [ 18.700819] nix-grpc-daemon[784]: ts=2026-09-20T08:07:20Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4132worker1 # [ 19.101196] nix-grpc-daemon[784]: ts=2026-09-20T08:07:21Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4133worker1 # [ 19.905316] nix-grpc-daemon[784]: ts=2026-09-20T08:07:21Z level=info event=scheduler_connected addr=lb:500514134worker1 # [ 19.909958] nix-grpc-daemon[784]: ts=2026-09-20T08:07:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04135lb # [ 29.263143] rustfs-bucket-start[1104]: mb s3://farm4136lb # [ 29.268748] systemd[1]: Finished rustfs-bucket.service.4137lb # [ 29.275592] systemd[1]: Starting niks3 server...4138lb # [ 29.498441] postgres[1120]: [1120] ERROR: relation "goose_db_version" does not exist at character 364139lb # [ 29.499670] postgres[1120]: [1120] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4140lb # [ 29.536416] niks3-server[1113]: 2026/09/20 08:07:31 OK 20241026095416_initial_model.sql (19.73ms)4141lb # [ 29.540100] niks3-server[1113]: 2026/09/20 08:07:31 OK 20251210153512_drop_unused_gin_index.sql (3.8ms)4142lb # [ 29.544618] niks3-server[1113]: 2026/09/20 08:07:31 OK 20251218171726_add_pins.sql (4.31ms)4143lb # [ 29.549161] niks3-server[1113]: 2026/09/20 08:07:31 OK 20260628120000_add_object_size_and_stats.sql (4.8ms)4144lb # [ 29.553960] niks3-server[1113]: 2026/09/20 08:07:31 OK 20260905000000_add_claims.sql (3.33ms)4145lb # [ 29.555087] niks3-server[1113]: 2026/09/20 08:07:31 goose: successfully migrated database to version: 202609050000004146lb # [ 29.560603] niks3-server[1113]: 2026/09/20 08:07:31 OK 1_commit_pending_closure.sql (6.7ms)4147lb # [ 29.563100] niks3-server[1113]: 2026/09/20 08:07:31 OK 2_object_stats_trigger.sql (1.23ms)4148lb # [ 29.564522] niks3-server[1113]: 2026/09/20 08:07:31 goose: up to current file version: 24149lb # [ 29.569892] niks3-server[1113]: 2026/09/20 08:07:31 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4150lb # [ 29.629481] niks3-server[1113]: 2026/09/20 08:07:31 INFO Read proxy enabled — serving cache objects from S34151lb # [ 29.631310] niks3-server[1113]: 2026/09/20 08:07:31 INFO Using socket-activated listener address=0.0.0.0:57514152lb # [ 29.636325] systemd[1]: Started niks3 server.4153lb # [ 29.636956] niks3-server[1113]: 2026/09/20 08:07:31 INFO systemd watchdog enabled interval=15s4154lb # [ 29.638102] systemd[1]: Reached target Multi-User System.4155lb # [ 29.640495] systemd[1]: Startup finished in 873ms (kernel) + 5.041s (initrd) + 23.724s (userspace) = 29.640s.4156lb # [ 29.643182] niks3-server[1113]: 2026/09/20 08:07:31 INFO Starting HTTP server address=0.0.0.0:57514157lb: (finished: waiting for unit niks3.service, in 18.39 seconds)4158lb: waiting for TCP port 5751 on localhost4159lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4160lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4161lb: waiting for unit envoy.service4162lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4163lb: waiting for TCP port 50051 on localhost4164lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4165lb # [ 30.397423] envoy[984]: conn peer=[::1]:57878 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34166lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4167lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4168??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4169 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284170lb: must succeed: curl -sf localhost:9901/clusters4171lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4172lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4173lb: waiting until exactly no endpoints of sched are unhealthy4174lb: must succeed: curl -sf localhost:9901/clusters4175lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4176lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.05 seconds)4177subtest: both builders hold a WorkerSession on the scheduler4178worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4179worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4180(finished: subtest: both builders hold a WorkerSession on the scheduler, in 0.07 seconds)4181subtest: balancer auth: client cert, bearer token, nothing, unknown CN4182worker1 # [ 31.036573] nix-grpc-daemon[784]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:545244183worker1 # [ 31.047464] systemd[1]: Started Nix Daemon.4184worker1 # [ 31.252695] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4185worker1 # [ 31.305366] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)4186worker1 # [ 31.347876] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 2/5)4187worker1 # [ 31.431771] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 3/5)4188worker1 # [ 31.470681] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 573 ms (attempt 4/5)4189worker1 # [ 32.056212] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4190worker2 # [ 32.113816] nix-grpc-daemon[848]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:548244191worker2 # [ 32.127925] systemd[1]: Started Nix Daemon.4192worker2 # [ 32.345693] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4193worker2 # [ 32.389840] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)4194worker2 # [ 32.447884] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 2/5)4195worker2 # [ 32.633565] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 364 ms (attempt 3/5)4196worker2 # [ 32.997820] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 699 ms (attempt 4/5)4197worker2 # [ 33.706258] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4198worker2 # [ 33.726229] nix-grpc-daemon[848]: ts=2026-09-20T08:07:35Z level=debug event=path_info_miss path=af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test error="error: path '/nix/store/af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test' is required, but there is no substituter that can build it"4199worker1 # [ 33.728423] nix-grpc-daemon[784]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:545244200worker1 # [ 33.747239] nix-grpc-daemon[784]: ts=2026-09-20T08:07:35Z level=debug event=path_info_miss path=af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test error="error: path '/nix/store/af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test' is required, but there is no substituter that can build it"4201client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4202client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4203client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4204client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4205worker1 # [ 34.118271] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=info event=oidc_jwks provider=mock keys=14206worker1 # [ 34.123485] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:545244207worker1 # [ 34.135556] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:545244208worker1 # [ 34.143511] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=debug event=path_info_miss path=af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test error="error: path '/nix/store/af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test' is required, but there is no substituter that can build it"4209worker2 # [ 34.181265] nix-grpc-daemon[848]: ts=2026-09-20T08:07:35Z level=info event=oidc_jwks provider=mock keys=14210worker2 # [ 34.186292] nix-grpc-daemon[848]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:548244211worker2 # [ 34.195266] nix-grpc-daemon[848]: ts=2026-09-20T08:07:35Z level=debug event=path_info_miss path=af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test error="error: path '/nix/store/af2224p8q87s85fjaqj9izsixgnmzk4v-nixos-system-client-test' is required, but there is no substituter that can build it"4212client: must succeed: rm -r /var/lib/nix-grpc-store4213client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4214worker1 # [ 34.424457] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=info event=denied method=QueryMissing cn=- role=none4215worker1 # [ 34.635324] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=info event=denied method=QueryMissing cn=stranger role=none4216(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.93 seconds)4217subtest: DAG build is scheduled across workers and lands in the cache4218client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24219worker2 # [ 34.888831] nix-grpc-daemon[848]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:548244220client # don't know how to build these paths:4221client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4222worker1 # [ 34.918299] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04223worker1 # [ 34.922361] nix-grpc-daemon[784]: ts=2026-09-20T08:07:36Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14224worker2 # [ 35.000527] nix-grpc-daemon[848]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244225worker2 # [ 35.024749] nix-grpc-daemon[848]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244226client # copying 1 paths to 'lb:50051'...4227worker2 # [ 35.034206] nix-grpc-daemon[848]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:548244228client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4229worker2 # [ 35.061203] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4230worker2 # [ 35.089594] nix-grpc-daemon[848]: ts=2026-09-20T08:07:36Z level=info event=niks3_push_started pid=8814231worker2 # [ 35.511733] nix-daemon[871]: accepted connection from pid 892, user nix-grpc-daemon (trusted)4232worker2 # [ 35.526843] nix-daemon[871]: reaped child process 896, status = succeeded4233worker2 # [ 35.683301] nix-daemon[871]: accepted connection from pid 898, user nix-grpc-daemon (trusted)4234worker2 # [ 35.695956] nix-daemon[871]: reaped child process 901, status = succeeded4235lb # [ 35.705173] niks3-server[1113]: 2026/09/20 08:07:37 INFO Received uploads request method=POST path=/api/pending_closures4236worker2 # [ 35.740767] nix-grpc-daemon[881]: time=2026-09-20T08:07:37.521Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4237worker2 # [ 35.743437] nix-grpc-daemon[881]: time=2026-09-20T08:07:37.524Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4238lb # [ 35.779851] niks3-server[1113]: 2026/09/20 08:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4239lb # [ 35.782170] niks3-server[1113]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4240lb # [ 35.796605] niks3-server[1113]: 2026/09/20 08:07:37 INFO Signed narinfos id=1 count=14241worker2 # [ 35.805756] nix-grpc-daemon[881]: time=2026-09-20T08:07:37.587Z level=INFO msg="Uploading 1 narinfos"4242lb # [ 35.808080] niks3-server[1113]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4243lb # [ 35.811123] niks3-server[1113]: 2026/09/20 08:07:37 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4244lb # [ 35.821141] niks3-server[1113]: 2026/09/20 08:07:37 INFO Completed upload id=14245worker2 # [ 35.828370] nix-grpc-daemon[881]: time=2026-09-20T08:07:37.610Z level=INFO msg="Upload complete. (491ms)"4246lb # [ 35.825861] niks3-server[1113]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4247worker2 # [ 35.832497] nix-grpc-daemon[848]: ts=2026-09-20T08:07:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_in=5044248worker2 # [ 35.841627] nix-grpc-daemon[848]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244249worker2 # [ 35.851152] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4250worker2 # [ 35.853589] nix-daemon[871]: reaped child process 879, status = succeeded4251client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4252worker2 # [ 35.861498] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4253client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4254client # farm-a> LOG-farm-a-t14255worker2 # [ 37.281465] nix-daemon[871]: reaped child process 905, status = succeeded4256worker2 # [ 37.430347] nix-daemon[871]: accepted connection from pid 921, user nix-grpc-daemon (trusted)4257worker2 # [ 37.444149] nix-daemon[871]: reaped child process 924, status = succeeded4258lb # [ 37.453740] niks3-server[1113]: 2026/09/20 08:07:39 INFO Received uploads request method=POST path=/api/pending_closures4259worker2 # [ 37.473144] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.254Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4260worker2 # [ 37.474756] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.256Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4261lb # [ 37.509841] niks3-server[1113]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4262lb # [ 37.518505] niks3-server[1113]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4263lb # [ 37.530535] niks3-server[1113]: 2026/09/20 08:07:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4264lb # [ 37.534978] niks3-server[1113]: 2026/09/20 08:07:39 INFO Signed narinfos id=2 count=14265worker2 # [ 37.545093] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.326Z level=INFO msg="Uploading 1 narinfos"4266lb # [ 37.539252] niks3-server[1113]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4267lb # [ 37.545153] niks3-server[1113]: 2026/09/20 08:07:39 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4268lb # [ 37.551453] niks3-server[1113]: 2026/09/20 08:07:39 INFO Completed upload id=24269worker2 # [ 37.558594] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.340Z level=INFO msg="Upload complete. (281ms)"4270lb # [ 37.553237] niks3-server[1113]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4271worker2 # [ 37.565652] nix-grpc-daemon[848]: ts=2026-09-20T08:07:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14272worker2 # [ 37.578877] nix-daemon[871]: reaped child process 903, status = succeeded4273worker1 # [ 37.563836] nix-grpc-daemon[784]: ts=2026-09-20T08:07:39Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04274worker1 # [ 37.567978] nix-grpc-daemon[784]: ts=2026-09-20T08:07:39Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14275worker2 # [ 37.633583] nix-grpc-daemon[848]: ts=2026-09-20T08:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244276worker2 # [ 37.647625] nix-grpc-daemon[848]: ts=2026-09-20T08:07:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244277worker2 # [ 37.661691] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.443Z level=INFO msg="All 1 paths already cached"4278client # copying 1 paths to 'lb:50051'...4279worker2 # [ 37.669747] nix-grpc-daemon[848]: ts=2026-09-20T08:07:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:548244280client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4281worker2 # [ 37.690247] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4282worker2 # [ 37.874402] nix-daemon[871]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4283worker2 # [ 37.889329] nix-daemon[871]: reaped child process 931, status = succeeded4284worker2 # [ 38.049815] nix-daemon[871]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4285worker2 # [ 38.063687] nix-daemon[871]: reaped child process 937, status = succeeded4286lb # [ 38.072163] niks3-server[1113]: 2026/09/20 08:07:39 INFO Received uploads request method=POST path=/api/pending_closures4287worker2 # [ 38.091305] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.873Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4288worker2 # [ 38.093434] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.874Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4289lb # [ 38.104923] niks3-server[1113]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4290lb # [ 38.116814] niks3-server[1113]: 2026/09/20 08:07:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4291worker2 # [ 38.131147] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.912Z level=INFO msg="Uploading 1 narinfos"4292lb # [ 38.123843] niks3-server[1113]: 2026/09/20 08:07:39 INFO Signed narinfos id=3 count=14293lb # [ 38.128692] niks3-server[1113]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4294lb # [ 38.139458] niks3-server[1113]: 2026/09/20 08:07:39 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4295lb # [ 38.146321] niks3-server[1113]: 2026/09/20 08:07:39 INFO Completed upload id=34296worker2 # [ 38.153253] nix-grpc-daemon[881]: time=2026-09-20T08:07:39.935Z level=INFO msg="Upload complete. (448ms)"4297lb # [ 38.149421] niks3-server[1113]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4298worker2 # [ 38.158141] nix-grpc-daemon[848]: ts=2026-09-20T08:07:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_in=6244299worker2 # [ 38.162807] nix-grpc-daemon[848]: ts=2026-09-20T08:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244300worker2 # [ 38.174061] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4301worker2 # [ 38.178241] nix-daemon[871]: reaped child process 926, status = succeeded4302worker2 # [ 38.183188] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4303client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4304client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4305lb # [ 38.245394] envoy[984]: conn peer=[2001:db8:1::1]:35620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=27664306lb # [ 38.249100] envoy[984]: conn peer=[2001:db8:1::1]:36832 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=363 ms=874307lb # [ 38.252425] envoy[984]: conn peer=[2001:db8:1::1]:36842 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=104308lb # [ 38.255737] envoy[984]: conn peer=[2001:db8:1::1]:36852 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84309client # farm-b> LOG-farm-b-t14310worker2 # [ 39.201346] nix-daemon[871]: reaped child process 941, status = succeeded4311worker2 # [ 39.342203] nix-daemon[871]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4312worker2 # [ 39.356773] nix-daemon[871]: reaped child process 960, status = succeeded4313lb # [ 39.365234] niks3-server[1113]: 2026/09/20 08:07:41 INFO Received uploads request method=POST path=/api/pending_closures4314worker2 # [ 39.379476] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.161Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4315worker2 # [ 39.381242] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.163Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4316lb # [ 39.410949] niks3-server[1113]: 2026/09/20 08:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4317lb # [ 39.416427] niks3-server[1113]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4318lb # [ 39.423232] niks3-server[1113]: 2026/09/20 08:07:41 INFO Signed narinfos id=4 count=14319worker2 # [ 39.432788] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.214Z level=INFO msg="Uploading 1 narinfos"4320lb # [ 39.428395] niks3-server[1113]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4321lb # [ 39.432972] niks3-server[1113]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4322lb # [ 39.441765] niks3-server[1113]: 2026/09/20 08:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4323lb # [ 39.447639] niks3-server[1113]: 2026/09/20 08:07:41 INFO Completed upload id=44324lb # [ 39.448835] niks3-server[1113]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4325worker2 # [ 39.454859] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.236Z level=INFO msg="Upload complete. (263ms)"4326worker2 # [ 39.460687] nix-grpc-daemon[848]: ts=2026-09-20T08:07:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14327worker1 # [ 39.446942] nix-grpc-daemon[784]: ts=2026-09-20T08:07:41Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04328worker1 # [ 39.451410] nix-grpc-daemon[784]: ts=2026-09-20T08:07:41Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14329worker2 # [ 39.473781] nix-daemon[871]: reaped child process 939, status = succeeded4330worker2 # [ 39.509709] nix-grpc-daemon[848]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244331worker2 # [ 39.523341] nix-grpc-daemon[848]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244332worker2 # [ 39.537524] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.319Z level=INFO msg="All 2 paths already cached"4333client # copying 1 paths to 'lb:50051'...4334client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4335worker2 # [ 39.546656] nix-grpc-daemon[848]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:548244336worker2 # [ 39.563413] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4337worker2 # [ 39.741918] nix-daemon[871]: accepted connection from pid 964, user nix-grpc-daemon (trusted)4338worker2 # [ 39.756482] nix-daemon[871]: reaped child process 967, status = succeeded4339worker2 # [ 39.914280] nix-daemon[871]: accepted connection from pid 969, user nix-grpc-daemon (trusted)4340worker2 # [ 39.927433] nix-daemon[871]: reaped child process 972, status = succeeded4341lb # [ 39.936533] niks3-server[1113]: 2026/09/20 08:07:41 INFO Received uploads request method=POST path=/api/pending_closures4342worker2 # [ 39.951673] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.733Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4343worker2 # [ 39.953377] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.735Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4344lb # [ 39.965165] niks3-server[1113]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4345lb # [ 39.975222] niks3-server[1113]: 2026/09/20 08:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4346worker2 # [ 39.990415] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.772Z level=INFO msg="Uploading 1 narinfos"4347lb # [ 39.983141] niks3-server[1113]: 2026/09/20 08:07:41 INFO Signed narinfos id=5 count=14348lb # [ 39.991764] niks3-server[1113]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4349lb # [ 39.998903] niks3-server[1113]: 2026/09/20 08:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4350worker2 # [ 40.013571] nix-grpc-daemon[881]: time=2026-09-20T08:07:41.795Z level=INFO msg="Upload complete. (434ms)"4351lb # [ 40.006641] niks3-server[1113]: 2026/09/20 08:07:41 INFO Completed upload id=54352lb # [ 40.009614] niks3-server[1113]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4353worker2 # [ 40.016939] nix-grpc-daemon[848]: ts=2026-09-20T08:07:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_in=7524354worker2 # [ 40.023524] nix-grpc-daemon[848]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244355worker2 # [ 40.033535] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4356worker2 # [ 40.036342] nix-daemon[871]: reaped child process 962, status = succeeded4357worker2 # [ 40.041569] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4358client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4359client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4360client # farm-top> LOG-farm-top-t14361worker2 # [ 41.063864] nix-daemon[871]: reaped child process 976, status = succeeded4362worker2 # [ 41.215426] nix-daemon[871]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4363worker2 # [ 41.229931] nix-daemon[871]: reaped child process 994, status = succeeded4364lb # [ 41.240535] niks3-server[1113]: 2026/09/20 08:07:43 INFO Received uploads request method=POST path=/api/pending_closures4365worker2 # [ 41.257577] nix-grpc-daemon[881]: time=2026-09-20T08:07:43.039Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4366worker2 # [ 41.259083] nix-grpc-daemon[881]: time=2026-09-20T08:07:43.041Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4367lb # [ 41.285422] niks3-server[1113]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4368lb # [ 41.290104] niks3-server[1113]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4369lb # [ 41.301213] niks3-server[1113]: 2026/09/20 08:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4370lb # [ 41.304858] niks3-server[1113]: 2026/09/20 08:07:43 INFO Signed narinfos id=6 count=14371worker2 # [ 41.314456] nix-grpc-daemon[881]: time=2026-09-20T08:07:43.096Z level=INFO msg="Uploading 1 narinfos"4372lb # [ 41.312905] niks3-server[1113]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4373lb # [ 41.317257] niks3-server[1113]: 2026/09/20 08:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4374lb # [ 41.321875] niks3-server[1113]: 2026/09/20 08:07:43 INFO Completed upload id=64375lb # [ 41.323406] niks3-server[1113]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4376worker2 # [ 41.328886] nix-grpc-daemon[881]: time=2026-09-20T08:07:43.110Z level=INFO msg="Upload complete. (280ms)"4377worker2 # [ 41.334849] nix-grpc-daemon[848]: ts=2026-09-20T08:07:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14378worker2 # [ 41.348971] nix-daemon[871]: reaped child process 974, status = succeeded4379client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.70 seconds)4380client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4381client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4382client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4383client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4384client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4385client # copying 3 paths...4386client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4387client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4388client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4389client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4390(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.25 seconds)4391subtest: repeat is answered Cached by the scheduler without building4392worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4393worker1 # finding garbage collector roots...4394worker1 # deleting specified paths...4395worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4396worker1 # deleting unused links...4397worker1 # note: hard linking is currently saving 0.0 KiB4398worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.30 seconds)4399worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4400worker2 # finding garbage collector roots...4401worker2 # deleting specified paths...4402worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4403worker2 # deleting unused links...4404worker2 # note: hard linking is currently saving 0.0 KiB4405worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4406client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24407client # don't know how to build these paths:4408client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4409worker1 # [ 42.663519] nix-grpc-daemon[784]: ts=2026-09-20T08:07:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:545244410worker1 # [ 42.677815] nix-grpc-daemon[784]: ts=2026-09-20T08:07:44Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14411worker1 # [ 42.688896] nix-grpc-daemon[784]: ts=2026-09-20T08:07:44Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14412worker1 # [ 42.699934] nix-grpc-daemon[784]: ts=2026-09-20T08:07:44Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14413client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.26 seconds)4414client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4415client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.17 seconds)4416worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}'4417worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}', in 0.06 seconds)4418(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.12 seconds)4419subtest: two clients wanting the same drv build it once4420client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4421client # [ 43.109635] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4422client # Running as unit: dedup1.service; invocation ID: 29d23e119542446e876699da8334de954423client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4424client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4425worker2 # [ 43.280494] nix-grpc-daemon[848]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:548244426client # [ 43.295293] nix[868]: don't know how to build these paths:4427client # [ 43.296157] nix[868]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4428worker1 # [ 43.277183] nix-grpc-daemon[784]: ts=2026-09-20T08:07:45Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04429worker1 # [ 43.282928] nix-grpc-daemon[784]: ts=2026-09-20T08:07:45Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14430worker1 # [ 43.288932] nix-grpc-daemon[784]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545244431worker1 # [ 43.304344] nix-grpc-daemon[784]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545244432client # [ 43.342409] nix[868]: copying 1 paths to 'lb:50051'...4433client # [ 43.343249] nix[868]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4434worker1 # [ 43.315326] nix-grpc-daemon[784]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545244435worker1 # [ 43.326935] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4436worker1 # [ 43.348395] nix-grpc-daemon[784]: ts=2026-09-20T08:07:45Z level=info event=niks3_push_started pid=8894437worker1 # [ 43.754502] nix-daemon[844]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4438worker1 # [ 43.770208] nix-daemon[844]: reaped child process 904, status = succeeded4439worker1 # [ 43.901212] nix-daemon[844]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4440worker1 # [ 43.914989] nix-daemon[844]: reaped child process 909, status = succeeded4441lb # [ 43.941200] niks3-server[1113]: 2026/09/20 08:07:45 INFO Received uploads request method=POST path=/api/pending_closures4442worker1 # [ 43.939474] nix-grpc-daemon[889]: time=2026-09-20T08:07:45.967Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4443worker1 # [ 43.941542] nix-grpc-daemon[889]: time=2026-09-20T08:07:45.968Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4444lb # [ 43.978481] niks3-server[1113]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4445lb # [ 43.985948] niks3-server[1113]: 2026/09/20 08:07:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4446lb # [ 43.992388] niks3-server[1113]: 2026/09/20 08:07:45 INFO Signed narinfos id=7 count=14447worker1 # [ 43.984066] nix-grpc-daemon[889]: time=2026-09-20T08:07:46.013Z level=INFO msg="Uploading 1 narinfos"4448lb # [ 44.000112] niks3-server[1113]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4449lb # [ 44.012565] niks3-server[1113]: 2026/09/20 08:07:45 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4450lb # [ 44.016887] niks3-server[1113]: 2026/09/20 08:07:45 INFO Completed upload id=74451worker1 # [ 44.006646] nix-grpc-daemon[889]: time=2026-09-20T08:07:46.036Z level=INFO msg="Upload complete. (403ms)"4452lb # [ 44.020078] niks3-server[1113]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4453worker1 # [ 44.010181] nix-grpc-daemon[784]: ts=2026-09-20T08:07:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=1 nar_bytes_in=4324454worker1 # [ 44.014360] nix-grpc-daemon[784]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545244455worker1 # [ 44.019297] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4456worker1 # [ 44.021561] nix-daemon[844]: reaped child process 887, status = succeeded4457worker1 # [ 44.027378] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4458client # [ 44.054599] nix[868]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4459client # [ 44.182543] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4460client # Running as unit: dedup2.service; invocation ID: 436b75d519604079bc7d7b71f4c157da4461client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4462client # [ 44.436994] nix[883]: don't know how to build these paths:4463client # [ 44.437912] nix[883]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4464worker2 # [ 44.425978] nix-grpc-daemon[848]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:548244465worker1 # [ 44.416572] nix-grpc-daemon[784]: ts=2026-09-20T08:07:46Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04466worker1 # [ 44.425569] nix-grpc-daemon[784]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545244467client # [ 44.458540] nix[883]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4468client: must succeed: sleep 24469client: (finished: must succeed: sleep 2, in 2.05 seconds)4470??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4471 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394472client: waiting for success: ! systemctl is-active dedup1 dedup24473??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4474 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394475worker1 # [ 47.652792] nix-daemon[844]: reaped child process 913, status = succeeded4476worker1 # [ 47.791087] nix-daemon[844]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4477worker1 # [ 47.801697] nix-daemon[844]: reaped child process 947, status = succeeded4478lb # [ 47.829762] niks3-server[1113]: 2026/09/20 08:07:49 INFO Received uploads request method=POST path=/api/pending_closures4479worker1 # [ 47.827800] nix-grpc-daemon[889]: time=2026-09-20T08:07:49.857Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4480worker1 # [ 47.829298] nix-grpc-daemon[889]: time=2026-09-20T08:07:49.858Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4481lb # [ 47.878323] niks3-server[1113]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4482lb # [ 47.886055] niks3-server[1113]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4483lb # [ 47.896351] niks3-server[1113]: 2026/09/20 08:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4484lb # [ 47.902551] niks3-server[1113]: 2026/09/20 08:07:49 INFO Signed narinfos id=8 count=14485worker1 # [ 47.891084] nix-grpc-daemon[889]: time=2026-09-20T08:07:49.919Z level=INFO msg="Uploading 1 narinfos"4486lb # [ 47.907819] niks3-server[1113]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4487lb # [ 47.917054] niks3-server[1113]: 2026/09/20 08:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4488lb # [ 47.919675] niks3-server[1113]: 2026/09/20 08:07:49 INFO Completed upload id=84489worker1 # [ 47.907543] nix-grpc-daemon[889]: time=2026-09-20T08:07:49.936Z level=INFO msg="Upload complete. (265ms)"4490lb # [ 47.922152] niks3-server[1113]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4491worker1 # [ 47.914988] nix-grpc-daemon[784]: ts=2026-09-20T08:07:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14492worker1 # [ 47.921922] nix-grpc-daemon[784]: ts=2026-09-20T08:07:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14493worker1 # [ 47.931618] nix-daemon[844]: reaped child process 911, status = succeeded4494client # [ 47.991653] systemd[1]: dedup1.service: Deactivated successfully.4495client # [ 47.996200] systemd[1]: dedup1.service: Consumed 101ms CPU time over 4.885s wall clock time, 39.3M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.4496client # [ 48.002713] systemd[1]: dedup2.service: Deactivated successfully.4497client # [ 48.004625] systemd[1]: dedup2.service: Consumed 131ms CPU time over 3.819s wall clock time, 33.1M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic.4498lb # [ 48.246336] envoy[984]: conn peer=[2001:db8:1::1]:36864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9355 tx=3756 ms=64924499lb # [ 48.247964] envoy[984]: conn peer=[2001:db8:1::1]:36880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=534500lb # [ 48.249307] envoy[984]: conn peer=[2001:db8:1::1]:54960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1329 ms=46664501lb # [ 48.250718] envoy[984]: conn peer=[2001:db8:1::1]:54962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=35334502client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4503client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4504client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4505worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4506worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4507worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4508worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4509worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4510worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4511worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4512worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4513(finished: subtest: two clients wanting the same drv build it once, in 5.97 seconds)4514subtest: build hook: nix-daemon with builders = grpc://lb4515client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4516client # [ 49.236742] systemd[1]: Started Nix Daemon.4517client # [ 49.404651] nix-daemon[924]: accepted connection from pid 921, user root (trusted)4518worker2 # [ 49.569320] nix-grpc-daemon[848]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:548244519worker2 # [ 49.579109] nix-grpc-daemon[848]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244520worker1 # [ 49.576508] nix-grpc-daemon[784]: ts=2026-09-20T08:07:51Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04521worker1 # [ 49.580574] nix-grpc-daemon[784]: ts=2026-09-20T08:07:51Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14522worker2 # [ 49.639818] nix-grpc-daemon[848]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244523worker2 # [ 49.653192] nix-grpc-daemon[848]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244524worker2 # [ 49.665291] nix-grpc-daemon[848]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:548244525worker2 # [ 49.677504] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4526worker2 # [ 49.854361] nix-daemon[871]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)4527worker2 # [ 49.869077] nix-daemon[871]: reaped child process 1038, status = succeeded4528worker2 # [ 50.020579] nix-daemon[871]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4529worker2 # [ 50.034621] nix-daemon[871]: reaped child process 1043, status = succeeded4530lb # [ 50.042396] niks3-server[1113]: 2026/09/20 08:07:51 INFO Received uploads request method=POST path=/api/pending_closures4531worker2 # [ 50.057219] nix-grpc-daemon[881]: time=2026-09-20T08:07:51.839Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4532worker2 # [ 50.058781] nix-grpc-daemon[881]: time=2026-09-20T08:07:51.840Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4533lb # [ 50.070141] niks3-server[1113]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4534lb # [ 50.081916] niks3-server[1113]: 2026/09/20 08:07:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4535worker2 # [ 50.093846] nix-grpc-daemon[881]: time=2026-09-20T08:07:51.875Z level=INFO msg="Uploading 1 narinfos"4536lb # [ 50.088207] niks3-server[1113]: 2026/09/20 08:07:51 INFO Signed narinfos id=9 count=14537lb # [ 50.099589] niks3-server[1113]: 2026/09/20 08:07:51 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4538lb # [ 50.140868] niks3-server[1113]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4539lb # [ 50.145651] niks3-server[1113]: 2026/09/20 08:07:51 INFO Completed upload id=94540worker2 # [ 50.152963] nix-grpc-daemon[881]: time=2026-09-20T08:07:51.934Z level=INFO msg="Upload complete. (462ms)"4541lb # [ 50.149658] niks3-server[1113]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4542worker2 # [ 50.158138] nix-grpc-daemon[848]: ts=2026-09-20T08:07:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_in=5124543worker2 # [ 50.164562] nix-grpc-daemon[848]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244544worker2 # [ 50.177130] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4545worker2 # [ 50.185102] nix-daemon[871]: reaped child process 1033, status = succeeded4546worker2 # [ 50.194229] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4547worker2 # [ 51.226777] nix-daemon[871]: reaped child process 1047, status = succeeded4548worker2 # [ 51.378221] nix-daemon[871]: accepted connection from pid 1062, user nix-grpc-daemon (trusted)4549worker2 # [ 51.392427] nix-daemon[871]: reaped child process 1065, status = succeeded4550lb # [ 51.398713] niks3-server[1113]: 2026/09/20 08:07:53 INFO Received uploads request method=POST path=/api/pending_closures4551worker2 # [ 51.410185] nix-grpc-daemon[881]: time=2026-09-20T08:07:53.191Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4552worker2 # [ 51.411735] nix-grpc-daemon[881]: time=2026-09-20T08:07:53.193Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4553lb # [ 51.420942] niks3-server[1113]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4554lb # [ 51.425692] niks3-server[1113]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4555lb # [ 51.434911] niks3-server[1113]: 2026/09/20 08:07:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4556lb # [ 51.438332] niks3-server[1113]: 2026/09/20 08:07:53 INFO Signed narinfos id=10 count=14557worker2 # [ 51.447691] nix-grpc-daemon[881]: time=2026-09-20T08:07:53.229Z level=INFO msg="Uploading 1 narinfos"4558lb # [ 51.445915] niks3-server[1113]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4559lb # [ 51.453172] niks3-server[1113]: 2026/09/20 08:07:53 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4560lb # [ 51.456827] niks3-server[1113]: 2026/09/20 08:07:53 INFO Completed upload id=104561worker2 # [ 51.463949] nix-grpc-daemon[881]: time=2026-09-20T08:07:53.246Z level=INFO msg="Upload complete. (259ms)"4562lb # [ 51.458528] niks3-server[1113]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4563worker2 # [ 51.466735] nix-grpc-daemon[848]: ts=2026-09-20T08:07:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14564worker2 # [ 51.473500] nix-grpc-daemon[848]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:548244565worker2 # [ 51.476868] nix-daemon[871]: reaped child process 1045, status = succeeded4566worker1 # [ 51.469457] nix-grpc-daemon[784]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:545244567worker1 # [ 51.480191] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4568worker1 # [ 51.497726] nix-grpc-daemon[784]: ts=2026-09-20T08:07:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=1 nar_bytes_out=1284569worker1 # [ 51.753982] nix-grpc-daemon[784]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:545244570worker1 # [ 51.759533] nix-grpc-daemon[784]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545244571worker1 # [ 51.765175] nix-grpc-daemon[889]: time=2026-09-20T08:07:53.793Z level=INFO msg="All 1 paths already cached"4572worker1 # [ 51.774175] nix-grpc-daemon[784]: ts=2026-09-20T08:07:53Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04573worker1 # [ 51.778257] nix-grpc-daemon[784]: ts=2026-09-20T08:07:53Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14574worker2 # [ 51.805091] nix-grpc-daemon[848]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244575worker2 # [ 51.817290] nix-grpc-daemon[848]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244576worker2 # [ 51.829552] nix-grpc-daemon[881]: time=2026-09-20T08:07:53.611Z level=INFO msg="All 1 paths already cached"4577worker2 # [ 51.835528] nix-grpc-daemon[848]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:548244578worker2 # [ 51.843940] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4579worker2 # [ 52.025769] nix-daemon[871]: accepted connection from pid 1069, user nix-grpc-daemon (trusted)4580worker2 # [ 52.039040] nix-daemon[871]: reaped child process 1072, status = succeeded4581worker2 # [ 52.195983] nix-daemon[871]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4582worker2 # [ 52.207832] nix-daemon[871]: reaped child process 1077, status = succeeded4583lb # [ 52.214546] niks3-server[1113]: 2026/09/20 08:07:54 INFO Received uploads request method=POST path=/api/pending_closures4584worker2 # [ 52.231564] nix-grpc-daemon[881]: time=2026-09-20T08:07:54.013Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4585worker2 # [ 52.233122] nix-grpc-daemon[881]: time=2026-09-20T08:07:54.015Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4586lb # [ 52.243872] niks3-server[1113]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4587lb # [ 52.257279] niks3-server[1113]: 2026/09/20 08:07:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4588lb # [ 52.261649] niks3-server[1113]: 2026/09/20 08:07:54 INFO Signed narinfos id=11 count=14589worker2 # [ 52.271563] nix-grpc-daemon[881]: time=2026-09-20T08:07:54.053Z level=INFO msg="Uploading 1 narinfos"4590lb # [ 52.268380] niks3-server[1113]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4591lb # [ 52.279586] niks3-server[1113]: 2026/09/20 08:07:54 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4592lb # [ 52.286150] niks3-server[1113]: 2026/09/20 08:07:54 INFO Completed upload id=114593worker2 # [ 52.295672] nix-grpc-daemon[881]: time=2026-09-20T08:07:54.077Z level=INFO msg="Upload complete. (437ms)"4594lb # [ 52.289105] niks3-server[1113]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4595worker2 # [ 52.300901] nix-grpc-daemon[848]: ts=2026-09-20T08:07:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_in=6244596worker2 # [ 52.308568] nix-grpc-daemon[848]: ts=2026-09-20T08:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244597worker2 # [ 52.317645] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4598worker2 # [ 52.327174] nix-daemon[871]: reaped child process 1067, status = succeeded4599worker2 # [ 52.330964] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4600worker2 # [ 53.156974] nix-daemon[871]: reaped child process 1081, status = succeeded4601worker2 # [ 53.326530] nix-daemon[871]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)4602worker2 # [ 53.337895] nix-daemon[871]: reaped child process 1099, status = succeeded4603lb # [ 53.347652] niks3-server[1113]: 2026/09/20 08:07:55 INFO Received uploads request method=POST path=/api/pending_closures4604worker2 # [ 53.364182] nix-grpc-daemon[881]: time=2026-09-20T08:07:55.146Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4605worker2 # [ 53.367337] nix-grpc-daemon[881]: time=2026-09-20T08:07:55.147Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4606lb # [ 53.396833] niks3-server[1113]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4607lb # [ 53.402832] niks3-server[1113]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4608lb # [ 53.414221] niks3-server[1113]: 2026/09/20 08:07:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4609lb # [ 53.417715] niks3-server[1113]: 2026/09/20 08:07:55 INFO Signed narinfos id=12 count=14610worker2 # [ 53.427495] nix-grpc-daemon[881]: time=2026-09-20T08:07:55.209Z level=INFO msg="Uploading 1 narinfos"4611lb # [ 53.427044] niks3-server[1113]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4612lb # [ 53.431149] niks3-server[1113]: 2026/09/20 08:07:55 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4613lb # [ 53.436583] niks3-server[1113]: 2026/09/20 08:07:55 INFO Completed upload id=124614lb # [ 53.438028] niks3-server[1113]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4615worker2 # [ 53.443777] nix-grpc-daemon[881]: time=2026-09-20T08:07:55.225Z level=INFO msg="Upload complete. (303ms)"4616worker1 # [ 53.434629] nix-grpc-daemon[784]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:545244617worker2 # [ 53.450736] nix-grpc-daemon[848]: ts=2026-09-20T08:07:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14618worker1 # [ 53.439633] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4619worker2 # [ 53.463964] nix-daemon[871]: reaped child process 1079, status = succeeded4620worker1 # [ 53.456747] nix-grpc-daemon[784]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:545244621worker1 # [ 53.458702] nix-grpc-daemon[784]: ts=2026-09-20T08:07:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=1 nar_bytes_out=1764622worker2 # [ 53.743402] nix-grpc-daemon[848]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:548244623worker2 # [ 53.746381] nix-grpc-daemon[848]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244624worker2 # [ 53.751642] nix-grpc-daemon[881]: time=2026-09-20T08:07:55.533Z level=INFO msg="All 2 paths already cached"4625worker1 # [ 53.742564] nix-grpc-daemon[784]: ts=2026-09-20T08:07:55Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04626worker1 # [ 53.747108] nix-grpc-daemon[784]: ts=2026-09-20T08:07:55Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14627worker2 # [ 53.806723] nix-grpc-daemon[848]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244628worker2 # [ 53.818554] nix-grpc-daemon[848]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244629worker2 # [ 53.939666] nix-grpc-daemon[881]: time=2026-09-20T08:07:55.721Z level=INFO msg="All 2 paths already cached"4630worker2 # [ 53.948792] nix-grpc-daemon[848]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:548244631worker2 # [ 53.957672] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4632worker2 # [ 54.144655] nix-daemon[871]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4633worker2 # [ 54.158488] nix-daemon[871]: reaped child process 1106, status = succeeded4634worker2 # [ 54.333401] nix-daemon[871]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4635worker2 # [ 54.348048] nix-daemon[871]: reaped child process 1111, status = succeeded4636lb # [ 54.356673] niks3-server[1113]: 2026/09/20 08:07:56 INFO Received uploads request method=POST path=/api/pending_closures4637worker2 # [ 54.373599] nix-grpc-daemon[881]: time=2026-09-20T08:07:56.155Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4638worker2 # [ 54.375185] nix-grpc-daemon[881]: time=2026-09-20T08:07:56.157Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4639lb # [ 54.389562] niks3-server[1113]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4640lb # [ 54.399853] niks3-server[1113]: 2026/09/20 08:07:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4641worker2 # [ 54.411892] nix-grpc-daemon[881]: time=2026-09-20T08:07:56.193Z level=INFO msg="Uploading 1 narinfos"4642lb # [ 54.405418] niks3-server[1113]: 2026/09/20 08:07:56 INFO Signed narinfos id=13 count=14643lb # [ 54.412187] niks3-server[1113]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4644lb # [ 54.422269] niks3-server[1113]: 2026/09/20 08:07:56 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4645lb # [ 54.427286] niks3-server[1113]: 2026/09/20 08:07:56 INFO Completed upload id=134646worker2 # [ 54.436485] nix-grpc-daemon[881]: time=2026-09-20T08:07:56.218Z level=INFO msg="Upload complete. (464ms)"4647worker2 # [ 54.438870] nix-grpc-daemon[848]: ts=2026-09-20T08:07:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_in=7524648worker2 # [ 54.441935] nix-grpc-daemon[848]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244649lb # [ 54.438684] niks3-server[1113]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4650worker2 # [ 54.448610] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4651worker2 # [ 54.453961] nix-daemon[871]: reaped child process 1101, status = succeeded4652worker2 # [ 54.460102] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4653worker2 # [ 55.685551] nix-daemon[871]: reaped child process 1115, status = succeeded4654worker2 # [ 55.840188] nix-daemon[871]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)4655worker2 # [ 55.852900] nix-daemon[871]: reaped child process 1133, status = succeeded4656lb # [ 55.857672] niks3-server[1113]: 2026/09/20 08:07:57 INFO Received uploads request method=POST path=/api/pending_closures4657worker2 # [ 55.873240] nix-grpc-daemon[881]: time=2026-09-20T08:07:57.655Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4658worker2 # [ 55.874919] nix-grpc-daemon[881]: time=2026-09-20T08:07:57.656Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4659lb # [ 55.898159] niks3-server[1113]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4660lb # [ 55.903628] niks3-server[1113]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4661lb # [ 55.917675] niks3-server[1113]: 2026/09/20 08:07:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4662lb # [ 55.922696] niks3-server[1113]: 2026/09/20 08:07:57 INFO Signed narinfos id=14 count=14663worker2 # [ 55.930251] nix-grpc-daemon[881]: time=2026-09-20T08:07:57.711Z level=INFO msg="Uploading 1 narinfos"4664lb # [ 55.928829] niks3-server[1113]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4665lb # [ 55.938472] niks3-server[1113]: 2026/09/20 08:07:57 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4666lb # [ 55.943074] niks3-server[1113]: 2026/09/20 08:07:57 INFO Completed upload id=144667lb # [ 55.944895] niks3-server[1113]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4668worker2 # [ 55.950356] nix-grpc-daemon[881]: time=2026-09-20T08:07:57.732Z level=INFO msg="Upload complete. (279ms)"4669worker1 # [ 55.941595] nix-grpc-daemon[784]: ts=2026-09-20T08:07:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:545244670worker2 # [ 55.956863] nix-grpc-daemon[848]: ts=2026-09-20T08:07:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14671worker1 # [ 55.947048] nix-grpc-daemon[784]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4672worker2 # [ 55.971680] nix-daemon[871]: reaped child process 1113, status = succeeded4673worker1 # [ 55.966424] nix-grpc-daemon[784]: ts=2026-09-20T08:07:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:545244674worker1 # [ 55.968807] nix-grpc-daemon[784]: ts=2026-09-20T08:07:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=1 nar_bytes_out=2324675client # [ 56.108231] nix-daemon[924]: reaped child process 926, status = succeeded4676client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.09 seconds)4677client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4678client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4679client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4680client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4681client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4682client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4683(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.18 seconds)4684subtest: an input only one worker has still reaches the builder4685client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4686client # this derivation will be built:4687client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4688client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4689client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.43 seconds)4690client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4691client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4692worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4693worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4694worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4695worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4696client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24697client # [ 57.232732] nix-daemon[924]: accepted connection from pid 1004, user root (trusted)4698client # this derivation will be built:4699client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4700worker2 # [ 57.384508] nix-grpc-daemon[848]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:548244701client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4702worker2 # [ 57.390274] nix-grpc-daemon[848]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244703client # copying 1 paths...4704client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4705worker1 # [ 57.379545] nix-grpc-daemon[784]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545244706worker1 # [ 57.386129] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4707worker1 # [ 57.541106] nix-daemon[844]: accepted connection from pid 976, user nix-grpc-daemon (trusted)4708worker1 # [ 57.553817] nix-daemon[844]: reaped child process 979, status = succeeded4709lb # [ 57.583563] niks3-server[1113]: 2026/09/20 08:07:59 INFO Received uploads request method=POST path=/api/pending_closures4710worker1 # [ 57.587272] nix-grpc-daemon[889]: time=2026-09-20T08:07:59.616Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4711worker1 # [ 57.588787] nix-grpc-daemon[889]: time=2026-09-20T08:07:59.616Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4712lb # [ 57.626664] niks3-server[1113]: 2026/09/20 08:07:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4713lb # [ 57.635822] niks3-server[1113]: 2026/09/20 08:07:59 INFO Signed narinfos id=15 count=14714worker1 # [ 57.626637] nix-grpc-daemon[889]: time=2026-09-20T08:07:59.655Z level=INFO msg="Uploading 1 narinfos"4715lb # [ 57.648066] niks3-server[1113]: 2026/09/20 08:07:59 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4716lb # [ 57.697705] niks3-server[1113]: 2026/09/20 08:07:59 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4717lb # [ 57.712294] niks3-server[1113]: 2026/09/20 08:07:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4718lb # [ 57.726617] niks3-server[1113]: 2026/09/20 08:07:59 INFO Completed upload id=154719worker1 # [ 57.714171] nix-grpc-daemon[889]: time=2026-09-20T08:07:59.743Z level=INFO msg="Upload complete. (323ms)"4720lb # [ 57.731989] niks3-server[1113]: 2026/09/20 08:07:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4721worker1 # [ 57.719826] nix-grpc-daemon[784]: ts=2026-09-20T08:07:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=1 nar_bytes_in=1204722worker1 # [ 57.732717] nix-grpc-daemon[784]: ts=2026-09-20T08:07:59Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04723worker1 # [ 57.736309] nix-grpc-daemon[784]: ts=2026-09-20T08:07:59Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14724worker1 # [ 57.741372] nix-daemon[844]: reaped child process 974, status = succeeded4725worker1 # [ 57.779761] nix-grpc-daemon[784]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545244726worker1 # [ 57.790236] nix-grpc-daemon[784]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545244727client # copying 2 paths to 'lb:50051'...4728client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4729worker1 # [ 57.801949] nix-grpc-daemon[784]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545244730client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4731worker1 # [ 57.817156] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4732worker1 # [ 57.978544] nix-daemon[844]: accepted connection from pid 986, user nix-grpc-daemon (trusted)4733worker1 # [ 57.991139] nix-daemon[844]: reaped child process 989, status = succeeded4734worker1 # [ 58.154680] nix-daemon[844]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4735worker1 # [ 58.167068] nix-daemon[844]: reaped child process 994, status = succeeded4736lb # [ 58.195309] niks3-server[1113]: 2026/09/20 08:07:59 INFO Received uploads request method=POST path=/api/pending_closures4737lb # [ 58.203942] niks3-server[1113]: 2026/09/20 08:07:59 INFO Received uploads request method=POST path=/api/pending_closures4738worker1 # [ 58.200344] nix-grpc-daemon[889]: time=2026-09-20T08:08:00.229Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4739worker1 # [ 58.201736] nix-grpc-daemon[889]: time=2026-09-20T08:08:00.229Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4740worker1 # [ 58.203295] nix-grpc-daemon[889]: time=2026-09-20T08:08:00.229Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4741lb # [ 58.233160] niks3-server[1113]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4742lb # [ 58.246541] envoy[984]: conn peer=[2001:db8:1::1]:54964 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3410 tx=1638 ms=20004743lb # [ 58.251791] envoy[984]: conn peer=[2001:db8:1::1]:54974 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=794744lb # [ 58.255198] envoy[984]: conn peer=[2001:db8:1::1]:54980 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3893 tx=1992 ms=17564745lb # [ 58.258903] envoy[984]: conn peer=[2001:db8:1::1]:47578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=524746lb # [ 58.261651] envoy[984]: conn peer=[2001:db8:1::1]:47596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=544747lb # [ 58.264354] envoy[984]: conn peer=[2001:db8:1::1]:47588 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2223 ms=22994748lb # [ 58.272816] niks3-server[1113]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4749lb # [ 58.275076] niks3-server[1113]: 2026/09/20 08:08:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4750lb # [ 58.277531] niks3-server[1113]: 2026/09/20 08:08:00 INFO Signed narinfos id=16 count=14751lb # [ 58.279158] niks3-server[1113]: 2026/09/20 08:08:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4752lb # [ 58.280896] niks3-server[1113]: 2026/09/20 08:08:00 INFO Signed narinfos id=17 count=24753lb # [ 58.282747] niks3-server[1113]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4754worker1 # [ 58.271077] nix-grpc-daemon[889]: time=2026-09-20T08:08:00.299Z level=INFO msg="Uploading 3 narinfos"4755lb # [ 58.285310] niks3-server[1113]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4756lb # [ 58.298154] niks3-server[1113]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4757lb # [ 58.301334] niks3-server[1113]: 2026/09/20 08:08:00 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4758lb # [ 58.303853] niks3-server[1113]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4759lb # [ 58.307170] niks3-server[1113]: 2026/09/20 08:08:00 INFO Completed upload id=164760lb # [ 58.309163] niks3-server[1113]: 2026/09/20 08:08:00 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4761lb # [ 58.311872] niks3-server[1113]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4762lb # [ 58.313946] niks3-server[1113]: 2026/09/20 08:08:00 INFO Completed upload id=174763worker1 # [ 58.301817] nix-grpc-daemon[889]: time=2026-09-20T08:08:00.331Z level=INFO msg="Upload complete. (469ms)"4764worker1 # [ 58.307152] nix-grpc-daemon[784]: ts=2026-09-20T08:08:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=2 nar_bytes_in=9764765worker1 # [ 58.312659] nix-grpc-daemon[784]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545244766worker1 # [ 58.323456] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4767worker1 # [ 58.331140] nix-daemon[844]: reaped child process 983, status = succeeded4768worker1 # [ 58.339347] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4769client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4770client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4771worker1 # [ 59.363505] nix-daemon[844]: reaped child process 998, status = succeeded4772worker1 # [ 59.503798] nix-daemon[844]: accepted connection from pid 1013, user nix-grpc-daemon (trusted)4773worker1 # [ 59.514108] nix-daemon[844]: reaped child process 1016, status = succeeded4774lb # [ 59.541899] niks3-server[1113]: 2026/09/20 08:08:01 INFO Received uploads request method=POST path=/api/pending_closures4775worker1 # [ 59.534139] nix-grpc-daemon[889]: time=2026-09-20T08:08:01.563Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4776lb # [ 59.558901] niks3-server[1113]: 2026/09/20 08:08:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4777worker1 # [ 59.548674] nix-grpc-daemon[889]: time=2026-09-20T08:08:01.578Z level=INFO msg="Uploading 1 narinfos"4778lb # [ 59.561536] niks3-server[1113]: 2026/09/20 08:08:01 INFO Signed narinfos id=18 count=14779lb # [ 59.564924] niks3-server[1113]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4780lb # [ 59.569768] niks3-server[1113]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4781lb # [ 59.574424] niks3-server[1113]: 2026/09/20 08:08:01 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4782lb # [ 59.578642] niks3-server[1113]: 2026/09/20 08:08:01 INFO Completed upload id=184783worker1 # [ 59.567956] nix-grpc-daemon[889]: time=2026-09-20T08:08:01.597Z level=INFO msg="Upload complete. (219ms)"4784lb # [ 59.580803] niks3-server[1113]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4785worker1 # [ 59.570044] nix-grpc-daemon[784]: ts=2026-09-20T08:08:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14786worker1 # [ 59.576869] nix-daemon[844]: reaped child process 996, status = succeeded4787client # copying 1 paths...4788worker1 # [ 59.615104] nix-grpc-daemon[784]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:545244789client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4790worker1 # [ 59.632108] nix-grpc-daemon[784]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:545244791worker1 # [ 59.635812] nix-grpc-daemon[784]: ts=2026-09-20T08:08:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=1 nar_bytes_out=1204792client # [ 59.769117] nix-daemon[924]: reaped child process 1007, status = succeeded4793client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.75 seconds)4794client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24795client # [ 59.933350] nix-daemon[924]: accepted connection from pid 1025, user root (trusted)4796client # this derivation will be built:4797client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4798worker1 # [ 60.079152] nix-grpc-daemon[784]: ts=2026-09-20T08:08:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:545244799client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4800worker1 # [ 60.086941] nix-grpc-daemon[784]: ts=2026-09-20T08:08:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545244801worker1 # [ 60.100773] nix-grpc-daemon[889]: time=2026-09-20T08:08:02.130Z level=INFO msg="All 1 paths already cached"4802worker1 # [ 60.114569] nix-grpc-daemon[784]: ts=2026-09-20T08:08:02Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04803worker1 # [ 60.119314] nix-grpc-daemon[784]: ts=2026-09-20T08:08:02Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14804worker2 # [ 60.142338] nix-grpc-daemon[848]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244805worker2 # [ 60.155277] nix-grpc-daemon[848]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:548244806client # copying 1 paths to 'lb:50051'...4807client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4808worker2 # [ 60.175587] nix-grpc-daemon[848]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:548244809worker2 # [ 60.184867] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4810worker2 # [ 60.203280] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)4811worker2 # [ 60.209115] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 2/5)4812worker2 # [ 60.338146] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 394 ms (attempt 3/5)4813worker2 # [ 60.737721] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 4/5)4814worker2 # [ 60.797071] nix-grpc-daemon[848]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4815worker2 # [ 60.802963] nix-grpc-daemon[848]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4816worker2 # [ 61.001128] nix-daemon[871]: accepted connection from pid 1144, user nix-grpc-daemon (trusted)4817worker2 # [ 61.014097] nix-daemon[871]: reaped child process 1147, status = succeeded4818worker2 # [ 61.175565] nix-daemon[871]: accepted connection from pid 1149, user nix-grpc-daemon (trusted)4819worker2 # [ 61.188254] nix-daemon[871]: reaped child process 1152, status = succeeded4820lb # [ 61.196761] niks3-server[1113]: 2026/09/20 08:08:02 INFO Received uploads request method=POST path=/api/pending_closures4821worker2 # [ 61.212860] nix-grpc-daemon[881]: time=2026-09-20T08:08:02.994Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4822worker2 # [ 61.214578] nix-grpc-daemon[881]: time=2026-09-20T08:08:02.996Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4823lb # [ 61.224197] niks3-server[1113]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4824lb # [ 61.235121] niks3-server[1113]: 2026/09/20 08:08:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4825worker2 # [ 61.247786] nix-grpc-daemon[881]: time=2026-09-20T08:08:03.029Z level=INFO msg="Uploading 1 narinfos"4826lb # [ 61.240774] niks3-server[1113]: 2026/09/20 08:08:03 INFO Signed narinfos id=19 count=14827lb # [ 61.245429] niks3-server[1113]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4828lb # [ 61.255059] niks3-server[1113]: 2026/09/20 08:08:03 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4829worker2 # [ 61.267112] nix-grpc-daemon[881]: time=2026-09-20T08:08:03.049Z level=INFO msg="Upload complete. (442ms)"4830lb # [ 61.260532] niks3-server[1113]: 2026/09/20 08:08:03 INFO Completed upload id=194831worker2 # [ 61.269885] nix-grpc-daemon[848]: ts=2026-09-20T08:08:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 paths=1 nar_bytes_in=5604832lb # [ 61.265538] niks3-server[1113]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4833worker2 # [ 61.276491] nix-grpc-daemon[848]: ts=2026-09-20T08:08:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:548244834worker2 # [ 61.284805] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4835worker2 # [ 61.288138] nix-daemon[871]: reaped child process 1138, status = succeeded4836worker2 # [ 61.298731] nix-grpc-daemon[848]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4837worker2 # [ 61.307756] nix-daemon[871]: accepted connection from pid 848, user nix-grpc-daemon (trusted)4838client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4839client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4840worker2 # [ 62.732835] nix-daemon[871]: reaped child process 1157, status = succeeded4841worker2 # [ 62.866439] nix-daemon[871]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4842worker2 # [ 62.878736] nix-daemon[871]: reaped child process 1175, status = succeeded4843lb # [ 62.883395] niks3-server[1113]: 2026/09/20 08:08:04 INFO Received uploads request method=POST path=/api/pending_closures4844worker2 # [ 62.900392] nix-grpc-daemon[881]: time=2026-09-20T08:08:04.682Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4845lb # [ 62.914497] niks3-server[1113]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4846lb # [ 62.923612] niks3-server[1113]: 2026/09/20 08:08:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4847worker2 # [ 62.936352] nix-grpc-daemon[881]: time=2026-09-20T08:08:04.718Z level=INFO msg="Uploading 1 narinfos"4848lb # [ 62.929207] niks3-server[1113]: 2026/09/20 08:08:04 INFO Signed narinfos id=20 count=14849lb # [ 62.935613] niks3-server[1113]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4850lb # [ 62.946582] niks3-server[1113]: 2026/09/20 08:08:04 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4851worker2 # [ 62.958701] nix-grpc-daemon[881]: time=2026-09-20T08:08:04.740Z level=INFO msg="Upload complete. (241ms)"4852lb # [ 62.952310] niks3-server[1113]: 2026/09/20 08:08:04 INFO Completed upload id=204853worker2 # [ 62.962343] nix-grpc-daemon[848]: ts=2026-09-20T08:08:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=14854lb # [ 62.957592] niks3-server[1113]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4855worker2 # [ 62.973521] nix-daemon[871]: reaped child process 1154, status = succeeded4856client # copying 1 paths...4857worker1 # [ 62.988437] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:545244858worker1 # [ 63.000188] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...4859client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4860worker2 # [ 63.053070] nix-grpc-daemon[848]: ts=2026-09-20T08:08:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:548244861worker2 # [ 63.058898] nix-grpc-daemon[848]: ts=2026-09-20T08:08:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_out=1204862client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.35 seconds)4863client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24864client # [ 63.159471] nix-daemon[924]: reaped child process 1028, status = succeeded4865client # [ 63.293500] nix-daemon[924]: accepted connection from pid 1046, user root (trusted)4866client # this derivation will be built:4867client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4868worker2 # [ 63.463255] nix-grpc-daemon[848]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:548244869client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4870worker1 # [ 63.451379] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545244871worker1 # [ 63.460557] nix-grpc-daemon[889]: time=2026-09-20T08:08:05.489Z level=INFO msg="All 1 paths already cached"4872worker1 # [ 63.474076] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=04873worker1 # [ 63.480255] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14874worker1 # [ 63.485741] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545244875worker1 # [ 63.497262] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545244876worker1 # [ 63.510099] nix-grpc-daemon[889]: time=2026-09-20T08:08:05.539Z level=INFO msg="All 1 paths already cached"4877client # copying 1 paths to 'lb:50051'...4878client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...4879worker1 # [ 63.517876] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545244880worker1 # [ 63.529095] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4881worker1 # [ 63.690522] nix-daemon[844]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4882worker1 # [ 63.703087] nix-daemon[844]: reaped child process 1028, status = succeeded4883worker1 # [ 63.854273] nix-daemon[844]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4884worker1 # [ 63.866108] nix-daemon[844]: reaped child process 1033, status = succeeded4885lb # [ 63.893399] niks3-server[1113]: 2026/09/20 08:08:05 INFO Received uploads request method=POST path=/api/pending_closures4886worker1 # [ 63.888648] nix-grpc-daemon[889]: time=2026-09-20T08:08:05.917Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4887worker1 # [ 63.890035] nix-grpc-daemon[889]: time=2026-09-20T08:08:05.917Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"4888lb # [ 63.920064] niks3-server[1113]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst4889lb # [ 63.928627] niks3-server[1113]: 2026/09/20 08:08:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4890lb # [ 63.934128] niks3-server[1113]: 2026/09/20 08:08:05 INFO Signed narinfos id=21 count=14891worker1 # [ 63.925725] nix-grpc-daemon[889]: time=2026-09-20T08:08:05.955Z level=INFO msg="Uploading 1 narinfos"4892lb # [ 63.939931] niks3-server[1113]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls4893lb # [ 63.950515] niks3-server[1113]: 2026/09/20 08:08:05 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4894worker1 # [ 63.943887] nix-grpc-daemon[889]: time=2026-09-20T08:08:05.973Z level=INFO msg="Upload complete. (404ms)"4895lb # [ 63.956343] niks3-server[1113]: 2026/09/20 08:08:05 INFO Completed upload id=214896worker1 # [ 63.946151] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=0 paths=1 nar_bytes_in=5604897lb # [ 63.962644] niks3-server[1113]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo4898worker1 # [ 63.951584] nix-grpc-daemon[784]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545244899worker1 # [ 63.959616] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4900worker1 # [ 63.964265] nix-daemon[844]: reaped child process 1023, status = succeeded4901client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...4902worker1 # [ 63.969300] nix-daemon[844]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4903client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4904worker1 # [ 64.781466] nix-daemon[844]: reaped child process 1037, status = succeeded4905worker1 # [ 64.925209] nix-daemon[844]: accepted connection from pid 1052, user nix-grpc-daemon (trusted)4906worker1 # [ 64.938147] nix-daemon[844]: reaped child process 1055, status = succeeded4907lb # [ 64.965376] niks3-server[1113]: 2026/09/20 08:08:06 INFO Received uploads request method=POST path=/api/pending_closures4908worker1 # [ 64.968486] nix-grpc-daemon[889]: time=2026-09-20T08:08:06.997Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4909lb # [ 64.991805] niks3-server[1113]: 2026/09/20 08:08:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4910lb # [ 64.993880] niks3-server[1113]: 2026/09/20 08:08:06 INFO Signed narinfos id=22 count=14911worker1 # [ 64.981426] nix-grpc-daemon[889]: time=2026-09-20T08:08:07.010Z level=INFO msg="Uploading 1 narinfos"4912lb # [ 64.999983] niks3-server[1113]: 2026/09/20 08:08:06 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4913lb # [ 65.005488] niks3-server[1113]: 2026/09/20 08:08:06 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4914lb # [ 65.019399] niks3-server[1113]: 2026/09/20 08:08:06 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls4915lb # [ 65.071500] niks3-server[1113]: 2026/09/20 08:08:06 INFO Completed upload id=224916worker1 # [ 65.061582] nix-grpc-daemon[889]: time=2026-09-20T08:08:07.090Z level=INFO msg="Upload complete. (286ms)"4917worker1 # [ 65.066588] nix-grpc-daemon[784]: ts=2026-09-20T08:08:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54524 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=14918worker1 # [ 65.078189] nix-daemon[844]: reaped child process 1035, status = succeeded4919lb # [ 65.091767] niks3-server[1113]: 2026/09/20 08:08:06 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo4920client # copying 1 paths...4921worker1 # [ 65.112138] nix-grpc-daemon[784]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:545244922client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...4923worker2 # [ 65.149073] nix-grpc-daemon[848]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:548244924worker2 # [ 65.158157] nix-grpc-daemon[848]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...4925worker2 # [ 65.169151] nix-grpc-daemon[848]: ts=2026-09-20T08:08:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54824 duration_s=0 paths=1 nar_bytes_out=1204926client # [ 65.284706] nix-daemon[924]: reaped child process 1049, status = succeeded4927client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.16 seconds)4928(finished: subtest: an input only one worker has still reaches the builder, in 9.08 seconds)4929subtest: upload whose reference the worker lacks is completed from the cache4930client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache4931client # this derivation will be built:4932client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv4933client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...4934client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.35 seconds)4935client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache4936client # this derivation will be built:4937client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv4938client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...4939client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds)4940client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure4941client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)4942worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4943worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.21 seconds)4944worker2 # [ 66.442927] systemd[1]: Stopping Nix worker-protocol over gRPC...4945worker2 # [ 66.519657] nix-grpc-daemon[848]: ts=2026-09-20T08:08:08Z level=info event=signal_exit4946worker1 # [ 66.509656] nix-grpc-daemon[784]: ts=2026-09-20T08:08:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:516004947worker1 # [ 66.513792] nix-grpc-daemon[784]: ts=2026-09-20T08:08:08Z level=info event=worker_gone addr=192.168.1.4:500514948worker2 # [ 66.535930] nix-grpc-daemon[848]: ts=2026-09-20T08:08:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4949worker2 # [ 66.554544] nix-daemon[871]: reaped child process 873, status = succeeded4950worker2 # [ 66.640748] nix-grpc-daemon[848]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4951worker2 # [ 66.644185] nix-grpc-daemon[848]: E0000 00:00:1789891688.422288 859 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4952worker2 # [ 67.055194] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4953worker2 # [ 67.056323] systemd[1]: Stopped Nix worker-protocol over gRPC.4954worker2 # [ 67.058272] systemd[1]: nix-grpc-daemon.service: Consumed 2.201s CPU time over 48.804s wall clock time, 51.6M memory peak, 64.8K incoming IP traffic, 115.1K outgoing IP traffic.4955worker2 # [ 67.062503] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4956worker2 # [ 67.064253] systemd[1]: Closed Nix worker-protocol over gRPC.4957worker2 # [ 67.065421] systemd[1]: nix-grpc-daemon.socket: Consumed 385us CPU time over 57.949s wall clock time, 256K memory peak, 48.9K incoming IP traffic, 37.9K outgoing IP traffic.4958lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy4959lb: must succeed: curl -sf localhost:9901/clusters4960lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4961lb: must succeed: curl -sf localhost:9901/clusters4962lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4963lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 1.08 seconds)4964client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&24965lb # [ 68.247212] envoy[984]: conn peer=[2001:db8:1::1]:47598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4228 tx=1751 ms=23234966lb # [ 68.250913] envoy[984]: conn peer=[2001:db8:1::1]:47602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=564967lb # [ 68.254384] envoy[984]: conn peer=[2001:db8:1::1]:47612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3710 tx=1943 ms=29724968lb # [ 68.257902] envoy[984]: conn peer=[2001:db8:1::1]:41242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=184969lb # [ 68.259279] envoy[984]: conn peer=[2001:db8:1::1]:41244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3699 tx=1780 ms=17574970lb # [ 68.260790] envoy[984]: conn peer=[2001:db8:1::1]:41254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=724971lb # [ 68.262225] envoy[984]: conn peer=192.168.1.4:43024 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1769 tx=732 ms=479984972client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache4973worker1 # [ 68.301959] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:545244974worker1 # [ 68.306091] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:545244975client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.20 seconds)4976worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache4977worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)4978worker2 # [ 68.425137] systemd[1]: Listening on Nix worker-protocol over gRPC.4979worker1 # [ 68.454502] systemd[1]: Stopping Nix worker-protocol over gRPC...4980worker1 # [ 68.481384] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=info event=signal_exit4981worker1 # [ 68.483774] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=info event=scheduler_restarting4982worker1 # [ 68.486528] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=info event=scheduler_restarting addr=lb:500514983worker1 # [ 68.488293] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:516004984worker1 # [ 68.489925] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=info event=worker_gone addr=192.168.1.3:500514985worker1 # [ 68.499940] nix-daemon[844]: reaped child process 846, status = succeeded4986worker1 # [ 68.580325] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4987worker1 # [ 68.583599] nix-grpc-daemon[784]: E0000 00:00:1789891690.608719 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true4988worker1 # [ 68.588445] nix-grpc-daemon[784]: E0000 00:00:1789891690.617671 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4989worker1 # [ 68.690700] nix-grpc-daemon[784]: ts=2026-09-20T08:08:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4990worker1 # [ 68.973617] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4991worker1 # [ 68.976646] systemd[1]: Stopped Nix worker-protocol over gRPC.4992worker1 # [ 68.982165] systemd[1]: nix-grpc-daemon.service: Consumed 1.326s CPU time over 50.746s wall clock time, 49.4M memory peak, 49.6K incoming IP traffic, 84.9K outgoing IP traffic.4993worker1 # [ 68.994591] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4994worker1 # [ 68.998496] systemd[1]: Closed Nix worker-protocol over gRPC.4995worker1 # [ 69.001481] systemd[1]: nix-grpc-daemon.socket: Consumed 297us CPU time over 59.551s wall clock time, 256K memory peak, 72.3K incoming IP traffic, 62K outgoing IP traffic.4996lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy4997lb: must succeed: curl -sf localhost:9901/clusters4998worker2 # [ 69.051135] systemd[1]: Starting Nix worker-protocol over gRPC...4999lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5000worker2 # [ 69.231096] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5001worker2 # [ 69.232833] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15002worker2 # [ 69.238599] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5003worker2 # [ 69.240191] systemd[1]: Started Nix worker-protocol over gRPC.5004worker2 # [ 69.256217] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_connected addr=lb:500515005worker2 # [ 69.259863] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5006worker2 # [ 69.460832] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_connected addr=lb:500515007worker2 # [ 69.462955] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5008worker2 # [ 69.664099] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_connected addr=lb:500515009worker2 # [ 69.668131] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5010worker2 # [ 69.868959] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_connected addr=lb:500515011worker2 # [ 69.873234] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5012lb: must succeed: curl -sf localhost:9901/clusters5013worker2 # [ 70.074288] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_connected addr=lb:500515014worker2 # [ 70.078354] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5015lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5016lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 1.07 seconds)5017client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25018client # lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, retrying5019worker2 # [ 70.278931] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_connected addr=lb:500515020worker2 # [ 70.280650] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5021worker2 # [ 70.481514] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_connected addr=lb:500515022worker2 # [ 70.483808] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5023worker2 # [ 70.684773] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_connected addr=lb:500515024worker2 # [ 70.686661] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5025worker2 # [ 70.775931] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349425026worker2 # [ 70.788067] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5027worker2 # [ 70.804603] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)5028worker2 # [ 70.852420] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5)5029worker2 # [ 70.887835] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_connected addr=lb:500515030worker2 # [ 70.891907] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5031worker2 # [ 70.984354] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 137 ms (attempt 3/5)5032worker2 # [ 71.092429] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_connected addr=lb:500515033worker2 # [ 71.094808] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5034worker2 # [ 71.121537] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 721 ms (attempt 4/5)5035worker2 # [ 71.296065] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_connected addr=lb:500515036worker2 # [ 71.297929] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5037worker2 # [ 71.499157] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_connected addr=lb:500515038worker2 # [ 71.503178] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5039worker2 # [ 71.704694] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_connected addr=lb:500515040worker2 # [ 71.708659] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5041worker2 # [ 71.843308] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5042client # copying 2 paths...5043client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5044worker2 # [ 71.854585] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349425045client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5046worker2 # [ 71.861142] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5047worker2 # [ 71.871195] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=niks3_push_started pid=12185048worker2 # [ 71.909093] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_connected addr=lb:500515049worker2 # [ 71.911207] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5050worker2 # [ 72.114097] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_connected addr=lb:500515051worker2 # [ 72.116416] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5052worker2 # [ 72.194848] nix-daemon[871]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5053worker2 # [ 72.207939] nix-daemon[871]: reaped child process 1234, status = succeeded5054lb # [ 72.216286] niks3-server[1113]: 2026/09/20 08:08:14 INFO Received uploads request method=POST path=/api/pending_closures5055lb # [ 72.220336] niks3-server[1113]: 2026/09/20 08:08:14 INFO Received uploads request method=POST path=/api/pending_closures5056worker2 # [ 72.230804] nix-grpc-daemon[1218]: time=2026-09-20T08:08:14.012Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5057worker2 # [ 72.232408] nix-grpc-daemon[1218]: time=2026-09-20T08:08:14.014Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5058worker2 # [ 72.235051] nix-grpc-daemon[1218]: time=2026-09-20T08:08:14.016Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5059lb # [ 72.260130] niks3-server[1113]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5060lb # [ 72.272918] niks3-server[1113]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5061lb # [ 72.283844] niks3-server[1113]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5062lb # [ 72.286209] niks3-server[1113]: 2026/09/20 08:08:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5063lb # [ 72.288301] niks3-server[1113]: 2026/09/20 08:08:14 INFO Signed narinfos id=23 count=15064lb # [ 72.289782] niks3-server[1113]: 2026/09/20 08:08:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5065lb # [ 72.292836] niks3-server[1113]: 2026/09/20 08:08:14 INFO Signed narinfos id=24 count=25066worker2 # [ 72.300915] nix-grpc-daemon[1218]: time=2026-09-20T08:08:14.082Z level=INFO msg="Uploading 3 narinfos"5067lb # [ 72.295761] niks3-server[1113]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5068lb # [ 72.310130] niks3-server[1113]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5069worker2 # [ 72.317727] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:14Z level=info event=scheduler_connected addr=lb:500515070lb # [ 72.313565] niks3-server[1113]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5071lb # [ 72.315520] niks3-server[1113]: 2026/09/20 08:08:14 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5072lb # [ 72.319097] niks3-server[1113]: 2026/09/20 08:08:14 INFO Completed upload id=235073worker2 # [ 72.322859] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5074lb # [ 72.321731] niks3-server[1113]: 2026/09/20 08:08:14 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5075lb # [ 72.323233] niks3-server[1113]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5076lb # [ 72.325388] niks3-server[1113]: 2026/09/20 08:08:14 INFO Completed upload id=245077worker2 # [ 72.333638] nix-grpc-daemon[1218]: time=2026-09-20T08:08:14.115Z level=INFO msg="Upload complete. (299ms)"5078worker2 # [ 72.336833] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=0 paths=2 nar_bytes_in=3125079worker2 # [ 72.344550] nix-daemon[871]: reaped child process 1216, status = succeeded5080client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 2.27 seconds)5081worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5082worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5083worker1 # [ 72.434643] systemd[1]: Listening on Nix worker-protocol over gRPC.5084worker1 # [ 72.441740] systemd[1]: Starting Nix worker-protocol over gRPC...5085worker2 # [ 72.522504] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:14Z level=info event=scheduler_connected addr=lb:500515086worker1 # [ 72.596251] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5087worker1 # [ 72.599587] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15088worker1 # [ 72.606056] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5089worker1 # [ 72.610127] systemd[1]: Started Nix worker-protocol over gRPC.5090worker1 # [ 72.617675] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05091lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5092lb: must succeed: curl -sf localhost:9901/clusters5093worker1 # [ 72.627100] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:14Z level=info event=scheduler_connected addr=lb:500515094worker1 # [ 72.628729] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05095lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5096lb: must succeed: curl -sf localhost:9901/clusters5097lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5098lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds)5099(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 8.47 seconds)5100subtest: scheduler down: builds wait, then resume when it is back5101worker1 # [ 73.787302] systemd[1]: Stopping Nix worker-protocol over gRPC...5102worker1 # [ 74.609859] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:16Z level=info event=signal_exit5103worker1 # [ 74.612996] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:16Z level=info event=scheduler_restarting5104worker2 # [ 74.631752] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:16Z level=info event=scheduler_restarting addr=lb:500515105worker1 # [ 74.614365] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:16Z level=info event=scheduler_restarting addr=lb:500515106worker1 # [ 74.615941] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:378345107worker1 # [ 74.617684] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:16Z level=info event=worker_gone addr=192.168.1.4:500515108worker1 # [ 74.619271] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:378345109worker1 # [ 74.621135] nix-grpc-daemon[1078]: ts=2026-09-20T08:08:16Z level=info event=worker_gone addr=192.168.1.3:500515110worker1 # [ 74.813724] nix-grpc-daemon[1078]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5111worker2 # [ 74.832260] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:16Z level=info event=scheduler_connected addr=lb:500515112worker1 # [ 74.815718] nix-grpc-daemon[1078]: E0000 00:00:1789891696.843123 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 13, started true, shutdown true5113worker1 # [ 74.969743] nix-grpc-daemon[1078]: E0000 00:00:1789891696.998934 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5114worker1 # [ 74.972429] nix-grpc-daemon[1078]: E0000 00:00:1789891696.999138 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5115worker2 # [ 76.627529] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5116worker1 # [ 76.619497] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5117worker1 # [ 76.621932] systemd[1]: Stopped Nix worker-protocol over gRPC.5118worker1 # [ 76.623951] systemd[1]: nix-grpc-daemon.service: Consumed 106ms CPU time over 4.178s wall clock time, 9.8M memory peak, 6.2K incoming IP traffic, 5K outgoing IP traffic.5119worker1 # [ 76.628644] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5120worker1 # [ 76.630733] systemd[1]: Closed Nix worker-protocol over gRPC.5121worker1 # [ 76.632331] systemd[1]: nix-grpc-daemon.socket: Consumed 569us CPU time over 4.203s wall clock time, 256K memory peak, 13.9K incoming IP traffic, 10.2K outgoing IP traffic.5122lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy5123lb: must succeed: curl -sf localhost:9901/clusters5124lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5125worker2 # [ 76.827886] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:18Z level=info event=scheduler_connected addr=lb:500515126worker2 # [ 76.832265] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5127worker2 # [ 77.033070] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:18Z level=info event=scheduler_connected addr=lb:500515128worker2 # [ 77.037212] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5129worker2 # [ 77.237774] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_connected addr=lb:500515130worker2 # [ 77.240208] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5131worker2 # [ 77.441317] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_connected addr=lb:500515132worker2 # [ 77.443594] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5133worker2 # [ 77.644991] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_connected addr=lb:500515134worker2 # [ 77.646830] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5135lb: must succeed: curl -sf localhost:9901/clusters5136lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5137lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 1.14 seconds)5138client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback5139worker2 # [ 77.847989] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_connected addr=lb:500515140worker2 # [ 77.852276] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5141client # [ 77.863112] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback.5142client # Running as unit: waits.service; invocation ID: 52958c09dc6c41ab9ebbb23c48eb51295143client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback, in 0.07 seconds)5144??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5145 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735146client: must succeed: sleep 3.05147worker2 # [ 78.052751] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_connected addr=lb:500515148worker2 # [ 78.054867] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5149worker2 # [ 78.062928] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349425150client # [ 78.074526] nix[1125]: don't know how to build these paths:5151client # [ 78.075958] nix[1125]: /nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5152client # [ 78.077552] nix[1125]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5153worker2 # [ 78.256059] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_connected addr=lb:500515154lb # [ 78.247915] envoy[984]: conn peer=[2001:db8:1::1]:41256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=95155lb # [ 78.254829] envoy[984]: conn peer=[2001:db8:1::3]:44824 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1223 tx=468 ms=493745156worker2 # [ 78.262261] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5157lb # [ 78.259282] envoy[984]: conn peer=[2001:db8:1::1]:41266 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1160 tx=426 ms=20765158lb # [ 78.263717] envoy[984]: conn peer=[2001:db8:1::3]:47864 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=552 tx=177 ms=21905159worker2 # [ 78.462963] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_connected addr=lb:500515160worker2 # [ 78.465331] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5161client # [ 78.581630] nix[1125]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5162worker2 # [ 78.667495] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_connected addr=lb:500515163worker2 # [ 78.671414] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5164worker2 # [ 78.872276] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_connected addr=lb:500515165worker2 # [ 78.874934] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5166worker2 # [ 79.075772] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_connected addr=lb:500515167worker2 # [ 79.077978] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5168worker2 # [ 79.278480] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_connected addr=lb:500515169worker2 # [ 79.280276] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5170worker2 # [ 79.481170] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_connected addr=lb:500515171worker2 # [ 79.484060] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5172client # [ 79.586188] nix[1125]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5173worker2 # [ 79.686605] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_connected addr=lb:500515174worker2 # [ 79.690638] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5175worker2 # [ 79.891714] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_connected addr=lb:500515176worker2 # [ 79.896842] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5177worker2 # [ 80.097306] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_connected addr=lb:500515178worker2 # [ 80.101656] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5179worker2 # [ 80.302474] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_connected addr=lb:500515180worker2 # [ 80.306776] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5181worker2 # [ 80.507831] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_connected addr=lb:500515182worker2 # [ 80.512710] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5183worker2 # [ 80.714644] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_connected addr=lb:500515184worker2 # [ 80.718664] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5185client: (finished: must succeed: sleep 3.0, in 3.04 seconds)5186client: must succeed: systemctl is-active waits5187worker2 # [ 80.919760] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_connected addr=lb:500515188worker2 # [ 80.923989] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5189client: (finished: must succeed: systemctl is-active waits, in 0.02 seconds)5190worker1 # [ 80.966673] systemd[1]: Listening on Nix worker-protocol over gRPC.5191worker1 # [ 80.973105] systemd[1]: Starting Nix worker-protocol over gRPC...5192worker2 # [ 81.124846] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:22Z level=info event=scheduler_connected addr=lb:500515193worker1 # [ 81.123829] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5194worker1 # [ 81.127255] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15195worker1 # [ 81.134373] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5196worker1 # [ 81.137797] systemd[1]: Started Nix worker-protocol over gRPC.5197worker1 # [ 81.142655] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05198lb: waiting until exactly no endpoints of sched are unhealthy5199lb: must succeed: curl -sf localhost:9901/clusters5200worker1 # [ 81.152995] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=info event=scheduler_connected addr=lb:500515201worker1 # [ 81.154573] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05202lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5203worker1 # [ 81.568651] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=debug event=want client=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv cached=05204worker1 # [ 81.572860] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:23Z level=debug event=assigned drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv worker=192.168.1.4:50051 clients=15205worker2 # [ 81.634068] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425206worker2 # [ 81.648568] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349425207client # [ 81.668460] nix[1125]: copying 1 paths to 'lb:50051'...5208client # [ 81.669283] nix[1125]: copying path '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' to 'lb:50051'...5209worker2 # [ 81.661091] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349425210worker2 # [ 81.673341] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5211worker2 # [ 81.850453] nix-daemon[871]: accepted connection from pid 1241, user nix-grpc-daemon (trusted)5212worker2 # [ 81.865176] nix-daemon[871]: reaped child process 1244, status = succeeded5213worker2 # [ 82.035960] nix-daemon[871]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5214worker2 # [ 82.052378] nix-daemon[871]: reaped child process 1249, status = succeeded5215lb # [ 82.060136] niks3-server[1113]: 2026/09/20 08:08:23 INFO Received uploads request method=POST path=/api/pending_closures5216worker2 # [ 82.074118] nix-grpc-daemon[1218]: time=2026-09-20T08:08:23.855Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5217worker2 # [ 82.075737] nix-grpc-daemon[1218]: time=2026-09-20T08:08:23.857Z level=INFO msg="Uploading 78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv (520B)"5218lb # [ 82.086071] niks3-server[1113]: 2026/09/20 08:08:23 INFO Registered completed upload object_key=nar/06bjks304hxld0mwhch6kvcfiix46iimcpysvzrdsfv41vfc14ny.nar.zst5219lb # [ 82.089401] niks3-server[1113]: 2026/09/20 08:08:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5220lb # [ 82.092659] niks3-server[1113]: 2026/09/20 08:08:23 INFO Signed narinfos id=25 count=15221worker2 # [ 82.101216] nix-grpc-daemon[1218]: time=2026-09-20T08:08:23.883Z level=INFO msg="Uploading 1 narinfos"5222lb # [ 82.098120] niks3-server[1113]: 2026/09/20 08:08:23 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.ls5223lb # [ 82.103613] niks3-server[1113]: 2026/09/20 08:08:23 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5224lb # [ 82.108860] niks3-server[1113]: 2026/09/20 08:08:23 INFO Completed upload id=255225worker2 # [ 82.115702] nix-grpc-daemon[1218]: time=2026-09-20T08:08:23.897Z level=INFO msg="Upload complete. (428ms)"5226lb # [ 82.110916] niks3-server[1113]: 2026/09/20 08:08:23 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.narinfo5227worker2 # [ 82.119293] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=0 paths=1 nar_bytes_in=5205228worker2 # [ 82.122481] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425229worker2 # [ 82.128622] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5230worker2 # [ 82.134689] nix-daemon[871]: reaped child process 1239, status = succeeded5231client # [ 82.147304] nix[1125]: building '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' on lb:50051...5232worker2 # [ 82.139399] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5233lb: must succeed: curl -sf localhost:9901/clusters5234lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5235lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.12 seconds)5236client: waiting for success: ! systemctl is-active waits5237worker2 # [ 82.956402] nix-daemon[871]: reaped child process 1253, status = succeeded5238worker2 # [ 83.094353] nix-daemon[871]: accepted connection from pid 1268, user nix-grpc-daemon (trusted)5239worker2 # [ 83.110409] nix-daemon[871]: reaped child process 1271, status = succeeded5240lb # [ 83.119823] niks3-server[1113]: 2026/09/20 08:08:24 INFO Received uploads request method=POST path=/api/pending_closures5241worker2 # [ 83.137439] nix-grpc-daemon[1218]: time=2026-09-20T08:08:24.918Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5242worker2 # [ 83.138894] nix-grpc-daemon[1218]: time=2026-09-20T08:08:24.918Z level=INFO msg="Uploading wxl98jgbbzfq9nz6nhndwvzybqml1mdg-farm-a (136B)"5243lb # [ 83.157099] niks3-server[1113]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=log/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv5244lb # [ 83.167419] niks3-server[1113]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst5245lb # [ 83.177784] niks3-server[1113]: 2026/09/20 08:08:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5246lb # [ 83.184732] niks3-server[1113]: 2026/09/20 08:08:24 INFO Signed narinfos id=26 count=15247worker2 # [ 83.192221] nix-grpc-daemon[1218]: time=2026-09-20T08:08:24.973Z level=INFO msg="Uploading 1 narinfos"5248lb # [ 83.190870] niks3-server[1113]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.ls5249lb # [ 83.199068] niks3-server[1113]: 2026/09/20 08:08:24 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5250lb # [ 83.204504] niks3-server[1113]: 2026/09/20 08:08:24 INFO Completed upload id=265251worker2 # [ 83.211871] nix-grpc-daemon[1218]: time=2026-09-20T08:08:24.993Z level=INFO msg="Upload complete. (265ms)"5252lb # [ 83.206331] niks3-server[1113]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.narinfo5253worker2 # [ 83.218714] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv assign_id=1 outputs=15254worker1 # [ 83.205806] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:25Z level=debug event=want client=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv cached=05255worker1 # [ 83.209759] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:25Z level=debug event=assigned drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv worker=192.168.1.4:50051 clients=15256worker2 # [ 83.233244] nix-daemon[871]: reaped child process 1251, status = succeeded5257worker2 # [ 83.269246] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425258worker2 # [ 83.282484] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349425259worker2 # [ 83.297158] nix-grpc-daemon[1218]: time=2026-09-20T08:08:25.079Z level=INFO msg="All 1 paths already cached"5260client # [ 83.311865] nix[1125]: copying 1 paths to 'lb:50051'...5261client # [ 83.312729] nix[1125]: copying path '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' to 'lb:50051'...5262worker2 # [ 83.304438] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349425263worker2 # [ 83.314345] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5264worker2 # [ 83.493334] nix-daemon[871]: accepted connection from pid 1275, user nix-grpc-daemon (trusted)5265worker2 # [ 83.510431] nix-daemon[871]: reaped child process 1278, status = succeeded5266worker2 # [ 83.681751] nix-daemon[871]: accepted connection from pid 1280, user nix-grpc-daemon (trusted)5267worker2 # [ 83.697542] nix-daemon[871]: reaped child process 1283, status = succeeded5268lb # [ 83.701798] niks3-server[1113]: 2026/09/20 08:08:25 INFO Received uploads request method=POST path=/api/pending_closures5269worker2 # [ 83.716531] nix-grpc-daemon[1218]: time=2026-09-20T08:08:25.498Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5270worker2 # [ 83.718235] nix-grpc-daemon[1218]: time=2026-09-20T08:08:25.498Z level=INFO msg="Uploading jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv (632B)"5271lb # [ 83.726878] niks3-server[1113]: 2026/09/20 08:08:25 INFO Registered completed upload object_key=nar/06r703613wasx30c56zihv19sk7v1y1xsivlzw3jax3csnwjf02v.nar.zst5272lb # [ 83.737402] niks3-server[1113]: 2026/09/20 08:08:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5273worker2 # [ 83.749926] nix-grpc-daemon[1218]: time=2026-09-20T08:08:25.531Z level=INFO msg="Uploading 1 narinfos"5274lb # [ 83.742554] niks3-server[1113]: 2026/09/20 08:08:25 INFO Signed narinfos id=27 count=15275lb # [ 83.749155] niks3-server[1113]: 2026/09/20 08:08:25 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.ls5276lb # [ 83.758229] niks3-server[1113]: 2026/09/20 08:08:25 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5277worker2 # [ 83.771657] nix-grpc-daemon[1218]: time=2026-09-20T08:08:25.553Z level=INFO msg="Upload complete. (445ms)"5278lb # [ 83.764483] niks3-server[1113]: 2026/09/20 08:08:25 INFO Completed upload id=275279worker2 # [ 83.774135] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=0 paths=1 nar_bytes_in=6325280lb # [ 83.769104] niks3-server[1113]: 2026/09/20 08:08:25 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.narinfo5281worker2 # [ 83.780313] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425282worker2 # [ 83.787488] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5283worker2 # [ 83.790339] nix-daemon[871]: reaped child process 1273, status = succeeded5284worker2 # [ 83.796677] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5285client # [ 83.804468] nix[1125]: building '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' on lb:50051...5286worker2 # [ 84.814265] nix-daemon[871]: reaped child process 1287, status = succeeded5287worker2 # [ 84.960676] nix-daemon[871]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5288worker2 # [ 84.976034] nix-daemon[871]: reaped child process 1305, status = succeeded5289lb # [ 84.985892] niks3-server[1113]: 2026/09/20 08:08:26 INFO Received uploads request method=POST path=/api/pending_closures5290worker2 # [ 85.146458] nix-grpc-daemon[1218]: time=2026-09-20T08:08:26.927Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5291worker2 # [ 85.152943] nix-grpc-daemon[1218]: time=2026-09-20T08:08:26.932Z level=INFO msg="Uploading ahy8cs7r52ad4fklig5k1khmrwzp7bkc-farm-b (184B)"5292lb # [ 85.182825] niks3-server[1113]: 2026/09/20 08:08:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5293lb # [ 85.189587] niks3-server[1113]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=nar/1bxjgkmwyii071c3ahwryw7md5gl9qidg8bm2rb2v2idzf8bvmpb.nar.zst5294lb # [ 85.197570] niks3-server[1113]: 2026/09/20 08:08:26 INFO Signed narinfos id=28 count=15295worker2 # [ 85.208860] nix-grpc-daemon[1218]: time=2026-09-20T08:08:26.990Z level=INFO msg="Uploading 1 narinfos"5296lb # [ 85.203899] niks3-server[1113]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=log/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv5297lb # [ 85.218936] niks3-server[1113]: 2026/09/20 08:08:27 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5298lb # [ 85.223530] niks3-server[1113]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.ls5299lb # [ 85.229925] niks3-server[1113]: 2026/09/20 08:08:27 INFO Completed upload id=285300worker2 # [ 85.237330] nix-grpc-daemon[1218]: time=2026-09-20T08:08:27.019Z level=INFO msg="Upload complete. (432ms)"5301lb # [ 85.232716] niks3-server[1113]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.narinfo5302worker2 # [ 85.245277] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv assign_id=2 outputs=15303worker1 # [ 85.230968] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:27Z level=debug event=want client=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv cached=05304worker1 # [ 85.235451] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:27Z level=debug event=assigned drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv worker=192.168.1.4:50051 clients=15305worker2 # [ 85.262335] nix-daemon[871]: reaped child process 1285, status = succeeded5306worker2 # [ 85.294113] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425307worker2 # [ 85.307145] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349425308worker2 # [ 85.319742] nix-grpc-daemon[1218]: time=2026-09-20T08:08:27.101Z level=INFO msg="All 2 paths already cached"5309client # [ 85.334388] nix[1125]: copying 1 paths to 'lb:50051'...5310client # [ 85.335185] nix[1125]: copying path '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' to 'lb:50051'...5311worker2 # [ 85.326758] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349425312worker2 # [ 85.338125] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5313worker2 # [ 85.494069] nix-daemon[871]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5314worker2 # [ 85.511075] nix-daemon[871]: reaped child process 1312, status = succeeded5315worker2 # [ 85.658732] nix-daemon[871]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5316worker2 # [ 85.676119] nix-daemon[871]: reaped child process 1317, status = succeeded5317lb # [ 85.679781] niks3-server[1113]: 2026/09/20 08:08:27 INFO Received uploads request method=POST path=/api/pending_closures5318worker2 # [ 85.692571] nix-grpc-daemon[1218]: time=2026-09-20T08:08:27.474Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5319worker2 # [ 85.693985] nix-grpc-daemon[1218]: time=2026-09-20T08:08:27.474Z level=INFO msg="Uploading 4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv (760B)"5320lb # [ 85.698507] niks3-server[1113]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=nar/1dx1l3qanf0yqmk397nzvl6w8vm5z1klsskxak9mqzzqlm7rj9id.nar.zst5321lb # [ 85.701280] niks3-server[1113]: 2026/09/20 08:08:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5322lb # [ 85.703358] niks3-server[1113]: 2026/09/20 08:08:27 INFO Signed narinfos id=29 count=15323worker2 # [ 85.711778] nix-grpc-daemon[1218]: time=2026-09-20T08:08:27.493Z level=INFO msg="Uploading 1 narinfos"5324lb # [ 85.707442] niks3-server[1113]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.ls5325lb # [ 85.712933] niks3-server[1113]: 2026/09/20 08:08:27 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5326lb # [ 85.716689] niks3-server[1113]: 2026/09/20 08:08:27 INFO Completed upload id=295327worker2 # [ 85.723713] nix-grpc-daemon[1218]: time=2026-09-20T08:08:27.505Z level=INFO msg="Upload complete. (373ms)"5328worker2 # [ 85.725746] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=0 paths=1 nar_bytes_in=7605329lb # [ 85.719557] niks3-server[1113]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.narinfo5330worker2 # [ 85.728972] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425331worker2 # [ 85.735566] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5332worker2 # [ 85.741149] nix-daemon[871]: reaped child process 1307, status = succeeded5333client # [ 85.752593] nix[1125]: building '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' on lb:50051...5334worker2 # [ 85.744770] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5335worker2 # [ 87.161927] nix-daemon[871]: reaped child process 1321, status = succeeded5336worker2 # [ 87.285519] nix-daemon[871]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)5337worker2 # [ 87.299540] nix-daemon[871]: reaped child process 1339, status = succeeded5338lb # [ 87.304947] niks3-server[1113]: 2026/09/20 08:08:29 INFO Received uploads request method=POST path=/api/pending_closures5339worker2 # [ 87.321717] nix-grpc-daemon[1218]: time=2026-09-20T08:08:29.103Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5340worker2 # [ 87.323253] nix-grpc-daemon[1218]: time=2026-09-20T08:08:29.105Z level=INFO msg="Uploading 2kzynzc2x7d9fjl737krjzzjbsp5p77k-farm-top (240B)"5341lb # [ 87.336149] niks3-server[1113]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=nar/1x5xsygwz4a6bpv0g402i3p0nk63j2j9qkxs1rdnp6s20644kc3j.nar.zst5342lb # [ 87.341335] niks3-server[1113]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=log/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5343lb # [ 87.348585] niks3-server[1113]: 2026/09/20 08:08:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5344lb # [ 87.350670] niks3-server[1113]: 2026/09/20 08:08:29 INFO Signed narinfos id=30 count=15345worker2 # [ 87.357914] nix-grpc-daemon[1218]: time=2026-09-20T08:08:29.139Z level=INFO msg="Uploading 1 narinfos"5346lb # [ 87.354072] niks3-server[1113]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.ls5347lb # [ 87.358304] niks3-server[1113]: 2026/09/20 08:08:29 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5348lb # [ 87.360947] niks3-server[1113]: 2026/09/20 08:08:29 INFO Completed upload id=305349worker2 # [ 87.367954] nix-grpc-daemon[1218]: time=2026-09-20T08:08:29.150Z level=INFO msg="Upload complete. (214ms)"5350lb # [ 87.364043] niks3-server[1113]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.narinfo5351worker2 # [ 87.371203] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv assign_id=3 outputs=15352worker2 # [ 87.377810] nix-daemon[871]: reaped child process 1319, status = succeeded5353client # [ 87.417818] systemd[1]: waits.service: Deactivated successfully.5354client # [ 87.422093] systemd[1]: waits.service: Consumed 132ms CPU time over 9.557s wall clock time, 49.5M memory peak, 14.6K incoming IP traffic, 19.9K outgoing IP traffic.5355client: (finished: waiting for success: ! systemctl is-active waits, in 5.23 seconds)5356client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }5357client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.04 seconds)5358worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5359worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5360(finished: subtest: scheduler down: builds wait, then resume when it is back, in 13.88 seconds)5361subtest: clean scheduler restart: peers are told, reconnect without error or backoff5362client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5363client # [ 87.668385] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5364client # Running as unit: rs.service; invocation ID: d4ed4cc1287e4d61b1669e97f889981e5365client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5366worker2 # [ 87.847318] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349425367client # [ 87.862311] nix[1185]: don't know how to build these paths:5368client # [ 87.863243] nix[1185]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5369worker1 # [ 87.842923] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:29Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05370worker1 # [ 87.848743] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:29Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15371worker1 # [ 87.860208] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347765372worker1 # [ 87.870237] nix-daemon[844]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5373worker1 # [ 87.887649] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 1/5)5374worker1 # [ 87.919489] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 2/5)5375worker1 # [ 88.024480] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 3/5)5376worker1 # [ 88.088392] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 4/5)5377lb # [ 88.248518] envoy[984]: conn peer=[2001:db8:1::1]:54256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=10033 tx=4050 ms=93195378worker1 # [ 88.314934] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5379worker1 # [ 88.333705] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347765380client # [ 88.373175] nix[1185]: copying 1 paths to 'lb:50051'...5381client # [ 88.377145] nix[1185]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5382worker1 # [ 88.350175] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347765383worker1 # [ 88.360187] nix-daemon[844]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5384worker1 # [ 88.383716] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:30Z level=info event=niks3_push_started pid=12095385worker1 # [ 88.769137] nix-daemon[844]: accepted connection from pid 1222, user nix-grpc-daemon (trusted)5386worker1 # [ 88.790958] nix-daemon[844]: reaped child process 1227, status = succeeded5387worker1 # [ 88.963495] nix-daemon[844]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5388worker1 # [ 88.978517] nix-daemon[844]: reaped child process 1234, status = succeeded5389lb # [ 89.009336] niks3-server[1113]: 2026/09/20 08:08:30 INFO Received uploads request method=POST path=/api/pending_closures5390worker1 # [ 89.021218] nix-grpc-daemon[1209]: time=2026-09-20T08:08:31.050Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5391worker1 # [ 89.024753] nix-grpc-daemon[1209]: time=2026-09-20T08:08:31.052Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5392lb # [ 89.067163] niks3-server[1113]: 2026/09/20 08:08:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5393lb # [ 89.074976] niks3-server[1113]: 2026/09/20 08:08:30 INFO Signed narinfos id=31 count=15394worker1 # [ 89.066728] nix-grpc-daemon[1209]: time=2026-09-20T08:08:31.095Z level=INFO msg="Uploading 1 narinfos"5395lb # [ 89.083900] niks3-server[1113]: 2026/09/20 08:08:30 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5396lb # [ 89.095672] niks3-server[1113]: 2026/09/20 08:08:30 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5397lb # [ 89.103662] niks3-server[1113]: 2026/09/20 08:08:30 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5398worker1 # [ 89.112304] nix-grpc-daemon[1209]: time=2026-09-20T08:08:31.141Z level=INFO msg="Upload complete. (523ms)"5399lb # [ 89.124509] niks3-server[1113]: 2026/09/20 08:08:30 INFO Completed upload id=315400worker1 # [ 89.115201] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_in=4165401worker1 # [ 89.118439] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347765402worker1 # [ 89.127343] nix-daemon[844]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5403lb # [ 89.141388] niks3-server[1113]: 2026/09/20 08:08:30 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5404worker1 # [ 89.131723] nix-daemon[844]: reaped child process 1207, status = succeeded5405worker1 # [ 89.139075] nix-daemon[844]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5406client # [ 89.165714] nix[1185]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5407worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5408worker2 # [ 91.270328] systemd-journald[286]: Received client request to rotate journal, rotating.5409worker2 # [ 91.279424] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ebf8667f29d547cd9c286e47346670ab.5410worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5411worker1: must succeed: systemctl restart nix-grpc-daemon.service5412worker1 # [ 91.209861] systemd[1]: Stopping Nix worker-protocol over gRPC...5413worker1 # [ 91.356656] nix-daemon[844]: reaped child process 1238, status = succeeded5414worker1 # [ 91.474762] nix-daemon[844]: accepted connection from pid 1270, user nix-grpc-daemon (trusted)5415worker1 # [ 91.487387] nix-daemon[844]: reaped child process 1273, status = succeeded5416lb # [ 91.506980] niks3-server[1113]: 2026/09/20 08:08:33 INFO Received uploads request method=POST path=/api/pending_closures5417worker1 # [ 91.498479] nix-grpc-daemon[1209]: time=2026-09-20T08:08:33.527Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5418worker1 # [ 91.500190] nix-grpc-daemon[1209]: time=2026-09-20T08:08:33.529Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5419lb # [ 91.523527] niks3-server[1113]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5420lb # [ 91.529887] niks3-server[1113]: 2026/09/20 08:08:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5421lb # [ 91.531608] niks3-server[1113]: 2026/09/20 08:08:33 INFO Signed narinfos id=32 count=15422worker1 # [ 91.521035] nix-grpc-daemon[1209]: time=2026-09-20T08:08:33.549Z level=INFO msg="Uploading 1 narinfos"5423lb # [ 91.535106] niks3-server[1113]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5424lb # [ 91.539580] niks3-server[1113]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5425lb # [ 91.541873] niks3-server[1113]: 2026/09/20 08:08:33 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5426lb # [ 91.544752] niks3-server[1113]: 2026/09/20 08:08:33 INFO Completed upload id=325427worker1 # [ 91.532362] nix-grpc-daemon[1209]: time=2026-09-20T08:08:33.561Z level=INFO msg="Upload complete. (185ms)"5428lb # [ 91.547419] niks3-server[1113]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5429worker1 # [ 91.536227] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15430worker1 # [ 91.541295] nix-daemon[844]: reaped child process 1236, status = succeeded5431client # [ 91.598452] systemd[1]: rs.service: Deactivated successfully.5432client # [ 91.601919] systemd[1]: rs.service: Consumed 104ms CPU time over 3.932s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9K outgoing IP traffic.5433worker1 # [ 92.142583] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=signal_exit5434worker2 # [ 92.169195] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:33Z level=info event=scheduler_restarting addr=lb:500515435worker1 # [ 92.149540] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=scheduler_restarting5436worker1 # [ 92.155651] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=scheduler_restarting addr=lb:500515437worker1 # [ 92.159231] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:548205438worker1 # [ 92.162539] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=worker_gone addr=192.168.1.3:500515439worker1 # [ 92.165836] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:548205440worker1 # [ 92.169435] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=worker_gone addr=192.168.1.4:500515441worker1 # [ 92.182251] nix-daemon[844]: reaped child process 1202, status = succeeded5442worker2 # [ 92.368909] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:34Z level=info event=scheduler_connected addr=lb:500515443worker1 # [ 92.351635] nix-grpc-daemon[1139]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5444worker1 # [ 92.353613] nix-grpc-daemon[1139]: E0000 00:00:1789891714.381031 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5445worker1 # [ 92.360247] nix-grpc-daemon[1139]: ts=2026-09-20T08:08:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5446worker1 # [ 92.635530] nix-grpc-daemon[1139]: E0000 00:00:1789891714.664151 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5447worker1 # [ 92.640891] nix-grpc-daemon[1139]: E0000 00:00:1789891714.670173 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5448worker2 # [ 93.640812] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5449worker1 # [ 93.637200] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5450worker1 # [ 93.639772] systemd[1]: Stopped Nix worker-protocol over gRPC.5451worker1 # [ 93.642709] systemd[1]: nix-grpc-daemon.service: Consumed 530ms CPU time over 12.663s wall clock time, 31M memory peak, 17.4K incoming IP traffic, 23.6K outgoing IP traffic.5452worker1 # [ 93.658927] systemd[1]: Starting Nix worker-protocol over gRPC...5453worker1 # [ 93.822204] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5454worker2 # [ 93.841101] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:35Z level=info event=scheduler_connected addr=lb:500515455worker1 # [ 93.825735] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15456worker1 # [ 93.832497] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5457worker1 # [ 93.834290] systemd[1]: Started Nix worker-protocol over gRPC.5458worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.66 seconds)5459worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5460worker1 # [ 93.843814] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05461worker1 # [ 93.850159] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:35Z level=info event=scheduler_connected addr=lb:500515462worker1 # [ 93.851895] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05463worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.06 seconds)5464worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5465worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5466client: waiting for success: ! systemctl is-active rs5467client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5468client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5469client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5470client: must fail: journalctl -u rs | grep -q 'reconnecting'5471client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5472(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.55 seconds)5473subtest: scheduler restart mid-build: build finishes, no double build5474client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5475client # [ 94.214647] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5476client # Running as unit: mid.service; invocation ID: 0210977531194bf2be0062963cbf768a5477client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5478worker2 # [ 94.407549] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349425479client # [ 94.418794] nix[1217]: don't know how to build these paths:5480client # [ 94.419850] nix[1217]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5481worker1 # [ 94.398696] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:36Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05482worker1 # [ 94.401350] nix-grpc-daemon[1280]: ts=2026-09-20T08:08:36Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15483worker2 # [ 94.464710] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425484worker2 # [ 94.474744] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349425485client # [ 94.491269] nix[1217]: copying 1 paths to 'lb:50051'...5486worker2 # [ 94.483180] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349425487client # [ 94.494097] nix[1217]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5488worker2 # [ 94.491089] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5489worker2 # [ 94.674068] nix-daemon[871]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5490worker2 # [ 94.691040] nix-daemon[871]: reaped child process 1381, status = succeeded5491worker2 # [ 94.860385] nix-daemon[871]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)5492worker2 # [ 94.876105] nix-daemon[871]: reaped child process 1386, status = succeeded5493lb # [ 94.885835] niks3-server[1113]: 2026/09/20 08:08:36 INFO Received uploads request method=POST path=/api/pending_closures5494worker2 # [ 94.905141] nix-grpc-daemon[1218]: time=2026-09-20T08:08:36.686Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5495worker2 # [ 94.906576] nix-grpc-daemon[1218]: time=2026-09-20T08:08:36.686Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5496lb # [ 94.918311] niks3-server[1113]: 2026/09/20 08:08:36 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5497lb # [ 94.926769] niks3-server[1113]: 2026/09/20 08:08:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5498worker2 # [ 94.941660] nix-grpc-daemon[1218]: time=2026-09-20T08:08:36.723Z level=INFO msg="Uploading 1 narinfos"5499lb # [ 94.934315] niks3-server[1113]: 2026/09/20 08:08:36 INFO Signed narinfos id=33 count=15500lb # [ 94.938400] niks3-server[1113]: 2026/09/20 08:08:36 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5501lb # [ 94.947594] niks3-server[1113]: 2026/09/20 08:08:36 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5502lb # [ 94.955080] niks3-server[1113]: 2026/09/20 08:08:36 INFO Completed upload id=335503worker2 # [ 94.962145] nix-grpc-daemon[1218]: time=2026-09-20T08:08:36.744Z level=INFO msg="Upload complete. (463ms)"5504lb # [ 94.956892] niks3-server[1113]: 2026/09/20 08:08:36 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5505worker2 # [ 94.964848] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=0 paths=1 nar_bytes_in=4245506worker2 # [ 94.968640] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425507worker2 # [ 94.977382] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5508worker2 # [ 94.980806] nix-daemon[871]: reaped child process 1376, status = succeeded5509client # [ 94.994932] nix[1217]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5510worker2 # [ 94.988100] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5511worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5512worker1 # [ 96.593492] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1280 (nix-grpc-daemon) on client request.5513worker1 # [ 96.600173] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5514worker2 # [ 96.621983] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:38Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5515client # [ 96.631619] nix[1217]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5516worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.05 seconds)5517client: must succeed: sleep 5.05518worker1 # [ 96.621606] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5519worker1 # [ 96.623298] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5520worker1 # [ 96.625397] systemd[1]: nix-grpc-daemon.service: Consumed 100ms CPU time over 2.963s wall clock time, 10.1M memory peak, 6.6K incoming IP traffic, 7.1K outgoing IP traffic.5521worker1 # [ 96.730566] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5522worker1 # [ 96.735450] systemd[1]: Starting Nix worker-protocol over gRPC...5523worker2 # [ 96.822329] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:38Z level=info event=scheduler_connected addr=lb:500515524worker1 # [ 96.884905] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5525worker1 # [ 96.887730] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15526worker1 # [ 96.893880] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5527worker1 # [ 96.897294] systemd[1]: Started Nix worker-protocol over gRPC.5528worker1 # [ 96.908739] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:38Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15529worker1 # [ 96.913392] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:38Z level=info event=scheduler_connected addr=lb:500515530worker1 # [ 96.914943] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:38Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05531lb # [ 98.248921] envoy[984]: conn peer=[2001:db8:1::1]:46612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2934 tx=1350 ms=37205532lb # [ 98.253881] envoy[984]: conn peer=[2001:db8:1::3]:47846 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=744 tx=260 ms=112095533lb # [ 98.258692] envoy[984]: conn peer=[2001:db8:1::3]:51048 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=496 tx=55 ms=27535534client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5535client: waiting for success: ! systemctl is-active mid5536worker2 # [ 102.020825] nix-daemon[871]: reaped child process 1390, status = succeeded5537worker2 # [ 102.184617] nix-daemon[871]: accepted connection from pid 1426, user nix-grpc-daemon (trusted)5538worker2 # [ 102.199456] nix-daemon[871]: reaped child process 1429, status = succeeded5539lb # [ 102.202235] niks3-server[1113]: 2026/09/20 08:08:43 INFO Received uploads request method=POST path=/api/pending_closures5540worker2 # [ 102.214883] nix-grpc-daemon[1218]: time=2026-09-20T08:08:43.996Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5541worker2 # [ 102.216413] nix-grpc-daemon[1218]: time=2026-09-20T08:08:43.998Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5542lb # [ 102.230503] niks3-server[1113]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5543lb # [ 102.234716] niks3-server[1113]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5544lb # [ 102.240078] niks3-server[1113]: 2026/09/20 08:08:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5545lb # [ 102.243273] niks3-server[1113]: 2026/09/20 08:08:44 INFO Signed narinfos id=34 count=15546worker2 # [ 102.251959] nix-grpc-daemon[1218]: time=2026-09-20T08:08:44.033Z level=INFO msg="Uploading 1 narinfos"5547lb # [ 102.248673] niks3-server[1113]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5548lb # [ 102.255968] niks3-server[1113]: 2026/09/20 08:08:44 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5549lb # [ 102.259920] niks3-server[1113]: 2026/09/20 08:08:44 INFO Completed upload id=345550worker2 # [ 102.266904] nix-grpc-daemon[1218]: time=2026-09-20T08:08:44.049Z level=INFO msg="Upload complete. (264ms)"5551lb # [ 102.261221] niks3-server[1113]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5552worker2 # [ 102.269535] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15553worker2 # [ 102.276444] nix-daemon[871]: reaped child process 1388, status = succeeded5554client # [ 102.320173] systemd[1]: mid.service: Deactivated successfully.5555client # [ 102.323705] systemd[1]: mid.service: Consumed 114ms CPU time over 8.108s wall clock time, 37.3M memory peak, 8.8K incoming IP traffic, 9.2K outgoing IP traffic.5556client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)5557client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5558client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5559(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 8.85 seconds)5560subtest: interrupting the client stops the build on the worker5561client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5562client # [ 103.059709] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5563client # Running as unit: intr.service; invocation ID: 171c9bfac53d4e00a50f22a96e3ab2a15564client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5565worker2 # [ 103.226609] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349425566client # [ 103.241894] nix[1252]: don't know how to build these paths:5567client # [ 103.242809] nix[1252]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5568worker1 # [ 103.225865] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:45Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05569worker1 # [ 103.230152] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:45Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15570worker1 # [ 103.273081] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845571worker1 # [ 103.283837] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5572worker1 # [ 103.303506] nix-grpc-daemon[1360]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 1/5)5573worker1 # [ 103.404539] nix-grpc-daemon[1360]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 2/5)5574worker1 # [ 103.466240] nix-grpc-daemon[1360]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 196 ms (attempt 3/5)5575worker1 # [ 103.667936] nix-grpc-daemon[1360]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 4/5)5576worker1 # [ 103.723686] nix-grpc-daemon[1360]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5577worker1 # [ 103.741486] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546845578client # [ 103.780132] nix[1252]: copying 1 paths to 'lb:50051'...5579client # [ 103.784128] nix[1252]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5580worker1 # [ 103.756302] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546845581worker1 # [ 103.764797] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5582worker1 # [ 103.785143] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:45Z level=info event=niks3_push_started pid=14275583worker1 # [ 104.129774] nix-daemon[844]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5584worker1 # [ 104.141848] nix-daemon[844]: reaped child process 1443, status = succeeded5585worker1 # [ 104.304619] nix-daemon[844]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)5586worker1 # [ 104.316942] nix-daemon[844]: reaped child process 1452, status = succeeded5587lb # [ 104.345525] niks3-server[1113]: 2026/09/20 08:08:46 INFO Received uploads request method=POST path=/api/pending_closures5588worker1 # [ 104.344533] nix-grpc-daemon[1427]: time=2026-09-20T08:08:46.373Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5589worker1 # [ 104.347231] nix-grpc-daemon[1427]: time=2026-09-20T08:08:46.375Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5590lb # [ 104.381540] niks3-server[1113]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5591lb # [ 104.390266] niks3-server[1113]: 2026/09/20 08:08:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5592lb # [ 104.395523] niks3-server[1113]: 2026/09/20 08:08:46 INFO Signed narinfos id=35 count=15593worker1 # [ 104.386766] nix-grpc-daemon[1427]: time=2026-09-20T08:08:46.415Z level=INFO msg="Uploading 1 narinfos"5594lb # [ 104.410167] niks3-server[1113]: 2026/09/20 08:08:46 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5595lb # [ 104.417105] niks3-server[1113]: 2026/09/20 08:08:46 INFO Completed upload id=355596worker1 # [ 104.403588] nix-grpc-daemon[1427]: time=2026-09-20T08:08:46.432Z level=WARN msg="Failed to register uploaded object" key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo error="server returned 404: object is not pending upload\n"5597lb # [ 104.420480] niks3-server[1113]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5598worker1 # [ 104.409764] nix-grpc-daemon[1427]: time=2026-09-20T08:08:46.437Z level=INFO msg="Upload complete. (429ms)"5599worker1 # [ 104.414436] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=4245600worker1 # [ 104.417129] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845601worker1 # [ 104.422524] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5602worker1 # [ 104.425127] nix-daemon[844]: reaped child process 1425, status = succeeded5603worker1 # [ 104.431050] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5604client # [ 104.458513] nix[1252]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5605client: must succeed: systemctl kill -s INT intr5606client # [ 106.560549] systemd[1]: intr.service: Sent signal SIGINT to main process 1252 (nix) on client request.5607client # [ 106.566708] nix[1252]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5608client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5609client # [ 106.573653] nix[1252]: error: interrupted by the user5610client # [ 106.597964] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5611client # [ 106.599789] systemd[1]: intr.service: Failed with result 'exit-code'.5612client # [ 106.601402] systemd[1]: intr.service: Consumed 99ms CPU time over 3.539s wall clock time, 39.1M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5613worker1 # [ 106.647843] nix-daemon[844]: reaped child process 1454, status = succeeded5614worker1 # [ 106.652256] nix-daemon[1456]: unexpected Nix daemon error: error: interrupted by the user5615worker1 # [ 106.655940] nix-daemon[844]: reaped child process 1456, status = failed with exit code 15616(finished: subtest: interrupting the client stops the build on the worker, in 4.76 seconds)5617subtest: a deploy mid-build drains: the build finishes, the new generation takes over5618client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5619client # [ 107.831797] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5620client # Running as unit: sw.service; invocation ID: 6ca2e1efca4347568b4978dda27ba4cc5621client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.05 seconds)5622worker1 # [ 107.992167] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546845623client # [ 108.025826] nix[1272]: don't know how to build these paths:5624client # [ 108.027273] nix[1272]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5625worker1 # [ 108.007690] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:50Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05626worker1 # [ 108.011676] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:50Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15627worker2 # [ 108.073914] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425628worker2 # [ 108.087782] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349425629client # [ 108.106139] nix[1272]: copying 1 paths to 'lb:50051'...5630client # [ 108.108893] nix[1272]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5631worker2 # [ 108.101356] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349425632worker2 # [ 108.112336] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5633lb # [ 108.248881] envoy[984]: conn peer=[2001:db8:1::1]:33010 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=1356 ms=78775634lb # [ 108.252554] envoy[984]: conn peer=[2001:db8:1::1]:52382 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=755 ms=33515635worker2 # [ 108.297179] nix-daemon[871]: accepted connection from pid 1461, user nix-grpc-daemon (trusted)5636worker2 # [ 108.309513] nix-daemon[871]: reaped child process 1464, status = succeeded5637worker2 # [ 108.468871] nix-daemon[871]: accepted connection from pid 1466, user nix-grpc-daemon (trusted)5638worker2 # [ 108.485846] nix-daemon[871]: reaped child process 1469, status = succeeded5639lb # [ 108.492628] niks3-server[1113]: 2026/09/20 08:08:50 INFO Received uploads request method=POST path=/api/pending_closures5640worker2 # [ 108.508797] nix-grpc-daemon[1218]: time=2026-09-20T08:08:50.290Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5641worker2 # [ 108.510223] nix-grpc-daemon[1218]: time=2026-09-20T08:08:50.290Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5642lb # [ 108.523700] niks3-server[1113]: 2026/09/20 08:08:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5643lb # [ 108.532172] niks3-server[1113]: 2026/09/20 08:08:50 INFO Signed narinfos id=36 count=15644worker2 # [ 108.542131] nix-grpc-daemon[1218]: time=2026-09-20T08:08:50.324Z level=INFO msg="Uploading 1 narinfos"5645lb # [ 108.545979] niks3-server[1113]: 2026/09/20 08:08:50 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5646lb # [ 108.554247] niks3-server[1113]: 2026/09/20 08:08:50 INFO Completed upload id=365647worker2 # [ 108.561275] nix-grpc-daemon[1218]: time=2026-09-20T08:08:50.343Z level=INFO msg="Upload complete. (437ms)"5648worker2 # [ 108.563426] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=0 paths=1 nar_bytes_in=4165649lb # [ 108.558819] niks3-server[1113]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5650worker2 # [ 108.570417] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349425651lb # [ 108.564709] niks3-server[1113]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5652worker2 # [ 108.572949] nix-grpc-daemon[1218]: time=2026-09-20T08:08:50.354Z level=WARN msg="Failed to register uploaded object" key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo error="server returned 404: object is not pending upload\n"5653worker2 # [ 108.577590] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5654worker2 # [ 108.580102] nix-daemon[871]: reaped child process 1459, status = succeeded5655worker2 # [ 108.585031] nix-daemon[871]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5656client # [ 108.593556] nix[1272]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5657worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25658worker2 # Checking switch inhibitors... done5659worker2 # [ 110.968475] nixos[1504]: switching to system configuration /nix/store/w65g02vgiky24w4fmjgw93b5jcmypcvj-nixos-system-worker2-test5660worker2 # activating the configuration...5661worker2 # [ 110.973673] systemd[1]: Stopped target Remote File Systems.5662worker2 # [ 110.974596] systemd[1]: Stopped target Local File Systems.5663worker2 # setting up /etc...5664worker2 # [ 111.611949] systemd[1]: Reload requested from client PID 1504 ('.switch-to-conf') (unit backdoor.service)...5665worker2 # [ 111.613594] systemd[1]: Reloading...5666worker2 # [ 112.232307] systemd[1]: Reloading finished in 616 ms.5667worker2 # restarting sysinit-reactivation.target5668worker2 # [ 112.291725] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5669worker2 # [ 112.429098] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5670worker2 # [ 112.432764] systemd[1]: Reached target Reactivate sysinit units.5671worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5672worker2 # [ 112.437305] dbus-broker-launch[581]: Caught SIGHUP, trigger reload.5673worker2 # [ 112.440578] systemd[1]: Reloading D-Bus System Message Bus...5674worker2 # [ 112.443157] systemd[1]: Reloading Nix worker-protocol over gRPC...5675worker2 # [ 112.471431] dbus-broker-launch[581]: Looking up NSS user entry for 'systemd-timesync'...5676worker2 # [ 112.478492] dbus-broker-launch[581]: NSS returned no entry for 'systemd-timesync'5677worker2 # [ 112.480087] dbus-broker-launch[581]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5678worker2 # [ 112.492852] systemd[1]: Reloaded Nix worker-protocol over gRPC.5679worker2 # [ 112.511941] systemd[1]: Reloaded D-Bus System Message Bus.5680worker2 # [ 112.522410] systemd[1]: Reached target Local File Systems.5681worker2 # [ 112.525317] systemd[1]: Reached target Remote File Systems.5682worker2 # [ 112.530873] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5683worker2 # [ 112.537091] systemd[1]: Starting Create SUID/SGID Wrappers...5684worker2 # [ 112.538975] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5685worker2 # [ 112.541211] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675686worker2 # [ 112.543178] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5687worker2 # [ 112.544651] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5688worker2 # [ 112.547159] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5689worker2 # [ 112.551742] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5690worker2 # [ 112.553038] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5691worker2 # [ 112.986922] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5692worker2 # [ 112.988631] systemd[1]: Finished Create SUID/SGID Wrappers.5693worker2 # [ 112.994446] systemd[1]: Starting linger-users.service...5694worker2 # [ 113.035219] systemd[1]: linger-users.service: Deactivated successfully.5695worker2 # [ 113.037182] systemd[1]: Finished linger-users.service.5696worker2 # [ 113.262533] nix-grpc-daemon[1197]: ts=2026-09-20T08:08:55Z level=info event=draining5697worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5698worker2 # [ 113.293483] nixos[1504]: finished switching to system configuration /nix/store/w65g02vgiky24w4fmjgw93b5jcmypcvj-nixos-system-worker2-test5699worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.01 seconds)5700worker2: must succeed: pgrep -f 'read -t [9]0 x'5701worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5702client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25703client # don't know how to build these paths:5704client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5705worker1 # [ 113.552084] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546845706worker1 # [ 113.560262] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:55Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05707worker1 # [ 113.562707] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:55Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15708worker1 # [ 113.607790] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845709worker1 # [ 113.616204] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546845710client # copying 1 paths to 'lb:50051'...5711worker1 # [ 113.623894] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546845712client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5713worker1 # [ 113.638723] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5714worker1 # [ 113.793158] nix-daemon[844]: accepted connection from pid 1510, user nix-grpc-daemon (trusted)5715worker1 # [ 113.805676] nix-daemon[844]: reaped child process 1513, status = succeeded5716worker1 # [ 113.969693] nix-daemon[844]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5717worker1 # [ 113.982492] nix-daemon[844]: reaped child process 1518, status = succeeded5718lb # [ 114.010866] niks3-server[1113]: 2026/09/20 08:08:55 INFO Received uploads request method=POST path=/api/pending_closures5719worker1 # [ 114.008830] nix-grpc-daemon[1427]: time=2026-09-20T08:08:56.037Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5720worker1 # [ 114.010270] nix-grpc-daemon[1427]: time=2026-09-20T08:08:56.037Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5721lb # [ 114.039163] niks3-server[1113]: 2026/09/20 08:08:55 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5722lb # [ 114.051138] niks3-server[1113]: 2026/09/20 08:08:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5723lb # [ 114.055867] niks3-server[1113]: 2026/09/20 08:08:55 INFO Signed narinfos id=37 count=15724worker1 # [ 114.046530] nix-grpc-daemon[1427]: time=2026-09-20T08:08:56.075Z level=INFO msg="Uploading 1 narinfos"5725lb # [ 114.061932] niks3-server[1113]: 2026/09/20 08:08:55 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5726lb # [ 114.070155] niks3-server[1113]: 2026/09/20 08:08:55 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5727lb # [ 114.073256] niks3-server[1113]: 2026/09/20 08:08:55 INFO Completed upload id=375728worker1 # [ 114.061206] nix-grpc-daemon[1427]: time=2026-09-20T08:08:56.090Z level=INFO msg="Upload complete. (416ms)"5729lb # [ 114.075541] niks3-server[1113]: 2026/09/20 08:08:55 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5730worker1 # [ 114.064072] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=5285731worker1 # [ 114.067449] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845732worker1 # [ 114.073564] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5733worker1 # [ 114.075857] nix-daemon[844]: reaped child process 1508, status = succeeded5734worker1 # [ 114.081096] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5735client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5736client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5737client # farm-a> LOG-farm-a-during-drain5738worker1 # [ 115.695464] nix-daemon[844]: reaped child process 1522, status = succeeded5739worker1 # [ 115.839583] nix-daemon[844]: accepted connection from pid 1537, user nix-grpc-daemon (trusted)5740worker1 # [ 115.851448] nix-daemon[844]: reaped child process 1540, status = succeeded5741lb # [ 115.879733] niks3-server[1113]: 2026/09/20 08:08:57 INFO Received uploads request method=POST path=/api/pending_closures5742worker1 # [ 115.876035] nix-grpc-daemon[1427]: time=2026-09-20T08:08:57.905Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5743worker1 # [ 115.877571] nix-grpc-daemon[1427]: time=2026-09-20T08:08:57.907Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5744lb # [ 115.922614] niks3-server[1113]: 2026/09/20 08:08:57 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5745lb # [ 115.932774] niks3-server[1113]: 2026/09/20 08:08:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5746lb # [ 115.938119] niks3-server[1113]: 2026/09/20 08:08:57 INFO Signed narinfos id=38 count=15747worker1 # [ 115.928883] nix-grpc-daemon[1427]: time=2026-09-20T08:08:57.957Z level=INFO msg="Uploading 1 narinfos"5748lb # [ 115.944915] niks3-server[1113]: 2026/09/20 08:08:57 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5749lb # [ 115.955473] niks3-server[1113]: 2026/09/20 08:08:57 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5750lb # [ 115.959085] niks3-server[1113]: 2026/09/20 08:08:57 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5751lb # [ 115.963575] niks3-server[1113]: 2026/09/20 08:08:57 INFO Completed upload id=385752worker1 # [ 115.951294] nix-grpc-daemon[1427]: time=2026-09-20T08:08:57.980Z level=INFO msg="Upload complete. (262ms)"5753lb # [ 115.965431] niks3-server[1113]: 2026/09/20 08:08:57 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5754worker1 # [ 115.954289] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=15755worker1 # [ 115.962424] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:57Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05756worker1 # [ 115.964358] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:57Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15757worker1 # [ 115.966445] nix-daemon[844]: reaped child process 1520, status = succeeded5758worker1 # [ 116.007273] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845759worker1 # [ 116.013289] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546845760worker1 # [ 116.021413] nix-grpc-daemon[1427]: time=2026-09-20T08:08:58.050Z level=INFO msg="All 1 paths already cached"5761client # copying 1 paths to 'lb:50051'...5762worker1 # [ 116.025655] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546845763client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5764worker1 # [ 116.036076] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5765worker1 # [ 116.182660] nix-daemon[844]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5766worker1 # [ 116.195359] nix-daemon[844]: reaped child process 1549, status = succeeded5767worker1 # [ 116.342088] nix-daemon[844]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)5768worker1 # [ 116.353273] nix-daemon[844]: reaped child process 1554, status = succeeded5769lb # [ 116.381639] niks3-server[1113]: 2026/09/20 08:08:58 INFO Received uploads request method=POST path=/api/pending_closures5770worker1 # [ 116.378413] nix-grpc-daemon[1427]: time=2026-09-20T08:08:58.407Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5771worker1 # [ 116.379888] nix-grpc-daemon[1427]: time=2026-09-20T08:08:58.409Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5772lb # [ 116.415487] niks3-server[1113]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5773lb # [ 116.428222] niks3-server[1113]: 2026/09/20 08:08:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5774worker1 # [ 116.420106] nix-grpc-daemon[1427]: time=2026-09-20T08:08:58.449Z level=INFO msg="Uploading 1 narinfos"5775lb # [ 116.432944] niks3-server[1113]: 2026/09/20 08:08:58 INFO Signed narinfos id=39 count=15776lb # [ 116.437609] niks3-server[1113]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5777lb # [ 116.446562] niks3-server[1113]: 2026/09/20 08:08:58 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5778lb # [ 116.450801] niks3-server[1113]: 2026/09/20 08:08:58 INFO Completed upload id=395779worker1 # [ 116.438527] nix-grpc-daemon[1427]: time=2026-09-20T08:08:58.468Z level=INFO msg="Upload complete. (396ms)"5780lb # [ 116.452142] niks3-server[1113]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5781worker1 # [ 116.440663] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=6405782worker1 # [ 116.443851] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845783worker1 # [ 116.451101] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5784worker1 # [ 116.453305] nix-daemon[844]: reaped child process 1544, status = succeeded5785client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5786client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5787worker1 # [ 116.459143] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5788client # farm-b> LOG-farm-b-during-drain5789worker1 # [ 117.484494] nix-daemon[844]: reaped child process 1558, status = succeeded5790worker1 # [ 117.620889] nix-daemon[844]: accepted connection from pid 1573, user nix-grpc-daemon (trusted)5791worker1 # [ 117.633725] nix-daemon[844]: reaped child process 1576, status = succeeded5792lb # [ 117.657817] niks3-server[1113]: 2026/09/20 08:08:59 INFO Received uploads request method=POST path=/api/pending_closures5793worker1 # [ 117.655619] nix-grpc-daemon[1427]: time=2026-09-20T08:08:59.684Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5794worker1 # [ 117.657131] nix-grpc-daemon[1427]: time=2026-09-20T08:08:59.686Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5795lb # [ 117.687076] niks3-server[1113]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5796lb # [ 117.692665] niks3-server[1113]: 2026/09/20 08:08:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5797lb # [ 117.698674] niks3-server[1113]: 2026/09/20 08:08:59 INFO Signed narinfos id=40 count=15798worker1 # [ 117.686263] nix-grpc-daemon[1427]: time=2026-09-20T08:08:59.715Z level=INFO msg="Uploading 1 narinfos"5799lb # [ 117.700042] niks3-server[1113]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5800lb # [ 117.704925] niks3-server[1113]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5801lb # [ 117.708422] niks3-server[1113]: 2026/09/20 08:08:59 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5802lb # [ 117.711901] niks3-server[1113]: 2026/09/20 08:08:59 INFO Completed upload id=405803worker1 # [ 117.699491] nix-grpc-daemon[1427]: time=2026-09-20T08:08:59.728Z level=INFO msg="Upload complete. (231ms)"5804lb # [ 117.714645] niks3-server[1113]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5805worker1 # [ 117.703143] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=15806worker1 # [ 117.708489] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:59Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05807worker1 # [ 117.710408] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:59Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15808worker1 # [ 117.714488] nix-daemon[844]: reaped child process 1556, status = succeeded5809worker1 # [ 117.753667] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845810worker1 # [ 117.761514] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546845811worker1 # [ 117.770744] nix-grpc-daemon[1427]: time=2026-09-20T08:08:59.800Z level=INFO msg="All 2 paths already cached"5812client # copying 1 paths to 'lb:50051'...5813worker1 # [ 117.775115] nix-grpc-daemon[1360]: ts=2026-09-20T08:08:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546845814client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5815worker1 # [ 117.782971] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5816worker1 # [ 117.936197] nix-daemon[844]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5817worker1 # [ 117.949990] nix-daemon[844]: reaped child process 1585, status = succeeded5818worker1 # [ 118.110299] nix-daemon[844]: accepted connection from pid 1587, user nix-grpc-daemon (trusted)5819worker1 # [ 118.122183] nix-daemon[844]: reaped child process 1590, status = succeeded5820lb # [ 118.149946] niks3-server[1113]: 2026/09/20 08:08:59 INFO Received uploads request method=POST path=/api/pending_closures5821worker1 # [ 118.146419] nix-grpc-daemon[1427]: time=2026-09-20T08:09:00.175Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5822worker1 # [ 118.147822] nix-grpc-daemon[1427]: time=2026-09-20T08:09:00.175Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5823lb # [ 118.180848] niks3-server[1113]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5824lb # [ 118.190979] niks3-server[1113]: 2026/09/20 08:08:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5825lb # [ 118.195229] niks3-server[1113]: 2026/09/20 08:08:59 INFO Signed narinfos id=41 count=15826worker1 # [ 118.186070] nix-grpc-daemon[1427]: time=2026-09-20T08:09:00.215Z level=INFO msg="Uploading 1 narinfos"5827lb # [ 118.203293] niks3-server[1113]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5828lb # [ 118.213316] niks3-server[1113]: 2026/09/20 08:09:00 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5829lb # [ 118.219202] niks3-server[1113]: 2026/09/20 08:09:00 INFO Completed upload id=415830worker1 # [ 118.206857] nix-grpc-daemon[1427]: time=2026-09-20T08:09:00.236Z level=INFO msg="Upload complete. (417ms)"5831lb # [ 118.222704] niks3-server[1113]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5832worker1 # [ 118.210757] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=7685833worker1 # [ 118.216497] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845834worker1 # [ 118.225516] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5835worker1 # [ 118.230661] nix-daemon[844]: reaped child process 1580, status = succeeded5836client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5837worker1 # [ 118.236861] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5838client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5839client # farm-top> LOG-farm-top-during-drain5840worker1 # [ 119.262669] nix-daemon[844]: reaped child process 1594, status = succeeded5841worker1 # [ 119.415693] nix-daemon[844]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5842worker1 # [ 119.427662] nix-daemon[844]: reaped child process 1612, status = succeeded5843lb # [ 119.456289] niks3-server[1113]: 2026/09/20 08:09:01 INFO Received uploads request method=POST path=/api/pending_closures5844worker1 # [ 119.453986] nix-grpc-daemon[1427]: time=2026-09-20T08:09:01.483Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5845worker1 # [ 119.455731] nix-grpc-daemon[1427]: time=2026-09-20T08:09:01.485Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5846lb # [ 119.505218] niks3-server[1113]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5847lb # [ 119.510673] niks3-server[1113]: 2026/09/20 08:09:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5848lb # [ 119.515770] niks3-server[1113]: 2026/09/20 08:09:01 INFO Signed narinfos id=42 count=15849worker1 # [ 119.506498] nix-grpc-daemon[1427]: time=2026-09-20T08:09:01.535Z level=INFO msg="Uploading 1 narinfos"5850lb # [ 119.525889] niks3-server[1113]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5851lb # [ 119.531777] niks3-server[1113]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5852lb # [ 119.539245] niks3-server[1113]: 2026/09/20 08:09:01 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5853lb # [ 119.542750] niks3-server[1113]: 2026/09/20 08:09:01 INFO Completed upload id=425854worker1 # [ 119.530630] nix-grpc-daemon[1427]: time=2026-09-20T08:09:01.559Z level=INFO msg="Upload complete. (287ms)"5855lb # [ 119.545093] niks3-server[1113]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo5856worker1 # [ 119.539342] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=15857worker1 # [ 119.551322] nix-daemon[844]: reaped child process 1592, status = succeeded5858client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 6.24 seconds)5859client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath5860client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.15 seconds)5861worker2: must succeed: pkill -f 'read -t [9]0 x'5862worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)5863client: waiting for success: ! systemctl is-active sw5864worker2 # [ 120.034367] nix-daemon[871]: reaped child process 1473, status = succeeded5865worker2 # [ 120.198907] nix-daemon[871]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)5866worker2 # [ 120.212978] nix-daemon[871]: reaped child process 1647, status = succeeded5867lb # [ 120.222603] niks3-server[1113]: 2026/09/20 08:09:02 INFO Received uploads request method=POST path=/api/pending_closures5868worker2 # [ 120.234378] nix-grpc-daemon[1218]: time=2026-09-20T08:09:02.016Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5869worker2 # [ 120.235968] nix-grpc-daemon[1218]: time=2026-09-20T08:09:02.018Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"5870lb # [ 120.249394] niks3-server[1113]: 2026/09/20 08:09:02 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5871lb # [ 120.253498] niks3-server[1113]: 2026/09/20 08:09:02 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5872lb # [ 120.258226] niks3-server[1113]: 2026/09/20 08:09:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5873worker2 # [ 120.267242] nix-grpc-daemon[1218]: time=2026-09-20T08:09:02.049Z level=INFO msg="Uploading 1 narinfos"5874lb # [ 120.260456] niks3-server[1113]: 2026/09/20 08:09:02 INFO Signed narinfos id=43 count=15875lb # [ 120.263323] niks3-server[1113]: 2026/09/20 08:09:02 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls5876lb # [ 120.268792] niks3-server[1113]: 2026/09/20 08:09:02 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5877lb # [ 120.274598] niks3-server[1113]: 2026/09/20 08:09:02 INFO Completed upload id=435878worker2 # [ 120.281597] nix-grpc-daemon[1218]: time=2026-09-20T08:09:02.063Z level=INFO msg="Upload complete. (275ms)"5879lb # [ 120.275995] niks3-server[1113]: 2026/09/20 08:09:02 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo5880worker2 # [ 120.284254] nix-grpc-daemon[1197]: ts=2026-09-20T08:09:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34942 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=15881worker2 # [ 120.292548] nix-daemon[871]: reaped child process 1471, status = succeeded5882client # [ 120.331783] systemd[1]: sw.service: Deactivated successfully.5883client # [ 120.336142] systemd[1]: sw.service: Consumed 111ms CPU time over 12.502s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5884client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)5885client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5886client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)5887worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5888worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.04 seconds)5889lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5890lb: must succeed: curl -sf localhost:9901/clusters5891lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5892worker2 # [ 121.266429] nix-grpc-daemon[1197]: ts=2026-09-20T08:09:03Z level=info event=signal_exit5893worker1 # [ 121.254884] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:483005894worker1 # [ 121.256558] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:03Z level=info event=worker_gone addr=192.168.1.4:500515895worker2 # [ 121.281963] nix-grpc-daemon[1197]: ts=2026-09-20T08:09:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5896worker2 # [ 121.318153] nix-daemon[871]: reaped child process 1211, status = succeeded5897worker2 # [ 121.332484] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5898worker2 # [ 121.336549] systemd[1]: nix-grpc-daemon.service: Consumed 1.801s CPU time over 52.281s wall clock time, 32.7M memory peak, 65.7K incoming IP traffic, 107.3K outgoing IP traffic.5899worker2 # [ 121.350721] systemd[1]: Starting Nix worker-protocol over gRPC...5900worker2 # [ 121.526809] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5901worker2 # [ 121.528598] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:03Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15902worker2 # [ 121.535062] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5903worker2 # [ 121.538566] systemd[1]: Started Nix worker-protocol over gRPC.5904worker2 # [ 121.551429] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:03Z level=info event=scheduler_connected addr=lb:500515905worker1 # [ 121.533728] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05906lb: must succeed: curl -sf localhost:9901/clusters5907lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5908lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.16 seconds)5909worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5910worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5911(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.42 seconds)5912subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5913client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15914worker1 # [ 122.406567] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546845915worker1 # [ 122.419154] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=05916worker1 # [ 122.424419] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=15917worker1 # [ 122.428635] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=05918worker1 # [ 122.432407] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=05919worker1 # [ 122.463157] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845920worker1 # [ 122.477541] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546845921worker1 # [ 122.490558] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546845922worker1 # [ 122.502264] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5923worker1 # [ 122.679184] nix-daemon[844]: accepted connection from pid 1623, user nix-grpc-daemon (trusted)5924worker1 # [ 122.692153] nix-daemon[844]: reaped child process 1626, status = succeeded5925worker1 # [ 122.850454] nix-daemon[844]: accepted connection from pid 1628, user nix-grpc-daemon (trusted)5926worker1 # [ 122.862403] nix-daemon[844]: reaped child process 1631, status = succeeded5927lb # [ 122.888731] niks3-server[1113]: 2026/09/20 08:09:04 INFO Received uploads request method=POST path=/api/pending_closures5928worker1 # [ 122.881081] nix-grpc-daemon[1427]: time=2026-09-20T08:09:04.909Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5929worker1 # [ 122.882484] nix-grpc-daemon[1427]: time=2026-09-20T08:09:04.909Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"5930lb # [ 122.902205] niks3-server[1113]: 2026/09/20 08:09:04 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst5931lb # [ 122.905935] niks3-server[1113]: 2026/09/20 08:09:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5932lb # [ 122.907973] niks3-server[1113]: 2026/09/20 08:09:04 INFO Signed narinfos id=44 count=15933worker1 # [ 122.895792] nix-grpc-daemon[1427]: time=2026-09-20T08:09:04.925Z level=INFO msg="Uploading 1 narinfos"5934lb # [ 122.913903] niks3-server[1113]: 2026/09/20 08:09:04 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls5935lb # [ 122.916883] niks3-server[1113]: 2026/09/20 08:09:04 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5936lb # [ 122.919788] niks3-server[1113]: 2026/09/20 08:09:04 INFO Completed upload id=445937worker1 # [ 122.907485] nix-grpc-daemon[1427]: time=2026-09-20T08:09:04.936Z level=INFO msg="Upload complete. (391ms)"5938worker1 # [ 122.909410] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=5045939lb # [ 122.922541] niks3-server[1113]: 2026/09/20 08:09:04 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo5940worker1 # [ 122.912763] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845941worker1 # [ 122.918549] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5942worker1 # [ 122.921299] nix-daemon[844]: reaped child process 1621, status = succeeded5943worker1 # [ 122.926649] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5944worker1 # [ 123.548945] nix-daemon[844]: reaped child process 1635, status = succeeded5945worker1 # [ 123.683587] nix-daemon[844]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)5946worker1 # [ 123.694725] nix-daemon[844]: reaped child process 1653, status = succeeded5947lb # [ 123.719230] niks3-server[1113]: 2026/09/20 08:09:05 INFO Received uploads request method=POST path=/api/pending_closures5948worker1 # [ 123.715505] nix-grpc-daemon[1427]: time=2026-09-20T08:09:05.745Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5949worker1 # [ 123.716990] nix-grpc-daemon[1427]: time=2026-09-20T08:09:05.746Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"5950lb # [ 123.770169] niks3-server[1113]: 2026/09/20 08:09:05 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5951lb # [ 123.774098] niks3-server[1113]: 2026/09/20 08:09:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5952lb # [ 123.778722] niks3-server[1113]: 2026/09/20 08:09:05 INFO Signed narinfos id=45 count=15953worker1 # [ 123.771115] nix-grpc-daemon[1427]: time=2026-09-20T08:09:05.800Z level=INFO msg="Uploading 1 narinfos"5954lb # [ 123.789164] niks3-server[1113]: 2026/09/20 08:09:05 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv5955lb # [ 123.793490] niks3-server[1113]: 2026/09/20 08:09:05 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5956lb # [ 123.798070] niks3-server[1113]: 2026/09/20 08:09:05 INFO Completed upload id=455957worker1 # [ 123.785855] nix-grpc-daemon[1427]: time=2026-09-20T08:09:05.815Z level=INFO msg="Upload complete. (253ms)"5958lb # [ 123.799637] niks3-server[1113]: 2026/09/20 08:09:05 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls5959lb # [ 123.802067] niks3-server[1113]: 2026/09/20 08:09:05 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo5960worker1 # [ 123.791340] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:05Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=15961worker1 # [ 123.798800] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=15962worker1 # [ 123.805852] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845963worker1 # [ 123.807817] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:05Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=05964worker1 # [ 123.814200] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546845965worker1 # [ 123.815898] nix-daemon[844]: reaped child process 1633, status = succeeded5966worker1 # [ 123.820491] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546845967worker1 # [ 123.824246] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5968worker1 # [ 123.961608] nix-daemon[844]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)5969worker1 # [ 123.974748] nix-daemon[844]: reaped child process 1662, status = succeeded5970worker1 # [ 124.103319] nix-daemon[844]: accepted connection from pid 1664, user nix-grpc-daemon (trusted)5971worker1 # [ 124.115095] nix-daemon[844]: reaped child process 1667, status = succeeded5972lb # [ 124.138633] niks3-server[1113]: 2026/09/20 08:09:05 INFO Received uploads request method=POST path=/api/pending_closures5973worker1 # [ 124.135233] nix-grpc-daemon[1427]: time=2026-09-20T08:09:06.164Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5974worker1 # [ 124.137095] nix-grpc-daemon[1427]: time=2026-09-20T08:09:06.166Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"5975lb # [ 124.167341] niks3-server[1113]: 2026/09/20 08:09:05 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst5976lb # [ 124.178393] niks3-server[1113]: 2026/09/20 08:09:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5977lb # [ 124.184199] niks3-server[1113]: 2026/09/20 08:09:05 INFO Signed narinfos id=46 count=15978worker1 # [ 124.174878] nix-grpc-daemon[1427]: time=2026-09-20T08:09:06.204Z level=INFO msg="Uploading 1 narinfos"5979lb # [ 124.189209] niks3-server[1113]: 2026/09/20 08:09:05 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls5980lb # [ 124.203793] niks3-server[1113]: 2026/09/20 08:09:05 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5981lb # [ 124.208834] niks3-server[1113]: 2026/09/20 08:09:05 INFO Completed upload id=465982worker1 # [ 124.198784] nix-grpc-daemon[1427]: time=2026-09-20T08:09:06.228Z level=INFO msg="Upload complete. (367ms)"5983lb # [ 124.211212] niks3-server[1113]: 2026/09/20 08:09:06 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo5984worker1 # [ 124.203133] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=5045985worker1 # [ 124.207426] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546845986worker1 # [ 124.216120] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5987worker1 # [ 124.225201] nix-daemon[844]: reaped child process 1657, status = succeeded5988worker1 # [ 124.229217] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5989worker1 # [ 125.644702] nix-daemon[844]: reaped child process 1671, status = succeeded5990worker1 # [ 125.777355] nix-daemon[844]: accepted connection from pid 1686, user nix-grpc-daemon (trusted)5991worker1 # [ 125.789241] nix-daemon[844]: reaped child process 1689, status = succeeded5992lb # [ 125.818112] niks3-server[1113]: 2026/09/20 08:09:07 INFO Received uploads request method=POST path=/api/pending_closures5993worker1 # [ 125.811568] nix-grpc-daemon[1427]: time=2026-09-20T08:09:07.840Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5994worker1 # [ 125.813146] nix-grpc-daemon[1427]: time=2026-09-20T08:09:07.842Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"5995lb # [ 125.852206] niks3-server[1113]: 2026/09/20 08:09:07 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv5996lb # [ 125.865563] niks3-server[1113]: 2026/09/20 08:09:07 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5997lb # [ 125.873488] niks3-server[1113]: 2026/09/20 08:09:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5998lb # [ 125.878108] niks3-server[1113]: 2026/09/20 08:09:07 INFO Signed narinfos id=47 count=15999worker1 # [ 125.868733] nix-grpc-daemon[1427]: time=2026-09-20T08:09:07.898Z level=INFO msg="Uploading 1 narinfos"6000lb # [ 125.885671] niks3-server[1113]: 2026/09/20 08:09:07 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6001lb # [ 125.894591] niks3-server[1113]: 2026/09/20 08:09:07 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6002lb # [ 125.899540] niks3-server[1113]: 2026/09/20 08:09:07 INFO Completed upload id=476003worker1 # [ 125.887238] nix-grpc-daemon[1427]: time=2026-09-20T08:09:07.916Z level=INFO msg="Upload complete. (250ms)"6004lb # [ 125.902189] niks3-server[1113]: 2026/09/20 08:09:07 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6005worker1 # [ 125.897398] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16006worker1 # [ 125.905375] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:07Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16007worker1 # [ 125.908846] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846008worker1 # [ 125.911997] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:07Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06009worker1 # [ 125.920178] nix-daemon[844]: reaped child process 1669, status = succeeded6010worker1 # [ 125.924320] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546846011worker1 # [ 125.930967] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546846012worker1 # [ 125.938844] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6013worker1 # [ 126.083839] nix-daemon[844]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6014worker1 # [ 126.096967] nix-daemon[844]: reaped child process 1698, status = succeeded6015worker1 # [ 126.236824] nix-daemon[844]: accepted connection from pid 1700, user nix-grpc-daemon (trusted)6016worker1 # [ 126.249691] nix-daemon[844]: reaped child process 1703, status = succeeded6017lb # [ 126.270822] niks3-server[1113]: 2026/09/20 08:09:08 INFO Received uploads request method=POST path=/api/pending_closures6018worker1 # [ 126.266240] nix-grpc-daemon[1427]: time=2026-09-20T08:09:08.295Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6019worker1 # [ 126.267802] nix-grpc-daemon[1427]: time=2026-09-20T08:09:08.297Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6020lb # [ 126.295935] niks3-server[1113]: 2026/09/20 08:09:08 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6021lb # [ 126.307350] niks3-server[1113]: 2026/09/20 08:09:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6022lb # [ 126.312258] niks3-server[1113]: 2026/09/20 08:09:08 INFO Signed narinfos id=48 count=16023worker1 # [ 126.303330] nix-grpc-daemon[1427]: time=2026-09-20T08:09:08.332Z level=INFO msg="Uploading 1 narinfos"6024lb # [ 126.326630] niks3-server[1113]: 2026/09/20 08:09:08 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6025lb # [ 126.330731] niks3-server[1113]: 2026/09/20 08:09:08 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6026lb # [ 126.338623] niks3-server[1113]: 2026/09/20 08:09:08 INFO Completed upload id=486027worker1 # [ 126.326183] nix-grpc-daemon[1427]: time=2026-09-20T08:09:08.355Z level=INFO msg="Upload complete. (382ms)"6028lb # [ 126.341581] niks3-server[1113]: 2026/09/20 08:09:08 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6029worker1 # [ 126.329753] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=5046030worker1 # [ 126.335697] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846031worker1 # [ 126.345442] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6032worker1 # [ 126.347741] nix-daemon[844]: reaped child process 1693, status = succeeded6033worker1 # [ 126.352855] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6034worker1 # [ 127.166428] nix-daemon[844]: reaped child process 1707, status = succeeded6035worker1 # [ 127.287491] nix-daemon[844]: accepted connection from pid 1722, user nix-grpc-daemon (trusted)6036worker1 # [ 127.299296] nix-daemon[844]: reaped child process 1725, status = succeeded6037lb # [ 127.327466] niks3-server[1113]: 2026/09/20 08:09:09 INFO Received uploads request method=POST path=/api/pending_closures6038worker1 # [ 127.321867] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.351Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6039worker1 # [ 127.323694] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.353Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6040lb # [ 127.358686] niks3-server[1113]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6041lb # [ 127.371465] niks3-server[1113]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6042lb # [ 127.381699] niks3-server[1113]: 2026/09/20 08:09:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6043worker1 # [ 127.374590] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.403Z level=INFO msg="Uploading 1 narinfos"6044lb # [ 127.386847] niks3-server[1113]: 2026/09/20 08:09:09 INFO Signed narinfos id=49 count=16045lb # [ 127.392849] niks3-server[1113]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6046lb # [ 127.403195] niks3-server[1113]: 2026/09/20 08:09:09 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6047lb # [ 127.409306] niks3-server[1113]: 2026/09/20 08:09:09 INFO Completed upload id=496048lb # [ 127.411479] niks3-server[1113]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6049worker1 # [ 127.398649] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.428Z level=INFO msg="Upload complete. (238ms)"6050worker1 # [ 127.409415] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16051worker1 # [ 127.416997] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16052worker1 # [ 127.423267] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846053worker1 # [ 127.426891] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06054worker1 # [ 127.437108] nix-daemon[844]: reaped child process 1705, status = succeeded6055worker1 # [ 127.438679] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546846056worker1 # [ 127.446065] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.475Z level=INFO msg="All 1 paths already cached"6057worker1 # [ 127.450289] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546846058worker1 # [ 127.456904] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6059worker1 # [ 127.603196] nix-daemon[844]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6060worker1 # [ 127.615951] nix-daemon[844]: reaped child process 1734, status = succeeded6061worker1 # [ 127.767434] nix-daemon[844]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6062worker1 # [ 127.779679] nix-daemon[844]: reaped child process 1739, status = succeeded6063lb # [ 127.805112] niks3-server[1113]: 2026/09/20 08:09:09 INFO Received uploads request method=POST path=/api/pending_closures6064worker1 # [ 127.801208] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.830Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6065worker1 # [ 127.802963] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.832Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6066lb # [ 127.831693] niks3-server[1113]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6067lb # [ 127.843290] niks3-server[1113]: 2026/09/20 08:09:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6068lb # [ 127.848387] niks3-server[1113]: 2026/09/20 08:09:09 INFO Signed narinfos id=50 count=16069worker1 # [ 127.839367] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.868Z level=INFO msg="Uploading 1 narinfos"6070lb # [ 127.857077] niks3-server[1113]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6071lb # [ 127.867964] niks3-server[1113]: 2026/09/20 08:09:09 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6072lb # [ 127.874134] niks3-server[1113]: 2026/09/20 08:09:09 INFO Completed upload id=506073worker1 # [ 127.861700] nix-grpc-daemon[1427]: time=2026-09-20T08:09:09.891Z level=INFO msg="Upload complete. (399ms)"6074lb # [ 127.879110] niks3-server[1113]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6075worker1 # [ 127.866134] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=6246076worker1 # [ 127.871649] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846077worker1 # [ 127.881256] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6078worker1 # [ 127.885754] nix-daemon[844]: reaped child process 1729, status = succeeded6079worker1 # [ 127.890784] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6080lb # [ 128.249397] envoy[984]: conn peer=[2001:db8:1::1]:39478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9403 tx=3761 ms=60026081lb # [ 128.253262] envoy[984]: conn peer=[2001:db8:1::1]:52396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1351 ms=122886082lb # [ 128.256749] envoy[984]: conn peer=[2001:db8:1::4]:33996 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9733 tx=2187 ms=520256083worker1 # [ 129.104785] nix-daemon[844]: reaped child process 1743, status = succeeded6084worker1 # [ 129.262588] nix-daemon[844]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)6085worker1 # [ 129.274656] nix-daemon[844]: reaped child process 1761, status = succeeded6086lb # [ 129.301341] niks3-server[1113]: 2026/09/20 08:09:11 INFO Received uploads request method=POST path=/api/pending_closures6087worker1 # [ 129.301287] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.329Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6088worker1 # [ 129.302857] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.329Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6089lb # [ 129.335395] niks3-server[1113]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6090lb # [ 129.351410] niks3-server[1113]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6091lb # [ 129.361677] niks3-server[1113]: 2026/09/20 08:09:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6092lb # [ 129.365500] niks3-server[1113]: 2026/09/20 08:09:11 INFO Signed narinfos id=51 count=16093worker1 # [ 129.355885] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.385Z level=INFO msg="Uploading 1 narinfos"6094lb # [ 129.371053] niks3-server[1113]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6095lb # [ 129.376396] niks3-server[1113]: 2026/09/20 08:09:11 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6096lb # [ 129.379405] niks3-server[1113]: 2026/09/20 08:09:11 INFO Completed upload id=516097worker1 # [ 129.367280] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.396Z level=WARN msg="Failed to register uploaded object" key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo error="server returned 404: object is not pending upload\n"6098worker1 # [ 129.372807] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.396Z level=INFO msg="Upload complete. (269ms)"6099worker1 # [ 129.382635] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16100worker1 # [ 129.389205] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16101worker1 # [ 129.393257] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846102worker1 # [ 129.395349] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06103worker1 # [ 129.401851] nix-daemon[844]: reaped child process 1741, status = succeeded6104worker1 # [ 129.403713] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546846105worker1 # [ 129.411458] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.440Z level=INFO msg="All 1 paths already cached"6106worker1 # [ 129.415886] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546846107worker1 # [ 129.422073] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6108worker1 # [ 129.565972] nix-daemon[844]: accepted connection from pid 1767, user nix-grpc-daemon (trusted)6109worker1 # [ 129.578923] nix-daemon[844]: reaped child process 1770, status = succeeded6110worker1 # [ 129.729931] nix-daemon[844]: accepted connection from pid 1772, user nix-grpc-daemon (trusted)6111worker1 # [ 129.741682] nix-daemon[844]: reaped child process 1775, status = succeeded6112lb # [ 129.767903] niks3-server[1113]: 2026/09/20 08:09:11 INFO Received uploads request method=POST path=/api/pending_closures6113worker1 # [ 129.763866] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.793Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6114worker1 # [ 129.765435] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.793Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6115lb # [ 129.801125] niks3-server[1113]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6116lb # [ 129.806430] niks3-server[1113]: 2026/09/20 08:09:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6117worker1 # [ 129.800635] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.829Z level=INFO msg="Uploading 1 narinfos"6118lb # [ 129.812920] niks3-server[1113]: 2026/09/20 08:09:11 INFO Signed narinfos id=52 count=16119lb # [ 129.818154] niks3-server[1113]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6120lb # [ 129.827637] niks3-server[1113]: 2026/09/20 08:09:11 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6121lb # [ 129.829939] niks3-server[1113]: 2026/09/20 08:09:11 INFO Completed upload id=526122worker1 # [ 129.817628] nix-grpc-daemon[1427]: time=2026-09-20T08:09:11.847Z level=INFO msg="Upload complete. (390ms)"6123lb # [ 129.833779] niks3-server[1113]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6124worker1 # [ 129.821070] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=6246125worker1 # [ 129.823862] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846126worker1 # [ 129.830176] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6127worker1 # [ 129.832645] nix-daemon[844]: reaped child process 1765, status = succeeded6128worker1 # [ 129.837960] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6129worker1 # [ 131.467348] nix-daemon[844]: reaped child process 1779, status = succeeded6130worker1 # [ 131.588576] nix-daemon[844]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6131worker1 # [ 131.600406] nix-daemon[844]: reaped child process 1797, status = succeeded6132lb # [ 131.622873] niks3-server[1113]: 2026/09/20 08:09:13 INFO Received uploads request method=POST path=/api/pending_closures6133worker1 # [ 131.614984] nix-grpc-daemon[1427]: time=2026-09-20T08:09:13.644Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6134worker1 # [ 131.616431] nix-grpc-daemon[1427]: time=2026-09-20T08:09:13.645Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6135lb # [ 131.641289] niks3-server[1113]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6136lb # [ 131.646065] niks3-server[1113]: 2026/09/20 08:09:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6137lb # [ 131.648120] niks3-server[1113]: 2026/09/20 08:09:13 INFO Signed narinfos id=53 count=16138worker1 # [ 131.637830] nix-grpc-daemon[1427]: time=2026-09-20T08:09:13.667Z level=INFO msg="Uploading 1 narinfos"6139lb # [ 131.652483] niks3-server[1113]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6140lb # [ 131.655299] niks3-server[1113]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6141lb # [ 131.660023] niks3-server[1113]: 2026/09/20 08:09:13 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6142lb # [ 131.663104] niks3-server[1113]: 2026/09/20 08:09:13 INFO Completed upload id=536143worker1 # [ 131.652049] nix-grpc-daemon[1427]: time=2026-09-20T08:09:13.681Z level=INFO msg="Upload complete. (205ms)"6144lb # [ 131.665752] niks3-server[1113]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6145worker1 # [ 131.654697] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16146worker1 # [ 131.659398] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:13Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16147worker1 # [ 131.662506] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846148worker1 # [ 131.666121] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:13Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06149worker1 # [ 131.671972] nix-daemon[844]: reaped child process 1777, status = succeeded6150worker1 # [ 131.673310] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546846151worker1 # [ 131.678887] nix-grpc-daemon[1427]: time=2026-09-20T08:09:13.708Z level=INFO msg="All 1 paths already cached"6152worker1 # [ 131.682698] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546846153worker1 # [ 131.686479] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6154worker1 # [ 131.829337] nix-daemon[844]: accepted connection from pid 1803, user nix-grpc-daemon (trusted)6155worker1 # [ 131.842226] nix-daemon[844]: reaped child process 1806, status = succeeded6156worker1 # [ 131.975826] nix-daemon[844]: accepted connection from pid 1808, user nix-grpc-daemon (trusted)6157worker1 # [ 131.987776] nix-daemon[844]: reaped child process 1811, status = succeeded6158lb # [ 132.008372] niks3-server[1113]: 2026/09/20 08:09:13 INFO Received uploads request method=POST path=/api/pending_closures6159worker1 # [ 132.000187] nix-grpc-daemon[1427]: time=2026-09-20T08:09:14.029Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6160worker1 # [ 132.001652] nix-grpc-daemon[1427]: time=2026-09-20T08:09:14.031Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6161lb # [ 132.024653] niks3-server[1113]: 2026/09/20 08:09:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6162lb # [ 132.027663] niks3-server[1113]: 2026/09/20 08:09:13 INFO Signed narinfos id=54 count=16163worker1 # [ 132.016659] nix-grpc-daemon[1427]: time=2026-09-20T08:09:14.045Z level=INFO msg="Uploading 1 narinfos"6164lb # [ 132.029208] niks3-server[1113]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6165lb # [ 132.034529] niks3-server[1113]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6166lb # [ 132.038154] niks3-server[1113]: 2026/09/20 08:09:13 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6167lb # [ 132.041268] niks3-server[1113]: 2026/09/20 08:09:13 INFO Completed upload id=546168worker1 # [ 132.028924] nix-grpc-daemon[1427]: time=2026-09-20T08:09:14.058Z level=INFO msg="Upload complete. (336ms)"6169lb # [ 132.044156] niks3-server[1113]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6170worker1 # [ 132.031173] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=6246171worker1 # [ 132.034450] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846172worker1 # [ 132.038633] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6173worker1 # [ 132.043918] nix-daemon[844]: reaped child process 1801, status = succeeded6174worker1 # [ 132.049605] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6175worker1 # [ 133.262401] nix-daemon[844]: reaped child process 1815, status = succeeded6176worker1 # [ 133.407284] nix-daemon[844]: accepted connection from pid 1830, user nix-grpc-daemon (trusted)6177worker1 # [ 133.417697] nix-daemon[844]: reaped child process 1833, status = succeeded6178lb # [ 133.445308] niks3-server[1113]: 2026/09/20 08:09:15 INFO Received uploads request method=POST path=/api/pending_closures6179worker1 # [ 133.440472] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.469Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6180worker1 # [ 133.442035] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.471Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6181lb # [ 133.480811] niks3-server[1113]: 2026/09/20 08:09:15 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6182lb # [ 133.488534] niks3-server[1113]: 2026/09/20 08:09:15 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6183lb # [ 133.499863] niks3-server[1113]: 2026/09/20 08:09:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6184lb # [ 133.505540] niks3-server[1113]: 2026/09/20 08:09:15 INFO Signed narinfos id=55 count=16185worker1 # [ 133.495976] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.525Z level=INFO msg="Uploading 1 narinfos"6186lb # [ 133.509717] niks3-server[1113]: 2026/09/20 08:09:15 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6187lb # [ 133.519139] niks3-server[1113]: 2026/09/20 08:09:15 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6188lb # [ 133.523864] niks3-server[1113]: 2026/09/20 08:09:15 INFO Completed upload id=556189worker1 # [ 133.511178] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.540Z level=INFO msg="Upload complete. (255ms)"6190lb # [ 133.528285] niks3-server[1113]: 2026/09/20 08:09:15 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6191worker1 # [ 133.517681] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16192worker1 # [ 133.527523] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:15Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16193worker1 # [ 133.531836] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846194worker1 # [ 133.536630] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:15Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06195worker1 # [ 133.545731] nix-daemon[844]: reaped child process 1813, status = succeeded6196worker1 # [ 133.547724] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546846197worker1 # [ 133.555588] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.585Z level=INFO msg="All 2 paths already cached"6198worker1 # [ 133.559897] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546846199worker1 # [ 133.563503] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6200worker1 # [ 133.710365] nix-daemon[844]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6201worker1 # [ 133.722269] nix-daemon[844]: reaped child process 1842, status = succeeded6202worker1 # [ 133.877103] nix-daemon[844]: accepted connection from pid 1844, user nix-grpc-daemon (trusted)6203worker1 # [ 133.888495] nix-daemon[844]: reaped child process 1847, status = succeeded6204lb # [ 133.917247] niks3-server[1113]: 2026/09/20 08:09:15 INFO Received uploads request method=POST path=/api/pending_closures6205worker1 # [ 133.912704] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.942Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6206worker1 # [ 133.914386] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.943Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6207lb # [ 133.943400] niks3-server[1113]: 2026/09/20 08:09:15 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6208lb # [ 133.954968] niks3-server[1113]: 2026/09/20 08:09:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6209worker1 # [ 133.947531] nix-grpc-daemon[1427]: time=2026-09-20T08:09:15.976Z level=INFO msg="Uploading 1 narinfos"6210lb # [ 133.959983] niks3-server[1113]: 2026/09/20 08:09:15 INFO Signed narinfos id=56 count=16211lb # [ 133.966090] niks3-server[1113]: 2026/09/20 08:09:15 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6212lb # [ 133.977306] niks3-server[1113]: 2026/09/20 08:09:15 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6213worker1 # [ 133.970843] nix-grpc-daemon[1427]: time=2026-09-20T08:09:16.000Z level=INFO msg="Upload complete. (401ms)"6214lb # [ 133.983524] niks3-server[1113]: 2026/09/20 08:09:15 INFO Completed upload id=566215lb # [ 133.986676] niks3-server[1113]: 2026/09/20 08:09:15 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6216worker1 # [ 133.973858] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=7526217worker1 # [ 133.978841] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846218worker1 # [ 133.987952] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6219worker1 # [ 133.989641] nix-daemon[844]: reaped child process 1837, status = succeeded6220worker1 # [ 133.994545] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6221worker1 # [ 135.020264] nix-daemon[844]: reaped child process 1851, status = succeeded6222worker1 # [ 135.172623] nix-daemon[844]: accepted connection from pid 1866, user nix-grpc-daemon (trusted)6223worker1 # [ 135.183744] nix-daemon[844]: reaped child process 1869, status = succeeded6224lb # [ 135.211477] niks3-server[1113]: 2026/09/20 08:09:17 INFO Received uploads request method=POST path=/api/pending_closures6225worker1 # [ 135.205677] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.234Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6226worker1 # [ 135.207172] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.236Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6227lb # [ 135.253632] niks3-server[1113]: 2026/09/20 08:09:17 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6228lb # [ 135.261115] niks3-server[1113]: 2026/09/20 08:09:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6229lb # [ 135.266657] niks3-server[1113]: 2026/09/20 08:09:17 INFO Signed narinfos id=57 count=16230worker1 # [ 135.257219] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.286Z level=INFO msg="Uploading 1 narinfos"6231lb # [ 135.272911] niks3-server[1113]: 2026/09/20 08:09:17 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6232lb # [ 135.277109] niks3-server[1113]: 2026/09/20 08:09:17 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6233lb # [ 135.286465] niks3-server[1113]: 2026/09/20 08:09:17 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6234lb # [ 135.291091] niks3-server[1113]: 2026/09/20 08:09:17 INFO Completed upload id=576235lb # [ 135.293960] niks3-server[1113]: 2026/09/20 08:09:17 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6236worker1 # [ 135.280262] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.309Z level=INFO msg="Upload complete. (278ms)"6237worker1 # [ 135.288200] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16238worker1 # [ 135.293396] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:17Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16239worker1 # [ 135.302625] nix-daemon[844]: reaped child process 1849, status = succeeded6240worker1 # [ 135.327853] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846241worker1 # [ 135.336755] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546846242worker1 # [ 135.348286] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.377Z level=INFO msg="All 2 paths already cached"6243worker1 # [ 135.355128] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546846244worker1 # [ 135.365105] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6245worker1 # [ 135.527680] nix-daemon[844]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)6246worker1 # [ 135.539609] nix-daemon[844]: reaped child process 1876, status = succeeded6247worker1 # [ 135.706725] nix-daemon[844]: accepted connection from pid 1878, user nix-grpc-daemon (trusted)6248worker1 # [ 135.719171] nix-daemon[844]: reaped child process 1881, status = succeeded6249lb # [ 135.744780] niks3-server[1113]: 2026/09/20 08:09:17 INFO Received uploads request method=POST path=/api/pending_closures6250worker1 # [ 135.740475] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.769Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6251worker1 # [ 135.742021] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.771Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6252lb # [ 135.775468] niks3-server[1113]: 2026/09/20 08:09:17 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6253lb # [ 135.783791] niks3-server[1113]: 2026/09/20 08:09:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6254worker1 # [ 135.775800] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.805Z level=INFO msg="Uploading 1 narinfos"6255lb # [ 135.789265] niks3-server[1113]: 2026/09/20 08:09:17 INFO Signed narinfos id=58 count=16256lb # [ 135.794302] niks3-server[1113]: 2026/09/20 08:09:17 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6257lb # [ 135.805854] niks3-server[1113]: 2026/09/20 08:09:17 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6258worker1 # [ 135.797905] nix-grpc-daemon[1427]: time=2026-09-20T08:09:17.827Z level=INFO msg="Upload complete. (423ms)"6259lb # [ 135.810258] niks3-server[1113]: 2026/09/20 08:09:17 INFO Completed upload id=586260worker1 # [ 135.800653] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=7526261lb # [ 135.814645] niks3-server[1113]: 2026/09/20 08:09:17 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6262worker1 # [ 135.806468] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846263worker1 # [ 135.816314] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6264worker1 # [ 135.819128] nix-daemon[844]: reaped child process 1871, status = succeeded6265worker1 # [ 135.824847] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6266worker1 # [ 136.837724] nix-daemon[844]: reaped child process 1885, status = succeeded6267worker1 # [ 136.973248] nix-daemon[844]: accepted connection from pid 1900, user nix-grpc-daemon (trusted)6268worker1 # [ 136.986175] nix-daemon[844]: reaped child process 1903, status = succeeded6269lb # [ 137.015386] niks3-server[1113]: 2026/09/20 08:09:18 INFO Received uploads request method=POST path=/api/pending_closures6270worker1 # [ 137.012140] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.040Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6271worker1 # [ 137.013527] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.040Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6272lb # [ 137.052639] niks3-server[1113]: 2026/09/20 08:09:18 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6273lb # [ 137.056384] niks3-server[1113]: 2026/09/20 08:09:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6274lb # [ 137.061356] niks3-server[1113]: 2026/09/20 08:09:18 INFO Signed narinfos id=59 count=16275worker1 # [ 137.051300] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.080Z level=INFO msg="Uploading 1 narinfos"6276lb # [ 137.067427] niks3-server[1113]: 2026/09/20 08:09:18 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6277lb # [ 137.077517] niks3-server[1113]: 2026/09/20 08:09:18 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6278lb # [ 137.083665] niks3-server[1113]: 2026/09/20 08:09:18 INFO Completed upload id=596279worker1 # [ 137.071075] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.100Z level=INFO msg="Upload complete. (239ms)"6280lb # [ 137.085624] niks3-server[1113]: 2026/09/20 08:09:18 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6281lb # [ 137.087879] niks3-server[1113]: 2026/09/20 08:09:18 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6282worker1 # [ 137.076162] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16283worker1 # [ 137.082814] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:19Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16284worker1 # [ 137.088670] nix-daemon[844]: reaped child process 1883, status = succeeded6285worker1 # [ 137.120402] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846286worker1 # [ 137.131312] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546846287worker1 # [ 137.143067] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.172Z level=INFO msg="All 2 paths already cached"6288worker1 # [ 137.149867] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546846289worker1 # [ 137.159329] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6290worker1 # [ 137.319500] nix-daemon[844]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)6291worker1 # [ 137.331426] nix-daemon[844]: reaped child process 1910, status = succeeded6292worker1 # [ 137.495642] nix-daemon[844]: accepted connection from pid 1912, user nix-grpc-daemon (trusted)6293worker1 # [ 137.507630] nix-daemon[844]: reaped child process 1915, status = succeeded6294lb # [ 137.536562] niks3-server[1113]: 2026/09/20 08:09:19 INFO Received uploads request method=POST path=/api/pending_closures6295worker1 # [ 137.532651] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.561Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6296worker1 # [ 137.534116] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.561Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6297lb # [ 137.567538] niks3-server[1113]: 2026/09/20 08:09:19 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6298lb # [ 137.579218] niks3-server[1113]: 2026/09/20 08:09:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6299worker1 # [ 137.571356] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.600Z level=INFO msg="Uploading 1 narinfos"6300lb # [ 137.585051] niks3-server[1113]: 2026/09/20 08:09:19 INFO Signed narinfos id=60 count=16301lb # [ 137.589717] niks3-server[1113]: 2026/09/20 08:09:19 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6302lb # [ 137.602126] niks3-server[1113]: 2026/09/20 08:09:19 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6303worker1 # [ 137.594363] nix-grpc-daemon[1427]: time=2026-09-20T08:09:19.623Z level=INFO msg="Upload complete. (425ms)"6304lb # [ 137.606797] niks3-server[1113]: 2026/09/20 08:09:19 INFO Completed upload id=606305worker1 # [ 137.596743] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=0 paths=1 nar_bytes_in=7526306lb # [ 137.609652] niks3-server[1113]: 2026/09/20 08:09:19 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6307worker1 # [ 137.600966] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546846308worker1 # [ 137.606451] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6309worker1 # [ 137.608675] nix-daemon[844]: reaped child process 1905, status = succeeded6310worker1 # [ 137.613927] nix-daemon[844]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6311worker1 # [ 138.426763] nix-daemon[844]: reaped child process 1919, status = succeeded6312worker1 # [ 138.570771] nix-daemon[844]: accepted connection from pid 1934, user nix-grpc-daemon (trusted)6313worker1 # [ 138.581450] nix-daemon[844]: reaped child process 1937, status = succeeded6314lb # [ 138.610045] niks3-server[1113]: 2026/09/20 08:09:20 INFO Received uploads request method=POST path=/api/pending_closures6315worker1 # [ 138.601951] nix-grpc-daemon[1427]: time=2026-09-20T08:09:20.631Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6316worker1 # [ 138.603437] nix-grpc-daemon[1427]: time=2026-09-20T08:09:20.632Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6317lb # [ 138.629440] niks3-server[1113]: 2026/09/20 08:09:20 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6318lb # [ 138.632104] niks3-server[1113]: 2026/09/20 08:09:20 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6319lb # [ 138.636043] niks3-server[1113]: 2026/09/20 08:09:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6320lb # [ 138.638062] niks3-server[1113]: 2026/09/20 08:09:20 INFO Signed narinfos id=61 count=16321worker1 # [ 138.625633] nix-grpc-daemon[1427]: time=2026-09-20T08:09:20.655Z level=INFO msg="Uploading 1 narinfos"6322lb # [ 138.640726] niks3-server[1113]: 2026/09/20 08:09:20 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6323lb # [ 138.645498] niks3-server[1113]: 2026/09/20 08:09:20 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6324lb # [ 138.648420] niks3-server[1113]: 2026/09/20 08:09:20 INFO Completed upload id=616325worker1 # [ 138.636111] nix-grpc-daemon[1427]: time=2026-09-20T08:09:20.665Z level=INFO msg="Upload complete. (216ms)"6326lb # [ 138.649975] niks3-server[1113]: 2026/09/20 08:09:20 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6327worker1 # [ 138.638382] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54684 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16328worker1 # [ 138.645133] nix-daemon[844]: reaped child process 1917, status = succeeded6329client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.56 seconds)6330worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6331worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.04 seconds)6332client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16333worker2 # [ 139.034767] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:454426334worker2 # [ 139.047766] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6335worker1 # [ 139.048601] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:21Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06336client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.29 seconds)6337(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 16.90 seconds)6338subtest: low disk drains a worker and builds go to the other6339worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6340worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.98 seconds)6341worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6342worker1 # [ 140.909857] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:22Z level=info event=unhealthy reason=min_free6343worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)6344client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26345worker1 # [ 141.376987] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546846346client # don't know how to build these paths:6347client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6348worker1 # [ 141.391069] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:23Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06349worker1 # [ 141.392749] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:23Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16350worker2 # [ 141.454743] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454426351worker2 # [ 141.462397] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 1/5)6352worker2 # [ 141.528840] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 2/5)6353worker2 # [ 141.665710] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 398 ms (attempt 3/5)6354worker2 # [ 142.070128] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 363 ms (attempt 4/5)6355worker2 # [ 142.439909] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6356worker2 # [ 142.456849] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454426357client # copying 1 paths to 'lb:50051'...6358client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6359worker2 # [ 142.468127] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454426360worker2 # [ 142.479199] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6361worker2 # [ 142.496845] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:24Z level=info event=niks3_push_started pid=16806362worker2 # [ 142.846096] nix-daemon[871]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)6363worker2 # [ 142.857261] nix-daemon[871]: reaped child process 1696, status = succeeded6364worker2 # [ 143.008838] nix-daemon[871]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)6365worker2 # [ 143.021293] nix-daemon[871]: reaped child process 1701, status = succeeded6366lb # [ 143.029764] niks3-server[1113]: 2026/09/20 08:09:24 INFO Received uploads request method=POST path=/api/pending_closures6367worker2 # [ 143.044455] nix-grpc-daemon[1680]: time=2026-09-20T08:09:24.826Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6368worker2 # [ 143.047663] nix-grpc-daemon[1680]: time=2026-09-20T08:09:24.828Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6369lb # [ 143.061314] niks3-server[1113]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6370lb # [ 143.075258] niks3-server[1113]: 2026/09/20 08:09:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6371worker2 # [ 143.090441] nix-grpc-daemon[1680]: time=2026-09-20T08:09:24.872Z level=INFO msg="Uploading 1 narinfos"6372lb # [ 143.083271] niks3-server[1113]: 2026/09/20 08:09:24 INFO Signed narinfos id=62 count=16373lb # [ 143.089810] niks3-server[1113]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6374lb # [ 143.099179] niks3-server[1113]: 2026/09/20 08:09:24 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6375lb # [ 143.104602] niks3-server[1113]: 2026/09/20 08:09:24 INFO Completed upload id=626376worker2 # [ 143.111453] nix-grpc-daemon[1680]: time=2026-09-20T08:09:24.893Z level=WARN msg="Failed to register uploaded object" key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo error="server returned 404: object is not pending upload\n"6377worker2 # [ 143.117686] nix-grpc-daemon[1680]: time=2026-09-20T08:09:24.898Z level=INFO msg="Upload complete. (430ms)"6378worker2 # [ 143.122568] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45442 duration_s=0 paths=1 nar_bytes_in=5126379worker2 # [ 143.126216] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454426380worker2 # [ 143.133061] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6381worker2 # [ 143.137809] nix-daemon[871]: reaped child process 1678, status = succeeded6382client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6383client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6384worker2 # [ 143.143844] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6385client # farm-a> LOG-farm-a-drain6386worker2 # [ 144.170836] nix-daemon[871]: reaped child process 1705, status = succeeded6387worker2 # [ 144.337107] nix-daemon[871]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6388worker2 # [ 144.349422] nix-daemon[871]: reaped child process 1723, status = succeeded6389lb # [ 144.359953] niks3-server[1113]: 2026/09/20 08:09:26 INFO Received uploads request method=POST path=/api/pending_closures6390worker2 # [ 144.375900] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.157Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6391worker2 # [ 144.377477] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.159Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6392lb # [ 144.399154] niks3-server[1113]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6393lb # [ 144.407550] niks3-server[1113]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6394lb # [ 144.411935] niks3-server[1113]: 2026/09/20 08:09:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6395worker2 # [ 144.425149] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.206Z level=INFO msg="Uploading 1 narinfos"6396lb # [ 144.417845] niks3-server[1113]: 2026/09/20 08:09:26 INFO Signed narinfos id=63 count=16397lb # [ 144.422857] niks3-server[1113]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6398lb # [ 144.437670] niks3-server[1113]: 2026/09/20 08:09:26 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6399lb # [ 144.441886] niks3-server[1113]: 2026/09/20 08:09:26 INFO Completed upload id=636400worker2 # [ 144.449190] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.231Z level=INFO msg="Upload complete. (298ms)"6401lb # [ 144.443493] niks3-server[1113]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6402worker2 # [ 144.455373] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45442 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16403worker1 # [ 144.443344] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:26Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06404worker2 # [ 144.467456] nix-daemon[871]: reaped child process 1703, status = succeeded6405worker1 # [ 144.447460] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:26Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16406worker2 # [ 144.506090] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454426407worker2 # [ 144.516702] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454426408worker2 # [ 144.527524] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.309Z level=INFO msg="All 1 paths already cached"6409client # copying 1 paths to 'lb:50051'...6410client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6411worker2 # [ 144.535391] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454426412worker2 # [ 144.545369] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6413worker2 # [ 144.732369] nix-daemon[871]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6414worker2 # [ 144.746854] nix-daemon[871]: reaped child process 1730, status = succeeded6415worker2 # [ 144.922109] nix-daemon[871]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6416worker2 # [ 144.935594] nix-daemon[871]: reaped child process 1735, status = succeeded6417lb # [ 144.945131] niks3-server[1113]: 2026/09/20 08:09:26 INFO Received uploads request method=POST path=/api/pending_closures6418worker2 # [ 144.961247] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.743Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6419worker2 # [ 144.962802] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.744Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6420lb # [ 144.974245] niks3-server[1113]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6421lb # [ 144.985412] niks3-server[1113]: 2026/09/20 08:09:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6422lb # [ 144.990895] niks3-server[1113]: 2026/09/20 08:09:26 INFO Signed narinfos id=64 count=16423worker2 # [ 145.000783] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.782Z level=INFO msg="Uploading 1 narinfos"6424lb # [ 144.997306] niks3-server[1113]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6425lb # [ 145.010689] niks3-server[1113]: 2026/09/20 08:09:26 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6426worker2 # [ 145.021582] nix-grpc-daemon[1680]: time=2026-09-20T08:09:26.803Z level=INFO msg="Upload complete. (463ms)"6427lb # [ 145.014848] niks3-server[1113]: 2026/09/20 08:09:26 INFO Completed upload id=646428worker2 # [ 145.024098] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45442 duration_s=0 paths=1 nar_bytes_in=6246429lb # [ 145.018741] niks3-server[1113]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6430worker2 # [ 145.029816] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454426431worker2 # [ 145.038636] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6432worker2 # [ 145.044369] nix-daemon[871]: reaped child process 1725, status = succeeded6433client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6434client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6435worker2 # [ 145.049871] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6436client # farm-b> LOG-farm-b-drain6437worker2 # [ 145.862375] nix-daemon[871]: reaped child process 1739, status = succeeded6438worker2 # [ 146.014484] nix-daemon[871]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)6439worker2 # [ 146.028592] nix-daemon[871]: reaped child process 1757, status = succeeded6440lb # [ 146.038611] niks3-server[1113]: 2026/09/20 08:09:27 INFO Received uploads request method=POST path=/api/pending_closures6441worker2 # [ 146.054223] nix-grpc-daemon[1680]: time=2026-09-20T08:09:27.836Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6442worker2 # [ 146.055820] nix-grpc-daemon[1680]: time=2026-09-20T08:09:27.837Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6443lb # [ 146.068604] niks3-server[1113]: 2026/09/20 08:09:27 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6444lb # [ 146.084140] niks3-server[1113]: 2026/09/20 08:09:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6445worker2 # [ 146.098064] nix-grpc-daemon[1680]: time=2026-09-20T08:09:27.879Z level=INFO msg="Uploading 1 narinfos"6446lb # [ 146.091696] niks3-server[1113]: 2026/09/20 08:09:27 INFO Signed narinfos id=65 count=16447lb # [ 146.098122] niks3-server[1113]: 2026/09/20 08:09:27 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6448lb # [ 146.102701] niks3-server[1113]: 2026/09/20 08:09:27 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6449lb # [ 146.111430] niks3-server[1113]: 2026/09/20 08:09:27 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6450lb # [ 146.117355] niks3-server[1113]: 2026/09/20 08:09:27 INFO Completed upload id=656451worker2 # [ 146.124562] nix-grpc-daemon[1680]: time=2026-09-20T08:09:27.906Z level=INFO msg="Upload complete. (267ms)"6452lb # [ 146.120372] niks3-server[1113]: 2026/09/20 08:09:27 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6453worker2 # [ 146.129597] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45442 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16454worker1 # [ 146.116813] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:28Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06455worker2 # [ 146.143511] nix-daemon[871]: reaped child process 1737, status = succeeded6456worker1 # [ 146.121669] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:28Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16457worker2 # [ 146.179447] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454426458worker2 # [ 146.191107] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454426459worker2 # [ 146.203867] nix-grpc-daemon[1680]: time=2026-09-20T08:09:27.985Z level=INFO msg="All 2 paths already cached"6460client # copying 1 paths to 'lb:50051'...6461client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6462worker2 # [ 146.211274] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454426463worker2 # [ 146.219942] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6464worker2 # [ 146.395933] nix-daemon[871]: accepted connection from pid 1761, user nix-grpc-daemon (trusted)6465worker2 # [ 146.411747] nix-daemon[871]: reaped child process 1764, status = succeeded6466worker2 # [ 146.576132] nix-daemon[871]: accepted connection from pid 1766, user nix-grpc-daemon (trusted)6467worker2 # [ 146.590706] nix-daemon[871]: reaped child process 1769, status = succeeded6468lb # [ 146.599987] niks3-server[1113]: 2026/09/20 08:09:28 INFO Received uploads request method=POST path=/api/pending_closures6469worker2 # [ 146.616285] nix-grpc-daemon[1680]: time=2026-09-20T08:09:28.398Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6470worker2 # [ 146.617774] nix-grpc-daemon[1680]: time=2026-09-20T08:09:28.398Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6471lb # [ 146.624614] niks3-server[1113]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6472lb # [ 146.636943] niks3-server[1113]: 2026/09/20 08:09:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6473lb # [ 146.643661] niks3-server[1113]: 2026/09/20 08:09:28 INFO Signed narinfos id=66 count=16474worker2 # [ 146.653911] nix-grpc-daemon[1680]: time=2026-09-20T08:09:28.435Z level=INFO msg="Uploading 1 narinfos"6475lb # [ 146.646947] niks3-server[1113]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6476lb # [ 146.659456] niks3-server[1113]: 2026/09/20 08:09:28 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6477worker2 # [ 146.670893] nix-grpc-daemon[1680]: time=2026-09-20T08:09:28.452Z level=INFO msg="Upload complete. (437ms)"6478lb # [ 146.663977] niks3-server[1113]: 2026/09/20 08:09:28 INFO Completed upload id=666479worker2 # [ 146.673592] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45442 duration_s=0 paths=1 nar_bytes_in=7526480lb # [ 146.668500] niks3-server[1113]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6481worker2 # [ 146.679617] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454426482worker2 # [ 146.688304] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6483worker2 # [ 146.693674] nix-daemon[871]: reaped child process 1759, status = succeeded6484worker2 # [ 146.699356] nix-daemon[871]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6485client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6486client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6487client # farm-top> LOG-farm-top-drain6488worker2 # [ 147.715953] nix-daemon[871]: reaped child process 1773, status = succeeded6489worker2 # [ 147.833667] nix-daemon[871]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6490worker2 # [ 147.848979] nix-daemon[871]: reaped child process 1791, status = succeeded6491lb # [ 147.853074] niks3-server[1113]: 2026/09/20 08:09:29 INFO Received uploads request method=POST path=/api/pending_closures6492worker2 # [ 147.868553] nix-grpc-daemon[1680]: time=2026-09-20T08:09:29.650Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6493worker2 # [ 147.871809] nix-grpc-daemon[1680]: time=2026-09-20T08:09:29.652Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6494lb # [ 147.884576] niks3-server[1113]: 2026/09/20 08:09:29 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6495lb # [ 147.896957] niks3-server[1113]: 2026/09/20 08:09:29 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6496lb # [ 147.906291] niks3-server[1113]: 2026/09/20 08:09:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6497worker2 # [ 147.918597] nix-grpc-daemon[1680]: time=2026-09-20T08:09:29.700Z level=INFO msg="Uploading 1 narinfos"6498lb # [ 147.911258] niks3-server[1113]: 2026/09/20 08:09:29 INFO Signed narinfos id=67 count=16499lb # [ 147.916636] niks3-server[1113]: 2026/09/20 08:09:29 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6500lb # [ 147.924558] niks3-server[1113]: 2026/09/20 08:09:29 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6501lb # [ 147.930799] niks3-server[1113]: 2026/09/20 08:09:29 INFO Completed upload id=676502worker2 # [ 147.937600] nix-grpc-daemon[1680]: time=2026-09-20T08:09:29.719Z level=INFO msg="Upload complete. (230ms)"6503lb # [ 147.933817] niks3-server[1113]: 2026/09/20 08:09:29 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6504worker2 # [ 147.942751] nix-grpc-daemon[1659]: ts=2026-09-20T08:09:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45442 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16505worker2 # [ 147.954979] nix-daemon[871]: reaped child process 1771, status = succeeded6506client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.80 seconds)6507client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6508client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.21 seconds)6509lb # [ 148.249686] envoy[984]: conn peer=[2001:db8:1::1]:39490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26782 tx=10563 ms=162976510lb # [ 148.253634] envoy[984]: conn peer=[2001:db8:1::1]:42398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=708 tx=439 ms=576511lb # [ 148.257326] envoy[984]: conn peer=[2001:db8:1::1]:42412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9377 tx=3816 ms=65596512worker1: must succeed: rm /nix/.rw-store/fill6513worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6514worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6515worker1 # [ 148.916453] nix-grpc-daemon[1360]: ts=2026-09-20T08:09:30Z level=info event=healthy reason=min_free6516worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6517(finished: subtest: low disk drains a worker and builds go to the other, in 10.40 seconds)6518(finished: run the VM test script, in 150.57 seconds)6519test script finished in 150.81s6520cleanup6521kill QemuMachine (pid 50)6522client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6523kill QemuMachine (pid 49)6524lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6525kill QemuMachine (pid 51)6526worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6527kill QemuMachine (pid 52)6528worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6529(finished: cleanup, in 0.97 seconds)6530additionally exposed symbols:6531 client, lb, worker1, worker2,6532 vlan1,6533 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh