vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #300
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client: QEMU running (pid 49)14client # Formatting '/build/vm-state-client/tmp.nKKvxfiwIX', fmt=raw size=107374182415client # mke2fs 1.47.4 (6-Mar-2025)16client # Discarding device blocks: 0/262144 done17client # Creating filesystem with 262144 4k blocks and 65536 inodes18client # Filesystem UUID: 1e2dc5c7-247f-4405-b864-1871fe2608d719client # Superblock backups stored on blocks:20client # 32768, 98304, 163840, 22937621worker1: QEMU running (pid 51)22client # 23worker1 # Disk image does not exist, creating the virtualisation disk image...24client # Allocating group tables: 0/8 done25worker1 # Formatting '/build/vm-state-worker1/tmp.oxSzAZcUl9', fmt=raw size=107374182426client # Writing inode tables: 0/8 done27worker1 # mke2fs 1.47.4 (6-Mar-2025)28client # Creating journal (8192 blocks): done29worker1 # Discarding device blocks: 0/262144 done30client # Writing superblocks and filesystem accounting information: 0/8 done31worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes32worker1 # Filesystem UUID: 0131dd84-baae-48e7-8391-c5cbfc8e08aa33worker2 # Disk image does not exist, creating the virtualisation disk image...34lb # Disk image does not exist, creating the virtualisation disk image...35client # 36worker2 # Formatting '/build/vm-state-worker2/tmp.dW98SmGX37', fmt=raw size=107374182437worker1 # Superblock backups stored on blocks:38worker1 # 32768, 98304, 163840, 22937639worker2 # mke2fs 1.47.4 (6-Mar-2025)40lb # Formatting '/build/vm-state-lb/tmp.CH0zQL7ETe', fmt=raw size=107374182441lb: QEMU running (pid 50)42worker2: QEMU running (pid 52)43client # Virtualisation disk image created.44worker1 # 45lb # mke2fs 1.47.4 (6-Mar-2025)46worker1 # Allocating group tables: 0/8 done47(finished: start all VMs, in 0.24 seconds)48worker2 # Discarding device blocks: 0/262144 done49lb # Discarding device blocks: 0/262144 done50worker1 # Writing inode tables: 0/8 done51client: waiting for unit network-addresses-eth1.service52worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes53worker1 # Creating journal (8192 blocks): done54lb # Creating filesystem with 262144 4k blocks and 65536 inodes55client: waiting for the VM to finish booting56worker2 # Filesystem UUID: 7fa703ef-bd7f-484d-ab1b-4d43667b370157worker1 # Writing superblocks and filesystem accounting information: 0/8 done58worker2 # Superblock backups stored on blocks:59worker2 # 32768, 98304, 163840, 22937660worker1 # 61worker1 # Virtualisation disk image created.62lb # Filesystem UUID: 2da8b45c-5191-4718-99a7-09c607825eff63lb # Superblock backups stored on blocks:64worker2 # 65lb # 32768, 98304, 163840, 22937666lb # 67worker2 # Allocating group tables: 0/8 done68lb # Allocating group tables: 0/8 done69worker2 # Writing inode tables: 0/8 done70worker2 # Creating journal (8192 blocks): done71worker2 # Writing superblocks and filesystem accounting information: 0/8 done72lb # Writing inode tables: 0/8 done73worker2 # 74lb # Creating journal (8192 blocks): done75worker2 # Virtualisation disk image created.76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086client # 87client # 88client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...90worker1 # 91worker1 # 92worker1 # 93worker1 # 94worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0095client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...96client # 97client # 98client # 99client # 100client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00101worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...102worker1 # 103worker1 # 104client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105client # 106client # 107worker2 # 108worker2 # 109worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00110worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...111worker2 # 112worker2 # 113worker2 # 114worker2 # 115lb # 116worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00117lb # 118worker1 # Booting from ROM...119lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00120client # Booting from ROM...121worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...122worker2 # 123worker2 # 124lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...125lb # 126lb # 127lb # 128lb # 129lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00130lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...131lb # 132lb # 133worker2 # Booting from ROM...134lb # Booting from ROM...135lb # Probing EDD (edd=off to disable)... ok136lb # 137lb # 138lb # 139lb # 140lb # 141lb # 142lb # 143lb # 144lb # 145lb # 146lb # 147lb # 148lb # 149lb # 150worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026151client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026152worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hvv0rrwgpqzhm46a4280mwzmbapcmqq9-nixos-system-worker1-test/init regInfo=/nix/store/vhr1b62dfjs04ywz0rz399x3gf2shwsl-closure-info/registration console=ttyS0,115200n8 console=tty0153worker1 # [ 0.000000] BIOS-provided physical RAM map:154client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test/init regInfo=/nix/store/9p1idx4s91wv7zwkal5pb5lr899hddrn-closure-info/registration console=ttyS0,115200n8 console=tty0155client # [ 0.000000] BIOS-provided physical RAM map:156worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable157client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable158worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved159client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved160worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved161client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved162worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable163client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable164worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved165client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved166worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved167client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved168worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved169client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved170worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved171client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved172worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved173client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved174worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved175worker1 # [ 0.000000] NX (Execute Disable) protection: active176client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved177worker1 # [ 0.000000] APIC: Static calls initialized178client # [ 0.000000] NX (Execute Disable) protection: active179worker1 # [ 0.000000] SMBIOS 2.8 present.180client # [ 0.000000] APIC: Static calls initialized181client # [ 0.000000] SMBIOS 2.8 present.182worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014183worker1 # [ 0.000000] DMI: Memory slots populated: 1/1184client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014185worker1 # [ 0.000000] Hypervisor detected: KVM186client # [ 0.000000] DMI: Memory slots populated: 1/1187worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000188client # [ 0.000000] Hypervisor detected: KVM189worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00190client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000191worker1 # [ 0.000001] kvm-clock: using sched offset of 462361608 cycles192client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00193client # [ 0.000000] kvm-clock: using sched offset of 451328423 cycles194worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns195worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor196client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns197worker1 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000198client # [ 0.000005] tsc: Detected 2400.012 MHz processor199client # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000200worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs201client # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs202worker1 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT203worker1 # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f]204client # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT205worker1 # [ 0.002747] Using GB pages for direct mapping206client # [ 0.002730] found SMP MP-table at [mem 0x000f5450-0x000f545f]207worker1 # [ 0.002842] RAMDISK: [mem 0x5e367000-0x5ffcffff]208client # [ 0.002740] Using GB pages for direct mapping209worker1 # [ 0.002854] ACPI: Early table checksum verification disabled210client # [ 0.002878] RAMDISK: [mem 0x5e366000-0x5ffcffff]211worker1 # [ 0.002857] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )212client # [ 0.002886] ACPI: Early table checksum verification disabled213client # [ 0.002888] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )214worker1 # [ 0.002861] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)215client # [ 0.002892] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)216worker1 # [ 0.002865] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)217client # [ 0.002896] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)218worker1 # [ 0.002871] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)219worker1 # [ 0.002873] ACPI: FACS 0x000000005FFE0000 000040220client # [ 0.002903] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)221client # [ 0.002905] ACPI: FACS 0x000000005FFE0000 000040222worker1 # [ 0.002875] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)223client # [ 0.002906] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)224worker1 # [ 0.002876] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)225client # [ 0.002908] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)226worker1 # [ 0.002878] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)227client # [ 0.002909] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)228worker1 # [ 0.002879] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)229client # [ 0.002911] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)230worker1 # [ 0.002881] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]231client # [ 0.002912] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]232worker1 # [ 0.002882] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]233client # [ 0.002913] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]234worker1 # [ 0.002882] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]235client # [ 0.002914] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]236worker1 # [ 0.002883] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]237worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026238client # [ 0.002914] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]239worker1 # [ 0.002883] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]240client # [ 0.002915] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]241worker1 # [ 0.002884] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]242client # [ 0.002915] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]243worker1 # [ 0.002884] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]244worker1 # [ 0.003122] No NUMA configuration found245client # [ 0.002916] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]246client # [ 0.003143] No NUMA configuration found247worker1 # [ 0.003123] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]248worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x5qgax5h37ybfdjp7r7k01yx9abl6wij-nixos-system-worker2-test/init regInfo=/nix/store/dq71v172s5jppb7nnfi3vkq85w35rkbj-closure-info/registration console=ttyS0,115200n8 console=tty0249client # [ 0.003144] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]250worker2 # [ 0.000000] BIOS-provided physical RAM map:251worker1 # [ 0.003126] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]252worker1 # [ 0.005272] Zone ranges:253client # [ 0.003146] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]254worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable255client # [ 0.005441] Zone ranges:256worker1 # [ 0.005272] DMA [mem 0x0000000000001000-0x0000000000ffffff]257lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026258client # [ 0.005442] DMA [mem 0x0000000000001000-0x0000000000ffffff]259worker1 # [ 0.005274] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]260worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved261worker1 # [ 0.005275] Normal empty262worker1 # [ 0.005276] Device empty263worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved264client # [ 0.005443] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]265client # [ 0.005444] Normal empty266worker1 # [ 0.005276] Movable zone start for each node267client # [ 0.005445] Device empty268worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable269worker1 # [ 0.005277] Early memory node ranges270client # [ 0.005446] Movable zone start for each node271client # [ 0.005446] Early memory node ranges272worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved273worker1 # [ 0.005278] node 0: [mem 0x0000000000001000-0x000000000009efff]274client # [ 0.005447] node 0: [mem 0x0000000000001000-0x000000000009efff]275lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xzrwmx591i25vlijx1m7lk76hjmbxra6-nixos-system-lb-test/init regInfo=/nix/store/5b1jdrkcd54zycf7j131lh8wai3gzg44-closure-info/registration console=ttyS0,115200n8 console=tty0276worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved277worker1 # [ 0.005279] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]278lb # [ 0.000000] BIOS-provided physical RAM map:279client # [ 0.005448] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]280worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved281worker1 # [ 0.005280] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]282lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable283worker1 # [ 0.005300] On node 0, zone DMA: 1 pages in unavailable ranges284client # [ 0.005449] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]285worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved286lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved287client # [ 0.005466] On node 0, zone DMA: 1 pages in unavailable ranges288worker1 # [ 0.005564] On node 0, zone DMA: 97 pages in unavailable ranges289worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved290worker1 # [ 0.030658] On node 0, zone DMA32: 40 pages in unavailable ranges291lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved292client # [ 0.005713] On node 0, zone DMA: 97 pages in unavailable ranges293worker1 # [ 0.031113] ACPI: PM-Timer IO Port: 0x608294worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved295client # [ 0.030749] On node 0, zone DMA32: 40 pages in unavailable ranges296lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable297worker2 # [ 0.000000] NX (Execute Disable) protection: active298worker1 # [ 0.031124] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])299client # [ 0.031207] ACPI: PM-Timer IO Port: 0x608300worker2 # [ 0.000000] APIC: Static calls initialized301lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved302client # [ 0.031217] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])303worker2 # [ 0.000000] SMBIOS 2.8 present.304worker1 # [ 0.031149] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23305lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved306worker1 # [ 0.031151] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)307client # [ 0.031241] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23308worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014309lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved310client # [ 0.031244] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)311worker1 # [ 0.031153] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)312worker2 # [ 0.000000] DMI: Memory slots populated: 1/1313worker2 # [ 0.000000] Hypervisor detected: KVM314lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved315worker1 # [ 0.031154] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)316client # [ 0.031246] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)317worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000318lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved319client # [ 0.031247] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)320worker1 # [ 0.031155] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)321worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00322lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved323client # [ 0.031248] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)324worker1 # [ 0.031155] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)325worker2 # [ 0.000000] kvm-clock: using sched offset of 461160173 cycles326lb # [ 0.000000] NX (Execute Disable) protection: active327client # [ 0.031249] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)328worker1 # [ 0.031158] ACPI: Using ACPI (MADT) for SMP configuration information329lb # [ 0.000000] APIC: Static calls initialized330worker1 # [ 0.031159] ACPI: HPET id: 0x8086a201 base: 0xfed00000331lb # [ 0.000000] SMBIOS 2.8 present.332worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns333client # [ 0.031251] ACPI: Using ACPI (MADT) for SMP configuration information334worker1 # [ 0.031163] TSC deadline timer available335worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor336client # [ 0.031252] ACPI: HPET id: 0x8086a201 base: 0xfed00000337worker1 # [ 0.031167] CPU topo: Max. logical packages: 1338worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000339client # [ 0.031256] TSC deadline timer available340lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014341worker1 # [ 0.031168] CPU topo: Max. logical dies: 1342lb # [ 0.000000] DMI: Memory slots populated: 1/1343client # [ 0.031260] CPU topo: Max. logical packages: 1344worker1 # [ 0.031168] CPU topo: Max. dies per package: 1345lb # [ 0.000000] Hypervisor detected: KVM346worker2 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs347client # [ 0.031260] CPU topo: Max. logical dies: 1348worker1 # [ 0.031171] CPU topo: Max. threads per core: 1349lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000350client # [ 0.031261] CPU topo: Max. dies per package: 1351worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT352worker1 # [ 0.031172] CPU topo: Num. cores per package: 1353lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00354client # [ 0.031264] CPU topo: Max. threads per core: 1355worker2 # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f]356worker1 # [ 0.031173] CPU topo: Num. threads per package: 1357lb # [ 0.000000] kvm-clock: using sched offset of 465668221 cycles358worker2 # [ 0.002752] Using GB pages for direct mapping359client # [ 0.031265] CPU topo: Num. cores per package: 1360client # [ 0.031265] CPU topo: Num. threads per package: 1361worker1 # [ 0.031173] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs362worker2 # [ 0.002825] RAMDISK: [mem 0x5e367000-0x5ffcffff]363lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns364worker2 # [ 0.002834] ACPI: Early table checksum verification disabled365worker1 # [ 0.031191] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()366client # [ 0.031266] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs367lb # [ 0.000005] tsc: Detected 2400.012 MHz processor368client # [ 0.031283] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()369worker2 # [ 0.002837] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )370worker1 # [ 0.031220] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]371lb # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000372client # [ 0.031313] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]373worker2 # [ 0.002841] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)374worker1 # [ 0.031222] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]375lb # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs376client # [ 0.031314] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]377worker1 # [ 0.031223] [mem 0x60000000-0xafffffff] available for PCI devices378worker2 # [ 0.002846] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)379lb # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT380worker1 # [ 0.031225] Booting paravirtualized kernel on KVM381client # [ 0.031316] [mem 0x60000000-0xafffffff] available for PCI devices382worker2 # [ 0.002853] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)383lb # [ 0.002743] found SMP MP-table at [mem 0x000f5450-0x000f545f]384client # [ 0.031317] Booting paravirtualized kernel on KVM385lb # [ 0.002754] Using GB pages for direct mapping386worker2 # [ 0.002855] ACPI: FACS 0x000000005FFE0000 000040387worker1 # [ 0.031228] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns388lb # [ 0.002899] RAMDISK: [mem 0x5e367000-0x5ffcffff]389client # [ 0.031320] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns390worker1 # [ 0.035682] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1391worker2 # [ 0.002856] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)392lb # [ 0.002907] ACPI: Early table checksum verification disabled393client # [ 0.035763] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1394lb # [ 0.002910] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )395worker1 # [ 0.037879] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152396worker2 # [ 0.002858] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)397client # [ 0.037808] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152398worker1 # [ 0.037923] kvm-guest: PV spinlocks disabled, single CPU399lb # [ 0.002914] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)400worker2 # [ 0.002859] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)401client # [ 0.037849] kvm-guest: PV spinlocks disabled, single CPU402lb # [ 0.002918] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)403worker2 # [ 0.002861] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)404lb # [ 0.002924] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)405worker2 # [ 0.002862] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]406lb # [ 0.002926] ACPI: FACS 0x000000005FFE0000 000040407worker2 # [ 0.002863] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]408worker1 # [ 0.037924] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hvv0rrwgpqzhm46a4280mwzmbapcmqq9-nixos-system-worker1-test/init regInfo=/nix/store/vhr1b62dfjs04ywz0rz399x3gf2shwsl-closure-info/registration console=ttyS0,115200n8 console=tty0409lb # [ 0.002928] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)410worker2 # [ 0.002864] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]411client # [ 0.037851] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test/init regInfo=/nix/store/9p1idx4s91wv7zwkal5pb5lr899hddrn-closure-info/registration console=ttyS0,115200n8 console=tty0412lb # [ 0.002929] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)413worker2 # [ 0.002864] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]414worker1 # [ 0.038020] Unknown kernel command line parameters "regInfo=/nix/store/vhr1b62dfjs04ywz0rz399x3gf2shwsl-closure-info/registration", will be passed to user space.415worker2 # [ 0.002865] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]416worker1 # [ 0.038032] random: crng init done417lb # [ 0.002931] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)418client # [ 0.037940] Unknown kernel command line parameters "regInfo=/nix/store/9p1idx4s91wv7zwkal5pb5lr899hddrn-closure-info/registration", will be passed to user space.419client # [ 0.037952] random: crng init done420worker2 # [ 0.002865] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]421worker1 # [ 0.038032] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes422lb # [ 0.002932] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)423client # [ 0.037953] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes424worker2 # [ 0.002866] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]425worker1 # [ 0.040045] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)426lb # [ 0.002933] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]427worker2 # [ 0.003089] No NUMA configuration found428client # [ 0.039964] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)429worker1 # [ 0.041058] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)430lb # [ 0.002934] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]431worker2 # [ 0.003090] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]432worker1 # [ 0.041094] Fallback order for Node 0: 0433client # [ 0.040969] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)434worker2 # [ 0.003092] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]435lb # [ 0.002935] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]436client # [ 0.041008] Fallback order for Node 0: 0437worker2 # [ 0.005206] Zone ranges:438worker1 # [ 0.041097] Built 1 zonelists, mobility grouping on. Total pages: 393078439worker1 # [ 0.041098] Policy zone: DMA32440lb # [ 0.002935] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]441worker2 # [ 0.005207] DMA [mem 0x0000000000001000-0x0000000000ffffff]442client # [ 0.041011] Built 1 zonelists, mobility grouping on. Total pages: 393078443client # [ 0.041012] Policy zone: DMA32444lb # [ 0.002936] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]445worker1 # [ 0.043467] mem auto-init: stack:all(zero), heap alloc:on, heap free:off446worker2 # [ 0.005209] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]447worker2 # [ 0.005210] Normal empty448client # [ 0.043510] mem auto-init: stack:all(zero), heap alloc:on, heap free:off449worker1 # [ 0.046480] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1450worker2 # [ 0.005211] Device empty451lb # [ 0.002936] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]452worker1 # [ 0.049785] allocated 3145728 bytes of page_ext453worker2 # [ 0.005211] Movable zone start for each node454client # [ 0.046411] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1455worker2 # [ 0.005212] Early memory node ranges456lb # [ 0.002937] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]457client # [ 0.049571] allocated 3145728 bytes of page_ext458worker1 # [ 0.059602] ftrace: allocating 48731 entries in 192 pages459lb # [ 0.003154] No NUMA configuration found460worker1 # [ 0.059604] ftrace: allocated 192 pages with 2 groups461client # [ 0.059188] ftrace: allocating 48731 entries in 192 pages462worker2 # [ 0.005213] node 0: [mem 0x0000000000001000-0x000000000009efff]463worker1 # [ 0.060420] Dynamic Preempt: lazy464lb # [ 0.003155] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]465client # [ 0.059190] ftrace: allocated 192 pages with 2 groups466worker2 # [ 0.005214] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]467client # [ 0.060006] Dynamic Preempt: lazy468worker1 # [ 0.060590] rcu: Preemptible hierarchical RCU implementation.469lb # [ 0.003157] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]470lb # [ 0.005267] Zone ranges:471worker2 # [ 0.005215] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]472worker1 # [ 0.060590] rcu: RCU event tracing is enabled.473client # [ 0.060162] rcu: Preemptible hierarchical RCU implementation.474lb # [ 0.005267] DMA [mem 0x0000000000001000-0x0000000000ffffff]475client # [ 0.060163] rcu: RCU event tracing is enabled.476worker2 # [ 0.005243] On node 0, zone DMA: 1 pages in unavailable ranges477worker1 # [ 0.060591] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.478lb # [ 0.005269] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]479worker1 # [ 0.060592] Trampoline variant of Tasks RCU enabled.480client # [ 0.060164] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.481worker2 # [ 0.005489] On node 0, zone DMA: 97 pages in unavailable ranges482lb # [ 0.005270] Normal empty483worker1 # [ 0.060592] Rude variant of Tasks RCU enabled.484lb # [ 0.005270] Device empty485worker2 # [ 0.030430] On node 0, zone DMA32: 40 pages in unavailable ranges486client # [ 0.060165] Trampoline variant of Tasks RCU enabled.487worker1 # [ 0.060593] Tracing variant of Tasks RCU enabled.488lb # [ 0.005271] Movable zone start for each node489client # [ 0.060165] Rude variant of Tasks RCU enabled.490worker2 # [ 0.030890] ACPI: PM-Timer IO Port: 0x608491lb # [ 0.005272] Early memory node ranges492client # [ 0.060166] Tracing variant of Tasks RCU enabled.493worker2 # [ 0.030902] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])494worker1 # [ 0.060594] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.495lb # [ 0.005272] node 0: [mem 0x0000000000001000-0x000000000009efff]496client # [ 0.060166] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.497worker2 # [ 0.030927] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23498worker1 # [ 0.060594] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1499lb # [ 0.005273] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]500client # [ 0.060167] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1501worker2 # [ 0.030930] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)502worker1 # [ 0.060608] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.503lb # [ 0.005274] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]504worker2 # [ 0.030931] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)505client # [ 0.060187] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.506lb # [ 0.005293] On node 0, zone DMA: 1 pages in unavailable ranges507worker1 # [ 0.060610] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.508worker2 # [ 0.030932] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)509lb # [ 0.005541] On node 0, zone DMA: 97 pages in unavailable ranges510client # [ 0.060189] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.511worker2 # [ 0.030933] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)512lb # [ 0.030401] On node 0, zone DMA32: 40 pages in unavailable ranges513worker1 # [ 0.060610] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.514lb # [ 0.030857] ACPI: PM-Timer IO Port: 0x608515worker2 # [ 0.030934] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)516client # [ 0.060190] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.517worker1 # [ 0.064906] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16518lb # [ 0.030867] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])519worker2 # [ 0.030936] ACPI: Using ACPI (MADT) for SMP configuration information520client # [ 0.064497] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16521worker1 # [ 0.065171] rcu: srcu_init: Setting srcu_struct sizes based on contention.522lb # [ 0.030893] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23523worker2 # [ 0.030937] ACPI: HPET id: 0x8086a201 base: 0xfed00000524client # [ 0.064791] rcu: srcu_init: Setting srcu_struct sizes based on contention.525worker2 # [ 0.030941] TSC deadline timer available526lb # [ 0.030896] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)527worker1 # [ 0.065179] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns528worker2 # [ 0.030945] CPU topo: Max. logical packages: 1529client # [ 0.064796] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns530lb # [ 0.030898] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)531worker2 # [ 0.030946] CPU topo: Max. logical dies: 1532worker1 # [ 0.065280] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)533worker2 # [ 0.030947] CPU topo: Max. dies per package: 1534lb # [ 0.030899] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)535worker1 # [ 0.068820] Console: colour VGA+ 80x25536client # [ 0.064898] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)537worker2 # [ 0.030950] CPU topo: Max. threads per core: 1538worker1 # [ 0.068823] printk: legacy console [tty0] enabled539client # [ 0.068414] Console: colour VGA+ 80x25540lb # [ 0.030900] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)541worker2 # [ 0.030951] CPU topo: Num. cores per package: 1542worker1 # [ 0.098311] printk: legacy console [ttyS0] enabled543client # [ 0.068417] printk: legacy console [tty0] enabled544worker2 # [ 0.030951] CPU topo: Num. threads per package: 1545lb # [ 0.030900] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)546client # [ 0.097815] printk: legacy console [ttyS0] enabled547worker1 # [ 0.196696] ACPI: Core revision 20250807548worker2 # [ 0.030951] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs549lb # [ 0.030903] ACPI: Using ACPI (MADT) for SMP configuration information550client # [ 0.195943] ACPI: Core revision 20250807551lb # [ 0.030903] ACPI: HPET id: 0x8086a201 base: 0xfed00000552worker2 # [ 0.030971] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()553lb # [ 0.030907] TSC deadline timer available554worker1 # [ 0.197560] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns555worker2 # [ 0.031001] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]556lb # [ 0.030911] CPU topo: Max. logical packages: 1557client # [ 0.196844] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns558lb # [ 0.030911] CPU topo: Max. logical dies: 1559worker1 # [ 0.199128] APIC: Switch to symmetric I/O mode setup560worker2 # [ 0.031003] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]561lb # [ 0.030912] CPU topo: Max. dies per package: 1562client # [ 0.198329] APIC: Switch to symmetric I/O mode setup563worker1 # [ 0.200067] x2apic enabled564worker2 # [ 0.031004] [mem 0x60000000-0xafffffff] available for PCI devices565lb # [ 0.030915] CPU topo: Max. threads per core: 1566client # [ 0.199263] x2apic enabled567worker2 # [ 0.031006] Booting paravirtualized kernel on KVM568lb # [ 0.030916] CPU topo: Num. cores per package: 1569worker1 # [ 0.200814] APIC: Switched APIC routing to: physical x2apic570lb # [ 0.030916] CPU topo: Num. threads per package: 1571client # [ 0.200001] APIC: Switched APIC routing to: physical x2apic572worker2 # [ 0.031009] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns573lb # [ 0.030917] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs574worker2 # [ 0.035491] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1575lb # [ 0.030933] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()576worker1 # [ 0.202624] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1577client # [ 0.201811] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1578worker2 # [ 0.037518] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152579lb # [ 0.030963] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]580worker2 # [ 0.037561] kvm-guest: PV spinlocks disabled, single CPU581worker1 # [ 0.203601] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns582lb # [ 0.030965] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]583client # [ 0.202763] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns584lb # [ 0.030966] [mem 0x60000000-0xafffffff] available for PCI devices585lb # [ 0.030967] Booting paravirtualized kernel on KVM586worker1 # [ 0.205235] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)587client # [ 0.204367] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)588worker1 # [ 0.206319] x86/cpu: User Mode Instruction Prevention (UMIP) activated589lb # [ 0.030970] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns590client # [ 0.205449] x86/cpu: User Mode Instruction Prevention (UMIP) activated591worker2 # [ 0.037562] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x5qgax5h37ybfdjp7r7k01yx9abl6wij-nixos-system-worker2-test/init regInfo=/nix/store/dq71v172s5jppb7nnfi3vkq85w35rkbj-closure-info/registration console=ttyS0,115200n8 console=tty0592lb # [ 0.035440] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1593worker1 # [ 0.207369] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127594client # [ 0.206502] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127595lb # [ 0.037463] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152596worker1 # [ 0.208233] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0597lb # [ 0.037502] kvm-guest: PV spinlocks disabled, single CPU598worker2 # [ 0.037655] Unknown kernel command line parameters "regInfo=/nix/store/dq71v172s5jppb7nnfi3vkq85w35rkbj-closure-info/registration", will be passed to user space.599client # [ 0.207364] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0600worker2 # [ 0.037668] random: crng init done601worker1 # [ 0.209236] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto602worker2 # [ 0.037668] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes603client # [ 0.208367] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto604worker2 # [ 0.039677] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)605worker1 # [ 0.210232] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl606worker2 # [ 0.040688] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)607client # [ 0.209364] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl608lb # [ 0.037503] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xzrwmx591i25vlijx1m7lk76hjmbxra6-nixos-system-lb-test/init regInfo=/nix/store/5b1jdrkcd54zycf7j131lh8wai3gzg44-closure-info/registration console=ttyS0,115200n8 console=tty0609worker2 # [ 0.040718] Fallback order for Node 0: 0610worker1 # [ 0.211232] Transient Scheduler Attacks: Vulnerable: No microcode611client # [ 0.210364] Transient Scheduler Attacks: Vulnerable: No microcode612worker2 # [ 0.040720] Built 1 zonelists, mobility grouping on. Total pages: 393078613worker1 # [ 0.212232] Spectre V2 : Mitigation: Enhanced / Automatic IBRS614worker2 # [ 0.040721] Policy zone: DMA32615client # [ 0.211363] Spectre V2 : Mitigation: Enhanced / Automatic IBRS616lb # [ 0.037592] Unknown kernel command line parameters "regInfo=/nix/store/5b1jdrkcd54zycf7j131lh8wai3gzg44-closure-info/registration", will be passed to user space.617worker2 # [ 0.043215] mem auto-init: stack:all(zero), heap alloc:on, heap free:off618worker1 # [ 0.213232] Speculative Return Stack Overflow: Mitigation: Safe RET619lb # [ 0.037605] random: crng init done620client # [ 0.212364] Speculative Return Stack Overflow: Mitigation: Safe RET621worker2 # [ 0.046262] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1622lb # [ 0.037606] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes623worker2 # [ 0.049429] allocated 3145728 bytes of page_ext624lb # [ 0.039600] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)625worker2 # [ 0.059144] ftrace: allocating 48731 entries in 192 pages626worker2 # [ 0.059146] ftrace: allocated 192 pages with 2 groups627lb # [ 0.040752] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)628worker2 # [ 0.059944] Dynamic Preempt: lazy629lb # [ 0.040782] Fallback order for Node 0: 0630worker2 # [ 0.060094] rcu: Preemptible hierarchical RCU implementation.631worker1 # [ 0.214232] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization632worker2 # [ 0.060094] rcu: RCU event tracing is enabled.633lb # [ 0.040784] Built 1 zonelists, mobility grouping on. Total pages: 393078634client # [ 0.213364] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization635lb # [ 0.040785] Policy zone: DMA32636worker1 # [ 0.216240] Spectre V2 : Enabling IBPB for BPF637worker2 # [ 0.060095] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.638client # [ 0.215373] Spectre V2 : Enabling IBPB for BPF639lb # [ 0.043121] mem auto-init: stack:all(zero), heap alloc:on, heap free:off640worker2 # [ 0.060096] Trampoline variant of Tasks RCU enabled.641worker2 # [ 0.060097] Rude variant of Tasks RCU enabled.642lb # [ 0.047122] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1643worker1 # [ 0.217233] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier644client # [ 0.216364] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier645worker2 # [ 0.060097] Tracing variant of Tasks RCU enabled.646lb # [ 0.050277] allocated 3145728 bytes of page_ext647worker1 # [ 0.218232] active return thunk: srso_alias_return_thunk648lb # [ 0.059935] ftrace: allocating 48731 entries in 192 pages649client # [ 0.217364] active return thunk: srso_alias_return_thunk650worker2 # [ 0.060098] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.651lb # [ 0.059938] ftrace: allocated 192 pages with 2 groups652lb # [ 0.060740] Dynamic Preempt: lazy653worker2 # [ 0.060099] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1654worker1 # [ 0.219254] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'655client # [ 0.218385] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'656lb # [ 0.060899] rcu: Preemptible hierarchical RCU implementation.657worker2 # [ 0.060119] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.658lb # [ 0.060900] rcu: RCU event tracing is enabled.659worker1 # [ 0.220232] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'660client # [ 0.219363] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'661lb # [ 0.060901] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.662worker2 # [ 0.060120] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.663worker1 # [ 0.221960] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'664client # [ 0.220364] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'665lb # [ 0.060902] Trampoline variant of Tasks RCU enabled.666lb # [ 0.060902] Rude variant of Tasks RCU enabled.667worker1 # [ 0.222954] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'668worker2 # [ 0.060121] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.669client # [ 0.221363] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'670lb # [ 0.060903] Tracing variant of Tasks RCU enabled.671worker2 # [ 0.064405] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16672worker1 # [ 0.223232] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'673client # [ 0.222363] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'674lb # [ 0.060903] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.675worker2 # [ 0.064674] rcu: srcu_init: Setting srcu_struct sizes based on contention.676lb # [ 0.060904] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1677client # [ 0.223363] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'678worker1 # [ 0.224961] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'679worker2 # [ 0.064680] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns680lb # [ 0.060924] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.681worker1 # [ 0.226000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'682client # [ 0.224363] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'683worker2 # [ 0.064781] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)684lb # [ 0.060926] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.685worker1 # [ 0.227120] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256686client # [ 0.225364] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256687worker2 # [ 0.068303] Console: colour VGA+ 80x25688worker2 # [ 0.068306] printk: legacy console [tty0] enabled689lb # [ 0.060927] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.690client # [ 0.226363] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64691worker2 # [ 0.097786] printk: legacy console [ttyS0] enabled692worker1 # [ 0.227930] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64693lb # [ 0.065204] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16694worker2 # [ 0.193178] ACPI: Core revision 20250807695worker1 # [ 0.228924] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512696client # [ 0.227363] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512697lb # [ 0.065485] rcu: srcu_init: Setting srcu_struct sizes based on contention.698worker1 # [ 0.229920] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024699client # [ 0.228363] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024700worker2 # [ 0.194108] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns701lb # [ 0.065491] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns702worker1 # [ 0.230956] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8703client # [ 0.229363] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8704worker2 # [ 0.195587] APIC: Switch to symmetric I/O mode setup705lb # [ 0.065597] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)706worker2 # [ 0.196561] x2apic enabled707lb # [ 0.069112] Console: colour VGA+ 80x25708worker1 # [ 0.231933] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.709client # [ 0.230363] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.710lb # [ 0.069115] printk: legacy console [tty0] enabled711worker2 # [ 0.197328] APIC: Switched APIC routing to: physical x2apic712lb # [ 0.098538] printk: legacy console [ttyS0] enabled713lb # [ 0.193946] ACPI: Core revision 20250807714worker2 # [ 0.199124] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1715lb # [ 0.194843] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns716worker2 # [ 0.200096] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns717lb # [ 0.196439] APIC: Switch to symmetric I/O mode setup718lb # [ 0.197403] x2apic enabled719worker2 # [ 0.201739] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)720lb # [ 0.198185] APIC: Switched APIC routing to: physical x2apic721worker2 # [ 0.202823] x86/cpu: User Mode Instruction Prevention (UMIP) activated722worker2 # [ 0.203867] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127723lb # [ 0.199988] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1724worker2 # [ 0.204736] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0725lb # [ 0.200992] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns726worker2 # [ 0.205739] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto727lb # [ 0.202741] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)728worker2 # [ 0.207736] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl729lb # [ 0.203824] x86/cpu: User Mode Instruction Prevention (UMIP) activated730worker2 # [ 0.208736] Transient Scheduler Attacks: Vulnerable: No microcode731lb # [ 0.205764] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127732worker2 # [ 0.209736] Spectre V2 : Mitigation: Enhanced / Automatic IBRS733lb # [ 0.206693] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0734worker2 # [ 0.210735] Speculative Return Stack Overflow: Mitigation: Safe RET735lb # [ 0.207535] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto736lb # [ 0.208738] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl737worker2 # [ 0.211735] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization738lb # [ 0.210738] Transient Scheduler Attacks: Vulnerable: No microcode739worker2 # [ 0.213743] Spectre V2 : Enabling IBPB for BPF740lb # [ 0.211738] Spectre V2 : Mitigation: Enhanced / Automatic IBRS741lb # [ 0.212738] Speculative Return Stack Overflow: Mitigation: Safe RET742worker2 # [ 0.214737] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier743worker2 # [ 0.215736] active return thunk: srso_alias_return_thunk744worker2 # [ 0.216757] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'745worker2 # [ 0.217735] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'746lb # [ 0.213738] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization747worker2 # [ 0.218735] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'748lb # [ 0.215746] Spectre V2 : Enabling IBPB for BPF749worker2 # [ 0.219735] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750lb # [ 0.216486] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier751worker2 # [ 0.220735] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'752lb # [ 0.217738] active return thunk: srso_alias_return_thunk753worker2 # [ 0.221735] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'754lb # [ 0.218760] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'755worker2 # [ 0.222735] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'756lb # [ 0.219738] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'757worker2 # [ 0.224641] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256758worker2 # [ 0.225452] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64759lb # [ 0.220738] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'760worker2 # [ 0.226451] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512761lb # [ 0.221738] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'762worker2 # [ 0.227449] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024763lb # [ 0.222738] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'764client # [ 0.264752] Freeing SMP alternatives memory: 44K765worker1 # [ 0.266196] Freeing SMP alternatives memory: 44K766worker2 # [ 0.228453] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8767worker1 # [ 0.266767] pid_max: default: 32768 minimum: 301768lb # [ 0.223738] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'769client # [ 0.265366] pid_max: default: 32768 minimum: 301770client # [ 0.266163] LSM: initializing lsm=capability,landlock,yama,bpf,ima771worker1 # [ 0.267331] LSM: initializing lsm=capability,landlock,yama,bpf,ima772lb # [ 0.224738] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'773worker2 # [ 0.228739] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.774client # [ 0.267392] landlock: Up and running.775worker1 # [ 0.268338] landlock: Up and running.776lb # [ 0.225739] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256777client # [ 0.267990] Yama: becoming mindful.778worker1 # [ 0.269233] Yama: becoming mindful.779client # [ 0.268574] LSM support for eBPF active780lb # [ 0.227449] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64781worker1 # [ 0.270403] LSM support for eBPF active782lb # [ 0.227738] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512783client # [ 0.269465] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)784worker1 # [ 0.271143] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)785lb # [ 0.228738] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024786client # [ 0.270405] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)787worker1 # [ 0.272271] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)788lb # [ 0.229738] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8789lb # [ 0.230738] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.790client # [ 0.272929] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)791worker1 # [ 0.274703] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)792client # [ 0.273877] Performance Events: Fam17h+ core perfctr, AMD PMU driver.793worker1 # [ 0.275765] Performance Events: Fam17h+ core perfctr, AMD PMU driver.794client # [ 0.274378] ... version: 2795worker1 # [ 0.276241] ... version: 2796client # [ 0.275131] ... bit width: 48797worker1 # [ 0.276983] ... bit width: 48798client # [ 0.275366] ... generic counters: 6799worker1 # [ 0.277234] ... generic counters: 6800client # [ 0.276091] ... generic bitmap: 000000000000003f801worker1 # [ 0.277942] ... generic bitmap: 000000000000003f802client # [ 0.276367] ... fixed-purpose counters: 0803worker1 # [ 0.278235] ... fixed-purpose counters: 0804client # [ 0.277118] ... fixed-purpose bitmap: 0000000000000000805worker1 # [ 0.278980] ... fixed-purpose bitmap: 0000000000000000806client # [ 0.277366] ... value mask: 0000ffffffffffff807worker1 # [ 0.279234] ... value mask: 0000ffffffffffff808client # [ 0.278283] ... max period: 00007fffffffffff809worker1 # [ 0.280163] ... max period: 00007fffffffffff810client # [ 0.279067] ... global_ctrl mask: 000000000000003f811worker1 # [ 0.280927] ... global_ctrl mask: 000000000000003f812client # [ 0.279476] signal: max sigframe size: 3376813worker1 # [ 0.281351] signal: max sigframe size: 3376814client # [ 0.280272] rcu: Hierarchical SRCU implementation.815worker1 # [ 0.282183] rcu: Hierarchical SRCU implementation.816client # [ 0.280959] rcu: Max phase no-delay instances is 400.817worker1 # [ 0.282820] rcu: Max phase no-delay instances is 400.818client # [ 0.285790] smp: Bringing up secondary CPUs ...819worker1 # [ 0.287833] smp: Bringing up secondary CPUs ...820client # [ 0.286380] smp: Brought up 1 node, 1 CPU821worker1 # [ 0.288261] smp: Brought up 1 node, 1 CPU822client # [ 0.287041] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)823worker1 # [ 0.288939] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)824client # [ 0.287622] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)825worker1 # [ 0.289374] Memory: 1454584K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)826client # [ 0.288761] devtmpfs: initialized827worker1 # [ 0.290530] devtmpfs: initialized828client # [ 0.289562] x86/mm: Memory block size: 128MB829worker1 # [ 0.291431] x86/mm: Memory block size: 128MB830client # [ 0.291295] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)831worker1 # [ 0.293227] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)832worker2 # [ 0.263739] Freeing SMP alternatives memory: 44K833client # [ 0.292299] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).834worker1 # [ 0.294262] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).835worker2 # [ 0.264488] pid_max: default: 32768 minimum: 301836client # [ 0.293453] pinctrl core: initialized pinctrl subsystem837worker1 # [ 0.295322] pinctrl core: initialized pinctrl subsystem838worker2 # [ 0.264841] LSM: initializing lsm=capability,landlock,yama,bpf,ima839client # [ 0.294575] PM: RTC time: 10:51:07, date: 2026-09-20840worker2 # [ 0.265849] landlock: Up and running.841worker1 # [ 0.296439] PM: RTC time: 10:51:07, date: 2026-09-20842worker2 # [ 0.266736] Yama: becoming mindful.843worker2 # [ 0.267889] LSM support for eBPF active844worker2 # [ 0.268668] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)845lb # [ 0.263875] Freeing SMP alternatives memory: 44K846client # [ 0.297940] NET: Registered PF_NETLINK/PF_ROUTE protocol family847lb # [ 0.264645] pid_max: default: 32768 minimum: 301848worker1 # [ 0.300007] NET: Registered PF_NETLINK/PF_ROUTE protocol family849worker2 # [ 0.269773] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)850client # [ 0.298842] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations851lb # [ 0.265356] LSM: initializing lsm=capability,landlock,yama,bpf,ima852worker1 # [ 0.301407] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations853lb # [ 0.265835] landlock: Up and running.854client # [ 0.299388] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations855lb # [ 0.266739] Yama: becoming mindful.856worker2 # [ 0.272082] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)857worker1 # [ 0.302254] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations858lb # [ 0.267927] LSM support for eBPF active859client # [ 0.300626] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations860worker2 # [ 0.273282] Performance Events: Fam17h+ core perfctr, AMD PMU driver.861lb # [ 0.268647] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)862worker1 # [ 0.303495] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations863client # [ 0.301377] audit: initializing netlink subsys (disabled)864worker2 # [ 0.273744] ... version: 2865worker1 # [ 0.304245] audit: initializing netlink subsys (disabled)866lb # [ 0.269772] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)867worker2 # [ 0.274421] ... bit width: 48868client # [ 0.302487] thermal_sys: Registered thermal governor 'fair_share'869worker2 # [ 0.274738] ... generic counters: 6870worker1 # [ 0.305358] thermal_sys: Registered thermal governor 'fair_share'871client # [ 0.302490] thermal_sys: Registered thermal governor 'bang_bang'872worker2 # [ 0.275411] ... generic bitmap: 000000000000003f873worker1 # [ 0.305361] thermal_sys: Registered thermal governor 'bang_bang'874client # [ 0.303367] thermal_sys: Registered thermal governor 'step_wise'875worker2 # [ 0.275738] ... fixed-purpose counters: 0876lb # [ 0.272003] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)877worker1 # [ 0.306236] thermal_sys: Registered thermal governor 'step_wise'878client # [ 0.304266] thermal_sys: Registered thermal governor 'user_space'879worker2 # [ 0.276403] ... fixed-purpose bitmap: 0000000000000000880worker1 # [ 0.307154] thermal_sys: Registered thermal governor 'user_space'881lb # [ 0.273263] Performance Events: Fam17h+ core perfctr, AMD PMU driver.882worker2 # [ 0.276738] ... value mask: 0000ffffffffffff883client # [ 0.305091] audit: type=2000 audit(1789901468.561:1): state=initialized audit_enabled=0 res=1884lb # [ 0.273747] ... version: 2885worker2 # [ 0.277574] ... max period: 00007fffffffffff886worker1 # [ 0.307962] audit: type=2000 audit(1789901468.561:1): state=initialized audit_enabled=0 res=1887lb # [ 0.274406] ... bit width: 48888client # [ 0.306369] thermal_sys: Registered thermal governor 'power_allocator'889worker2 # [ 0.278371] ... global_ctrl mask: 000000000000003f890client # [ 0.306383] cpuidle: using governor menu891lb # [ 0.274741] ... generic counters: 6892worker1 # [ 0.309238] thermal_sys: Registered thermal governor 'power_allocator'893worker2 # [ 0.278842] signal: max sigframe size: 3376894lb # [ 0.275417] ... generic bitmap: 000000000000003f895worker1 # [ 0.309253] cpuidle: using governor menu896worker2 # [ 0.279618] rcu: Hierarchical SRCU implementation.897client # [ 0.308353] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5898lb # [ 0.275740] ... fixed-purpose counters: 0899worker2 # [ 0.280285] rcu: Max phase no-delay instances is 400.900lb # [ 0.276463] ... fixed-purpose bitmap: 0000000000000000901worker1 # [ 0.311489] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5902client # [ 0.309373] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]903lb # [ 0.276740] ... value mask: 0000ffffffffffff904client # [ 0.310369] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry905worker1 # [ 0.312477] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]906lb # [ 0.277601] ... max period: 00007fffffffffff907lb # [ 0.278383] ... global_ctrl mask: 000000000000003f908client # [ 0.311378] PCI: Using configuration type 1 for base access909worker1 # [ 0.313238] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry910lb # [ 0.278856] signal: max sigframe size: 3376911worker1 # [ 0.314247] PCI: Using configuration type 1 for base access912client # [ 0.312462] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.913lb # [ 0.279650] rcu: Hierarchical SRCU implementation.914worker2 # [ 0.285241] smp: Bringing up secondary CPUs ...915lb # [ 0.280309] rcu: Max phase no-delay instances is 400.916worker1 # [ 0.315425] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.917worker2 # [ 0.285750] smp: Brought up 1 node, 1 CPU918worker2 # [ 0.286395] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)919worker2 # [ 0.286872] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)920client # [ 0.317581] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages921worker2 # [ 0.287983] devtmpfs: initialized922lb # [ 0.285148] smp: Bringing up secondary CPUs ...923worker1 # [ 0.320319] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages924client # [ 0.318367] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page925worker2 # [ 0.288726] x86/mm: Memory block size: 128MB926lb # [ 0.285754] smp: Brought up 1 node, 1 CPU927worker1 # [ 0.321236] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page928lb # [ 0.286402] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)929worker2 # [ 0.290388] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)930lb # [ 0.286854] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)931worker2 # [ 0.290761] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).932lb # [ 0.287965] devtmpfs: initialized933worker2 # [ 0.291914] pinctrl core: initialized pinctrl subsystem934client # [ 0.323368] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages935lb # [ 0.288746] x86/mm: Memory block size: 128MB936client # [ 0.324366] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page937worker2 # [ 0.293032] PM: RTC time: 10:51:07, date: 2026-09-20938worker1 # [ 0.326236] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages939worker1 # [ 0.327234] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page940lb # [ 0.290468] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)941lb # [ 0.291660] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).942worker2 # [ 0.296294] NET: Registered PF_NETLINK/PF_ROUTE protocol family943lb # [ 0.292982] pinctrl core: initialized pinctrl subsystem944lb # [ 0.294053] PM: RTC time: 10:51:07, date: 2026-09-20945worker2 # [ 0.297232] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations946worker2 # [ 0.297760] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations947worker2 # [ 0.299002] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations948lb # [ 0.297327] NET: Registered PF_NETLINK/PF_ROUTE protocol family949worker2 # [ 0.299748] audit: initializing netlink subsys (disabled)950worker2 # [ 0.300848] thermal_sys: Registered thermal governor 'fair_share'951client # [ 0.334814] ACPI: Added _OSI(Module Device)952lb # [ 0.298206] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations953client # [ 0.335368] ACPI: Added _OSI(Processor Device)954worker2 # [ 0.300850] thermal_sys: Registered thermal governor 'bang_bang'955worker1 # [ 0.337587] ACPI: Added _OSI(Module Device)956lb # [ 0.298759] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations957client # [ 0.336081] ACPI: Added _OSI(Processor Aggregator Device)958worker1 # [ 0.338236] ACPI: Added _OSI(Processor Device)959worker2 # [ 0.301739] thermal_sys: Registered thermal governor 'step_wise'960worker1 # [ 0.338987] ACPI: Added _OSI(Processor Aggregator Device)961worker2 # [ 0.302624] thermal_sys: Registered thermal governor 'user_space'962lb # [ 0.300002] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations963lb # [ 0.300750] audit: initializing netlink subsys (disabled)964worker2 # [ 0.303441] audit: type=2000 audit(1789901468.598:1): state=initialized audit_enabled=0 res=1965lb # [ 0.301743] audit: type=2000 audit(1789901468.604:1): state=initialized audit_enabled=0 res=1966worker2 # [ 0.304743] thermal_sys: Registered thermal governor 'power_allocator'967worker2 # [ 0.304758] cpuidle: using governor menu968lb # [ 0.302888] thermal_sys: Registered thermal governor 'fair_share'969lb # [ 0.302890] thermal_sys: Registered thermal governor 'bang_bang'970worker2 # [ 0.306962] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5971lb # [ 0.303742] thermal_sys: Registered thermal governor 'step_wise'972worker2 # [ 0.307973] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]973lb # [ 0.304721] thermal_sys: Registered thermal governor 'user_space'974lb # [ 0.305525] thermal_sys: Registered thermal governor 'power_allocator'975worker2 # [ 0.308741] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry976lb # [ 0.306497] cpuidle: using governor menu977worker2 # [ 0.309751] PCI: Using configuration type 1 for base access978client # [ 0.344982] ACPI: 1 ACPI AML tables successfully acquired and loaded979worker1 # [ 0.347553] ACPI: 1 ACPI AML tables successfully acquired and loaded980lb # [ 0.307929] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5981worker2 # [ 0.310810] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.982lb # [ 0.308952] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]983lb # [ 0.309743] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry984client # [ 0.348801] ACPI: Interpreter enabled985client # [ 0.349382] ACPI: PM: (supports S0 S3 S4 S5)986worker1 # [ 0.351652] ACPI: Interpreter enabled987lb # [ 0.310753] PCI: Using configuration type 1 for base access988worker1 # [ 0.352252] ACPI: PM: (supports S0 S3 S4 S5)989client # [ 0.350062] ACPI: Using IOAPIC for interrupt routing990worker1 # [ 0.352954] ACPI: Using IOAPIC for interrupt routing991lb # [ 0.311842] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.992worker2 # [ 0.315966] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages993client # [ 0.350418] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug994worker2 # [ 0.316739] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page995client # [ 0.351367] PCI: Using E820 reservations for host bridge windows996worker1 # [ 0.355303] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug997worker1 # [ 0.356236] PCI: Using E820 reservations for host bridge windows998client # [ 0.354467] ACPI: Enabled 2 GPEs in block 00 to 3F999lb # [ 0.316818] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1000lb # [ 0.317742] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1001worker2 # [ 0.321739] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1002worker1 # [ 0.359364] ACPI: Enabled 2 GPEs in block 00 to 3F1003worker2 # [ 0.322738] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1004lb # [ 0.322742] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1005lb # [ 0.323741] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1006client # [ 0.363109] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1007client # [ 0.363373] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1008worker1 # [ 0.367094] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1009client # [ 0.364897] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1010worker1 # [ 0.368029] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1011worker2 # [ 0.333126] ACPI: Added _OSI(Module Device)1012client # [ 0.365490] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1013worker1 # [ 0.369315] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1014worker2 # [ 0.333740] ACPI: Added _OSI(Processor Device)1015client # [ 0.366709] PCI host bridge to bus 0000:001016worker2 # [ 0.334467] ACPI: Added _OSI(Processor Aggregator Device)1017worker1 # [ 0.370371] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1018client # [ 0.367370] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1019worker1 # [ 0.371618] PCI host bridge to bus 0000:001020client # [ 0.368366] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1021worker1 # [ 0.372240] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1022client # [ 0.369366] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1023lb # [ 0.334111] ACPI: Added _OSI(Module Device)1024worker1 # [ 0.373235] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1025lb # [ 0.334742] ACPI: Added _OSI(Processor Device)1026client # [ 0.370366] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1027worker1 # [ 0.374235] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1028lb # [ 0.335476] ACPI: Added _OSI(Processor Aggregator Device)1029client # [ 0.371366] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1030worker1 # [ 0.375236] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1031client # [ 0.372366] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1032worker1 # [ 0.376235] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1033client # [ 0.373367] pci_bus 0000:00: root bus resource [bus 00-ff]1034worker1 # [ 0.377240] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1035client # [ 0.374366] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1036worker1 # [ 0.378237] pci_bus 0000:00: root bus resource [bus 00-ff]1037worker2 # [ 0.343269] ACPI: 1 ACPI AML tables successfully acquired and loaded1038worker1 # [ 0.379204] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1039client # [ 0.375830] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1040worker1 # [ 0.380727] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1041worker2 # [ 0.347145] ACPI: Interpreter enabled1042lb # [ 0.343920] ACPI: 1 ACPI AML tables successfully acquired and loaded1043worker2 # [ 0.347754] ACPI: PM: (supports S0 S3 S4 S5)1044worker2 # [ 0.348472] ACPI: Using IOAPIC for interrupt routing1045worker2 # [ 0.348802] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1046worker2 # [ 0.349739] PCI: Using E820 reservations for host bridge windows1047client # [ 0.378403] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1048lb # [ 0.348152] ACPI: Interpreter enabled1049client # [ 0.379380] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1050lb # [ 0.348757] ACPI: PM: (supports S0 S3 S4 S5)1051worker1 # [ 0.383282] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1052lb # [ 0.349466] ACPI: Using IOAPIC for interrupt routing1053client # [ 0.380389] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1054worker1 # [ 0.384247] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1055worker2 # [ 0.352837] ACPI: Enabled 2 GPEs in block 00 to 3F1056worker1 # [ 0.385214] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1057client # [ 0.381694] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1058worker1 # [ 0.386213] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1059lb # [ 0.351784] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1060client # [ 0.383083] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1061lb # [ 0.352741] PCI: Using E820 reservations for host bridge windows1062worker1 # [ 0.388035] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1063client # [ 0.386392] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1064lb # [ 0.355837] ACPI: Enabled 2 GPEs in block 00 to 3F1065client # [ 0.387237] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1066worker1 # [ 0.391269] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1067client # [ 0.388111] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1068worker1 # [ 0.392115] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1069worker2 # [ 0.361660] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1070client # [ 0.388372] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1071worker1 # [ 0.393008] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1072worker2 # [ 0.362481] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1073worker1 # [ 0.394097] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1074client # [ 0.389902] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1075worker2 # [ 0.364253] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1076worker1 # [ 0.395598] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1077worker2 # [ 0.364864] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1078lb # [ 0.363332] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1079worker2 # [ 0.366082] PCI host bridge to bus 0000:001080client # [ 0.392391] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1081worker2 # [ 0.366742] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1082client # [ 0.393234] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1083lb # [ 0.363748] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1084client # [ 0.394073] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1085worker2 # [ 0.367739] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1086lb # [ 0.364820] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1087worker1 # [ 0.398270] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1088worker1 # [ 0.399154] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1089worker2 # [ 0.368739] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1090lb # [ 0.365862] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1091client # [ 0.394901] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1092worker1 # [ 0.399956] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1093worker2 # [ 0.369739] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1094lb # [ 0.367096] PCI host bridge to bus 0000:001095lb # [ 0.367745] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1096worker2 # [ 0.370739] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1097worker1 # [ 0.400827] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1098lb # [ 0.368741] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1099worker2 # [ 0.371739] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1100client # [ 0.397392] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1101worker2 # [ 0.372739] pci_bus 0000:00: root bus resource [bus 00-ff]1102lb # [ 0.369741] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1103worker1 # [ 0.403153] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1104client # [ 0.398235] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1105lb # [ 0.370741] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1106worker2 # [ 0.373725] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1107worker1 # [ 0.403865] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1108client # [ 0.399388] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1109lb # [ 0.371741] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1110worker2 # [ 0.375167] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1111lb # [ 0.372741] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1112client # [ 0.400933] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1113worker1 # [ 0.404258] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1114lb # [ 0.373753] pci_bus 0000:00: root bus resource [bus 00-ff]1115lb # [ 0.374734] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1116worker1 # [ 0.405828] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117client # [ 0.403112] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1118client # [ 0.403373] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1119lb # [ 0.376192] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1120client # [ 0.404389] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1121worker1 # [ 0.408131] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1122worker1 # [ 0.408908] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1123worker2 # [ 0.377795] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1124worker1 # [ 0.409257] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1125worker2 # [ 0.378750] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1126client # [ 0.405906] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1127worker2 # [ 0.379693] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1128worker1 # [ 0.410776] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1129worker2 # [ 0.380671] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1130client # [ 0.408158] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1131lb # [ 0.378763] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1132client # [ 0.409035] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1133worker2 # [ 0.382564] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1134lb # [ 0.379753] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1135client # [ 0.409388] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1136worker1 # [ 0.413268] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1137lb # [ 0.380686] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1138worker1 # [ 0.414095] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1139client # [ 0.410964] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1140lb # [ 0.381795] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1141worker1 # [ 0.415001] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1142worker2 # [ 0.384755] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1143worker2 # [ 0.385570] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1144worker1 # [ 0.416628] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1145worker2 # [ 0.386456] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1146lb # [ 0.383652] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1147client # [ 0.413391] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1148worker2 # [ 0.386745] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1149worker1 # [ 0.419102] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1150lb # [ 0.385748] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1151worker2 # [ 0.388255] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1152client # [ 0.414259] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1153worker1 # [ 0.419871] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1154lb # [ 0.386555] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1155client # [ 0.415092] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1156lb # [ 0.387453] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1157worker1 # [ 0.420257] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1158lb # [ 0.387747] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1159client # [ 0.415907] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1160worker2 # [ 0.390747] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1161worker2 # [ 0.391602] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1162worker1 # [ 0.421812] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1163lb # [ 0.389228] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1164client # [ 0.418049] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1165worker2 # [ 0.392432] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1166client # [ 0.418373] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1167worker1 # [ 0.424021] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1168client # [ 0.419381] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1169worker2 # [ 0.393283] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1170lb # [ 0.391759] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1171worker1 # [ 0.424872] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1172client # [ 0.420372] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1173lb # [ 0.392568] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1174worker1 # [ 0.425256] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1175lb # [ 0.393464] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1176worker2 # [ 0.395734] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1177worker1 # [ 0.426242] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1178worker2 # [ 0.396561] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1179client # [ 0.421931] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1180lb # [ 0.394371] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1181worker1 # [ 0.427738] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1182worker2 # [ 0.397456] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1183client # [ 0.424379] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1184lb # [ 0.395749] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1185client # [ 0.425333] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1186worker2 # [ 0.398305] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1187worker1 # [ 0.429876] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1188lb # [ 0.396593] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1189worker1 # [ 0.430258] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1190client # [ 0.426757] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1191lb # [ 0.397463] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1192worker2 # [ 0.400545] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1193worker1 # [ 0.431790] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1194worker2 # [ 0.401375] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1195client # [ 0.428400] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1196lb # [ 0.398288] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1197worker2 # [ 0.401760] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1198client # [ 0.429257] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1199worker1 # [ 0.433254] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1200lb # [ 0.399757] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1201worker2 # [ 0.403285] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1202worker1 # [ 0.434125] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1203client # [ 0.430121] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1204lb # [ 0.400591] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1205worker1 # [ 0.434940] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1206lb # [ 0.401452] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1207client # [ 0.430916] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1208lb # [ 0.402278] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1209worker1 # [ 0.436693] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1210worker2 # [ 0.405745] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1211client # [ 0.433046] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1212worker2 # [ 0.407369] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1213client # [ 0.433373] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1214worker2 # [ 0.407760] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1215client # [ 0.434354] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1216worker1 # [ 0.438989] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1217lb # [ 0.403748] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1218worker1 # [ 0.439243] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1219lb # [ 0.405372] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1220worker2 # [ 0.409371] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1221client # [ 0.435798] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1222worker1 # [ 0.440203] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1223lb # [ 0.405762] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1224worker1 # [ 0.441727] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1225worker2 # [ 0.411656] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1226lb # [ 0.407313] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1227client # [ 0.437047] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1228worker2 # [ 0.412356] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1229client # [ 0.437581] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1230worker2 # [ 0.412761] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1231worker1 # [ 0.442928] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1232lb # [ 0.408758] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1233client # [ 0.439178] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1234lb # [ 0.409631] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1235worker1 # [ 0.443509] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1236lb # [ 0.410476] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1237worker2 # [ 0.414277] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1238worker1 # [ 0.445125] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1239worker2 # [ 0.416754] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1240lb # [ 0.411314] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1241worker2 # [ 0.417627] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1242worker2 # [ 0.418538] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1243lb # [ 0.412750] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1244worker2 # [ 0.419637] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1245lb # [ 0.413604] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1246lb # [ 0.414486] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1247worker2 # [ 0.421164] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1248lb # [ 0.414746] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1249lb # [ 0.416266] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1250worker2 # [ 0.422758] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1251client # [ 0.440213] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1252worker2 # [ 0.424529] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1253lb # [ 0.417764] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1254client # [ 0.442123] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1255lb # [ 0.418774] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1256worker2 # [ 0.426135] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1257worker1 # [ 0.446120] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1258client # [ 0.442658] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1259lb # [ 0.420280] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1260worker1 # [ 0.448001] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1261worker2 # [ 0.428479] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1262client # [ 0.444110] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1263worker1 # [ 0.448507] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1264worker2 # [ 0.428745] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1265lb # [ 0.421758] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1266client # [ 0.445276] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1267worker2 # [ 0.429682] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1268lb # [ 0.422603] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1269worker1 # [ 0.449862] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1270lb # [ 0.423440] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1271client # [ 0.446609] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1272worker1 # [ 0.450511] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1273worker2 # [ 0.431114] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1274client # [ 0.447631] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1275lb # [ 0.424283] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1276worker1 # [ 0.451525] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1277client # [ 0.449394] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1278worker2 # [ 0.433422] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1279worker1 # [ 0.452534] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1280client # [ 0.450236] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1281worker2 # [ 0.433746] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1282lb # [ 0.426777] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1283lb # [ 0.427619] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1284worker2 # [ 0.434694] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1285client # [ 0.451389] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1286worker1 # [ 0.454263] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1287lb # [ 0.428512] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1288worker1 # [ 0.455108] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1289worker2 # [ 0.436132] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1290client # [ 0.453758] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1291lb # [ 0.430178] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1292worker2 # [ 0.437466] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1293worker1 # [ 0.456329] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1294lb # [ 0.431353] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1295worker2 # [ 0.437937] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1296worker1 # [ 0.458034] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1297lb # [ 0.431936] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1298client # [ 0.457301] ACPI: PCI: Interrupt link LNKA configured for IRQ 101299lb # [ 0.433362] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1300client # [ 0.458239] ACPI: PCI: Interrupt link LNKB configured for IRQ 101301worker2 # [ 0.440221] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1302client # [ 0.459196] ACPI: PCI: Interrupt link LNKC configured for IRQ 111303worker1 # [ 0.461958] ACPI: PCI: Interrupt link LNKA configured for IRQ 101304client # [ 0.460256] ACPI: PCI: Interrupt link LNKD configured for IRQ 111305worker1 # [ 0.462339] ACPI: PCI: Interrupt link LNKB configured for IRQ 101306client # [ 0.461242] ACPI: PCI: Interrupt link LNKE configured for IRQ 101307worker1 # [ 0.463337] ACPI: PCI: Interrupt link LNKC configured for IRQ 111308client # [ 0.462229] ACPI: PCI: Interrupt link LNKF configured for IRQ 101309worker1 # [ 0.464335] ACPI: PCI: Interrupt link LNKD configured for IRQ 111310client # [ 0.463473] ACPI: PCI: Interrupt link LNKG configured for IRQ 111311worker1 # [ 0.465365] ACPI: PCI: Interrupt link LNKE configured for IRQ 101312client # [ 0.464463] ACPI: PCI: Interrupt link LNKH configured for IRQ 111313worker1 # [ 0.466336] ACPI: PCI: Interrupt link LNKF configured for IRQ 101314client # [ 0.465403] ACPI: PCI: Interrupt link GSIA configured for IRQ 161315worker1 # [ 0.467338] ACPI: PCI: Interrupt link LNKG configured for IRQ 111316client # [ 0.466381] ACPI: PCI: Interrupt link GSIB configured for IRQ 171317worker1 # [ 0.468332] ACPI: PCI: Interrupt link LNKH configured for IRQ 111318client # [ 0.467340] ACPI: PCI: Interrupt link GSIC configured for IRQ 181319worker1 # [ 0.469279] ACPI: PCI: Interrupt link GSIA configured for IRQ 161320client # [ 0.468139] ACPI: PCI: Interrupt link GSID configured for IRQ 191321worker1 # [ 0.470249] ACPI: PCI: Interrupt link GSIB configured for IRQ 171322client # [ 0.468378] ACPI: PCI: Interrupt link GSIE configured for IRQ 201323client # [ 0.469324] ACPI: PCI: Interrupt link GSIF configured for IRQ 211324worker1 # [ 0.471221] ACPI: PCI: Interrupt link GSIC configured for IRQ 181325worker2 # [ 0.440940] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1326lb # [ 0.434630] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1327worker1 # [ 0.471958] ACPI: PCI: Interrupt link GSID configured for IRQ 191328client # [ 0.470082] ACPI: PCI: Interrupt link GSIG configured for IRQ 221329worker2 # [ 0.443465] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1330worker1 # [ 0.472248] ACPI: PCI: Interrupt link GSIE configured for IRQ 201331client # [ 0.470378] ACPI: PCI: Interrupt link GSIH configured for IRQ 231332worker1 # [ 0.473204] ACPI: PCI: Interrupt link GSIF configured for IRQ 211333worker2 # [ 0.444019] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1334lb # [ 0.437353] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1335client # [ 0.472414] iommu: Default domain type: Translated1336worker1 # [ 0.474056] ACPI: PCI: Interrupt link GSIG configured for IRQ 221337client # [ 0.473195] iommu: DMA domain TLB invalidation policy: lazy mode1338worker1 # [ 0.475171] ACPI: PCI: Interrupt link GSIH configured for IRQ 231339worker2 # [ 0.445399] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1340lb # [ 0.437979] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1341client # [ 0.474313] ACPI: bus type USB registered1342client # [ 0.474933] usbcore: registered new interface driver usbfs1343worker2 # [ 0.445955] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1344lb # [ 0.439608] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1345worker1 # [ 0.477152] iommu: Default domain type: Translated1346client # [ 0.475381] usbcore: registered new interface driver hub1347worker1 # [ 0.477806] iommu: DMA domain TLB invalidation policy: lazy mode1348client # [ 0.476247] usbcore: registered new device driver usb1349lb # [ 0.440729] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1350worker2 # [ 0.447050] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1351worker1 # [ 0.478484] ACPI: bus type USB registered1352client # [ 0.477815] NetLabel: Initializing1353worker1 # [ 0.479251] usbcore: registered new interface driver usbfs1354lb # [ 0.442033] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1355worker2 # [ 0.447985] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1356client # [ 0.478367] NetLabel: domain hash size = 1281357worker1 # [ 0.480131] usbcore: registered new interface driver hub1358client # [ 0.479073] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1359worker1 # [ 0.480920] usbcore: registered new device driver usb1360lb # [ 0.443029] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1361worker2 # [ 0.449791] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1362client # [ 0.479416] NetLabel: unlabeled traffic allowed by default1363worker1 # [ 0.482213] NetLabel: Initializing1364worker2 # [ 0.450665] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1365client # [ 0.480433] PCI: Using ACPI for IRQ routing1366worker1 # [ 0.482633] NetLabel: domain hash size = 1281367lb # [ 0.445757] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1368worker2 # [ 0.451789] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1369worker1 # [ 0.483235] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1370lb # [ 0.446590] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1371worker1 # [ 0.484281] NetLabel: unlabeled traffic allowed by default1372worker2 # [ 0.453560] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1373worker1 # [ 0.485249] PCI: Using ACPI for IRQ routing1374lb # [ 0.447800] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1375lb # [ 0.449505] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1376worker2 # [ 0.457995] ACPI: PCI: Interrupt link LNKA configured for IRQ 101377worker2 # [ 0.458848] ACPI: PCI: Interrupt link LNKB configured for IRQ 101378lb # [ 0.452667] ACPI: PCI: Interrupt link LNKA configured for IRQ 101379worker2 # [ 0.459837] ACPI: PCI: Interrupt link LNKC configured for IRQ 111380lb # [ 0.453634] ACPI: PCI: Interrupt link LNKB configured for IRQ 101381worker2 # [ 0.460838] ACPI: PCI: Interrupt link LNKD configured for IRQ 111382lb # [ 0.454839] ACPI: PCI: Interrupt link LNKC configured for IRQ 111383worker2 # [ 0.461843] ACPI: PCI: Interrupt link LNKE configured for IRQ 101384lb # [ 0.455842] ACPI: PCI: Interrupt link LNKD configured for IRQ 111385worker2 # [ 0.462841] ACPI: PCI: Interrupt link LNKF configured for IRQ 101386lb # [ 0.456848] ACPI: PCI: Interrupt link LNKE configured for IRQ 101387worker2 # [ 0.463839] ACPI: PCI: Interrupt link LNKG configured for IRQ 111388lb # [ 0.457838] ACPI: PCI: Interrupt link LNKF configured for IRQ 101389worker2 # [ 0.464833] ACPI: PCI: Interrupt link LNKH configured for IRQ 111390lb # [ 0.458841] ACPI: PCI: Interrupt link LNKG configured for IRQ 111391worker2 # [ 0.465778] ACPI: PCI: Interrupt link GSIA configured for IRQ 161392lb # [ 0.459837] ACPI: PCI: Interrupt link LNKH configured for IRQ 111393worker2 # [ 0.466751] ACPI: PCI: Interrupt link GSIB configured for IRQ 171394lb # [ 0.460780] ACPI: PCI: Interrupt link GSIA configured for IRQ 161395worker2 # [ 0.467754] ACPI: PCI: Interrupt link GSIC configured for IRQ 181396lb # [ 0.461756] ACPI: PCI: Interrupt link GSIB configured for IRQ 171397worker2 # [ 0.468753] ACPI: PCI: Interrupt link GSID configured for IRQ 191398lb # [ 0.462746] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399worker2 # [ 0.469752] ACPI: PCI: Interrupt link GSIE configured for IRQ 201400lb # [ 0.463754] ACPI: PCI: Interrupt link GSID configured for IRQ 191401worker2 # [ 0.470750] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402lb # [ 0.464755] ACPI: PCI: Interrupt link GSIE configured for IRQ 201403worker2 # [ 0.471748] ACPI: PCI: Interrupt link GSIG configured for IRQ 221404lb # [ 0.465753] ACPI: PCI: Interrupt link GSIF configured for IRQ 211405worker2 # [ 0.472753] ACPI: PCI: Interrupt link GSIH configured for IRQ 231406lb # [ 0.466730] ACPI: PCI: Interrupt link GSIG configured for IRQ 221407lb # [ 0.467531] ACPI: PCI: Interrupt link GSIH configured for IRQ 231408worker2 # [ 0.474853] iommu: Default domain type: Translated1409worker2 # [ 0.475678] iommu: DMA domain TLB invalidation policy: lazy mode1410lb # [ 0.469662] iommu: Default domain type: Translated1411worker2 # [ 0.476827] ACPI: bus type USB registered1412lb # [ 0.470369] iommu: DMA domain TLB invalidation policy: lazy mode1413worker2 # [ 0.477600] usbcore: registered new interface driver usbfs1414lb # [ 0.470978] ACPI: bus type USB registered1415worker2 # [ 0.478499] usbcore: registered new interface driver hub1416lb # [ 0.471702] usbcore: registered new interface driver usbfs1417worker2 # [ 0.478869] usbcore: registered new device driver usb1418lb # [ 0.472494] usbcore: registered new interface driver hub1419lb # [ 0.472751] usbcore: registered new device driver usb1420worker2 # [ 0.480585] NetLabel: Initializing1421worker2 # [ 0.481164] NetLabel: domain hash size = 1281422lb # [ 0.474464] NetLabel: Initializing1423worker2 # [ 0.481738] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1424lb # [ 0.474746] NetLabel: domain hash size = 1281425worker2 # [ 0.482759] NetLabel: unlabeled traffic allowed by default1426lb # [ 0.475463] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1427worker2 # [ 0.483706] PCI: Using ACPI for IRQ routing1428lb # [ 0.475777] NetLabel: unlabeled traffic allowed by default1429lb # [ 0.476744] PCI: Using ACPI for IRQ routing1430client # [ 0.524051] pci 0000:00:01.0: vgaarb: setting as boot VGA device1431client # [ 0.524362] pci 0000:00:01.0: vgaarb: bridge control possible1432client # [ 0.524362] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1433client # [ 0.524374] vgaarb: loaded1434client # [ 0.525131] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01435client # [ 0.525369] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1436worker1 # [ 0.530614] pci 0000:00:01.0: vgaarb: setting as boot VGA device1437worker1 # [ 0.531231] pci 0000:00:01.0: vgaarb: bridge control possible1438worker1 # [ 0.531231] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1439worker1 # [ 0.531239] vgaarb: loaded1440worker1 # [ 0.532035] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01441worker1 # [ 0.532888] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1442client # [ 0.529479] clocksource: Switched to clocksource kvm-clock1443client # [ 0.532807] VFS: Disk quotas dquot_6.6.01444worker1 # [ 0.536330] clocksource: Switched to clocksource kvm-clock1445client # [ 0.533507] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1446client # [ 0.534907] pnp: PnP ACPI init1447worker1 # [ 0.538030] VFS: Disk quotas dquot_6.6.01448client # [ 0.535752] ACPI: IRQ 4 override to edge(!), high(!)1449client # [ 0.536795] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1450worker1 # [ 0.540571] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1451client # [ 0.538386] pnp: PnP ACPI: found 6 devices1452worker1 # [ 0.541943] pnp: PnP ACPI init1453worker1 # [ 0.542751] ACPI: IRQ 4 override to edge(!), high(!)1454worker1 # [ 0.543725] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1455worker1 # [ 0.545342] pnp: PnP ACPI: found 6 devices1456client # [ 0.546009] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1457client # [ 0.547516] clocksource: Switched to clocksource acpi_pm1458client # [ 0.548540] NET: Registered PF_INET protocol family1459client # [ 0.549901] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1460worker1 # [ 0.552913] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1461worker1 # [ 0.554436] clocksource: Switched to clocksource acpi_pm1462worker1 # [ 0.555453] NET: Registered PF_INET protocol family1463worker1 # [ 0.556671] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1464worker2 # [ 0.527304] pci 0000:00:01.0: vgaarb: setting as boot VGA device1465worker2 # [ 0.527734] pci 0000:00:01.0: vgaarb: bridge control possible1466lb # [ 0.521116] pci 0000:00:01.0: vgaarb: setting as boot VGA device1467worker2 # [ 0.527734] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1468lb # [ 0.521737] pci 0000:00:01.0: vgaarb: bridge control possible1469worker2 # [ 0.527743] vgaarb: loaded1470worker2 # [ 0.528469] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01471lb # [ 0.521737] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1472lb # [ 0.521744] vgaarb: loaded1473worker2 # [ 0.528740] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1474lb # [ 0.522447] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01475lb # [ 0.522742] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1476worker2 # [ 0.532827] clocksource: Switched to clocksource kvm-clock1477lb # [ 0.526824] clocksource: Switched to clocksource kvm-clock1478client # [ 0.565938] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1479client # [ 0.567485] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1480worker2 # [ 0.536264] VFS: Disk quotas dquot_6.6.01481lb # [ 0.530178] VFS: Disk quotas dquot_6.6.01482client # [ 0.568854] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1483worker2 # [ 0.536984] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1484worker2 # [ 0.538342] pnp: PnP ACPI init1485lb # [ 0.530884] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1486client # [ 0.570169] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1487worker1 # [ 0.573198] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1488lb # [ 0.532179] pnp: PnP ACPI init1489worker2 # [ 0.539118] ACPI: IRQ 4 override to edge(!), high(!)1490client # [ 0.571386] TCP: Hash tables configured (established 16384 bind 16384)1491lb # [ 0.532930] ACPI: IRQ 4 override to edge(!), high(!)1492worker1 # [ 0.574601] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1493worker2 # [ 0.540081] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1494client # [ 0.572435] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1495lb # [ 0.533863] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1496worker1 # [ 0.575822] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1497worker2 # [ 0.541579] pnp: PnP ACPI: found 6 devices1498client # [ 0.573672] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1499lb # [ 0.535357] pnp: PnP ACPI: found 6 devices1500worker1 # [ 0.577129] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1501client # [ 0.574715] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1502worker1 # [ 0.578349] TCP: Hash tables configured (established 16384 bind 16384)1503client # [ 0.575917] NET: Registered PF_UNIX/PF_LOCAL protocol family1504client # [ 0.576916] NET: Registered PF_XDP protocol family1505worker1 # [ 0.579480] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1506client # [ 0.577776] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1507worker1 # [ 0.580739] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1508client # [ 0.578806] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1509worker1 # [ 0.581801] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1510client # [ 0.579811] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1511worker1 # [ 0.582996] NET: Registered PF_UNIX/PF_LOCAL protocol family1512worker1 # [ 0.584002] NET: Registered PF_XDP protocol family1513client # [ 0.580935] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1514worker2 # [ 0.549101] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1515worker1 # [ 0.584819] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1516client # [ 0.582016] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1517lb # [ 0.542888] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1518worker2 # [ 0.550504] clocksource: Switched to clocksource acpi_pm1519worker1 # [ 0.585761] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1520client # [ 0.583055] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1521lb # [ 0.544279] clocksource: Switched to clocksource acpi_pm1522worker2 # [ 0.551410] NET: Registered PF_INET protocol family1523worker1 # [ 0.586704] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1524lb # [ 0.545206] NET: Registered PF_INET protocol family1525client # [ 0.584895] ACPI: \_SB_.GSIA: Enabled at IRQ 161526worker2 # [ 0.552511] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1527worker1 # [ 0.587773] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1528lb # [ 0.546386] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1529worker1 # [ 0.588810] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1530client # [ 0.587250] ACPI: \_SB_.GSIB: Enabled at IRQ 171531worker1 # [ 0.589947] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1532worker1 # [ 0.591758] ACPI: \_SB_.GSIA: Enabled at IRQ 161533client # [ 0.589123] ACPI: \_SB_.GSIC: Enabled at IRQ 181534client # [ 0.591033] ACPI: \_SB_.GSID: Enabled at IRQ 191535worker1 # [ 0.594318] ACPI: \_SB_.GSIB: Enabled at IRQ 171536client # [ 0.592698] PCI: CLS 0 bytes, default 641537worker1 # [ 0.596223] ACPI: \_SB_.GSIC: Enabled at IRQ 181538client # [ 0.593549] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1539worker1 # [ 0.598128] ACPI: \_SB_.GSID: Enabled at IRQ 191540client # [ 0.595329] Trying to unpack rootfs image as initramfs...1541worker1 # [ 0.599726] PCI: CLS 0 bytes, default 641542worker1 # [ 0.600627] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1543worker1 # [ 0.602489] Trying to unpack rootfs image as initramfs...1544lb # [ 0.562632] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1545worker2 # [ 0.569512] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1546lb # [ 0.564163] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1547worker2 # [ 0.571306] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1548lb # [ 0.565539] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1549worker2 # [ 0.572839] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1550lb # [ 0.566888] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1551worker2 # [ 0.574392] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1552lb # [ 0.568197] TCP: Hash tables configured (established 16384 bind 16384)1553worker2 # [ 0.575854] TCP: Hash tables configured (established 16384 bind 16384)1554lb # [ 0.569374] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1555lb # [ 0.570634] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1556worker2 # [ 0.577215] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1557lb # [ 0.571749] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1558worker2 # [ 0.578735] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559lb # [ 0.572917] NET: Registered PF_UNIX/PF_LOCAL protocol family1560worker2 # [ 0.580032] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1561lb # [ 0.573915] NET: Registered PF_XDP protocol family1562worker2 # [ 0.581530] NET: Registered PF_UNIX/PF_LOCAL protocol family1563lb # [ 0.574749] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1564worker2 # [ 0.582668] NET: Registered PF_XDP protocol family1565lb # [ 0.575736] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1566lb # [ 0.576786] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1567worker2 # [ 0.583695] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1568lb # [ 0.577923] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1569worker2 # [ 0.584868] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1570lb # [ 0.579061] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1571worker2 # [ 0.586132] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1572lb # [ 0.580182] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1573worker2 # [ 0.587436] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1574lb # [ 0.581908] ACPI: \_SB_.GSIA: Enabled at IRQ 161575worker2 # [ 0.588723] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1576worker2 # [ 0.590007] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1577lb # [ 0.584023] ACPI: \_SB_.GSIB: Enabled at IRQ 171578worker2 # [ 0.592170] ACPI: \_SB_.GSIA: Enabled at IRQ 161579lb # [ 0.586371] ACPI: \_SB_.GSIC: Enabled at IRQ 181580worker2 # [ 0.594919] ACPI: \_SB_.GSIB: Enabled at IRQ 171581lb # [ 0.588376] ACPI: \_SB_.GSID: Enabled at IRQ 191582lb # [ 0.590054] PCI: CLS 0 bytes, default 641583worker2 # [ 0.597196] ACPI: \_SB_.GSIC: Enabled at IRQ 181584lb # [ 0.591014] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1585worker2 # [ 0.599468] ACPI: \_SB_.GSID: Enabled at IRQ 191586lb # [ 0.592816] Trying to unpack rootfs image as initramfs...1587worker2 # [ 0.601396] PCI: CLS 0 bytes, default 641588worker2 # [ 0.602415] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1589worker2 # [ 0.604416] Trying to unpack rootfs image as initramfs...1590client # [ 0.639093] Initialise system trusted keyrings1591client # [ 0.640055] workingset: timestamp_bits=40 max_order=19 bucket_order=01592worker1 # [ 0.649508] Initialise system trusted keyrings1593worker1 # [ 0.650529] workingset: timestamp_bits=40 max_order=19 bucket_order=01594client # [ 0.661544] Key type asymmetric registered1595client # [ 0.663613] Asymmetric key parser 'x509' registered1596client # [ 0.664459] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1597client # [ 0.667751] io scheduler mq-deadline registered1598client # [ 0.668547] io scheduler kyber registered1599worker1 # [ 0.673354] Key type asymmetric registered1600worker1 # [ 0.674126] Asymmetric key parser 'x509' registered1601client # [ 0.671182] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1602worker1 # [ 0.674983] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1603client # [ 0.672518] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1604lb # [ 0.634352] Initialise system trusted keyrings1605lb # [ 0.637315] workingset: timestamp_bits=40 max_order=19 bucket_order=01606worker1 # [ 0.680192] io scheduler mq-deadline registered1607worker1 # [ 0.680990] io scheduler kyber registered1608client # [ 0.678202] Linux agpgart interface v0.1031609client # [ 0.678976] ACPI: bus type drm_connector registered1610worker1 # [ 0.684625] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1611worker2 # [ 0.649961] Initialise system trusted keyrings1612client # [ 0.682025] usbcore: registered new interface driver usbserial_generic1613client # [ 0.683079] usbserial: USB Serial support registered for generic1614worker1 # [ 0.685948] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1615worker2 # [ 0.653126] workingset: timestamp_bits=40 max_order=19 bucket_order=01616worker1 # [ 0.689835] Linux agpgart interface v0.1031617client # [ 0.686605] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1618worker1 # [ 0.690631] ACPI: bus type drm_connector registered1619client # [ 0.686605] Please enable it if your BIOS has the CPPC option.1620client # [ 0.688820] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1621worker1 # [ 0.695558] usbcore: registered new interface driver usbserial_generic1622client # [ 0.692749] drop_monitor: Initializing network drop monitor service1623worker1 # [ 0.696655] usbserial: USB Serial support registered for generic1624client # [ 0.693914] NET: Registered PF_INET6 protocol family1625lb # [ 0.657178] Key type asymmetric registered1626client # [ 0.697018] Segment Routing with IPv61627worker1 # [ 0.700102] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1628worker1 # [ 0.700102] Please enable it if your BIOS has the CPPC option.1629client # [ 0.699627] In-situ OAM (IOAM) with IPv61630worker1 # [ 0.702406] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1631lb # [ 0.661301] Asymmetric key parser 'x509' registered1632client # [ 0.700629] IPI shorthand broadcast: enabled1633worker1 # [ 0.703789] drop_monitor: Initializing network drop monitor service1634lb # [ 0.662139] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1635worker1 # [ 0.704936] NET: Registered PF_INET6 protocol family1636lb # [ 0.665401] io scheduler mq-deadline registered1637lb # [ 0.666191] io scheduler kyber registered1638worker2 # [ 0.674184] Key type asymmetric registered1639worker1 # [ 0.709537] Segment Routing with IPv61640worker2 # [ 0.674875] Asymmetric key parser 'x509' registered1641lb # [ 0.668797] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1642worker2 # [ 0.675714] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1643client # [ 0.708727] sched_clock: Marking stable (574013578, 134566482)->(785364573, -76784513)1644lb # [ 0.670058] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1645worker1 # [ 0.713113] In-situ OAM (IOAM) with IPv61646worker1 # [ 0.714113] IPI shorthand broadcast: enabled1647client # [ 0.712797] registered taskstats version 11648worker2 # [ 0.681243] io scheduler mq-deadline registered1649client # [ 0.713733] Loading compiled-in X.509 certificates1650worker2 # [ 0.681978] io scheduler kyber registered1651lb # [ 0.676024] Linux agpgart interface v0.1031652lb # [ 0.676830] ACPI: bus type drm_connector registered1653worker2 # [ 0.686166] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1654lb # [ 0.679681] usbcore: registered new interface driver usbserial_generic1655worker1 # [ 0.722189] sched_clock: Marking stable (586014951, 136052150)->(797310123, -75243022)1656worker2 # [ 0.687405] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1657lb # [ 0.680755] usbserial: USB Serial support registered for generic1658worker1 # [ 0.725165] registered taskstats version 11659lb # [ 0.683285] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1660worker1 # [ 0.726173] Loading compiled-in X.509 certificates1661lb # [ 0.683285] Please enable it if your BIOS has the CPPC option.1662worker2 # [ 0.692868] Linux agpgart interface v0.1031663lb # [ 0.685517] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1664worker2 # [ 0.693633] ACPI: bus type drm_connector registered1665lb # [ 0.689428] drop_monitor: Initializing network drop monitor service1666worker2 # [ 0.696503] usbcore: registered new interface driver usbserial_generic1667lb # [ 0.690614] NET: Registered PF_INET6 protocol family1668worker2 # [ 0.697532] usbserial: USB Serial support registered for generic1669client # [ 0.731602] Demotion targets for Node 0: null1670lb # [ 0.693712] Segment Routing with IPv61671client # [ 0.733636] Key type .fscrypt registered1672worker2 # [ 0.701086] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1673client # [ 0.734418] Key type fscrypt-provisioning registered1674worker2 # [ 0.701086] Please enable it if your BIOS has the CPPC option.1675lb # [ 0.696299] In-situ OAM (IOAM) with IPv61676client # [ 0.735363] ima: No TPM chip found, activating TPM-bypass!1677worker2 # [ 0.703243] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1678lb # [ 0.697339] IPI shorthand broadcast: enabled1679worker2 # [ 0.706207] drop_monitor: Initializing network drop monitor service1680worker2 # [ 0.707366] NET: Registered PF_INET6 protocol family1681client # [ 0.739599] ima: Allocated hash algorithm: sha11682client # [ 0.740386] ima: No architecture policies found1683worker1 # [ 0.744092] Demotion targets for Node 0: null1684worker2 # [ 0.710523] Segment Routing with IPv61685client # [ 0.742602] PM: Magic number: 10:919:8811686worker1 # [ 0.746127] Key type .fscrypt registered1687worker1 # [ 0.746767] Key type fscrypt-provisioning registered1688client # [ 0.744180] RAS: Correctable Errors collector initialized.1689worker1 # [ 0.747663] ima: No TPM chip found, activating TPM-bypass!1690lb # [ 0.705498] sched_clock: Marking stable (572014018, 133246133)->(778831526, -73571375)1691worker2 # [ 0.713108] In-situ OAM (IOAM) with IPv61692worker2 # [ 0.714163] IPI shorthand broadcast: enabled1693lb # [ 0.709503] registered taskstats version 11694worker1 # [ 0.752218] ima: Allocated hash algorithm: sha11695lb # [ 0.710493] Loading compiled-in X.509 certificates1696worker1 # [ 0.752995] ima: No architecture policies found1697worker1 # [ 0.753923] PM: Magic number: 10:919:8811698client # [ 0.752309] clk: Disabling unused clocks1699worker1 # [ 0.757561] RAS: Correctable Errors collector initialized.1700worker2 # [ 0.722288] sched_clock: Marking stable (589020342, 133055074)->(793236754, -71161338)1701client # [ 0.755602] PM: genpd: Disabling unused power domains1702worker2 # [ 0.727264] registered taskstats version 11703worker2 # [ 0.728215] Loading compiled-in X.509 certificates1704worker1 # [ 0.766312] clk: Disabling unused clocks1705worker1 # [ 0.766986] PM: genpd: Disabling unused power domains1706lb # [ 0.728277] Demotion targets for Node 0: null1707lb # [ 0.730319] Key type .fscrypt registered1708lb # [ 0.730977] Key type fscrypt-provisioning registered1709lb # [ 0.731879] ima: No TPM chip found, activating TPM-bypass!1710lb # [ 0.736277] ima: Allocated hash algorithm: sha11711lb # [ 0.737066] ima: No architecture policies found1712worker2 # [ 0.744700] Demotion targets for Node 0: null1713lb # [ 0.737979] PM: Magic number: 10:919:8811714worker2 # [ 0.747139] Key type .fscrypt registered1715worker2 # [ 0.747809] Key type fscrypt-provisioning registered1716lb # [ 0.741538] RAS: Correctable Errors collector initialized.1717worker2 # [ 0.748761] ima: No TPM chip found, activating TPM-bypass!1718worker2 # [ 0.753096] ima: Allocated hash algorithm: sha11719worker2 # [ 0.753878] ima: No architecture policies found1720worker2 # [ 0.756202] PM: Magic number: 10:919:8811721lb # [ 0.750125] clk: Disabling unused clocks1722worker2 # [ 0.757766] RAS: Correctable Errors collector initialized.1723lb # [ 0.752275] PM: genpd: Disabling unused power domains1724worker2 # [ 0.765729] clk: Disabling unused clocks1725worker2 # [ 0.770095] PM: genpd: Disabling unused power domains1726client # [ 0.913730] Freeing initrd memory: 29096K1727client # [ 0.916976] Freeing unused decrypted memory: 2028K1728client # [ 0.919586] Freeing unused kernel image (initmem) memory: 3644K1729client # [ 0.920694] Write protecting the kernel read-only data: 32768k1730client # [ 0.922556] Freeing unused kernel image (text/rodata gap) memory: 1208K1731worker1 # [ 0.926249] Freeing initrd memory: 29092K1732client # [ 0.924096] Freeing unused kernel image (rodata/data gap) memory: 752K1733worker1 # [ 0.929402] Freeing unused decrypted memory: 2028K1734worker1 # [ 0.932034] Freeing unused kernel image (initmem) memory: 3644K1735worker1 # [ 0.933211] Write protecting the kernel read-only data: 32768k1736worker1 # [ 0.935140] Freeing unused kernel image (text/rodata gap) memory: 1208K1737worker1 # [ 0.936657] Freeing unused kernel image (rodata/data gap) memory: 752K1738lb # [ 0.910599] Freeing initrd memory: 29092K1739lb # [ 0.913699] Freeing unused decrypted memory: 2028K1740lb # [ 0.916216] Freeing unused kernel image (initmem) memory: 3644K1741lb # [ 0.917368] Write protecting the kernel read-only data: 32768k1742lb # [ 0.919267] Freeing unused kernel image (text/rodata gap) memory: 1208K1743lb # [ 0.920794] Freeing unused kernel image (rodata/data gap) memory: 752K1744worker2 # [ 0.928912] Freeing initrd memory: 29092K1745worker2 # [ 0.932112] Freeing unused decrypted memory: 2028K1746worker2 # [ 0.934653] Freeing unused kernel image (initmem) memory: 3644K1747worker2 # [ 0.935763] Write protecting the kernel read-only data: 32768k1748worker2 # [ 0.937675] Freeing unused kernel image (text/rodata gap) memory: 1208K1749worker2 # [ 0.939257] Freeing unused kernel image (rodata/data gap) memory: 752K1750client # [ 0.975144] x86/mm: Checked W+X mappings: passed, no W+X pages found.1751client # [ 0.976272] Run /init as init process1752worker1 # [ 0.987786] x86/mm: Checked W+X mappings: passed, no W+X pages found.1753worker1 # [ 0.988922] Run /init as init process1754client # [ 0.986120] systemd[1]: Inserted module 'autofs4'1755worker1 # [ 0.998905] systemd[1]: Inserted module 'autofs4'1756client # [ 1.002249] fuse: init (API version 7.45)1757client # [ 1.008058] ACPI: \_SB_.GSIG: Enabled at IRQ 221758client # [ 1.010485] ACPI: \_SB_.GSIH: Enabled at IRQ 231759lb # [ 0.971903] x86/mm: Checked W+X mappings: passed, no W+X pages found.1760lb # [ 0.973023] Run /init as init process1761worker1 # [ 1.015241] fuse: init (API version 7.45)1762client # [ 1.013635] ACPI: \_SB_.GSIE: Enabled at IRQ 201763client # [ 1.015781] ACPI: \_SB_.GSIF: Enabled at IRQ 211764worker1 # [ 1.021101] ACPI: \_SB_.GSIG: Enabled at IRQ 221765worker1 # [ 1.023862] ACPI: \_SB_.GSIH: Enabled at IRQ 231766lb # [ 0.982919] systemd[1]: Inserted module 'autofs4'1767worker2 # [ 0.990314] x86/mm: Checked W+X mappings: passed, no W+X pages found.1768worker2 # [ 0.991386] Run /init as init process1769worker1 # [ 1.027715] ACPI: \_SB_.GSIE: Enabled at IRQ 201770worker1 # [ 1.030233] ACPI: \_SB_.GSIF: Enabled at IRQ 211771worker2 # [ 1.001528] systemd[1]: Inserted module 'autofs4'1772lb # [ 0.999297] fuse: init (API version 7.45)1773lb # [ 1.005014] ACPI: \_SB_.GSIG: Enabled at IRQ 221774lb # [ 1.007555] ACPI: \_SB_.GSIH: Enabled at IRQ 231775lb # [ 1.010623] ACPI: \_SB_.GSIE: Enabled at IRQ 201776worker2 # [ 1.017846] fuse: init (API version 7.45)1777lb # [ 1.012827] ACPI: \_SB_.GSIF: Enabled at IRQ 211778client # [ 1.051674] systemd[1]: Successfully made /usr/ read-only.1779worker2 # [ 1.023553] ACPI: \_SB_.GSIG: Enabled at IRQ 221780worker2 # [ 1.025942] ACPI: \_SB_.GSIH: Enabled at IRQ 231781worker1 # [ 1.060847] systemd[1]: Successfully made /usr/ read-only.1782worker2 # [ 1.028982] ACPI: \_SB_.GSIE: Enabled at IRQ 201783worker2 # [ 1.031255] ACPI: \_SB_.GSIF: Enabled at IRQ 211784lb # [ 1.043441] systemd[1]: Successfully made /usr/ read-only.1785worker2 # [ 1.063189] systemd[1]: Successfully made /usr/ read-only.1786client # [ 1.388934] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1787client # [ 1.401146] systemd[1]: Detected virtualization kvm.1788client # [ 1.403328] systemd[1]: Detected architecture x86-64.1789worker1 # [ 1.397438] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790client # [ 1.405460] systemd[1]: Running in initrd.1791worker1 # [ 1.409395] systemd[1]: Detected virtualization kvm.1792worker1 # [ 1.411507] systemd[1]: Detected architecture x86-64.1793client # [ 1.408222] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.413595] systemd[1]: Running in initrd.1795client # [ 1.411097] systemd[1]: Hostname set to <client>.1796worker1 # [ 1.416150] systemd[1]: Initializing machine ID from random generator.1797worker1 # [ 1.419006] systemd[1]: Hostname set to <worker1>.1798lb # [ 1.380389] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1799lb # [ 1.392400] systemd[1]: Detected virtualization kvm.1800lb # [ 1.394541] systemd[1]: Detected architecture x86-64.1801lb # [ 1.396623] systemd[1]: Running in initrd.1802lb # [ 1.399200] systemd[1]: Initializing machine ID from random generator.1803lb # [ 1.402051] systemd[1]: Hostname set to <lb>.1804worker2 # [ 1.399909] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1805worker2 # [ 1.412242] systemd[1]: Detected virtualization kvm.1806worker2 # [ 1.414395] systemd[1]: Detected architecture x86-64.1807worker2 # [ 1.416562] systemd[1]: Running in initrd.1808worker2 # [ 1.419206] systemd[1]: Initializing machine ID from random generator.1809worker2 # [ 1.422017] systemd[1]: Hostname set to <worker2>.1810worker2 # [ 1.529659] systemd[1]: bpf-restrict-fs: LSM BPF program attached1811worker2 # [ 1.567784] systemd[1]: Queued start job for default target Initrd Default Target.1812worker2 # [ 1.572378] systemd[1]: Created slice Slice /system/modprobe.1813worker2 # [ 1.573562] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1814worker2 # [ 1.574974] systemd[1]: Expecting device /dev/disk/by-label/nixos...1815worker2 # [ 1.576096] systemd[1]: Reached target Path Units.1816worker2 # [ 1.576933] systemd[1]: Reached target Slice Units.1817worker2 # [ 1.577831] systemd[1]: Reached target Swaps.1818worker2 # [ 1.578686] systemd[1]: Reached target Timer Units.1819worker2 # [ 1.579674] systemd[1]: Listening on D-Bus System Message Bus Socket.1820worker2 # [ 1.580840] systemd[1]: Listening on Journal Socket (/dev/log).1821worker2 # [ 1.581968] systemd[1]: Listening on Journal Sockets.1822worker2 # [ 1.582973] systemd[1]: Listening on udev Control Socket.1823worker2 # [ 1.583985] systemd[1]: Listening on udev Kernel Socket.1824worker2 # [ 1.584993] systemd[1]: Reached target Socket Units.1825worker2 # [ 1.586782] systemd[1]: Starting Create List of Static Device Nodes...1826worker2 # [ 1.591146] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1827worker2 # [ 1.599144] systemd[1]: Starting Load Kernel Module configfs...1828worker1 # [ 1.641761] systemd[1]: bpf-restrict-fs: LSM BPF program attached1829client # [ 1.639615] systemd[1]: bpf-restrict-fs: LSM BPF program attached1830worker2 # [ 1.613742] systemd[1]: Starting Journal Service...1831worker2 # [ 1.626183] systemd[1]: Starting Load Kernel Modules...1832lb # [ 1.623479] systemd[1]: bpf-restrict-fs: LSM BPF program attached1833worker2 # [ 1.633159] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1834worker2 # [ 1.648906] netfs: FS-Cache loaded1835worker2 # [ 1.653907] 9pnet: Installing 9P2000 support1836worker1 # [ 1.695481] systemd[1]: Queued start job for default target Initrd Default Target.1837client # [ 1.695513] systemd[1]: Queued start job for default target Initrd Default Target.1838worker2 # [ 1.664153] systemd[1]: Starting Coldplug All udev Devices...1839worker1 # [ 1.699340] systemd[1]: Created slice Slice /system/modprobe.1840worker1 # [ 1.700523] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1841worker1 # [ 1.702006] systemd[1]: Expecting device /dev/disk/by-label/nixos...1842client # [ 1.699959] systemd[1]: Created slice Slice /system/modprobe.1843worker1 # [ 1.703219] systemd[1]: Reached target Path Units.1844worker1 # [ 1.704098] systemd[1]: Reached target Slice Units.1845client # [ 1.701175] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1846worker1 # [ 1.704956] systemd[1]: Reached target Swaps.1847worker1 # [ 1.705772] systemd[1]: Reached target Timer Units.1848client # [ 1.702621] systemd[1]: Expecting device /dev/disk/by-label/nixos...1849client # [ 1.703769] systemd[1]: Reached target Path Units.1850worker1 # [ 1.706711] systemd[1]: Listening on D-Bus System Message Bus Socket.1851client # [ 1.704685] systemd[1]: Reached target Slice Units.1852worker1 # [ 1.707928] systemd[1]: Listening on Journal Socket (/dev/log).1853client # [ 1.705554] systemd[1]: Reached target Swaps.1854worker1 # [ 1.709144] systemd[1]: Listening on Journal Sockets.1855client # [ 1.706364] systemd[1]: Reached target Timer Units.1856worker1 # [ 1.710179] systemd[1]: Listening on udev Control Socket.1857client # [ 1.707370] systemd[1]: Listening on D-Bus System Message Bus Socket.1858worker1 # [ 1.711212] systemd[1]: Listening on udev Kernel Socket.1859client # [ 1.708695] systemd[1]: Listening on Journal Socket (/dev/log).1860worker1 # [ 1.712201] systemd[1]: Reached target Socket Units.1861worker2 # [ 1.677183] systemd[1]: Finished Create List of Static Device Nodes.1862client # [ 1.709872] systemd[1]: Listening on Journal Sockets.1863client # [ 1.710916] systemd[1]: Listening on udev Control Socket.1864worker1 # [ 1.713950] systemd[1]: Starting Create List of Static Device Nodes...1865client # [ 1.711979] systemd[1]: Listening on udev Kernel Socket.1866client # [ 1.712975] systemd[1]: Reached target Socket Units.1867client # [ 1.714905] systemd[1]: Starting Create List of Static Device Nodes...1868worker1 # [ 1.717871] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1869worker2 # [ 1.683655] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1870lb # [ 1.678866] systemd[1]: Queued start job for default target Initrd Default Target.1871client # [ 1.718664] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1872worker2 # [ 1.690133] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1873worker1 # [ 1.725265] systemd[1]: Starting Load Kernel Module configfs...1874lb # [ 1.683657] systemd[1]: Created slice Slice /system/modprobe.1875lb # [ 1.684858] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1876lb # [ 1.686318] systemd[1]: Expecting device /dev/disk/by-label/nixos...1877lb # [ 1.687470] systemd[1]: Reached target Path Units.1878client # [ 1.726659] systemd[1]: Starting Load Kernel Module configfs...1879worker2 # [ 1.694797] systemd-journald[67]: Collecting audit messages is disabled.1880lb # [ 1.688365] systemd[1]: Reached target Slice Units.1881lb # [ 1.689278] systemd[1]: Reached target Swaps.1882lb # [ 1.690103] systemd[1]: Reached target Timer Units.1883lb # [ 1.691163] systemd[1]: Listening on D-Bus System Message Bus Socket.1884worker2 # [ 1.698534] systemd[1]: modprobe@configfs.service: Deactivated successfully.1885lb # [ 1.692404] systemd[1]: Listening on Journal Socket (/dev/log).1886lb # [ 1.693614] systemd[1]: Listening on Journal Sockets.1887lb # [ 1.694673] systemd[1]: Listening on udev Control Socket.1888worker2 # [ 1.702461] systemd[1]: Finished Load Kernel Module configfs.1889lb # [ 1.695784] systemd[1]: Listening on udev Kernel Socket.1890worker1 # [ 1.737749] systemd[1]: Starting Journal Service...1891lb # [ 1.696680] systemd[1]: Reached target Socket Units.1892lb # [ 1.698614] systemd[1]: Starting Create List of Static Device Nodes...1893client # [ 1.740244] systemd[1]: Starting Journal Service...1894worker2 # [ 1.708519] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1895lb # [ 1.703338] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1896worker2 # [ 1.712630] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1897worker1 # [ 1.752145] systemd[1]: Starting Load Kernel Modules...1898lb # [ 1.711333] systemd[1]: Starting Load Kernel Module configfs...1899worker2 # [ 1.720150] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1900worker2 # [ 1.721411] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1901client # [ 1.755681] systemd[1]: Starting Load Kernel Modules...1902lb # [ 1.726445] systemd[1]: Starting Journal Service...1903worker1 # [ 1.757223] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1904worker1 # [ 1.774805] netfs: FS-Cache loaded1905client # [ 1.760686] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1906worker1 # [ 1.779444] 9pnet: Installing 9P2000 support1907lb # [ 1.738392] systemd[1]: Starting Load Kernel Modules...1908client # [ 1.778420] netfs: FS-Cache loaded1909worker2 # [ 1.750612] systemd[1]: Finished Load Kernel Modules.1910client # [ 1.783311] 9pnet: Installing 9P2000 support1911worker2 # [ 1.757860] systemd[1]: Starting Apply Kernel Variables...1912worker1 # [ 1.793157] systemd[1]: Starting Coldplug All udev Devices...1913client # [ 1.796869] systemd[1]: Starting Coldplug All udev Devices...1914lb # [ 1.746351] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1915worker2 # [ 1.768203] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1916lb # [ 1.762633] netfs: FS-Cache loaded1917worker1 # [ 1.807203] systemd[1]: Finished Create List of Static Device Nodes.1918lb # [ 1.767461] 9pnet: Installing 9P2000 support1919worker2 # [ 1.777525] systemd[1]: Starting Create Static Device Nodes in /dev...1920worker1 # [ 1.813717] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1921client # [ 1.813735] systemd[1]: Finished Create List of Static Device Nodes.1922lb # [ 1.777536] systemd[1]: Starting Coldplug All udev Devices...1923worker1 # [ 1.820771] systemd-journald[67]: Collecting audit messages is disabled.1924worker1 # [ 1.822461] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1925client # [ 1.820314] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1926worker1 # [ 1.827459] systemd[1]: modprobe@configfs.service: Deactivated successfully.1927client # [ 1.829059] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1928worker2 # [ 1.797382] systemd[1]: Finished Apply Kernel Variables.1929worker1 # [ 1.834484] systemd[1]: Finished Load Kernel Module configfs.1930lb # [ 1.795576] systemd[1]: Finished Create List of Static Device Nodes.1931client # [ 1.836055] systemd[1]: modprobe@configfs.service: Deactivated successfully.1932client # [ 1.837250] systemd-journald[67]: Collecting audit messages is disabled.1933worker1 # [ 1.839538] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1934worker1 # [ 1.841664] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1935lb # [ 1.800866] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1936client # [ 1.842005] systemd[1]: Finished Load Kernel Module configfs.1937worker2 # [ 1.810600] systemd[1]: Finished Create Static Device Nodes in /dev.1938worker2 # [ 1.680245] systemd-modules-load[68]: Inserted module 'dm_mod'1939worker1 # [ 1.848856] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1940worker2 # [ 1.682256] systemd-modules-load[68]: Inserted module 'virtio_balloon'1941client # [ 1.847071] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1942worker2 # [ 1.683288] systemd-modules-load[68]: Inserted module 'virtio_gpu'1943lb # [ 1.809701] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1944worker2 # [ 1.817335] systemd[1]: Started Journal Service.1945worker1 # [ 1.853150] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1946client # [ 1.851465] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1947lb # [ 1.813753] systemd-journald[67]: Collecting audit messages is disabled.1948lb # [ 1.816709] systemd[1]: modprobe@configfs.service: Deactivated successfully.1949worker2 # [ 1.694123] systemd[1]: Reached target Preparation for Local File Systems.1950worker2 # [ 1.695134] systemd[1]: Reached target Local File Systems.1951client # [ 1.859725] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1952client # [ 1.861406] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1953worker2 # [ 1.698071] systemd[1]: Starting Create System Files and Directories...1954lb # [ 1.824626] systemd[1]: Finished Load Kernel Module configfs.1955worker2 # [ 1.703082] systemd[1]: Starting Rule-based Manager for Device Events and Files...1956lb # [ 1.828746] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1957lb # [ 1.831449] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1958worker1 # [ 1.878570] systemd[1]: Finished Load Kernel Modules.1959lb # [ 1.840311] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1960worker1 # [ 1.884257] systemd[1]: Starting Apply Kernel Variables...1961lb # [ 1.842046] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1962client # [ 1.890127] systemd[1]: Finished Load Kernel Modules.1963worker2 # [ 1.726195] systemd[1]: Finished Create System Files and Directories.1964worker1 # [ 1.897162] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1965client # [ 1.896775] systemd[1]: Starting Apply Kernel Variables...1966worker1 # [ 1.906313] systemd[1]: Starting Create Static Device Nodes in /dev...1967client # [ 1.908733] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1968lb # [ 1.870780] systemd[1]: Finished Load Kernel Modules.1969worker2 # [ 1.750416] systemd-udevd[83]: Using default interface naming scheme 'v261'.1970lb # [ 1.877492] systemd[1]: Starting Apply Kernel Variables...1971worker1 # [ 1.920157] systemd[1]: Finished Apply Kernel Variables.1972client # [ 1.918218] systemd[1]: Starting Create Static Device Nodes in /dev...1973lb # [ 1.894441] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1974worker1 # [ 1.936819] systemd[1]: Started Journal Service.1975worker1 # [ 1.801926] systemd-modules-load[68]: Inserted module 'dm_mod'1976worker1 # [ 1.804945] systemd-modules-load[68]: Inserted module 'virtio_balloon'1977worker1 # [ 1.806266] systemd-modules-load[68]: Inserted module 'virtio_gpu'1978client # [ 1.939726] systemd[1]: Finished Apply Kernel Variables.1979worker2 # [ 1.776073] systemd[1]: Started Rule-based Manager for Device Events and Files.1980worker1 # [ 1.809282] systemd[1]: Finished Create Static Device Nodes in /dev.1981worker1 # [ 1.810433] systemd[1]: Reached target Preparation for Local File Systems.1982lb # [ 1.904471] systemd[1]: Starting Create Static Device Nodes in /dev...1983worker1 # [ 1.812375] systemd[1]: Reached target Local File Systems.1984worker1 # [ 1.815879] systemd[1]: Starting Create System Files and Directories...1985client # [ 1.953115] systemd[1]: Finished Create Static Device Nodes in /dev.1986worker1 # [ 1.822784] systemd[1]: Starting Rule-based Manager for Device Events and Files...1987client # [ 1.821579] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.957374] systemd[1]: Started Journal Service.1988lb # [ 1.918376] systemd[1]: Finished Apply Kernel Variables.1989client # 1990client # [ 1.825319] systemd-modules-load[68]: Inserted module 'virtio_balloon'1991client # [ 1.826385] systemd-modules-load[68]: Inserted module 'virtio_gpu'1992client # [ 1.828265] systemd[1]: Reached target Preparation for Local File Systems.1993client # [ 1.831189] systemd[1]: Reached target Local File Systems.1994client # [ 1.835072] systemd[1]: Starting Create System Files and Directories...1995client # [ 1.837845] systemd[1]: Starting Rule-based Manager for Device Events and Files...1996lb # [ 1.935445] systemd[1]: Started Journal Service.1997lb # [ 1.801638] systemd-modules-load[68]: Inserted module 'dm_mod'1998lb # [ 1.805969] systemd-modules-load[68]: Inserted module 'virtio_balloon'1999lb # [ 1.807723] systemd-modules-load[68]: Inserted module 'virtio_gpu'2000worker1 # [ 1.849559] systemd[1]: Finished Create System Files and Directories.
loading 1,842 hidden lines…
3843worker1 # [ 10.637424] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3844worker1 # [ 10.645349] systemd-logind[553]: Watching system buttons on /dev/input/event2 (Power Button)3845worker1 # [ 10.646518] systemd-logind[553]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3846worker1 # [ 10.647682] systemd-logind[553]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3847worker1 # [ 10.652188] systemd[1]: Started D-Bus System Message Bus.3848worker1 # [ 10.652979] systemd[1]: Started User Login Management.3849worker1 # [ 10.657329] systemd[1]: Starting linger-users.service...3850worker1 # [ 10.706339] dbus-broker-launch[533]: Ready3851worker1 # [ 10.720097] systemd[1]: linger-users.service: Deactivated successfully.3852worker1 # [ 10.722335] systemd[1]: Finished linger-users.service.3853worker1 # [ 10.724902] systemd[1]: Started Name Service Cache Daemon (nsncd).3854worker1 # [ 10.726347] nsncd[599]: Sep 20 10:51:18.815 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3855worker1 # [ 10.728484] systemd[1]: Reached target Host and Network Name Lookups.3856worker1 # [ 10.729528] systemd[1]: Reached target User and Group Name Lookups.3857worker1 # [ 10.748316] systemd[1]: Finished resolvconf update.3858worker1 # [ 10.749167] systemd[1]: Reached target Preparation for Network.3859worker1 # [ 10.753147] systemd[1]: Starting DHCP Client...3860worker1 # [ 10.756948] systemd[1]: Starting Address configuration of eth1...3861worker1 # [ 10.760690] systemd[1]: Starting Extra networking commands....3862client # [ 10.857681] dhcpcd[566]: eth0: soliciting a DHCP lease3863worker1 # [ 10.864316] network-addresses-eth1-start[629]: adding address 192.168.1.3/24... done3864client # [ 11.013794] NET: Registered PF_PACKET protocol family3865worker1 # [ 10.881372] network-addresses-eth1-start[629]: adding address 2001:db8:1::3/64... done3866client # [ 10.885634] dhcpcd[566]: eth0: offered 10.0.2.15 from 10.0.2.23867client # [ 10.890361] dhcpcd[566]: eth0: probing address 10.0.2.15/243868worker1 # [ 10.902963] systemd[1]: Finished Address configuration of eth1.3869worker1 # [ 10.927820] dhcpcd[636]: dhcpcd-10.3.2 starting3870worker1 # [ 10.938348] dhcpcd[691]: dev: loaded udev3871worker1 # [ 10.946114] systemd[1]: Finished Extra networking commands..3872worker1 # [ 10.947665] systemd[1]: Reached target Network.3873worker1 # [ 10.951358] systemd[1]: Starting Permit User Sessions...3874worker1 # [ 11.100478] 8021q: 802.1Q VLAN Support v1.83875worker1 # [ 11.100926] 8021q: adding VLAN 0 to HW filter on device eth13876worker1 # [ 10.984668] systemd[1]: Finished Permit User Sessions.3877worker1 # [ 10.987385] systemd[1]: Started Getty on tty1.3878worker1 # [ 10.989397] systemd[1]: Reached target Login Prompts.3879worker1 # [ 11.001193] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3880worker1 # [ 11.190533] cfg80211: Loading compiled-in X.509 certificates for regulatory database3881worker1 # [ 11.214173] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3882worker1 # [ 11.214822] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3883worker1 # [ 11.217775] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23884worker1 # [ 11.218634] cfg80211: failed to load regulatory.db3885worker1 # [ 11.261610] 8021q: adding VLAN 0 to HW filter on device eth03886worker1 # [ 11.126737] dhcpcd[691]: eth0: waiting for carrier3887worker1 # [ 11.127615] dhcpcd[691]: eth0: carrier acquired3888worker1 # [ 11.135974] dhcpcd[691]: DUID 00:01:00:01:32:42:77:27:52:54:00:12:34:563889worker1 # [ 11.137288] dhcpcd[691]: eth0: IAID 00:12:34:563890worker1 # [ 11.137947] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:34563891client: (finished: waiting for unit network-addresses-eth1.service, in 11.78 seconds)3892client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3893client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3894lb: waiting for unit network-addresses-eth1.service3895lb: waiting for the VM to finish booting3896lb: Guest shell says: b'Spawning backdoor root shell...\n'3897lb: connected to guest root shell3898lb: (connecting took 0.00 seconds)3899lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3900lb: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds)3901lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3902lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3903worker1: waiting for unit network-addresses-eth1.service3904worker1: waiting for the VM to finish booting3905worker1: Guest shell says: b'Spawning backdoor root shell...\n'3906worker1: connected to guest root shell3907worker1: (connecting took 0.00 seconds)3908worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3909worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3910worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3911worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3912worker2: waiting for unit network-addresses-eth1.service3913worker2: waiting for the VM to finish booting3914worker2: Guest shell says: b'Spawning backdoor root shell...\n'3915worker2: connected to guest root shell3916worker2: (connecting took 0.00 seconds)3917worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3918worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3919worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3920worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3921lb: waiting for unit niks3.service3922worker2 # [ 11.563963] dhcpcd[692]: eth0: soliciting an IPv6 router3923worker2 # [ 11.565236] dhcpcd[692]: eth0: Router Advertisement from fe80::23924worker2 # [ 11.566079] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643925worker2 # [ 11.566907] dhcpcd[692]: eth0: adding route to fec0::/643926worker2 # [ 11.567694] dhcpcd[692]: eth0: adding default route via fe80::23927lb # [ 11.759672] dhcpcd[721]: eth0: soliciting an IPv6 router3928lb # [ 11.761400] dhcpcd[721]: eth0: Router Advertisement from fe80::23929lb # [ 11.762313] dhcpcd[721]: eth0: adding address fec0::5054:ff:fe12:3456/643930lb # [ 11.763373] dhcpcd[721]: eth0: adding route to fec0::/643931lb # [ 11.764212] dhcpcd[721]: eth0: adding default route via fe80::23932lb # [ 12.120671] dhcpcd[721]: eth0: soliciting a DHCP lease3933lb # [ 12.275828] NET: Registered PF_PACKET protocol family3934lb # [ 12.149335] dhcpcd[721]: eth0: offered 10.0.2.15 from 10.0.2.23935lb # [ 12.152166] dhcpcd[721]: eth0: probing address 10.0.2.15/243936lb # [ 12.311599] postgresql-pre-start[734]: selecting default time zone ... UTC3937lb # [ 12.316265] postgresql-pre-start[734]: creating configuration files ... ok3938worker1 # [ 12.394955] dhcpcd[691]: eth0: soliciting an IPv6 router3939worker1 # [ 12.398339] dhcpcd[691]: eth0: Router Advertisement from fe80::23940worker1 # [ 12.400530] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/643941worker1 # [ 12.402859] dhcpcd[691]: eth0: adding route to fec0::/643942worker1 # [ 12.404757] dhcpcd[691]: eth0: adding default route via fe80::23943lb # [ 12.524347] postgresql-pre-start[734]: running bootstrap script ... ok3944client # [ 12.581582] dhcpcd[566]: eth0: soliciting an IPv6 router3945client # [ 12.584336] dhcpcd[566]: eth0: Router Advertisement from fe80::23946client # [ 12.586740] dhcpcd[566]: eth0: adding address fec0::5054:ff:fe12:3456/643947client # [ 12.589077] dhcpcd[566]: eth0: adding route to fec0::/643948client # [ 12.590886] dhcpcd[566]: eth0: adding default route via fe80::23949worker1 # [ 12.623901] dhcpcd[691]: eth0: soliciting a DHCP lease3950worker1 # [ 12.784870] NET: Registered PF_PACKET protocol family3951worker1 # [ 12.655755] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.23952worker1 # [ 12.659499] dhcpcd[691]: eth0: probing address 10.0.2.15/243953lb # [ 13.071947] postgresql-pre-start[734]: performing post-bootstrap initialization ... ok3954lb # [ 13.254961] postgresql-pre-start[734]: syncing data to disk ... ok3955lb # [ 13.256059] postgresql-pre-start[734]: initdb: warning: enabling "trust" authentication for local connections3956lb # [ 13.258199] postgresql-pre-start[734]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3957lb # [ 13.260158] postgresql-pre-start[734]: Success. You can now start the database server using:3958lb # [ 13.261240] postgresql-pre-start[734]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3959lb # [ 13.368399] postgres[795]: [795] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3960lb # [ 13.372885] postgres[795]: [795] LOG: listening on IPv6 address "::1", port 54323961lb # [ 13.373974] postgres[795]: [795] LOG: listening on IPv4 address "127.0.0.1", port 54323962lb # [ 13.379630] postgres[795]: [795] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3963lb # [ 13.392337] postgres[804]: [804] LOG: database system was shut down at 2026-09-20 10:51:20 GMT3964lb # [ 13.399473] postgres[795]: [795] LOG: database system is ready to accept connections3965lb # [ 13.403381] systemd[1]: Started PostgreSQL Server.3966lb # [ 13.410256] systemd[1]: Starting PostgreSQL Setup Scripts...3967lb # [ 13.589737] postgresql-setup-start[815]: CREATE DATABASE3968lb # [ 13.648313] postgresql-setup-start[824]: CREATE ROLE3969lb # [ 13.676411] postgresql-setup-start[826]: ALTER DATABASE3970lb # [ 13.681142] systemd[1]: Finished PostgreSQL Setup Scripts.3971lb # [ 13.683520] systemd[1]: Reached target PostgreSQL.3972worker2 # [ 15.644507] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3973worker2 # [ 15.647341] dhcpcd[692]: eth0: adding route to 10.0.2.0/243974worker2 # [ 15.649530] dhcpcd[692]: eth0: adding default route via 10.0.2.23975worker2 # [ 15.769634] systemd[1]: Started DHCP Client.3976worker2 # [ 15.771577] systemd[1]: Reached target Multi-User System.3977worker2 # [ 15.772664] systemd[1]: Startup finished in 861ms (kernel) + 3.908s (initrd) + 11.001s (userspace) = 15.772s.3978client # [ 15.951704] dhcpcd[566]: eth0: leased 10.0.2.15 for 86400 seconds3979client # [ 15.952638] dhcpcd[566]: eth0: adding route to 10.0.2.0/243980client # [ 15.953371] dhcpcd[566]: eth0: adding default route via 10.0.2.23981client # [ 16.041166] systemd[1]: Started DHCP Client.3982client # [ 16.043190] systemd[1]: Reached target Multi-User System.3983client # [ 16.044281] systemd[1]: Startup finished in 845ms (kernel) + 4.845s (initrd) + 10.353s (userspace) = 16.044s.3984lb # [ 16.901982] dhcpcd[721]: eth0: leased 10.0.2.15 for 86400 seconds3985lb # [ 16.906077] dhcpcd[721]: eth0: adding route to 10.0.2.0/243986lb # [ 16.907880] dhcpcd[721]: eth0: adding default route via 10.0.2.23987lb # [ 17.029280] systemd[1]: Started DHCP Client.3988lb # [ 17.031198] systemd[1]: Reached target Network is Online.3989lb # [ 17.035213] systemd[1]: Started Envoy reverse proxy.3990lb # [ 17.038494] systemd[1]: Started mock-oidc.service.3991lb # [ 17.135790] mock-oidc-server[923]: Mock OIDC Server running3992lb # [ 17.136779] mock-oidc-server[923]: OIDC Address: 192.168.1.2:80803993lb # [ 17.137872] mock-oidc-server[923]: Issue Address: 0.0.0.0:80813994lb # [ 17.139039] mock-oidc-server[923]: Issuer: http://192.168.1.2:8080/oidc3995lb # [ 17.139900] mock-oidc-server[923]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3996lb # [ 17.141189] mock-oidc-server[923]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3997lb # [ 17.142638] mock-oidc-server[923]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3998lb # [ 17.531699] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3999lb # [ 17.533450] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:469] statically linked extensions:4000lb # [ 17.534849] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4001lb # [ 17.536633] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4002lb # [ 17.538651] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4003lb # [ 17.541232] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4004lb # [ 17.543519] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4005lb # [ 17.545339] envoy[922]: [2026-09-20 10:51:25.461][922][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4006lb # [ 17.548217] envoy[922]: [2026-09-20 10:51:25.466][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4007lb # [ 17.550198] envoy[922]: [2026-09-20 10:51:25.466][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24008lb # [ 17.551734] envoy[922]: [2026-09-20 10:51:25.466][922][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4009lb # [ 17.555645] envoy[922]: [2026-09-20 10:51:25.466][922][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4010lb # [ 17.588512] envoy[922]: [2026-09-20 10:51:25.466][922][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4011lb # [ 17.593261] envoy[922]: [2026-09-20 10:51:25.468][922][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4012lb # [ 17.596676] envoy[922]: [2026-09-20 10:51:25.468][922][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4013lb # [ 17.599291] envoy[922]: [2026-09-20 10:51:25.468][922][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4014lb # [ 17.601499] envoy[922]: [2026-09-20 10:51:25.471][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4015lb # [ 17.605208] envoy[922]: [2026-09-20 10:51:25.471][922][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4016lb # [ 17.607548] envoy[922]: [2026-09-20 10:51:25.471][922][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4017lb # [ 17.610292] envoy[922]: [2026-09-20 10:51:25.471][922][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4018lb # [ 17.612213] envoy[922]: [2026-09-20 10:51:25.471][922][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84019lb # [ 17.614077] envoy[922]: [2026-09-20 10:51:25.471][922][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4020lb # [ 17.615910] envoy[922]: [2026-09-20 10:51:25.471][922][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4021lb # [ 17.617477] envoy[922]: [2026-09-20 10:51:25.473][922][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4022lb # [ 17.623620] envoy[922]: [2026-09-20 10:51:25.473][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4023lb # [ 17.625619] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4024lb # [ 17.627776] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4025lb # [ 17.629498] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4026lb # [ 17.631621] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4027lb # [ 17.633250] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4028lb # [ 17.635952] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4029lb # [ 17.637880] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4030lb # [ 17.639577] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4031lb # [ 17.641859] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4032lb # [ 17.643476] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4033lb # [ 17.649184] envoy[922]: [2026-09-20 10:51:25.475][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4034lb # [ 17.650994] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4035lb # [ 17.653805] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4036lb # [ 17.657131] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4037lb # [ 17.659923] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4038lb # [ 17.661846] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4039lb # [ 17.665489] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4040lb # [ 17.667354] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4041lb # [ 17.673336] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4042lb # [ 17.674826] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4043lb # [ 17.676603] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4044lb # [ 17.680846] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4045lb # [ 17.682869] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4046lb # [ 17.684879] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4047lb # [ 17.687769] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4048lb # [ 17.689395] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4049lb # [ 17.692396] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4050lb # [ 17.696808] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4051lb # [ 17.698515] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4052lb # [ 17.701160] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4053lb # [ 17.702851] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4054lb # [ 17.704373] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4055lb # [ 17.706853] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4056lb # [ 17.708870] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4057lb # [ 17.714202] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4058lb # [ 17.716126] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4059lb # [ 17.718286] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4060lb # [ 17.722600] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4061lb # [ 17.724449] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4062lb # [ 17.728503] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4063lb # [ 17.730290] envoy[922]: [2026-09-20 10:51:25.477][922][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4064lb # [ 17.732703] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4065lb # [ 17.735519] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24066lb # [ 17.737739] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4067lb # [ 17.741773] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4068lb # [ 17.744148] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4069lb # [ 17.745918] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4070lb # [ 17.748425] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4071lb # [ 17.750881] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4072lb # [ 17.753214] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4073lb # [ 17.754920] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4074lb # [ 17.757079] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4075lb # [ 17.758720] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4076lb # [ 17.760210] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24077lb # [ 17.761769] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4078lb # [ 17.764164] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4079lb # [ 17.765873] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4080lb # [ 17.768460] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4081lb # [ 17.770143] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4082lb # [ 17.776952] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4083lb # [ 17.778591] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4084lb # [ 17.789495] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4085lb # [ 17.793471] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4086lb # [ 17.795946] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4087lb # [ 17.798933] envoy[922]: [2026-09-20 10:51:25.478][922][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4088lb # [ 17.801277] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4089lb # [ 17.802783] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14090lb # [ 17.804837] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4091lb # [ 17.806765] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4092lb # [ 17.808606] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4093lb # [ 17.814981] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4094lb # [ 17.817698] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4095lb # [ 17.826727] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4096lb # [ 17.832148] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4097lb # [ 17.833898] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4098lb # [ 17.835549] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4099lb # [ 17.837191] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4100lb # [ 17.839509] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4101lb # [ 17.842907] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4102lb # [ 17.845047] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4103lb # [ 17.846733] envoy[922]: [2026-09-20 10:51:25.510][922][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4104lb # [ 17.848598] envoy[922]: [2026-09-20 10:51:25.636][922][info][main] [source/server/server.cc:531] HTTP header map info:4105lb # [ 17.849820] envoy[922]: [2026-09-20 10:51:25.680][922][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4106lb # [ 17.862324] envoy[922]: [2026-09-20 10:51:25.680][922][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4107lb # [ 17.863661] envoy[922]: [2026-09-20 10:51:25.680][922][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4108lb # [ 17.871035] envoy[922]: [2026-09-20 10:51:25.680][922][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4109lb # [ 17.901665] envoy[922]: [2026-09-20 10:51:25.831][922][info][main] [source/server/server.cc:968] runtime: {}4110lb # [ 17.906938] envoy[922]: [2026-09-20 10:51:25.836][922][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4111lb # [ 17.908862] envoy[922]: [2026-09-20 10:51:25.838][922][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014112lb # [ 17.911288] envoy[922]: [2026-09-20 10:51:25.841][922][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014113lb # [ 17.913752] envoy[922]: [2026-09-20 10:51:25.843][922][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4114lb # [ 17.915379] envoy[922]: [2026-09-20 10:51:25.845][922][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4115lb # [ 17.916922] envoy[922]: [2026-09-20 10:51:25.845][922][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4116lb # [ 17.953829] envoy[922]: [2026-09-20 10:51:25.883][922][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4117worker2 # [ 17.964601] systemd[1]: Starting Nix worker-protocol over gRPC...4118worker1 # [ 17.997946] systemd[1]: Starting Nix worker-protocol over gRPC...4119lb # [ 17.970814] envoy[922]: [2026-09-20 10:51:25.900][922][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4120lb # [ 17.973045] envoy[922]: [2026-09-20 10:51:25.903][922][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4121lb # [ 17.975801] envoy[922]: [2026-09-20 10:51:25.905][922][info][main] [source/server/server.cc:1077] starting main dispatch loop4122worker1 # [ 18.122777] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds4123worker1 # [ 18.123983] dhcpcd[691]: eth0: adding route to 10.0.2.0/244124worker1 # [ 18.125047] dhcpcd[691]: eth0: adding default route via 10.0.2.24125worker2 # [ 18.158178] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4126worker2 # [ 18.169770] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14127worker1 # [ 18.212218] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4128worker1 # [ 18.225536] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14129worker2 # [ 18.209416] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4130worker2 # [ 18.213652] systemd[1]: Started Nix worker-protocol over gRPC.4131worker1 # [ 18.261080] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4132worker1 # [ 18.265364] systemd[1]: Started Nix worker-protocol over gRPC.4133lb # [ 18.258862] envoy[922]: [2026-09-20 10:51:26.188][922][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4134lb # [ 18.263321] envoy[922]: [2026-09-20 10:51:26.193][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4135lb # [ 18.267582] envoy[922]: [2026-09-20 10:51:26.193][922][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4136worker1 # [ 18.312217] systemd[1]: Started DHCP Client.4137lb # [ 18.272184] envoy[922]: [2026-09-20 10:51:26.197][922][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4138worker1 # [ 18.315199] systemd[1]: Reached target Multi-User System.4139worker1 # [ 18.316281] systemd[1]: Startup finished in 856ms (kernel) + 5.040s (initrd) + 12.418s (userspace) = 18.314s.4140worker2 # [ 18.301424] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 18.334969] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=scheduler_connected addr=lb:500514142worker1 # [ 18.343079] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4143worker2 # [ 18.311285] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4144worker1 # [ 18.544286] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=scheduler_connected addr=lb:500514145worker2 # [ 18.512412] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=scheduler_connected addr=lb:500514146worker1 # [ 18.548978] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4147worker2 # [ 18.516970] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4148worker1 # [ 18.749657] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=scheduler_connected addr=lb:500514149worker2 # [ 18.717571] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_connected addr=lb:500514150worker1 # [ 18.753514] nix-grpc-daemon[728]: ts=2026-09-20T10:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4151worker2 # [ 18.722080] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4152worker1 # [ 18.954509] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514153worker2 # [ 18.922731] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_connected addr=lb:500514154worker1 # [ 18.958449] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4155worker2 # [ 18.926687] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4156worker1 # [ 19.159310] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514157worker2 # [ 19.127620] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_connected addr=lb:500514158worker1 # [ 19.163247] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4159worker2 # [ 19.131509] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4160worker1 # [ 19.364757] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514161worker2 # [ 19.333743] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_connected addr=lb:500514162worker1 # [ 19.368696] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4163worker2 # [ 19.336881] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4164worker2 # [ 19.534661] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 19.570138] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514166worker2 # [ 19.538684] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4167worker1 # [ 19.573858] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4168worker2 # [ 19.739821] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 19.771294] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514170worker2 # [ 19.743691] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4171worker1 # [ 19.775916] nix-grpc-daemon[728]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4172worker2 # [ 19.944241] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514173worker2 # [ 19.946140] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4174worker1 # [ 19.976783] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514175worker1 # [ 19.981480] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4176worker2 # [ 20.146821] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 20.148611] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4178worker1 # [ 20.182432] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514179worker1 # [ 20.186336] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4180worker2 # [ 20.349449] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 20.351119] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4182worker1 # [ 20.388385] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514183worker1 # [ 20.391421] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4184worker2 # [ 20.552097] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 20.588613] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514186worker2 # [ 20.556109] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4187worker1 # [ 20.590632] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4188worker2 # [ 20.756807] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 20.791578] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514190worker2 # [ 20.760711] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4191worker1 # [ 20.795331] nix-grpc-daemon[728]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4192worker2 # [ 20.961157] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514193worker2 # [ 20.962890] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4194worker1 # [ 20.996342] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514195worker1 # [ 21.000114] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4196worker2 # [ 21.163446] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514197worker2 # [ 21.165496] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4198worker1 # [ 21.200855] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514199worker1 # [ 21.204687] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4200worker2 # [ 21.366358] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 21.368094] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4202worker1 # [ 21.406580] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514203worker1 # [ 21.410293] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4204worker2 # [ 21.568551] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514205worker2 # [ 21.570345] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4206worker1 # [ 21.610971] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514207worker1 # [ 21.614881] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4208worker2 # [ 21.771246] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514209worker2 # [ 21.775116] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4210worker1 # [ 21.815762] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 21.819575] nix-grpc-daemon[728]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4212worker2 # [ 21.976070] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514213worker2 # [ 21.980359] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4214worker1 # [ 22.020307] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514215worker1 # [ 22.024293] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4216worker2 # [ 22.180870] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514217worker2 # [ 22.184783] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4218worker1 # [ 22.225456] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514219worker1 # [ 22.229570] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4220worker2 # [ 22.385381] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_connected addr=lb:500514221worker2 # [ 22.387145] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4222worker1 # [ 22.431689] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514223worker1 # [ 22.434975] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4224worker2 # [ 22.587915] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 22.592320] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4226worker1 # [ 22.632611] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514227worker1 # [ 22.636798] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4228worker2 # [ 22.792780] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514229worker2 # [ 22.795126] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4230worker1 # [ 22.837320] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514231worker1 # [ 22.839372] nix-grpc-daemon[728]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4232worker2 # [ 22.996087] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514233worker2 # [ 22.999861] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4234worker1 # [ 23.040052] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514235worker1 # [ 23.043476] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4236worker2 # [ 23.200679] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 23.204499] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4238worker1 # [ 23.244298] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514239worker1 # [ 23.248738] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4240lb # [ 23.343241] rustfs-bucket-start[986]: mb s3://farm4241lb # [ 23.349344] systemd[1]: Finished rustfs-bucket.service.4242lb # [ 23.355935] systemd[1]: Starting niks3 server...4243worker2 # [ 23.406210] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_connected addr=lb:500514244worker2 # [ 23.409754] nix-grpc-daemon[784]: ts=2026-09-20T10:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4245worker1 # [ 23.449574] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 23.452121] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4247lb # [ 23.578352] postgres[1005]: [1005] ERROR: relation "goose_db_version" does not exist at character 364248lb # [ 23.579662] postgres[1005]: [1005] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4249worker2 # [ 23.610730] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514250worker2 # [ 23.614588] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4251worker1 # [ 23.653243] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514252lb # [ 23.617787] niks3-server[995]: 2026/09/20 10:51:31 OK 20241026095416_initial_model.sql (20.71ms)4253worker1 # [ 23.657214] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4254lb # [ 23.621703] niks3-server[995]: 2026/09/20 10:51:31 OK 20251210153512_drop_unused_gin_index.sql (2.23ms)4255lb # [ 23.626476] niks3-server[995]: 2026/09/20 10:51:31 OK 20251218171726_add_pins.sql (4.72ms)4256lb # [ 23.631187] niks3-server[995]: 2026/09/20 10:51:31 OK 20260628120000_add_object_size_and_stats.sql (4.79ms)4257lb # [ 23.635741] niks3-server[995]: 2026/09/20 10:51:31 OK 20260905000000_add_claims.sql (3.1ms)4258lb # [ 23.639748] niks3-server[995]: 2026/09/20 10:51:31 OK 20260920000000_drop_claims.sql (3.92ms)4259lb # [ 23.640973] niks3-server[995]: 2026/09/20 10:51:31 goose: successfully migrated database to version: 202609200000004260lb # [ 23.646141] niks3-server[995]: 2026/09/20 10:51:31 OK 1_commit_pending_closure.sql (6.46ms)4261lb # [ 23.648880] niks3-server[995]: 2026/09/20 10:51:31 OK 2_object_stats_trigger.sql (1.42ms)4262lb # [ 23.650141] niks3-server[995]: 2026/09/20 10:51:31 goose: up to current file version: 24263lb # [ 23.656549] niks3-server[995]: 2026/09/20 10:51:31 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4264lb # [ 23.728490] niks3-server[995]: 2026/09/20 10:51:31 INFO Read proxy enabled — serving cache objects from S34265lb # [ 23.730467] niks3-server[995]: 2026/09/20 10:51:31 INFO Using socket-activated listener address=0.0.0.0:57514266lb # [ 23.735069] niks3-server[995]: 2026/09/20 10:51:31 INFO systemd watchdog enabled interval=15s4267lb # [ 23.737049] systemd[1]: Started niks3 server.4268lb # [ 23.737644] systemd[1]: Reached target Multi-User System.4269lb # [ 23.739959] niks3-server[995]: 2026/09/20 10:51:31 INFO Starting HTTP server address=0.0.0.0:57514270lb # [ 23.741725] systemd[1]: Startup finished in 843ms (kernel) + 4.151s (initrd) + 18.744s (userspace) = 23.739s.4271lb # [ 23.746310] niks3-server[995]: 2026/09/20 10:51:31 INFO lead: acquired remote=192.168.1.3:578984272worker1 # [ 23.791497] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_take_over4273worker2 # [ 23.815493] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514274worker2 # [ 23.820079] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4275worker1 # [ 23.857750] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514276worker1 # [ 23.862372] nix-grpc-daemon[728]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4277worker2 # [ 24.020924] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514278worker2 # [ 24.024838] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4279worker1 # [ 24.063333] nix-grpc-daemon[728]: ts=2026-09-20T10:51:32Z level=info event=scheduler_connected addr=lb:500514280worker1 # [ 24.067334] nix-grpc-daemon[728]: ts=2026-09-20T10:51:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4281worker2 # [ 24.225651] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514282worker2 # [ 24.229442] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4283worker1 # [ 24.267958] nix-grpc-daemon[728]: ts=2026-09-20T10:51:32Z level=info event=scheduler_connected addr=lb:500514284worker1 # [ 24.272167] nix-grpc-daemon[728]: ts=2026-09-20T10:51:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4285worker2 # [ 24.431152] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 24.476590] nix-grpc-daemon[728]: ts=2026-09-20T10:51:32Z level=info event=scheduler_connected addr=lb:500514287worker1 # [ 24.480587] nix-grpc-daemon[728]: ts=2026-09-20T10:51:32Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04288worker1 # [ 24.486640] nix-grpc-daemon[728]: ts=2026-09-20T10:51:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04289lb: (finished: waiting for unit niks3.service, in 13.09 seconds)4290lb: waiting for TCP port 5751 on localhost4291lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4292lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4293lb: waiting for unit envoy.service4294lb: (finished: waiting for unit envoy.service, in 0.07 seconds)4295lb: waiting for TCP port 50051 on localhost4296lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4297lb # [ 24.720774] envoy[922]: conn peer=[::1]:35692 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34298lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4299lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4300lb: must succeed: curl -sf localhost:9901/clusters4301lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4302lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4303subtest: one node schedules and both builders hold a WorkerSession on it4304lb: must succeed: curl -sf localhost:9901/clusters4305lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4306worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4307worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4308(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.12 seconds)4309subtest: balancer auth: client cert, bearer token, nothing, unknown CN4310worker2 # [ 25.352278] nix-grpc-daemon[784]: ts=2026-09-20T10:51:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:409684311worker2 # [ 25.365489] systemd[1]: Started Nix Daemon.4312worker2 # [ 25.585252] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4313worker2 # [ 25.638162] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)4314worker2 # [ 25.680577] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5)4315worker2 # [ 25.823414] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 387 ms (attempt 3/5)4316worker2 # [ 26.216226] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 751 ms (attempt 4/5)4317worker2 # [ 26.974826] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4318worker2 # [ 27.005108] nix-grpc-daemon[784]: ts=2026-09-20T10:51:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:409684319worker2 # [ 27.023252] nix-grpc-daemon[784]: ts=2026-09-20T10:51:34Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4320worker1 # [ 27.072892] nix-grpc-daemon[728]: ts=2026-09-20T10:51:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:331204321worker1 # [ 27.085794] systemd[1]: Started Nix Daemon.4322worker1 # [ 27.296295] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4323worker1 # [ 27.326785] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5)4324worker1 # [ 27.420629] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 2/5)4325worker1 # [ 27.584780] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 3/5)4326worker1 # [ 27.634382] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 779 ms (attempt 4/5)4327worker1 # [ 28.423284] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4328worker1 # [ 28.443171] nix-grpc-daemon[728]: ts=2026-09-20T10:51:36Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4329client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4330client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.07 seconds)4331client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4332client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4333worker1 # [ 28.756932] nix-grpc-daemon[728]: ts=2026-09-20T10:51:36Z level=info event=oidc_jwks provider=mock keys=14334worker1 # [ 28.762182] nix-grpc-daemon[728]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:331204335worker1 # [ 28.781244] nix-grpc-daemon[728]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:331204336worker1 # [ 28.790378] nix-grpc-daemon[728]: ts=2026-09-20T10:51:36Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4337worker2 # [ 28.776820] nix-grpc-daemon[784]: ts=2026-09-20T10:51:36Z level=info event=oidc_jwks provider=mock keys=14338worker2 # [ 28.781256] nix-grpc-daemon[784]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:409684339worker2 # [ 28.788352] nix-grpc-daemon[784]: ts=2026-09-20T10:51:36Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4340client: must succeed: rm -r /var/lib/nix-grpc-store4341client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4342worker1 # [ 29.028852] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=info event=denied method=QueryMissing cn=- role=none4343worker2 # [ 29.192209] nix-grpc-daemon[784]: ts=2026-09-20T10:51:36Z level=info event=denied method=QueryMissing cn=stranger role=none4344(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.16 seconds)4345subtest: DAG build is scheduled across workers and lands in the cache4346client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24347worker2 # [ 29.407457] nix-grpc-daemon[784]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:409684348client # don't know how to build these paths:4349client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4350worker1 # [ 29.453552] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204351worker1 # [ 29.488434] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04352worker1 # [ 29.493308] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14353worker1 # [ 29.537462] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204354worker1 # [ 29.553226] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204355client # copying 1 paths to 'lb:50051'...4356worker1 # [ 29.564491] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331204357client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4358worker1 # [ 29.592926] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4359worker1 # [ 29.618602] nix-grpc-daemon[728]: ts=2026-09-20T10:51:37Z level=info event=niks3_push_started pid=8544360worker1 # [ 30.042573] nix-daemon[842]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4361worker1 # [ 30.056627] nix-daemon[842]: reaped child process 869, status = succeeded4362worker1 # [ 30.217085] nix-daemon[842]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4363worker1 # [ 30.228967] nix-daemon[842]: reaped child process 875, status = succeeded4364lb # [ 30.207819] niks3-server[995]: 2026/09/20 10:51:38 INFO Received uploads request method=POST path=/api/pending_closures4365worker1 # [ 30.275424] nix-grpc-daemon[854]: time=2026-09-20T10:51:38.364Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4366worker1 # [ 30.278578] nix-grpc-daemon[854]: time=2026-09-20T10:51:38.368Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4367lb # [ 30.281318] niks3-server[995]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4368lb # [ 30.284058] niks3-server[995]: 2026/09/20 10:51:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4369lb # [ 30.290065] niks3-server[995]: 2026/09/20 10:51:38 INFO Signed narinfos id=1 count=14370worker1 # [ 30.331315] nix-grpc-daemon[854]: time=2026-09-20T10:51:38.421Z level=INFO msg="Uploading 1 narinfos"4371lb # [ 30.299546] niks3-server[995]: 2026/09/20 10:51:38 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4372lb # [ 30.305575] niks3-server[995]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4373worker1 # [ 30.360253] nix-grpc-daemon[854]: time=2026-09-20T10:51:38.450Z level=INFO msg="Upload complete. (486ms)"4374lb # [ 30.321201] niks3-server[995]: 2026/09/20 10:51:38 INFO Completed upload id=14375worker1 # [ 30.362456] nix-grpc-daemon[728]: ts=2026-09-20T10:51:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=5044376worker1 # [ 30.365526] nix-grpc-daemon[728]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204377lb # [ 30.328912] niks3-server[995]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4378worker1 # [ 30.370912] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4379worker1 # [ 30.377121] nix-daemon[842]: reaped child process 852, status = succeeded4380client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4381client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4382worker1 # [ 30.380344] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4383client # farm-a> LOG-farm-a-t14384worker1 # [ 31.602613] nix-daemon[842]: reaped child process 880, status = succeeded4385worker1 # [ 31.730903] nix-daemon[842]: accepted connection from pid 895, user nix-grpc-daemon (trusted)4386worker1 # [ 31.743191] nix-daemon[842]: reaped child process 898, status = succeeded4387lb # [ 31.715373] niks3-server[995]: 2026/09/20 10:51:39 INFO Received uploads request method=POST path=/api/pending_closures4388worker1 # [ 31.767305] nix-grpc-daemon[854]: time=2026-09-20T10:51:39.857Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4389worker1 # [ 31.768779] nix-grpc-daemon[854]: time=2026-09-20T10:51:39.859Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4390lb # [ 31.761744] niks3-server[995]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4391lb # [ 31.770647] niks3-server[995]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4392lb # [ 31.781989] niks3-server[995]: 2026/09/20 10:51:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4393worker1 # [ 31.827515] nix-grpc-daemon[854]: time=2026-09-20T10:51:39.917Z level=INFO msg="Uploading 1 narinfos"4394lb # [ 31.788099] niks3-server[995]: 2026/09/20 10:51:39 INFO Signed narinfos id=2 count=14395lb # [ 31.792953] niks3-server[995]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4396lb # [ 31.801149] niks3-server[995]: 2026/09/20 10:51:39 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4397lb # [ 31.805193] niks3-server[995]: 2026/09/20 10:51:39 INFO Completed upload id=24398worker1 # [ 31.844262] nix-grpc-daemon[854]: time=2026-09-20T10:51:39.934Z level=INFO msg="Upload complete. (254ms)"4399lb # [ 31.806584] niks3-server[995]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4400worker1 # [ 31.851310] nix-grpc-daemon[728]: ts=2026-09-20T10:51:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14401worker1 # [ 31.868244] nix-grpc-daemon[728]: ts=2026-09-20T10:51:39Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04402worker1 # [ 31.870305] nix-grpc-daemon[728]: ts=2026-09-20T10:51:39Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14403worker1 # [ 31.872421] nix-daemon[842]: reaped child process 878, status = succeeded4404worker1 # [ 31.915522] nix-grpc-daemon[728]: ts=2026-09-20T10:51:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204405worker1 # [ 31.927736] nix-grpc-daemon[728]: ts=2026-09-20T10:51:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204406worker1 # [ 31.940936] nix-grpc-daemon[854]: time=2026-09-20T10:51:40.031Z level=INFO msg="All 1 paths already cached"4407client # copying 1 paths to 'lb:50051'...4408client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4409worker1 # [ 31.947761] nix-grpc-daemon[728]: ts=2026-09-20T10:51:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331204410worker1 # [ 31.958948] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4411worker1 # [ 32.123930] nix-daemon[842]: accepted connection from pid 904, user nix-grpc-daemon (trusted)4412worker1 # [ 32.137516] nix-daemon[842]: reaped child process 907, status = succeeded4413worker1 # [ 32.293401] nix-daemon[842]: accepted connection from pid 909, user nix-grpc-daemon (trusted)4414worker1 # [ 32.305577] nix-daemon[842]: reaped child process 912, status = succeeded4415lb # [ 32.281926] niks3-server[995]: 2026/09/20 10:51:40 INFO Received uploads request method=POST path=/api/pending_closures4416worker1 # [ 32.336658] nix-grpc-daemon[854]: time=2026-09-20T10:51:40.426Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4417worker1 # [ 32.338191] nix-grpc-daemon[854]: time=2026-09-20T10:51:40.426Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4418lb # [ 32.318125] niks3-server[995]: 2026/09/20 10:51:40 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4419lb # [ 32.328644] niks3-server[995]: 2026/09/20 10:51:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4420worker1 # [ 32.373420] nix-grpc-daemon[854]: time=2026-09-20T10:51:40.463Z level=INFO msg="Uploading 1 narinfos"4421lb # [ 32.334131] niks3-server[995]: 2026/09/20 10:51:40 INFO Signed narinfos id=3 count=14422lb # [ 32.340189] niks3-server[995]: 2026/09/20 10:51:40 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4423lb # [ 32.353460] niks3-server[995]: 2026/09/20 10:51:40 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4424lb # [ 32.360925] niks3-server[995]: 2026/09/20 10:51:40 INFO Completed upload id=34425worker1 # [ 32.403115] nix-grpc-daemon[854]: time=2026-09-20T10:51:40.493Z level=INFO msg="Upload complete. (431ms)"4426lb # [ 32.364465] niks3-server[995]: 2026/09/20 10:51:40 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4427worker1 # [ 32.407252] nix-grpc-daemon[728]: ts=2026-09-20T10:51:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=6244428worker1 # [ 32.413320] nix-grpc-daemon[728]: ts=2026-09-20T10:51:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204429worker1 # [ 32.425252] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4430worker1 # [ 32.432815] nix-daemon[842]: reaped child process 902, status = succeeded4431client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4432client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4433worker1 # [ 32.440533] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4434client # farm-b> LOG-farm-b-t14435worker1 # [ 33.867898] nix-daemon[842]: reaped child process 916, status = succeeded4436worker1 # [ 34.002965] nix-daemon[842]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4437worker1 # [ 34.014688] nix-daemon[842]: reaped child process 935, status = succeeded4438lb # [ 33.991622] niks3-server[995]: 2026/09/20 10:51:41 INFO Received uploads request method=POST path=/api/pending_closures4439worker1 # [ 34.039067] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.129Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4440worker1 # [ 34.040643] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.130Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4441lb # [ 34.022471] niks3-server[995]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4442lb # [ 34.038955] niks3-server[995]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4443lb # [ 34.046133] niks3-server[995]: 2026/09/20 10:51:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4444lb # [ 34.051473] niks3-server[995]: 2026/09/20 10:51:41 INFO Signed narinfos id=4 count=14445worker1 # [ 34.093374] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.183Z level=INFO msg="Uploading 1 narinfos"4446lb # [ 34.056464] niks3-server[995]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4447lb # [ 34.064885] niks3-server[995]: 2026/09/20 10:51:41 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4448lb # [ 34.073895] niks3-server[995]: 2026/09/20 10:51:42 INFO Completed upload id=44449worker1 # [ 34.113370] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.203Z level=INFO msg="Upload complete. (263ms)"4450lb # [ 34.075559] niks3-server[995]: 2026/09/20 10:51:42 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4451worker1 # [ 34.118745] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14452worker1 # [ 34.128636] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04453worker1 # [ 34.132424] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14454worker1 # [ 34.141175] nix-daemon[842]: reaped child process 914, status = succeeded4455worker1 # [ 34.172519] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204456worker1 # [ 34.184507] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204457worker1 # [ 34.196308] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.286Z level=INFO msg="All 2 paths already cached"4458client # copying 1 paths to 'lb:50051'...4459client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4460worker1 # [ 34.203306] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331204461worker1 # [ 34.211803] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4462worker1 # [ 34.348641] nix-daemon[842]: accepted connection from pid 941, user nix-grpc-daemon (trusted)4463worker1 # [ 34.362843] nix-daemon[842]: reaped child process 944, status = succeeded4464worker1 # [ 34.503254] nix-daemon[842]: accepted connection from pid 946, user nix-grpc-daemon (trusted)4465worker1 # [ 34.515265] nix-daemon[842]: reaped child process 949, status = succeeded4466lb # [ 34.490602] niks3-server[995]: 2026/09/20 10:51:42 INFO Received uploads request method=POST path=/api/pending_closures4467worker1 # [ 34.538089] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.628Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4468worker1 # [ 34.539606] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.630Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4469lb # [ 34.518338] niks3-server[995]: 2026/09/20 10:51:42 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4470lb # [ 34.530830] niks3-server[995]: 2026/09/20 10:51:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4471worker1 # [ 34.574945] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.665Z level=INFO msg="Uploading 1 narinfos"4472lb # [ 34.536147] niks3-server[995]: 2026/09/20 10:51:42 INFO Signed narinfos id=5 count=14473lb # [ 34.542362] niks3-server[995]: 2026/09/20 10:51:42 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4474lb # [ 34.555626] niks3-server[995]: 2026/09/20 10:51:42 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4475lb # [ 34.560339] niks3-server[995]: 2026/09/20 10:51:42 INFO Completed upload id=54476worker1 # [ 34.601699] nix-grpc-daemon[854]: time=2026-09-20T10:51:42.692Z level=INFO msg="Upload complete. (377ms)"4477lb # [ 34.563503] niks3-server[995]: 2026/09/20 10:51:42 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4478worker1 # [ 34.605436] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=7524479worker1 # [ 34.611265] nix-grpc-daemon[728]: ts=2026-09-20T10:51:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204480worker1 # [ 34.619602] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4481worker1 # [ 34.626958] nix-daemon[842]: reaped child process 939, status = succeeded4482worker1 # [ 34.632597] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4483client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4484client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4485client # farm-top> LOG-farm-top-t14486worker1 # [ 35.858972] nix-daemon[842]: reaped child process 953, status = succeeded4487worker1 # [ 35.984168] nix-daemon[842]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4488worker1 # [ 35.996310] nix-daemon[842]: reaped child process 971, status = succeeded4489lb # [ 35.974987] niks3-server[995]: 2026/09/20 10:51:43 INFO Received uploads request method=POST path=/api/pending_closures4490worker1 # [ 36.025078] nix-grpc-daemon[854]: time=2026-09-20T10:51:44.115Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4491worker1 # [ 36.026900] nix-grpc-daemon[854]: time=2026-09-20T10:51:44.117Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4492lb # [ 36.017638] niks3-server[995]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4493lb # [ 36.027707] niks3-server[995]: 2026/09/20 10:51:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4494lb # [ 36.034396] niks3-server[995]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4495lb # [ 36.041221] niks3-server[995]: 2026/09/20 10:51:43 INFO Signed narinfos id=6 count=14496worker1 # [ 36.080742] nix-grpc-daemon[854]: time=2026-09-20T10:51:44.170Z level=INFO msg="Uploading 1 narinfos"4497lb # [ 36.047082] niks3-server[995]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4498lb # [ 36.054835] niks3-server[995]: 2026/09/20 10:51:43 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4499lb # [ 36.064040] niks3-server[995]: 2026/09/20 10:51:43 INFO Completed upload id=64500worker1 # [ 36.103531] nix-grpc-daemon[854]: time=2026-09-20T10:51:44.193Z level=INFO msg="Upload complete. (263ms)"4501lb # [ 36.065971] niks3-server[995]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4502worker1 # [ 36.112341] nix-grpc-daemon[728]: ts=2026-09-20T10:51:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14503worker1 # [ 36.124780] nix-daemon[842]: reaped child process 951, status = succeeded4504client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.89 seconds)4505client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4506client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds)4507client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4508client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4509client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4510client # copying 3 paths...4511client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4512client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4513client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4514client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4515(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.38 seconds)4516subtest: repeat is answered Cached by the scheduler without building4517worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4518worker1 # finding garbage collector roots...4519worker1 # deleting specified paths...4520worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4521worker1 # deleting unused links...4522worker1 # note: hard linking is currently saving 0.0 KiB4523worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4524worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4525worker2 # finding garbage collector roots...4526worker2 # deleting specified paths...4527worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4528worker2 # deleting unused links...4529worker2 # note: hard linking is currently saving 0.0 KiB4530worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4531client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24532worker2 # [ 37.340339] nix-grpc-daemon[784]: ts=2026-09-20T10:51:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:409684533client # don't know how to build these paths:4534client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4535worker1 # [ 37.381875] nix-grpc-daemon[728]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204536worker1 # [ 37.391141] nix-grpc-daemon[854]: time=2026-09-20T10:51:45.480Z level=INFO msg="All 2 paths already cached"4537worker1 # [ 37.400888] nix-grpc-daemon[728]: ts=2026-09-20T10:51:45Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14538client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.27 seconds)4539client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4540client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds)4541lb: must succeed: curl -sf localhost:9901/clusters4542lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4543lb: must succeed: curl -sf localhost:9901/clusters4544lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4545worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4546worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4547(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.24 seconds)4548subtest: inputs already in the cache are not sent to the scheduler4549lb: must succeed: curl -sf localhost:9901/clusters4550lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4551lb: must succeed: curl -sf localhost:9901/clusters4552lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4553worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4554lb # [ 37.960037] envoy[922]: conn peer=[2001:db8:1::1]:60288 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=31174555lb # [ 37.961500] envoy[922]: conn peer=[2001:db8:1::1]:60300 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=944556lb # [ 37.962917] envoy[922]: conn peer=[2001:db8:1::1]:60314 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=64557lb # [ 37.964601] envoy[922]: conn peer=[2001:db8:1::1]:60330 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84558lb # [ 37.967407] envoy[922]: conn peer=[2001:db8:1::1]:60332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9511 tx=3835 ms=67124559lb # [ 37.969091] envoy[922]: conn peer=[2001:db8:1::1]:38918 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=424560worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4561client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24562worker2 # [ 38.153925] nix-grpc-daemon[784]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:409684563client # don't know how to build these paths:4564client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4565worker2 # [ 38.162315] nix-grpc-daemon[784]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:409684566worker1 # [ 38.220820] nix-grpc-daemon[728]: ts=2026-09-20T10:51:46Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04567worker1 # [ 38.226369] nix-grpc-daemon[728]: ts=2026-09-20T10:51:46Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14568worker1 # [ 38.264926] nix-grpc-daemon[728]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204569worker1 # [ 38.276846] nix-grpc-daemon[728]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204570worker1 # [ 38.289506] nix-grpc-daemon[854]: time=2026-09-20T10:51:46.379Z level=INFO msg="All 2 paths already cached"4571client # copying 1 paths to 'lb:50051'...4572client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4573worker1 # [ 38.298098] nix-grpc-daemon[728]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331204574worker1 # [ 38.306817] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4575worker1 # [ 38.478362] nix-daemon[842]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)4576worker1 # [ 38.491397] nix-daemon[842]: reaped child process 1004, status = succeeded4577worker1 # [ 38.651724] nix-daemon[842]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4578worker1 # [ 38.663614] nix-daemon[842]: reaped child process 1009, status = succeeded4579lb # [ 38.642477] niks3-server[995]: 2026/09/20 10:51:46 INFO Received uploads request method=POST path=/api/pending_closures4580worker1 # [ 38.688873] nix-grpc-daemon[854]: time=2026-09-20T10:51:46.779Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4581worker1 # [ 38.690366] nix-grpc-daemon[854]: time=2026-09-20T10:51:46.780Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4582lb # [ 38.670721] niks3-server[995]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4583lb # [ 38.681835] niks3-server[995]: 2026/09/20 10:51:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4584worker1 # [ 38.725757] nix-grpc-daemon[854]: time=2026-09-20T10:51:46.816Z level=INFO msg="Uploading 1 narinfos"4585lb # [ 38.686481] niks3-server[995]: 2026/09/20 10:51:46 INFO Signed narinfos id=7 count=14586lb # [ 38.692253] niks3-server[995]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4587lb # [ 38.703819] niks3-server[995]: 2026/09/20 10:51:46 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4588lb # [ 38.708878] niks3-server[995]: 2026/09/20 10:51:46 INFO Completed upload id=74589worker1 # [ 38.748345] nix-grpc-daemon[854]: time=2026-09-20T10:51:46.838Z level=INFO msg="Upload complete. (427ms)"4590lb # [ 38.713694] niks3-server[995]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4591worker1 # [ 38.753402] nix-grpc-daemon[728]: ts=2026-09-20T10:51:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=7524592worker1 # [ 38.757913] nix-grpc-daemon[728]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204593worker1 # [ 38.765852] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4594worker1 # [ 38.773154] nix-daemon[842]: reaped child process 999, status = succeeded4595worker1 # [ 38.776339] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4596client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4597client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4598client # farm-top> LOG-farm-top-t1b4599worker1 # [ 39.599577] nix-daemon[842]: reaped child process 1013, status = succeeded4600worker1 # [ 39.750670] nix-daemon[842]: accepted connection from pid 1028, user nix-grpc-daemon (trusted)4601worker1 # [ 39.764132] nix-daemon[842]: reaped child process 1031, status = succeeded4602lb # [ 39.735316] niks3-server[995]: 2026/09/20 10:51:47 INFO Received uploads request method=POST path=/api/pending_closures4603worker1 # [ 39.784883] nix-grpc-daemon[854]: time=2026-09-20T10:51:47.875Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4604worker1 # [ 39.786379] nix-grpc-daemon[854]: time=2026-09-20T10:51:47.876Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4605lb # [ 39.770133] niks3-server[995]: 2026/09/20 10:51:47 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4606lb # [ 39.783845] niks3-server[995]: 2026/09/20 10:51:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4607lb # [ 39.789249] niks3-server[995]: 2026/09/20 10:51:47 INFO Signed narinfos id=8 count=14608worker1 # [ 39.831942] nix-grpc-daemon[854]: time=2026-09-20T10:51:47.922Z level=INFO msg="Uploading 1 narinfos"4609lb # [ 39.797169] niks3-server[995]: 2026/09/20 10:51:47 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4610lb # [ 39.802077] niks3-server[995]: 2026/09/20 10:51:47 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4611lb # [ 39.811510] niks3-server[995]: 2026/09/20 10:51:47 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4612lb # [ 39.816576] niks3-server[995]: 2026/09/20 10:51:47 INFO Completed upload id=84613worker1 # [ 39.855983] nix-grpc-daemon[854]: time=2026-09-20T10:51:47.946Z level=INFO msg="Upload complete. (270ms)"4614lb # [ 39.819823] niks3-server[995]: 2026/09/20 10:51:47 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4615worker1 # [ 39.859415] nix-grpc-daemon[728]: ts=2026-09-20T10:51:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14616worker1 # [ 39.869761] nix-daemon[842]: reaped child process 1011, status = succeeded4617client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.89 seconds)4618client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4619client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.19 seconds)4620lb: must succeed: curl -sf localhost:9901/clusters4621lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4622lb: must succeed: curl -sf localhost:9901/clusters4623lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4624worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4625worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4626(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.37 seconds)4627subtest: two clients wanting the same drv build it once4628client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4629client # [ 40.286795] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4630client # Running as unit: dedup1.service; invocation ID: 56fa9d7783674b4a96d6dc30f676f6444631client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4632client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4633worker2 # [ 40.440559] nix-grpc-daemon[784]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:409684634client # [ 40.477069] nix[887]: don't know how to build these paths:4635client # [ 40.477888] nix[887]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4636worker1 # [ 40.482710] nix-grpc-daemon[728]: ts=2026-09-20T10:51:48Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04637worker1 # [ 40.484639] nix-grpc-daemon[728]: ts=2026-09-20T10:51:48Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14638worker2 # [ 40.456825] nix-grpc-daemon[784]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409684639worker2 # [ 40.470795] nix-grpc-daemon[784]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:409684640client # [ 40.509621] nix[887]: copying 1 paths to 'lb:50051'...4641client # [ 40.510463] nix[887]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4642worker2 # [ 40.479841] nix-grpc-daemon[784]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:409684643worker2 # [ 40.492450] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4644worker2 # [ 40.513790] nix-grpc-daemon[784]: ts=2026-09-20T10:51:47Z level=info event=niks3_push_started pid=8674645worker2 # [ 40.944353] nix-daemon[840]: accepted connection from pid 879, user nix-grpc-daemon (trusted)4646worker2 # [ 40.959545] nix-daemon[840]: reaped child process 882, status = succeeded4647worker2 # [ 41.116604] nix-daemon[840]: accepted connection from pid 885, user nix-grpc-daemon (trusted)4648worker2 # [ 41.129299] nix-daemon[840]: reaped child process 888, status = succeeded4649lb # [ 41.136340] niks3-server[995]: 2026/09/20 10:51:49 INFO Received uploads request method=POST path=/api/pending_closures4650worker2 # [ 41.153192] nix-grpc-daemon[867]: time=2026-09-20T10:51:48.619Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4651worker2 # [ 41.155575] nix-grpc-daemon[867]: time=2026-09-20T10:51:48.622Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4652lb # [ 41.176673] niks3-server[995]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4653lb # [ 41.183086] niks3-server[995]: 2026/09/20 10:51:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4654worker2 # [ 41.197241] nix-grpc-daemon[867]: time=2026-09-20T10:51:48.665Z level=INFO msg="Uploading 1 narinfos"4655lb # [ 41.190322] niks3-server[995]: 2026/09/20 10:51:49 INFO Signed narinfos id=9 count=14656lb # [ 41.195452] niks3-server[995]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4657lb # [ 41.204725] niks3-server[995]: 2026/09/20 10:51:49 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4658lb # [ 41.208838] niks3-server[995]: 2026/09/20 10:51:49 INFO Completed upload id=94659worker2 # [ 41.216212] nix-grpc-daemon[867]: time=2026-09-20T10:51:48.684Z level=INFO msg="Upload complete. (437ms)"4660lb # [ 41.210608] niks3-server[995]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4661worker2 # [ 41.218462] nix-grpc-daemon[784]: ts=2026-09-20T10:51:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=1 nar_bytes_in=4324662worker2 # [ 41.222689] nix-grpc-daemon[784]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409684663worker2 # [ 41.229437] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4664worker2 # [ 41.230690] nix-daemon[840]: reaped child process 865, status = succeeded4665worker2 # [ 41.236116] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4666client # [ 41.265864] nix[887]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4667client # [ 41.366678] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4668client # Running as unit: dedup2.service; invocation ID: 9b682ddc53df44ef89a8b2b21470ae264669client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4670client # [ 41.625719] nix[903]: don't know how to build these paths:4671client # [ 41.626633] nix[903]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4672worker1 # [ 41.626162] nix-grpc-daemon[728]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:331204673worker1 # [ 41.635641] nix-grpc-daemon[728]: ts=2026-09-20T10:51:49Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04674worker2 # [ 41.606823] nix-grpc-daemon[784]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409684675client # [ 41.642760] nix[903]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4676client: must succeed: sleep 24677client: (finished: must succeed: sleep 2, in 2.05 seconds)4678client: waiting for success: ! systemctl is-active dedup1 dedup24679worker2 # [ 44.850492] nix-daemon[840]: reaped child process 892, status = succeeded4680worker2 # [ 45.003100] nix-daemon[840]: accepted connection from pid 922, user nix-grpc-daemon (trusted)4681worker2 # [ 45.013299] nix-daemon[840]: reaped child process 925, status = succeeded4682lb # [ 45.025569] niks3-server[995]: 2026/09/20 10:51:52 INFO Received uploads request method=POST path=/api/pending_closures4683worker2 # [ 45.040396] nix-grpc-daemon[867]: time=2026-09-20T10:51:52.508Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4684worker2 # [ 45.042076] nix-grpc-daemon[867]: time=2026-09-20T10:51:52.510Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4685lb # [ 45.067855] niks3-server[995]: 2026/09/20 10:51:52 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4686lb # [ 45.078335] niks3-server[995]: 2026/09/20 10:51:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4687lb # [ 45.085525] niks3-server[995]: 2026/09/20 10:51:53 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4688lb # [ 45.090255] niks3-server[995]: 2026/09/20 10:51:53 INFO Signed narinfos id=10 count=14689worker2 # [ 45.100643] nix-grpc-daemon[867]: time=2026-09-20T10:51:52.567Z level=INFO msg="Uploading 1 narinfos"4690lb # [ 45.094864] niks3-server[995]: 2026/09/20 10:51:53 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4691lb # [ 45.103153] niks3-server[995]: 2026/09/20 10:51:53 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4692lb # [ 45.106961] niks3-server[995]: 2026/09/20 10:51:53 INFO Completed upload id=104693worker2 # [ 45.114631] nix-grpc-daemon[867]: time=2026-09-20T10:51:52.582Z level=INFO msg="Upload complete. (266ms)"4694lb # [ 45.108743] niks3-server[995]: 2026/09/20 10:51:53 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4695worker2 # [ 45.120505] nix-grpc-daemon[784]: ts=2026-09-20T10:51:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14696worker2 # [ 45.126408] nix-grpc-daemon[784]: ts=2026-09-20T10:51:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14697worker2 # [ 45.135599] nix-daemon[840]: reaped child process 890, status = succeeded4698client # [ 45.194244] systemd[1]: dedup1.service: Deactivated successfully.4699client # [ 45.198149] systemd[1]: dedup1.service: Consumed 101ms CPU time over 4.911s wall clock time, 37.3M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4700client # [ 45.205369] systemd[1]: dedup2.service: Deactivated successfully.4701client # [ 45.207761] systemd[1]: dedup2.service: Consumed 131ms CPU time over 3.838s wall clock time, 31.1M memory peak, 7.6K incoming IP traffic, 6.4K outgoing IP traffic.4702client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.10 seconds)4703client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4704client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4705worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4706worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4707worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4708worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4709worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4710worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4711worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4712worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4713(finished: subtest: two clients wanting the same drv build it once, in 5.96 seconds)4714subtest: build hook: nix-daemon with builders = grpc://lb4715client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4716client # [ 46.378955] systemd[1]: Started Nix Daemon.4717client # [ 46.536491] nix-daemon[946]: accepted connection from pid 943, user root (trusted)4718worker2 # [ 46.682675] nix-grpc-daemon[784]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:409684719worker1 # [ 46.720188] nix-grpc-daemon[728]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204720worker1 # [ 46.728845] nix-grpc-daemon[728]: ts=2026-09-20T10:51:54Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04721worker1 # [ 46.734158] nix-grpc-daemon[728]: ts=2026-09-20T10:51:54Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14722worker1 # [ 46.772714] nix-grpc-daemon[728]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204723worker1 # [ 46.784644] nix-grpc-daemon[728]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204724worker1 # [ 46.796538] nix-grpc-daemon[728]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331204725worker1 # [ 46.807361] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4726worker1 # [ 46.981637] nix-daemon[842]: accepted connection from pid 1069, user nix-grpc-daemon (trusted)4727worker1 # [ 46.994938] nix-daemon[842]: reaped child process 1072, status = succeeded4728worker1 # [ 47.161316] nix-daemon[842]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4729worker1 # [ 47.173993] nix-daemon[842]: reaped child process 1077, status = succeeded4730lb # [ 47.149590] niks3-server[995]: 2026/09/20 10:51:55 INFO Received uploads request method=POST path=/api/pending_closures4731worker1 # [ 47.197699] nix-grpc-daemon[854]: time=2026-09-20T10:51:55.287Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4732worker1 # [ 47.199146] nix-grpc-daemon[854]: time=2026-09-20T10:51:55.287Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4733lb # [ 47.175467] niks3-server[995]: 2026/09/20 10:51:55 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4734lb # [ 47.186108] niks3-server[995]: 2026/09/20 10:51:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4735lb # [ 47.190475] niks3-server[995]: 2026/09/20 10:51:55 INFO Signed narinfos id=11 count=14736worker1 # [ 47.232849] nix-grpc-daemon[854]: time=2026-09-20T10:51:55.323Z level=INFO msg="Uploading 1 narinfos"4737lb # [ 47.197345] niks3-server[995]: 2026/09/20 10:51:55 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4738lb # [ 47.208483] niks3-server[995]: 2026/09/20 10:51:55 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4739lb # [ 47.215714] niks3-server[995]: 2026/09/20 10:51:55 INFO Completed upload id=114740worker1 # [ 47.257329] nix-grpc-daemon[854]: time=2026-09-20T10:51:55.347Z level=INFO msg="Upload complete. (438ms)"4741lb # [ 47.218747] niks3-server[995]: 2026/09/20 10:51:55 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4742worker1 # [ 47.260326] nix-grpc-daemon[728]: ts=2026-09-20T10:51:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=5124743worker1 # [ 47.265427] nix-grpc-daemon[728]: ts=2026-09-20T10:51:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204744worker1 # [ 47.274281] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4745worker1 # [ 47.281169] nix-daemon[842]: reaped child process 1067, status = succeeded4746worker1 # [ 47.286840] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4747lb # [ 47.960655] envoy[922]: conn peer=[2001:db8:1::1]:38924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4126 tx=1707 ms=16894748lb # [ 47.964420] envoy[922]: conn peer=[2001:db8:1::1]:38926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2968 tx=1355 ms=46944749lb # [ 47.967998] envoy[922]: conn peer=[2001:db8:1::1]:38938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=35414750worker1 # [ 48.311230] nix-daemon[842]: reaped child process 1081, status = succeeded4751worker1 # [ 48.460283] nix-daemon[842]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)4752worker1 # [ 48.470920] nix-daemon[842]: reaped child process 1099, status = succeeded4753lb # [ 48.447574] niks3-server[995]: 2026/09/20 10:51:56 INFO Received uploads request method=POST path=/api/pending_closures4754worker1 # [ 48.495404] nix-grpc-daemon[854]: time=2026-09-20T10:51:56.585Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4755worker1 # [ 48.496848] nix-grpc-daemon[854]: time=2026-09-20T10:51:56.587Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4756lb # [ 48.491242] niks3-server[995]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4757lb # [ 48.496519] niks3-server[995]: 2026/09/20 10:51:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4758worker1 # [ 48.544109] nix-grpc-daemon[854]: time=2026-09-20T10:51:56.634Z level=INFO msg="Uploading 1 narinfos"4759lb # [ 48.505118] niks3-server[995]: 2026/09/20 10:51:56 INFO Signed narinfos id=12 count=14760lb # [ 48.508840] niks3-server[995]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4761lb # [ 48.515594] niks3-server[995]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4762lb # [ 48.525986] niks3-server[995]: 2026/09/20 10:51:56 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4763lb # [ 48.530701] niks3-server[995]: 2026/09/20 10:51:56 INFO Completed upload id=124764worker1 # [ 48.572452] nix-grpc-daemon[854]: time=2026-09-20T10:51:56.662Z level=INFO msg="Upload complete. (279ms)"4765lb # [ 48.533981] niks3-server[995]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4766worker1 # [ 48.579679] nix-grpc-daemon[728]: ts=2026-09-20T10:51:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14767worker2 # [ 48.550780] nix-grpc-daemon[784]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:409684768worker1 # [ 48.592855] nix-daemon[842]: reaped child process 1079, status = succeeded4769worker2 # [ 48.563094] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4770worker1 # [ 48.624881] nix-grpc-daemon[728]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:331204771worker1 # [ 48.630396] nix-grpc-daemon[728]: ts=2026-09-20T10:51:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_out=1284772worker2 # [ 48.811097] nix-grpc-daemon[784]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:409684773worker2 # [ 48.815965] nix-grpc-daemon[784]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:409684774worker2 # [ 48.825319] nix-grpc-daemon[867]: time=2026-09-20T10:51:56.292Z level=INFO msg="All 1 paths already cached"4775worker1 # [ 48.871363] nix-grpc-daemon[728]: ts=2026-09-20T10:51:56Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04776worker1 # [ 48.875353] nix-grpc-daemon[728]: ts=2026-09-20T10:51:56Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14777worker1 # [ 48.882901] nix-grpc-daemon[728]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204778worker1 # [ 48.894198] nix-grpc-daemon[728]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204779worker1 # [ 48.905863] nix-grpc-daemon[854]: time=2026-09-20T10:51:56.996Z level=INFO msg="All 1 paths already cached"4780worker1 # [ 48.912759] nix-grpc-daemon[728]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331204781worker1 # [ 48.923168] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4782worker1 # [ 49.092677] nix-daemon[842]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)4783worker1 # [ 49.105752] nix-daemon[842]: reaped child process 1108, status = succeeded4784worker1 # [ 49.273093] nix-daemon[842]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4785worker1 # [ 49.285248] nix-daemon[842]: reaped child process 1113, status = succeeded4786lb # [ 49.262431] niks3-server[995]: 2026/09/20 10:51:57 INFO Received uploads request method=POST path=/api/pending_closures4787worker1 # [ 49.309192] nix-grpc-daemon[854]: time=2026-09-20T10:51:57.399Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4788worker1 # [ 49.311071] nix-grpc-daemon[854]: time=2026-09-20T10:51:57.401Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4789lb # [ 49.290877] niks3-server[995]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4790lb # [ 49.298379] niks3-server[995]: 2026/09/20 10:51:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4791worker1 # [ 49.342365] nix-grpc-daemon[854]: time=2026-09-20T10:51:57.432Z level=INFO msg="Uploading 1 narinfos"4792lb # [ 49.303121] niks3-server[995]: 2026/09/20 10:51:57 INFO Signed narinfos id=13 count=14793lb # [ 49.309559] niks3-server[995]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4794lb # [ 49.321301] niks3-server[995]: 2026/09/20 10:51:57 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4795worker1 # [ 49.366631] nix-grpc-daemon[854]: time=2026-09-20T10:51:57.457Z level=INFO msg="Upload complete. (431ms)"4796lb # [ 49.327571] niks3-server[995]: 2026/09/20 10:51:57 INFO Completed upload id=134797worker1 # [ 49.368661] nix-grpc-daemon[728]: ts=2026-09-20T10:51:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=6244798lb # [ 49.330711] niks3-server[995]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4799worker1 # [ 49.374246] nix-grpc-daemon[728]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204800worker1 # [ 49.384376] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4801worker1 # [ 49.386751] nix-daemon[842]: reaped child process 1103, status = succeeded4802worker1 # [ 49.392214] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4803worker1 # [ 50.618771] nix-daemon[842]: reaped child process 1117, status = succeeded4804worker1 # [ 50.768265] nix-daemon[842]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)4805worker1 # [ 50.779961] nix-daemon[842]: reaped child process 1135, status = succeeded4806lb # [ 50.755979] niks3-server[995]: 2026/09/20 10:51:58 INFO Received uploads request method=POST path=/api/pending_closures4807worker1 # [ 50.800545] nix-grpc-daemon[854]: time=2026-09-20T10:51:58.889Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4808worker1 # [ 50.802115] nix-grpc-daemon[854]: time=2026-09-20T10:51:58.890Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4809lb # [ 50.772410] niks3-server[995]: 2026/09/20 10:51:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4810lb # [ 50.775051] niks3-server[995]: 2026/09/20 10:51:58 INFO Signed narinfos id=14 count=14811worker1 # [ 50.814408] nix-grpc-daemon[854]: time=2026-09-20T10:51:58.904Z level=INFO msg="Uploading 1 narinfos"4812lb # [ 50.780648] niks3-server[995]: 2026/09/20 10:51:58 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4813lb # [ 50.783137] niks3-server[995]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4814lb # [ 50.786816] niks3-server[995]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4815lb # [ 50.791175] niks3-server[995]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4816lb # [ 50.795574] niks3-server[995]: 2026/09/20 10:51:58 INFO Completed upload id=144817worker1 # [ 50.836079] nix-grpc-daemon[854]: time=2026-09-20T10:51:58.926Z level=INFO msg="Upload complete. (234ms)"4818lb # [ 50.799168] niks3-server[995]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4819worker1 # [ 50.838791] nix-grpc-daemon[728]: ts=2026-09-20T10:51:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14820worker1 # [ 50.845179] nix-daemon[842]: reaped child process 1115, status = succeeded4821worker1 # [ 50.882939] nix-grpc-daemon[728]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:331204822worker2 # [ 50.869907] nix-grpc-daemon[784]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:409684823worker2 # [ 50.877937] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4824worker2 # [ 50.892566] nix-grpc-daemon[784]: ts=2026-09-20T10:51:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=1 nar_bytes_out=1764825worker1 # [ 51.184279] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:331204826worker2 # [ 51.159579] nix-grpc-daemon[784]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:409684827worker2 # [ 51.170415] nix-grpc-daemon[867]: time=2026-09-20T10:51:58.637Z level=INFO msg="All 2 paths already cached"4828worker1 # [ 51.214045] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04829worker1 # [ 51.216092] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14830worker1 # [ 51.257536] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204831worker1 # [ 51.265937] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204832worker1 # [ 51.273948] nix-grpc-daemon[854]: time=2026-09-20T10:51:59.364Z level=INFO msg="All 2 paths already cached"4833worker1 # [ 51.278435] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331204834worker1 # [ 51.283455] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4835worker1 # [ 51.435137] nix-daemon[842]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4836worker1 # [ 51.447202] nix-daemon[842]: reaped child process 1144, status = succeeded4837worker1 # [ 51.601857] nix-daemon[842]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)4838worker1 # [ 51.613803] nix-daemon[842]: reaped child process 1149, status = succeeded4839lb # [ 51.588578] niks3-server[995]: 2026/09/20 10:51:59 INFO Received uploads request method=POST path=/api/pending_closures4840worker1 # [ 51.636264] nix-grpc-daemon[854]: time=2026-09-20T10:51:59.726Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4841worker1 # [ 51.637624] nix-grpc-daemon[854]: time=2026-09-20T10:51:59.726Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4842lb # [ 51.611271] niks3-server[995]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4843lb # [ 51.624332] niks3-server[995]: 2026/09/20 10:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4844worker1 # [ 51.667967] nix-grpc-daemon[854]: time=2026-09-20T10:51:59.758Z level=INFO msg="Uploading 1 narinfos"4845lb # [ 51.628597] niks3-server[995]: 2026/09/20 10:51:59 INFO Signed narinfos id=15 count=14846lb # [ 51.636745] niks3-server[995]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4847lb # [ 51.645457] niks3-server[995]: 2026/09/20 10:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4848worker1 # [ 51.691429] nix-grpc-daemon[854]: time=2026-09-20T10:51:59.781Z level=INFO msg="Upload complete. (402ms)"4849lb # [ 51.652178] niks3-server[995]: 2026/09/20 10:51:59 INFO Completed upload id=154850worker1 # [ 51.694087] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=7524851lb # [ 51.655201] niks3-server[995]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4852worker1 # [ 51.699410] nix-grpc-daemon[728]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204853worker1 # [ 51.703777] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4854worker1 # [ 51.706045] nix-daemon[842]: reaped child process 1139, status = succeeded4855worker1 # [ 51.711234] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4856worker1 # [ 52.924668] nix-daemon[842]: reaped child process 1153, status = succeeded4857worker1 # [ 53.065474] nix-daemon[842]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4858worker1 # [ 53.076155] nix-daemon[842]: reaped child process 1171, status = succeeded4859lb # [ 53.053133] niks3-server[995]: 2026/09/20 10:52:00 INFO Received uploads request method=POST path=/api/pending_closures4860worker1 # [ 53.100194] nix-grpc-daemon[854]: time=2026-09-20T10:52:01.190Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4861worker1 # [ 53.101803] nix-grpc-daemon[854]: time=2026-09-20T10:52:01.192Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4862lb # [ 53.082875] niks3-server[995]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4863lb # [ 53.100135] niks3-server[995]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4864lb # [ 53.104661] niks3-server[995]: 2026/09/20 10:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4865worker1 # [ 53.152297] nix-grpc-daemon[854]: time=2026-09-20T10:52:01.242Z level=INFO msg="Uploading 1 narinfos"4866lb # [ 53.112842] niks3-server[995]: 2026/09/20 10:52:01 INFO Signed narinfos id=16 count=14867lb # [ 53.116149] niks3-server[995]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4868lb # [ 53.125294] niks3-server[995]: 2026/09/20 10:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4869lb # [ 53.132399] niks3-server[995]: 2026/09/20 10:52:01 INFO Completed upload id=164870worker1 # [ 53.171835] nix-grpc-daemon[854]: time=2026-09-20T10:52:01.262Z level=INFO msg="Upload complete. (253ms)"4871lb # [ 53.133954] niks3-server[995]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4872worker2 # [ 53.148358] nix-grpc-daemon[784]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:409684873worker1 # [ 53.179319] nix-grpc-daemon[728]: ts=2026-09-20T10:52:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14874worker2 # [ 53.152869] nix-grpc-daemon[784]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4875worker1 # [ 53.190251] nix-daemon[842]: reaped child process 1151, status = succeeded4876worker2 # [ 53.165961] nix-grpc-daemon[784]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:409684877worker2 # [ 53.167932] nix-grpc-daemon[784]: ts=2026-09-20T10:52:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=1 nar_bytes_out=2324878client # [ 53.306113] nix-daemon[946]: reaped child process 948, status = succeeded4879client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.13 seconds)4880client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4881client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4882client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4883client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4884client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4885client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds)4886(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.21 seconds)4887subtest: an input only one worker has still reaches the builder4888client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4889client # this derivation will be built:4890client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4891client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4892client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.36 seconds)4893client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4894client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds)4895worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4896worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.15 seconds)4897worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4898worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4899client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24900client # [ 54.264729] nix-daemon[946]: accepted connection from pid 1029, user root (trusted)4901client # this derivation will be built:4902client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4903worker1 # [ 54.432561] nix-grpc-daemon[728]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:331204904worker1 # [ 54.434870] nix-grpc-daemon[728]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204905client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4906worker1 # [ 54.573904] nix-daemon[842]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)4907worker1 # [ 54.584595] nix-daemon[842]: reaped child process 1181, status = succeeded4908lb # [ 54.559821] niks3-server[995]: 2026/09/20 10:52:02 INFO Received uploads request method=POST path=/api/pending_closures4909worker1 # [ 54.603118] nix-grpc-daemon[854]: time=2026-09-20T10:52:02.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4910worker1 # [ 54.604869] nix-grpc-daemon[854]: time=2026-09-20T10:52:02.695Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4911lb # [ 54.573913] niks3-server[995]: 2026/09/20 10:52:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4912lb # [ 54.575518] niks3-server[995]: 2026/09/20 10:52:02 INFO Signed narinfos id=17 count=14913worker1 # [ 54.615205] nix-grpc-daemon[854]: time=2026-09-20T10:52:02.705Z level=INFO msg="Uploading 1 narinfos"4914lb # [ 54.578931] niks3-server[995]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4915lb # [ 54.583241] niks3-server[995]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4916lb # [ 54.585990] niks3-server[995]: 2026/09/20 10:52:02 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4917lb # [ 54.590374] niks3-server[995]: 2026/09/20 10:52:02 INFO Completed upload id=174918worker1 # [ 54.629736] nix-grpc-daemon[854]: time=2026-09-20T10:52:02.720Z level=INFO msg="Upload complete. (193ms)"4919lb # [ 54.592322] niks3-server[995]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4920worker1 # [ 54.640721] nix-grpc-daemon[728]: ts=2026-09-20T10:52:02Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04921worker1 # [ 54.642667] nix-grpc-daemon[728]: ts=2026-09-20T10:52:02Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14922worker2 # [ 54.653179] nix-grpc-daemon[784]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409684923worker2 # [ 54.663660] nix-grpc-daemon[784]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:409684924client # copying 2 paths to 'lb:50051'...4925client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4926client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4927worker2 # [ 54.673767] nix-grpc-daemon[784]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:409684928worker2 # [ 54.684554] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4929worker2 # [ 54.865319] nix-daemon[840]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4930worker2 # [ 54.877849] nix-daemon[840]: reaped child process 947, status = succeeded4931worker2 # [ 55.027515] nix-daemon[840]: accepted connection from pid 949, user nix-grpc-daemon (trusted)4932worker2 # [ 55.038157] nix-daemon[840]: reaped child process 952, status = succeeded4933lb # [ 55.042667] niks3-server[995]: 2026/09/20 10:52:02 INFO Received uploads request method=POST path=/api/pending_closures4934lb # [ 55.047034] niks3-server[995]: 2026/09/20 10:52:02 INFO Received uploads request method=POST path=/api/pending_closures4935worker2 # [ 55.057882] nix-grpc-daemon[867]: time=2026-09-20T10:52:02.525Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4936worker2 # [ 55.059615] nix-grpc-daemon[867]: time=2026-09-20T10:52:02.527Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4937worker2 # [ 55.061660] nix-grpc-daemon[867]: time=2026-09-20T10:52:02.527Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4938lb # [ 55.064973] niks3-server[995]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4939lb # [ 55.068490] niks3-server[995]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4940lb # [ 55.075312] niks3-server[995]: 2026/09/20 10:52:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4941lb # [ 55.078143] niks3-server[995]: 2026/09/20 10:52:03 INFO Signed narinfos id=18 count=14942lb # [ 55.079667] niks3-server[995]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4943lb # [ 55.081604] niks3-server[995]: 2026/09/20 10:52:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4944lb # [ 55.083259] niks3-server[995]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4945lb # [ 55.086107] niks3-server[995]: 2026/09/20 10:52:03 INFO Signed narinfos id=19 count=24946worker2 # [ 55.095085] nix-grpc-daemon[867]: time=2026-09-20T10:52:02.562Z level=INFO msg="Uploading 3 narinfos"4947lb # [ 55.100402] niks3-server[995]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4948lb # [ 55.103030] niks3-server[995]: 2026/09/20 10:52:03 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4949lb # [ 55.106465] niks3-server[995]: 2026/09/20 10:52:03 INFO Completed upload id=184950lb # [ 55.107662] niks3-server[995]: 2026/09/20 10:52:03 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4951lb # [ 55.109822] niks3-server[995]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4952lb # [ 55.111455] niks3-server[995]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4953lb # [ 55.113339] niks3-server[995]: 2026/09/20 10:52:03 INFO Completed upload id=194954worker2 # [ 55.121701] nix-grpc-daemon[867]: time=2026-09-20T10:52:02.589Z level=INFO msg="Upload complete. (422ms)"4955worker2 # [ 55.123700] nix-grpc-daemon[784]: ts=2026-09-20T10:52:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=2 nar_bytes_in=9764956worker2 # [ 55.126656] nix-grpc-daemon[784]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409684957worker2 # [ 55.132646] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4958worker2 # [ 55.137083] nix-daemon[840]: reaped child process 942, status = succeeded4959worker2 # [ 55.141449] nix-grpc-daemon[784]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4960worker2 # [ 55.148046] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4961client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4962client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4963worker2 # [ 56.561511] nix-daemon[840]: reaped child process 957, status = succeeded4964worker2 # [ 56.695651] nix-daemon[840]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4965worker2 # [ 56.707685] nix-daemon[840]: reaped child process 975, status = succeeded4966lb # [ 56.714214] niks3-server[995]: 2026/09/20 10:52:04 INFO Received uploads request method=POST path=/api/pending_closures4967worker2 # [ 56.728163] nix-grpc-daemon[867]: time=2026-09-20T10:52:04.195Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4968lb # [ 56.741808] niks3-server[995]: 2026/09/20 10:52:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4969worker2 # [ 56.756958] nix-grpc-daemon[867]: time=2026-09-20T10:52:04.224Z level=INFO msg="Uploading 1 narinfos"4970lb # [ 56.750827] niks3-server[995]: 2026/09/20 10:52:04 INFO Signed narinfos id=20 count=14971lb # [ 56.753363] niks3-server[995]: 2026/09/20 10:52:04 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4972lb # [ 56.759912] niks3-server[995]: 2026/09/20 10:52:04 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4973lb # [ 56.770728] niks3-server[995]: 2026/09/20 10:52:04 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4974worker2 # [ 56.783662] nix-grpc-daemon[867]: time=2026-09-20T10:52:04.251Z level=INFO msg="Upload complete. (226ms)"4975lb # [ 56.776512] niks3-server[995]: 2026/09/20 10:52:04 INFO Completed upload id=204976worker2 # [ 56.786053] nix-grpc-daemon[784]: ts=2026-09-20T10:52:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14977lb # [ 56.779403] niks3-server[995]: 2026/09/20 10:52:04 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4978worker2 # [ 56.792434] nix-daemon[840]: reaped child process 954, status = succeeded4979client # copying 1 paths...4980worker1 # [ 56.863777] nix-grpc-daemon[728]: ts=2026-09-20T10:52:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:331204981worker1 # [ 56.879092] nix-grpc-daemon[728]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4982client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4983worker2 # [ 56.876225] nix-grpc-daemon[784]: ts=2026-09-20T10:52:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:409684984worker2 # [ 56.878474] nix-grpc-daemon[784]: ts=2026-09-20T10:52:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=1 nar_bytes_out=1204985client # [ 56.959089] nix-daemon[946]: reaped child process 1032, status = succeeded4986client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.89 seconds)4987client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24988client # [ 57.139691] nix-daemon[946]: accepted connection from pid 1051, user root (trusted)4989client # this derivation will be built:4990client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4991worker2 # [ 57.265855] nix-grpc-daemon[784]: ts=2026-09-20T10:52:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:409684992client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4993worker1 # [ 57.303073] nix-grpc-daemon[728]: ts=2026-09-20T10:52:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204994worker1 # [ 57.312352] nix-grpc-daemon[854]: time=2026-09-20T10:52:05.402Z level=INFO msg="All 1 paths already cached"4995worker1 # [ 57.325589] nix-grpc-daemon[728]: ts=2026-09-20T10:52:05Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04996worker1 # [ 57.330904] nix-grpc-daemon[728]: ts=2026-09-20T10:52:05Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14997worker1 # [ 57.369810] nix-grpc-daemon[728]: ts=2026-09-20T10:52:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331204998worker1 # [ 57.382303] nix-grpc-daemon[728]: ts=2026-09-20T10:52:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331204999client # copying 1 paths to 'lb:50051'...5000client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5001worker1 # [ 57.400747] nix-grpc-daemon[728]: ts=2026-09-20T10:52:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331205002worker1 # [ 57.412309] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5003worker1 # [ 57.428199] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5004worker1 # [ 57.438828] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 2/5)5005worker1 # [ 57.576897] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 3/5)5006worker1 # [ 57.764892] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 4/5)5007worker1 # [ 57.849270] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5008worker1 # [ 57.854683] nix-grpc-daemon[728]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5009lb # [ 57.961647] envoy[922]: conn peer=[2001:db8:1::1]:50938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=215010lb # [ 57.965719] envoy[922]: conn peer=[2001:db8:1::1]:50926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3425 tx=1749 ms=19335011lb # [ 57.969284] envoy[922]: conn peer=[2001:db8:1::1]:50952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3880 tx=1851 ms=21345012lb # [ 57.972763] envoy[922]: conn peer=[2001:db8:1::1]:50954 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=765013lb # [ 57.976167] envoy[922]: conn peer=[2001:db8:1::1]:50960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4298 tx=2204 ms=20685014lb # [ 57.979671] envoy[922]: conn peer=[2001:db8:1::1]:42780 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=505015lb # [ 57.983205] envoy[922]: conn peer=[2001:db8:1::1]:42786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3852 tx=1877 ms=24895016lb # [ 57.987308] envoy[922]: conn peer=[2001:db8:1::1]:42798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=115017worker1 # [ 58.058288] nix-daemon[842]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5018worker1 # [ 58.071600] nix-daemon[842]: reaped child process 1197, status = succeeded5019worker1 # [ 58.233819] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5020worker1 # [ 58.245717] nix-daemon[842]: reaped child process 1202, status = succeeded5021lb # [ 58.222282] niks3-server[995]: 2026/09/20 10:52:06 INFO Received uploads request method=POST path=/api/pending_closures5022worker1 # [ 58.269489] nix-grpc-daemon[854]: time=2026-09-20T10:52:06.359Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5023worker1 # [ 58.271265] nix-grpc-daemon[854]: time=2026-09-20T10:52:06.361Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5024lb # [ 58.250954] niks3-server[995]: 2026/09/20 10:52:06 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5025lb # [ 58.258460] niks3-server[995]: 2026/09/20 10:52:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5026lb # [ 58.263092] niks3-server[995]: 2026/09/20 10:52:06 INFO Signed narinfos id=21 count=15027worker1 # [ 58.305325] nix-grpc-daemon[854]: time=2026-09-20T10:52:06.395Z level=INFO msg="Uploading 1 narinfos"5028lb # [ 58.272773] niks3-server[995]: 2026/09/20 10:52:06 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5029lb # [ 58.282827] niks3-server[995]: 2026/09/20 10:52:06 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5030lb # [ 58.287383] niks3-server[995]: 2026/09/20 10:52:06 INFO Completed upload id=215031worker1 # [ 58.327072] nix-grpc-daemon[854]: time=2026-09-20T10:52:06.416Z level=INFO msg="Upload complete. (451ms)"5032worker1 # [ 58.330467] nix-grpc-daemon[728]: ts=2026-09-20T10:52:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=0 paths=1 nar_bytes_in=5605033lb # [ 58.290553] niks3-server[995]: 2026/09/20 10:52:06 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5034worker1 # [ 58.334163] nix-grpc-daemon[728]: ts=2026-09-20T10:52:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331205035worker1 # [ 58.339491] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5036worker1 # [ 58.341899] nix-daemon[842]: reaped child process 1188, status = succeeded5037worker1 # [ 58.346798] nix-daemon[842]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5038client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5039client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5040worker1 # [ 59.759591] nix-daemon[842]: reaped child process 1206, status = succeeded5041worker1 # [ 59.903526] nix-daemon[842]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5042worker1 # [ 59.915545] nix-daemon[842]: reaped child process 1224, status = succeeded5043lb # [ 59.893480] niks3-server[995]: 2026/09/20 10:52:07 INFO Received uploads request method=POST path=/api/pending_closures5044worker1 # [ 59.940776] nix-grpc-daemon[854]: time=2026-09-20T10:52:08.031Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5045lb # [ 59.927593] niks3-server[995]: 2026/09/20 10:52:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5046lb # [ 59.935105] niks3-server[995]: 2026/09/20 10:52:07 INFO Signed narinfos id=22 count=15047worker1 # [ 59.978100] nix-grpc-daemon[854]: time=2026-09-20T10:52:08.068Z level=INFO msg="Uploading 1 narinfos"5048lb # [ 59.938853] niks3-server[995]: 2026/09/20 10:52:07 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5049lb # [ 59.943824] niks3-server[995]: 2026/09/20 10:52:07 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5050lb # [ 59.957514] niks3-server[995]: 2026/09/20 10:52:07 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5051worker1 # [ 60.001149] nix-grpc-daemon[854]: time=2026-09-20T10:52:08.091Z level=INFO msg="Upload complete. (246ms)"5052lb # [ 59.962155] niks3-server[995]: 2026/09/20 10:52:07 INFO Completed upload id=225053worker1 # [ 60.003529] nix-grpc-daemon[728]: ts=2026-09-20T10:52:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33120 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15054lb # [ 59.965654] niks3-server[995]: 2026/09/20 10:52:07 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5055worker1 # [ 60.010387] nix-daemon[842]: reaped child process 1204, status = succeeded5056client # copying 1 paths...5057worker2 # [ 60.017277] nix-grpc-daemon[784]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:409685058worker2 # [ 60.024543] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5059client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5060worker2 # [ 60.051126] nix-grpc-daemon[784]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:409685061worker2 # [ 60.053152] nix-grpc-daemon[784]: ts=2026-09-20T10:52:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=1 nar_bytes_out=1205062client # [ 60.188455] nix-daemon[946]: reaped child process 1054, status = succeeded5063client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.23 seconds)5064client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25065client # [ 60.350576] nix-daemon[946]: accepted connection from pid 1073, user root (trusted)5066client # this derivation will be built:5067client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5068worker2 # [ 60.488590] nix-grpc-daemon[784]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:409685069client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5070worker1 # [ 60.524633] nix-grpc-daemon[728]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331205071worker1 # [ 60.532860] nix-grpc-daemon[854]: time=2026-09-20T10:52:08.623Z level=INFO msg="All 1 paths already cached"5072worker1 # [ 60.545953] nix-grpc-daemon[728]: ts=2026-09-20T10:52:08Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05073worker1 # [ 60.550671] nix-grpc-daemon[728]: ts=2026-09-20T10:52:08Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15074worker2 # [ 60.561850] nix-grpc-daemon[784]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409685075worker2 # [ 60.574528] nix-grpc-daemon[784]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:409685076worker2 # [ 60.587660] nix-grpc-daemon[867]: time=2026-09-20T10:52:08.055Z level=INFO msg="All 1 paths already cached"5077client # copying 1 paths to 'lb:50051'...5078client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5079worker2 # [ 60.596788] nix-grpc-daemon[784]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:409685080worker2 # [ 60.605885] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5081worker2 # [ 60.792317] nix-daemon[840]: accepted connection from pid 980, user nix-grpc-daemon (trusted)5082worker2 # [ 60.804784] nix-daemon[840]: reaped child process 983, status = succeeded5083worker2 # [ 60.972247] nix-daemon[840]: accepted connection from pid 985, user nix-grpc-daemon (trusted)5084worker2 # [ 60.983879] nix-daemon[840]: reaped child process 988, status = succeeded5085lb # [ 60.996102] niks3-server[995]: 2026/09/20 10:52:08 INFO Received uploads request method=POST path=/api/pending_closures5086worker2 # [ 61.010613] nix-grpc-daemon[867]: time=2026-09-20T10:52:08.478Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5087worker2 # [ 61.012186] nix-grpc-daemon[867]: time=2026-09-20T10:52:08.478Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5088lb # [ 61.019860] niks3-server[995]: 2026/09/20 10:52:08 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5089lb # [ 61.030744] niks3-server[995]: 2026/09/20 10:52:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5090lb # [ 61.036457] niks3-server[995]: 2026/09/20 10:52:08 INFO Signed narinfos id=23 count=15091worker2 # [ 61.047089] nix-grpc-daemon[867]: time=2026-09-20T10:52:08.514Z level=INFO msg="Uploading 1 narinfos"5092lb # [ 61.042389] niks3-server[995]: 2026/09/20 10:52:08 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5093lb # [ 61.054094] niks3-server[995]: 2026/09/20 10:52:08 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5094lb # [ 61.060227] niks3-server[995]: 2026/09/20 10:52:08 INFO Completed upload id=235095worker2 # [ 61.069780] nix-grpc-daemon[867]: time=2026-09-20T10:52:08.537Z level=INFO msg="Upload complete. (449ms)"5096lb # [ 61.064219] niks3-server[995]: 2026/09/20 10:52:08 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5097worker2 # [ 61.072410] nix-grpc-daemon[784]: ts=2026-09-20T10:52:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=1 nar_bytes_in=5605098worker2 # [ 61.077613] nix-grpc-daemon[784]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409685099worker2 # [ 61.083541] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5100worker2 # [ 61.086145] nix-daemon[840]: reaped child process 978, status = succeeded5101worker2 # [ 61.092113] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5102client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5103client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5104worker2 # [ 62.305175] nix-daemon[840]: reaped child process 992, status = succeeded5105worker2 # [ 62.453434] nix-daemon[840]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)5106worker2 # [ 62.465276] nix-daemon[840]: reaped child process 1010, status = succeeded5107lb # [ 62.473809] niks3-server[995]: 2026/09/20 10:52:10 INFO Received uploads request method=POST path=/api/pending_closures5108worker2 # [ 62.489971] nix-grpc-daemon[867]: time=2026-09-20T10:52:09.956Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5109lb # [ 62.501615] niks3-server[995]: 2026/09/20 10:52:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5110lb # [ 62.507292] niks3-server[995]: 2026/09/20 10:52:10 INFO Signed narinfos id=24 count=15111worker2 # [ 62.517530] nix-grpc-daemon[867]: time=2026-09-20T10:52:09.985Z level=INFO msg="Uploading 1 narinfos"5112lb # [ 62.512543] niks3-server[995]: 2026/09/20 10:52:10 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5113lb # [ 62.524971] niks3-server[995]: 2026/09/20 10:52:10 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5114lb # [ 62.530127] niks3-server[995]: 2026/09/20 10:52:10 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5115worker2 # [ 62.541856] nix-grpc-daemon[867]: time=2026-09-20T10:52:10.009Z level=INFO msg="Upload complete. (243ms)"5116lb # [ 62.534657] niks3-server[995]: 2026/09/20 10:52:10 INFO Completed upload id=245117worker2 # [ 62.544224] nix-grpc-daemon[784]: ts=2026-09-20T10:52:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15118lb # [ 62.539201] niks3-server[995]: 2026/09/20 10:52:10 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5119worker2 # [ 62.550773] nix-daemon[840]: reaped child process 990, status = succeeded5120client # copying 1 paths...5121worker2 # [ 62.590990] nix-grpc-daemon[784]: ts=2026-09-20T10:52:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:409685122client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5123worker2 # [ 62.609255] nix-grpc-daemon[784]: ts=2026-09-20T10:52:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:409685124worker2 # [ 62.610892] nix-grpc-daemon[784]: ts=2026-09-20T10:52:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40968 duration_s=0 paths=1 nar_bytes_out=1205125client # [ 62.730366] nix-daemon[946]: reaped child process 1076, status = succeeded5126client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.54 seconds)5127(finished: subtest: an input only one worker has still reaches the builder, in 9.34 seconds)5128subtest: upload whose reference the worker lacks is completed from the cache5129client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5130client # this derivation will be built:5131client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5132client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5133client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.37 seconds)5134client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5135client # this derivation will be built:5136client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5137client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5138client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.36 seconds)5139client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5140client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5141worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5142worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5143worker2 # [ 63.867611] systemd[1]: Stopping Nix worker-protocol over gRPC...5144worker2 # [ 64.231432] nix-grpc-daemon[784]: ts=2026-09-20T10:52:11Z level=info event=signal_exit5145worker2 # [ 65.489978] nix-grpc-daemon[784]: ts=2026-09-20T10:52:12Z level=info event=scheduler_restarting5146worker1 # [ 65.530731] nix-grpc-daemon[728]: ts=2026-09-20T10:52:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:331125147worker1 # [ 65.532208] nix-grpc-daemon[728]: ts=2026-09-20T10:52:13Z level=info event=worker_gone addr=192.168.1.4:500515148worker2 # [ 65.502355] nix-grpc-daemon[784]: ts=2026-09-20T10:52:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5149worker2 # [ 65.515937] nix-daemon[840]: reaped child process 842, status = succeeded5150worker2 # [ 66.206748] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5151worker2 # [ 66.211583] systemd[1]: Stopped Nix worker-protocol over gRPC.5152worker2 # [ 66.214343] systemd[1]: nix-grpc-daemon.service: Consumed 1.172s CPU time over 48.241s wall clock time, 50M memory peak, 42.6K incoming IP traffic, 76.1K outgoing IP traffic.5153worker2 # [ 66.225573] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5154worker2 # [ 66.229759] systemd[1]: Closed Nix worker-protocol over gRPC.5155worker2 # [ 66.233267] systemd[1]: nix-grpc-daemon.socket: Consumed 284us CPU time over 57.332s wall clock time, 256K memory peak, 53.6K incoming IP traffic, 50.6K outgoing IP traffic.5156lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5157lb: must succeed: curl -sf localhost:9901/clusters5158lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5159lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5160client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25161worker1 # [ 66.552697] nix-grpc-daemon[728]: ts=2026-09-20T10:52:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:331205162client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5163worker1 # [ 66.557951] nix-grpc-daemon[728]: ts=2026-09-20T10:52:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:331205164client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5165worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5166worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5167worker2 # [ 66.629756] systemd[1]: Listening on Nix worker-protocol over gRPC.5168worker1 # [ 66.718511] systemd[1]: Stopping Nix worker-protocol over gRPC...5169worker1 # [ 67.291280] nix-grpc-daemon[728]: ts=2026-09-20T10:52:15Z level=info event=signal_exit5170worker2 # [ 67.361184] systemd[1]: Starting Nix worker-protocol over gRPC...5171worker1 # [ 67.546871] nix-grpc-daemon[728]: ts=2026-09-20T10:52:15Z level=info event=scheduler_yield5172worker1 # [ 67.550847] nix-grpc-daemon[728]: ts=2026-09-20T10:52:15Z level=info event=scheduler_restarting addr=lb:500515173lb # [ 67.510745] niks3-server[995]: 2026/09/20 10:52:15 INFO lead: released remote=192.168.1.3:578985174worker1 # [ 67.556330] nix-grpc-daemon[728]: ts=2026-09-20T10:52:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:331125175worker1 # [ 67.559616] nix-grpc-daemon[728]: ts=2026-09-20T10:52:15Z level=info event=worker_gone addr=192.168.1.3:500515176worker2 # [ 67.534312] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5177worker2 # [ 67.537819] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15178worker2 # [ 67.545723] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5179worker2 # [ 67.548133] systemd[1]: Started Nix worker-protocol over gRPC.5180lb # [ 67.548520] niks3-server[995]: 2026/09/20 10:52:15 INFO lead: acquired remote=192.168.1.4:429805181worker2 # [ 67.560189] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_take_over5182worker2 # [ 67.576357] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500515183worker2 # [ 67.577962] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5184worker1 # [ 67.751751] nix-grpc-daemon[728]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500515185worker1 # [ 67.755667] nix-grpc-daemon[728]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5186worker2 # [ 67.779116] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500515187worker2 # [ 67.783164] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5188worker1 # [ 67.956631] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500515189worker1 # [ 67.960605] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5190lb # [ 67.961621] envoy[922]: conn peer=[2001:db8:1::1]:42814 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1917 ms=28375191lb # [ 67.965247] envoy[922]: conn peer=[2001:db8:1::1]:42820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=545192lb # [ 67.968701] envoy[922]: conn peer=[2001:db8:1::1]:42832 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3688 tx=1802 ms=21725193lb # [ 67.972208] envoy[922]: conn peer=[2001:db8:1::1]:42834 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=545194lb # [ 67.975571] envoy[922]: conn peer=192.168.1.4:49152 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6952 tx=1454 ms=472115195worker2 # [ 67.983731] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500515196lb # [ 67.979865] envoy[922]: conn peer=[2001:db8:1::1]:39570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=165197worker2 # [ 67.987629] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5198worker1 # [ 68.161490] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500515199worker1 # [ 68.165473] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5200worker2 # [ 68.188262] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500515201worker2 # [ 68.190442] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5202worker1 # [ 68.366247] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500515203worker1 # [ 68.370210] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5204worker2 # [ 68.391338] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500515205worker2 # [ 68.395283] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5206worker1 # [ 68.550799] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=scheduler_restarting5207worker1 # [ 68.590622] nix-grpc-daemon[728]: ts=2026-09-20T10:52:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5208worker1 # [ 68.595132] nix-daemon[842]: reaped child process 845, status = succeeded5209worker2 # [ 68.596661] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500515210worker2 # [ 68.603735] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05211worker1 # [ 69.413382] nix-grpc-daemon[728]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5212worker1 # [ 69.416833] nix-grpc-daemon[728]: E0000 00:00:1789901537.503103 823 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5213worker1 # [ 69.421415] nix-grpc-daemon[728]: E0000 00:00:1789901537.503748 823 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5214worker1 # [ 70.172895] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5215worker1 # [ 70.177075] systemd[1]: Stopped Nix worker-protocol over gRPC.5216worker1 # [ 70.179653] systemd[1]: nix-grpc-daemon.service: Consumed 2.580s CPU time over 52.174s wall clock time, 63.9M memory peak, 90.5K incoming IP traffic, 176.1K outgoing IP traffic.5217worker1 # [ 70.189788] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5218worker1 # [ 70.193974] systemd[1]: Closed Nix worker-protocol over gRPC.5219worker1 # [ 70.196981] systemd[1]: nix-grpc-daemon.socket: Consumed 290us CPU time over 59.829s wall clock time, 256K memory peak, 87.8K incoming IP traffic, 69.2K outgoing IP traffic.5220lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5221lb: must succeed: curl -sf localhost:9901/clusters5222lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5223lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5224client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25225worker2 # [ 70.448319] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:575485226worker2 # [ 70.454273] nix-daemon[840]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)5227worker2 # [ 70.462926] nix-grpc-daemon[1031]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)5228worker2 # [ 70.544879] nix-grpc-daemon[1031]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 127 ms (attempt 2/5)5229worker2 # [ 70.674906] nix-grpc-daemon[1031]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 3/5)5230worker2 # [ 70.695655] nix-grpc-daemon[1031]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 608 ms (attempt 4/5)5231worker2 # [ 71.306920] nix-grpc-daemon[1031]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5232client # copying 2 paths...5233client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5234worker2 # [ 71.329165] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:575485235client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5236worker2 # [ 71.339344] nix-daemon[840]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)5237worker2 # [ 71.361430] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:18Z level=info event=niks3_push_started pid=10875238worker2 # [ 71.722706] nix-daemon[840]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)5239worker2 # [ 71.735029] nix-daemon[840]: reaped child process 1103, status = succeeded5240lb # [ 71.746742] niks3-server[995]: 2026/09/20 10:52:19 INFO Received uploads request method=POST path=/api/pending_closures5241lb # [ 71.755736] niks3-server[995]: 2026/09/20 10:52:19 INFO Received uploads request method=POST path=/api/pending_closures5242worker2 # [ 71.770734] nix-grpc-daemon[1087]: time=2026-09-20T10:52:19.238Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5243worker2 # [ 71.772386] nix-grpc-daemon[1087]: time=2026-09-20T10:52:19.240Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5244worker2 # [ 71.776109] nix-grpc-daemon[1087]: time=2026-09-20T10:52:19.242Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5245lb # [ 71.810917] niks3-server[995]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5246lb # [ 71.813916] niks3-server[995]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5247lb # [ 71.817353] niks3-server[995]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5248lb # [ 71.827238] niks3-server[995]: 2026/09/20 10:52:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5249lb # [ 71.830810] niks3-server[995]: 2026/09/20 10:52:19 INFO Signed narinfos id=25 count=15250lb # [ 71.833454] niks3-server[995]: 2026/09/20 10:52:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5251lb # [ 71.835093] niks3-server[995]: 2026/09/20 10:52:19 INFO Signed narinfos id=26 count=25252lb # [ 71.837950] niks3-server[995]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5253worker2 # [ 71.845179] nix-grpc-daemon[1087]: time=2026-09-20T10:52:19.311Z level=INFO msg="Uploading 3 narinfos"5254lb # [ 71.850104] niks3-server[995]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5255lb # [ 71.854035] niks3-server[995]: 2026/09/20 10:52:19 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5256lb # [ 71.858098] niks3-server[995]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5257lb # [ 71.862185] niks3-server[995]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5258lb # [ 71.869822] niks3-server[995]: 2026/09/20 10:52:19 INFO Completed upload id=255259lb # [ 71.871624] niks3-server[995]: 2026/09/20 10:52:19 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5260lb # [ 71.874070] niks3-server[995]: 2026/09/20 10:52:19 INFO Completed upload id=265261worker2 # [ 71.881728] nix-grpc-daemon[1087]: time=2026-09-20T10:52:19.349Z level=INFO msg="Upload complete. (323ms)"5262worker2 # [ 71.888400] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57548 duration_s=0 paths=2 nar_bytes_in=3125263worker2 # [ 71.900652] nix-daemon[840]: reaped child process 1085, status = succeeded5264client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.68 seconds)5265worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5266worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5267worker1 # [ 72.040665] systemd[1]: Listening on Nix worker-protocol over gRPC.5268worker1 # [ 72.047380] systemd[1]: Starting Nix worker-protocol over gRPC...5269worker1 # [ 72.218936] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5270worker1 # [ 72.222810] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15271worker1 # [ 72.228813] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5272worker1 # [ 72.233365] systemd[1]: Started Nix worker-protocol over gRPC.5273lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5274lb: must succeed: curl -sf localhost:9901/clusters5275worker1 # [ 72.264713] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:20Z level=info event=scheduler_connected addr=lb:500515276worker2 # [ 72.235619] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05277lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5278lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5279(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.58 seconds)5280subtest: scheduler down: the other node takes the lock and keeps it5281lb: must succeed: curl -sf localhost:9901/clusters5282lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5283lb: must succeed: curl -sf localhost:9901/clusters5284lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5285lb: must succeed: curl -sf localhost:9901/clusters5286lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5287lb: must succeed: curl -sf localhost:9901/clusters5288lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5289worker2 # [ 72.553374] systemd[1]: Stopping Nix worker-protocol over gRPC...5290worker2 # [ 73.549446] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=signal_exit5291worker2 # [ 73.761978] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_yield5292worker1 # [ 73.797817] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:21Z level=info event=scheduler_restarting addr=lb:500515293lb # [ 73.758472] niks3-server[995]: 2026/09/20 10:52:21 INFO lead: released remote=192.168.1.4:429805294worker2 # [ 73.770476] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:575445295worker2 # [ 73.776210] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=worker_gone addr=192.168.1.3:500515296worker2 # [ 73.779312] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_restarting addr=lb:500515297worker2 # [ 73.782282] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:575445298worker2 # [ 73.785483] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=worker_gone addr=192.168.1.4:500515299worker1 # [ 73.998162] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_connected addr=lb:500515300worker1 # [ 74.000090] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5301worker2 # [ 73.975795] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_connected addr=lb:500515302worker2 # [ 73.979936] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5303worker1 # [ 74.200666] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_connected addr=lb:500515304worker1 # [ 74.202477] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5305worker2 # [ 74.180874] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_connected addr=lb:500515306worker2 # [ 74.184806] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5307worker1 # [ 74.403863] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_connected addr=lb:500515308worker1 # [ 74.407955] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5309worker2 # [ 74.385801] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_connected addr=lb:500515310worker2 # [ 74.389613] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5311worker1 # [ 74.608553] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_connected addr=lb:500515312worker1 # [ 74.610560] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5313worker2 # [ 74.588673] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:22Z level=info event=scheduler_connected addr=lb:500515314worker2 # [ 74.591861] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5315worker2 # [ 74.766907] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:22Z level=info event=scheduler_restarting5316worker1 # [ 74.811965] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_connected addr=lb:500515317worker1 # [ 74.814102] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5318worker2 # [ 74.787848] nix-daemon[840]: reaped child process 1080, status = succeeded5319worker2 # [ 74.802358] nix-grpc-daemon[1031]: ts=2026-09-20T10:52:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5320worker1 # [ 75.014698] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_connected addr=lb:500515321worker1 # [ 75.016644] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5322worker1 # [ 75.217852] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_connected addr=lb:500515323worker1 # [ 75.222144] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5324worker1 # [ 75.422794] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_connected addr=lb:500515325worker1 # [ 75.426089] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5326worker2 # [ 75.584498] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5327worker2 # [ 75.587824] systemd[1]: Stopped Nix worker-protocol over gRPC.5328worker2 # [ 75.591767] systemd[1]: nix-grpc-daemon.service: Consumed 363ms CPU time over 8.223s wall clock time, 32.8M memory peak, 17.8K incoming IP traffic, 24.3K outgoing IP traffic.5329worker1 # [ 75.627088] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_connected addr=lb:500515330worker1 # [ 75.631230] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5331worker2 # [ 75.603300] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5332worker2 # [ 75.606840] systemd[1]: Closed Nix worker-protocol over gRPC.5333worker2 # [ 75.609449] systemd[1]: nix-grpc-daemon.socket: Consumed 270us CPU time over 8.980s wall clock time, 256K memory peak, 19.6K incoming IP traffic, 14.8K outgoing IP traffic.5334worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5335worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds)5336worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5337worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)5338worker1 # [ 75.833688] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_connected addr=lb:500515339worker1 # [ 75.836769] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5340worker1 # [ 76.034896] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_connected addr=lb:500515341worker1 # [ 76.038977] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5342worker1 # [ 76.239371] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_connected addr=lb:500515343worker1 # [ 76.241270] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5344worker1 # [ 76.442131] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_connected addr=lb:500515345worker1 # [ 76.444401] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5346worker1 # [ 76.645278] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_connected addr=lb:500515347worker1 # [ 76.647204] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5348worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5349worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5350worker1 # [ 76.848316] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_connected addr=lb:500515351worker1 # [ 76.850083] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5352worker1 # [ 77.051047] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515353worker1 # [ 77.054533] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5354lb # [ 77.201221] niks3-server[995]: 2026/09/20 10:52:25 INFO lead: acquired remote=192.168.1.3:483705355worker1 # [ 77.240590] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:25Z level=info event=scheduler_take_over5356worker1 # [ 77.254968] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515357worker1 # [ 77.261941] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05358worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5359worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5360client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25361lb # [ 77.962070] envoy[922]: conn peer=[2001:db8:1::3]:36546 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8882 tx=2024 ms=502505362lb # [ 77.966534] envoy[922]: conn peer=[2001:db8:1::1]:39576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1008 tx=305 ms=14505363lb # [ 77.971846] envoy[922]: conn peer=[2001:db8:1::4]:57406 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2293 tx=512 ms=72175364worker1 # [ 78.065226] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:555825365worker1 # [ 78.072791] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5366client # don't know how to build these paths:5367client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5368worker1 # [ 78.089642] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555825369worker1 # [ 78.100953] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5370worker1 # [ 78.111512] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5)5371worker1 # [ 78.220428] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 347 ms (attempt 3/5)5372worker1 # [ 78.573403] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 308 ms (attempt 4/5)5373worker1 # [ 78.888218] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5374worker1 # [ 78.913279] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05375worker1 # [ 78.917260] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15376worker1 # [ 78.966778] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825377worker1 # [ 78.979870] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555825378client # copying 1 paths to 'lb:50051'...5379client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5380worker1 # [ 78.992486] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555825381worker1 # [ 79.001179] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5382worker1 # [ 79.021637] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=info event=niks3_push_started pid=13225383worker1 # [ 79.341863] nix-daemon[842]: accepted connection from pid 1335, user nix-grpc-daemon (trusted)5384worker1 # [ 79.356825] nix-daemon[842]: reaped child process 1338, status = succeeded5385worker1 # [ 79.513339] nix-daemon[842]: accepted connection from pid 1340, user nix-grpc-daemon (trusted)5386worker1 # [ 79.528225] nix-daemon[842]: reaped child process 1343, status = succeeded5387lb # [ 79.500875] niks3-server[995]: 2026/09/20 10:52:27 INFO Received uploads request method=POST path=/api/pending_closures5388worker1 # [ 79.548385] nix-grpc-daemon[1322]: time=2026-09-20T10:52:27.638Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5389worker1 # [ 79.549933] nix-grpc-daemon[1322]: time=2026-09-20T10:52:27.640Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5390lb # [ 79.537814] niks3-server[995]: 2026/09/20 10:52:27 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5391lb # [ 79.544429] niks3-server[995]: 2026/09/20 10:52:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5392lb # [ 79.552579] niks3-server[995]: 2026/09/20 10:52:27 INFO Signed narinfos id=27 count=15393worker1 # [ 79.595130] nix-grpc-daemon[1322]: time=2026-09-20T10:52:27.685Z level=INFO msg="Uploading 1 narinfos"5394lb # [ 79.559566] niks3-server[995]: 2026/09/20 10:52:27 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5395lb # [ 79.569648] niks3-server[995]: 2026/09/20 10:52:27 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5396lb # [ 79.573410] niks3-server[995]: 2026/09/20 10:52:27 INFO Completed upload id=275397worker1 # [ 79.614863] nix-grpc-daemon[1322]: time=2026-09-20T10:52:27.705Z level=INFO msg="Upload complete. (414ms)"5398worker1 # [ 79.617782] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=0 paths=1 nar_bytes_in=5205399worker1 # [ 79.623619] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825400worker1 # [ 79.631078] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5401worker1 # [ 79.636942] nix-daemon[842]: reaped child process 1320, status = succeeded5402worker1 # [ 79.642353] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5403client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5404lb # [ 79.602648] niks3-server[995]: 2026/09/20 10:52:27 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5405client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5406client # farm-a> LOG-farm-a-on-standby5407worker1 # [ 80.258951] nix-daemon[842]: reaped child process 1347, status = succeeded5408worker1 # [ 80.391774] nix-daemon[842]: accepted connection from pid 1362, user nix-grpc-daemon (trusted)5409worker1 # [ 80.403749] nix-daemon[842]: reaped child process 1365, status = succeeded5410lb # [ 80.378158] niks3-server[995]: 2026/09/20 10:52:28 INFO Received uploads request method=POST path=/api/pending_closures5411worker1 # [ 80.424714] nix-grpc-daemon[1322]: time=2026-09-20T10:52:28.515Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5412worker1 # [ 80.426282] nix-grpc-daemon[1322]: time=2026-09-20T10:52:28.516Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5413lb # [ 80.413880] niks3-server[995]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5414lb # [ 80.425148] niks3-server[995]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5415lb # [ 80.435992] niks3-server[995]: 2026/09/20 10:52:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5416lb # [ 80.441967] niks3-server[995]: 2026/09/20 10:52:28 INFO Signed narinfos id=28 count=15417worker1 # [ 80.483948] nix-grpc-daemon[1322]: time=2026-09-20T10:52:28.574Z level=INFO msg="Uploading 1 narinfos"5418lb # [ 80.444910] niks3-server[995]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5419lb # [ 80.455405] niks3-server[995]: 2026/09/20 10:52:28 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5420lb # [ 80.461587] niks3-server[995]: 2026/09/20 10:52:28 INFO Completed upload id=285421worker1 # [ 80.501086] nix-grpc-daemon[1322]: time=2026-09-20T10:52:28.591Z level=INFO msg="Upload complete. (252ms)"5422lb # [ 80.464054] niks3-server[995]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5423worker1 # [ 80.511505] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=0 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15424worker1 # [ 80.518728] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:28Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05425worker1 # [ 80.522083] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:28Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15426worker1 # [ 80.529577] nix-daemon[842]: reaped child process 1345, status = succeeded5427worker1 # [ 80.562397] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825428worker1 # [ 80.573634] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555825429worker1 # [ 80.586865] nix-grpc-daemon[1322]: time=2026-09-20T10:52:28.676Z level=INFO msg="All 1 paths already cached"5430client # copying 1 paths to 'lb:50051'...5431client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5432worker1 # [ 80.593866] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555825433worker1 # [ 80.603136] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5434worker1 # [ 80.767935] nix-daemon[842]: accepted connection from pid 1371, user nix-grpc-daemon (trusted)5435worker1 # [ 80.782191] nix-daemon[842]: reaped child process 1374, status = succeeded5436worker1 # [ 80.929392] nix-daemon[842]: accepted connection from pid 1376, user nix-grpc-daemon (trusted)5437worker1 # [ 80.943072] nix-daemon[842]: reaped child process 1379, status = succeeded5438lb # [ 80.917328] niks3-server[995]: 2026/09/20 10:52:28 INFO Received uploads request method=POST path=/api/pending_closures5439worker1 # [ 80.964334] nix-grpc-daemon[1322]: time=2026-09-20T10:52:29.054Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5440worker1 # [ 80.965669] nix-grpc-daemon[1322]: time=2026-09-20T10:52:29.054Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5441lb # [ 80.941666] niks3-server[995]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5442lb # [ 80.950703] niks3-server[995]: 2026/09/20 10:52:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5443lb # [ 80.955251] niks3-server[995]: 2026/09/20 10:52:28 INFO Signed narinfos id=29 count=15444worker1 # [ 80.997564] nix-grpc-daemon[1322]: time=2026-09-20T10:52:29.087Z level=INFO msg="Uploading 1 narinfos"5445lb # [ 80.966193] niks3-server[995]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5446lb # [ 80.974986] niks3-server[995]: 2026/09/20 10:52:28 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5447worker1 # [ 81.019688] nix-grpc-daemon[1322]: time=2026-09-20T10:52:29.110Z level=INFO msg="Upload complete. (406ms)"5448lb # [ 80.980588] niks3-server[995]: 2026/09/20 10:52:28 INFO Completed upload id=295449worker1 # [ 81.022197] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=0 paths=1 nar_bytes_in=6405450lb # [ 80.983756] niks3-server[995]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5451worker1 # [ 81.027123] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825452worker1 # [ 81.033545] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5453worker1 # [ 81.036042] nix-daemon[842]: reaped child process 1369, status = succeeded5454worker1 # [ 81.041238] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5455client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5456client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5457client # farm-b> LOG-farm-b-on-standby5458worker1 # [ 82.268562] nix-daemon[842]: reaped child process 1383, status = succeeded5459worker1 # [ 82.414093] nix-daemon[842]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)5460worker1 # [ 82.424766] nix-daemon[842]: reaped child process 1401, status = succeeded5461lb # [ 82.399806] niks3-server[995]: 2026/09/20 10:52:30 INFO Received uploads request method=POST path=/api/pending_closures5462worker1 # [ 82.447754] nix-grpc-daemon[1322]: time=2026-09-20T10:52:30.537Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5463worker1 # [ 82.449533] nix-grpc-daemon[1322]: time=2026-09-20T10:52:30.539Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5464lb # [ 82.433534] niks3-server[995]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5465lb # [ 82.447101] niks3-server[995]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5466lb # [ 82.451367] niks3-server[995]: 2026/09/20 10:52:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5467lb # [ 82.455726] niks3-server[995]: 2026/09/20 10:52:30 INFO Signed narinfos id=30 count=15468worker1 # [ 82.498162] nix-grpc-daemon[1322]: time=2026-09-20T10:52:30.588Z level=INFO msg="Uploading 1 narinfos"5469lb # [ 82.468480] niks3-server[995]: 2026/09/20 10:52:30 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5470lb # [ 82.473323] niks3-server[995]: 2026/09/20 10:52:30 INFO Completed upload id=305471worker1 # [ 82.514911] nix-grpc-daemon[1322]: time=2026-09-20T10:52:30.605Z level=INFO msg="Upload complete. (266ms)"5472lb # [ 82.481767] niks3-server[995]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5473worker1 # [ 82.520716] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15474lb # [ 82.487618] niks3-server[995]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5475worker1 # [ 82.531611] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:30Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05476worker1 # [ 82.536179] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:30Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15477worker1 # [ 82.540486] nix-daemon[842]: reaped child process 1381, status = succeeded5478worker1 # [ 82.574540] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825479worker1 # [ 82.586841] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555825480worker1 # [ 82.599676] nix-grpc-daemon[1322]: time=2026-09-20T10:52:30.690Z level=INFO msg="All 2 paths already cached"5481client # copying 1 paths to 'lb:50051'...5482client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5483worker1 # [ 82.607492] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555825484worker1 # [ 82.615619] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5485worker1 # [ 82.767360] nix-daemon[842]: accepted connection from pid 1407, user nix-grpc-daemon (trusted)5486worker1 # [ 82.779300] nix-daemon[842]: reaped child process 1410, status = succeeded5487worker1 # [ 82.910307] nix-daemon[842]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5488worker1 # [ 82.921772] nix-daemon[842]: reaped child process 1415, status = succeeded5489lb # [ 82.893238] niks3-server[995]: 2026/09/20 10:52:30 INFO Received uploads request method=POST path=/api/pending_closures5490worker1 # [ 82.942304] nix-grpc-daemon[1322]: time=2026-09-20T10:52:31.032Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5491worker1 # [ 82.943781] nix-grpc-daemon[1322]: time=2026-09-20T10:52:31.034Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5492lb # [ 82.923650] niks3-server[995]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5493lb # [ 82.936256] niks3-server[995]: 2026/09/20 10:52:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5494worker1 # [ 82.981717] nix-grpc-daemon[1322]: time=2026-09-20T10:52:31.072Z level=INFO msg="Uploading 1 narinfos"5495lb # [ 82.942419] niks3-server[995]: 2026/09/20 10:52:30 INFO Signed narinfos id=31 count=15496lb # [ 82.946628] niks3-server[995]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5497lb # [ 82.957154] niks3-server[995]: 2026/09/20 10:52:30 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5498worker1 # [ 83.001107] nix-grpc-daemon[1322]: time=2026-09-20T10:52:31.091Z level=INFO msg="Upload complete. (373ms)"5499lb # [ 82.961814] niks3-server[995]: 2026/09/20 10:52:30 INFO Completed upload id=315500worker1 # [ 83.003088] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=0 paths=1 nar_bytes_in=7685501worker1 # [ 83.006311] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825502lb # [ 82.967483] niks3-server[995]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5503worker1 # [ 83.012987] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5504worker1 # [ 83.015568] nix-daemon[842]: reaped child process 1405, status = succeeded5505client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5506worker1 # [ 83.021477] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5507client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5508client # farm-top> LOG-farm-top-on-standby5509worker1 # [ 84.446641] nix-daemon[842]: reaped child process 1419, status = succeeded5510worker1 # [ 84.570591] nix-daemon[842]: accepted connection from pid 1434, user nix-grpc-daemon (trusted)5511worker1 # [ 84.582421] nix-daemon[842]: reaped child process 1437, status = succeeded5512lb # [ 84.555934] niks3-server[995]: 2026/09/20 10:52:32 INFO Received uploads request method=POST path=/api/pending_closures5513worker1 # [ 84.603507] nix-grpc-daemon[1322]: time=2026-09-20T10:52:32.693Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5514worker1 # [ 84.605161] nix-grpc-daemon[1322]: time=2026-09-20T10:52:32.695Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5515lb # [ 84.593846] niks3-server[995]: 2026/09/20 10:52:32 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5516lb # [ 84.601168] niks3-server[995]: 2026/09/20 10:52:32 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5517lb # [ 84.610992] niks3-server[995]: 2026/09/20 10:52:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5518lb # [ 84.617514] niks3-server[995]: 2026/09/20 10:52:32 INFO Signed narinfos id=32 count=15519worker1 # [ 84.659444] nix-grpc-daemon[1322]: time=2026-09-20T10:52:32.749Z level=INFO msg="Uploading 1 narinfos"5520lb # [ 84.620327] niks3-server[995]: 2026/09/20 10:52:32 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5521lb # [ 84.630853] niks3-server[995]: 2026/09/20 10:52:32 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5522lb # [ 84.637128] niks3-server[995]: 2026/09/20 10:52:32 INFO Completed upload id=325523worker1 # [ 84.676287] nix-grpc-daemon[1322]: time=2026-09-20T10:52:32.766Z level=INFO msg="Upload complete. (247ms)"5524lb # [ 84.640176] niks3-server[995]: 2026/09/20 10:52:32 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5525worker1 # [ 84.680509] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15526worker1 # [ 84.694557] nix-daemon[842]: reaped child process 1417, status = succeeded5527client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.86 seconds)5528client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5529client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5530worker2 # [ 84.933279] systemd[1]: Listening on Nix worker-protocol over gRPC.5531worker2 # [ 84.937347] systemd[1]: Starting Nix worker-protocol over gRPC...5532worker2 # [ 85.103653] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5533worker2 # [ 85.107745] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15534worker2 # [ 85.113797] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5535worker2 # [ 85.116803] systemd[1]: Started Nix worker-protocol over gRPC.5536lb: must succeed: curl -sf localhost:9901/clusters5537worker2 # [ 85.146721] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:32Z level=info event=scheduler_connected addr=lb:500515538worker1 # [ 85.181152] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05539lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5540worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5541worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5542lb: must succeed: curl -sf localhost:9901/clusters5543lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5544lb: must succeed: curl -sf localhost:9901/clusters5545lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5546worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5547worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5548(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.13 seconds)5549subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5550client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5551client # [ 85.502411] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5552client # Running as unit: rs.service; invocation ID: d338c37acb804662909add524890f0d05553client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5554worker2 # [ 85.658569] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536605555worker2 # [ 85.664710] nix-daemon[840]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)5556client # [ 85.701873] nix[1177]: don't know how to build these paths:5557client # [ 85.702836] nix[1177]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5558worker1 # [ 85.710879] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:33Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05559worker1 # [ 85.716439] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:33Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15560worker1 # [ 85.759185] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825561worker1 # [ 85.771728] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555825562client # [ 85.780257] nix[1177]: copying 1 paths to 'lb:50051'...5563worker1 # [ 85.782810] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555825564client # [ 85.783150] nix[1177]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5565worker1 # [ 85.797135] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5566worker1 # [ 85.948069] nix-daemon[842]: accepted connection from pid 1450, user nix-grpc-daemon (trusted)5567worker1 # [ 85.960230] nix-daemon[842]: reaped child process 1453, status = succeeded5568worker1 # [ 86.125277] nix-daemon[842]: accepted connection from pid 1455, user nix-grpc-daemon (trusted)5569worker1 # [ 86.135820] nix-daemon[842]: reaped child process 1458, status = succeeded5570lb # [ 86.114173] niks3-server[995]: 2026/09/20 10:52:34 INFO Received uploads request method=POST path=/api/pending_closures5571worker1 # [ 86.161644] nix-grpc-daemon[1322]: time=2026-09-20T10:52:34.251Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5572worker1 # [ 86.163235] nix-grpc-daemon[1322]: time=2026-09-20T10:52:34.253Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5573lb # [ 86.144071] niks3-server[995]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5574lb # [ 86.158173] niks3-server[995]: 2026/09/20 10:52:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5575lb # [ 86.163101] niks3-server[995]: 2026/09/20 10:52:34 INFO Signed narinfos id=33 count=15576worker1 # [ 86.207162] nix-grpc-daemon[1322]: time=2026-09-20T10:52:34.297Z level=INFO msg="Uploading 1 narinfos"5577lb # [ 86.169647] niks3-server[995]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5578lb # [ 86.179051] niks3-server[995]: 2026/09/20 10:52:34 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5579lb # [ 86.187791] niks3-server[995]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5580worker1 # [ 86.231981] nix-grpc-daemon[1322]: time=2026-09-20T10:52:34.322Z level=INFO msg="Upload complete. (423ms)"5581lb # [ 86.192719] niks3-server[995]: 2026/09/20 10:52:34 INFO Completed upload id=335582worker1 # [ 86.234147] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=0 paths=1 nar_bytes_in=4165583worker1 # [ 86.236968] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555825584worker1 # [ 86.242283] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5585worker1 # [ 86.246743] nix-daemon[842]: reaped child process 1448, status = succeeded5586client # [ 86.249358] nix[1177]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5587worker1 # [ 86.252461] nix-daemon[842]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5588lb # [ 87.962743] envoy[922]: conn peer=[2001:db8:1::1]:50782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9521 tx=3821 ms=66395589lb: must succeed: curl -sf localhost:9901/clusters5590lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5591lb: must succeed: curl -sf localhost:9901/clusters5592lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5593lb: must succeed: curl -sf localhost:9901/clusters5594lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5595lb: must succeed: curl -sf localhost:9901/clusters5596lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5597worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5598worker2 # [ 88.305597] systemd-journald[287]: Received client request to rotate journal, rotating.5599worker2 # [ 88.321054] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/171dd3ab27aa4531bdadcca0221866b7.5600worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)5601worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5602worker1 # [ 88.261512] systemd[1]: Stopping Nix worker-protocol over gRPC...5603worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5604client: must succeed: sleep 5.05605worker1 # [ 89.238433] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:37Z level=info event=draining5606client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5607worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5608worker1 # [ 93.683622] nix-daemon[842]: reaped child process 1462, status = succeeded5609worker1 # [ 93.824129] nix-daemon[842]: accepted connection from pid 1502, user nix-grpc-daemon (trusted)5610worker1 # [ 93.835774] nix-daemon[842]: reaped child process 1505, status = succeeded5611lb # [ 93.809439] niks3-server[995]: 2026/09/20 10:52:41 INFO Received uploads request method=POST path=/api/pending_closures5612worker1 # [ 93.857549] nix-grpc-daemon[1322]: time=2026-09-20T10:52:41.947Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5613worker1 # [ 93.859155] nix-grpc-daemon[1322]: time=2026-09-20T10:52:41.949Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5614lb # [ 93.855942] niks3-server[995]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5615lb # [ 93.861304] niks3-server[995]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5616lb # [ 93.873126] niks3-server[995]: 2026/09/20 10:52:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5617lb # [ 93.877431] niks3-server[995]: 2026/09/20 10:52:41 INFO Signed narinfos id=34 count=15618worker1 # [ 93.919900] nix-grpc-daemon[1322]: time=2026-09-20T10:52:42.010Z level=INFO msg="Uploading 1 narinfos"5619lb # [ 93.882371] niks3-server[995]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5620lb # [ 93.891330] niks3-server[995]: 2026/09/20 10:52:41 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5621lb # [ 93.898126] niks3-server[995]: 2026/09/20 10:52:41 INFO Completed upload id=345622worker1 # [ 93.937749] nix-grpc-daemon[1322]: time=2026-09-20T10:52:42.028Z level=INFO msg="Upload complete. (272ms)"5623lb # [ 93.899710] niks3-server[995]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5624worker1 # [ 93.945625] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55582 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15625worker1 # [ 93.957430] nix-daemon[842]: reaped child process 1460, status = succeeded5626client # [ 93.968648] systemd[1]: rs.service: Deactivated successfully.5627client # [ 93.972245] systemd[1]: rs.service: Consumed 102ms CPU time over 8.468s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5628worker1 # [ 94.239856] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=signal_exit5629worker1 # [ 94.260352] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_yield5630lb # [ 94.224869] niks3-server[995]: 2026/09/20 10:52:42 INFO lead: released remote=192.168.1.3:483705631worker1 # [ 94.264785] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_restarting addr=lb:500515632worker2 # [ 94.234449] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:41Z level=info event=scheduler_restarting addr=lb:500515633worker1 # [ 94.268901] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:555765634worker1 # [ 94.272194] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=worker_gone addr=192.168.1.3:500515635worker1 # [ 94.277850] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:555765636worker1 # [ 94.281173] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=worker_gone addr=192.168.1.4:500515637worker1 # [ 94.465870] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515638worker2 # [ 94.434836] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:41Z level=info event=scheduler_connected addr=lb:500515639worker1 # [ 94.469822] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5640worker2 # [ 94.438991] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5641worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.10 seconds)5642client: waiting for success: ! systemctl is-active rs5643worker1 # [ 94.671149] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515644worker2 # [ 94.639388] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515645worker1 # [ 94.675314] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5646worker2 # [ 94.644943] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5647client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds)5648client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5649client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5650client: must fail: journalctl -u rs | grep -q 'reconnecting'5651client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5652lb: must succeed: curl -sf localhost:9901/clusters5653lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5654worker2 # [ 94.845109] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515655worker1 # [ 94.875939] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515656worker2 # [ 94.847234] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5657worker1 # [ 94.879950] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5658worker2 # [ 95.047724] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515659worker2 # [ 95.049635] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5660worker1 # [ 95.081491] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500515661worker1 # [ 95.085158] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5662worker2 # [ 95.124972] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_take_over5663lb # [ 95.118130] niks3-server[995]: 2026/09/20 10:52:43 INFO lead: acquired remote=192.168.1.4:434185664worker1 # [ 95.261232] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:43Z level=info event=scheduler_restarting5665worker1 # [ 95.277449] nix-grpc-daemon[1249]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5666worker1 # [ 95.280694] nix-grpc-daemon[1249]: E0000 00:00:1789901563.367615 1292 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5667worker2 # [ 95.251932] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515668worker1 # [ 95.285496] nix-grpc-daemon[1249]: E0000 00:00:1789901563.367828 1292 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5669worker2 # [ 95.255377] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5670worker1 # [ 95.303284] nix-grpc-daemon[1249]: ts=2026-09-20T10:52:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5671worker1 # [ 95.311895] nix-daemon[842]: reaped child process 1313, status = succeeded5672worker1 # [ 95.339362] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5673worker1 # [ 95.340347] systemd[1]: Stopped Nix worker-protocol over gRPC.5674worker1 # [ 95.341715] systemd[1]: nix-grpc-daemon.service: Consumed 1.281s CPU time over 23.291s wall clock time, 35.1M memory peak, 47.3K incoming IP traffic, 90.7K outgoing IP traffic.5675worker1 # [ 95.347643] systemd[1]: Starting Nix worker-protocol over gRPC...5676worker1 # [ 95.488859] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5677worker2 # [ 95.455880] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500515678worker2 # [ 95.459927] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5679worker1 # [ 95.492654] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15680worker1 # [ 95.498066] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5681worker1 # [ 95.501963] systemd[1]: Started Nix worker-protocol over gRPC.5682worker1 # [ 95.522997] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500515683worker1 # [ 95.524642] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5684worker2 # [ 95.660528] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500515685worker2 # [ 95.667720] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05686worker1 # [ 95.725902] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500515687worker2 # [ 95.694826] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05688lb: must succeed: curl -sf localhost:9901/clusters5689lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5690worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5691worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5692(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.48 seconds)5693subtest: scheduler restart mid-build: build finishes, no double build5694client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5695client # [ 95.979122] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5696client # Running as unit: mid.service; invocation ID: 4f7aa3fb894e48a6b35959e7e7a2ee305697client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5698worker2 # [ 96.146357] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536605699client # [ 96.179368] nix[1213]: don't know how to build these paths:5700client # [ 96.180327] nix[1213]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5701worker2 # [ 96.154336] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:43Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05702worker2 # [ 96.156407] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:43Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15703worker2 # [ 96.198405] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536605704worker2 # [ 96.209741] nix-grpc-daemon[1124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5)5705worker2 # [ 96.227538] nix-grpc-daemon[1124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 2/5)5706worker2 # [ 96.292914] nix-grpc-daemon[1124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 3/5)5707worker2 # [ 96.604231] nix-grpc-daemon[1124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 4/5)5708worker2 # [ 96.717752] nix-grpc-daemon[1124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5709worker2 # [ 96.734702] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536605710client # [ 96.775278] nix[1213]: copying 1 paths to 'lb:50051'...5711worker2 # [ 96.745679] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536605712client # [ 96.778069] nix[1213]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5713worker2 # [ 96.754966] nix-daemon[840]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)5714worker2 # [ 96.775466] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:44Z level=info event=niks3_push_started pid=12335715worker2 # [ 97.136106] nix-daemon[840]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5716worker2 # [ 97.149236] nix-daemon[840]: reaped child process 1249, status = succeeded5717worker2 # [ 97.322884] nix-daemon[840]: accepted connection from pid 1254, user nix-grpc-daemon (trusted)5718worker2 # [ 97.336909] nix-daemon[840]: reaped child process 1258, status = succeeded5719lb # [ 97.345921] niks3-server[995]: 2026/09/20 10:52:45 INFO Received uploads request method=POST path=/api/pending_closures5720worker2 # [ 97.362902] nix-grpc-daemon[1233]: time=2026-09-20T10:52:44.830Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5721worker2 # [ 97.364463] nix-grpc-daemon[1233]: time=2026-09-20T10:52:44.832Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5722lb # [ 97.381879] niks3-server[995]: 2026/09/20 10:52:45 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5723lb # [ 97.389764] niks3-server[995]: 2026/09/20 10:52:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5724lb # [ 97.394585] niks3-server[995]: 2026/09/20 10:52:45 INFO Signed narinfos id=35 count=15725worker2 # [ 97.404792] nix-grpc-daemon[1233]: time=2026-09-20T10:52:44.872Z level=INFO msg="Uploading 1 narinfos"5726lb # [ 97.405439] niks3-server[995]: 2026/09/20 10:52:45 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5727lb # [ 97.413053] niks3-server[995]: 2026/09/20 10:52:45 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5728lb # [ 97.421924] niks3-server[995]: 2026/09/20 10:52:45 INFO Completed upload id=355729worker2 # [ 97.429178] nix-grpc-daemon[1233]: time=2026-09-20T10:52:44.897Z level=INFO msg="Upload complete. (462ms)"5730lb # [ 97.424213] niks3-server[995]: 2026/09/20 10:52:45 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5731worker2 # [ 97.432033] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53660 duration_s=0 paths=1 nar_bytes_in=4245732worker2 # [ 97.435843] nix-grpc-daemon[1124]: ts=2026-09-20T10:52:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536605733worker2 # [ 97.444065] nix-daemon[840]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)5734worker2 # [ 97.446518] nix-daemon[840]: reaped child process 1231, status = succeeded5735worker2 # [ 97.452137] nix-daemon[840]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)5736client # [ 97.482592] nix[1213]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5737lb # [ 97.963792] envoy[922]: conn peer=[2001:db8:1::1]:33710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1322 ms=82645738lb # [ 97.967475] envoy[922]: conn peer=[2001:db8:1::3]:34740 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5568 tx=1292 ms=230345739lb: must succeed: curl -sf localhost:9901/clusters5740lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5741lb: must succeed: curl -sf localhost:9901/clusters5742lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5743worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5744worker2 # [ 99.731402] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1124 (nix-grpc-daemon) on client request.5745worker2 # [ 99.735366] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5746lb # [ 99.735799] niks3-server[995]: 2026/09/20 10:52:47 INFO lead: released remote=192.168.1.4:434185747client # [ 99.783438] nix[1213]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5748worker1 # [ 99.783937] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:47Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5749worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5750client: must succeed: sleep 5.05751client # [ 99.788196] nix[1213]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5752worker2 # [ 99.769593] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5753worker2 # [ 99.771232] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5754worker2 # [ 99.773358] systemd[1]: nix-grpc-daemon.service: Consumed 426ms CPU time over 14.830s wall clock time, 33.1M memory peak, 13.4K incoming IP traffic, 19.9K outgoing IP traffic.5755worker2 # [ 99.777359] nix-daemon[840]: reaped child process 1260, status = succeeded5756worker2 # [ 99.778402] nix-daemon[840]: reaped child process 1180, status = succeeded5757worker2 # [ 99.785269] nix-daemon[1262]: unexpected Nix daemon error: error: interrupted by the user5758worker2 # [ 99.789066] nix-daemon[840]: reaped child process 1262, status = failed with exit code 15759worker1 # [ 99.984169] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:48Z level=info event=scheduler_connected addr=lb:500515760worker2 # [ 99.955831] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5761worker2 # [ 99.965932] systemd[1]: Starting Nix worker-protocol over gRPC...5762worker2 # [ 100.160538] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5763worker2 # [ 100.163914] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15764worker2 # [ 100.172486] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5765worker2 # [ 100.175227] systemd[1]: Started Nix worker-protocol over gRPC.5766worker2 # [ 100.184375] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=info event=scheduler_take_over5767lb # [ 100.176855] niks3-server[995]: 2026/09/20 10:52:48 INFO lead: acquired remote=192.168.1.4:545865768worker1 # [ 100.221108] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5769worker2 # [ 100.202585] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=info event=scheduler_connected addr=lb:500515770worker2 # [ 100.204404] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05771worker2 # [ 100.266059] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05772worker2 # [ 100.269945] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15773worker2 # [ 100.323179] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561785774worker2 # [ 100.333173] nix-daemon[840]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5775worker2 # [ 100.346773] nix-daemon[840]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5776client # [ 100.388344] nix[1213]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5777worker2 # [ 100.359617] nix-daemon[840]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5778worker1 # [ 100.421884] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:48Z level=info event=scheduler_connected addr=lb:500515779worker2 # [ 100.391199] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05780client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5781client: waiting for success: ! systemctl is-active mid5782worker2 # [ 105.182357] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:52Z level=info event=niks3_push_started pid=13775783worker2 # [ 105.209818] nix-daemon[840]: reaped child process 1353, status = succeeded5784worker2 # [ 105.533729] nix-daemon[840]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5785worker2 # [ 105.545260] nix-daemon[840]: reaped child process 1393, status = succeeded5786lb # [ 105.553704] niks3-server[995]: 2026/09/20 10:52:53 INFO Received uploads request method=POST path=/api/pending_closures5787worker2 # [ 105.570949] nix-grpc-daemon[1377]: time=2026-09-20T10:52:53.038Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5788worker2 # [ 105.572623] nix-grpc-daemon[1377]: time=2026-09-20T10:52:53.040Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5789lb # [ 105.602403] niks3-server[995]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5790worker2 # [ 105.627126] nix-grpc-daemon[1377]: time=2026-09-20T10:52:53.094Z level=INFO msg="Uploading 1 narinfos"5791lb # [ 105.619305] niks3-server[995]: 2026/09/20 10:52:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5792lb # [ 105.622506] niks3-server[995]: 2026/09/20 10:52:53 INFO Signed narinfos id=36 count=15793lb # [ 105.634253] niks3-server[995]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5794lb # [ 105.638052] niks3-server[995]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5795lb # [ 105.640478] niks3-server[995]: 2026/09/20 10:52:53 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5796lb # [ 105.643240] niks3-server[995]: 2026/09/20 10:52:53 INFO Completed upload id=365797worker2 # [ 105.650480] nix-grpc-daemon[1377]: time=2026-09-20T10:52:53.118Z level=INFO msg="Upload complete. (265ms)"5798lb # [ 105.645467] niks3-server[995]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5799worker2 # [ 105.654565] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56178 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15800worker2 # [ 105.671924] nix-daemon[840]: reaped child process 1351, status = succeeded5801client # [ 105.726118] systemd[1]: mid.service: Deactivated successfully.5802client # [ 105.729983] systemd[1]: mid.service: Consumed 125ms CPU time over 9.750s wall clock time, 39.3M memory peak, 9.4K incoming IP traffic, 10.7K outgoing IP traffic.5803client: (finished: waiting for success: ! systemctl is-active mid, in 1.10 seconds)5804client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5805client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5806(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.29 seconds)5807subtest: interrupting the client stops the build on the worker5808client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5809client # [ 106.244807] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5810client # Running as unit: intr.service; invocation ID: f2c62821746c40198cbd518a1c95cc655811client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5812worker1 # [ 106.435896] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609225813worker1 # [ 106.446344] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5814client # [ 106.456908] nix[1249]: don't know how to build these paths:5815client # [ 106.457805] nix[1249]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5816worker2 # [ 106.436688] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:53Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05817worker2 # [ 106.441117] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:53Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15818worker1 # [ 106.511961] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609225819worker1 # [ 106.523801] nix-grpc-daemon[1512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 1/5)5820worker1 # [ 106.550449] nix-grpc-daemon[1512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 146 ms (attempt 2/5)5821worker1 # [ 106.702254] nix-grpc-daemon[1512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 240 ms (attempt 3/5)5822worker1 # [ 106.948278] nix-grpc-daemon[1512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 616 ms (attempt 4/5)5823worker1 # [ 107.565729] nix-grpc-daemon[1512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5824worker1 # [ 107.581928] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609225825client # [ 107.591797] nix[1249]: copying 1 paths to 'lb:50051'...5826worker1 # [ 107.593706] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609225827client # [ 107.594518] nix[1249]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5828worker1 # [ 107.607151] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5829worker1 # [ 107.624606] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:55Z level=info event=niks3_push_started pid=16045830worker1 # [ 107.964213] nix-daemon[842]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)5831worker1 # [ 107.976542] nix-daemon[842]: reaped child process 1620, status = succeeded5832lb # [ 107.963619] envoy[922]: conn peer=[2001:db8:1::4]:48808 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1948 tx=539 ms=146105833lb # [ 107.967606] envoy[922]: conn peer=[2001:db8:1::1]:47256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1637 ms=95225834worker1 # [ 108.113236] nix-daemon[842]: accepted connection from pid 1622, user nix-grpc-daemon (trusted)5835worker1 # [ 108.125546] nix-daemon[842]: reaped child process 1625, status = succeeded5836lb # [ 108.099368] niks3-server[995]: 2026/09/20 10:52:56 INFO Received uploads request method=POST path=/api/pending_closures5837worker1 # [ 108.147497] nix-grpc-daemon[1604]: time=2026-09-20T10:52:56.237Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5838worker1 # [ 108.149528] nix-grpc-daemon[1604]: time=2026-09-20T10:52:56.239Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5839lb # [ 108.133461] niks3-server[995]: 2026/09/20 10:52:56 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5840lb # [ 108.141524] niks3-server[995]: 2026/09/20 10:52:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5841worker1 # [ 108.185607] nix-grpc-daemon[1604]: time=2026-09-20T10:52:56.275Z level=INFO msg="Uploading 1 narinfos"5842lb # [ 108.146147] niks3-server[995]: 2026/09/20 10:52:56 INFO Signed narinfos id=37 count=15843lb # [ 108.158904] niks3-server[995]: 2026/09/20 10:52:56 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5844lb # [ 108.167158] niks3-server[995]: 2026/09/20 10:52:56 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5845lb # [ 108.170532] niks3-server[995]: 2026/09/20 10:52:56 INFO Completed upload id=375846worker1 # [ 108.209655] nix-grpc-daemon[1604]: time=2026-09-20T10:52:56.300Z level=INFO msg="Upload complete. (388ms)"5847lb # [ 108.172122] niks3-server[995]: 2026/09/20 10:52:56 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5848worker1 # [ 108.212483] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=4245849worker1 # [ 108.218569] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609225850worker1 # [ 108.226300] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5851worker1 # [ 108.229369] nix-daemon[842]: reaped child process 1602, status = succeeded5852client # [ 108.232317] nix[1249]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5853worker1 # [ 108.234815] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5854client: must succeed: systemctl kill -s INT intr5855client # [ 109.787133] systemd[1]: intr.service: Sent signal SIGINT to main process 1249 (nix) on client request.5856worker1 # [ 109.795225] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:57Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5857client # [ 109.795345] nix[1249]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5858client: (finished: must succeed: systemctl kill -s INT intr, in 0.06 seconds)5859client # [ 109.802316] nix[1249]: error: interrupted by the user5860client # [ 109.830719] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5861client # [ 109.832189] systemd[1]: intr.service: Failed with result 'exit-code'.5862client # [ 109.834113] systemd[1]: intr.service: Consumed 102ms CPU time over 3.588s wall clock time, 39.1M memory peak, 7.8K incoming IP traffic, 8.9K outgoing IP traffic.5863worker1 # [ 109.860286] nix-daemon[842]: reaped child process 1627, status = succeeded5864worker1 # [ 109.863264] nix-daemon[1629]: unexpected Nix daemon error: error: interrupted by the user5865worker1 # [ 109.867355] nix-daemon[842]: reaped child process 1629, status = failed with exit code 15866(finished: subtest: interrupting the client stops the build on the worker, in 3.68 seconds)5867subtest: a deploy mid-build drains: the build finishes, the new generation takes over5868client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5869client # [ 109.953854] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5870client # Running as unit: sw.service; invocation ID: b7ec95fbf65d4560972d30c8d02d58685871client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5872worker1 # [ 110.148636] nix-grpc-daemon[1512]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609225873client # [ 110.148442] nix[1269]: don't know how to build these paths:5874client # [ 110.149322] nix[1269]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5875worker2 # [ 110.125392] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:57Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05876worker2 # [ 110.129396] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:57Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15877worker2 # [ 110.167147] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561785878worker2 # [ 110.179749] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 1/5)5879worker2 # [ 110.264346] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 2/5)5880worker2 # [ 110.349335] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 3/5)5881worker2 # [ 110.364224] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 663 ms (attempt 4/5)5882worker2 # [ 111.027983] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5883worker2 # [ 111.045186] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561785884client # [ 111.085695] nix[1269]: copying 1 paths to 'lb:50051'...5885client # [ 111.088681] nix[1269]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5886worker2 # [ 111.059256] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561785887worker2 # [ 111.067871] nix-daemon[840]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5888worker2 # [ 111.246637] nix-daemon[840]: accepted connection from pid 1428, user nix-grpc-daemon (trusted)5889worker2 # [ 111.259247] nix-daemon[840]: reaped child process 1435, status = succeeded5890worker2 # [ 111.419742] nix-daemon[840]: accepted connection from pid 1437, user nix-grpc-daemon (trusted)5891worker2 # [ 111.431666] nix-daemon[840]: reaped child process 1440, status = succeeded5892lb # [ 111.437901] niks3-server[995]: 2026/09/20 10:52:59 INFO Received uploads request method=POST path=/api/pending_closures5893worker2 # [ 111.457054] nix-grpc-daemon[1377]: time=2026-09-20T10:52:58.924Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5894worker2 # [ 111.458512] nix-grpc-daemon[1377]: time=2026-09-20T10:52:58.926Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5895lb # [ 111.475116] niks3-server[995]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5896lb # [ 111.479384] niks3-server[995]: 2026/09/20 10:52:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5897worker2 # [ 111.492654] nix-grpc-daemon[1377]: time=2026-09-20T10:52:58.960Z level=INFO msg="Uploading 1 narinfos"5898lb # [ 111.485178] niks3-server[995]: 2026/09/20 10:52:59 INFO Signed narinfos id=38 count=15899lb # [ 111.490814] niks3-server[995]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5900lb # [ 111.498538] niks3-server[995]: 2026/09/20 10:52:59 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5901lb # [ 111.502200] niks3-server[995]: 2026/09/20 10:52:59 INFO Completed upload id=385902worker2 # [ 111.509233] nix-grpc-daemon[1377]: time=2026-09-20T10:52:58.977Z level=INFO msg="Upload complete. (428ms)"5903lb # [ 111.504056] niks3-server[995]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5904worker2 # [ 111.512706] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56178 duration_s=0 paths=1 nar_bytes_in=4165905worker2 # [ 111.518470] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561785906worker2 # [ 111.526762] nix-daemon[840]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5907worker2 # [ 111.530607] nix-daemon[840]: reaped child process 1426, status = succeeded5908worker2 # [ 111.535440] nix-daemon[840]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5909client # [ 111.565968] nix[1269]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5910worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25911worker2 # Checking switch inhibitors... done5912worker2 # [ 113.098797] nixos[1471]: switching to system configuration /nix/store/sk820hc3azag8pgag8zqa4r8rvx2cp9w-nixos-system-worker2-test5913worker2 # [ 113.102345] systemd[1]: Stopped target Local File Systems.5914worker2 # [ 113.103790] systemd[1]: Stopped target Remote File Systems.5915worker2 # activating the configuration...5916worker2 # setting up /etc...5917worker2 # [ 113.731608] systemd[1]: Reload requested from client PID 1471 ('.switch-to-conf') (unit backdoor.service)...5918worker2 # [ 113.733180] systemd[1]: Reloading...5919worker2 # [ 114.498328] systemd[1]: Reloading finished in 762 ms.5920worker2 # restarting sysinit-reactivation.target5921worker2 # [ 114.553527] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5922worker2 # [ 114.700155] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5923worker2 # [ 114.703494] systemd[1]: Reached target Reactivate sysinit units.5924worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5925worker2 # [ 114.711704] systemd[1]: Reloading Nix worker-protocol over gRPC...5926worker2 # [ 114.712890] systemd[1]: Reloading D-Bus System Message Bus...5927worker2 # [ 114.715436] dbus-broker-launch[534]: Caught SIGHUP, trigger reload.5928worker2 # [ 114.748942] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'...5929worker2 # [ 114.751756] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync'5930worker2 # [ 114.753081] dbus-broker-launch[534]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5931worker2 # [ 114.764079] systemd[1]: Reloaded Nix worker-protocol over gRPC.5932worker2 # [ 114.782327] systemd[1]: Reloaded D-Bus System Message Bus.5933worker2 # [ 114.786820] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5934worker2 # [ 114.788122] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5935worker2 # [ 114.791506] systemd[1]: Reached target Remote File Systems.5936worker2 # [ 114.794827] systemd[1]: Reached target Local File Systems.5937worker2 # [ 114.799378] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5938worker2 # [ 114.803719] systemd[1]: Starting Create SUID/SGID Wrappers...5939worker2 # [ 114.804623] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5940worker2 # [ 114.805969] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675941worker2 # [ 114.807999] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5942worker2 # [ 114.809807] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5943worker2 # [ 114.814391] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5944worker2 # [ 115.187284] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:02Z level=info event=draining5945worker2 # [ 115.270347] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5946worker2 # [ 115.271398] systemd[1]: Finished Create SUID/SGID Wrappers.5947worker2 # [ 115.273927] systemd[1]: Starting linger-users.service...5948worker2 # [ 115.315810] systemd[1]: linger-users.service: Deactivated successfully.5949worker2 # [ 115.317844] systemd[1]: Finished linger-users.service.5950worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5951worker2 # [ 115.573970] nixos[1471]: finished switching to system configuration /nix/store/sk820hc3azag8pgag8zqa4r8rvx2cp9w-nixos-system-worker2-test5952worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.20 seconds)5953worker2: must succeed: pgrep -f 'read -t [9]0 x'5954worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5955client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25956client # don't know how to build these paths:5957client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5958worker1 # [ 115.872895] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609225959worker1 # [ 115.878168] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609225960worker2 # [ 115.862333] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:03Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05961worker2 # [ 115.865148] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:03Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15962worker1 # [ 115.937750] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609225963worker1 # [ 115.951418] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609225964client # copying 1 paths to 'lb:50051'...5965worker1 # [ 115.964177] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609225966client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5967worker1 # [ 115.984653] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5968worker1 # [ 116.165521] nix-daemon[842]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)5969worker1 # [ 116.177889] nix-daemon[842]: reaped child process 1678, status = succeeded5970worker1 # [ 116.342224] nix-daemon[842]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)5971worker1 # [ 116.353767] nix-daemon[842]: reaped child process 1683, status = succeeded5972lb # [ 116.332879] niks3-server[995]: 2026/09/20 10:53:04 INFO Received uploads request method=POST path=/api/pending_closures5973worker1 # [ 116.382421] nix-grpc-daemon[1604]: time=2026-09-20T10:53:04.472Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5974worker1 # [ 116.383907] nix-grpc-daemon[1604]: time=2026-09-20T10:53:04.474Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5975lb # [ 116.363255] niks3-server[995]: 2026/09/20 10:53:04 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5976lb # [ 116.375800] niks3-server[995]: 2026/09/20 10:53:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5977lb # [ 116.381529] niks3-server[995]: 2026/09/20 10:53:04 INFO Signed narinfos id=39 count=15978worker1 # [ 116.423907] nix-grpc-daemon[1604]: time=2026-09-20T10:53:04.514Z level=INFO msg="Uploading 1 narinfos"5979lb # [ 116.388576] niks3-server[995]: 2026/09/20 10:53:04 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5980lb # [ 116.396610] niks3-server[995]: 2026/09/20 10:53:04 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5981lb # [ 116.406657] niks3-server[995]: 2026/09/20 10:53:04 INFO Completed upload id=395982worker1 # [ 116.446160] nix-grpc-daemon[1604]: time=2026-09-20T10:53:04.536Z level=INFO msg="Upload complete. (450ms)"5983lb # [ 116.409248] niks3-server[995]: 2026/09/20 10:53:04 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5984worker1 # [ 116.450225] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=5285985worker1 # [ 116.456533] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609225986worker1 # [ 116.467118] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5987worker1 # [ 116.473818] nix-daemon[842]: reaped child process 1673, status = succeeded5988worker1 # [ 116.479765] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5989client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5990client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5991client # farm-a> LOG-farm-a-during-drain5992lb # [ 117.965104] envoy[922]: conn peer=[2001:db8:1::1]:53138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=755 ms=33865993worker1 # [ 118.104755] nix-daemon[842]: reaped child process 1687, status = succeeded5994worker1 # [ 118.281354] nix-daemon[842]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)5995worker1 # [ 118.291974] nix-daemon[842]: reaped child process 1705, status = succeeded5996lb # [ 118.272582] niks3-server[995]: 2026/09/20 10:53:06 INFO Received uploads request method=POST path=/api/pending_closures5997worker1 # [ 118.320872] nix-grpc-daemon[1604]: time=2026-09-20T10:53:06.411Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5998worker1 # [ 118.323157] nix-grpc-daemon[1604]: time=2026-09-20T10:53:06.412Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5999lb # [ 118.320718] niks3-server[995]: 2026/09/20 10:53:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6000lb # [ 118.330133] niks3-server[995]: 2026/09/20 10:53:06 INFO Signed narinfos id=40 count=16001worker1 # [ 118.370074] nix-grpc-daemon[1604]: time=2026-09-20T10:53:06.459Z level=INFO msg="Uploading 1 narinfos"6002lb # [ 118.337762] niks3-server[995]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6003lb # [ 118.343993] niks3-server[995]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6004lb # [ 118.353975] niks3-server[995]: 2026/09/20 10:53:06 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6005lb # [ 118.360590] niks3-server[995]: 2026/09/20 10:53:06 INFO Completed upload id=406006lb # [ 118.362696] niks3-server[995]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6007worker1 # [ 118.402127] nix-grpc-daemon[1604]: time=2026-09-20T10:53:06.492Z level=INFO msg="Upload complete. (313ms)"6008lb # [ 118.368826] niks3-server[995]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6009worker1 # [ 118.407547] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16010worker2 # [ 118.380541] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:05Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06011worker2 # [ 118.383297] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:05Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16012worker1 # [ 118.421376] nix-daemon[842]: reaped child process 1685, status = succeeded6013worker1 # [ 118.459321] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226014worker1 # [ 118.477386] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226015worker1 # [ 118.491510] nix-grpc-daemon[1604]: time=2026-09-20T10:53:06.581Z level=INFO msg="All 1 paths already cached"6016client # copying 1 paths to 'lb:50051'...6017worker1 # [ 118.499506] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226018client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6019worker1 # [ 118.516442] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6020worker1 # [ 118.687355] nix-daemon[842]: accepted connection from pid 1709, user nix-grpc-daemon (trusted)6021worker1 # [ 118.699128] nix-daemon[842]: reaped child process 1712, status = succeeded6022worker1 # [ 118.840468] nix-daemon[842]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)6023worker1 # [ 118.851905] nix-daemon[842]: reaped child process 1717, status = succeeded6024lb # [ 118.828200] niks3-server[995]: 2026/09/20 10:53:06 INFO Received uploads request method=POST path=/api/pending_closures6025worker1 # [ 118.880904] nix-grpc-daemon[1604]: time=2026-09-20T10:53:06.971Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6026worker1 # [ 118.882464] nix-grpc-daemon[1604]: time=2026-09-20T10:53:06.972Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6027lb # [ 118.869250] niks3-server[995]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6028lb # [ 118.873441] niks3-server[995]: 2026/09/20 10:53:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6029lb # [ 118.878249] niks3-server[995]: 2026/09/20 10:53:06 INFO Signed narinfos id=41 count=16030worker1 # [ 118.920620] nix-grpc-daemon[1604]: time=2026-09-20T10:53:07.010Z level=INFO msg="Uploading 1 narinfos"6031lb # [ 118.890474] niks3-server[995]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6032lb # [ 118.897434] niks3-server[995]: 2026/09/20 10:53:06 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6033lb # [ 118.904578] niks3-server[995]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6034lb # [ 118.909643] niks3-server[995]: 2026/09/20 10:53:06 INFO Completed upload id=416035worker1 # [ 118.949117] nix-grpc-daemon[1604]: time=2026-09-20T10:53:07.039Z level=INFO msg="Upload complete. (418ms)"6036worker1 # [ 118.953195] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=6406037worker1 # [ 118.957689] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226038worker1 # [ 118.966531] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6039worker1 # [ 118.973845] nix-daemon[842]: reaped child process 1707, status = succeeded6040client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6041worker1 # [ 118.979701] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6042client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6043client # farm-b> LOG-farm-b-during-drain6044worker1 # [ 120.394439] nix-daemon[842]: reaped child process 1721, status = succeeded6045worker1 # [ 120.517954] nix-daemon[842]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6046worker1 # [ 120.529568] nix-daemon[842]: reaped child process 1739, status = succeeded6047lb # [ 120.502940] niks3-server[995]: 2026/09/20 10:53:08 INFO Received uploads request method=POST path=/api/pending_closures6048worker1 # [ 120.547092] nix-grpc-daemon[1604]: time=2026-09-20T10:53:08.637Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6049worker1 # [ 120.548665] nix-grpc-daemon[1604]: time=2026-09-20T10:53:08.639Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6050lb # [ 120.540287] niks3-server[995]: 2026/09/20 10:53:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6051lb # [ 120.544172] niks3-server[995]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6052worker1 # [ 120.589579] nix-grpc-daemon[1604]: time=2026-09-20T10:53:08.679Z level=INFO msg="Uploading 1 narinfos"6053lb # [ 120.550958] niks3-server[995]: 2026/09/20 10:53:08 INFO Signed narinfos id=42 count=16054lb # [ 120.555498] niks3-server[995]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6055lb # [ 120.559916] niks3-server[995]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6056lb # [ 120.568321] niks3-server[995]: 2026/09/20 10:53:08 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6057lb # [ 120.571986] niks3-server[995]: 2026/09/20 10:53:08 INFO Completed upload id=426058worker1 # [ 120.611481] nix-grpc-daemon[1604]: time=2026-09-20T10:53:08.701Z level=INFO msg="Upload complete. (224ms)"6059lb # [ 120.573473] niks3-server[995]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6060worker1 # [ 120.617134] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16061worker2 # [ 120.588743] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:08Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06062worker2 # [ 120.591219] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:08Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16063worker1 # [ 120.628718] nix-daemon[842]: reaped child process 1719, status = succeeded6064worker1 # [ 120.665426] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226065worker1 # [ 120.677141] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226066worker1 # [ 120.690295] nix-grpc-daemon[1604]: time=2026-09-20T10:53:08.780Z level=INFO msg="All 2 paths already cached"6067client # copying 1 paths to 'lb:50051'...6068client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6069worker1 # [ 120.698286] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226070worker1 # [ 120.706644] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6071worker1 # [ 120.876378] nix-daemon[842]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)6072worker1 # [ 120.888289] nix-daemon[842]: reaped child process 1746, status = succeeded6073worker1 # [ 121.051270] nix-daemon[842]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)6074worker1 # [ 121.061515] nix-daemon[842]: reaped child process 1751, status = succeeded6075lb # [ 121.038652] niks3-server[995]: 2026/09/20 10:53:08 INFO Received uploads request method=POST path=/api/pending_closures6076worker1 # [ 121.086541] nix-grpc-daemon[1604]: time=2026-09-20T10:53:09.176Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6077worker1 # [ 121.088087] nix-grpc-daemon[1604]: time=2026-09-20T10:53:09.178Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6078lb # [ 121.071394] niks3-server[995]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6079lb # [ 121.079936] niks3-server[995]: 2026/09/20 10:53:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6080lb # [ 121.085359] niks3-server[995]: 2026/09/20 10:53:09 INFO Signed narinfos id=43 count=16081worker1 # [ 121.127545] nix-grpc-daemon[1604]: time=2026-09-20T10:53:09.217Z level=INFO msg="Uploading 1 narinfos"6082lb # [ 121.091650] niks3-server[995]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6083lb # [ 121.103107] niks3-server[995]: 2026/09/20 10:53:09 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6084lb # [ 121.109574] niks3-server[995]: 2026/09/20 10:53:09 INFO Completed upload id=436085worker1 # [ 121.148918] nix-grpc-daemon[1604]: time=2026-09-20T10:53:09.239Z level=INFO msg="Upload complete. (429ms)"6086lb # [ 121.112800] niks3-server[995]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6087worker1 # [ 121.152687] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=7686088worker1 # [ 121.158233] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226089worker1 # [ 121.168136] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6090worker1 # [ 121.172272] nix-daemon[842]: reaped child process 1741, status = succeeded6091worker1 # [ 121.177770] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6092client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6093client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6094worker1 # [ 121.990176] nix-daemon[842]: reaped child process 1755, status = succeeded6095client # farm-top> LOG-farm-top-during-drain6096worker1 # [ 122.125088] nix-daemon[842]: accepted connection from pid 1770, user nix-grpc-daemon (trusted)6097worker1 # [ 122.136840] nix-daemon[842]: reaped child process 1773, status = succeeded6098lb # [ 122.115362] niks3-server[995]: 2026/09/20 10:53:10 INFO Received uploads request method=POST path=/api/pending_closures6099worker1 # [ 122.164169] nix-grpc-daemon[1604]: time=2026-09-20T10:53:10.253Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6100worker1 # [ 122.165539] nix-grpc-daemon[1604]: time=2026-09-20T10:53:10.253Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6101lb # [ 122.148508] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6102lb # [ 122.155129] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6103lb # [ 122.163403] niks3-server[995]: 2026/09/20 10:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6104lb # [ 122.167556] niks3-server[995]: 2026/09/20 10:53:10 INFO Signed narinfos id=44 count=16105worker1 # [ 122.209337] nix-grpc-daemon[1604]: time=2026-09-20T10:53:10.299Z level=INFO msg="Uploading 1 narinfos"6106lb # [ 122.175882] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6107lb # [ 122.180760] niks3-server[995]: 2026/09/20 10:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6108lb # [ 122.184252] niks3-server[995]: 2026/09/20 10:53:10 INFO Completed upload id=446109lb # [ 122.185467] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6110worker1 # [ 122.223695] nix-grpc-daemon[1604]: time=2026-09-20T10:53:10.314Z level=INFO msg="Upload complete. (239ms)"6111worker1 # [ 122.229485] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16112worker1 # [ 122.239650] nix-daemon[842]: reaped child process 1753, status = succeeded6113client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.60 seconds)6114client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6115client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6116worker2: must succeed: pkill -f 'read -t [9]0 x'6117worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6118client: waiting for success: ! systemctl is-active sw6119worker2 # [ 122.566431] nix-daemon[840]: reaped child process 1444, status = succeeded6120worker2 # [ 122.731862] nix-daemon[840]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)6121worker2 # [ 122.742330] nix-daemon[840]: reaped child process 1620, status = succeeded6122lb # [ 122.752158] niks3-server[995]: 2026/09/20 10:53:10 INFO Received uploads request method=POST path=/api/pending_closures6123worker2 # [ 122.768109] nix-grpc-daemon[1377]: time=2026-09-20T10:53:10.235Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6124worker2 # [ 122.769825] nix-grpc-daemon[1377]: time=2026-09-20T10:53:10.237Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6125lb # [ 122.786850] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6126lb # [ 122.796706] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6127lb # [ 122.803050] niks3-server[995]: 2026/09/20 10:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6128lb # [ 122.806922] niks3-server[995]: 2026/09/20 10:53:10 INFO Signed narinfos id=45 count=16129worker2 # [ 122.817145] nix-grpc-daemon[1377]: time=2026-09-20T10:53:10.284Z level=INFO msg="Uploading 1 narinfos"6130lb # [ 122.815542] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6131lb # [ 122.820332] niks3-server[995]: 2026/09/20 10:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6132lb # [ 122.823184] niks3-server[995]: 2026/09/20 10:53:10 INFO Completed upload id=456133worker2 # [ 122.830597] nix-grpc-daemon[1377]: time=2026-09-20T10:53:10.298Z level=INFO msg="Upload complete. (277ms)"6134lb # [ 122.825649] niks3-server[995]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6135worker2 # [ 122.837652] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56178 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16136worker2 # [ 122.848059] nix-daemon[840]: reaped child process 1442, status = succeeded6137client # [ 122.904671] systemd[1]: sw.service: Deactivated successfully.6138client # [ 122.908771] systemd[1]: sw.service: Consumed 110ms CPU time over 12.953s wall clock time, 39.1M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.6139worker2 # [ 123.190356] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=signal_exit6140worker2 # [ 123.400363] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=scheduler_yield6141lb # [ 123.394511] niks3-server[995]: 2026/09/20 10:53:11 INFO lead: released remote=192.168.1.4:545866142worker1 # [ 123.436351] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:11Z level=info event=scheduler_restarting addr=lb:500516143worker2 # [ 123.404746] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:561706144worker2 # [ 123.409956] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=worker_gone addr=192.168.1.3:500516145worker2 # [ 123.413123] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=scheduler_restarting addr=lb:500516146worker2 # [ 123.416095] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:561706147worker2 # [ 123.419345] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:10Z level=info event=worker_gone addr=192.168.1.4:500516148client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6149client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6150client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6151worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6152worker1 # [ 123.636666] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:11Z level=info event=scheduler_connected addr=lb:500516153worker1 # [ 123.639480] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6154worker2 # [ 123.610260] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_connected addr=lb:500516155worker2 # [ 123.616141] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6156worker1 # [ 123.840213] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:11Z level=info event=scheduler_connected addr=lb:500516157worker1 # [ 123.842179] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6158worker2 # [ 123.815994] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_connected addr=lb:500516159worker2 # [ 123.819915] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6160worker1 # [ 124.042586] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_connected addr=lb:500516161worker1 # [ 124.044355] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6162worker2 # [ 124.021797] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_connected addr=lb:500516163worker2 # [ 124.025419] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6164worker1 # [ 124.245288] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_connected addr=lb:500516165worker1 # [ 124.249230] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6166worker2 # [ 124.226394] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_connected addr=lb:500516167worker2 # [ 124.230273] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6168worker2 # [ 124.404207] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=scheduler_restarting6169worker1 # [ 124.451212] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_connected addr=lb:500516170worker1 # [ 124.454380] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6171worker2 # [ 124.426251] nix-daemon[840]: reaped child process 1349, status = succeeded6172worker2 # [ 124.441948] nix-grpc-daemon[1298]: ts=2026-09-20T10:53:11Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6173worker1 # [ 124.652276] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_connected addr=lb:500516174worker1 # [ 124.656286] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6175worker2 # [ 124.694872] nix-grpc-daemon[1298]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6176worker2 # [ 124.696310] nix-grpc-daemon[1298]: E0000 00:00:1789901592.162467 1341 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true6177worker2 # [ 124.698217] nix-grpc-daemon[1298]: E0000 00:00:1789901592.162857 1341 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6178worker1 # [ 124.856599] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_connected addr=lb:500516179worker1 # [ 124.858383] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6180worker1 # [ 125.059325] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_connected addr=lb:500516181worker1 # [ 125.063304] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6182worker1 # [ 125.264089] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_connected addr=lb:500516183worker1 # [ 125.267935] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6184worker1 # [ 125.469871] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_connected addr=lb:500516185worker1 # [ 125.473698] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6186lb # [ 125.467676] niks3-server[995]: 2026/09/20 10:53:13 INFO lead: acquired remote=192.168.1.3:605546187worker1 # [ 125.510149] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_take_over6188worker1 # [ 125.674597] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_connected addr=lb:500516189worker1 # [ 125.678537] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6190worker1 # [ 125.879439] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_connected addr=lb:500516191worker1 # [ 125.883411] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6192worker1 # [ 126.084301] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:14Z level=info event=scheduler_connected addr=lb:500516193worker1 # [ 126.088304] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6194worker2 # [ 126.215856] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6195worker2 # [ 126.219403] systemd[1]: nix-grpc-daemon.service: Consumed 669ms CPU time over 26.445s wall clock time, 33.6M memory peak, 23.8K incoming IP traffic, 32.7K outgoing IP traffic.6196worker2 # [ 126.234892] systemd[1]: Starting Nix worker-protocol over gRPC...6197worker1 # [ 126.289114] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:14Z level=info event=scheduler_connected addr=lb:500516198worker1 # [ 126.293143] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6199worker2 # [ 126.390807] nix-grpc-daemon[1634]: ts=2026-09-20T10:53:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6200worker2 # [ 126.394780] nix-grpc-daemon[1634]: ts=2026-09-20T10:53:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16201worker2 # [ 126.400514] nix-grpc-daemon[1634]: ts=2026-09-20T10:53:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6202worker2 # [ 126.405493] systemd[1]: Started Nix worker-protocol over gRPC.6203worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.86 seconds)6204lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6205lb: must succeed: curl -sf localhost:9901/clusters6206worker2 # [ 126.432570] nix-grpc-daemon[1634]: ts=2026-09-20T10:53:13Z level=info event=scheduler_connected addr=lb:500516207worker1 # [ 126.476441] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06208worker1 # [ 126.493623] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:14Z level=info event=scheduler_connected addr=lb:500516209worker1 # [ 126.497479] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06210lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6211lb: must succeed: curl -sf localhost:9901/clusters6212lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6213lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.15 seconds)6214lb: must succeed: curl -sf localhost:9901/clusters6215lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6216worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6217worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6218(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.81 seconds)6219subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6220client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16221worker2 # [ 127.890478] nix-grpc-daemon[1634]: ts=2026-09-20T10:53:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:387866222worker2 # [ 127.896525] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6223worker1 # [ 127.938741] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226224worker1 # [ 127.981919] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06225worker1 # [ 127.987166] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16226worker1 # [ 127.991747] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06227worker1 # [ 127.995736] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06228lb # [ 127.966501] envoy[922]: conn peer=[2001:db8:1::1]:53088 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=3806 ms=63746229lb # [ 127.970380] envoy[922]: conn peer=[2001:db8:1::1]:53150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1352 ms=127306230lb # [ 127.973984] envoy[922]: conn peer=[2001:db8:1::4]:42962 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1764 tx=627 ms=242336231worker1 # [ 128.026604] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226232worker1 # [ 128.039764] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226233worker1 # [ 128.051366] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226234worker1 # [ 128.062768] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6235worker1 # [ 128.234922] nix-daemon[842]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)6236worker1 # [ 128.246795] nix-daemon[842]: reaped child process 1785, status = succeeded6237worker1 # [ 128.409158] nix-daemon[842]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6238worker1 # [ 128.420946] nix-daemon[842]: reaped child process 1790, status = succeeded6239lb # [ 128.393472] niks3-server[995]: 2026/09/20 10:53:16 INFO Received uploads request method=POST path=/api/pending_closures6240worker1 # [ 128.440743] nix-grpc-daemon[1604]: time=2026-09-20T10:53:16.530Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6241worker1 # [ 128.442194] nix-grpc-daemon[1604]: time=2026-09-20T10:53:16.530Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6242lb # [ 128.417936] niks3-server[995]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6243lb # [ 128.431112] niks3-server[995]: 2026/09/20 10:53:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6244worker1 # [ 128.475334] nix-grpc-daemon[1604]: time=2026-09-20T10:53:16.565Z level=INFO msg="Uploading 1 narinfos"6245lb # [ 128.437138] niks3-server[995]: 2026/09/20 10:53:16 INFO Signed narinfos id=46 count=16246lb # [ 128.442096] niks3-server[995]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6247lb # [ 128.452954] niks3-server[995]: 2026/09/20 10:53:16 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6248worker1 # [ 128.501404] nix-grpc-daemon[1604]: time=2026-09-20T10:53:16.591Z level=INFO msg="Upload complete. (427ms)"6249lb # [ 128.462205] niks3-server[995]: 2026/09/20 10:53:16 INFO Completed upload id=466250lb # [ 128.465683] niks3-server[995]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6251worker1 # [ 128.504659] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=5046252worker1 # [ 128.510169] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226253worker1 # [ 128.518552] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6254worker1 # [ 128.523668] nix-daemon[842]: reaped child process 1780, status = succeeded6255worker1 # [ 128.529245] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6256worker1 # [ 129.341355] nix-daemon[842]: reaped child process 1794, status = succeeded6257worker1 # [ 129.482786] nix-daemon[842]: accepted connection from pid 1809, user nix-grpc-daemon (trusted)6258worker1 # [ 129.494566] nix-daemon[842]: reaped child process 1812, status = succeeded6259lb # [ 129.470560] niks3-server[995]: 2026/09/20 10:53:17 INFO Received uploads request method=POST path=/api/pending_closures6260worker1 # [ 129.518285] nix-grpc-daemon[1604]: time=2026-09-20T10:53:17.607Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6261worker1 # [ 129.519636] nix-grpc-daemon[1604]: time=2026-09-20T10:53:17.607Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6262lb # [ 129.507805] niks3-server[995]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6263lb # [ 129.515091] niks3-server[995]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6264lb # [ 129.526871] niks3-server[995]: 2026/09/20 10:53:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6265worker1 # [ 129.570948] nix-grpc-daemon[1604]: time=2026-09-20T10:53:17.661Z level=INFO msg="Uploading 1 narinfos"6266lb # [ 129.531569] niks3-server[995]: 2026/09/20 10:53:17 INFO Signed narinfos id=47 count=16267lb # [ 129.537360] niks3-server[995]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6268lb # [ 129.545182] niks3-server[995]: 2026/09/20 10:53:17 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6269lb # [ 129.550741] niks3-server[995]: 2026/09/20 10:53:17 INFO Completed upload id=476270worker1 # [ 129.590285] nix-grpc-daemon[1604]: time=2026-09-20T10:53:17.680Z level=INFO msg="Upload complete. (255ms)"6271lb # [ 129.554747] niks3-server[995]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6272worker1 # [ 129.599275] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16273worker1 # [ 129.605844] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:17Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16274worker1 # [ 129.611938] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:17Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06275worker1 # [ 129.619855] nix-daemon[842]: reaped child process 1792, status = succeeded6276worker1 # [ 129.649180] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226277worker1 # [ 129.659882] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226278worker1 # [ 129.670584] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226279worker1 # [ 129.680183] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6280worker1 # [ 129.840400] nix-daemon[842]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6281worker1 # [ 129.852123] nix-daemon[842]: reaped child process 1821, status = succeeded6282worker1 # [ 130.008994] nix-daemon[842]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)6283worker1 # [ 130.020555] nix-daemon[842]: reaped child process 1826, status = succeeded6284lb # [ 129.997283] niks3-server[995]: 2026/09/20 10:53:17 INFO Received uploads request method=POST path=/api/pending_closures6285worker1 # [ 130.044447] nix-grpc-daemon[1604]: time=2026-09-20T10:53:18.134Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6286worker1 # [ 130.046437] nix-grpc-daemon[1604]: time=2026-09-20T10:53:18.136Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6287lb # [ 130.026937] niks3-server[995]: 2026/09/20 10:53:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6288lb # [ 130.035768] niks3-server[995]: 2026/09/20 10:53:17 INFO Signed narinfos id=48 count=16289worker1 # [ 130.078399] nix-grpc-daemon[1604]: time=2026-09-20T10:53:18.168Z level=INFO msg="Uploading 1 narinfos"6290lb # [ 130.040616] niks3-server[995]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6291lb # [ 130.059337] niks3-server[995]: 2026/09/20 10:53:17 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6292lb # [ 130.069101] niks3-server[995]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6293lb # [ 130.074137] niks3-server[995]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6294lb # [ 130.077572] niks3-server[995]: 2026/09/20 10:53:18 INFO Completed upload id=486295worker1 # [ 130.118434] nix-grpc-daemon[1604]: time=2026-09-20T10:53:18.208Z level=INFO msg="Upload complete. (428ms)"6296worker1 # [ 130.123173] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=5046297worker1 # [ 130.128663] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226298worker1 # [ 130.137790] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6299worker1 # [ 130.148391] nix-daemon[842]: reaped child process 1816, status = succeeded6300worker1 # [ 130.152938] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6301worker1 # [ 131.566475] nix-daemon[842]: reaped child process 1830, status = succeeded6302worker1 # [ 131.716803] nix-daemon[842]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)6303worker1 # [ 131.728773] nix-daemon[842]: reaped child process 1848, status = succeeded6304lb # [ 131.705665] niks3-server[995]: 2026/09/20 10:53:19 INFO Received uploads request method=POST path=/api/pending_closures6305worker1 # [ 131.753327] nix-grpc-daemon[1604]: time=2026-09-20T10:53:19.843Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6306worker1 # [ 131.754912] nix-grpc-daemon[1604]: time=2026-09-20T10:53:19.845Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6307lb # [ 131.751057] niks3-server[995]: 2026/09/20 10:53:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6308lb # [ 131.759128] niks3-server[995]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6309lb # [ 131.764858] niks3-server[995]: 2026/09/20 10:53:19 INFO Signed narinfos id=49 count=16310worker1 # [ 131.807212] nix-grpc-daemon[1604]: time=2026-09-20T10:53:19.897Z level=INFO msg="Uploading 1 narinfos"6311lb # [ 131.769519] niks3-server[995]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6312lb # [ 131.775750] niks3-server[995]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6313lb # [ 131.785710] niks3-server[995]: 2026/09/20 10:53:19 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6314lb # [ 131.792240] niks3-server[995]: 2026/09/20 10:53:19 INFO Completed upload id=496315worker1 # [ 131.831595] nix-grpc-daemon[1604]: time=2026-09-20T10:53:19.921Z level=INFO msg="Upload complete. (271ms)"6316lb # [ 131.793938] niks3-server[995]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6317worker1 # [ 131.843280] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16318worker1 # [ 131.848261] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:19Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16319worker1 # [ 131.851630] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226320worker1 # [ 131.854622] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:19Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06321worker1 # [ 131.863273] nix-daemon[842]: reaped child process 1828, status = succeeded6322worker1 # [ 131.865101] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226323worker1 # [ 131.871735] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226324worker1 # [ 131.875611] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6325worker1 # [ 132.017614] nix-daemon[842]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6326worker1 # [ 132.028109] nix-daemon[842]: reaped child process 1857, status = succeeded6327worker1 # [ 132.165690] nix-daemon[842]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6328worker1 # [ 132.177281] nix-daemon[842]: reaped child process 1862, status = succeeded6329lb # [ 132.149070] niks3-server[995]: 2026/09/20 10:53:20 INFO Received uploads request method=POST path=/api/pending_closures6330worker1 # [ 132.199245] nix-grpc-daemon[1604]: time=2026-09-20T10:53:20.289Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6331worker1 # [ 132.200982] nix-grpc-daemon[1604]: time=2026-09-20T10:53:20.291Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6332lb # [ 132.178442] niks3-server[995]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6333lb # [ 132.190939] niks3-server[995]: 2026/09/20 10:53:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6334worker1 # [ 132.236450] nix-grpc-daemon[1604]: time=2026-09-20T10:53:20.326Z level=INFO msg="Uploading 1 narinfos"6335lb # [ 132.198105] niks3-server[995]: 2026/09/20 10:53:20 INFO Signed narinfos id=50 count=16336lb # [ 132.203745] niks3-server[995]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6337lb # [ 132.215599] niks3-server[995]: 2026/09/20 10:53:20 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6338lb # [ 132.223903] niks3-server[995]: 2026/09/20 10:53:20 INFO Completed upload id=506339worker1 # [ 132.263364] nix-grpc-daemon[1604]: time=2026-09-20T10:53:20.353Z level=INFO msg="Upload complete. (382ms)"6340lb # [ 132.226301] niks3-server[995]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6341worker1 # [ 132.267808] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=5046342worker1 # [ 132.274317] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226343worker1 # [ 132.282248] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6344worker1 # [ 132.290664] nix-daemon[842]: reaped child process 1852, status = succeeded6345worker1 # [ 132.295783] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6346worker1 # [ 133.321936] nix-daemon[842]: reaped child process 1866, status = succeeded6347worker1 # [ 133.456612] nix-daemon[842]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6348worker1 # [ 133.468292] nix-daemon[842]: reaped child process 1884, status = succeeded6349lb # [ 133.442767] niks3-server[995]: 2026/09/20 10:53:21 INFO Received uploads request method=POST path=/api/pending_closures6350worker1 # [ 133.490092] nix-grpc-daemon[1604]: time=2026-09-20T10:53:21.579Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6351worker1 # [ 133.491406] nix-grpc-daemon[1604]: time=2026-09-20T10:53:21.579Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6352lb # [ 133.479295] niks3-server[995]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6353lb # [ 133.488669] niks3-server[995]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6354lb # [ 133.500431] niks3-server[995]: 2026/09/20 10:53:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6355worker1 # [ 133.544148] nix-grpc-daemon[1604]: time=2026-09-20T10:53:21.634Z level=INFO msg="Uploading 1 narinfos"6356lb # [ 133.504707] niks3-server[995]: 2026/09/20 10:53:21 INFO Signed narinfos id=51 count=16357lb # [ 133.517359] niks3-server[995]: 2026/09/20 10:53:21 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6358lb # [ 133.520569] niks3-server[995]: 2026/09/20 10:53:21 INFO Completed upload id=516359worker1 # [ 133.561163] nix-grpc-daemon[1604]: time=2026-09-20T10:53:21.651Z level=INFO msg="Upload complete. (258ms)"6360lb # [ 133.522172] niks3-server[995]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6361lb # [ 133.524236] niks3-server[995]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6362worker1 # [ 133.564935] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16363worker1 # [ 133.574505] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:21Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16364worker1 # [ 133.579282] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:21Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06365worker1 # [ 133.586430] nix-daemon[842]: reaped child process 1864, status = succeeded6366worker1 # [ 133.613296] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226367worker1 # [ 133.625247] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226368worker1 # [ 133.636983] nix-grpc-daemon[1604]: time=2026-09-20T10:53:21.727Z level=INFO msg="All 1 paths already cached"6369worker1 # [ 133.644539] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226370worker1 # [ 133.653329] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6371worker1 # [ 133.796449] nix-daemon[842]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)6372worker1 # [ 133.808127] nix-daemon[842]: reaped child process 1893, status = succeeded6373worker1 # [ 133.958665] nix-daemon[842]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6374worker1 # [ 133.970173] nix-daemon[842]: reaped child process 1898, status = succeeded6375lb # [ 133.947117] niks3-server[995]: 2026/09/20 10:53:21 INFO Received uploads request method=POST path=/api/pending_closures6376worker1 # [ 133.994303] nix-grpc-daemon[1604]: time=2026-09-20T10:53:22.084Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6377worker1 # [ 133.995685] nix-grpc-daemon[1604]: time=2026-09-20T10:53:22.084Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6378lb # [ 133.969898] niks3-server[995]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6379lb # [ 133.983635] niks3-server[995]: 2026/09/20 10:53:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6380lb # [ 133.988415] niks3-server[995]: 2026/09/20 10:53:21 INFO Signed narinfos id=52 count=16381worker1 # [ 134.031030] nix-grpc-daemon[1604]: time=2026-09-20T10:53:22.121Z level=INFO msg="Uploading 1 narinfos"6382lb # [ 133.993649] niks3-server[995]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6383lb # [ 134.004713] niks3-server[995]: 2026/09/20 10:53:21 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6384lb # [ 134.010484] niks3-server[995]: 2026/09/20 10:53:21 INFO Completed upload id=526385worker1 # [ 134.050051] nix-grpc-daemon[1604]: time=2026-09-20T10:53:22.140Z level=INFO msg="Upload complete. (385ms)"6386lb # [ 134.013276] niks3-server[995]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6387worker1 # [ 134.053079] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=6246388worker1 # [ 134.055641] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226389worker1 # [ 134.060271] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6390worker1 # [ 134.064406] nix-daemon[842]: reaped child process 1888, status = succeeded6391worker1 # [ 134.069116] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6392worker1 # [ 135.498554] nix-daemon[842]: reaped child process 1902, status = succeeded6393worker1 # [ 135.641094] nix-daemon[842]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)6394worker1 # [ 135.651590] nix-daemon[842]: reaped child process 1920, status = succeeded6395lb # [ 135.628710] niks3-server[995]: 2026/09/20 10:53:23 INFO Received uploads request method=POST path=/api/pending_closures6396worker1 # [ 135.675884] nix-grpc-daemon[1604]: time=2026-09-20T10:53:23.766Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6397worker1 # [ 135.677378] nix-grpc-daemon[1604]: time=2026-09-20T10:53:23.767Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6398lb # [ 135.671845] niks3-server[995]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6399lb # [ 135.678871] niks3-server[995]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6400lb # [ 135.684815] niks3-server[995]: 2026/09/20 10:53:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6401lb # [ 135.689475] niks3-server[995]: 2026/09/20 10:53:23 INFO Signed narinfos id=53 count=16402worker1 # [ 135.731615] nix-grpc-daemon[1604]: time=2026-09-20T10:53:23.822Z level=INFO msg="Uploading 1 narinfos"6403lb # [ 135.695672] niks3-server[995]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6404lb # [ 135.704850] niks3-server[995]: 2026/09/20 10:53:23 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6405lb # [ 135.711976] niks3-server[995]: 2026/09/20 10:53:23 INFO Completed upload id=536406worker1 # [ 135.751566] nix-grpc-daemon[1604]: time=2026-09-20T10:53:23.841Z level=INFO msg="Upload complete. (272ms)"6407lb # [ 135.716387] niks3-server[995]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6408worker1 # [ 135.761587] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16409worker1 # [ 135.768748] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:23Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16410worker1 # [ 135.774248] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226411worker1 # [ 135.777419] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:23Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06412worker1 # [ 135.787125] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226413worker1 # [ 135.789218] nix-daemon[842]: reaped child process 1900, status = succeeded6414worker1 # [ 135.794024] nix-grpc-daemon[1604]: time=2026-09-20T10:53:23.884Z level=INFO msg="All 1 paths already cached"6415worker1 # [ 135.798028] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226416worker1 # [ 135.802751] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6417worker1 # [ 135.950056] nix-daemon[842]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)6418worker1 # [ 135.961738] nix-daemon[842]: reaped child process 1929, status = succeeded6419worker1 # [ 136.115700] nix-daemon[842]: accepted connection from pid 1931, user nix-grpc-daemon (trusted)6420worker1 # [ 136.127508] nix-daemon[842]: reaped child process 1934, status = succeeded6421lb # [ 136.103283] niks3-server[995]: 2026/09/20 10:53:24 INFO Received uploads request method=POST path=/api/pending_closures6422worker1 # [ 136.149961] nix-grpc-daemon[1604]: time=2026-09-20T10:53:24.240Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6423worker1 # [ 136.151404] nix-grpc-daemon[1604]: time=2026-09-20T10:53:24.240Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6424lb # [ 136.127105] niks3-server[995]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6425lb # [ 136.137749] niks3-server[995]: 2026/09/20 10:53:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6426lb # [ 136.144391] niks3-server[995]: 2026/09/20 10:53:24 INFO Signed narinfos id=54 count=16427worker1 # [ 136.186772] nix-grpc-daemon[1604]: time=2026-09-20T10:53:24.277Z level=INFO msg="Uploading 1 narinfos"6428lb # [ 136.148860] niks3-server[995]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6429lb # [ 136.159449] niks3-server[995]: 2026/09/20 10:53:24 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6430worker1 # [ 136.205439] nix-grpc-daemon[1604]: time=2026-09-20T10:53:24.295Z level=INFO msg="Upload complete. (397ms)"6431lb # [ 136.166156] niks3-server[995]: 2026/09/20 10:53:24 INFO Completed upload id=546432worker1 # [ 136.207493] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=6246433lb # [ 136.168628] niks3-server[995]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6434worker1 # [ 136.213964] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226435worker1 # [ 136.217843] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6436worker1 # [ 136.220267] nix-daemon[842]: reaped child process 1924, status = succeeded6437worker1 # [ 136.226149] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6438worker1 # [ 137.452491] nix-daemon[842]: reaped child process 1938, status = succeeded6439worker1 # [ 137.599561] nix-daemon[842]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6440worker1 # [ 137.611394] nix-daemon[842]: reaped child process 1956, status = succeeded6441lb # [ 137.591288] niks3-server[995]: 2026/09/20 10:53:25 INFO Received uploads request method=POST path=/api/pending_closures6442worker1 # [ 137.638955] nix-grpc-daemon[1604]: time=2026-09-20T10:53:25.729Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6443worker1 # [ 137.640863] nix-grpc-daemon[1604]: time=2026-09-20T10:53:25.731Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6444lb # [ 137.625440] niks3-server[995]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6445lb # [ 137.638157] niks3-server[995]: 2026/09/20 10:53:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6446lb # [ 137.645496] niks3-server[995]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6447lb # [ 137.651496] niks3-server[995]: 2026/09/20 10:53:25 INFO Signed narinfos id=55 count=16448worker1 # [ 137.691183] nix-grpc-daemon[1604]: time=2026-09-20T10:53:25.781Z level=INFO msg="Uploading 1 narinfos"6449lb # [ 137.654875] niks3-server[995]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6450lb # [ 137.663655] niks3-server[995]: 2026/09/20 10:53:25 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6451lb # [ 137.670940] niks3-server[995]: 2026/09/20 10:53:25 INFO Completed upload id=556452lb # [ 137.672386] niks3-server[995]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6453worker1 # [ 137.710500] nix-grpc-daemon[1604]: time=2026-09-20T10:53:25.800Z level=INFO msg="Upload complete. (277ms)"6454worker1 # [ 137.722740] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16455worker1 # [ 137.728268] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:25Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16456worker1 # [ 137.731789] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226457worker1 # [ 137.734912] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:25Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06458worker1 # [ 137.744443] nix-daemon[842]: reaped child process 1936, status = succeeded6459worker1 # [ 137.745829] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226460worker1 # [ 137.753418] nix-grpc-daemon[1604]: time=2026-09-20T10:53:25.843Z level=INFO msg="All 1 paths already cached"6461worker1 # [ 137.756072] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226462worker1 # [ 137.759971] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6463worker1 # [ 137.917095] nix-daemon[842]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)6464worker1 # [ 137.929293] nix-daemon[842]: reaped child process 1965, status = succeeded6465worker1 # [ 138.088701] nix-daemon[842]: accepted connection from pid 1967, user nix-grpc-daemon (trusted)6466worker1 # [ 138.100302] nix-daemon[842]: reaped child process 1970, status = succeeded6467lb # [ 138.077386] niks3-server[995]: 2026/09/20 10:53:26 INFO Received uploads request method=POST path=/api/pending_closures6468worker1 # [ 138.124771] nix-grpc-daemon[1604]: time=2026-09-20T10:53:26.214Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6469worker1 # [ 138.126194] nix-grpc-daemon[1604]: time=2026-09-20T10:53:26.215Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6470lb # [ 138.101578] niks3-server[995]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6471lb # [ 138.114086] niks3-server[995]: 2026/09/20 10:53:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6472lb # [ 138.119247] niks3-server[995]: 2026/09/20 10:53:26 INFO Signed narinfos id=56 count=16473worker1 # [ 138.161474] nix-grpc-daemon[1604]: time=2026-09-20T10:53:26.251Z level=INFO msg="Uploading 1 narinfos"6474lb # [ 138.126132] niks3-server[995]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6475lb # [ 138.136822] niks3-server[995]: 2026/09/20 10:53:26 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6476lb # [ 138.143321] niks3-server[995]: 2026/09/20 10:53:26 INFO Completed upload id=566477worker1 # [ 138.182435] nix-grpc-daemon[1604]: time=2026-09-20T10:53:26.272Z level=INFO msg="Upload complete. (416ms)"6478lb # [ 138.146183] niks3-server[995]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6479worker1 # [ 138.187153] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=6246480worker1 # [ 138.191788] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226481worker1 # [ 138.200862] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6482worker1 # [ 138.204451] nix-daemon[842]: reaped child process 1960, status = succeeded6483worker1 # [ 138.209436] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6484worker1 # [ 139.434869] nix-daemon[842]: reaped child process 1974, status = succeeded6485worker1 # [ 139.584797] nix-daemon[842]: accepted connection from pid 1989, user nix-grpc-daemon (trusted)6486worker1 # [ 139.596404] nix-daemon[842]: reaped child process 1992, status = succeeded6487lb # [ 139.570354] niks3-server[995]: 2026/09/20 10:53:27 INFO Received uploads request method=POST path=/api/pending_closures6488worker1 # [ 139.620044] nix-grpc-daemon[1604]: time=2026-09-20T10:53:27.710Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6489worker1 # [ 139.621723] nix-grpc-daemon[1604]: time=2026-09-20T10:53:27.711Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6490lb # [ 139.611241] niks3-server[995]: 2026/09/20 10:53:27 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6491lb # [ 139.618219] niks3-server[995]: 2026/09/20 10:53:27 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6492lb # [ 139.628335] niks3-server[995]: 2026/09/20 10:53:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6493worker1 # [ 139.672905] nix-grpc-daemon[1604]: time=2026-09-20T10:53:27.763Z level=INFO msg="Uploading 1 narinfos"6494lb # [ 139.633733] niks3-server[995]: 2026/09/20 10:53:27 INFO Signed narinfos id=57 count=16495lb # [ 139.638045] niks3-server[995]: 2026/09/20 10:53:27 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6496lb # [ 139.647794] niks3-server[995]: 2026/09/20 10:53:27 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6497lb # [ 139.652796] niks3-server[995]: 2026/09/20 10:53:27 INFO Completed upload id=576498lb # [ 139.655878] niks3-server[995]: 2026/09/20 10:53:27 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6499worker1 # [ 139.694130] nix-grpc-daemon[1604]: time=2026-09-20T10:53:27.784Z level=INFO msg="Upload complete. (276ms)"6500worker1 # [ 139.706710] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16501worker1 # [ 139.712319] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:27Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16502worker1 # [ 139.716344] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226503worker1 # [ 139.719578] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:27Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06504worker1 # [ 139.730337] nix-daemon[842]: reaped child process 1972, status = succeeded6505worker1 # [ 139.731960] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226506worker1 # [ 139.739746] nix-grpc-daemon[1604]: time=2026-09-20T10:53:27.830Z level=INFO msg="All 2 paths already cached"6507worker1 # [ 139.743839] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226508worker1 # [ 139.752406] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6509worker1 # [ 139.914351] nix-daemon[842]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)6510worker1 # [ 139.926269] nix-daemon[842]: reaped child process 2001, status = succeeded6511worker1 # [ 140.099236] nix-daemon[842]: accepted connection from pid 2003, user nix-grpc-daemon (trusted)6512worker1 # [ 140.110884] nix-daemon[842]: reaped child process 2006, status = succeeded6513lb # [ 140.088791] niks3-server[995]: 2026/09/20 10:53:28 INFO Received uploads request method=POST path=/api/pending_closures6514worker1 # [ 140.136026] nix-grpc-daemon[1604]: time=2026-09-20T10:53:28.226Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6515worker1 # [ 140.137585] nix-grpc-daemon[1604]: time=2026-09-20T10:53:28.228Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6516lb # [ 140.118230] niks3-server[995]: 2026/09/20 10:53:28 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6517lb # [ 140.127904] niks3-server[995]: 2026/09/20 10:53:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6518lb # [ 140.132550] niks3-server[995]: 2026/09/20 10:53:28 INFO Signed narinfos id=58 count=16519worker1 # [ 140.174650] nix-grpc-daemon[1604]: time=2026-09-20T10:53:28.265Z level=INFO msg="Uploading 1 narinfos"6520lb # [ 140.138766] niks3-server[995]: 2026/09/20 10:53:28 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6521lb # [ 140.149318] niks3-server[995]: 2026/09/20 10:53:28 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6522worker1 # [ 140.193863] nix-grpc-daemon[1604]: time=2026-09-20T10:53:28.284Z level=INFO msg="Upload complete. (435ms)"6523lb # [ 140.154617] niks3-server[995]: 2026/09/20 10:53:28 INFO Completed upload id=586524worker1 # [ 140.195942] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=7526525lb # [ 140.159476] niks3-server[995]: 2026/09/20 10:53:28 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6526worker1 # [ 140.201991] nix-daemon[842]: reaped child process 1996, status = succeeded6527worker1 # [ 140.203715] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226528worker1 # [ 140.207269] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6529worker1 # [ 140.213862] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6530worker1 # [ 141.838900] nix-daemon[842]: reaped child process 2010, status = succeeded6531worker1 # [ 141.995750] nix-daemon[842]: accepted connection from pid 2025, user nix-grpc-daemon (trusted)6532worker1 # [ 142.006482] nix-daemon[842]: reaped child process 2028, status = succeeded6533lb # [ 141.984748] niks3-server[995]: 2026/09/20 10:53:29 INFO Received uploads request method=POST path=/api/pending_closures6534worker1 # [ 142.032243] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.122Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6535worker1 # [ 142.034409] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.124Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6536lb # [ 142.024149] niks3-server[995]: 2026/09/20 10:53:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6537worker1 # [ 142.070535] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.160Z level=INFO msg="Uploading 1 narinfos"6538lb # [ 142.031225] niks3-server[995]: 2026/09/20 10:53:29 INFO Signed narinfos id=59 count=16539lb # [ 142.039847] niks3-server[995]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6540lb # [ 142.045125] niks3-server[995]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6541lb # [ 142.050548] niks3-server[995]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6542lb # [ 142.059434] niks3-server[995]: 2026/09/20 10:53:29 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6543lb # [ 142.064519] niks3-server[995]: 2026/09/20 10:53:29 INFO Completed upload id=596544lb # [ 142.067637] niks3-server[995]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6545worker1 # [ 142.103620] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.193Z level=INFO msg="Upload complete. (279ms)"6546worker1 # [ 142.113746] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16547worker1 # [ 142.120464] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:30Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16548worker1 # [ 142.124153] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226549worker1 # [ 142.134955] nix-daemon[842]: reaped child process 2008, status = succeeded6550worker1 # [ 142.156600] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226551worker1 # [ 142.168442] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.258Z level=INFO msg="All 2 paths already cached"6552worker1 # [ 142.175377] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226553worker1 # [ 142.185137] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6554worker1 # [ 142.344855] nix-daemon[842]: accepted connection from pid 2032, user nix-grpc-daemon (trusted)6555worker1 # [ 142.356992] nix-daemon[842]: reaped child process 2035, status = succeeded6556worker1 # [ 142.501787] nix-daemon[842]: accepted connection from pid 2037, user nix-grpc-daemon (trusted)6557worker1 # [ 142.513523] nix-daemon[842]: reaped child process 2040, status = succeeded6558lb # [ 142.489915] niks3-server[995]: 2026/09/20 10:53:30 INFO Received uploads request method=POST path=/api/pending_closures6559worker1 # [ 142.537373] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.627Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6560worker1 # [ 142.538736] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.627Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6561lb # [ 142.512948] niks3-server[995]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6562lb # [ 142.525548] niks3-server[995]: 2026/09/20 10:53:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6563worker1 # [ 142.569943] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.660Z level=INFO msg="Uploading 1 narinfos"6564lb # [ 142.531227] niks3-server[995]: 2026/09/20 10:53:30 INFO Signed narinfos id=60 count=16565lb # [ 142.535718] niks3-server[995]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6566lb # [ 142.547323] niks3-server[995]: 2026/09/20 10:53:30 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6567worker1 # [ 142.592393] nix-grpc-daemon[1604]: time=2026-09-20T10:53:30.682Z level=INFO msg="Upload complete. (397ms)"6568lb # [ 142.553441] niks3-server[995]: 2026/09/20 10:53:30 INFO Completed upload id=606569worker1 # [ 142.594346] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=7526570lb # [ 142.556806] niks3-server[995]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6571worker1 # [ 142.600543] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226572worker1 # [ 142.604572] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6573worker1 # [ 142.606832] nix-daemon[842]: reaped child process 2030, status = succeeded6574worker1 # [ 142.612053] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6575worker1 # [ 143.826333] nix-daemon[842]: reaped child process 2044, status = succeeded6576worker1 # [ 143.949325] nix-daemon[842]: accepted connection from pid 2059, user nix-grpc-daemon (trusted)6577worker1 # [ 143.960856] nix-daemon[842]: reaped child process 2062, status = succeeded6578lb # [ 143.940283] niks3-server[995]: 2026/09/20 10:53:31 INFO Received uploads request method=POST path=/api/pending_closures6579worker1 # [ 143.989117] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.079Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6580worker1 # [ 143.990718] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.081Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6581lb # [ 143.975133] niks3-server[995]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6582lb # [ 143.981556] niks3-server[995]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6583lb # [ 143.992601] niks3-server[995]: 2026/09/20 10:53:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6584worker1 # [ 144.035315] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.125Z level=INFO msg="Uploading 1 narinfos"6585lb # [ 143.996094] niks3-server[995]: 2026/09/20 10:53:31 INFO Signed narinfos id=61 count=16586lb # [ 144.003414] niks3-server[995]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6587lb # [ 144.011291] niks3-server[995]: 2026/09/20 10:53:31 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6588lb # [ 144.013829] niks3-server[995]: 2026/09/20 10:53:31 INFO Completed upload id=616589worker1 # [ 144.053262] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.143Z level=INFO msg="Upload complete. (234ms)"6590lb # [ 144.015863] niks3-server[995]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6591worker1 # [ 144.059506] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16592worker1 # [ 144.065385] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:32Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16593worker1 # [ 144.069238] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226594worker1 # [ 144.077512] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226595worker1 # [ 144.081398] nix-daemon[842]: reaped child process 2042, status = succeeded6596worker1 # [ 144.085255] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.175Z level=INFO msg="All 2 paths already cached"6597worker1 # [ 144.088914] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609226598worker1 # [ 144.092780] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6599worker1 # [ 144.242575] nix-daemon[842]: accepted connection from pid 2066, user nix-grpc-daemon (trusted)6600worker1 # [ 144.254328] nix-daemon[842]: reaped child process 2069, status = succeeded6601worker1 # [ 144.393176] nix-daemon[842]: accepted connection from pid 2071, user nix-grpc-daemon (trusted)6602worker1 # [ 144.404744] nix-daemon[842]: reaped child process 2074, status = succeeded6603lb # [ 144.377830] niks3-server[995]: 2026/09/20 10:53:32 INFO Received uploads request method=POST path=/api/pending_closures6604worker1 # [ 144.420864] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.511Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6605worker1 # [ 144.422213] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.511Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6606lb # [ 144.390424] niks3-server[995]: 2026/09/20 10:53:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6607lb # [ 144.392179] niks3-server[995]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6608lb # [ 144.395029] niks3-server[995]: 2026/09/20 10:53:32 INFO Signed narinfos id=62 count=16609worker1 # [ 144.434469] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.524Z level=INFO msg="Uploading 1 narinfos"6610lb # [ 144.398067] niks3-server[995]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6611lb # [ 144.402229] niks3-server[995]: 2026/09/20 10:53:32 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6612lb # [ 144.404844] niks3-server[995]: 2026/09/20 10:53:32 INFO Completed upload id=626613worker1 # [ 144.443979] nix-grpc-daemon[1604]: time=2026-09-20T10:53:32.534Z level=INFO msg="Upload complete. (345ms)"6614worker1 # [ 144.445740] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=0 paths=1 nar_bytes_in=7526615lb # [ 144.407364] niks3-server[995]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6616worker1 # [ 144.448803] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609226617worker1 # [ 144.454934] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6618worker1 # [ 144.457155] nix-daemon[842]: reaped child process 2064, status = succeeded6619worker1 # [ 144.462522] nix-daemon[842]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6620worker1 # [ 145.283813] nix-daemon[842]: reaped child process 2078, status = succeeded6621worker1 # [ 145.423939] nix-daemon[842]: accepted connection from pid 2093, user nix-grpc-daemon (trusted)6622worker1 # [ 145.435821] nix-daemon[842]: reaped child process 2096, status = succeeded6623lb # [ 145.413402] niks3-server[995]: 2026/09/20 10:53:33 INFO Received uploads request method=POST path=/api/pending_closures6624worker1 # [ 145.460671] nix-grpc-daemon[1604]: time=2026-09-20T10:53:33.550Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6625worker1 # [ 145.462515] nix-grpc-daemon[1604]: time=2026-09-20T10:53:33.552Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6626lb # [ 145.449290] niks3-server[995]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6627lb # [ 145.458700] niks3-server[995]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6628lb # [ 145.470626] niks3-server[995]: 2026/09/20 10:53:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6629lb # [ 145.475114] niks3-server[995]: 2026/09/20 10:53:33 INFO Signed narinfos id=63 count=16630worker1 # [ 145.517197] nix-grpc-daemon[1604]: time=2026-09-20T10:53:33.607Z level=INFO msg="Uploading 1 narinfos"6631lb # [ 145.479821] niks3-server[995]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6632lb # [ 145.488813] niks3-server[995]: 2026/09/20 10:53:33 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6633lb # [ 145.495422] niks3-server[995]: 2026/09/20 10:53:33 INFO Completed upload id=636634worker1 # [ 145.534713] nix-grpc-daemon[1604]: time=2026-09-20T10:53:33.625Z level=INFO msg="Upload complete. (265ms)"6635lb # [ 145.497026] niks3-server[995]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6636worker1 # [ 145.537070] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60922 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16637worker1 # [ 145.544040] nix-daemon[842]: reaped child process 2076, status = succeeded6638client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.93 seconds)6639worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6640worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6641client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16642worker2 # [ 145.854481] nix-grpc-daemon[1634]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:387866643worker1 # [ 145.888695] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226644worker1 # [ 145.903985] nix-grpc-daemon[1512]: ts=2026-09-20T10:53:33Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06645lb # [ 147.967368] envoy[922]: conn peer=[2001:db8:1::1]:57470 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27120 tx=10604 ms=176806646client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.25 seconds)6647(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 48.22 seconds)6648subtest: low disk drains a worker and builds go to the other6649worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6650worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.02 seconds)6651worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6652worker1 # [ 177.531889] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:05Z level=info event=unhealthy reason=min_free6653lb # [ 177.968388] envoy[922]: conn peer=[2001:db8:1::1]:37690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=300356654worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6655client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26656worker1 # [ 178.269829] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609226657client # don't know how to build these paths:6658client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6659worker1 # [ 178.278590] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609226660worker1 # [ 178.298908] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:06Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06661worker1 # [ 178.303277] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:06Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16662worker2 # [ 178.311254] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387866663worker2 # [ 178.318670] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)6664worker2 # [ 178.406587] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 2/5)6665worker2 # [ 178.517720] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 380 ms (attempt 3/5)6666worker2 # [ 178.903883] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 4/5)6667worker2 # [ 178.983614] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6668worker2 # [ 179.001747] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:387866669client # copying 1 paths to 'lb:50051'...6670client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6671worker2 # [ 179.014550] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:387866672worker2 # [ 179.025404] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6673worker2 # [ 179.044249] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:06Z level=info event=niks3_push_started pid=16906674worker2 # [ 179.324103] nix-daemon[840]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)6675worker2 # [ 179.335364] nix-daemon[840]: reaped child process 1706, status = succeeded6676worker2 # [ 179.451169] nix-daemon[840]: accepted connection from pid 1708, user nix-grpc-daemon (trusted)6677worker2 # [ 179.462775] nix-daemon[840]: reaped child process 1711, status = succeeded6678lb # [ 179.471502] niks3-server[995]: 2026/09/20 10:54:07 INFO Received uploads request method=POST path=/api/pending_closures6679worker2 # [ 179.486269] nix-grpc-daemon[1690]: time=2026-09-20T10:54:06.954Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6680worker2 # [ 179.489547] nix-grpc-daemon[1690]: time=2026-09-20T10:54:06.955Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6681lb # [ 179.506880] niks3-server[995]: 2026/09/20 10:54:07 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6682lb # [ 179.515162] niks3-server[995]: 2026/09/20 10:54:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6683lb # [ 179.520075] niks3-server[995]: 2026/09/20 10:54:07 INFO Signed narinfos id=64 count=16684worker2 # [ 179.531334] nix-grpc-daemon[1690]: time=2026-09-20T10:54:06.999Z level=INFO msg="Uploading 1 narinfos"6685lb # [ 179.525776] niks3-server[995]: 2026/09/20 10:54:07 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6686lb # [ 179.536857] niks3-server[995]: 2026/09/20 10:54:07 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6687worker2 # [ 179.551213] nix-grpc-daemon[1690]: time=2026-09-20T10:54:07.019Z level=INFO msg="Upload complete. (346ms)"6688lb # [ 179.544183] niks3-server[995]: 2026/09/20 10:54:07 INFO Completed upload id=646689worker2 # [ 179.553438] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38786 duration_s=0 paths=1 nar_bytes_in=5126690lb # [ 179.547590] niks3-server[995]: 2026/09/20 10:54:07 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6691worker2 # [ 179.558783] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387866692worker2 # [ 179.564768] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6693worker2 # [ 179.566977] nix-daemon[840]: reaped child process 1688, status = succeeded6694client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6695worker2 # [ 179.573076] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6696client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6697client # farm-a> LOG-farm-a-drain6698worker2 # [ 180.597476] nix-daemon[840]: reaped child process 1715, status = succeeded6699worker2 # [ 180.742768] nix-daemon[840]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6700worker2 # [ 180.753494] nix-daemon[840]: reaped child process 1733, status = succeeded6701lb # [ 180.762770] niks3-server[995]: 2026/09/20 10:54:08 INFO Received uploads request method=POST path=/api/pending_closures6702worker2 # [ 180.780295] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6703worker2 # [ 180.781695] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.246Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6704lb # [ 180.795422] niks3-server[995]: 2026/09/20 10:54:08 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6705lb # [ 180.808526] niks3-server[995]: 2026/09/20 10:54:08 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6706lb # [ 180.817292] niks3-server[995]: 2026/09/20 10:54:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6707worker2 # [ 180.830399] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.297Z level=INFO msg="Uploading 1 narinfos"6708lb # [ 180.823200] niks3-server[995]: 2026/09/20 10:54:08 INFO Signed narinfos id=65 count=16709lb # [ 180.828809] niks3-server[995]: 2026/09/20 10:54:08 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6710lb # [ 180.838503] niks3-server[995]: 2026/09/20 10:54:08 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6711lb # [ 180.844260] niks3-server[995]: 2026/09/20 10:54:08 INFO Completed upload id=656712worker2 # [ 180.851464] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.319Z level=INFO msg="Upload complete. (272ms)"6713lb # [ 180.845743] niks3-server[995]: 2026/09/20 10:54:08 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6714worker2 # [ 180.856536] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38786 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16715worker1 # [ 180.893068] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:08Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06716worker1 # [ 180.894830] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:08Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16717worker2 # [ 180.869701] nix-daemon[840]: reaped child process 1713, status = succeeded6718worker2 # [ 180.905190] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387866719worker2 # [ 180.917750] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:387866720worker2 # [ 180.930083] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.397Z level=INFO msg="All 1 paths already cached"6721client # copying 1 paths to 'lb:50051'...6722client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6723worker2 # [ 180.938198] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:387866724worker2 # [ 180.946606] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6725worker2 # [ 181.109372] nix-daemon[840]: accepted connection from pid 1737, user nix-grpc-daemon (trusted)6726worker2 # [ 181.121542] nix-daemon[840]: reaped child process 1740, status = succeeded6727worker2 # [ 181.281167] nix-daemon[840]: accepted connection from pid 1742, user nix-grpc-daemon (trusted)6728worker2 # [ 181.292685] nix-daemon[840]: reaped child process 1745, status = succeeded6729lb # [ 181.300439] niks3-server[995]: 2026/09/20 10:54:09 INFO Received uploads request method=POST path=/api/pending_closures6730worker2 # [ 181.316201] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.784Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6731worker2 # [ 181.317875] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.785Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6732lb # [ 181.332152] niks3-server[995]: 2026/09/20 10:54:09 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6733lb # [ 181.340880] niks3-server[995]: 2026/09/20 10:54:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6734lb # [ 181.346238] niks3-server[995]: 2026/09/20 10:54:09 INFO Signed narinfos id=66 count=16735worker2 # [ 181.356482] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.824Z level=INFO msg="Uploading 1 narinfos"6736lb # [ 181.352775] niks3-server[995]: 2026/09/20 10:54:09 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6737lb # [ 181.364056] niks3-server[995]: 2026/09/20 10:54:09 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6738lb # [ 181.370432] niks3-server[995]: 2026/09/20 10:54:09 INFO Completed upload id=666739worker2 # [ 181.377784] nix-grpc-daemon[1690]: time=2026-09-20T10:54:08.845Z level=INFO msg="Upload complete. (418ms)"6740lb # [ 181.374326] niks3-server[995]: 2026/09/20 10:54:09 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6741worker2 # [ 181.380747] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38786 duration_s=0 paths=1 nar_bytes_in=6246742worker2 # [ 181.385805] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387866743worker2 # [ 181.394476] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6744worker2 # [ 181.399640] nix-daemon[840]: reaped child process 1735, status = succeeded6745worker2 # [ 181.404521] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6746client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6747client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6748client # farm-b> LOG-farm-b-drain6749worker2 # [ 182.432337] nix-daemon[840]: reaped child process 1749, status = succeeded6750worker2 # [ 182.584505] nix-daemon[840]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6751worker2 # [ 182.596242] nix-daemon[840]: reaped child process 1767, status = succeeded6752lb # [ 182.604537] niks3-server[995]: 2026/09/20 10:54:10 INFO Received uploads request method=POST path=/api/pending_closures6753worker2 # [ 182.616367] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.084Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6754worker2 # [ 182.617878] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.085Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6755lb # [ 182.620755] niks3-server[995]: 2026/09/20 10:54:10 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6756lb # [ 182.625224] niks3-server[995]: 2026/09/20 10:54:10 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6757lb # [ 182.630026] niks3-server[995]: 2026/09/20 10:54:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6758lb # [ 182.632153] niks3-server[995]: 2026/09/20 10:54:10 INFO Signed narinfos id=67 count=16759worker2 # [ 182.640900] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.108Z level=INFO msg="Uploading 1 narinfos"6760lb # [ 182.635162] niks3-server[995]: 2026/09/20 10:54:10 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6761lb # [ 182.639055] niks3-server[995]: 2026/09/20 10:54:10 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6762lb # [ 182.642653] niks3-server[995]: 2026/09/20 10:54:10 INFO Completed upload id=676763worker2 # [ 182.649997] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.118Z level=INFO msg="Upload complete. (238ms)"6764lb # [ 182.644350] niks3-server[995]: 2026/09/20 10:54:10 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6765worker2 # [ 182.653212] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38786 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16766worker2 # [ 182.658833] nix-daemon[840]: reaped child process 1747, status = succeeded6767worker1 # [ 182.693317] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:10Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06768worker1 # [ 182.697346] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:10Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16769worker2 # [ 182.704841] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387866770worker2 # [ 182.716127] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:387866771worker2 # [ 182.726112] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.194Z level=INFO msg="All 2 paths already cached"6772client # copying 1 paths to 'lb:50051'...6773client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6774worker2 # [ 182.733669] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:387866775worker2 # [ 182.741893] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6776worker2 # [ 182.898784] nix-daemon[840]: accepted connection from pid 1771, user nix-grpc-daemon (trusted)6777worker2 # [ 182.911059] nix-daemon[840]: reaped child process 1774, status = succeeded6778worker2 # [ 183.060377] nix-daemon[840]: accepted connection from pid 1776, user nix-grpc-daemon (trusted)6779worker2 # [ 183.071712] nix-daemon[840]: reaped child process 1779, status = succeeded6780lb # [ 183.079945] niks3-server[995]: 2026/09/20 10:54:11 INFO Received uploads request method=POST path=/api/pending_closures6781worker2 # [ 183.094859] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.562Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6782worker2 # [ 183.096377] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.564Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6783lb # [ 183.108916] niks3-server[995]: 2026/09/20 10:54:11 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6784lb # [ 183.118924] niks3-server[995]: 2026/09/20 10:54:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6785worker2 # [ 183.131432] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.599Z level=INFO msg="Uploading 1 narinfos"6786lb # [ 183.124129] niks3-server[995]: 2026/09/20 10:54:11 INFO Signed narinfos id=68 count=16787lb # [ 183.130510] niks3-server[995]: 2026/09/20 10:54:11 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6788lb # [ 183.141305] niks3-server[995]: 2026/09/20 10:54:11 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6789worker2 # [ 183.155111] nix-grpc-daemon[1690]: time=2026-09-20T10:54:10.623Z level=INFO msg="Upload complete. (401ms)"6790lb # [ 183.147816] niks3-server[995]: 2026/09/20 10:54:11 INFO Completed upload id=686791worker2 # [ 183.157061] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38786 duration_s=0 paths=1 nar_bytes_in=7526792lb # [ 183.150849] niks3-server[995]: 2026/09/20 10:54:11 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6793worker2 # [ 183.162058] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387866794worker2 # [ 183.167499] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6795worker2 # [ 183.169704] nix-daemon[840]: reaped child process 1769, status = succeeded6796worker2 # [ 183.174960] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6797client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6798client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6799client # farm-top> LOG-farm-top-drain6800worker2 # [ 184.601865] nix-daemon[840]: reaped child process 1783, status = succeeded6801worker2 # [ 184.722680] nix-daemon[840]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6802worker2 # [ 184.734445] nix-daemon[840]: reaped child process 1801, status = succeeded6803lb # [ 184.737138] niks3-server[995]: 2026/09/20 10:54:12 INFO Received uploads request method=POST path=/api/pending_closures6804worker2 # [ 184.748459] nix-grpc-daemon[1690]: time=2026-09-20T10:54:12.216Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6805worker2 # [ 184.749953] nix-grpc-daemon[1690]: time=2026-09-20T10:54:12.218Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6806lb # [ 184.759036] niks3-server[995]: 2026/09/20 10:54:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6807lb # [ 184.761655] niks3-server[995]: 2026/09/20 10:54:12 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6808lb # [ 184.763555] niks3-server[995]: 2026/09/20 10:54:12 INFO Signed narinfos id=69 count=16809worker2 # [ 184.771120] nix-grpc-daemon[1690]: time=2026-09-20T10:54:12.239Z level=INFO msg="Uploading 1 narinfos"6810lb # [ 184.765579] niks3-server[995]: 2026/09/20 10:54:12 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6811lb # [ 184.771067] niks3-server[995]: 2026/09/20 10:54:12 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6812worker2 # [ 184.781644] nix-grpc-daemon[1690]: time=2026-09-20T10:54:12.249Z level=INFO msg="Upload complete. (198ms)"6813lb # [ 184.774843] niks3-server[995]: 2026/09/20 10:54:12 INFO Completed upload id=696814lb # [ 184.776811] niks3-server[995]: 2026/09/20 10:54:12 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6815worker2 # [ 184.784125] nix-grpc-daemon[1634]: ts=2026-09-20T10:54:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38786 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16816lb # [ 184.779055] niks3-server[995]: 2026/09/20 10:54:12 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6817worker2 # [ 184.790296] nix-daemon[840]: reaped child process 1781, status = succeeded6818client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.78 seconds)6819client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6820client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.19 seconds)6821worker1: must succeed: rm /nix/.rw-store/fill6822worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6823worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6824worker1 # [ 185.535826] nix-grpc-daemon[1512]: ts=2026-09-20T10:54:13Z level=info event=healthy reason=min_free6825worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6826(finished: subtest: low disk drains a worker and builds go to the other, in 10.41 seconds)6827(finished: run the VM test script, in 187.21 seconds)6828test script finished in 187.45s6829cleanup6830kill QemuMachine (pid 49)6831client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6832kill QemuMachine (pid 50)6833lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6834kill QemuMachine (pid 51)6835worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6836kill QemuMachine (pid 52)6837worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6838(finished: cleanup, in 0.95 seconds)6839additionally exposed symbols:6840 client, lb, worker1, worker2,6841 vlan1,6842 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh