vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #278
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb: QEMU running (pid 51)14lb # Formatting '/build/vm-state-lb/tmp.UJQURrnTBL', fmt=raw size=107374182415client: QEMU running (pid 49)16lb # mke2fs 1.47.4 (6-Mar-2025)17client # Disk image does not exist, creating the virtualisation disk image...18worker2 # Disk image does not exist, creating the virtualisation disk image...19client # Formatting '/build/vm-state-client/tmp.LAvoSSmTs9', fmt=raw size=107374182420lb # Discarding device blocks: 0/262144 done21worker2: QEMU running (pid 52)22worker2 # Formatting '/build/vm-state-worker2/tmp.iE6M5AUl0A', fmt=raw size=107374182423client # mke2fs 1.47.4 (6-Mar-2025)24worker2 # mke2fs 1.47.4 (6-Mar-2025)25lb # Creating filesystem with 262144 4k blocks and 65536 inodes26client # Discarding device blocks: 0/262144 done27worker2 # Discarding device blocks: 0/262144 done28worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes29lb # Filesystem UUID: 4ff42d7a-45fa-4331-86d7-1ff12cf0039830worker1: QEMU running (pid 50)31worker1 # Disk image does not exist, creating the virtualisation disk image...32lb # Superblock backups stored on blocks:33client # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # 32768, 98304, 163840, 22937635client # Filesystem UUID: 9dba121e-c285-4e21-abb2-7106e106d8f436worker1 # Formatting '/build/vm-state-worker1/tmp.ug1Y8YPnhC', fmt=raw size=107374182437(finished: start all VMs, in 0.21 seconds)38client # Superblock backups stored on blocks:39worker1 # mke2fs 1.47.4 (6-Mar-2025)40client: waiting for unit network-addresses-eth1.service41client # 32768, 98304, 163840, 22937642worker1 # Discarding device blocks: 0/262144 done43client: waiting for the VM to finish booting44client # 45worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes46lb # 47lb # Allocating group tables: 0/8 done48lb # Writing inode tables: 0/8 done49client # Allocating group tables: 0/8 done50worker1 # Filesystem UUID: f6c2f3da-f35b-4039-8716-3458bafe501351worker1 # Superblock backups stored on blocks:52worker2 # Filesystem UUID: c3d2cf8d-870a-41a2-b652-f4700140e91053client # Writing inode tables: 0/8 done54client # Creating journal (8192 blocks): done55client # Writing superblocks and filesystem accounting information: 0/8 done56worker2 # Superblock backups stored on blocks:57worker1 # 32768, 98304, 163840, 22937658lb # Creating journal (8192 blocks): done59worker1 # 60lb # Writing superblocks and filesystem accounting information: 0/8 done61worker2 # 32768, 98304, 163840, 22937662client # 63worker1 # Allocating group tables: 0/8 done64lb # 65worker2 # 66client # Virtualisation disk image created.67worker1 # Writing inode tables: 0/8 done68lb # Virtualisation disk image created.69worker1 # Creating journal (8192 blocks): done70worker2 # Allocating group tables: 0/8 done71worker1 # Writing superblocks and filesystem accounting information: 0/8 done72worker2 # Writing inode tables: 0/8 done73worker1 # 74worker2 # Creating journal (8192 blocks): done75worker1 # Virtualisation disk image created.76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83lb # 84lb # 85lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086client # 87client # 88lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...89lb # 90lb # 91lb # 92lb # 93worker2 # 94worker2 # 95client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0096lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0097worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0098client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99client # 100client # 101client # 102client # 103worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...104worker2 # 105worker2 # 106worker2 # 107worker2 # 108lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...109lb # 110lb # 111client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00112worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00113client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114client # 115client # 116worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117worker2 # 118worker2 # 119worker1 # 120worker1 # 121worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123worker1 # 124worker1 # 125worker1 # 126worker1 # 127worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker1 # 130worker1 # 131lb # Booting from ROM...132worker2 # Booting from ROM...133client # Booting from ROM...134worker1 # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8406p3fswj6h3s9840p4nnx6zl61n26s-nixos-system-worker2-test/init regInfo=/nix/store/9gsll5rv3mr0i84a6nw4dranvpwj5n3q-closure-info/registration console=ttyS0,115200n8 console=tty0137worker2 # [ 0.000000] BIOS-provided physical RAM map:138worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026140worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved141worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved142worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable143worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved144lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r7i2qny6zxqjgksiw8bnyjrpmwmq2adf-nixos-system-lb-test/init regInfo=/nix/store/nsd6mwhnd72yzbh9syf2drsax74mqqk0-closure-info/registration console=ttyS0,115200n8 console=tty0145worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved146lb # [ 0.000000] BIOS-provided physical RAM map:147worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved148lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable149client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026150lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved151worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved152worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved153lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved154worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved155lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable156worker2 # [ 0.000000] NX (Execute Disable) protection: active157lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved158worker2 # [ 0.000000] APIC: Static calls initialized159worker2 # [ 0.000000] SMBIOS 2.8 present.160lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved161client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test/init regInfo=/nix/store/qg7kkzbx4402mlhafr9635k4l8c0jiy9-closure-info/registration console=ttyS0,115200n8 console=tty0162client # [ 0.000000] BIOS-provided physical RAM map:163lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved164worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014165client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable166worker2 # [ 0.000000] DMI: Memory slots populated: 1/1167lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved168worker2 # [ 0.000000] Hypervisor detected: KVM169client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved170lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved171worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000172client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved173worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00174lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved175worker2 # [ 0.000000] kvm-clock: using sched offset of 480795886 cycles176client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable177lb # [ 0.000000] NX (Execute Disable) protection: active178lb # [ 0.000000] APIC: Static calls initialized179lb # [ 0.000000] SMBIOS 2.8 present.180client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved181worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns182client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved183worker2 # [ 0.000004] tsc: Detected 2400.012 MHz processor184lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014185worker2 # [ 0.000809] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000186client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved187lb # [ 0.000000] DMI: Memory slots populated: 1/1188lb # [ 0.000000] Hypervisor detected: KVM189client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved190worker2 # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs191lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000192client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved193worker2 # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT194lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00195worker2 # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]196lb # [ 0.000000] kvm-clock: using sched offset of 461623891 cycles197client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved198worker2 # [ 0.002743] Using GB pages for direct mapping199client # [ 0.000000] NX (Execute Disable) protection: active200worker2 # [ 0.002833] RAMDISK: [mem 0x5e367000-0x5ffcffff]201client # [ 0.000000] APIC: Static calls initialized202lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns203client # [ 0.000000] SMBIOS 2.8 present.204worker2 # [ 0.002841] ACPI: Early table checksum verification disabled205lb # [ 0.000005] tsc: Detected 2400.012 MHz processor206worker2 # [ 0.002843] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )207lb # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000208client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014209client # [ 0.000000] DMI: Memory slots populated: 1/1210worker2 # [ 0.002847] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)211lb # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs212client # [ 0.000000] Hypervisor detected: KVM213lb # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT214client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000215worker2 # [ 0.002850] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)216client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00217lb # [ 0.002743] found SMP MP-table at [mem 0x000f5450-0x000f545f]218worker2 # [ 0.002857] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)219lb # [ 0.002758] Using GB pages for direct mapping220client # [ 0.000000] kvm-clock: using sched offset of 479832012 cycles221worker2 # [ 0.002859] ACPI: FACS 0x000000005FFE0000 000040222lb # [ 0.002853] RAMDISK: [mem 0x5e367000-0x5ffcffff]223lb # [ 0.002864] ACPI: Early table checksum verification disabled224client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns225worker2 # [ 0.002860] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)226lb # [ 0.002868] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )227client # [ 0.000005] tsc: Detected 2400.012 MHz processor228worker2 # [ 0.002862] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)229client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000230lb # [ 0.002872] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)231worker2 # [ 0.002863] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)232client # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs233lb # [ 0.002877] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)234client # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT235worker2 # [ 0.002865] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)236lb # [ 0.002884] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)237client # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f]238worker2 # [ 0.002866] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]239lb # [ 0.002887] ACPI: FACS 0x000000005FFE0000 000040240client # [ 0.002740] Using GB pages for direct mapping241client # [ 0.002856] RAMDISK: [mem 0x5e366000-0x5ffcffff]242worker2 # [ 0.002867] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]243lb # [ 0.002888] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)244client # [ 0.002863] ACPI: Early table checksum verification disabled245worker2 # [ 0.002868] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]246lb # [ 0.002890] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)247client # [ 0.002867] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )248worker2 # [ 0.002868] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]249lb # [ 0.002891] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)250client # [ 0.002871] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)251worker2 # [ 0.002869] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]252lb # [ 0.002893] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)253worker2 # [ 0.002869] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]254client # [ 0.002875] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)255lb # [ 0.002894] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]256worker2 # [ 0.002870] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]257client # [ 0.002882] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)258worker2 # [ 0.003093] No NUMA configuration found259lb # [ 0.002895] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]260client # [ 0.002884] ACPI: FACS 0x000000005FFE0000 000040261worker2 # [ 0.003094] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]262lb # [ 0.002896] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]263client # [ 0.002886] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)264worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026265worker2 # [ 0.003097] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]266worker2 # [ 0.005400] Zone ranges:267lb # [ 0.002896] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]268client # [ 0.002888] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)269worker2 # [ 0.005401] DMA [mem 0x0000000000001000-0x0000000000ffffff]270lb # [ 0.002897] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]271worker2 # [ 0.005402] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]272client # [ 0.002889] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)273lb # [ 0.002897] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]274worker2 # [ 0.005403] Normal empty275worker2 # [ 0.005404] Device empty276client # [ 0.002891] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)277lb # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]278worker2 # [ 0.005405] Movable zone start for each node279worker2 # [ 0.005405] Early memory node ranges280lb # [ 0.003138] No NUMA configuration found281worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/41z8s7g0mnn0a1i9plh0bj17rca4hf8c-nixos-system-worker1-test/init regInfo=/nix/store/7n2qfgy34jnxzxm88039rdvpp8lh9x4i-closure-info/registration console=ttyS0,115200n8 console=tty0282client # [ 0.002892] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]283worker1 # [ 0.000000] BIOS-provided physical RAM map:284worker2 # [ 0.005406] node 0: [mem 0x0000000000001000-0x000000000009efff]285lb # [ 0.003139] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]286client # [ 0.002893] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]287worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable288worker2 # [ 0.005407] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]289lb # [ 0.003141] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]290lb # [ 0.005535] Zone ranges:291client # [ 0.002894] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]292worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved293worker2 # [ 0.005408] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]294lb # [ 0.005537] DMA [mem 0x0000000000001000-0x0000000000ffffff]295client # [ 0.002894] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]296worker2 # [ 0.005427] On node 0, zone DMA: 1 pages in unavailable ranges297worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved298lb # [ 0.005539] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]299client # [ 0.002894] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]300lb # [ 0.005540] Normal empty301worker2 # [ 0.005703] On node 0, zone DMA: 97 pages in unavailable ranges302worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable303lb # [ 0.005541] Device empty304worker2 # [ 0.032741] On node 0, zone DMA32: 40 pages in unavailable ranges305client # [ 0.002895] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]306lb # [ 0.005541] Movable zone start for each node307worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved308lb # [ 0.005542] Early memory node ranges309worker2 # [ 0.033200] ACPI: PM-Timer IO Port: 0x608310client # [ 0.002895] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]311worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved312worker2 # [ 0.033212] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])313lb # [ 0.005542] node 0: [mem 0x0000000000001000-0x000000000009efff]314client # [ 0.003120] No NUMA configuration found315worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved316worker2 # [ 0.033238] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23317lb # [ 0.005544] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]318client # [ 0.003121] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]319worker2 # [ 0.033241] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)320worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved321lb # [ 0.005545] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]322client # [ 0.003123] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]323client # [ 0.005447] Zone ranges:324worker2 # [ 0.033243] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)325worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved326lb # [ 0.005569] On node 0, zone DMA: 1 pages in unavailable ranges327client # [ 0.005448] DMA [mem 0x0000000000001000-0x0000000000ffffff]328lb # [ 0.005848] On node 0, zone DMA: 97 pages in unavailable ranges329worker2 # [ 0.033244] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)330worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved331client # [ 0.005450] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]332lb # [ 0.034025] On node 0, zone DMA32: 40 pages in unavailable ranges333worker1 # [ 0.000000] NX (Execute Disable) protection: active334client # [ 0.005451] Normal empty335worker2 # [ 0.033245] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)336client # [ 0.005452] Device empty337lb # [ 0.034497] ACPI: PM-Timer IO Port: 0x608338worker1 # [ 0.000000] APIC: Static calls initialized339client # [ 0.005453] Movable zone start for each node340worker1 # [ 0.000000] SMBIOS 2.8 present.341worker2 # [ 0.033245] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)342lb # [ 0.034509] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])343client # [ 0.005454] Early memory node ranges344worker2 # [ 0.033248] ACPI: Using ACPI (MADT) for SMP configuration information345lb # [ 0.034539] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23346client # [ 0.005454] node 0: [mem 0x0000000000001000-0x000000000009efff]347worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014348worker2 # [ 0.033249] ACPI: HPET id: 0x8086a201 base: 0xfed00000349worker1 # [ 0.000000] DMI: Memory slots populated: 1/1350lb # [ 0.034542] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)351client # [ 0.005455] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]352worker2 # [ 0.033252] TSC deadline timer available353worker1 # [ 0.000000] Hypervisor detected: KVM354worker2 # [ 0.033256] CPU topo: Max. logical packages: 1355lb # [ 0.034544] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)356client # [ 0.005456] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]357worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000358worker2 # [ 0.033257] CPU topo: Max. logical dies: 1359lb # [ 0.034545] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)360client # [ 0.005476] On node 0, zone DMA: 1 pages in unavailable ranges361worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00362worker2 # [ 0.033257] CPU topo: Max. dies per package: 1363worker1 # [ 0.000000] kvm-clock: using sched offset of 490731066 cycles364client # [ 0.005748] On node 0, zone DMA: 97 pages in unavailable ranges365worker2 # [ 0.033261] CPU topo: Max. threads per core: 1366lb # [ 0.034546] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)367worker2 # [ 0.033261] CPU topo: Num. cores per package: 1368client # [ 0.033791] On node 0, zone DMA32: 40 pages in unavailable ranges369lb # [ 0.034547] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)370worker2 # [ 0.033261] CPU topo: Num. threads per package: 1371client # [ 0.034249] ACPI: PM-Timer IO Port: 0x608372worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns373lb # [ 0.034549] ACPI: Using ACPI (MADT) for SMP configuration information374worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor375worker2 # [ 0.033262] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs376client # [ 0.034261] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])377lb # [ 0.034550] ACPI: HPET id: 0x8086a201 base: 0xfed00000378worker1 # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000379client # [ 0.034288] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23380worker2 # [ 0.033279] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()381lb # [ 0.034554] TSC deadline timer available382lb # [ 0.034558] CPU topo: Max. logical packages: 1383client # [ 0.034291] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)384worker1 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs385worker2 # [ 0.033310] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]386lb # [ 0.034559] CPU topo: Max. logical dies: 1387client # [ 0.034293] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)388worker1 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT389lb # [ 0.034559] CPU topo: Max. dies per package: 1390worker2 # [ 0.033311] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]391lb # [ 0.034564] CPU topo: Max. threads per core: 1392worker1 # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f]393client # [ 0.034294] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)394worker2 # [ 0.033313] [mem 0x60000000-0xafffffff] available for PCI devices395worker1 # [ 0.002746] Using GB pages for direct mapping396lb # [ 0.034565] CPU topo: Num. cores per package: 1397worker2 # [ 0.033314] Booting paravirtualized kernel on KVM398client # [ 0.034295] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)399worker1 # [ 0.002873] RAMDISK: [mem 0x5e367000-0x5ffcffff]400lb # [ 0.034565] CPU topo: Num. threads per package: 1401client # [ 0.034296] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)402lb # [ 0.034565] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs403worker1 # [ 0.002882] ACPI: Early table checksum verification disabled404worker2 # [ 0.033318] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns405worker1 # [ 0.002885] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )406client # [ 0.034298] ACPI: Using ACPI (MADT) for SMP configuration information407lb # [ 0.034586] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()408worker2 # [ 0.037789] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1409client # [ 0.034299] ACPI: HPET id: 0x8086a201 base: 0xfed00000410worker1 # [ 0.002889] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)411client # [ 0.034303] TSC deadline timer available412lb # [ 0.034622] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]413worker2 # [ 0.039979] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152414client # [ 0.034307] CPU topo: Max. logical packages: 1415worker1 # [ 0.002893] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)416worker2 # [ 0.040021] kvm-guest: PV spinlocks disabled, single CPU417lb # [ 0.034624] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]418client # [ 0.034308] CPU topo: Max. logical dies: 1419client # [ 0.034308] CPU topo: Max. dies per package: 1420lb # [ 0.034625] [mem 0x60000000-0xafffffff] available for PCI devices421worker1 # [ 0.002899] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)422client # [ 0.034312] CPU topo: Max. threads per core: 1423lb # [ 0.034627] Booting paravirtualized kernel on KVM424worker1 # [ 0.002901] ACPI: FACS 0x000000005FFE0000 000040425client # [ 0.034312] CPU topo: Num. cores per package: 1426lb # [ 0.034631] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns427client # [ 0.034313] CPU topo: Num. threads per package: 1428worker1 # [ 0.002903] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)429client # [ 0.034313] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs430lb # [ 0.039097] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1431worker1 # [ 0.002904] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)432worker2 # [ 0.040023] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8406p3fswj6h3s9840p4nnx6zl61n26s-nixos-system-worker2-test/init regInfo=/nix/store/9gsll5rv3mr0i84a6nw4dranvpwj5n3q-closure-info/registration console=ttyS0,115200n8 console=tty0433client # [ 0.034334] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()434lb # [ 0.041468] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152435worker1 # [ 0.002906] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)436lb # [ 0.041515] kvm-guest: PV spinlocks disabled, single CPU437client # [ 0.034368] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]438worker2 # [ 0.040114] Unknown kernel command line parameters "regInfo=/nix/store/9gsll5rv3mr0i84a6nw4dranvpwj5n3q-closure-info/registration", will be passed to user space.439worker1 # [ 0.002908] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)440worker2 # [ 0.040127] random: crng init done441client # [ 0.034370] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]442worker1 # [ 0.002909] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]443client # [ 0.034371] [mem 0x60000000-0xafffffff] available for PCI devices444worker2 # [ 0.040127] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes445client # [ 0.034373] Booting paravirtualized kernel on KVM446worker1 # [ 0.002910] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]447worker2 # [ 0.042274] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)448worker1 # [ 0.002910] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]449client # [ 0.034377] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns450lb # [ 0.041516] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r7i2qny6zxqjgksiw8bnyjrpmwmq2adf-nixos-system-lb-test/init regInfo=/nix/store/nsd6mwhnd72yzbh9syf2drsax74mqqk0-closure-info/registration console=ttyS0,115200n8 console=tty0451worker2 # [ 0.043634] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)452worker1 # [ 0.002911] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]453worker2 # [ 0.043664] Fallback order for Node 0: 0454client # [ 0.038869] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1455worker1 # [ 0.002911] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]456worker2 # [ 0.043667] Built 1 zonelists, mobility grouping on. Total pages: 393078457client # [ 0.041609] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152458worker2 # [ 0.043668] Policy zone: DMA32459lb # [ 0.041616] Unknown kernel command line parameters "regInfo=/nix/store/nsd6mwhnd72yzbh9syf2drsax74mqqk0-closure-info/registration", will be passed to user space.460worker1 # [ 0.002912] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]461client # [ 0.041651] kvm-guest: PV spinlocks disabled, single CPU462lb # [ 0.041629] random: crng init done463worker2 # [ 0.046203] mem auto-init: stack:all(zero), heap alloc:on, heap free:off464worker1 # [ 0.002912] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]465lb # [ 0.041630] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes466worker2 # [ 0.049338] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1467worker1 # [ 0.003138] No NUMA configuration found468worker2 # [ 0.052700] allocated 3145728 bytes of page_ext469lb # [ 0.043915] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)470worker1 # [ 0.003139] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]471worker2 # [ 0.062440] ftrace: allocating 48731 entries in 192 pages472worker1 # [ 0.003141] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]473lb # [ 0.045052] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)474worker2 # [ 0.062442] ftrace: allocated 192 pages with 2 groups475worker1 # [ 0.005535] Zone ranges:476lb # [ 0.045087] Fallback order for Node 0: 0477worker2 # [ 0.063278] Dynamic Preempt: lazy478client # [ 0.041653] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test/init regInfo=/nix/store/qg7kkzbx4402mlhafr9635k4l8c0jiy9-closure-info/registration console=ttyS0,115200n8 console=tty0479worker1 # [ 0.005536] DMA [mem 0x0000000000001000-0x0000000000ffffff]480lb # [ 0.045090] Built 1 zonelists, mobility grouping on. Total pages: 393078481worker2 # [ 0.063392] rcu: Preemptible hierarchical RCU implementation.482lb # [ 0.045091] Policy zone: DMA32483worker2 # [ 0.063393] rcu: RCU event tracing is enabled.484worker1 # [ 0.005537] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]485worker1 # [ 0.005538] Normal empty486worker1 # [ 0.005539] Device empty487lb # [ 0.048019] mem auto-init: stack:all(zero), heap alloc:on, heap free:off488worker2 # [ 0.063393] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.489client # [ 0.041761] Unknown kernel command line parameters "regInfo=/nix/store/qg7kkzbx4402mlhafr9635k4l8c0jiy9-closure-info/registration", will be passed to user space.490worker1 # [ 0.005540] Movable zone start for each node491worker2 # [ 0.063395] Trampoline variant of Tasks RCU enabled.492client # [ 0.041774] random: crng init done493lb # [ 0.051494] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1494worker1 # [ 0.005540] Early memory node ranges495worker2 # [ 0.063395] Rude variant of Tasks RCU enabled.496lb # [ 0.055024] allocated 3145728 bytes of page_ext497client # [ 0.041775] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes498worker1 # [ 0.005541] node 0: [mem 0x0000000000001000-0x000000000009efff]499worker2 # [ 0.063395] Tracing variant of Tasks RCU enabled.500lb # [ 0.065525] ftrace: allocating 48731 entries in 192 pages501worker1 # [ 0.005542] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]502lb # [ 0.065527] ftrace: allocated 192 pages with 2 groups503client # [ 0.044029] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)504worker2 # [ 0.063396] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.505lb # [ 0.066428] Dynamic Preempt: lazy506worker1 # [ 0.005543] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]507worker2 # [ 0.063397] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1508client # [ 0.045164] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)509lb # [ 0.066571] rcu: Preemptible hierarchical RCU implementation.510client # [ 0.045198] Fallback order for Node 0: 0511worker1 # [ 0.005563] On node 0, zone DMA: 1 pages in unavailable ranges512lb # [ 0.066572] rcu: RCU event tracing is enabled.513worker2 # [ 0.063452] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.514client # [ 0.045202] Built 1 zonelists, mobility grouping on. Total pages: 393078515worker1 # [ 0.005851] On node 0, zone DMA: 97 pages in unavailable ranges516lb # [ 0.066572] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.517client # [ 0.045203] Policy zone: DMA32518lb # [ 0.066573] Trampoline variant of Tasks RCU enabled.519worker2 # [ 0.063454] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.520worker1 # [ 0.034116] On node 0, zone DMA32: 40 pages in unavailable ranges521client # [ 0.047834] mem auto-init: stack:all(zero), heap alloc:on, heap free:off522worker1 # [ 0.034577] ACPI: PM-Timer IO Port: 0x608523lb # [ 0.066574] Rude variant of Tasks RCU enabled.524worker1 # [ 0.034590] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])525lb # [ 0.066574] Tracing variant of Tasks RCU enabled.526worker2 # [ 0.063455] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.527client # [ 0.051364] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1528client # [ 0.055169] allocated 3145728 bytes of page_ext529worker1 # [ 0.034619] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23530worker2 # [ 0.068072] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16531lb # [ 0.066575] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.532client # [ 0.065514] ftrace: allocating 48731 entries in 192 pages533worker1 # [ 0.034622] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)534worker2 # [ 0.068360] rcu: srcu_init: Setting srcu_struct sizes based on contention.535lb # [ 0.066576] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1536client # [ 0.065516] ftrace: allocated 192 pages with 2 groups537client # [ 0.066398] Dynamic Preempt: lazy538worker1 # [ 0.034623] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)539worker2 # [ 0.068366] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns540lb # [ 0.066639] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.541client # [ 0.066571] rcu: Preemptible hierarchical RCU implementation.542worker1 # [ 0.034625] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)543client # [ 0.066572] rcu: RCU event tracing is enabled.544worker1 # [ 0.034626] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)545lb # [ 0.066641] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.546worker2 # [ 0.068467] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)547client # [ 0.066572] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.548worker2 # [ 0.072047] Console: colour VGA+ 80x25549worker1 # [ 0.034626] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)550client # [ 0.066574] Trampoline variant of Tasks RCU enabled.551worker2 # [ 0.072050] printk: legacy console [tty0] enabled552lb # [ 0.066642] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.553worker2 # [ 0.101360] printk: legacy console [ttyS0] enabled554client # [ 0.066575] Rude variant of Tasks RCU enabled.555worker1 # [ 0.034629] ACPI: Using ACPI (MADT) for SMP configuration information556lb # [ 0.071112] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16557client # [ 0.066575] Tracing variant of Tasks RCU enabled.558worker1 # [ 0.034630] ACPI: HPET id: 0x8086a201 base: 0xfed00000559worker2 # [ 0.197916] ACPI: Core revision 20250807560lb # [ 0.071398] rcu: srcu_init: Setting srcu_struct sizes based on contention.561worker1 # [ 0.034633] TSC deadline timer available562client # [ 0.066576] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.563worker1 # [ 0.034638] CPU topo: Max. logical packages: 1564lb # [ 0.071406] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns565worker1 # [ 0.034639] CPU topo: Max. logical dies: 1566client # [ 0.066576] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1567worker2 # [ 0.198784] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns568worker1 # [ 0.034639] CPU topo: Max. dies per package: 1569client # [ 0.066592] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570worker2 # [ 0.200240] APIC: Switch to symmetric I/O mode setup571lb # [ 0.071521] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)572worker1 # [ 0.034643] CPU topo: Max. threads per core: 1573lb # [ 0.075084] Console: colour VGA+ 80x25574worker1 # [ 0.034644] CPU topo: Num. cores per package: 1575worker2 # [ 0.201205] x2apic enabled576lb # [ 0.075087] printk: legacy console [tty0] enabled577client # [ 0.066594] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.578worker1 # [ 0.034645] CPU topo: Num. threads per package: 1579lb # [ 0.104669] printk: legacy console [ttyS0] enabled580worker2 # [ 0.201940] APIC: Switched APIC routing to: physical x2apic581worker1 # [ 0.034645] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs582client # [ 0.066595] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.583lb # [ 0.200481] ACPI: Core revision 20250807584worker1 # [ 0.034664] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()585client # [ 0.071031] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16586worker1 # [ 0.034697] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]587client # [ 0.071301] rcu: srcu_init: Setting srcu_struct sizes based on contention.588worker2 # [ 0.203877] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1589lb # [ 0.201404] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns590worker1 # [ 0.034699] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]591client # [ 0.071307] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns592lb # [ 0.202937] APIC: Switch to symmetric I/O mode setup593worker1 # [ 0.034701] [mem 0x60000000-0xafffffff] available for PCI devices594worker2 # [ 0.204828] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns595lb # [ 0.203867] x2apic enabled596worker1 # [ 0.034702] Booting paravirtualized kernel on KVM597client # [ 0.071419] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)598client # [ 0.074967] Console: colour VGA+ 80x25599lb # [ 0.204597] APIC: Switched APIC routing to: physical x2apic600worker2 # [ 0.206439] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)601worker1 # [ 0.034705] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns602client # [ 0.074970] printk: legacy console [tty0] enabled603client # [ 0.104694] printk: legacy console [ttyS0] enabled604worker2 # [ 0.207523] x86/cpu: User Mode Instruction Prevention (UMIP) activated605worker1 # [ 0.039177] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1606client # [ 0.200917] ACPI: Core revision 20250807607lb # [ 0.206371] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1608worker1 # [ 0.041505] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152609worker2 # [ 0.208566] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127610worker1 # [ 0.041551] kvm-guest: PV spinlocks disabled, single CPU611worker2 # [ 0.209437] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0612client # [ 0.201806] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns613lb # [ 0.207338] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns614client # [ 0.203366] APIC: Switch to symmetric I/O mode setup615worker2 # [ 0.210440] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto616lb # [ 0.208957] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)617client # [ 0.204295] x2apic enabled618lb # [ 0.210050] x86/cpu: User Mode Instruction Prevention (UMIP) activated619client # [ 0.205036] APIC: Switched APIC routing to: physical x2apic620worker2 # [ 0.211436] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl621worker1 # [ 0.041553] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/41z8s7g0mnn0a1i9plh0bj17rca4hf8c-nixos-system-worker1-test/init regInfo=/nix/store/7n2qfgy34jnxzxm88039rdvpp8lh9x4i-closure-info/registration console=ttyS0,115200n8 console=tty0622lb # [ 0.211087] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127623worker2 # [ 0.212436] Transient Scheduler Attacks: Vulnerable: No microcode624client # [ 0.206825] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1625lb # [ 0.211955] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0626worker1 # [ 0.041649] Unknown kernel command line parameters "regInfo=/nix/store/7n2qfgy34jnxzxm88039rdvpp8lh9x4i-closure-info/registration", will be passed to user space.627worker2 # [ 0.213436] Spectre V2 : Mitigation: Enhanced / Automatic IBRS628worker1 # [ 0.041662] random: crng init done629worker2 # [ 0.214437] Speculative Return Stack Overflow: Mitigation: Safe RET630worker1 # [ 0.041663] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes631client # [ 0.207786] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns632lb # [ 0.212959] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto633worker1 # [ 0.043935] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)634client # [ 0.209397] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)635lb # [ 0.213955] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl636worker1 # [ 0.045339] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)637worker1 # [ 0.045372] Fallback order for Node 0: 0638lb # [ 0.214955] Transient Scheduler Attacks: Vulnerable: No microcode639client # [ 0.210487] x86/cpu: User Mode Instruction Prevention (UMIP) activated640worker1 # [ 0.045375] Built 1 zonelists, mobility grouping on. Total pages: 393078641worker1 # [ 0.045376] Policy zone: DMA32642worker2 # [ 0.215436] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization643lb # [ 0.215954] Spectre V2 : Mitigation: Enhanced / Automatic IBRS644client # [ 0.211572] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127645worker1 # [ 0.048376] mem auto-init: stack:all(zero), heap alloc:on, heap free:off646worker2 # [ 0.217443] Spectre V2 : Enabling IBPB for BPF647lb # [ 0.216954] Speculative Return Stack Overflow: Mitigation: Safe RET648client # [ 0.212394] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0649worker1 # [ 0.051760] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1650worker1 # [ 0.055273] allocated 3145728 bytes of page_ext651worker2 # [ 0.218140] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier652worker1 # [ 0.065449] ftrace: allocating 48731 entries in 192 pages653worker2 # [ 0.219437] active return thunk: srso_alias_return_thunk654client # [ 0.213398] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto655worker1 # [ 0.065451] ftrace: allocated 192 pages with 2 groups656worker1 # [ 0.066328] Dynamic Preempt: lazy657worker2 # [ 0.220458] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'658worker1 # [ 0.066467] rcu: Preemptible hierarchical RCU implementation.659client # [ 0.214394] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl660worker1 # [ 0.066467] rcu: RCU event tracing is enabled.661lb # [ 0.217954] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization662worker2 # [ 0.221436] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'663client # [ 0.215394] Transient Scheduler Attacks: Vulnerable: No microcode664worker1 # [ 0.066468] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.665lb # [ 0.219962] Spectre V2 : Enabling IBPB for BPF666worker2 # [ 0.222436] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'667client # [ 0.216394] Spectre V2 : Mitigation: Enhanced / Automatic IBRS668worker1 # [ 0.066469] Trampoline variant of Tasks RCU enabled.669worker1 # [ 0.066470] Rude variant of Tasks RCU enabled.670lb # [ 0.220676] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier671worker2 # [ 0.223436] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'672client # [ 0.217394] Speculative Return Stack Overflow: Mitigation: Safe RET673worker1 # [ 0.066470] Tracing variant of Tasks RCU enabled.674lb # [ 0.221955] active return thunk: srso_alias_return_thunk675worker2 # [ 0.224436] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'676worker1 # [ 0.066471] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.677worker1 # [ 0.066472] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1678lb # [ 0.222976] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'679worker2 # [ 0.225436] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'680worker1 # [ 0.066529] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.681lb # [ 0.223954] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'682worker2 # [ 0.226436] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'683worker1 # [ 0.066531] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.684lb # [ 0.224954] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'685client # [ 0.218394] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization686worker2 # [ 0.227437] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256687client # [ 0.220402] Spectre V2 : Enabling IBPB for BPF688lb # [ 0.225954] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'689worker1 # [ 0.066532] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.690worker2 # [ 0.228436] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64691worker1 # [ 0.071247] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16692lb # [ 0.226954] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'693worker2 # [ 0.229436] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512694client # [ 0.221395] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier695worker1 # [ 0.071529] rcu: srcu_init: Setting srcu_struct sizes based on contention.696lb # [ 0.227954] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'697client # [ 0.222395] active return thunk: srso_alias_return_thunk698worker2 # [ 0.230436] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024699worker1 # [ 0.071537] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns700lb # [ 0.228954] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'701worker2 # [ 0.231436] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8702client # [ 0.223415] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'703worker1 # [ 0.071649] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)704lb # [ 0.229955] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256705client # [ 0.224394] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'706worker1 # [ 0.075149] Console: colour VGA+ 80x25707worker2 # [ 0.232436] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.708worker1 # [ 0.075152] printk: legacy console [tty0] enabled709lb # [ 0.230954] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64710client # [ 0.225394] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'711worker1 # [ 0.104522] printk: legacy console [ttyS0] enabled712lb # [ 0.231954] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512713worker1 # [ 0.200170] ACPI: Core revision 20250807714client # [ 0.226394] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'715lb # [ 0.232954] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024716client # [ 0.227394] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'717worker1 # [ 0.201060] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns718lb # [ 0.233954] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8719client # [ 0.228394] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'720worker1 # [ 0.202551] APIC: Switch to symmetric I/O mode setup721worker1 # [ 0.203498] x2apic enabled722lb # [ 0.234954] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.723client # [ 0.229394] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'724worker1 # [ 0.204239] APIC: Switched APIC routing to: physical x2apic725client # [ 0.230394] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256726client # [ 0.232162] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64727worker1 # [ 0.206039] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1728client # [ 0.233185] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512729client # [ 0.234152] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024730worker1 # [ 0.206992] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns731client # [ 0.235147] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8732worker1 # [ 0.208605] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)733client # [ 0.236174] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.734worker1 # [ 0.209691] x86/cpu: User Mode Instruction Prevention (UMIP) activated735worker1 # [ 0.210742] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127736worker1 # [ 0.211602] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0737worker1 # [ 0.212606] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto738worker1 # [ 0.213602] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl739worker1 # [ 0.214602] Transient Scheduler Attacks: Vulnerable: No microcode740worker1 # [ 0.215601] Spectre V2 : Mitigation: Enhanced / Automatic IBRS741worker1 # [ 0.216602] Speculative Return Stack Overflow: Mitigation: Safe RET742worker1 # [ 0.217601] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization743worker1 # [ 0.219609] Spectre V2 : Enabling IBPB for BPF744worker1 # [ 0.220328] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745worker1 # [ 0.221602] active return thunk: srso_alias_return_thunk746worker1 # [ 0.222622] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747worker1 # [ 0.223601] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748worker1 # [ 0.224601] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749worker1 # [ 0.225601] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750worker1 # [ 0.226601] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker1 # [ 0.227601] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752worker2 # [ 0.266459] Freeing SMP alternatives memory: 44K753worker1 # [ 0.228601] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'754worker2 # [ 0.267270] pid_max: default: 32768 minimum: 301755worker1 # [ 0.229602] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256756worker2 # [ 0.268084] LSM: initializing lsm=capability,landlock,yama,bpf,ima757worker1 # [ 0.230601] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64758worker2 # [ 0.268546] landlock: Up and running.759worker2 # [ 0.269895] Yama: becoming mindful.760worker1 # [ 0.231601] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512761worker2 # [ 0.270656] LSM support for eBPF active762worker1 # [ 0.232601] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024763worker1 # [ 0.233601] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8764worker2 # [ 0.271536] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)765lb # [ 0.269830] Freeing SMP alternatives memory: 44K766lb # [ 0.270505] pid_max: default: 32768 minimum: 301767worker2 # [ 0.272474] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)768worker1 # [ 0.234601] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.769lb # [ 0.271064] LSM: initializing lsm=capability,landlock,yama,bpf,ima770lb # [ 0.272064] landlock: Up and running.771lb # [ 0.272955] Yama: becoming mindful.772worker2 # [ 0.275095] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)773lb # [ 0.273991] LSM support for eBPF active774worker2 # [ 0.275979] Performance Events: Fam17h+ core perfctr, AMD PMU driver.775lb # [ 0.274771] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)776worker2 # [ 0.276441] ... version: 2777lb # [ 0.275995] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)778worker2 # [ 0.277173] ... bit width: 48779worker2 # [ 0.277439] ... generic counters: 6780worker2 # [ 0.278194] ... generic bitmap: 000000000000003f781client # [ 0.273355] Freeing SMP alternatives memory: 44K782worker2 # [ 0.278486] ... fixed-purpose counters: 0783lb # [ 0.278650] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)784client # [ 0.273968] pid_max: default: 32768 minimum: 301785worker2 # [ 0.279171] ... fixed-purpose bitmap: 0000000000000000786client # [ 0.275047] LSM: initializing lsm=capability,landlock,yama,bpf,ima787worker2 # [ 0.279439] ... value mask: 0000ffffffffffff788lb # [ 0.279566] Performance Events: Fam17h+ core perfctr, AMD PMU driver.789lb # [ 0.279959] ... version: 2790client # [ 0.275503] landlock: Up and running.791worker2 # [ 0.280325] ... max period: 00007fffffffffff792client # [ 0.276394] Yama: becoming mindful.793lb # [ 0.280641] ... bit width: 48794worker2 # [ 0.281111] ... global_ctrl mask: 000000000000003f795lb # [ 0.280957] ... generic counters: 6796client # [ 0.277613] LSM support for eBPF active797worker2 # [ 0.281559] signal: max sigframe size: 3376798lb # [ 0.281656] ... generic bitmap: 000000000000003f799worker2 # [ 0.282387] rcu: Hierarchical SRCU implementation.800client # [ 0.278358] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)801lb # [ 0.281968] ... fixed-purpose counters: 0802worker2 # [ 0.283019] rcu: Max phase no-delay instances is 400.803lb # [ 0.282659] ... fixed-purpose bitmap: 0000000000000000804client # [ 0.279435] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)805lb # [ 0.282957] ... value mask: 0000ffffffffffff806lb # [ 0.283840] ... max period: 00007fffffffffff807lb # [ 0.284637] ... global_ctrl mask: 000000000000003f808client # [ 0.281954] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)809lb # [ 0.285071] signal: max sigframe size: 3376810client # [ 0.282966] Performance Events: Fam17h+ core perfctr, AMD PMU driver.811lb # [ 0.285898] rcu: Hierarchical SRCU implementation.812client # [ 0.283399] ... version: 2813worker2 # [ 0.288005] smp: Bringing up secondary CPUs ...814lb # [ 0.286540] rcu: Max phase no-delay instances is 400.815worker2 # [ 0.288453] smp: Brought up 1 node, 1 CPU816client # [ 0.284095] ... bit width: 48817client # [ 0.284396] ... generic counters: 6818worker2 # [ 0.289106] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)819client # [ 0.285076] ... generic bitmap: 000000000000003f820client # [ 0.285449] ... fixed-purpose counters: 0821client # [ 0.286153] ... fixed-purpose bitmap: 0000000000000000822worker2 # [ 0.289617] Memory: 1454592K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)823client # [ 0.286396] ... value mask: 0000ffffffffffff824worker2 # [ 0.290666] devtmpfs: initialized825lb # [ 0.291507] smp: Bringing up secondary CPUs ...826client # [ 0.287278] ... max period: 00007fffffffffff827worker2 # [ 0.291410] x86/mm: Memory block size: 128MB828lb # [ 0.291971] smp: Brought up 1 node, 1 CPU829client # [ 0.288055] ... global_ctrl mask: 000000000000003f830lb # [ 0.292639] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)831client # [ 0.288525] signal: max sigframe size: 3376832worker2 # [ 0.293007] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)833client # [ 0.289348] rcu: Hierarchical SRCU implementation.834client # [ 0.289950] rcu: Max phase no-delay instances is 400.835lb # [ 0.293115] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)836worker2 # [ 0.293468] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).837lb # [ 0.294241] devtmpfs: initialized838worker2 # [ 0.294513] pinctrl core: initialized pinctrl subsystem839lb # [ 0.295053] x86/mm: Memory block size: 128MB840worker2 # [ 0.295626] PM: RTC time: 09:32:07, date: 2026-09-20841lb # [ 0.296835] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)842client # [ 0.294870] smp: Bringing up secondary CPUs ...843lb # [ 0.297865] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).844worker1 # [ 0.269913] Freeing SMP alternatives memory: 44K845client # [ 0.295409] smp: Brought up 1 node, 1 CPU846worker2 # [ 0.299210] NET: Registered PF_NETLINK/PF_ROUTE protocol family847worker1 # [ 0.270606] pid_max: default: 32768 minimum: 301848lb # [ 0.299038] pinctrl core: initialized pinctrl subsystem849client # [ 0.296072] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)850worker1 # [ 0.271414] LSM: initializing lsm=capability,landlock,yama,bpf,ima851worker2 # [ 0.299932] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations852lb # [ 0.300134] PM: RTC time: 09:32:07, date: 2026-09-20853worker1 # [ 0.272409] landlock: Up and running.854worker1 # [ 0.273029] Yama: becoming mindful.855worker2 # [ 0.300460] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations856client # [ 0.296577] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)857worker1 # [ 0.273833] LSM support for eBPF active858client # [ 0.297663] devtmpfs: initialized859worker2 # [ 0.301722] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations860worker1 # [ 0.274733] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)861client # [ 0.298532] x86/mm: Memory block size: 128MB862worker2 # [ 0.302449] audit: initializing netlink subsys (disabled)863lb # [ 0.303762] NET: Registered PF_NETLINK/PF_ROUTE protocol family864worker1 # [ 0.275643] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)865worker2 # [ 0.303440] audit: type=2000 audit(1789896728.422:1): state=initialized audit_enabled=0 res=1866lb # [ 0.305159] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations867client # [ 0.300298] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)868worker2 # [ 0.304598] thermal_sys: Registered thermal governor 'fair_share'869lb # [ 0.305987] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations870client # [ 0.301284] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).871worker1 # [ 0.278281] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)872worker2 # [ 0.304600] thermal_sys: Registered thermal governor 'bang_bang'873client # [ 0.302491] pinctrl core: initialized pinctrl subsystem874lb # [ 0.307248] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations875worker2 # [ 0.305440] thermal_sys: Registered thermal governor 'step_wise'876worker1 # [ 0.279168] Performance Events: Fam17h+ core perfctr, AMD PMU driver.877lb # [ 0.307968] audit: initializing netlink subsys (disabled)878client # [ 0.303678] PM: RTC time: 09:32:07, date: 2026-09-20879worker2 # [ 0.306376] thermal_sys: Registered thermal governor 'user_space'880worker1 # [ 0.279606] ... version: 2881worker1 # [ 0.280286] ... bit width: 48882worker2 # [ 0.307146] thermal_sys: Registered thermal governor 'power_allocator'883lb # [ 0.309064] thermal_sys: Registered thermal governor 'fair_share'884worker1 # [ 0.280604] ... generic counters: 6885worker2 # [ 0.307452] cpuidle: using governor menu886lb # [ 0.309066] thermal_sys: Registered thermal governor 'bang_bang'887worker1 # [ 0.281282] ... generic bitmap: 000000000000003f888lb # [ 0.309958] thermal_sys: Registered thermal governor 'step_wise'889worker1 # [ 0.281615] ... fixed-purpose counters: 0890worker2 # [ 0.309650] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5891lb # [ 0.310894] thermal_sys: Registered thermal governor 'user_space'892client # [ 0.307484] NET: Registered PF_NETLINK/PF_ROUTE protocol family893worker1 # [ 0.282294] ... fixed-purpose bitmap: 0000000000000000894worker1 # [ 0.282603] ... value mask: 0000ffffffffffff895worker2 # [ 0.310678] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]896lb # [ 0.311674] audit: type=2000 audit(1789896728.430:1): state=initialized audit_enabled=0 res=1897client # [ 0.308897] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations898worker1 # [ 0.283438] ... max period: 00007fffffffffff899worker2 # [ 0.311442] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry900lb # [ 0.312960] thermal_sys: Registered thermal governor 'power_allocator'901worker1 # [ 0.284239] ... global_ctrl mask: 000000000000003f902client # [ 0.309421] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations903worker2 # [ 0.312450] PCI: Using configuration type 1 for base access904lb # [ 0.312973] cpuidle: using governor menu905worker1 # [ 0.284716] signal: max sigframe size: 3376906worker1 # [ 0.285528] rcu: Hierarchical SRCU implementation.907client # [ 0.310687] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations908lb # [ 0.315152] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5909worker2 # [ 0.313520] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.910worker1 # [ 0.286171] rcu: Max phase no-delay instances is 400.911client # [ 0.311407] audit: initializing netlink subsys (disabled)912lb # [ 0.316201] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]913client # [ 0.312398] audit: type=2000 audit(1789896728.439:1): state=initialized audit_enabled=0 res=1914lb # [ 0.316960] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry915client # [ 0.313587] thermal_sys: Registered thermal governor 'fair_share'916lb # [ 0.317969] PCI: Using configuration type 1 for base access917client # [ 0.313589] thermal_sys: Registered thermal governor 'bang_bang'918lb # [ 0.319075] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.919client # [ 0.314397] thermal_sys: Registered thermal governor 'step_wise'920worker1 # [ 0.291142] smp: Bringing up secondary CPUs ...921client # [ 0.315334] thermal_sys: Registered thermal governor 'user_space'922worker1 # [ 0.291618] smp: Brought up 1 node, 1 CPU923client # [ 0.316092] thermal_sys: Registered thermal governor 'power_allocator'924worker2 # [ 0.320457] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages925worker1 # [ 0.292273] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)926client # [ 0.316409] cpuidle: using governor menu927worker2 # [ 0.321440] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page928client # [ 0.318415] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5929worker1 # [ 0.292806] Memory: 1454608K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)930worker1 # [ 0.293876] devtmpfs: initialized931client # [ 0.319634] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]932worker1 # [ 0.294641] x86/mm: Memory block size: 128MB933client # [ 0.320399] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry934lb # [ 0.326221] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages935client # [ 0.321407] PCI: Using configuration type 1 for base access936worker2 # [ 0.326440] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages937lb # [ 0.326958] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page938worker1 # [ 0.296378] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)939worker2 # [ 0.327439] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page940client # [ 0.322477] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.941worker1 # [ 0.297471] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).942worker1 # [ 0.298702] pinctrl core: initialized pinctrl subsystem943worker1 # [ 0.299795] PM: RTC time: 09:32:07, date: 2026-09-20944lb # [ 0.331958] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages945lb # [ 0.332957] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page946worker1 # [ 0.303520] NET: Registered PF_NETLINK/PF_ROUTE protocol family947client # [ 0.329414] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages948client # [ 0.330397] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page949worker1 # [ 0.304827] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations950worker1 # [ 0.305628] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations951worker1 # [ 0.306895] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations952worker2 # [ 0.338693] ACPI: Added _OSI(Module Device)953worker2 # [ 0.339409] ACPI: Added _OSI(Processor Device)954worker1 # [ 0.307614] audit: initializing netlink subsys (disabled)955worker2 # [ 0.339966] ACPI: Added _OSI(Processor Aggregator Device)956worker1 # [ 0.308738] thermal_sys: Registered thermal governor 'fair_share'957client # [ 0.335397] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages958lb # [ 0.341636] ACPI: Added _OSI(Module Device)959worker1 # [ 0.308740] thermal_sys: Registered thermal governor 'bang_bang'960client # [ 0.336396] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page961lb # [ 0.341958] ACPI: Added _OSI(Processor Device)962worker1 # [ 0.309605] thermal_sys: Registered thermal governor 'step_wise'963lb # [ 0.342690] ACPI: Added _OSI(Processor Aggregator Device)964worker1 # [ 0.310517] thermal_sys: Registered thermal governor 'user_space'965worker1 # [ 0.311304] audit: type=2000 audit(1789896728.466:1): state=initialized audit_enabled=0 res=1966worker1 # [ 0.312607] thermal_sys: Registered thermal governor 'power_allocator'967worker1 # [ 0.312620] cpuidle: using governor menu968worker2 # [ 0.345848] ACPI: 1 ACPI AML tables successfully acquired and loaded969worker1 # [ 0.314808] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5970worker1 # [ 0.315821] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]971lb # [ 0.349530] ACPI: 1 ACPI AML tables successfully acquired and loaded972worker1 # [ 0.316607] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry973worker2 # [ 0.349847] ACPI: Interpreter enabled974worker1 # [ 0.317616] PCI: Using configuration type 1 for base access975worker2 # [ 0.350454] ACPI: PM: (supports S0 S3 S4 S5)976worker2 # [ 0.351192] ACPI: Using IOAPIC for interrupt routing977client # [ 0.347676] ACPI: Added _OSI(Module Device)978worker1 # [ 0.318668] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.979client # [ 0.348390] ACPI: Added _OSI(Processor Device)980lb # [ 0.352877] ACPI: Interpreter enabled981client # [ 0.349122] ACPI: Added _OSI(Processor Aggregator Device)982lb # [ 0.353423] ACPI: PM: (supports S0 S3 S4 S5)983lb # [ 0.353957] ACPI: Using IOAPIC for interrupt routing984worker2 # [ 0.353501] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug985lb # [ 0.354795] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug986worker2 # [ 0.354440] PCI: Using E820 reservations for host bridge windows987worker2 # [ 0.357559] ACPI: Enabled 2 GPEs in block 00 to 3F988worker1 # [ 0.325872] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages989client # [ 0.354934] ACPI: 1 ACPI AML tables successfully acquired and loaded990worker1 # [ 0.326606] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page991lb # [ 0.359958] PCI: Using E820 reservations for host bridge windows992lb # [ 0.361051] ACPI: Enabled 2 GPEs in block 00 to 3F993client # [ 0.358799] ACPI: Interpreter enabled994client # [ 0.359412] ACPI: PM: (supports S0 S3 S4 S5)995worker1 # [ 0.331605] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages996client # [ 0.360119] ACPI: Using IOAPIC for interrupt routing997worker1 # [ 0.332605] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page998worker2 # [ 0.364972] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])999worker2 # [ 0.365445] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1000client # [ 0.362432] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1001worker2 # [ 0.366517] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1002client # [ 0.363397] PCI: Using E820 reservations for host bridge windows1003worker2 # [ 0.367561] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1004lb # [ 0.369711] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1005worker2 # [ 0.368797] PCI host bridge to bus 0000:001006lb # [ 0.370577] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1007worker2 # [ 0.369444] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1008client # [ 0.366476] ACPI: Enabled 2 GPEs in block 00 to 3F1009worker2 # [ 0.370439] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1010lb # [ 0.371046] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1011worker1 # [ 0.341250] ACPI: Added _OSI(Module Device)1012worker2 # [ 0.371439] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1013lb # [ 0.372082] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1014worker1 # [ 0.341606] ACPI: Added _OSI(Processor Device)1015lb # [ 0.373322] PCI host bridge to bus 0000:001016worker2 # [ 0.372439] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1017worker1 # [ 0.342308] ACPI: Added _OSI(Processor Aggregator Device)1018lb # [ 0.373962] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1019worker2 # [ 0.373440] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1020lb # [ 0.374957] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1021worker2 # [ 0.374439] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1022lb # [ 0.375957] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1023worker2 # [ 0.375439] pci_bus 0000:00: root bus resource [bus 00-ff]1024client # [ 0.373868] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1025lb # [ 0.376957] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1026worker2 # [ 0.376456] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1027lb # [ 0.377957] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1028client # [ 0.374402] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1029worker2 # [ 0.377902] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1030lb # [ 0.378957] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1031client # [ 0.375475] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1032worker1 # [ 0.349206] ACPI: 1 ACPI AML tables successfully acquired and loaded1033lb # [ 0.379958] pci_bus 0000:00: root bus resource [bus 00-ff]1034client # [ 0.376519] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1035lb # [ 0.380960] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1036client # [ 0.377744] PCI host bridge to bus 0000:001037client # [ 0.378401] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1038lb # [ 0.382410] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1039worker1 # [ 0.352526] ACPI: Interpreter enabled1040client # [ 0.379396] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1041worker1 # [ 0.353045] ACPI: PM: (supports S0 S3 S4 S5)1042client # [ 0.380396] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1043worker1 # [ 0.353605] ACPI: Using IOAPIC for interrupt routing1044client # [ 0.381396] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1045worker1 # [ 0.354442] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1046client # [ 0.382396] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1047worker2 # [ 0.380521] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1048client # [ 0.383396] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1049worker2 # [ 0.381451] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1050client # [ 0.384397] pci_bus 0000:00: root bus resource [bus 00-ff]1051worker2 # [ 0.382438] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1052client # [ 0.385368] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1053worker1 # [ 0.359605] PCI: Using E820 reservations for host bridge windows1054worker2 # [ 0.383611] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1055lb # [ 0.385091] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1056worker1 # [ 0.360666] ACPI: Enabled 2 GPEs in block 00 to 3F1057client # [ 0.386801] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1058lb # [ 0.385969] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1059worker2 # [ 0.385143] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1060lb # [ 0.386924] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1061lb # [ 0.388013] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1062worker2 # [ 0.388489] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1063lb # [ 0.389771] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1064worker2 # [ 0.389395] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1065worker2 # [ 0.390195] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1066worker2 # [ 0.390445] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1067lb # [ 0.391966] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1068worker1 # [ 0.369321] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1069client # [ 0.389579] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1070lb # [ 0.392810] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1071worker2 # [ 0.392148] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1072client # [ 0.390409] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1073lb # [ 0.393745] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1074worker1 # [ 0.370173] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1075client # [ 0.391346] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1076lb # [ 0.394767] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1077worker1 # [ 0.370682] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1078worker2 # [ 0.394475] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1079worker1 # [ 0.371727] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1080client # [ 0.392762] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1081worker2 # [ 0.395333] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1082lb # [ 0.396506] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1083worker1 # [ 0.372964] PCI host bridge to bus 0000:001084worker2 # [ 0.396177] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1085worker1 # [ 0.373608] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1086client # [ 0.394128] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1087lb # [ 0.397965] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1088worker1 # [ 0.374605] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1089worker2 # [ 0.397004] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1090lb # [ 0.398802] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1091worker1 # [ 0.375604] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1092lb # [ 0.399687] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1093client # [ 0.397429] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1094worker1 # [ 0.376604] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1095client # [ 0.398287] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1096worker1 # [ 0.377604] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1097lb # [ 0.400575] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1098worker2 # [ 0.399473] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1099client # [ 0.399129] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1100worker1 # [ 0.378604] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1101worker2 # [ 0.400318] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1102worker1 # [ 0.379605] pci_bus 0000:00: root bus resource [bus 00-ff]1103client # [ 0.399403] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1104worker2 # [ 0.401179] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1105worker1 # [ 0.380514] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1106client # [ 0.400994] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1107worker2 # [ 0.401993] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1108lb # [ 0.403103] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1109worker1 # [ 0.382044] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1110lb # [ 0.403963] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1111lb # [ 0.404914] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1112client # [ 0.402428] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1113worker2 # [ 0.403474] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1114client # [ 0.403275] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1115worker2 # [ 0.404349] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1116lb # [ 0.406331] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117client # [ 0.404134] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1118worker2 # [ 0.405197] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1119lb # [ 0.407973] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1120client # [ 0.404939] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1121lb # [ 0.408814] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1122worker2 # [ 0.405975] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1123lb # [ 0.409705] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1124worker2 # [ 0.407446] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1125worker1 # [ 0.384668] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1126client # [ 0.407424] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1127worker2 # [ 0.408318] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1128lb # [ 0.410513] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1129worker1 # [ 0.385616] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1130client # [ 0.408291] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1131worker2 # [ 0.409158] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1132worker1 # [ 0.386530] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1133client # [ 0.409130] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1134lb # [ 0.411964] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1135worker2 # [ 0.410019] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1136worker1 # [ 0.387866] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1137lb # [ 0.412814] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1138client # [ 0.409945] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1139lb # [ 0.413675] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1140worker1 # [ 0.389396] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1141client # [ 0.412351] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1142lb # [ 0.414538] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1143worker2 # [ 0.412704] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1144client # [ 0.413016] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1145worker2 # [ 0.413446] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1146worker1 # [ 0.392638] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1147client # [ 0.413418] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1148worker2 # [ 0.414439] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1149lb # [ 0.416958] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1150worker1 # [ 0.393485] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1151worker1 # [ 0.394305] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1152lb # [ 0.417782] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1153client # [ 0.414967] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1154worker2 # [ 0.416038] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1155worker1 # [ 0.394629] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1156lb # [ 0.418660] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1157worker2 # [ 0.417469] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1158client # [ 0.416422] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1159lb # [ 0.419545] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1160worker1 # [ 0.396678] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1161client # [ 0.417233] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1162worker2 # [ 0.418285] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1163client # [ 0.418103] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1164worker2 # [ 0.419167] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1165lb # [ 0.420965] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1166lb # [ 0.421809] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1167worker1 # [ 0.398638] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1168worker2 # [ 0.419445] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1169client # [ 0.419017] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1170worker1 # [ 0.399484] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1171lb # [ 0.422684] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1172lb # [ 0.422963] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1173worker1 # [ 0.400331] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1174worker2 # [ 0.420977] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1175worker1 # [ 0.401160] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1176worker2 # [ 0.422440] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1177lb # [ 0.424469] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1178client # [ 0.421740] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1179worker2 # [ 0.423461] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1180client # [ 0.423034] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1181lb # [ 0.425761] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1182client # [ 0.423418] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1183worker2 # [ 0.424967] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1184lb # [ 0.426725] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1185worker1 # [ 0.403611] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1186worker1 # [ 0.404436] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1187client # [ 0.424986] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1188lb # [ 0.427504] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1189worker1 # [ 0.405335] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1190worker2 # [ 0.427183] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1191worker2 # [ 0.427446] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1192client # [ 0.426403] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1193lb # [ 0.428965] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1194worker1 # [ 0.406179] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1195client # [ 0.427249] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1196worker2 # [ 0.428461] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1197lb # [ 0.429779] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1198client # [ 0.428141] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1199lb # [ 0.430694] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1200worker2 # [ 0.429975] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1201worker1 # [ 0.407635] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1202client # [ 0.428403] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1203worker1 # [ 0.408463] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1204lb # [ 0.431494] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1205worker2 # [ 0.431446] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1206client # [ 0.430246] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1207worker1 # [ 0.409339] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1208worker2 # [ 0.432319] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1209lb # [ 0.433964] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1210worker2 # [ 0.433204] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1211lb # [ 0.434818] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1212client # [ 0.432397] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1213worker1 # [ 0.410178] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1214lb # [ 0.435652] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1215client # [ 0.433346] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1216worker2 # [ 0.434019] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1217worker1 # [ 0.411637] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1218lb # [ 0.436533] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1219client # [ 0.434760] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1220worker1 # [ 0.412496] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1221worker2 # [ 0.435466] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1222lb # [ 0.437553] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1223worker1 # [ 0.413339] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1224worker2 # [ 0.436527] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1225client # [ 0.436436] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1226lb # [ 0.438165] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1227worker1 # [ 0.414170] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1228worker2 # [ 0.438032] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1229client # [ 0.437286] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1230lb # [ 0.439985] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1231client # [ 0.438419] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1232client # [ 0.439958] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1233worker1 # [ 0.416641] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1234worker1 # [ 0.417611] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1235client # [ 0.441404] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1236worker1 # [ 0.418569] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1237client # [ 0.442330] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1238worker1 # [ 0.420042] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1239client # [ 0.443172] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1240client # [ 0.444780] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1241worker1 # [ 0.421612] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1242worker1 # [ 0.422435] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1243client # [ 0.446402] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1244worker1 # [ 0.423354] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1245worker2 # [ 0.438627] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1246client # [ 0.447447] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1247lb # [ 0.441013] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1248worker1 # [ 0.423610] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1249worker2 # [ 0.441109] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1250client # [ 0.449063] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1251lb # [ 0.443512] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1252worker1 # [ 0.425163] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1253worker2 # [ 0.441706] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1254lb # [ 0.444211] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1255worker1 # [ 0.426611] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1256worker2 # [ 0.443301] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1257lb # [ 0.445480] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1258worker1 # [ 0.427559] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1259worker2 # [ 0.444465] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1260lb # [ 0.446215] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1261worker1 # [ 0.428964] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1262worker2 # [ 0.445731] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1263lb # [ 0.447247] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1264worker2 # [ 0.446688] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1265lb # [ 0.448229] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1266worker1 # [ 0.431386] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1267worker2 # [ 0.448419] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1268worker1 # [ 0.431612] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1269lb # [ 0.449834] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1270worker2 # [ 0.449142] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1271lb # [ 0.450638] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1272worker1 # [ 0.432627] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1273worker2 # [ 0.449760] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1274lb # [ 0.451280] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1275client # [ 0.449589] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1276worker1 # [ 0.434145] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1277lb # [ 0.452556] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1278worker2 # [ 0.451080] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1279client # [ 0.452092] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1280worker1 # [ 0.435612] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1281client # [ 0.452698] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1282worker1 # [ 0.436471] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1283worker1 # [ 0.437338] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1284client # [ 0.454040] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1285worker2 # [ 0.454421] ACPI: PCI: Interrupt link LNKA configured for IRQ 101286lb # [ 0.456290] ACPI: PCI: Interrupt link LNKA configured for IRQ 101287worker1 # [ 0.438188] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1288worker2 # [ 0.455274] ACPI: PCI: Interrupt link LNKB configured for IRQ 101289lb # [ 0.457061] ACPI: PCI: Interrupt link LNKB configured for IRQ 101290client # [ 0.455367] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1291worker2 # [ 0.456264] ACPI: PCI: Interrupt link LNKC configured for IRQ 111292lb # [ 0.458058] ACPI: PCI: Interrupt link LNKC configured for IRQ 111293client # [ 0.456660] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1294worker2 # [ 0.457290] ACPI: PCI: Interrupt link LNKD configured for IRQ 111295worker1 # [ 0.440024] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1296lb # [ 0.459057] ACPI: PCI: Interrupt link LNKD configured for IRQ 111297worker2 # [ 0.458222] ACPI: PCI: Interrupt link LNKE configured for IRQ 101298lb # [ 0.460054] ACPI: PCI: Interrupt link LNKE configured for IRQ 101299client # [ 0.457639] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1300worker1 # [ 0.440813] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1301worker2 # [ 0.459368] ACPI: PCI: Interrupt link LNKF configured for IRQ 101302lb # [ 0.461057] ACPI: PCI: Interrupt link LNKF configured for IRQ 101303worker1 # [ 0.442251] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1304client # [ 0.459413] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1305worker2 # [ 0.460288] ACPI: PCI: Interrupt link LNKG configured for IRQ 111306lb # [ 0.462057] ACPI: PCI: Interrupt link LNKG configured for IRQ 111307client # [ 0.460268] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1308worker2 # [ 0.461261] ACPI: PCI: Interrupt link LNKH configured for IRQ 111309lb # [ 0.463059] ACPI: PCI: Interrupt link LNKH configured for IRQ 111310worker2 # [ 0.462203] ACPI: PCI: Interrupt link GSIA configured for IRQ 161311lb # [ 0.464002] ACPI: PCI: Interrupt link GSIA configured for IRQ 161312client # [ 0.461423] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1313worker2 # [ 0.462451] ACPI: PCI: Interrupt link GSIB configured for IRQ 171314lb # [ 0.464973] ACPI: PCI: Interrupt link GSIB configured for IRQ 171315worker2 # [ 0.463432] ACPI: PCI: Interrupt link GSIC configured for IRQ 181316client # [ 0.463418] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1317lb # [ 0.465976] ACPI: PCI: Interrupt link GSIC configured for IRQ 181318worker2 # [ 0.464391] ACPI: PCI: Interrupt link GSID configured for IRQ 191319lb # [ 0.466960] ACPI: PCI: Interrupt link GSID configured for IRQ 191320worker2 # [ 0.465171] ACPI: PCI: Interrupt link GSIE configured for IRQ 201321lb # [ 0.467956] ACPI: PCI: Interrupt link GSIE configured for IRQ 201322worker2 # [ 0.465451] ACPI: PCI: Interrupt link GSIF configured for IRQ 211323lb # [ 0.468926] ACPI: PCI: Interrupt link GSIF configured for IRQ 211324worker2 # [ 0.466451] ACPI: PCI: Interrupt link GSIG configured for IRQ 221325lb # [ 0.469704] ACPI: PCI: Interrupt link GSIG configured for IRQ 221326client # [ 0.467244] ACPI: PCI: Interrupt link LNKA configured for IRQ 101327worker2 # [ 0.467454] ACPI: PCI: Interrupt link GSIH configured for IRQ 231328lb # [ 0.469973] ACPI: PCI: Interrupt link GSIH configured for IRQ 231329client # [ 0.468223] ACPI: PCI: Interrupt link LNKB configured for IRQ 101330client # [ 0.469214] ACPI: PCI: Interrupt link LNKC configured for IRQ 111331worker2 # [ 0.469416] iommu: Default domain type: Translated1332lb # [ 0.472233] iommu: Default domain type: Translated1333client # [ 0.470220] ACPI: PCI: Interrupt link LNKD configured for IRQ 111334worker2 # [ 0.470052] iommu: DMA domain TLB invalidation policy: lazy mode1335lb # [ 0.472965] iommu: DMA domain TLB invalidation policy: lazy mode1336worker1 # [ 0.442849] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1337client # [ 0.471214] ACPI: PCI: Interrupt link LNKE configured for IRQ 101338worker2 # [ 0.470690] ACPI: bus type USB registered1339lb # [ 0.474172] ACPI: bus type USB registered1340worker2 # [ 0.471391] usbcore: registered new interface driver usbfs1341client # [ 0.472228] ACPI: PCI: Interrupt link LNKF configured for IRQ 101342worker1 # [ 0.445247] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1343lb # [ 0.474935] usbcore: registered new interface driver usbfs1344worker2 # [ 0.472137] usbcore: registered new interface driver hub1345client # [ 0.473338] ACPI: PCI: Interrupt link LNKG configured for IRQ 111346lb # [ 0.475623] usbcore: registered new interface driver hub1347worker2 # [ 0.472457] usbcore: registered new device driver usb1348worker1 # [ 0.445858] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1349client # [ 0.474210] ACPI: PCI: Interrupt link LNKH configured for IRQ 111350lb # [ 0.475967] usbcore: registered new device driver usb1351worker2 # [ 0.474110] NetLabel: Initializing1352client # [ 0.475128] ACPI: PCI: Interrupt link GSIA configured for IRQ 161353lb # [ 0.477670] NetLabel: Initializing1354worker1 # [ 0.447266] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1355worker2 # [ 0.474445] NetLabel: domain hash size = 1281356client # [ 0.475412] ACPI: PCI: Interrupt link GSIB configured for IRQ 171357lb # [ 0.477965] NetLabel: domain hash size = 1281358worker2 # [ 0.475156] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1359client # [ 0.476319] ACPI: PCI: Interrupt link GSIC configured for IRQ 181360lb # [ 0.478699] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1361worker1 # [ 0.448572] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1362worker2 # [ 0.475477] NetLabel: unlabeled traffic allowed by default1363client # [ 0.477095] ACPI: PCI: Interrupt link GSID configured for IRQ 191364lb # [ 0.478996] NetLabel: unlabeled traffic allowed by default1365worker2 # [ 0.476451] PCI: Using ACPI for IRQ routing1366client # [ 0.477409] ACPI: PCI: Interrupt link GSIE configured for IRQ 201367lb # [ 0.479879] PCI: Using ACPI for IRQ routing1368worker1 # [ 0.449854] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1369client # [ 0.478369] ACPI: PCI: Interrupt link GSIF configured for IRQ 211370worker1 # [ 0.450856] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1371client # [ 0.479135] ACPI: PCI: Interrupt link GSIG configured for IRQ 221372client # [ 0.479415] ACPI: PCI: Interrupt link GSIH configured for IRQ 231373worker1 # [ 0.452620] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1374worker1 # [ 0.453478] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1375client # [ 0.481453] iommu: Default domain type: Translated1376client # [ 0.482248] iommu: DMA domain TLB invalidation policy: lazy mode1377worker1 # [ 0.454644] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1378client # [ 0.483406] ACPI: bus type USB registered1379client # [ 0.484162] usbcore: registered new interface driver usbfs1380worker1 # [ 0.456632] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1381client # [ 0.484409] usbcore: registered new interface driver hub1382client # [ 0.485262] usbcore: registered new device driver usb1383client # [ 0.486932] NetLabel: Initializing1384client # [ 0.487398] NetLabel: domain hash size = 1281385worker1 # [ 0.460428] ACPI: PCI: Interrupt link LNKA configured for IRQ 101386client # [ 0.488118] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1387worker1 # [ 0.461443] ACPI: PCI: Interrupt link LNKB configured for IRQ 101388client # [ 0.488433] NetLabel: unlabeled traffic allowed by default1389worker1 # [ 0.462426] ACPI: PCI: Interrupt link LNKC configured for IRQ 111390client # [ 0.489408] PCI: Using ACPI for IRQ routing1391worker1 # [ 0.463431] ACPI: PCI: Interrupt link LNKD configured for IRQ 111392worker1 # [ 0.464425] ACPI: PCI: Interrupt link LNKE configured for IRQ 101393worker1 # [ 0.465433] ACPI: PCI: Interrupt link LNKF configured for IRQ 101394worker1 # [ 0.466589] ACPI: PCI: Interrupt link LNKG configured for IRQ 111395worker1 # [ 0.467412] ACPI: PCI: Interrupt link LNKH configured for IRQ 111396worker1 # [ 0.468360] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397worker1 # [ 0.468619] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398worker1 # [ 0.469552] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399worker1 # [ 0.470315] ACPI: PCI: Interrupt link GSID configured for IRQ 191400worker1 # [ 0.470619] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401worker1 # [ 0.471565] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402worker1 # [ 0.472341] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403worker1 # [ 0.472616] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404worker1 # [ 0.474683] iommu: Default domain type: Translated1405worker1 # [ 0.475569] iommu: DMA domain TLB invalidation policy: lazy mode1406worker1 # [ 0.476900] ACPI: bus type USB registered1407worker1 # [ 0.477664] usbcore: registered new interface driver usbfs1408worker1 # [ 0.478595] usbcore: registered new interface driver hub1409worker1 # [ 0.479227] usbcore: registered new device driver usb1410worker1 # [ 0.480557] NetLabel: Initializing1411worker1 # [ 0.481046] NetLabel: domain hash size = 1281412worker1 # [ 0.481604] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker1 # [ 0.482519] NetLabel: unlabeled traffic allowed by default1414worker1 # [ 0.483267] PCI: Using ACPI for IRQ routing1415lb # [ 0.524614] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker2 # [ 0.520913] pci 0000:00:01.0: vgaarb: setting as boot VGA device1417lb # [ 0.524953] pci 0000:00:01.0: vgaarb: bridge control possible1418worker2 # [ 0.521435] pci 0000:00:01.0: vgaarb: bridge control possible1419lb # [ 0.524953] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1420worker2 # [ 0.521435] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1421lb # [ 0.524963] vgaarb: loaded1422worker2 # [ 0.521444] vgaarb: loaded1423lb # [ 0.525722] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01424worker2 # [ 0.522190] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01425lb # [ 0.525958] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1426worker2 # [ 0.522439] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1427lb # [ 0.530047] clocksource: Switched to clocksource kvm-clock1428worker2 # [ 0.526525] clocksource: Switched to clocksource kvm-clock1429lb # [ 0.533592] VFS: Disk quotas dquot_6.6.01430worker2 # [ 0.530021] VFS: Disk quotas dquot_6.6.01431lb # [ 0.534308] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1432client # [ 0.534660] pci 0000:00:01.0: vgaarb: setting as boot VGA device1433worker2 # [ 0.530762] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1434lb # [ 0.535681] pnp: PnP ACPI init1435client # [ 0.535392] pci 0000:00:01.0: vgaarb: bridge control possible1436worker2 # [ 0.532107] pnp: PnP ACPI init1437lb # [ 0.536457] ACPI: IRQ 4 override to edge(!), high(!)1438worker2 # [ 0.532899] ACPI: IRQ 4 override to edge(!), high(!)1439client # [ 0.535392] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1440client # [ 0.535401] vgaarb: loaded1441lb # [ 0.537487] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1442worker2 # [ 0.533915] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1443client # [ 0.536106] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01444lb # [ 0.539020] pnp: PnP ACPI: found 6 devices1445worker2 # [ 0.535456] pnp: PnP ACPI: found 6 devices1446client # [ 0.536397] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1447client # [ 0.539490] clocksource: Switched to clocksource kvm-clock1448lb # [ 0.546645] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1449client # [ 0.543347] VFS: Disk quotas dquot_6.6.01450worker2 # [ 0.543104] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1451lb # [ 0.548105] clocksource: Switched to clocksource acpi_pm1452worker2 # [ 0.544530] clocksource: Switched to clocksource acpi_pm1453client # [ 0.544049] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454lb # [ 0.549110] NET: Registered PF_INET protocol family1455client # [ 0.545413] pnp: PnP ACPI init1456worker2 # [ 0.545489] NET: Registered PF_INET protocol family1457client # [ 0.546202] ACPI: IRQ 4 override to edge(!), high(!)1458lb # [ 0.550287] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1459worker2 # [ 0.546665] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1460client # [ 0.547170] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1461client # [ 0.548732] pnp: PnP ACPI: found 6 devices1462worker1 # [ 0.526624] pci 0000:00:01.0: vgaarb: setting as boot VGA device1463worker1 # [ 0.527593] pci 0000:00:01.0: vgaarb: bridge control possible1464worker1 # [ 0.527600] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1465client # [ 0.556438] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1466worker1 # [ 0.527608] vgaarb: loaded1467client # [ 0.557987] clocksource: Switched to clocksource acpi_pm1468worker1 # [ 0.528339] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01469client # [ 0.559011] NET: Registered PF_INET protocol family1470worker1 # [ 0.528606] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1471client # [ 0.560269] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1472worker1 # [ 0.531694] clocksource: Switched to clocksource kvm-clock1473lb # [ 0.566998] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1474worker2 # [ 0.563432] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1475lb # [ 0.568572] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1476worker2 # [ 0.564983] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1477lb # [ 0.569910] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1478worker2 # [ 0.566373] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1479worker1 # [ 0.535299] VFS: Disk quotas dquot_6.6.01480lb # [ 0.571276] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1481worker1 # [ 0.535978] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1482worker2 # [ 0.567730] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1483lb # [ 0.572500] TCP: Hash tables configured (established 16384 bind 16384)1484worker1 # [ 0.537305] pnp: PnP ACPI init1485worker2 # [ 0.568961] TCP: Hash tables configured (established 16384 bind 16384)1486worker1 # [ 0.538105] ACPI: IRQ 4 override to edge(!), high(!)1487lb # [ 0.573633] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1488worker2 # [ 0.570126] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1489lb # [ 0.574905] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1490worker1 # [ 0.539033] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1491worker2 # [ 0.571381] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1492lb # [ 0.575964] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1493worker1 # [ 0.540548] pnp: PnP ACPI: found 6 devices1494worker2 # [ 0.572487] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1495lb # [ 0.577166] NET: Registered PF_UNIX/PF_LOCAL protocol family1496worker2 # [ 0.573651] NET: Registered PF_UNIX/PF_LOCAL protocol family1497lb # [ 0.578165] NET: Registered PF_XDP protocol family1498worker2 # [ 0.574637] NET: Registered PF_XDP protocol family1499lb # [ 0.579024] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1500worker2 # [ 0.575491] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1501lb # [ 0.580056] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1502worker2 # [ 0.576453] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1503lb # [ 0.581075] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1504worker2 # [ 0.577488] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1505client # [ 0.576996] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1506lb # [ 0.582241] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1507worker2 # [ 0.578608] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1508client # [ 0.578575] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1509lb # [ 0.583423] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1510worker2 # [ 0.579664] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1511worker1 # [ 0.548169] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1512client # [ 0.579874] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1513lb # [ 0.584490] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1514worker2 # [ 0.580716] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1515worker1 # [ 0.549571] clocksource: Switched to clocksource acpi_pm1516client # [ 0.581179] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1517lb # [ 0.586191] ACPI: \_SB_.GSIA: Enabled at IRQ 161518worker2 # [ 0.582372] ACPI: \_SB_.GSIA: Enabled at IRQ 161519worker1 # [ 0.550542] NET: Registered PF_INET protocol family1520client # [ 0.582359] TCP: Hash tables configured (established 16384 bind 16384)1521worker1 # [ 0.551700] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1522client # [ 0.583422] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1523lb # [ 0.588413] ACPI: \_SB_.GSIB: Enabled at IRQ 171524worker2 # [ 0.584918] ACPI: \_SB_.GSIB: Enabled at IRQ 171525client # [ 0.584647] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1526client # [ 0.585705] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1527lb # [ 0.590366] ACPI: \_SB_.GSIC: Enabled at IRQ 181528worker2 # [ 0.586851] ACPI: \_SB_.GSIC: Enabled at IRQ 181529client # [ 0.586909] NET: Registered PF_UNIX/PF_LOCAL protocol family1530client # [ 0.587877] NET: Registered PF_XDP protocol family1531lb # [ 0.592342] ACPI: \_SB_.GSID: Enabled at IRQ 191532worker2 # [ 0.588786] ACPI: \_SB_.GSID: Enabled at IRQ 191533client # [ 0.588701] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1534lb # [ 0.594047] PCI: CLS 0 bytes, default 641535client # [ 0.589688] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1536worker2 # [ 0.590506] PCI: CLS 0 bytes, default 641537client # [ 0.590667] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1538lb # [ 0.594935] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1539worker2 # [ 0.591386] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1540client # [ 0.591730] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1541lb # [ 0.596647] Trying to unpack rootfs image as initramfs...1542worker2 # [ 0.593094] Trying to unpack rootfs image as initramfs...1543client # [ 0.592861] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1544client # [ 0.593964] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1545client # [ 0.595629] ACPI: \_SB_.GSIA: Enabled at IRQ 161546client # [ 0.597867] ACPI: \_SB_.GSIB: Enabled at IRQ 171547client # [ 0.600211] ACPI: \_SB_.GSIC: Enabled at IRQ 181548worker1 # [ 0.568668] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1549client # [ 0.602192] ACPI: \_SB_.GSID: Enabled at IRQ 191550worker1 # [ 0.570187] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1551worker1 # [ 0.571466] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1552client # [ 0.603859] PCI: CLS 0 bytes, default 641553worker1 # [ 0.572759] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1554client # [ 0.604837] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1555worker1 # [ 0.574025] TCP: Hash tables configured (established 16384 bind 16384)1556client # [ 0.606551] Trying to unpack rootfs image as initramfs...1557worker1 # [ 0.575136] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1558worker1 # [ 0.576378] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559worker1 # [ 0.577427] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560worker1 # [ 0.578600] NET: Registered PF_UNIX/PF_LOCAL protocol family1561worker1 # [ 0.579559] NET: Registered PF_XDP protocol family1562worker1 # [ 0.580393] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563worker1 # [ 0.581372] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564worker1 # [ 0.582358] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565worker1 # [ 0.583423] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566worker1 # [ 0.584500] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567worker1 # [ 0.585568] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568worker1 # [ 0.587283] ACPI: \_SB_.GSIA: Enabled at IRQ 161569worker1 # [ 0.589522] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker1 # [ 0.591595] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker1 # [ 0.593589] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker1 # [ 0.595277] PCI: CLS 0 bytes, default 641573worker1 # [ 0.596206] Trying to unpack rootfs image as initramfs...1574worker1 # [ 0.600694] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575lb # [ 0.643027] Initialise system trusted keyrings1576worker2 # [ 0.639503] Initialise system trusted keyrings1577worker2 # [ 0.640425] workingset: timestamp_bits=40 max_order=19 bucket_order=01578lb # [ 0.646619] workingset: timestamp_bits=40 max_order=19 bucket_order=01579client # [ 0.651506] Initialise system trusted keyrings1580client # [ 0.652442] workingset: timestamp_bits=40 max_order=19 bucket_order=01581lb # [ 0.665979] Key type asymmetric registered1582worker2 # [ 0.664145] Key type asymmetric registered1583worker2 # [ 0.664889] Asymmetric key parser 'x509' registered1584worker2 # [ 0.665807] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1585lb # [ 0.670605] Asymmetric key parser 'x509' registered1586lb # [ 0.671461] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1587worker2 # [ 0.669213] io scheduler mq-deadline registered1588worker2 # [ 0.670007] io scheduler kyber registered1589lb # [ 0.674722] io scheduler mq-deadline registered1590lb # [ 0.675504] io scheduler kyber registered1591worker1 # [ 0.641525] Initialise system trusted keyrings1592worker2 # [ 0.673614] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1593client # [ 0.674031] Key type asymmetric registered1594worker1 # [ 0.642468] workingset: timestamp_bits=40 max_order=19 bucket_order=01595lb # [ 0.679101] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1596worker2 # [ 0.674869] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1597client # [ 0.676174] Asymmetric key parser 'x509' registered1598lb # [ 0.680365] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1599client # [ 0.677027] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1600worker2 # [ 0.680160] Linux agpgart interface v0.1031601lb # [ 0.684383] Linux agpgart interface v0.1031602client # [ 0.680223] io scheduler mq-deadline registered1603worker2 # [ 0.680898] ACPI: bus type drm_connector registered1604client # [ 0.680948] io scheduler kyber registered1605lb # [ 0.685152] ACPI: bus type drm_connector registered1606worker2 # [ 0.683288] usbcore: registered new interface driver usbserial_generic1607worker2 # [ 0.684426] usbserial: USB Serial support registered for generic1608client # [ 0.684720] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1609lb # [ 0.689998] usbcore: registered new interface driver usbserial_generic1610client # [ 0.686002] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1611lb # [ 0.691108] usbserial: USB Serial support registered for generic1612worker2 # [ 0.688100] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1613worker2 # [ 0.688100] Please enable it if your BIOS has the CPPC option.1614client # [ 0.689917] Linux agpgart interface v0.1031615worker2 # [ 0.690452] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1616client # [ 0.690696] ACPI: bus type drm_connector registered1617lb # [ 0.694584] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1618lb # [ 0.694584] Please enable it if your BIOS has the CPPC option.1619lb # [ 0.696846] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1620lb # [ 0.698270] drop_monitor: Initializing network drop monitor service1621worker2 # [ 0.694234] drop_monitor: Initializing network drop monitor service1622worker2 # [ 0.695411] NET: Registered PF_INET6 protocol family1623lb # [ 0.699445] NET: Registered PF_INET6 protocol family1624client # [ 0.695579] usbcore: registered new interface driver usbserial_generic1625client # [ 0.696620] usbserial: USB Serial support registered for generic1626worker1 # [ 0.666219] Key type asymmetric registered1627worker2 # [ 0.698543] Segment Routing with IPv61628worker1 # [ 0.666904] Asymmetric key parser 'x509' registered1629lb # [ 0.703041] Segment Routing with IPv61630worker1 # [ 0.667772] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1631worker2 # [ 0.701112] In-situ OAM (IOAM) with IPv61632client # [ 0.700122] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1633lb # [ 0.705593] In-situ OAM (IOAM) with IPv61634client # [ 0.700122] Please enable it if your BIOS has the CPPC option.1635worker2 # [ 0.702171] IPI shorthand broadcast: enabled1636lb # [ 0.706644] IPI shorthand broadcast: enabled1637client # [ 0.702350] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1638worker1 # [ 0.671237] io scheduler mq-deadline registered1639worker1 # [ 0.672006] io scheduler kyber registered1640client # [ 0.703729] drop_monitor: Initializing network drop monitor service1641client # [ 0.704917] NET: Registered PF_INET6 protocol family1642worker1 # [ 0.674724] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1643worker1 # [ 0.676057] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1644client # [ 0.708583] Segment Routing with IPv61645worker2 # [ 0.710338] sched_clock: Marking stable (576013807, 134069270)->(790651717, -80568640)1646client # [ 0.711127] In-situ OAM (IOAM) with IPv61647lb # [ 0.714888] sched_clock: Marking stable (581014648, 133548002)->(788838166, -74275516)1648client # [ 0.712176] IPI shorthand broadcast: enabled1649worker1 # [ 0.681861] Linux agpgart interface v0.1031650worker1 # [ 0.682658] ACPI: bus type drm_connector registered1651worker2 # [ 0.715337] registered taskstats version 11652lb # [ 0.719804] registered taskstats version 11653worker2 # [ 0.716321] Loading compiled-in X.509 certificates1654lb # [ 0.720764] Loading compiled-in X.509 certificates1655worker1 # [ 0.685572] usbcore: registered new interface driver usbserial_generic1656worker1 # [ 0.686702] usbserial: USB Serial support registered for generic1657client # [ 0.720397] sched_clock: Marking stable (586016684, 134085570)->(793097994, -72995740)1658worker1 # [ 0.689108] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1659worker1 # [ 0.689108] Please enable it if your BIOS has the CPPC option.1660worker1 # [ 0.691414] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1661client # [ 0.725207] registered taskstats version 11662client # [ 0.726169] Loading compiled-in X.509 certificates1663worker1 # [ 0.695224] drop_monitor: Initializing network drop monitor service1664worker1 # [ 0.696467] NET: Registered PF_INET6 protocol family1665worker1 # [ 0.700643] Segment Routing with IPv61666worker1 # [ 0.703105] In-situ OAM (IOAM) with IPv61667worker2 # [ 0.735106] Demotion targets for Node 0: null1668lb # [ 0.739586] Demotion targets for Node 0: null1669worker1 # [ 0.704173] IPI shorthand broadcast: enabled1670worker2 # [ 0.736002] Key type .fscrypt registered1671lb # [ 0.740446] Key type .fscrypt registered1672worker2 # [ 0.736659] Key type fscrypt-provisioning registered1673lb # [ 0.741158] Key type fscrypt-provisioning registered1674worker2 # [ 0.737620] ima: No TPM chip found, activating TPM-bypass!1675lb # [ 0.742147] ima: No TPM chip found, activating TPM-bypass!1676worker2 # [ 0.740102] ima: Allocated hash algorithm: sha11677worker2 # [ 0.740958] ima: No architecture policies found1678lb # [ 0.746580] ima: Allocated hash algorithm: sha11679lb # [ 0.747378] ima: No architecture policies found1680lb # [ 0.748357] PM: Magic number: 10:951:5251681client # [ 0.744110] Demotion targets for Node 0: null1682worker1 # [ 0.712417] sched_clock: Marking stable (579014834, 133064135)->(786690796, -74611827)1683worker2 # [ 0.745102] PM: Magic number: 10:951:5251684client # [ 0.744980] Key type .fscrypt registered1685lb # [ 0.749094] PM: hash matches drivers/base/power/main.c:8931686worker2 # [ 0.745810] PM: hash matches drivers/base/power/main.c:8931687client # [ 0.748112] Key type fscrypt-provisioning registered1688worker1 # [ 0.717325] registered taskstats version 11689client # [ 0.749039] ima: No TPM chip found, activating TPM-bypass!1690worker2 # [ 0.749685] RAS: Correctable Errors collector initialized.1691worker1 # [ 0.718325] Loading compiled-in X.509 certificates1692client # [ 0.749947] ima: Allocated hash algorithm: sha11693lb # [ 0.754947] RAS: Correctable Errors collector initialized.1694client # [ 0.752136] ima: No architecture policies found1695client # [ 0.753124] PM: Magic number: 10:951:5251696client # [ 0.753830] PM: hash matches drivers/base/power/main.c:8931697client # [ 0.757694] RAS: Correctable Errors collector initialized.1698worker2 # [ 0.758298] clk: Disabling unused clocks1699worker2 # [ 0.759015] PM: genpd: Disabling unused power domains1700lb # [ 0.763669] clk: Disabling unused clocks1701lb # [ 0.764378] PM: genpd: Disabling unused power domains1702client # [ 0.766376] clk: Disabling unused clocks1703client # [ 0.767042] PM: genpd: Disabling unused power domains1704worker1 # [ 0.737099] Demotion targets for Node 0: null1705worker1 # [ 0.737990] Key type .fscrypt registered1706worker1 # [ 0.738701] Key type fscrypt-provisioning registered1707worker1 # [ 0.739690] ima: No TPM chip found, activating TPM-bypass!1708worker1 # [ 0.743104] ima: Allocated hash algorithm: sha11709worker1 # [ 0.743915] ima: No architecture policies found1710worker1 # [ 0.746095] PM: Magic number: 10:951:5251711worker1 # [ 0.746813] PM: hash matches drivers/base/power/main.c:8931712worker1 # [ 0.750734] RAS: Correctable Errors collector initialized.1713worker1 # [ 0.759406] clk: Disabling unused clocks1714worker1 # [ 0.764093] PM: genpd: Disabling unused power domains1715worker2 # [ 0.921453] Freeing initrd memory: 29092K1716lb # [ 0.926327] Freeing initrd memory: 29092K1717worker2 # [ 0.924629] Freeing unused decrypted memory: 2028K1718lb # [ 0.929670] Freeing unused decrypted memory: 2028K1719worker2 # [ 0.927296] Freeing unused kernel image (initmem) memory: 3644K1720lb # [ 0.932424] Freeing unused kernel image (initmem) memory: 3644K1721worker2 # [ 0.928422] Write protecting the kernel read-only data: 32768k1722lb # [ 0.933515] Write protecting the kernel read-only data: 32768k1723worker2 # [ 0.930284] Freeing unused kernel image (text/rodata gap) memory: 1208K1724lb # [ 0.935451] Freeing unused kernel image (text/rodata gap) memory: 1208K1725worker2 # [ 0.931846] Freeing unused kernel image (rodata/data gap) memory: 752K1726lb # [ 0.937010] Freeing unused kernel image (rodata/data gap) memory: 752K1727client # [ 0.945902] Freeing initrd memory: 29096K1728client # [ 0.949189] Freeing unused decrypted memory: 2028K1729client # [ 0.951873] Freeing unused kernel image (initmem) memory: 3644K1730client # [ 0.952943] Write protecting the kernel read-only data: 32768k1731client # [ 0.954838] Freeing unused kernel image (text/rodata gap) memory: 1208K1732client # [ 0.956357] Freeing unused kernel image (rodata/data gap) memory: 752K1733worker1 # [ 0.926766] Freeing initrd memory: 29092K1734worker1 # [ 0.930033] Freeing unused decrypted memory: 2028K1735worker1 # [ 0.932801] Freeing unused kernel image (initmem) memory: 3644K1736worker1 # [ 0.933903] Write protecting the kernel read-only data: 32768k1737worker1 # [ 0.935840] Freeing unused kernel image (text/rodata gap) memory: 1208K1738worker1 # [ 0.937441] Freeing unused kernel image (rodata/data gap) memory: 752K1739worker2 # [ 0.982746] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740worker2 # [ 0.983869] Run /init as init process1741lb # [ 0.988057] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742lb # [ 0.989157] Run /init as init process1743worker2 # [ 0.994016] systemd[1]: Inserted module 'autofs4'1744lb # [ 0.999712] systemd[1]: Inserted module 'autofs4'1745client # [ 1.007539] x86/mm: Checked W+X mappings: passed, no W+X pages found.1746client # [ 1.008605] Run /init as init process1747worker2 # [ 1.010226] fuse: init (API version 7.45)1748lb # [ 1.016115] fuse: init (API version 7.45)1749worker2 # [ 1.016116] ACPI: \_SB_.GSIG: Enabled at IRQ 221750lb # [ 1.022022] ACPI: \_SB_.GSIG: Enabled at IRQ 221751worker2 # [ 1.018720] ACPI: \_SB_.GSIH: Enabled at IRQ 231752client # [ 1.019157] systemd[1]: Inserted module 'autofs4'1753lb # [ 1.024517] ACPI: \_SB_.GSIH: Enabled at IRQ 231754worker1 # [ 0.988633] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755worker1 # [ 0.989754] Run /init as init process1756worker2 # [ 1.021954] ACPI: \_SB_.GSIE: Enabled at IRQ 201757lb # [ 1.027381] ACPI: \_SB_.GSIE: Enabled at IRQ 201758worker2 # [ 1.024733] ACPI: \_SB_.GSIF: Enabled at IRQ 211759lb # [ 1.029688] ACPI: \_SB_.GSIF: Enabled at IRQ 211760worker1 # [ 1.000087] systemd[1]: Inserted module 'autofs4'1761client # [ 1.036956] fuse: init (API version 7.45)1762client # [ 1.043035] ACPI: \_SB_.GSIG: Enabled at IRQ 221763client # [ 1.045817] ACPI: \_SB_.GSIH: Enabled at IRQ 231764worker1 # [ 1.016319] fuse: init (API version 7.45)1765client # [ 1.049061] ACPI: \_SB_.GSIE: Enabled at IRQ 201766lb # [ 1.053272] systemd[1]: Successfully made /usr/ read-only.1767worker2 # [ 1.050809] systemd[1]: Successfully made /usr/ read-only.1768client # [ 1.051608] ACPI: \_SB_.GSIF: Enabled at IRQ 211769worker1 # [ 1.022210] ACPI: \_SB_.GSIG: Enabled at IRQ 221770worker1 # [ 1.024557] ACPI: \_SB_.GSIH: Enabled at IRQ 231771worker1 # [ 1.027633] ACPI: \_SB_.GSIE: Enabled at IRQ 201772worker1 # [ 1.029890] ACPI: \_SB_.GSIF: Enabled at IRQ 211773client # [ 1.079046] systemd[1]: Successfully made /usr/ read-only.1774worker1 # [ 1.056971] systemd[1]: Successfully made /usr/ read-only.1775lb # [ 1.388815] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1776lb # [ 1.393571] systemd[1]: Detected virtualization kvm.1777lb # [ 1.394383] systemd[1]: Detected architecture x86-64.1778worker2 # [ 1.386408] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1779lb # [ 1.395282] systemd[1]: Running in initrd.1780worker2 # [ 1.391408] systemd[1]: Detected virtualization kvm.1781worker2 # [ 1.392279] systemd[1]: Detected architecture x86-64.1782lb # [ 1.396365] systemd[1]: Initializing machine ID from random generator.1783worker2 # [ 1.393169] systemd[1]: Running in initrd.1784lb # [ 1.397482] systemd[1]: Hostname set to <lb>.1785worker2 # [ 1.394271] systemd[1]: Initializing machine ID from random generator.1786worker2 # [ 1.395521] systemd[1]: Hostname set to <worker2>.1787client # [ 1.414677] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1788client # [ 1.423681] systemd[1]: Detected virtualization kvm.1789client # [ 1.425878] systemd[1]: Detected architecture x86-64.1790client # [ 1.428139] systemd[1]: Running in initrd.1791client # [ 1.430710] systemd[1]: Initializing machine ID from random generator.1792client # [ 1.433619] systemd[1]: Hostname set to <client>.1793worker1 # [ 1.393456] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1794worker1 # [ 1.405419] systemd[1]: Detected virtualization kvm.1795worker1 # [ 1.407526] systemd[1]: Detected architecture x86-64.1796worker1 # [ 1.409689] systemd[1]: Running in initrd.1797worker1 # [ 1.412253] systemd[1]: Initializing machine ID from random generator.1798worker1 # [ 1.415149] systemd[1]: Hostname set to <worker1>.1799worker2 # [ 1.589174] systemd[1]: bpf-restrict-fs: LSM BPF program attached1800lb # [ 1.606124] systemd[1]: bpf-restrict-fs: LSM BPF program attached1801worker2 # [ 1.627388] systemd[1]: Queued start job for default target Initrd Default Target.1802worker2 # [ 1.631367] systemd[1]: Created slice Slice /system/modprobe.1803worker2 # [ 1.632627] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1804worker2 # [ 1.634112] systemd[1]: Expecting device /dev/disk/by-label/nixos...1805worker2 # [ 1.635300] systemd[1]: Reached target Path Units.1806worker2 # [ 1.636235] systemd[1]: Reached target Slice Units.1807worker2 # [ 1.637150] systemd[1]: Reached target Swaps.1808worker2 # [ 1.637982] systemd[1]: Reached target Timer Units.1809worker2 # [ 1.638992] systemd[1]: Listening on D-Bus System Message Bus Socket.1810worker2 # [ 1.640268] systemd[1]: Listening on Journal Socket (/dev/log).1811worker2 # [ 1.641458] systemd[1]: Listening on Journal Sockets.1812worker2 # [ 1.642503] systemd[1]: Listening on udev Control Socket.1813worker2 # [ 1.643541] systemd[1]: Listening on udev Kernel Socket.1814worker2 # [ 1.644496] systemd[1]: Reached target Socket Units.1815worker2 # [ 1.646303] systemd[1]: Starting Create List of Static Device Nodes...1816worker2 # [ 1.650152] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1817client # [ 1.654440] systemd[1]: bpf-restrict-fs: LSM BPF program attached1818worker2 # [ 1.656754] systemd[1]: Starting Load Kernel Module configfs...1819lb # [ 1.660965] systemd[1]: Queued start job for default target Initrd Default Target.1820lb # [ 1.664949] systemd[1]: Created slice Slice /system/modprobe.1821lb # [ 1.666177] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1822lb # [ 1.667615] systemd[1]: Expecting device /dev/disk/by-label/nixos...1823lb # [ 1.668794] systemd[1]: Reached target Path Units.1824lb # [ 1.669679] systemd[1]: Reached target Slice Units.1825lb # [ 1.670537] systemd[1]: Reached target Swaps.1826lb # [ 1.671344] systemd[1]: Reached target Timer Units.1827lb # [ 1.672350] systemd[1]: Listening on D-Bus System Message Bus Socket.1828lb # [ 1.673619] systemd[1]: Listening on Journal Socket (/dev/log).1829worker1 # [ 1.637242] systemd[1]: bpf-restrict-fs: LSM BPF program attached1830lb # [ 1.674841] systemd[1]: Listening on Journal Sockets.1831lb # [ 1.675913] systemd[1]: Listening on udev Control Socket.1832worker2 # [ 1.672288] systemd[1]: Starting Journal Service...1833lb # [ 1.676977] systemd[1]: Listening on udev Kernel Socket.1834lb # [ 1.677999] systemd[1]: Reached target Socket Units.1835lb # [ 1.679862] systemd[1]: Starting Create List of Static Device Nodes...1836lb # [ 1.685652] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1837lb # [ 1.692638] systemd[1]: Starting Load Kernel Module configfs...1838worker2 # [ 1.685218] systemd[1]: Starting Load Kernel Modules...1839lb # [ 1.705753] systemd[1]: Starting Journal Service...1840worker2 # [ 1.703814] netfs: FS-Cache loaded1841worker2 # [ 1.708529] 9pnet: Installing 9P2000 support1842client # [ 1.709132] systemd[1]: Queued start job for default target Initrd Default Target.1843client # [ 1.712489] systemd[1]: Created slice Slice /system/modprobe.1844client # [ 1.713725] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1845worker2 # [ 1.714234] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1846client # [ 1.715216] systemd[1]: Expecting device /dev/disk/by-label/nixos...1847client # [ 1.716342] systemd[1]: Reached target Path Units.1848client # [ 1.717268] systemd[1]: Reached target Slice Units.1849client # [ 1.718169] systemd[1]: Reached target Swaps.1850client # [ 1.718998] systemd[1]: Reached target Timer Units.1851client # [ 1.719996] systemd[1]: Listening on D-Bus System Message Bus Socket.1852client # [ 1.721260] systemd[1]: Listening on Journal Socket (/dev/log).1853client # [ 1.722437] systemd[1]: Listening on Journal Sockets.1854worker2 # [ 1.723171] systemd[1]: Starting Coldplug All udev Devices...1855worker1 # [ 1.691400] systemd[1]: Queued start job for default target Initrd Default Target.1856client # [ 1.723445] systemd[1]: Listening on udev Control Socket.1857client # [ 1.724460] systemd[1]: Listening on udev Kernel Socket.1858client # [ 1.725462] systemd[1]: Reached target Socket Units.1859lb # [ 1.718890] systemd[1]: Starting Load Kernel Modules...1860worker1 # [ 1.695448] systemd[1]: Created slice Slice /system/modprobe.1861client # [ 1.727290] systemd[1]: Starting Create List of Static Device Nodes...1862worker1 # [ 1.696639] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1863worker1 # [ 1.698096] systemd[1]: Expecting device /dev/disk/by-label/nixos...1864worker1 # [ 1.699360] systemd[1]: Reached target Path Units.1865client # [ 1.731174] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1866worker1 # [ 1.700265] systemd[1]: Reached target Slice Units.1867worker1 # [ 1.701158] systemd[1]: Reached target Swaps.1868worker1 # [ 1.701976] systemd[1]: Reached target Timer Units.1869lb # [ 1.738299] netfs: FS-Cache loaded1870worker1 # [ 1.702971] systemd[1]: Listening on D-Bus System Message Bus Socket.1871worker2 # [ 1.735497] systemd[1]: Finished Create List of Static Device Nodes.1872worker1 # [ 1.704253] systemd[1]: Listening on Journal Socket (/dev/log).1873worker1 # [ 1.705425] systemd[1]: Listening on Journal Sockets.1874worker1 # [ 1.706456] systemd[1]: Listening on udev Control Socket.1875worker1 # [ 1.707511] systemd[1]: Listening on udev Kernel Socket.1876lb # [ 1.744152] 9pnet: Installing 9P2000 support1877worker1 # [ 1.708504] systemd[1]: Reached target Socket Units.1878client # [ 1.740292] systemd[1]: Starting Load Kernel Module configfs...1879worker2 # [ 1.741674] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1880worker1 # [ 1.710369] systemd[1]: Starting Create List of Static Device Nodes...1881worker1 # [ 1.714149] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1882worker2 # [ 1.749483] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1883lb # [ 1.753209] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1884worker2 # [ 1.753317] systemd-journald[67]: Collecting audit messages is disabled.1885client # [ 1.754182] systemd[1]: Starting Journal Service...1886worker1 # [ 1.723168] systemd[1]: Starting Load Kernel Module configfs...1887worker2 # [ 1.756485] systemd[1]: modprobe@configfs.service: Deactivated successfully.1888lb # [ 1.762082] systemd[1]: Starting Coldplug All udev Devices...1889worker2 # [ 1.762430] systemd[1]: Finished Load Kernel Module configfs.1890worker2 # [ 1.766521] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1891worker1 # [ 1.737281] systemd[1]: Starting Journal Service...1892worker2 # [ 1.768581] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1893lb # [ 1.776656] systemd[1]: Finished Create List of Static Device Nodes.1894worker2 # [ 1.775101] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1895client # [ 1.766570] systemd[1]: Starting Load Kernel Modules...1896lb # [ 1.783329] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1897worker2 # [ 1.780160] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1898lb # [ 1.787992] systemd-journald[67]: Collecting audit messages is disabled.1899client # [ 1.786707] netfs: FS-Cache loaded1900lb # [ 1.791629] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1901client # [ 1.792625] 9pnet: Installing 9P2000 support1902lb # [ 1.797023] systemd[1]: modprobe@configfs.service: Deactivated successfully.1903worker1 # [ 1.751172] systemd[1]: Starting Load Kernel Modules...1904lb # [ 1.804002] systemd[1]: Finished Load Kernel Module configfs.1905worker1 # [ 1.770821] netfs: FS-Cache loaded1906client # [ 1.801851] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1907lb # [ 1.807648] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1908lb # [ 1.810220] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1909worker1 # [ 1.775568] 9pnet: Installing 9P2000 support1910worker2 # [ 1.807615] systemd[1]: Finished Load Kernel Modules.1911client # [ 1.811227] systemd[1]: Starting Coldplug All udev Devices...1912lb # [ 1.816592] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1913worker2 # [ 1.814295] systemd[1]: Starting Apply Kernel Variables...1914lb # [ 1.821793] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1915worker1 # [ 1.786775] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1916client # [ 1.823548] systemd[1]: Finished Create List of Static Device Nodes.1917worker2 # [ 1.824199] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1918worker1 # [ 1.795671] systemd[1]: Starting Coldplug All udev Devices...1919client # [ 1.831937] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1920worker2 # [ 1.834279] systemd[1]: Starting Create Static Device Nodes in /dev...1921client # [ 1.835121] systemd-journald[67]: Collecting audit messages is disabled.1922client # [ 1.840559] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1923lb # [ 1.847147] systemd[1]: Finished Load Kernel Modules.1924worker1 # [ 1.811181] systemd[1]: Finished Create List of Static Device Nodes.1925client # [ 1.847567] systemd[1]: modprobe@configfs.service: Deactivated successfully.1926worker1 # [ 1.817775] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1927lb # [ 1.854752] systemd[1]: Starting Apply Kernel Variables...1928client # [ 1.851492] systemd[1]: Finished Load Kernel Module configfs.1929worker1 # [ 1.820888] systemd-journald[67]: Collecting audit messages is disabled.1930client # [ 1.853340] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1931worker2 # [ 1.855209] systemd[1]: Finished Apply Kernel Variables.1932worker1 # [ 1.826495] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1933client # [ 1.857579] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1934client # [ 1.863266] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1935lb # [ 1.867932] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1936worker1 # [ 1.833588] systemd[1]: modprobe@configfs.service: Deactivated successfully.1937worker2 # [ 1.868531] systemd[1]: Started Journal Service.1938worker1 # [ 1.837478] systemd[1]: Finished Load Kernel Module configfs.1939client # [ 1.869193] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1940worker1 # [ 1.839459] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1941worker2 # [ 1.735427] systemd-modules-load[68]: Inserted module 'dm_mod'1942worker2 # [ 1.739493] systemd-modules-load[68]: Inserted module 'virtio_balloon'1943worker2 # [ 1.741088] systemd-modules-load[68]: Inserted module 'virtio_gpu'1944lb # [ 1.879178] systemd[1]: Starting Create Static Device Nodes in /dev...1945worker1 # [ 1.844593] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1946worker2 # [ 1.746992] systemd[1]: Finished Create Static Device Nodes in /dev.1947worker1 # [ 1.850269] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1948worker2 # [ 1.752123] systemd[1]: Reached target Preparation for Local File Systems.1949lb # [ 1.891164] systemd[1]: Finished Apply Kernel Variables.1950worker2 # [ 1.754073] systemd[1]: Reached target Local File Systems.1951worker1 # [ 1.856164] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1952worker2 # [ 1.757129] systemd[1]: Starting Create System Files and Directories...1953client # [ 1.893640] systemd[1]: Finished Load Kernel Modules.1954worker2 # [ 1.764070] systemd[1]: Starting Rule-based Manager for Device Events and Files...1955lb # [ 1.904923] systemd[1]: Started Journal Service.1956client # [ 1.901298] systemd[1]: Starting Apply Kernel Variables...1957lb # [ 1.770893] systemd-modules-load[68]: Inserted module 'dm_mod'1958lb # [ 1.775158] systemd-modules-load[68]: Inserted module 'virtio_balloon'1959lb # [ 1.777238] systemd-modules-load[68]: Inserted module 'virtio_gpu'1960worker1 # [ 1.880656] systemd[1]: Finished Load Kernel Modules.1961client # [ 1.912208] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1962lb # [ 1.783403] systemd[1]: Finished Create Static Device Nodes in /dev.1963lb # [ 1.789597] systemd[1]: Reached target Preparation for Local File Systems.1964worker2 # [ 1.786878] systemd[1]: Finished Create System Files and Directories.1965worker1 # [ 1.889293] systemd[1]: Starting Apply Kernel Variables...1966lb # [ 1.792095] systemd[1]: Reached target Local File Systems.1967client # [ 1.921746] systemd[1]: Starting Create Static Device Nodes in /dev...1968lb # [ 1.793350] systemd[1]: Starting Create System Files and Directories...1969lb # [ 1.800347] systemd[1]: Starting Rule-based Manager for Device Events and Files...1970worker1 # [ 1.906212] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1971client # [ 1.938224] systemd[1]: Finished Apply Kernel Variables.1972worker2 # [ 1.809347] systemd-udevd[83]: Using default interface naming scheme 'v261'.1973worker1 # [ 1.915427] systemd[1]: Starting Create Static Device Nodes in /dev...1974lb # [ 1.823344] systemd[1]: Finished Create System Files and Directories.1975client # [ 1.953872] systemd[1]: Started Journal Service.1976client # [ 1.820942] systemd-modules-load[68]: Inserted module 'dm_mod'1977client # [ 1.823350] systemd-modules-load[68]: Inserted module 'virtio_balloon'1978client # [ 1.824912] systemd-modules-load[68]: Inserted module 'virtio_gpu'1979worker1 # [ 1.928186] systemd[1]: Finished Apply Kernel Variables.1980client # [ 1.828278] systemd[1]: Finished Create Static Device Nodes in /dev.1981client # [ 1.829392] systemd[1]: Reached target Preparation for Local File Systems.1982client # [ 1.830553] systemd[1]: Reached target Local File Systems.1983worker2 # [ 1.833066] systemd[1]: Started Rule-based Manager for Device Events and Files.1984client # [ 1.835073] systemd[1]: Starting Create System Files and Directories...1985client # [ 1.840171] systemd[1]: Starting Rule-based Manager for Device Events and Files...1986worker1 # [ 1.809337] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.943525] systemd[1]: Started Journal Service.1987worker1 # 1988lb # [ 1.847366] systemd-udevd[83]: Using default interface naming scheme 'v261'.1989worker1 # [ 1.812331] systemd-modules-load[68]: Inserted module 'virtio_balloon'1990worker1 # [ 1.814863] systemd-modules-load[68]: Inserted module 'virtio_gpu'1991worker1 # [ 1.822919] systemd[1]: Finished Create Static Device Nodes in /dev.1992worker1 # [ 1.829110] systemd[1]: Reached target Preparation for Local File Systems.1993worker1 # [ 1.830235] systemd[1]: Reached target Local File Systems.1994worker1 # [ 1.834069] systemd[1]: Starting Create System Files and Directories...1995lb # [ 1.871062] systemd[1]: Started Rule-based Manager for Device Events and Files.1996client # [ 1.867838] systemd[1]: Finished Create System Files and Directories.1997worker1 # [ 1.839378] systemd[1]: Starting Rule-based Manager for Device Events and Files...1998worker2 # [ 1.882635] systemd[1]: Finished Coldplug All udev Devices.1999worker2 # [ 1.883551] systemd[1]: Reached target System Initialization.2000worker2 # [ 1.884351] systemd[1]: Reached target Basic System.
loading 1,953 hidden lines…
3954worker1 # [ 15.089736] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3955worker1 # [ 15.092360] dhcpcd[692]: eth0: adding route to 10.0.2.0/243956worker1 # [ 15.094670] dhcpcd[692]: eth0: adding default route via 10.0.2.23957worker1 # [ 15.203641] systemd[1]: Started DHCP Client.3958worker1 # [ 15.205443] systemd[1]: Reached target Multi-User System.3959worker1 # [ 15.206594] systemd[1]: Startup finished in 860ms (kernel) + 4.131s (initrd) + 10.214s (userspace) = 15.206s.3960client # [ 15.524801] dhcpcd[568]: eth0: leased 10.0.2.15 for 86400 seconds3961client # [ 15.527646] dhcpcd[568]: eth0: adding route to 10.0.2.0/243962client # [ 15.529554] dhcpcd[568]: eth0: adding default route via 10.0.2.23963client # [ 15.652843] systemd[1]: Started DHCP Client.3964client # [ 15.655356] systemd[1]: Reached target Multi-User System.3965client # [ 15.657296] systemd[1]: Startup finished in 877ms (kernel) + 4.174s (initrd) + 10.604s (userspace) = 15.656s.3966worker2 # [ 16.041431] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3967worker2 # [ 16.044117] dhcpcd[692]: eth0: adding route to 10.0.2.0/243968worker2 # [ 16.046353] dhcpcd[692]: eth0: adding default route via 10.0.2.23969worker2 # [ 16.158736] systemd[1]: Started DHCP Client.3970worker2 # [ 16.160732] systemd[1]: Reached target Multi-User System.3971worker2 # [ 16.161546] systemd[1]: Startup finished in 853ms (kernel) + 3.956s (initrd) + 11.351s (userspace) = 16.160s.3972lb # [ 17.603621] dhcpcd[711]: eth0: leased 10.0.2.15 for 86400 seconds3973lb # [ 17.606575] dhcpcd[711]: eth0: adding route to 10.0.2.0/243974lb # [ 17.609443] dhcpcd[711]: eth0: adding default route via 10.0.2.23975lb # [ 17.722183] systemd[1]: Started DHCP Client.3976lb # [ 17.724479] systemd[1]: Reached target Network is Online.3977lb # [ 17.727792] systemd[1]: Started Envoy reverse proxy.3978lb # [ 17.730934] systemd[1]: Started mock-oidc.service.3979lb # [ 17.815684] mock-oidc-server[927]: Mock OIDC Server running3980lb # [ 17.816544] mock-oidc-server[927]: OIDC Address: 192.168.1.2:80803981lb # [ 17.817411] mock-oidc-server[927]: Issue Address: 0.0.0.0:80813982lb # [ 17.818408] mock-oidc-server[927]: Issuer: http://192.168.1.2:8080/oidc3983lb # [ 17.819765] mock-oidc-server[927]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3984lb # [ 17.821045] mock-oidc-server[927]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3985lb # [ 17.822434] mock-oidc-server[927]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3986lb # [ 18.230426] envoy[926]: [2026-09-20 09:32:26.345][926][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3987lb # [ 18.232768] envoy[926]: [2026-09-20 09:32:26.347][926][info][main] [source/server/server.cc:469] statically linked extensions:3988lb # [ 18.234517] envoy[926]: [2026-09-20 09:32:26.347][926][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3989lb # [ 18.236528] envoy[926]: [2026-09-20 09:32:26.347][926][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3990lb # [ 18.239371] envoy[926]: [2026-09-20 09:32:26.347][926][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3991lb # [ 18.253804] envoy[926]: [2026-09-20 09:32:26.347][926][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3992lb # [ 18.260193] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3993lb # [ 18.262351] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3994lb # [ 18.264514] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3995lb # [ 18.266576] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3996lb # [ 18.268527] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3997lb # [ 18.271322] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3998lb # [ 18.278150] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83999lb # [ 18.279942] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4000lb # [ 18.282695] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4001lb # [ 18.284305] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4002lb # [ 18.286885] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4003lb # [ 18.289657] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4004lb # [ 18.292143] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4005lb # [ 18.294548] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4006lb # [ 18.296148] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4007lb # [ 18.303130] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4008lb # [ 18.305118] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4009lb # [ 18.308962] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4010lb # [ 18.310912] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4011lb # [ 18.314058] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4012lb # [ 18.316272] envoy[926]: [2026-09-20 09:32:26.348][926][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4013lb # [ 18.317909] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4014lb # [ 18.320105] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14015lb # [ 18.321992] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4016lb # [ 18.324667] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4017lb # [ 18.326878] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4018lb # [ 18.329036] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4019lb # [ 18.331254] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4020lb # [ 18.333644] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4021lb # [ 18.335280] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4022lb # [ 18.339868] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4023lb # [ 18.341950] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4024lb # [ 18.343662] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4025lb # [ 18.346083] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4026lb # [ 18.348182] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4027lb # [ 18.349994] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4028lb # [ 18.352168] envoy[926]: [2026-09-20 09:32:26.349][926][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4029lb # [ 18.354569] envoy[926]: [2026-09-20 09:32:26.351][926][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4030lb # [ 18.356196] envoy[926]: [2026-09-20 09:32:26.351][926][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4031lb # [ 18.357650] envoy[926]: [2026-09-20 09:32:26.351][926][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4032lb # [ 18.359150] envoy[926]: [2026-09-20 09:32:26.351][926][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4033lb # [ 18.362413] envoy[926]: [2026-09-20 09:32:26.351][926][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4034lb # [ 18.364150] envoy[926]: [2026-09-20 09:32:26.351][926][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4035lb # [ 18.365828] envoy[926]: [2026-09-20 09:32:26.351][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4036lb # [ 18.369787] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4037lb # [ 18.372918] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4038lb # [ 18.374848] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4039lb # [ 18.378901] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4040lb # [ 18.380561] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4041lb # [ 18.382709] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4042lb # [ 18.384980] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4043lb # [ 18.387050] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4044lb # [ 18.389458] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4045lb # [ 18.391224] envoy[926]: [2026-09-20 09:32:26.354][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24046lb # [ 18.392847] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4047lb # [ 18.394363] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4048lb # [ 18.399090] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24049lb # [ 18.400728] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4050lb # [ 18.409910] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4051lb # [ 18.415414] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4052lb # [ 18.418154] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4053lb # [ 18.420044] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4054lb # [ 18.423748] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4055lb # [ 18.426206] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4056lb # [ 18.428305] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4057lb # [ 18.430193] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4058lb # [ 18.432132] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4059lb # [ 18.434451] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4060lb # [ 18.437357] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4061lb # [ 18.441653] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4062lb # [ 18.444632] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4063lb # [ 18.446379] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4064lb # [ 18.448721] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4065lb # [ 18.450255] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4066lb # [ 18.453088] envoy[926]: [2026-09-20 09:32:26.361][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4067lb # [ 18.455260] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4068lb # [ 18.457780] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4069lb # [ 18.459359] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4070lb # [ 18.461235] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4071lb # [ 18.463071] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4072lb # [ 18.465214] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4073lb # [ 18.467712] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4074lb # [ 18.469638] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4075lb # [ 18.472712] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4076lb # [ 18.474467] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4077lb # [ 18.479036] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4078lb # [ 18.490356] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4079lb # [ 18.492096] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4080lb # [ 18.493912] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4081lb # [ 18.495758] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4082lb # [ 18.497657] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4083lb # [ 18.499430] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4084lb # [ 18.501870] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4085lb # [ 18.507197] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24086lb # [ 18.509460] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4087lb # [ 18.511941] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4088lb # [ 18.513934] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4089lb # [ 18.518243] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4090lb # [ 18.525116] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4091lb # [ 18.526780] envoy[926]: [2026-09-20 09:32:26.362][926][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4092lb # [ 18.552868] envoy[926]: [2026-09-20 09:32:26.508][926][info][main] [source/server/server.cc:531] HTTP header map info:4093lb # [ 18.554218] envoy[926]: [2026-09-20 09:32:26.549][926][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4094lb # [ 18.567516] envoy[926]: [2026-09-20 09:32:26.549][926][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4095lb # [ 18.568925] envoy[926]: [2026-09-20 09:32:26.549][926][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4096lb # [ 18.576954] envoy[926]: [2026-09-20 09:32:26.549][926][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4097lb # [ 18.610422] envoy[926]: [2026-09-20 09:32:26.725][926][info][main] [source/server/server.cc:968] runtime: {}4098lb # [ 18.616368] envoy[926]: [2026-09-20 09:32:26.731][926][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4099lb # [ 18.618428] envoy[926]: [2026-09-20 09:32:26.733][926][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014100lb # [ 18.620871] envoy[926]: [2026-09-20 09:32:26.736][926][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014101lb # [ 18.623773] envoy[926]: [2026-09-20 09:32:26.739][926][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4102lb # [ 18.625399] envoy[926]: [2026-09-20 09:32:26.740][926][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4103lb # [ 18.626919] envoy[926]: [2026-09-20 09:32:26.740][926][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4104lb # [ 18.672513] envoy[926]: [2026-09-20 09:32:26.787][926][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4105worker1 # [ 18.643172] systemd[1]: Starting Nix worker-protocol over gRPC...4106worker2 # [ 18.676617] systemd[1]: Starting Nix worker-protocol over gRPC...4107lb # [ 18.699478] envoy[926]: [2026-09-20 09:32:26.814][926][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4108lb # [ 18.702799] envoy[926]: [2026-09-20 09:32:26.818][926][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4109lb # [ 18.705721] envoy[926]: [2026-09-20 09:32:26.818][926][info][main] [source/server/server.cc:1077] starting main dispatch loop4110worker1 # [ 18.829289] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4111worker1 # [ 18.840949] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14112worker2 # [ 18.898784] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4113worker1 # [ 18.879257] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4114worker2 # [ 18.910562] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14115worker1 # [ 18.882565] systemd[1]: Started Nix worker-protocol over gRPC.4116worker2 # [ 18.949125] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4117worker2 # [ 18.952229] systemd[1]: Started Nix worker-protocol over gRPC.4118lb # [ 18.968985] envoy[926]: [2026-09-20 09:32:27.084][926][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4119lb # [ 18.971052] envoy[926]: [2026-09-20 09:32:27.086][926][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4120lb # [ 18.972913] envoy[926]: [2026-09-20 09:32:27.088][926][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4121lb # [ 18.974882] envoy[926]: [2026-09-20 09:32:27.090][926][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4122worker1 # [ 18.956564] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514123worker1 # [ 18.965147] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4124worker2 # [ 19.020188] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4125worker1 # [ 19.166281] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514126worker1 # [ 19.170312] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4127worker2 # [ 19.221363] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514128worker2 # [ 19.225212] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4129worker1 # [ 19.371184] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 19.374971] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4131worker2 # [ 19.425546] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514132worker2 # [ 19.427314] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4133worker1 # [ 19.576115] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514134worker1 # [ 19.580337] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4135worker2 # [ 19.628231] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514136worker2 # [ 19.631483] nix-grpc-daemon[784]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4137worker1 # [ 19.780792] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514138worker1 # [ 19.784543] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4139worker2 # [ 19.832332] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514140worker2 # [ 19.836259] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4141worker1 # [ 19.986442] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514142worker1 # [ 19.989591] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4143worker2 # [ 20.038513] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514144worker2 # [ 20.041858] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4145worker1 # [ 20.187496] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514146worker1 # [ 20.191730] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4147worker2 # [ 20.238980] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514148worker2 # [ 20.243115] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4149worker1 # [ 20.392926] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514150worker1 # [ 20.396733] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4151worker2 # [ 20.444319] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514152worker2 # [ 20.448149] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4153worker1 # [ 20.597826] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514154worker1 # [ 20.601612] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4155worker2 # [ 20.648925] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514156worker2 # [ 20.652957] nix-grpc-daemon[784]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4157worker1 # [ 20.802194] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514158worker1 # [ 20.804173] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4159worker2 # [ 20.853521] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514160worker2 # [ 20.855516] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4161worker1 # [ 21.006380] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514162worker1 # [ 21.009488] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4163worker2 # [ 21.057453] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514164worker2 # [ 21.061117] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4165worker1 # [ 21.207370] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514166worker1 # [ 21.211303] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4167worker2 # [ 21.261962] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514168worker2 # [ 21.265871] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4169worker1 # [ 21.411769] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514170worker1 # [ 21.413599] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4171worker2 # [ 21.466299] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514172worker2 # [ 21.468059] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4173worker1 # [ 21.614229] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514174worker1 # [ 21.616101] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4175worker2 # [ 21.668627] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514176worker2 # [ 21.670426] nix-grpc-daemon[784]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4177worker1 # [ 21.816768] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514178worker1 # [ 21.818576] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4179worker2 # [ 21.870949] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514180worker2 # [ 21.872709] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4181worker1 # [ 22.020966] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 22.024182] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4183worker2 # [ 22.073644] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514184worker2 # [ 22.075320] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4185worker1 # [ 22.222171] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514186worker1 # [ 22.225869] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4187worker2 # [ 22.276413] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514188worker2 # [ 22.280185] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4189worker1 # [ 22.426733] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 22.430675] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4191worker2 # [ 22.480941] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514192worker2 # [ 22.484703] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4193worker1 # [ 22.631678] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 22.635671] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4195worker2 # [ 22.685558] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514196worker2 # [ 22.689415] nix-grpc-daemon[784]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4197worker1 # [ 22.836312] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514198worker1 # [ 22.839464] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4199worker2 # [ 22.890411] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514200worker2 # [ 22.894371] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4201worker1 # [ 23.041738] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 23.044831] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4203worker2 # [ 23.096460] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514204worker2 # [ 23.099586] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4205worker1 # [ 23.242354] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 23.246212] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4207worker2 # [ 23.297535] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514208worker2 # [ 23.301431] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4209worker1 # [ 23.447196] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514210worker1 # [ 23.450954] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4211worker2 # [ 23.502263] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514212worker2 # [ 23.506107] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4213worker1 # [ 23.651722] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 23.655610] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4215worker2 # [ 23.707064] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514216worker2 # [ 23.710832] nix-grpc-daemon[784]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4217worker1 # [ 23.856500] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514218worker1 # [ 23.860304] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4219worker2 # [ 23.911843] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514220worker2 # [ 23.915790] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4221worker1 # [ 24.062273] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514222worker1 # [ 24.065325] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4223worker2 # [ 24.118134] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514224worker2 # [ 24.121352] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4225worker1 # [ 24.263092] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 24.266996] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4227worker2 # [ 24.318147] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514228worker2 # [ 24.320105] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4229worker1 # [ 24.467836] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 24.471737] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4231worker2 # [ 24.521154] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514232worker2 # [ 24.524994] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4233worker1 # [ 24.672637] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 24.676658] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4235worker2 # [ 24.725228] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514236worker2 # [ 24.726944] nix-grpc-daemon[784]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4237worker1 # [ 24.877423] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514238worker1 # [ 24.881262] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4239worker2 # [ 24.927497] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514240worker2 # [ 24.929290] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4241worker1 # [ 25.083404] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 25.086544] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4243worker2 # [ 25.131484] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514244worker2 # [ 25.134544] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4245worker1 # [ 25.283930] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 25.285954] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4247worker2 # [ 25.332427] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514248worker2 # [ 25.336471] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4249worker1 # [ 25.486699] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 25.488541] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4251worker2 # [ 25.537325] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514252worker2 # [ 25.541298] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4253worker1 # [ 25.689405] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514254worker1 # [ 25.693322] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4255worker2 # [ 25.742367] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514256worker2 # [ 25.746468] nix-grpc-daemon[784]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4257worker1 # [ 25.893606] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 25.895308] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4259worker2 # [ 25.947373] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514260worker2 # [ 25.950979] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4261worker1 # [ 26.096983] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514262worker1 # [ 26.100618] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4263worker2 # [ 26.150072] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514264worker2 # [ 26.153720] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4265worker1 # [ 26.301602] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 26.305433] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4267worker2 # [ 26.351781] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514268worker2 # [ 26.355684] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4269worker1 # [ 26.506285] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 26.510167] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4271worker2 # [ 26.556587] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514272worker2 # [ 26.560394] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4273worker1 # [ 26.711088] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514274worker1 # [ 26.714729] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4275worker2 # [ 26.758345] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514276worker2 # [ 26.762149] nix-grpc-daemon[784]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4277worker1 # [ 26.915491] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514278worker1 # [ 26.919389] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4279worker2 # [ 26.960532] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514280worker2 # [ 26.963765] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4281worker1 # [ 27.120348] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514282worker1 # [ 27.122072] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4283worker2 # [ 27.166296] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514284worker2 # [ 27.169449] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4285lb # [ 27.238108] rustfs-bucket-start[1018]: mb s3://farm4286lb # [ 27.243570] systemd[1]: Finished rustfs-bucket.service.4287lb # [ 27.249701] systemd[1]: Starting niks3 server...4288worker1 # [ 27.323247] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514289worker1 # [ 27.326915] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4290worker2 # [ 27.366850] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514291worker2 # [ 27.370741] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4292lb # [ 27.480571] postgres[1037]: [1037] ERROR: relation "goose_db_version" does not exist at character 364293lb # [ 27.481807] postgres[1037]: [1037] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4294lb # [ 27.519322] niks3-server[1027]: 2026/09/20 09:32:35 OK 20241026095416_initial_model.sql (20.04ms)4295lb # [ 27.523439] niks3-server[1027]: 2026/09/20 09:32:35 OK 20251210153512_drop_unused_gin_index.sql (2.82ms)4296lb # [ 27.528447] niks3-server[1027]: 2026/09/20 09:32:35 OK 20251218171726_add_pins.sql (4.94ms)4297lb # [ 27.533396] niks3-server[1027]: 2026/09/20 09:32:35 OK 20260628120000_add_object_size_and_stats.sql (4.88ms)4298lb # [ 27.537581] niks3-server[1027]: 2026/09/20 09:32:35 OK 20260905000000_add_claims.sql (4.16ms)4299lb # [ 27.541987] niks3-server[1027]: 2026/09/20 09:32:35 OK 20260920000000_drop_claims.sql (4.32ms)4300lb # [ 27.543268] niks3-server[1027]: 2026/09/20 09:32:35 goose: successfully migrated database to version: 202609200000004301lb # [ 27.548265] niks3-server[1027]: 2026/09/20 09:32:35 OK 1_commit_pending_closure.sql (6.35ms)4302lb # [ 27.550674] niks3-server[1027]: 2026/09/20 09:32:35 OK 2_object_stats_trigger.sql (1.16ms)4303lb # [ 27.551918] niks3-server[1027]: 2026/09/20 09:32:35 goose: up to current file version: 24304lb # [ 27.557858] niks3-server[1027]: 2026/09/20 09:32:35 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4305worker1 # [ 27.528082] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514306worker1 # [ 27.531762] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4307worker2 # [ 27.571558] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514308worker2 # [ 27.575484] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4309lb # [ 27.625044] niks3-server[1027]: 2026/09/20 09:32:35 INFO Read proxy enabled — serving cache objects from S34310lb # [ 27.626718] niks3-server[1027]: 2026/09/20 09:32:35 INFO Using socket-activated listener address=0.0.0.0:57514311lb # [ 27.633078] niks3-server[1027]: 2026/09/20 09:32:35 INFO systemd watchdog enabled interval=15s4312lb # [ 27.634324] systemd[1]: Started niks3 server.4313lb # [ 27.634953] systemd[1]: Reached target Multi-User System.4314lb # [ 27.636891] systemd[1]: Startup finished in 859ms (kernel) + 4.063s (initrd) + 22.714s (userspace) = 27.636s.4315lb # [ 27.638637] niks3-server[1027]: 2026/09/20 09:32:35 INFO Starting HTTP server address=0.0.0.0:57514316lb # [ 27.643526] niks3-server[1027]: 2026/09/20 09:32:35 INFO lead: acquired remote=192.168.1.4:601664317worker2 # [ 27.646426] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_take_over4318worker1 # [ 27.732703] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514319worker1 # [ 27.736418] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4320worker2 # [ 27.776259] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514321worker2 # [ 27.780263] nix-grpc-daemon[784]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4322worker1 # [ 27.937380] nix-grpc-daemon[784]: ts=2026-09-20T09:32:36Z level=info event=scheduler_connected addr=lb:500514323worker1 # [ 27.941180] nix-grpc-daemon[784]: ts=2026-09-20T09:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4324worker2 # [ 27.981183] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514325worker2 # [ 27.984873] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4326worker1 # [ 28.142833] nix-grpc-daemon[784]: ts=2026-09-20T09:32:36Z level=info event=scheduler_connected addr=lb:500514327worker2 # [ 28.189563] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514328worker2 # [ 28.193359] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04329worker2 # [ 28.199006] nix-grpc-daemon[784]: ts=2026-09-20T09:32:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04330lb: (finished: waiting for unit niks3.service, in 17.33 seconds)4331lb: waiting for TCP port 5751 on localhost4332lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4333lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4334lb: waiting for unit envoy.service4335lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4336lb: waiting for TCP port 50051 on localhost4337lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4338lb # [ 28.579784] envoy[926]: conn peer=[::1]:39568 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24339lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4340lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4341lb: must succeed: curl -sf localhost:9901/clusters4342lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4343lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4344subtest: one node schedules and both builders hold a WorkerSession on it4345lb: must succeed: curl -sf localhost:9901/clusters4346lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4347worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4348worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4349lb: must succeed: curl -sf localhost:9901/clusters4350lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4351lb: must succeed: curl -sf localhost:9901/clusters4352lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4353worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true4354worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.07 seconds)4355lb: must succeed: curl -sf localhost:9901/clusters4356lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4357lb: must succeed: curl -sf localhost:9901/clusters4358lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4359worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true4360worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.09 seconds)4361worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true4362worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true, in 0.04 seconds)4363worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true4364worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true, in 0.04 seconds)4365worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true4366worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true, in 0.04 seconds)4367(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.59 seconds)4368subtest: balancer auth: client cert, bearer token, nothing, unknown CN4369worker2 # [ 29.689546] nix-grpc-daemon[784]: ts=2026-09-20T09:32:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:339064370worker2 # [ 29.702080] systemd[1]: Started Nix Daemon.4371worker2 # [ 29.901218] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4372worker2 # [ 29.948342] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5)4373worker2 # [ 29.966771] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5)4374worker2 # [ 30.072543] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 3/5)4375worker2 # [ 30.271783] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 511 ms (attempt 4/5)4376worker2 # [ 30.793359] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4377worker1 # [ 30.799854] nix-grpc-daemon[784]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:380964378worker1 # [ 30.812828] systemd[1]: Started Nix Daemon.4379worker1 # [ 31.029336] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4380worker1 # [ 31.057977] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 1/5)4381worker1 # [ 31.116188] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5)4382worker1 # [ 31.185475] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 388 ms (attempt 3/5)4383worker1 # [ 31.573782] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 634 ms (attempt 4/5)4384worker1 # [ 32.216477] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4385worker1 # [ 32.237972] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=path_info_miss path=rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test error="error: path '/nix/store/rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test' is required, but there is no substituter that can build it"4386worker2 # [ 32.282758] nix-grpc-daemon[784]: ts=2026-09-20T09:32:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:339064387worker2 # [ 32.301091] nix-grpc-daemon[784]: ts=2026-09-20T09:32:39Z level=debug event=path_info_miss path=rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test error="error: path '/nix/store/rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test' is required, but there is no substituter that can build it"4388client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4389client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)4390client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4391client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4392worker1 # [ 32.663220] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=info event=oidc_jwks provider=mock keys=14393worker1 # [ 32.665447] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:380964394worker1 # [ 32.675641] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:380964395worker1 # [ 32.679582] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=path_info_miss path=rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test error="error: path '/nix/store/rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test' is required, but there is no substituter that can build it"4396worker1 # [ 32.683277] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:380964397worker1 # [ 32.687091] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=path_info_miss path=rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test error="error: path '/nix/store/rd92mric7clp2ajnph200byp8g4917j4-nixos-system-client-test' is required, but there is no substituter that can build it"4398client: must succeed: rm -r /var/lib/nix-grpc-store4399client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4400worker2 # [ 32.978470] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=info event=denied method=QueryMissing cn=- role=none4401worker1 # [ 33.163481] nix-grpc-daemon[784]: ts=2026-09-20T09:32:41Z level=info event=denied method=QueryMissing cn=stranger role=none4402(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.83 seconds)4403subtest: DAG build is scheduled across workers and lands in the cache4404client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24405worker2 # [ 33.442317] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:339064406client # don't know how to build these paths:4407client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4408worker1 # [ 33.424308] nix-grpc-daemon[784]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964409worker2 # [ 33.488247] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04410worker2 # [ 33.490890] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14411worker2 # [ 33.543765] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064412worker2 # [ 33.562272] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064413client # copying 1 paths to 'lb:50051'...4414worker2 # [ 33.571970] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339064415client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4416worker2 # [ 33.595569] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4417worker2 # [ 33.613604] nix-grpc-daemon[784]: ts=2026-09-20T09:32:40Z level=info event=niks3_push_started pid=8824418worker2 # [ 34.016360] nix-daemon[870]: accepted connection from pid 894, user nix-grpc-daemon (trusted)4419worker2 # [ 34.034452] nix-daemon[870]: reaped child process 897, status = succeeded4420worker2 # [ 34.171675] nix-daemon[870]: accepted connection from pid 899, user nix-grpc-daemon (trusted)4421worker2 # [ 34.185278] nix-daemon[870]: reaped child process 902, status = succeeded4422lb # [ 34.201670] niks3-server[1027]: 2026/09/20 09:32:42 INFO Received uploads request method=POST path=/api/pending_closures4423worker2 # [ 34.225587] nix-grpc-daemon[882]: time=2026-09-20T09:32:41.443Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4424worker2 # [ 34.229106] nix-grpc-daemon[882]: time=2026-09-20T09:32:41.447Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4425lb # [ 34.271502] niks3-server[1027]: 2026/09/20 09:32:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4426lb # [ 34.291456] niks3-server[1027]: 2026/09/20 09:32:42 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4427lb # [ 34.302918] niks3-server[1027]: 2026/09/20 09:32:42 INFO Signed narinfos id=1 count=14428worker2 # [ 34.302863] nix-grpc-daemon[882]: time=2026-09-20T09:32:41.519Z level=INFO msg="Uploading 1 narinfos"4429lb # [ 34.316239] niks3-server[1027]: 2026/09/20 09:32:42 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4430lb # [ 34.318967] niks3-server[1027]: 2026/09/20 09:32:42 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4431lb # [ 34.328222] niks3-server[1027]: 2026/09/20 09:32:42 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4432lb # [ 34.332095] niks3-server[1027]: 2026/09/20 09:32:42 INFO Completed upload id=14433worker2 # [ 34.328118] nix-grpc-daemon[882]: time=2026-09-20T09:32:41.547Z level=INFO msg="Upload complete. (459ms)"4434worker2 # [ 34.332489] nix-grpc-daemon[784]: ts=2026-09-20T09:32:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_in=5044435worker2 # [ 34.339588] nix-grpc-daemon[784]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064436worker2 # [ 34.351117] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4437worker2 # [ 34.358688] nix-daemon[870]: reaped child process 880, status = succeeded4438worker2 # [ 34.364180] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4439client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4440client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4441client # farm-a> LOG-farm-a-t14442worker2 # [ 35.376992] nix-daemon[870]: reaped child process 906, status = succeeded4443worker2 # [ 35.530179] nix-daemon[870]: accepted connection from pid 921, user nix-grpc-daemon (trusted)4444worker2 # [ 35.544462] nix-daemon[870]: reaped child process 924, status = succeeded4445lb # [ 35.564784] niks3-server[1027]: 2026/09/20 09:32:43 INFO Received uploads request method=POST path=/api/pending_closures4446worker2 # [ 35.567876] nix-grpc-daemon[882]: time=2026-09-20T09:32:42.787Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4447worker2 # [ 35.569465] nix-grpc-daemon[882]: time=2026-09-20T09:32:42.788Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4448lb # [ 35.605666] niks3-server[1027]: 2026/09/20 09:32:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4449lb # [ 35.607697] niks3-server[1027]: 2026/09/20 09:32:43 INFO Signed narinfos id=2 count=14450worker2 # [ 35.603800] nix-grpc-daemon[882]: time=2026-09-20T09:32:42.822Z level=INFO msg="Uploading 1 narinfos"4451lb # [ 35.612920] niks3-server[1027]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4452lb # [ 35.615669] niks3-server[1027]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4453lb # [ 35.618875] niks3-server[1027]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4454lb # [ 35.622061] niks3-server[1027]: 2026/09/20 09:32:43 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4455lb # [ 35.627853] niks3-server[1027]: 2026/09/20 09:32:43 INFO Completed upload id=24456worker2 # [ 35.623403] nix-grpc-daemon[882]: time=2026-09-20T09:32:42.842Z level=INFO msg="Upload complete. (250ms)"4457lb # [ 35.629753] niks3-server[1027]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4458worker2 # [ 35.626539] nix-grpc-daemon[784]: ts=2026-09-20T09:32:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14459worker2 # [ 35.641926] nix-daemon[870]: reaped child process 904, status = succeeded4460worker2 # [ 35.643393] nix-grpc-daemon[784]: ts=2026-09-20T09:32:42Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04461worker2 # [ 35.645440] nix-grpc-daemon[784]: ts=2026-09-20T09:32:42Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14462worker2 # [ 35.686239] nix-grpc-daemon[784]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064463worker2 # [ 35.695321] nix-grpc-daemon[784]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064464worker2 # [ 35.704929] nix-grpc-daemon[882]: time=2026-09-20T09:32:42.924Z level=INFO msg="All 1 paths already cached"4465client # copying 1 paths to 'lb:50051'...4466worker2 # [ 35.711391] nix-grpc-daemon[784]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339064467client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4468worker2 # [ 35.719546] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4469worker2 # [ 35.901277] nix-daemon[870]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4470worker2 # [ 35.916348] nix-daemon[870]: reaped child process 935, status = succeeded4471worker2 # [ 36.068176] nix-daemon[870]: accepted connection from pid 937, user nix-grpc-daemon (trusted)4472worker2 # [ 36.081752] nix-daemon[870]: reaped child process 940, status = succeeded4473lb # [ 36.096832] niks3-server[1027]: 2026/09/20 09:32:44 INFO Received uploads request method=POST path=/api/pending_closures4474worker2 # [ 36.177077] nix-grpc-daemon[882]: time=2026-09-20T09:32:43.395Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4475worker2 # [ 36.179877] nix-grpc-daemon[882]: time=2026-09-20T09:32:43.395Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4476lb # [ 36.203364] niks3-server[1027]: 2026/09/20 09:32:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4477lb # [ 36.207959] niks3-server[1027]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4478lb # [ 36.213721] niks3-server[1027]: 2026/09/20 09:32:44 INFO Signed narinfos id=3 count=14479worker2 # [ 36.212689] nix-grpc-daemon[882]: time=2026-09-20T09:32:43.431Z level=INFO msg="Uploading 1 narinfos"4480lb # [ 36.224154] niks3-server[1027]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4481lb # [ 36.234682] niks3-server[1027]: 2026/09/20 09:32:44 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4482lb # [ 36.240694] niks3-server[1027]: 2026/09/20 09:32:44 INFO Completed upload id=34483worker2 # [ 36.239099] nix-grpc-daemon[882]: time=2026-09-20T09:32:43.458Z level=INFO msg="Upload complete. (511ms)"4484lb # [ 36.245091] niks3-server[1027]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4485worker2 # [ 36.244443] nix-grpc-daemon[784]: ts=2026-09-20T09:32:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_in=6244486worker2 # [ 36.250154] nix-grpc-daemon[784]: ts=2026-09-20T09:32:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064487worker2 # [ 36.262339] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4488worker2 # [ 36.273332] nix-daemon[870]: reaped child process 929, status = succeeded4489client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4490worker2 # [ 36.283055] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4491client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4492client # farm-b> LOG-farm-b-t14493worker2 # [ 37.301375] nix-daemon[870]: reaped child process 944, status = succeeded4494worker2 # [ 37.446804] nix-daemon[870]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4495worker2 # [ 37.460475] nix-daemon[870]: reaped child process 962, status = succeeded4496lb # [ 37.476344] niks3-server[1027]: 2026/09/20 09:32:45 INFO Received uploads request method=POST path=/api/pending_closures4497worker2 # [ 37.482144] nix-grpc-daemon[882]: time=2026-09-20T09:32:44.701Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4498worker2 # [ 37.484356] nix-grpc-daemon[882]: time=2026-09-20T09:32:44.703Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4499lb # [ 37.516144] niks3-server[1027]: 2026/09/20 09:32:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4500lb # [ 37.521709] niks3-server[1027]: 2026/09/20 09:32:45 INFO Signed narinfos id=4 count=14501worker2 # [ 37.521237] nix-grpc-daemon[882]: time=2026-09-20T09:32:44.740Z level=INFO msg="Uploading 1 narinfos"4502lb # [ 37.532388] niks3-server[1027]: 2026/09/20 09:32:45 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4503lb # [ 37.538276] niks3-server[1027]: 2026/09/20 09:32:45 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4504lb # [ 37.547384] niks3-server[1027]: 2026/09/20 09:32:45 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4505worker2 # [ 37.549524] nix-grpc-daemon[882]: time=2026-09-20T09:32:44.768Z level=INFO msg="Upload complete. (255ms)"4506lb # [ 37.553964] niks3-server[1027]: 2026/09/20 09:32:45 INFO Completed upload id=44507lb # [ 37.556536] niks3-server[1027]: 2026/09/20 09:32:45 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4508lb # [ 37.559339] niks3-server[1027]: 2026/09/20 09:32:45 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4509worker2 # [ 37.553867] nix-grpc-daemon[784]: ts=2026-09-20T09:32:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14510worker2 # [ 37.566458] nix-grpc-daemon[784]: ts=2026-09-20T09:32:44Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04511worker2 # [ 37.571188] nix-grpc-daemon[784]: ts=2026-09-20T09:32:44Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14512worker2 # [ 37.579136] nix-daemon[870]: reaped child process 942, status = succeeded4513worker2 # [ 37.610917] nix-grpc-daemon[784]: ts=2026-09-20T09:32:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064514worker2 # [ 37.623814] nix-grpc-daemon[784]: ts=2026-09-20T09:32:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064515worker2 # [ 37.640361] nix-grpc-daemon[882]: time=2026-09-20T09:32:44.859Z level=INFO msg="All 2 paths already cached"4516client # copying 1 paths to 'lb:50051'...4517client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4518worker2 # [ 37.647867] nix-grpc-daemon[784]: ts=2026-09-20T09:32:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339064519worker2 # [ 37.660175] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4520worker2 # [ 37.821125] nix-daemon[870]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4521worker2 # [ 37.834537] nix-daemon[870]: reaped child process 971, status = succeeded4522worker2 # [ 37.993277] nix-daemon[870]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4523worker2 # [ 38.005320] nix-daemon[870]: reaped child process 976, status = succeeded4524lb # [ 38.024172] niks3-server[1027]: 2026/09/20 09:32:46 INFO Received uploads request method=POST path=/api/pending_closures4525worker2 # [ 38.028338] nix-grpc-daemon[882]: time=2026-09-20T09:32:45.247Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4526worker2 # [ 38.030250] nix-grpc-daemon[882]: time=2026-09-20T09:32:45.249Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4527lb # [ 38.052222] niks3-server[1027]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4528lb # [ 38.063384] niks3-server[1027]: 2026/09/20 09:32:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4529worker2 # [ 38.064850] nix-grpc-daemon[882]: time=2026-09-20T09:32:45.284Z level=INFO msg="Uploading 1 narinfos"4530lb # [ 38.069849] niks3-server[1027]: 2026/09/20 09:32:46 INFO Signed narinfos id=5 count=14531lb # [ 38.075947] niks3-server[1027]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4532lb # [ 38.086941] niks3-server[1027]: 2026/09/20 09:32:46 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4533lb # [ 38.092189] niks3-server[1027]: 2026/09/20 09:32:46 INFO Completed upload id=54534worker2 # [ 38.090041] nix-grpc-daemon[882]: time=2026-09-20T09:32:45.309Z level=INFO msg="Upload complete. (418ms)"4535worker2 # [ 38.092174] nix-grpc-daemon[784]: ts=2026-09-20T09:32:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_in=7524536lb # [ 38.096311] niks3-server[1027]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4537worker2 # [ 38.098398] nix-grpc-daemon[784]: ts=2026-09-20T09:32:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064538worker2 # [ 38.102119] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4539worker2 # [ 38.104292] nix-daemon[870]: reaped child process 966, status = succeeded4540client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4541worker2 # [ 38.110447] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4542client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4543lb # [ 38.682720] envoy[926]: conn peer=[2001:db8:1::1]:44028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=26644544lb # [ 38.687840] envoy[926]: conn peer=[2001:db8:1::1]:44032 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=424545lb # [ 38.692862] envoy[926]: conn peer=[2001:db8:1::1]:57780 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=114546lb # [ 38.696599] envoy[926]: conn peer=[2001:db8:1::1]:57784 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=124547client # farm-top> LOG-farm-top-t14548worker2 # [ 38.721259] nix-daemon[870]: reaped child process 980, status = succeeded4549worker2 # [ 38.884800] nix-daemon[870]: accepted connection from pid 995, user nix-grpc-daemon (trusted)4550worker2 # [ 38.896116] nix-daemon[870]: reaped child process 999, status = succeeded4551lb # [ 38.917360] niks3-server[1027]: 2026/09/20 09:32:47 INFO Received uploads request method=POST path=/api/pending_closures4552worker2 # [ 38.923055] nix-grpc-daemon[882]: time=2026-09-20T09:32:46.142Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4553worker2 # [ 38.925053] nix-grpc-daemon[882]: time=2026-09-20T09:32:46.143Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4554lb # [ 38.955215] niks3-server[1027]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4555lb # [ 38.960283] niks3-server[1027]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4556lb # [ 38.973548] niks3-server[1027]: 2026/09/20 09:32:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4557lb # [ 38.979811] niks3-server[1027]: 2026/09/20 09:32:47 INFO Signed narinfos id=6 count=14558worker2 # [ 38.978562] nix-grpc-daemon[882]: time=2026-09-20T09:32:46.197Z level=INFO msg="Uploading 1 narinfos"4559lb # [ 38.982895] niks3-server[1027]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4560lb # [ 38.993915] niks3-server[1027]: 2026/09/20 09:32:47 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4561lb # [ 39.001156] niks3-server[1027]: 2026/09/20 09:32:47 INFO Completed upload id=64562worker2 # [ 38.996727] nix-grpc-daemon[882]: time=2026-09-20T09:32:46.216Z level=INFO msg="Upload complete. (280ms)"4563lb # [ 39.002945] niks3-server[1027]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4564worker2 # [ 38.999198] nix-grpc-daemon[784]: ts=2026-09-20T09:32:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14565worker2 # [ 39.006487] nix-daemon[870]: reaped child process 978, status = succeeded4566client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 5.81 seconds)4567client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4568client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4569client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4570client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4571client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4572client # copying 3 paths...4573client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4574client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4575client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4576client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4577(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.36 seconds)4578subtest: repeat is answered Cached by the scheduler without building4579worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4580worker1 # finding garbage collector roots...4581worker1 # deleting specified paths...4582worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4583worker1 # deleting unused links...4584worker1 # note: hard linking is currently saving 0.0 KiB4585worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4586worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4587worker2 # finding garbage collector roots...4588worker2 # deleting specified paths...4589worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4590worker2 # deleting unused links...4591worker2 # note: hard linking is currently saving 0.0 KiB4592worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.22 seconds)4593client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24594worker2 # [ 40.232071] nix-grpc-daemon[784]: ts=2026-09-20T09:32:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:339064595client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4596client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4597worker1 # [ 40.221839] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964598worker2 # [ 40.279483] nix-grpc-daemon[784]: ts=2026-09-20T09:32:47Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14599client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.28 seconds)4600client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4601client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4602lb: must succeed: curl -sf localhost:9901/clusters4603lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4604lb: must succeed: curl -sf localhost:9901/clusters4605lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4606worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4607worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.07 seconds)4608(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.18 seconds)4609subtest: inputs already in the cache are not sent to the scheduler4610lb: must succeed: curl -sf localhost:9901/clusters4611lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4612lb: must succeed: curl -sf localhost:9901/clusters4613lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4614worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4615worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4616client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24617worker2 # [ 41.118682] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:339064618client # don't know how to build these paths:4619client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4620worker1 # [ 41.094123] nix-grpc-daemon[784]: ts=2026-09-20T09:32:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964621worker2 # [ 41.135598] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04622worker2 # [ 41.137613] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14623worker2 # [ 41.179641] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064624worker2 # [ 41.187937] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064625worker2 # [ 41.197048] nix-grpc-daemon[882]: time=2026-09-20T09:32:48.416Z level=INFO msg="All 2 paths already cached"4626client # copying 1 paths to 'lb:50051'...4627worker2 # [ 41.202391] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339064628client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4629worker2 # [ 41.208961] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4630worker2 # [ 41.363543] nix-daemon[870]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4631worker2 # [ 41.377208] nix-daemon[870]: reaped child process 1033, status = succeeded4632worker2 # [ 41.535453] nix-daemon[870]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)4633worker2 # [ 41.547923] nix-daemon[870]: reaped child process 1038, status = succeeded4634lb # [ 41.569476] niks3-server[1027]: 2026/09/20 09:32:49 INFO Received uploads request method=POST path=/api/pending_closures4635worker2 # [ 41.573440] nix-grpc-daemon[882]: time=2026-09-20T09:32:48.792Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4636worker2 # [ 41.574853] nix-grpc-daemon[882]: time=2026-09-20T09:32:48.792Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4637lb # [ 41.599814] niks3-server[1027]: 2026/09/20 09:32:49 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4638lb # [ 41.607880] niks3-server[1027]: 2026/09/20 09:32:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4639worker2 # [ 41.611187] nix-grpc-daemon[882]: time=2026-09-20T09:32:48.830Z level=INFO msg="Uploading 1 narinfos"4640lb # [ 41.615557] niks3-server[1027]: 2026/09/20 09:32:49 INFO Signed narinfos id=7 count=14641lb # [ 41.622096] niks3-server[1027]: 2026/09/20 09:32:49 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4642lb # [ 41.633287] niks3-server[1027]: 2026/09/20 09:32:49 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4643lb # [ 41.638475] niks3-server[1027]: 2026/09/20 09:32:49 INFO Completed upload id=74644worker2 # [ 41.636481] nix-grpc-daemon[882]: time=2026-09-20T09:32:48.855Z level=INFO msg="Upload complete. (422ms)"4645lb # [ 41.642616] niks3-server[1027]: 2026/09/20 09:32:49 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4646worker2 # [ 41.641497] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_in=7524647worker2 # [ 41.646528] nix-grpc-daemon[784]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064648worker2 # [ 41.656110] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4649worker2 # [ 41.660309] nix-daemon[870]: reaped child process 1028, status = succeeded4650client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4651client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4652worker2 # [ 41.665399] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4653client # farm-top> LOG-farm-top-t1b4654worker2 # [ 42.891953] nix-daemon[870]: reaped child process 1042, status = succeeded4655worker2 # [ 43.049783] nix-daemon[870]: accepted connection from pid 1058, user nix-grpc-daemon (trusted)4656worker2 # [ 43.062100] nix-daemon[870]: reaped child process 1061, status = succeeded4657lb # [ 43.082979] niks3-server[1027]: 2026/09/20 09:32:51 INFO Received uploads request method=POST path=/api/pending_closures4658worker2 # [ 43.087596] nix-grpc-daemon[882]: time=2026-09-20T09:32:50.306Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4659worker2 # [ 43.089713] nix-grpc-daemon[882]: time=2026-09-20T09:32:50.308Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4660lb # [ 43.124337] niks3-server[1027]: 2026/09/20 09:32:51 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4661lb # [ 43.133768] niks3-server[1027]: 2026/09/20 09:32:51 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4662lb # [ 43.140506] niks3-server[1027]: 2026/09/20 09:32:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4663lb # [ 43.146771] niks3-server[1027]: 2026/09/20 09:32:51 INFO Signed narinfos id=8 count=14664worker2 # [ 43.145192] nix-grpc-daemon[882]: time=2026-09-20T09:32:50.364Z level=INFO msg="Uploading 1 narinfos"4665lb # [ 43.151886] niks3-server[1027]: 2026/09/20 09:32:51 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4666lb # [ 43.161824] niks3-server[1027]: 2026/09/20 09:32:51 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4667lb # [ 43.166285] niks3-server[1027]: 2026/09/20 09:32:51 INFO Completed upload id=84668worker2 # [ 43.163719] nix-grpc-daemon[882]: time=2026-09-20T09:32:50.383Z level=INFO msg="Upload complete. (289ms)"4669lb # [ 43.169286] niks3-server[1027]: 2026/09/20 09:32:51 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4670worker2 # [ 43.169552] nix-grpc-daemon[784]: ts=2026-09-20T09:32:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14671worker2 # [ 43.180803] nix-daemon[870]: reaped child process 1040, status = succeeded4672client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.28 seconds)4673client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4674client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.19 seconds)4675lb: must succeed: curl -sf localhost:9901/clusters4676lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4677lb: must succeed: curl -sf localhost:9901/clusters4678lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4679worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4680worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4681(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.78 seconds)4682subtest: two clients wanting the same drv build it once4683client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4684client # [ 43.603910] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4685client # Running as unit: dedup1.service; invocation ID: 66b555018b71435495bf08f1f75d75ba4686client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4687client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4688worker1 # [ 43.793088] nix-grpc-daemon[784]: ts=2026-09-20T09:32:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:380964689client # [ 43.827418] nix[890]: don't know how to build these paths:4690client # [ 43.828321] nix[890]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4691worker1 # [ 43.808155] nix-grpc-daemon[784]: ts=2026-09-20T09:32:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380964692worker2 # [ 43.836614] nix-grpc-daemon[784]: ts=2026-09-20T09:32:51Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04693worker2 # [ 43.841454] nix-grpc-daemon[784]: ts=2026-09-20T09:32:51Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14694worker1 # [ 43.818740] nix-grpc-daemon[784]: ts=2026-09-20T09:32:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964695client # [ 43.856113] nix[890]: copying 1 paths to 'lb:50051'...4696client # [ 43.856881] nix[890]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4697worker1 # [ 43.825902] nix-grpc-daemon[784]: ts=2026-09-20T09:32:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:380964698worker1 # [ 43.832564] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4699worker1 # [ 43.843873] nix-grpc-daemon[784]: ts=2026-09-20T09:32:51Z level=info event=niks3_push_started pid=8734700worker1 # [ 44.205302] nix-daemon[847]: accepted connection from pid 886, user nix-grpc-daemon (trusted)4701worker1 # [ 44.222323] nix-daemon[847]: reaped child process 889, status = succeeded4702worker1 # [ 44.366335] nix-daemon[847]: accepted connection from pid 891, user nix-grpc-daemon (trusted)4703worker1 # [ 44.378434] nix-daemon[847]: reaped child process 894, status = succeeded4704lb # [ 44.423603] niks3-server[1027]: 2026/09/20 09:32:52 INFO Received uploads request method=POST path=/api/pending_closures4705worker1 # [ 44.398038] nix-grpc-daemon[873]: time=2026-09-20T09:32:52.490Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4706worker1 # [ 44.400931] nix-grpc-daemon[873]: time=2026-09-20T09:32:52.493Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4707lb # [ 44.457798] niks3-server[1027]: 2026/09/20 09:32:52 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4708lb # [ 44.468100] niks3-server[1027]: 2026/09/20 09:32:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4709lb # [ 44.473633] niks3-server[1027]: 2026/09/20 09:32:52 INFO Signed narinfos id=9 count=14710worker1 # [ 44.441149] nix-grpc-daemon[873]: time=2026-09-20T09:32:52.534Z level=INFO msg="Uploading 1 narinfos"4711lb # [ 44.483807] niks3-server[1027]: 2026/09/20 09:32:52 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4712lb # [ 44.492500] niks3-server[1027]: 2026/09/20 09:32:52 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4713worker1 # [ 44.463676] nix-grpc-daemon[873]: time=2026-09-20T09:32:52.557Z level=INFO msg="Upload complete. (395ms)"4714lb # [ 44.498943] niks3-server[1027]: 2026/09/20 09:32:52 INFO Completed upload id=94715worker1 # [ 44.465788] nix-grpc-daemon[784]: ts=2026-09-20T09:32:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=0 paths=1 nar_bytes_in=4324716lb # [ 44.502069] niks3-server[1027]: 2026/09/20 09:32:52 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4717worker1 # [ 44.472147] nix-grpc-daemon[784]: ts=2026-09-20T09:32:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380964718worker1 # [ 44.473845] nix-daemon[847]: reaped child process 871, status = succeeded4719worker1 # [ 44.477101] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4720worker1 # [ 44.483948] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4721client # [ 44.514362] nix[890]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4722client # [ 44.686563] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4723client # Running as unit: dedup2.service; invocation ID: e03fbe4fadfe460ca6319139b587ffef4724client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4725worker2 # [ 44.958649] nix-grpc-daemon[784]: ts=2026-09-20T09:32:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:339064726client # [ 44.960178] nix[906]: don't know how to build these paths:4727client # [ 44.961284] nix[906]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4728worker2 # [ 44.964280] nix-grpc-daemon[784]: ts=2026-09-20T09:32:52Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04729worker1 # [ 44.938788] nix-grpc-daemon[784]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380964730client # [ 44.974207] nix[906]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4731client: must succeed: sleep 24732client: (finished: must succeed: sleep 2, in 2.04 seconds)4733client: waiting for success: ! systemctl is-active dedup1 dedup24734worker1 # [ 48.100371] nix-daemon[847]: reaped child process 898, status = succeeded4735worker1 # [ 48.240363] nix-daemon[847]: accepted connection from pid 927, user nix-grpc-daemon (trusted)4736worker1 # [ 48.250879] nix-daemon[847]: reaped child process 930, status = succeeded4737lb # [ 48.302298] niks3-server[1027]: 2026/09/20 09:32:56 INFO Received uploads request method=POST path=/api/pending_closures4738worker1 # [ 48.275893] nix-grpc-daemon[873]: time=2026-09-20T09:32:56.369Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4739worker1 # [ 48.277739] nix-grpc-daemon[873]: time=2026-09-20T09:32:56.371Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4740lb # [ 48.348471] niks3-server[1027]: 2026/09/20 09:32:56 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4741lb # [ 48.356325] niks3-server[1027]: 2026/09/20 09:32:56 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4742lb # [ 48.370193] niks3-server[1027]: 2026/09/20 09:32:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4743lb # [ 48.374116] niks3-server[1027]: 2026/09/20 09:32:56 INFO Signed narinfos id=10 count=14744worker1 # [ 48.342037] nix-grpc-daemon[873]: time=2026-09-20T09:32:56.434Z level=INFO msg="Uploading 1 narinfos"4745lb # [ 48.378146] niks3-server[1027]: 2026/09/20 09:32:56 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4746lb # [ 48.388748] niks3-server[1027]: 2026/09/20 09:32:56 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4747lb # [ 48.391655] niks3-server[1027]: 2026/09/20 09:32:56 INFO Completed upload id=104748worker1 # [ 48.356459] nix-grpc-daemon[873]: time=2026-09-20T09:32:56.449Z level=INFO msg="Upload complete. (261ms)"4749lb # [ 48.393171] niks3-server[1027]: 2026/09/20 09:32:56 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4750worker1 # [ 48.359797] nix-grpc-daemon[784]: ts=2026-09-20T09:32:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14751worker1 # [ 48.364182] nix-grpc-daemon[784]: ts=2026-09-20T09:32:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14752worker1 # [ 48.370606] nix-daemon[847]: reaped child process 896, status = succeeded4753client # [ 48.430892] systemd[1]: dedup1.service: Deactivated successfully.4754client # [ 48.434812] systemd[1]: dedup1.service: Consumed 110ms CPU time over 4.830s wall clock time, 39.3M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.4755client # [ 48.476691] systemd[1]: dedup2.service: Deactivated successfully.4756client # [ 48.478565] systemd[1]: dedup2.service: Consumed 136ms CPU time over 3.792s wall clock time, 33.2M memory peak, 7.3K incoming IP traffic, 6.3K outgoing IP traffic.4757lb # [ 48.682605] envoy[926]: conn peer=[2001:db8:1::1]:57800 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9464 tx=3812 ms=56064758lb # [ 48.686326] envoy[926]: conn peer=[2001:db8:1::1]:57812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=624759lb # [ 48.689736] envoy[926]: conn peer=[2001:db8:1::1]:57820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1726 ms=20604760lb # [ 48.693305] envoy[926]: conn peer=[2001:db8:1::1]:44944 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2968 tx=1352 ms=45834761lb # [ 48.696758] envoy[926]: conn peer=[2001:db8:1::1]:44960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=35014762client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.12 seconds)4763client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4764client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds)4765worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4766worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4767worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4768worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4769worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4770worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4771worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4772worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4773(finished: subtest: two clients wanting the same drv build it once, in 5.99 seconds)4774subtest: build hook: nix-daemon with builders = grpc://lb4775client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4776client # [ 49.749346] systemd[1]: Started Nix Daemon.4777client # [ 49.926831] nix-daemon[948]: accepted connection from pid 945, user root (trusted)4778worker2 # [ 50.114348] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:339064779worker1 # [ 50.089796] nix-grpc-daemon[784]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964780worker2 # [ 50.134323] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04781worker2 # [ 50.136362] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14782worker2 # [ 50.177816] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064783worker2 # [ 50.186310] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064784worker2 # [ 50.194385] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339064785worker2 # [ 50.199676] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4786worker2 # [ 50.339581] nix-daemon[870]: accepted connection from pid 1099, user nix-grpc-daemon (trusted)4787worker2 # [ 50.353589] nix-daemon[870]: reaped child process 1102, status = succeeded4788worker2 # [ 50.515592] nix-daemon[870]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4789worker2 # [ 50.527592] nix-daemon[870]: reaped child process 1107, status = succeeded4790lb # [ 50.549636] niks3-server[1027]: 2026/09/20 09:32:58 INFO Received uploads request method=POST path=/api/pending_closures4791worker2 # [ 50.553953] nix-grpc-daemon[882]: time=2026-09-20T09:32:57.772Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4792worker2 # [ 50.555434] nix-grpc-daemon[882]: time=2026-09-20T09:32:57.772Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4793lb # [ 50.574448] niks3-server[1027]: 2026/09/20 09:32:58 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4794lb # [ 50.585561] niks3-server[1027]: 2026/09/20 09:32:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4795worker2 # [ 50.586495] nix-grpc-daemon[882]: time=2026-09-20T09:32:57.805Z level=INFO msg="Uploading 1 narinfos"4796lb # [ 50.591120] niks3-server[1027]: 2026/09/20 09:32:58 INFO Signed narinfos id=11 count=14797lb # [ 50.597850] niks3-server[1027]: 2026/09/20 09:32:58 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4798lb # [ 50.608097] niks3-server[1027]: 2026/09/20 09:32:58 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4799worker2 # [ 50.610669] nix-grpc-daemon[882]: time=2026-09-20T09:32:57.830Z level=INFO msg="Upload complete. (406ms)"4800lb # [ 50.615403] niks3-server[1027]: 2026/09/20 09:32:58 INFO Completed upload id=114801worker2 # [ 50.612583] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_in=5124802lb # [ 50.619705] niks3-server[1027]: 2026/09/20 09:32:58 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4803worker2 # [ 50.619698] nix-grpc-daemon[784]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064804worker2 # [ 50.629227] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4805worker2 # [ 50.631544] nix-daemon[870]: reaped child process 1097, status = succeeded4806worker2 # [ 50.637098] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4807worker2 # [ 51.866546] nix-daemon[870]: reaped child process 1111, status = succeeded4808worker2 # [ 52.021894] nix-daemon[870]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)4809worker2 # [ 52.033592] nix-daemon[870]: reaped child process 1129, status = succeeded4810lb # [ 52.053933] niks3-server[1027]: 2026/09/20 09:33:00 INFO Received uploads request method=POST path=/api/pending_closures4811worker2 # [ 52.057241] nix-grpc-daemon[882]: time=2026-09-20T09:32:59.276Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4812worker2 # [ 52.058950] nix-grpc-daemon[882]: time=2026-09-20T09:32:59.278Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4813lb # [ 52.087074] niks3-server[1027]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4814lb # [ 52.100846] niks3-server[1027]: 2026/09/20 09:33:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4815lb # [ 52.107813] niks3-server[1027]: 2026/09/20 09:33:00 INFO Signed narinfos id=12 count=14816worker2 # [ 52.107320] nix-grpc-daemon[882]: time=2026-09-20T09:32:59.326Z level=INFO msg="Uploading 1 narinfos"4817lb # [ 52.113124] niks3-server[1027]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4818lb # [ 52.118253] niks3-server[1027]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4819lb # [ 52.128244] niks3-server[1027]: 2026/09/20 09:33:00 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4820lb # [ 52.133977] niks3-server[1027]: 2026/09/20 09:33:00 INFO Completed upload id=124821lb # [ 52.135637] niks3-server[1027]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4822worker2 # [ 52.131171] nix-grpc-daemon[882]: time=2026-09-20T09:32:59.350Z level=INFO msg="Upload complete. (284ms)"4823worker2 # [ 52.138458] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14824worker1 # [ 52.111457] nix-grpc-daemon[784]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:380964825worker2 # [ 52.151253] nix-daemon[870]: reaped child process 1109, status = succeeded4826worker1 # [ 52.123305] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4827worker2 # [ 52.184312] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:339064828worker2 # [ 52.189885] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_out=1284829worker1 # [ 52.383070] nix-grpc-daemon[784]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:380964830worker2 # [ 52.421134] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064831worker2 # [ 52.430488] nix-grpc-daemon[882]: time=2026-09-20T09:32:59.649Z level=INFO msg="All 1 paths already cached"4832worker2 # [ 52.444257] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04833worker2 # [ 52.449590] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14834worker2 # [ 52.455264] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064835worker2 # [ 52.466419] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064836worker2 # [ 52.478475] nix-grpc-daemon[882]: time=2026-09-20T09:32:59.697Z level=INFO msg="All 1 paths already cached"4837worker2 # [ 52.485176] nix-grpc-daemon[784]: ts=2026-09-20T09:32:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339064838worker2 # [ 52.493557] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4839worker2 # [ 52.666711] nix-daemon[870]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)4840worker2 # [ 52.679669] nix-daemon[870]: reaped child process 1138, status = succeeded4841worker2 # [ 52.843496] nix-daemon[870]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)4842worker2 # [ 52.855928] nix-daemon[870]: reaped child process 1143, status = succeeded4843lb # [ 52.874666] niks3-server[1027]: 2026/09/20 09:33:00 INFO Received uploads request method=POST path=/api/pending_closures4844worker2 # [ 52.874373] nix-grpc-daemon[882]: time=2026-09-20T09:33:00.093Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4845worker2 # [ 52.876048] nix-grpc-daemon[882]: time=2026-09-20T09:33:00.095Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4846lb # [ 52.889059] niks3-server[1027]: 2026/09/20 09:33:01 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4847lb # [ 52.893404] niks3-server[1027]: 2026/09/20 09:33:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4848lb # [ 52.895149] niks3-server[1027]: 2026/09/20 09:33:01 INFO Signed narinfos id=13 count=14849worker2 # [ 52.890952] nix-grpc-daemon[882]: time=2026-09-20T09:33:00.110Z level=INFO msg="Uploading 1 narinfos"4850lb # [ 52.899055] niks3-server[1027]: 2026/09/20 09:33:01 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4851lb # [ 52.903264] niks3-server[1027]: 2026/09/20 09:33:01 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4852lb # [ 52.905860] niks3-server[1027]: 2026/09/20 09:33:01 INFO Completed upload id=134853worker2 # [ 52.901430] nix-grpc-daemon[882]: time=2026-09-20T09:33:00.120Z level=INFO msg="Upload complete. (395ms)"4854lb # [ 52.908433] niks3-server[1027]: 2026/09/20 09:33:01 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4855worker2 # [ 52.903376] nix-grpc-daemon[784]: ts=2026-09-20T09:33:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_in=6244856worker2 # [ 52.906932] nix-grpc-daemon[784]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064857worker2 # [ 52.912768] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4858worker2 # [ 52.915825] nix-daemon[870]: reaped child process 1133, status = succeeded4859worker2 # [ 52.920827] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4860worker2 # [ 53.732152] nix-daemon[870]: reaped child process 1147, status = succeeded4861worker2 # [ 53.883564] nix-daemon[870]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)4862worker2 # [ 53.895844] nix-daemon[870]: reaped child process 1165, status = succeeded4863lb # [ 53.917143] niks3-server[1027]: 2026/09/20 09:33:02 INFO Received uploads request method=POST path=/api/pending_closures4864worker2 # [ 53.923300] nix-grpc-daemon[882]: time=2026-09-20T09:33:01.141Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4865worker2 # [ 53.924619] nix-grpc-daemon[882]: time=2026-09-20T09:33:01.141Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4866lb # [ 53.950341] niks3-server[1027]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4867lb # [ 53.967838] niks3-server[1027]: 2026/09/20 09:33:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4868lb # [ 53.972093] niks3-server[1027]: 2026/09/20 09:33:02 INFO Signed narinfos id=14 count=14869worker2 # [ 53.970432] nix-grpc-daemon[882]: time=2026-09-20T09:33:01.189Z level=INFO msg="Uploading 1 narinfos"4870lb # [ 53.976876] niks3-server[1027]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4871lb # [ 53.987708] niks3-server[1027]: 2026/09/20 09:33:02 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4872lb # [ 54.011603] niks3-server[1027]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4873lb # [ 54.018734] niks3-server[1027]: 2026/09/20 09:33:02 INFO Completed upload id=144874worker2 # [ 54.014463] nix-grpc-daemon[882]: time=2026-09-20T09:33:01.233Z level=INFO msg="Upload complete. (287ms)"4875lb # [ 54.024690] niks3-server[1027]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4876worker2 # [ 54.022166] nix-grpc-daemon[784]: ts=2026-09-20T09:33:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14877worker2 # [ 54.035332] nix-daemon[870]: reaped child process 1145, status = succeeded4878worker2 # [ 54.065177] nix-grpc-daemon[784]: ts=2026-09-20T09:33:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:339064879worker1 # [ 54.052878] nix-grpc-daemon[784]: ts=2026-09-20T09:33:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:380964880worker1 # [ 54.057603] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4881worker1 # [ 54.063453] nix-grpc-daemon[784]: ts=2026-09-20T09:33:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=0 paths=1 nar_bytes_out=1764882worker1 # [ 54.345681] nix-grpc-daemon[784]: ts=2026-09-20T09:33:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:380964883worker1 # [ 54.348177] nix-grpc-daemon[784]: ts=2026-09-20T09:33:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964884worker1 # [ 54.355152] nix-grpc-daemon[873]: time=2026-09-20T09:33:02.448Z level=INFO msg="All 2 paths already cached"4885worker2 # [ 54.399700] nix-grpc-daemon[784]: ts=2026-09-20T09:33:01Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04886worker2 # [ 54.405444] nix-grpc-daemon[784]: ts=2026-09-20T09:33:01Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14887worker2 # [ 54.410304] nix-grpc-daemon[784]: ts=2026-09-20T09:33:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064888worker2 # [ 54.421087] nix-grpc-daemon[784]: ts=2026-09-20T09:33:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339064889worker2 # [ 54.433085] nix-grpc-daemon[882]: time=2026-09-20T09:33:01.652Z level=INFO msg="All 2 paths already cached"4890worker2 # [ 54.439843] nix-grpc-daemon[784]: ts=2026-09-20T09:33:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339064891worker2 # [ 54.447885] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4892worker2 # [ 54.612099] nix-daemon[870]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)4893worker2 # [ 54.624977] nix-daemon[870]: reaped child process 1174, status = succeeded4894worker2 # [ 54.774800] nix-daemon[870]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)4895worker2 # [ 54.786861] nix-daemon[870]: reaped child process 1179, status = succeeded4896lb # [ 54.806330] niks3-server[1027]: 2026/09/20 09:33:02 INFO Received uploads request method=POST path=/api/pending_closures4897worker2 # [ 54.810402] nix-grpc-daemon[882]: time=2026-09-20T09:33:02.029Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4898worker2 # [ 54.812372] nix-grpc-daemon[882]: time=2026-09-20T09:33:02.031Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4899lb # [ 54.832864] niks3-server[1027]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4900lb # [ 54.844975] niks3-server[1027]: 2026/09/20 09:33:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4901worker2 # [ 54.845443] nix-grpc-daemon[882]: time=2026-09-20T09:33:02.064Z level=INFO msg="Uploading 1 narinfos"4902lb # [ 54.849740] niks3-server[1027]: 2026/09/20 09:33:02 INFO Signed narinfos id=15 count=14903lb # [ 54.856199] niks3-server[1027]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4904lb # [ 54.867833] niks3-server[1027]: 2026/09/20 09:33:02 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4905lb # [ 54.874992] niks3-server[1027]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4906lb # [ 54.880095] niks3-server[1027]: 2026/09/20 09:33:02 INFO Completed upload id=154907worker2 # [ 54.875762] nix-grpc-daemon[882]: time=2026-09-20T09:33:02.095Z level=INFO msg="Upload complete. (414ms)"4908worker2 # [ 54.880125] nix-grpc-daemon[784]: ts=2026-09-20T09:33:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_in=7524909worker2 # [ 54.884603] nix-grpc-daemon[784]: ts=2026-09-20T09:33:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339064910worker2 # [ 54.895102] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4911worker2 # [ 54.903120] nix-daemon[870]: reaped child process 1169, status = succeeded4912worker2 # [ 54.906854] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4913worker2 # [ 56.135539] nix-daemon[870]: reaped child process 1183, status = succeeded4914worker2 # [ 56.261741] nix-daemon[870]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4915worker2 # [ 56.273079] nix-daemon[870]: reaped child process 1201, status = succeeded4916lb # [ 56.287816] niks3-server[1027]: 2026/09/20 09:33:04 INFO Received uploads request method=POST path=/api/pending_closures4917worker2 # [ 56.287762] nix-grpc-daemon[882]: time=2026-09-20T09:33:03.506Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4918worker2 # [ 56.289325] nix-grpc-daemon[882]: time=2026-09-20T09:33:03.508Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4919lb # [ 56.311547] niks3-server[1027]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4920lb # [ 56.314260] niks3-server[1027]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4921lb # [ 56.319025] niks3-server[1027]: 2026/09/20 09:33:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4922lb # [ 56.320995] niks3-server[1027]: 2026/09/20 09:33:04 INFO Signed narinfos id=16 count=14923worker2 # [ 56.317929] nix-grpc-daemon[882]: time=2026-09-20T09:33:03.537Z level=INFO msg="Uploading 1 narinfos"4924lb # [ 56.323825] niks3-server[1027]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4925lb # [ 56.329386] niks3-server[1027]: 2026/09/20 09:33:04 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4926lb # [ 56.332230] niks3-server[1027]: 2026/09/20 09:33:04 INFO Completed upload id=164927worker2 # [ 56.327825] nix-grpc-daemon[882]: time=2026-09-20T09:33:03.547Z level=INFO msg="Upload complete. (213ms)"4928lb # [ 56.334336] niks3-server[1027]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4929worker2 # [ 56.330319] nix-grpc-daemon[784]: ts=2026-09-20T09:33:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14930worker2 # [ 56.334866] nix-grpc-daemon[784]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:339064931worker2 # [ 56.339092] nix-daemon[870]: reaped child process 1181, status = succeeded4932worker2 # [ 56.344157] nix-grpc-daemon[784]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:339064933worker2 # [ 56.346177] nix-grpc-daemon[784]: ts=2026-09-20T09:33:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_out=2324934client # [ 56.435904] nix-daemon[948]: reaped child process 950, status = succeeded4935client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.91 seconds)4936client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4937client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4938client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4939client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4940client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4941client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4942(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.01 seconds)4943subtest: an input only one worker has still reaches the builder4944client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4945client # this derivation will be built:4946client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4947client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4948client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.42 seconds)4949client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4950client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.18 seconds)4951worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4952worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4953worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4954worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4955client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24956client # [ 57.573808] nix-daemon[948]: accepted connection from pid 1030, user root (trusted)4957client # this derivation will be built:4958client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4959worker1 # [ 57.709604] nix-grpc-daemon[784]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:380964960client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4961worker1 # [ 57.715148] nix-grpc-daemon[784]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964962worker1 # [ 57.883370] nix-daemon[847]: accepted connection from pid 950, user nix-grpc-daemon (trusted)4963worker1 # [ 57.894073] nix-daemon[847]: reaped child process 953, status = succeeded4964lb # [ 57.944607] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received uploads request method=POST path=/api/pending_closures4965worker1 # [ 57.913980] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.007Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4966worker1 # [ 57.915819] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.008Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4967lb # [ 57.959991] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4968lb # [ 57.964309] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4969lb # [ 57.967091] niks3-server[1027]: 2026/09/20 09:33:06 INFO Signed narinfos id=17 count=14970worker1 # [ 57.932241] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.025Z level=INFO msg="Uploading 1 narinfos"4971lb # [ 57.970240] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4972lb # [ 57.976683] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4973lb # [ 57.980028] niks3-server[1027]: 2026/09/20 09:33:06 INFO Completed upload id=174974worker1 # [ 57.944808] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.038Z level=INFO msg="Upload complete. (230ms)"4975lb # [ 57.982062] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4976worker2 # [ 57.990964] nix-grpc-daemon[784]: ts=2026-09-20T09:33:05Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04977worker2 # [ 57.992955] nix-grpc-daemon[784]: ts=2026-09-20T09:33:05Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14978worker1 # [ 58.004130] nix-grpc-daemon[784]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380964979worker1 # [ 58.014971] nix-grpc-daemon[784]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380964980client # copying 2 paths to 'lb:50051'...4981client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4982worker1 # [ 58.027379] nix-grpc-daemon[784]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:380964983client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4984worker1 # [ 58.039393] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4985worker1 # [ 58.220066] nix-daemon[847]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4986worker1 # [ 58.233368] nix-daemon[847]: reaped child process 960, status = succeeded4987worker1 # [ 58.401382] nix-daemon[847]: accepted connection from pid 962, user nix-grpc-daemon (trusted)4988worker1 # [ 58.412946] nix-daemon[847]: reaped child process 965, status = succeeded4989lb # [ 58.462719] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received uploads request method=POST path=/api/pending_closures4990lb # [ 58.467689] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received uploads request method=POST path=/api/pending_closures4991worker1 # [ 58.436170] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.529Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4992worker1 # [ 58.437917] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.531Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4993worker1 # [ 58.440333] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.533Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4994lb # [ 58.488534] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4995lb # [ 58.493911] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4996lb # [ 58.495745] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4997lb # [ 58.501918] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4998lb # [ 58.504195] niks3-server[1027]: 2026/09/20 09:33:06 INFO Signed narinfos id=18 count=14999lb # [ 58.505990] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5000lb # [ 58.507656] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5001lb # [ 58.509446] niks3-server[1027]: 2026/09/20 09:33:06 INFO Signed narinfos id=19 count=25002worker1 # [ 58.474731] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.567Z level=INFO msg="Uploading 3 narinfos"5003lb # [ 58.522957] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5004lb # [ 58.525545] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5005lb # [ 58.527752] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5006lb # [ 58.530147] niks3-server[1027]: 2026/09/20 09:33:06 INFO Completed upload id=185007lb # [ 58.531917] niks3-server[1027]: 2026/09/20 09:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5008lb # [ 58.534600] niks3-server[1027]: 2026/09/20 09:33:06 INFO Completed upload id=195009worker1 # [ 58.500531] nix-grpc-daemon[873]: time=2026-09-20T09:33:06.593Z level=INFO msg="Upload complete. (445ms)"5010lb # [ 58.536473] niks3-server[1027]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5011worker1 # [ 58.502701] nix-grpc-daemon[784]: ts=2026-09-20T09:33:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=0 paths=2 nar_bytes_in=9765012worker1 # [ 58.505808] nix-grpc-daemon[784]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380965013worker1 # [ 58.513202] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5014worker1 # [ 58.515083] nix-daemon[847]: reaped child process 955, status = succeeded5015worker1 # [ 58.519961] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5016client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5017client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5018lb # [ 58.681856] envoy[926]: conn peer=[2001:db8:1::1]:44962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3423 tx=1772 ms=20905019lb # [ 58.683382] envoy[926]: conn peer=[2001:db8:1::1]:44972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=155020lb # [ 58.684759] envoy[926]: conn peer=[2001:db8:1::1]:44984 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1834 ms=17335021lb # [ 58.686224] envoy[926]: conn peer=[2001:db8:1::1]:43268 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=625022lb # [ 58.687613] envoy[926]: conn peer=[2001:db8:1::1]:43278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2086 ms=20195023lb # [ 58.688997] envoy[926]: conn peer=[2001:db8:1::1]:43290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=485024worker1 # [ 59.338772] nix-daemon[847]: reaped child process 969, status = succeeded5025worker1 # [ 59.470816] nix-daemon[847]: accepted connection from pid 984, user nix-grpc-daemon (trusted)5026worker1 # [ 59.483234] nix-daemon[847]: reaped child process 987, status = succeeded5027lb # [ 59.533325] niks3-server[1027]: 2026/09/20 09:33:07 INFO Received uploads request method=POST path=/api/pending_closures5028worker1 # [ 59.509110] nix-grpc-daemon[873]: time=2026-09-20T09:33:07.602Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5029lb # [ 59.567841] niks3-server[1027]: 2026/09/20 09:33:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5030lb # [ 59.572573] niks3-server[1027]: 2026/09/20 09:33:07 INFO Signed narinfos id=20 count=15031worker1 # [ 59.540644] nix-grpc-daemon[873]: time=2026-09-20T09:33:07.633Z level=INFO msg="Uploading 1 narinfos"5032lb # [ 59.581456] niks3-server[1027]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5033lb # [ 59.587312] niks3-server[1027]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5034lb # [ 59.600220] niks3-server[1027]: 2026/09/20 09:33:07 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5035lb # [ 59.609577] niks3-server[1027]: 2026/09/20 09:33:07 INFO Completed upload id=205036worker1 # [ 59.574483] nix-grpc-daemon[873]: time=2026-09-20T09:33:07.667Z level=INFO msg="Upload complete. (246ms)"5037lb # [ 59.611845] niks3-server[1027]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5038worker1 # [ 59.579065] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15039worker1 # [ 59.592597] nix-daemon[847]: reaped child process 967, status = succeeded5040client # copying 1 paths...5041worker2 # [ 59.657535] nix-grpc-daemon[784]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:339065042worker2 # [ 59.673304] nix-grpc-daemon[784]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5043client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5044worker1 # [ 59.686218] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:380965045worker1 # [ 59.689969] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=0 paths=1 nar_bytes_out=1205046client # [ 59.780266] nix-daemon[948]: reaped child process 1033, status = succeeded5047client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.43 seconds)5048client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25049client # [ 59.968318] nix-daemon[948]: accepted connection from pid 1052, user root (trusted)5050client # this derivation will be built:5051client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5052worker2 # [ 60.142406] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:339065053client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5054worker1 # [ 60.120362] nix-grpc-daemon[784]: ts=2026-09-20T09:33:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380965055worker1 # [ 60.128925] nix-grpc-daemon[873]: time=2026-09-20T09:33:08.222Z level=INFO msg="All 1 paths already cached"5056worker2 # [ 60.173780] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05057worker2 # [ 60.178959] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15058worker2 # [ 60.184784] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339065059worker2 # [ 60.196216] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339065060client # copying 1 paths to 'lb:50051'...5061client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5062worker2 # [ 60.213787] nix-grpc-daemon[784]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339065063worker2 # [ 60.222900] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5064worker2 # [ 60.239837] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)5065worker2 # [ 60.262503] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 2/5)5066worker2 # [ 60.273955] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 3/5)5067worker2 # [ 60.356939] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 749 ms (attempt 4/5)5068worker2 # [ 61.112464] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5069worker2 # [ 61.115097] nix-grpc-daemon[784]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5070worker2 # [ 61.258842] nix-daemon[870]: accepted connection from pid 1217, user nix-grpc-daemon (trusted)5071worker2 # [ 61.272086] nix-daemon[870]: reaped child process 1220, status = succeeded5072worker2 # [ 61.411167] nix-daemon[870]: accepted connection from pid 1222, user nix-grpc-daemon (trusted)5073worker2 # [ 61.424186] nix-daemon[870]: reaped child process 1225, status = succeeded5074lb # [ 61.436336] niks3-server[1027]: 2026/09/20 09:33:09 INFO Received uploads request method=POST path=/api/pending_closures5075worker2 # [ 61.437286] nix-grpc-daemon[882]: time=2026-09-20T09:33:08.656Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5076worker2 # [ 61.439179] nix-grpc-daemon[882]: time=2026-09-20T09:33:08.658Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5077lb # [ 61.452916] niks3-server[1027]: 2026/09/20 09:33:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5078lb # [ 61.455434] niks3-server[1027]: 2026/09/20 09:33:09 INFO Signed narinfos id=21 count=15079worker2 # [ 61.451372] nix-grpc-daemon[882]: time=2026-09-20T09:33:08.670Z level=INFO msg="Uploading 1 narinfos"5080lb # [ 61.459480] niks3-server[1027]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5081lb # [ 61.461991] niks3-server[1027]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5082lb # [ 61.465805] niks3-server[1027]: 2026/09/20 09:33:09 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5083lb # [ 61.469455] niks3-server[1027]: 2026/09/20 09:33:09 INFO Completed upload id=215084worker2 # [ 61.464804] nix-grpc-daemon[882]: time=2026-09-20T09:33:08.684Z level=INFO msg="Upload complete. (341ms)"5085lb # [ 61.472253] niks3-server[1027]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5086worker2 # [ 61.467266] nix-grpc-daemon[784]: ts=2026-09-20T09:33:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 paths=1 nar_bytes_in=5605087worker2 # [ 61.470611] nix-grpc-daemon[784]: ts=2026-09-20T09:33:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339065088worker2 # [ 61.478060] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5089worker2 # [ 61.484131] nix-daemon[870]: reaped child process 1211, status = succeeded5090worker2 # [ 61.489348] nix-grpc-daemon[784]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5091client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5092worker2 # [ 61.496945] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5093client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5094worker2 # [ 62.324973] nix-daemon[870]: reaped child process 1230, status = succeeded5095worker2 # [ 62.484418] nix-daemon[870]: accepted connection from pid 1245, user nix-grpc-daemon (trusted)5096worker2 # [ 62.499170] nix-daemon[870]: reaped child process 1248, status = succeeded5097lb # [ 62.517890] niks3-server[1027]: 2026/09/20 09:33:10 INFO Received uploads request method=POST path=/api/pending_closures5098worker2 # [ 62.521571] nix-grpc-daemon[882]: time=2026-09-20T09:33:09.740Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5099lb # [ 62.549071] niks3-server[1027]: 2026/09/20 09:33:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5100lb # [ 62.553474] niks3-server[1027]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5101lb # [ 62.558894] niks3-server[1027]: 2026/09/20 09:33:10 INFO Signed narinfos id=22 count=15102worker2 # [ 62.557568] nix-grpc-daemon[882]: time=2026-09-20T09:33:09.776Z level=INFO msg="Uploading 1 narinfos"5103lb # [ 62.572116] niks3-server[1027]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5104lb # [ 62.578757] niks3-server[1027]: 2026/09/20 09:33:10 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5105worker2 # [ 62.580072] nix-grpc-daemon[882]: time=2026-09-20T09:33:09.799Z level=INFO msg="Upload complete. (272ms)"5106lb # [ 62.584595] niks3-server[1027]: 2026/09/20 09:33:10 INFO Completed upload id=225107worker2 # [ 62.583640] nix-grpc-daemon[784]: ts=2026-09-20T09:33:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15108lb # [ 62.587945] niks3-server[1027]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5109client # copying 1 paths...5110worker2 # [ 62.588794] nix-grpc-daemon[784]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:339065111worker2 # [ 62.593741] nix-daemon[870]: reaped child process 1227, status = succeeded5112client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5113worker2 # [ 62.609287] nix-grpc-daemon[784]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:339065114worker2 # [ 62.611329] nix-grpc-daemon[784]: ts=2026-09-20T09:33:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_out=1205115client # [ 62.718820] nix-daemon[948]: reaped child process 1055, status = succeeded5116client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.94 seconds)5117client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25118client # [ 62.908064] nix-daemon[948]: accepted connection from pid 1074, user root (trusted)5119client # this derivation will be built:5120client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5121worker2 # [ 63.088492] nix-grpc-daemon[784]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:339065122client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5123worker2 # [ 63.094798] nix-grpc-daemon[784]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339065124worker2 # [ 63.099651] nix-grpc-daemon[882]: time=2026-09-20T09:33:10.318Z level=INFO msg="All 1 paths already cached"5125worker2 # [ 63.109597] nix-grpc-daemon[784]: ts=2026-09-20T09:33:10Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05126worker2 # [ 63.113986] nix-grpc-daemon[784]: ts=2026-09-20T09:33:10Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15127worker1 # [ 63.123800] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380965128worker1 # [ 63.131906] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380965129worker1 # [ 63.140560] nix-grpc-daemon[873]: time=2026-09-20T09:33:11.233Z level=INFO msg="All 1 paths already cached"5130client # copying 1 paths to 'lb:50051'...5131worker1 # [ 63.146340] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:380965132client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5133worker1 # [ 63.153661] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5134worker1 # [ 63.301443] nix-daemon[847]: accepted connection from pid 991, user nix-grpc-daemon (trusted)5135worker1 # [ 63.314403] nix-daemon[847]: reaped child process 994, status = succeeded5136worker1 # [ 63.459122] nix-daemon[847]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5137worker1 # [ 63.472211] nix-daemon[847]: reaped child process 999, status = succeeded5138lb # [ 63.515458] niks3-server[1027]: 2026/09/20 09:33:11 INFO Received uploads request method=POST path=/api/pending_closures5139worker1 # [ 63.489091] nix-grpc-daemon[873]: time=2026-09-20T09:33:11.582Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5140worker1 # [ 63.490689] nix-grpc-daemon[873]: time=2026-09-20T09:33:11.582Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5141lb # [ 63.542729] niks3-server[1027]: 2026/09/20 09:33:11 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5142lb # [ 63.555104] niks3-server[1027]: 2026/09/20 09:33:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5143worker1 # [ 63.524060] nix-grpc-daemon[873]: time=2026-09-20T09:33:11.617Z level=INFO msg="Uploading 1 narinfos"5144lb # [ 63.558955] niks3-server[1027]: 2026/09/20 09:33:11 INFO Signed narinfos id=23 count=15145lb # [ 63.563987] niks3-server[1027]: 2026/09/20 09:33:11 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5146lb # [ 63.573966] niks3-server[1027]: 2026/09/20 09:33:11 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5147lb # [ 63.577683] niks3-server[1027]: 2026/09/20 09:33:11 INFO Completed upload id=235148worker1 # [ 63.542674] nix-grpc-daemon[873]: time=2026-09-20T09:33:11.636Z level=INFO msg="Upload complete. (384ms)"5149lb # [ 63.579791] niks3-server[1027]: 2026/09/20 09:33:11 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5150worker1 # [ 63.545029] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=0 paths=1 nar_bytes_in=5605151worker1 # [ 63.549575] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380965152worker1 # [ 63.555445] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5153worker1 # [ 63.557647] nix-daemon[847]: reaped child process 989, status = succeeded5154worker1 # [ 63.562809] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5155client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5156client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5157worker1 # [ 64.387814] nix-daemon[847]: reaped child process 1003, status = succeeded5158worker1 # [ 64.545358] nix-daemon[847]: accepted connection from pid 1018, user nix-grpc-daemon (trusted)5159worker1 # [ 64.557970] nix-daemon[847]: reaped child process 1021, status = succeeded5160lb # [ 64.609623] niks3-server[1027]: 2026/09/20 09:33:12 INFO Received uploads request method=POST path=/api/pending_closures5161worker1 # [ 64.580509] nix-grpc-daemon[873]: time=2026-09-20T09:33:12.673Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5162lb # [ 64.635668] niks3-server[1027]: 2026/09/20 09:33:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5163worker1 # [ 64.608201] nix-grpc-daemon[873]: time=2026-09-20T09:33:12.701Z level=INFO msg="Uploading 1 narinfos"5164lb # [ 64.643392] niks3-server[1027]: 2026/09/20 09:33:12 INFO Signed narinfos id=24 count=15165lb # [ 64.649478] niks3-server[1027]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5166lb # [ 64.655428] niks3-server[1027]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5167lb # [ 64.666842] niks3-server[1027]: 2026/09/20 09:33:12 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5168worker1 # [ 64.638201] nix-grpc-daemon[873]: time=2026-09-20T09:33:12.731Z level=INFO msg="Upload complete. (268ms)"5169lb # [ 64.673346] niks3-server[1027]: 2026/09/20 09:33:12 INFO Completed upload id=245170lb # [ 64.676605] niks3-server[1027]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5171worker1 # [ 64.642502] nix-grpc-daemon[784]: ts=2026-09-20T09:33:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38096 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15172worker1 # [ 64.653415] nix-daemon[847]: reaped child process 1001, status = succeeded5173client # copying 1 paths...5174worker2 # [ 64.719761] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:339065175worker2 # [ 64.731528] nix-grpc-daemon[784]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5176client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5177worker2 # [ 64.764161] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:339065178worker2 # [ 64.768805] nix-grpc-daemon[784]: ts=2026-09-20T09:33:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33906 duration_s=0 paths=1 nar_bytes_out=1205179client # [ 64.870740] nix-daemon[948]: reaped child process 1077, status = succeeded5180client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.15 seconds)5181(finished: subtest: an input only one worker has still reaches the builder, in 8.35 seconds)5182subtest: upload whose reference the worker lacks is completed from the cache5183client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5184client # this derivation will be built:5185client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5186client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5187client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds)5188client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5189client # this derivation will be built:5190client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5191client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5192client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.35 seconds)5193client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5194client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5195worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5196worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.16 seconds)5197worker2 # [ 66.008641] systemd[1]: Stopping Nix worker-protocol over gRPC...5198worker2 # [ 66.970885] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=signal_exit5199worker2 # [ 67.231351] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=scheduler_yield5200worker1 # [ 67.203639] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_restarting addr=lb:500515201worker2 # [ 67.236180] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:338925202lb # [ 67.239880] niks3-server[1027]: 2026/09/20 09:33:15 INFO lead: released remote=192.168.1.4:601665203worker2 # [ 67.240540] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=worker_gone addr=192.168.1.3:500515204worker2 # [ 67.246096] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=scheduler_restarting addr=lb:500515205worker2 # [ 67.249190] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:338925206worker2 # [ 67.252405] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=worker_gone addr=192.168.1.4:500515207worker1 # [ 67.407316] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_connected addr=lb:500515208worker1 # [ 67.409398] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5209worker2 # [ 67.445967] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=scheduler_connected addr=lb:500515210worker2 # [ 67.450328] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5211worker1 # [ 67.609946] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_connected addr=lb:500515212lb # [ 67.644430] niks3-server[1027]: 2026/09/20 09:33:15 INFO lead: acquired remote=192.168.1.3:537845213worker1 # [ 67.612821] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_take_over5214worker1 # [ 67.614286] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5215worker2 # [ 67.651324] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=scheduler_connected addr=lb:500515216worker2 # [ 67.655425] nix-grpc-daemon[784]: ts=2026-09-20T09:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5217worker1 # [ 67.815329] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_connected addr=lb:500515218worker1 # [ 67.819734] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5219worker2 # [ 67.857153] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_connected addr=lb:500515220worker2 # [ 67.860471] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5221worker1 # [ 68.020051] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_connected addr=lb:500515222worker1 # [ 68.021990] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5223worker2 # [ 68.059635] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_connected addr=lb:500515224worker2 # [ 68.062994] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5225worker2 # [ 68.235851] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=scheduler_restarting5226worker1 # [ 68.223156] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_connected addr=lb:500515227worker1 # [ 68.225106] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5228worker2 # [ 68.279281] nix-daemon[870]: reaped child process 872, status = succeeded5229worker2 # [ 68.281742] nix-grpc-daemon[784]: ts=2026-09-20T09:33:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5230worker1 # [ 68.425931] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_connected addr=lb:500515231worker1 # [ 68.428102] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5232worker1 # [ 68.628948] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_connected addr=lb:500515233worker1 # [ 68.632784] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5234lb # [ 68.682297] envoy[926]: conn peer=[2001:db8:1::1]:43300 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=460 tx=307 ms=205235lb # [ 68.686452] envoy[926]: conn peer=[2001:db8:1::1]:43292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3836 tx=1875 ms=19925236lb # [ 68.690881] envoy[926]: conn peer=[2001:db8:1::1]:43308 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1803 ms=25215237lb # [ 68.695072] envoy[926]: conn peer=[2001:db8:1::1]:43324 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=555238lb # [ 68.699078] envoy[926]: conn peer=[2001:db8:1::1]:36104 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=535239lb # [ 68.703535] envoy[926]: conn peer=[2001:db8:1::1]:36102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1915 ms=17285240lb # [ 68.707727] envoy[926]: conn peer=[2001:db8:1::4]:42630 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11440 tx=2513 ms=492535241worker1 # [ 68.833610] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_connected addr=lb:500515242worker1 # [ 68.837506] nix-grpc-daemon[784]: ts=2026-09-20T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5243worker1 # [ 69.038104] nix-grpc-daemon[784]: ts=2026-09-20T09:33:17Z level=info event=scheduler_connected addr=lb:500515244worker1 # [ 69.050336] nix-grpc-daemon[784]: ts=2026-09-20T09:33:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05245worker2 # [ 69.087483] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5246worker2 # [ 69.091146] nix-grpc-daemon[784]: E0000 00:00:1789896796.304961 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5247worker2 # [ 69.095836] nix-grpc-daemon[784]: E0000 00:00:1789896796.306171 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5248worker2 # [ 69.583565] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5249worker2 # [ 69.589212] systemd[1]: Stopped Nix worker-protocol over gRPC.5250worker2 # [ 69.591380] systemd[1]: nix-grpc-daemon.service: Consumed 2.563s CPU time over 50.906s wall clock time, 60.3M memory peak, 89.2K incoming IP traffic, 206.1K outgoing IP traffic.5251worker2 # [ 69.603242] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5252worker2 # [ 69.606866] systemd[1]: Closed Nix worker-protocol over gRPC.5253worker2 # [ 69.608978] systemd[1]: nix-grpc-daemon.socket: Consumed 281us CPU time over 1min 358ms wall clock time, 256K memory peak, 86K incoming IP traffic, 66.9K outgoing IP traffic.5254lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5255lb: must succeed: curl -sf localhost:9901/clusters5256lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5257lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5258client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25259worker1 # [ 69.869213] nix-grpc-daemon[784]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:380965260worker1 # [ 69.876316] nix-grpc-daemon[784]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:380965261client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5262client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.25 seconds)5263worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5264worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5265worker2 # [ 70.021212] systemd[1]: Listening on Nix worker-protocol over gRPC.5266worker1 # [ 70.052834] systemd[1]: Stopping Nix worker-protocol over gRPC...5267worker2 # [ 70.578256] systemd[1]: Starting Nix worker-protocol over gRPC...5268worker2 # [ 70.759423] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5269worker2 # [ 70.763687] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15270worker2 # [ 70.770058] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5271worker2 # [ 70.774347] systemd[1]: Started Nix worker-protocol over gRPC.5272worker2 # [ 70.800115] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515273worker1 # [ 70.770684] nix-grpc-daemon[784]: ts=2026-09-20T09:33:18Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05274worker1 # [ 70.900880] nix-grpc-daemon[784]: ts=2026-09-20T09:33:18Z level=info event=signal_exit5275worker1 # [ 71.164345] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_yield5276lb # [ 71.202107] niks3-server[1027]: 2026/09/20 09:33:19 INFO lead: released remote=192.168.1.3:537845277worker1 # [ 71.171201] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:340645278worker2 # [ 71.201363] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:18Z level=info event=scheduler_restarting addr=lb:500515279worker1 # [ 71.172903] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=worker_gone addr=192.168.1.4:500515280worker1 # [ 71.174760] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_restarting addr=lb:500515281worker1 # [ 71.177061] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:340645282worker1 # [ 71.178625] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=worker_gone addr=192.168.1.3:500515283worker2 # [ 71.402819] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515284worker1 # [ 71.375493] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515285worker1 # [ 71.377409] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5286worker2 # [ 71.406981] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5287worker1 # [ 71.577869] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515288worker2 # [ 71.607974] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515289worker1 # [ 71.579632] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5290worker2 # [ 71.612884] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5291worker1 # [ 71.780624] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515292worker2 # [ 71.815459] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515293worker1 # [ 71.784453] nix-grpc-daemon[784]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5294worker2 # [ 71.818684] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5295worker2 # [ 72.015621] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515296worker2 # [ 72.017547] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5297worker1 # [ 71.986319] nix-grpc-daemon[784]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515298worker1 # [ 71.989971] nix-grpc-daemon[784]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5299worker1 # [ 72.164677] nix-grpc-daemon[784]: ts=2026-09-20T09:33:20Z level=info event=scheduler_restarting5300worker2 # [ 72.218417] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515301worker1 # [ 72.187586] nix-daemon[847]: reaped child process 849, status = succeeded5302worker2 # [ 72.220295] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5303worker1 # [ 72.202183] nix-grpc-daemon[784]: ts=2026-09-20T09:33:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5304worker2 # [ 72.421176] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515305worker2 # [ 72.423188] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5306worker2 # [ 72.624292] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515307worker2 # [ 72.628377] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5308worker2 # [ 72.830601] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515309worker2 # [ 72.833823] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5310worker2 # [ 73.031493] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515311worker2 # [ 73.035554] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5312worker1 # [ 73.017522] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5313worker1 # [ 73.021152] nix-grpc-daemon[784]: E0000 00:00:1789896801.109625 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5314worker1 # [ 73.025774] nix-grpc-daemon[784]: E0000 00:00:1789896801.110127 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5315worker2 # [ 73.236941] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515316worker2 # [ 73.240852] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5317worker2 # [ 73.441986] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515318worker2 # [ 73.446143] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5319worker1 # [ 73.486582] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5320worker1 # [ 73.490356] systemd[1]: Stopped Nix worker-protocol over gRPC.5321worker1 # [ 73.494102] systemd[1]: nix-grpc-daemon.service: Consumed 1.371s CPU time over 54.846s wall clock time, 50.6M memory peak, 51.2K incoming IP traffic, 94.6K outgoing IP traffic.5322worker1 # [ 73.505592] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5323worker1 # [ 73.509668] systemd[1]: Closed Nix worker-protocol over gRPC.5324worker1 # [ 73.512430] systemd[1]: nix-grpc-daemon.socket: Consumed 303us CPU time over 1min 4.231s wall clock time, 256K memory peak, 63K incoming IP traffic, 55.3K outgoing IP traffic.5325lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5326lb: must succeed: curl -sf localhost:9901/clusters5327lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5328lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5329client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25330worker2 # [ 73.647061] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515331worker2 # [ 73.651222] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5332worker2 # [ 73.789091] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574145333worker2 # [ 73.802293] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5334worker2 # [ 73.819616] nix-grpc-daemon[1272]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5335worker2 # [ 73.830954] nix-grpc-daemon[1272]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5)5336worker2 # [ 73.851930] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515337worker2 # [ 73.855845] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5338worker2 # [ 73.905962] nix-grpc-daemon[1272]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 240 ms (attempt 3/5)5339worker2 # [ 74.056938] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515340worker2 # [ 74.061135] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5341worker2 # [ 74.146554] nix-grpc-daemon[1272]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 4/5)5342worker2 # [ 74.215116] nix-grpc-daemon[1272]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5343client # copying 2 paths...5344client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5345worker2 # [ 74.234146] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574145346client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5347worker2 # [ 74.246167] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5348worker2 # [ 74.261623] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515349worker2 # [ 74.265593] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5350worker2 # [ 74.277355] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=niks3_push_started pid=13285351worker2 # [ 74.470298] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515352worker2 # [ 74.472441] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5353worker2 # [ 74.622464] nix-daemon[870]: accepted connection from pid 1341, user nix-grpc-daemon (trusted)5354worker2 # [ 74.637917] nix-daemon[870]: reaped child process 1344, status = succeeded5355lb # [ 74.653876] niks3-server[1027]: 2026/09/20 09:33:22 INFO Received uploads request method=POST path=/api/pending_closures5356lb # [ 74.659827] niks3-server[1027]: 2026/09/20 09:33:22 INFO Received uploads request method=POST path=/api/pending_closures5357worker2 # [ 74.659583] nix-grpc-daemon[1328]: time=2026-09-20T09:33:21.878Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5358worker2 # [ 74.662387] nix-grpc-daemon[1328]: time=2026-09-20T09:33:21.880Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5359worker2 # [ 74.665195] nix-grpc-daemon[1328]: time=2026-09-20T09:33:21.880Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5360worker2 # [ 74.672862] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515361worker2 # [ 74.674485] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5362lb # [ 74.690210] niks3-server[1027]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5363lb # [ 74.696475] niks3-server[1027]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5364lb # [ 74.700696] niks3-server[1027]: 2026/09/20 09:33:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5365lb # [ 74.703187] niks3-server[1027]: 2026/09/20 09:33:22 INFO Signed narinfos id=25 count=15366lb # [ 74.705531] niks3-server[1027]: 2026/09/20 09:33:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5367lb # [ 74.709291] niks3-server[1027]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5368lb # [ 74.711344] niks3-server[1027]: 2026/09/20 09:33:22 INFO Signed narinfos id=26 count=25369worker2 # [ 74.707617] nix-grpc-daemon[1328]: time=2026-09-20T09:33:21.926Z level=INFO msg="Uploading 3 narinfos"5370lb # [ 74.728150] niks3-server[1027]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5371lb # [ 74.732355] niks3-server[1027]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5372lb # [ 74.736257] niks3-server[1027]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5373lb # [ 74.738124] niks3-server[1027]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5374lb # [ 74.741430] niks3-server[1027]: 2026/09/20 09:33:22 INFO Completed upload id=255375lb # [ 74.743111] niks3-server[1027]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5376lb # [ 74.745144] niks3-server[1027]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5377lb # [ 74.747662] niks3-server[1027]: 2026/09/20 09:33:22 INFO Completed upload id=265378worker2 # [ 74.743393] nix-grpc-daemon[1328]: time=2026-09-20T09:33:21.962Z level=INFO msg="Upload complete. (267ms)"5379worker2 # [ 74.748126] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=0 paths=2 nar_bytes_in=3125380worker2 # [ 74.758145] nix-daemon[870]: reaped child process 1326, status = succeeded5381client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.19 seconds)5382worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5383worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5384worker2 # [ 74.875944] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_connected addr=lb:500515385worker2 # [ 74.877799] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5386worker1 # [ 74.849685] systemd[1]: Listening on Nix worker-protocol over gRPC.5387worker1 # [ 74.857709] systemd[1]: Starting Nix worker-protocol over gRPC...5388worker1 # [ 75.010344] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5389worker1 # [ 75.014313] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15390worker1 # [ 75.020088] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5391worker1 # [ 75.024682] systemd[1]: Started Nix worker-protocol over gRPC.5392lb # [ 75.064583] niks3-server[1027]: 2026/09/20 09:33:23 INFO lead: acquired remote=192.168.1.3:339005393worker1 # [ 75.034072] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_take_over5394lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5395lb: must succeed: curl -sf localhost:9901/clusters5396worker2 # [ 75.078623] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_connected addr=lb:500515397worker1 # [ 75.053715] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515398worker1 # [ 75.055424] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5399worker2 # [ 75.084390] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5400lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5401worker1 # [ 75.256115] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515402worker2 # [ 75.285480] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_connected addr=lb:500515403worker1 # [ 75.257919] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5404worker2 # [ 75.289478] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5405worker1 # [ 75.458557] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515406worker2 # [ 75.490402] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_connected addr=lb:500515407worker1 # [ 75.461207] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5408worker2 # [ 75.494400] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5409worker1 # [ 75.662199] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515410worker2 # [ 75.695228] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:22Z level=info event=scheduler_connected addr=lb:500515411worker1 # [ 75.670147] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05412worker1 # [ 75.677254] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05413lb: must succeed: curl -sf localhost:9901/clusters5414lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5415lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5416(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.32 seconds)5417subtest: scheduler down: the other node takes the lock and keeps it5418lb: must succeed: curl -sf localhost:9901/clusters5419lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5420lb: must succeed: curl -sf localhost:9901/clusters5421lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5422lb: must succeed: curl -sf localhost:9901/clusters5423lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5424lb: must succeed: curl -sf localhost:9901/clusters5425lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5426worker1 # [ 76.388234] systemd[1]: Stopping Nix worker-protocol over gRPC...5427worker1 # [ 77.024288] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=signal_exit5428worker1 # [ 77.032397] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_yield5429lb # [ 77.071187] niks3-server[1027]: 2026/09/20 09:33:25 INFO lead: released remote=192.168.1.3:339005430worker2 # [ 77.067438] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:24Z level=info event=scheduler_restarting addr=lb:500515431worker1 # [ 77.039427] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:489385432worker1 # [ 77.042895] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=worker_gone addr=192.168.1.4:500515433worker1 # [ 77.047917] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_restarting addr=lb:500515434worker1 # [ 77.050922] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:489385435worker1 # [ 77.054181] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=worker_gone addr=192.168.1.3:500515436worker2 # [ 77.267318] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515437worker2 # [ 77.271475] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5438worker1 # [ 77.247689] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515439worker1 # [ 77.252969] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5440worker2 # [ 77.472513] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515441worker2 # [ 77.475411] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5442worker1 # [ 77.453953] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515443worker1 # [ 77.459351] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5444worker2 # [ 77.676549] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515445worker2 # [ 77.679752] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5446worker1 # [ 77.659968] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515447worker1 # [ 77.661828] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5448worker2 # [ 77.880548] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515449worker2 # [ 77.882689] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5450worker1 # [ 77.862860] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515451worker1 # [ 77.866752] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5452worker1 # [ 78.036392] nix-grpc-daemon[1044]: ts=2026-09-20T09:33:26Z level=info event=scheduler_restarting5453worker2 # [ 78.085604] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515454worker2 # [ 78.089270] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5455worker2 # [ 78.286548] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515456worker2 # [ 78.290891] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5457worker2 # [ 78.491703] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515458worker2 # [ 78.493867] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5459worker1 # [ 78.484358] nix-grpc-daemon[1044]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5460worker1 # [ 78.485943] nix-grpc-daemon[1044]: E0000 00:00:1789896806.577466 1087 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5461worker1 # [ 78.488036] nix-grpc-daemon[1044]: E0000 00:00:1789896806.577759 1087 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5462lb # [ 78.682583] envoy[926]: conn peer=[2001:db8:1::1]:36120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=235463lb # [ 78.684232] envoy[926]: conn peer=192.168.1.3:33526 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=12778 tx=2455 ms=532475464lb # [ 78.685674] envoy[926]: conn peer=[2001:db8:1::1]:57774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=282 ms=9735465lb # [ 78.687694] envoy[926]: conn peer=[2001:db8:1::3]:51784 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1945 tx=508 ms=30225466worker2 # [ 78.694707] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515467worker2 # [ 78.696627] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5468worker2 # [ 78.897661] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515469worker2 # [ 78.901760] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5470worker1 # [ 79.037558] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5471worker1 # [ 79.041179] systemd[1]: Stopped Nix worker-protocol over gRPC.5472worker1 # [ 79.044671] systemd[1]: nix-grpc-daemon.service: Consumed 144ms CPU time over 4.180s wall clock time, 12.3M memory peak, 7.9K incoming IP traffic, 8.8K outgoing IP traffic.5473worker1 # [ 79.056404] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5474worker1 # [ 79.059841] systemd[1]: Closed Nix worker-protocol over gRPC.5475worker1 # [ 79.062480] systemd[1]: nix-grpc-daemon.socket: Consumed 518us CPU time over 4.215s wall clock time, 256K memory peak, 14.8K incoming IP traffic, 11.4K outgoing IP traffic.5476worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5477worker2 # [ 79.104517] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515478worker2 # [ 79.107799] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5479worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds)5480worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5481worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5482worker2 # [ 79.305669] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515483worker2 # [ 79.309526] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5484worker2 # [ 79.510542] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515485worker2 # [ 79.514645] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5486worker2 # [ 79.715887] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515487worker2 # [ 79.720404] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5488worker2 # [ 79.921763] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500515489worker2 # [ 79.925815] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5490worker2 # [ 80.128436] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500515491worker2 # [ 80.131651] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5492worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5493worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5494worker2 # [ 80.329569] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500515495worker2 # [ 80.333869] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5496worker2 # [ 80.535056] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500515497worker2 # [ 80.539189] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5498worker2 # [ 80.739549] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500515499worker2 # [ 80.741424] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5500lb # [ 80.787882] niks3-server[1027]: 2026/09/20 09:33:28 INFO lead: acquired remote=192.168.1.4:424245501worker2 # [ 80.785051] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=info event=scheduler_take_over5502worker2 # [ 80.941882] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:500515503worker2 # [ 80.946698] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05504worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5505worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5506client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25507worker2 # [ 81.635866] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574145508client # don't know how to build these paths:5509client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5510worker2 # [ 81.642038] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574145511worker2 # [ 81.659498] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05512worker2 # [ 81.661566] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=15513worker2 # [ 81.703851] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145514worker2 # [ 81.711900] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574145515client # copying 1 paths to 'lb:50051'...5516worker2 # [ 81.720492] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574145517client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5518worker2 # [ 81.725527] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5519worker2 # [ 81.854993] nix-daemon[870]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5520worker2 # [ 81.867480] nix-daemon[870]: reaped child process 1377, status = succeeded5521worker2 # [ 81.998096] nix-daemon[870]: accepted connection from pid 1379, user nix-grpc-daemon (trusted)5522worker2 # [ 82.010459] nix-daemon[870]: reaped child process 1382, status = succeeded5523lb # [ 82.024823] niks3-server[1027]: 2026/09/20 09:33:30 INFO Received uploads request method=POST path=/api/pending_closures5524worker2 # [ 82.027735] nix-grpc-daemon[1328]: time=2026-09-20T09:33:29.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5525worker2 # [ 82.029590] nix-grpc-daemon[1328]: time=2026-09-20T09:33:29.248Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5526lb # [ 82.051304] niks3-server[1027]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5527lb # [ 82.061324] niks3-server[1027]: 2026/09/20 09:33:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5528lb # [ 82.073095] niks3-server[1027]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5529lb # [ 82.082300] niks3-server[1027]: 2026/09/20 09:33:30 INFO Signed narinfos id=27 count=15530worker2 # [ 82.078474] nix-grpc-daemon[1328]: time=2026-09-20T09:33:29.297Z level=INFO msg="Uploading 1 narinfos"5531lb # [ 82.090745] niks3-server[1027]: 2026/09/20 09:33:30 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5532lb # [ 82.101438] niks3-server[1027]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5533lb # [ 82.104635] niks3-server[1027]: 2026/09/20 09:33:30 INFO Completed upload id=275534worker2 # [ 82.100400] nix-grpc-daemon[1328]: time=2026-09-20T09:33:29.319Z level=INFO msg="Upload complete. (368ms)"5535worker2 # [ 82.105163] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=0 paths=1 nar_bytes_in=5205536worker2 # [ 82.110604] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145537worker2 # [ 82.120086] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5538worker2 # [ 82.129938] nix-daemon[870]: reaped child process 1372, status = succeeded5539worker2 # [ 82.133994] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5540client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5541client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5542worker2 # [ 82.946482] nix-daemon[870]: reaped child process 1386, status = succeeded5543client # farm-a> LOG-farm-a-on-standby5544worker2 # [ 83.079917] nix-daemon[870]: accepted connection from pid 1401, user nix-grpc-daemon (trusted)5545worker2 # [ 83.092250] nix-daemon[870]: reaped child process 1404, status = succeeded5546lb # [ 83.107562] niks3-server[1027]: 2026/09/20 09:33:31 INFO Received uploads request method=POST path=/api/pending_closures5547worker2 # [ 83.113243] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.332Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5548worker2 # [ 83.114702] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.334Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5549lb # [ 83.146145] niks3-server[1027]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5550lb # [ 83.159308] niks3-server[1027]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5551lb # [ 83.166499] niks3-server[1027]: 2026/09/20 09:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5552worker2 # [ 83.166218] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.385Z level=INFO msg="Uploading 1 narinfos"5553lb # [ 83.170222] niks3-server[1027]: 2026/09/20 09:33:31 INFO Signed narinfos id=28 count=15554lb # [ 83.175189] niks3-server[1027]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5555lb # [ 83.183583] niks3-server[1027]: 2026/09/20 09:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5556lb # [ 83.190140] niks3-server[1027]: 2026/09/20 09:33:31 INFO Completed upload id=285557lb # [ 83.191344] niks3-server[1027]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5558worker2 # [ 83.185755] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.405Z level=INFO msg="Upload complete. (245ms)"5559worker2 # [ 83.194582] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15560worker2 # [ 83.204504] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05561worker2 # [ 83.207802] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=15562worker2 # [ 83.216423] nix-daemon[870]: reaped child process 1384, status = succeeded5563worker2 # [ 83.249270] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145564worker2 # [ 83.261412] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574145565worker2 # [ 83.273954] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.493Z level=INFO msg="All 1 paths already cached"5566client # copying 1 paths to 'lb:50051'...5567client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5568worker2 # [ 83.281885] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574145569worker2 # [ 83.289848] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5570worker2 # [ 83.449772] nix-daemon[870]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5571worker2 # [ 83.462438] nix-daemon[870]: reaped child process 1413, status = succeeded5572worker2 # [ 83.619607] nix-daemon[870]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5573worker2 # [ 83.631830] nix-daemon[870]: reaped child process 1418, status = succeeded5574lb # [ 83.651960] niks3-server[1027]: 2026/09/20 09:33:31 INFO Received uploads request method=POST path=/api/pending_closures5575worker2 # [ 83.655107] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.874Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5576worker2 # [ 83.656647] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.876Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5577lb # [ 83.680136] niks3-server[1027]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5578lb # [ 83.689519] niks3-server[1027]: 2026/09/20 09:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5579lb # [ 83.693888] niks3-server[1027]: 2026/09/20 09:33:31 INFO Signed narinfos id=29 count=15580worker2 # [ 83.692379] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.911Z level=INFO msg="Uploading 1 narinfos"5581lb # [ 83.704838] niks3-server[1027]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5582lb # [ 83.712657] niks3-server[1027]: 2026/09/20 09:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5583lb # [ 83.718053] niks3-server[1027]: 2026/09/20 09:33:31 INFO Completed upload id=295584worker2 # [ 83.716315] nix-grpc-daemon[1328]: time=2026-09-20T09:33:30.935Z level=INFO msg="Upload complete. (414ms)"5585lb # [ 83.722615] niks3-server[1027]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5586worker2 # [ 83.720123] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=0 paths=1 nar_bytes_in=6405587worker2 # [ 83.724594] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145588worker2 # [ 83.735061] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5589worker2 # [ 83.738248] nix-daemon[870]: reaped child process 1408, status = succeeded5590worker2 # [ 83.743190] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5591client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5592client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5593client # farm-b> LOG-farm-b-on-standby5594worker2 # [ 84.557376] nix-daemon[870]: reaped child process 1422, status = succeeded5595worker2 # [ 84.693381] nix-daemon[870]: accepted connection from pid 1437, user nix-grpc-daemon (trusted)5596worker2 # [ 84.706042] nix-daemon[870]: reaped child process 1440, status = succeeded5597lb # [ 84.726300] niks3-server[1027]: 2026/09/20 09:33:32 INFO Received uploads request method=POST path=/api/pending_closures5598worker2 # [ 84.728296] nix-grpc-daemon[1328]: time=2026-09-20T09:33:31.947Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5599worker2 # [ 84.729754] nix-grpc-daemon[1328]: time=2026-09-20T09:33:31.949Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5600lb # [ 84.768888] niks3-server[1027]: 2026/09/20 09:33:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5601worker2 # [ 84.776185] nix-grpc-daemon[1328]: time=2026-09-20T09:33:31.995Z level=INFO msg="Uploading 1 narinfos"5602lb # [ 84.781657] niks3-server[1027]: 2026/09/20 09:33:32 INFO Signed narinfos id=30 count=15603lb # [ 84.784180] niks3-server[1027]: 2026/09/20 09:33:32 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5604lb # [ 84.799049] niks3-server[1027]: 2026/09/20 09:33:32 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5605lb # [ 84.805032] niks3-server[1027]: 2026/09/20 09:33:32 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5606lb # [ 84.813895] niks3-server[1027]: 2026/09/20 09:33:32 INFO Completed upload id=305607worker2 # [ 84.809339] nix-grpc-daemon[1328]: time=2026-09-20T09:33:32.028Z level=INFO msg="Upload complete. (257ms)"5608worker2 # [ 84.819550] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15609worker2 # [ 84.827923] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05610worker2 # [ 84.831175] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=15611worker2 # [ 84.840259] nix-daemon[870]: reaped child process 1420, status = succeeded5612worker2 # [ 84.871437] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145613worker2 # [ 84.884129] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574145614lb # [ 84.938623] niks3-server[1027]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5615lb # [ 84.948542] niks3-server[1027]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5616worker2 # [ 84.949507] nix-grpc-daemon[1328]: time=2026-09-20T09:33:32.168Z level=INFO msg="All 2 paths already cached"5617client # copying 1 paths to 'lb:50051'...5618client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5619worker2 # [ 84.958673] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574145620worker2 # [ 84.966723] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5621worker2 # [ 85.132551] nix-daemon[870]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5622worker2 # [ 85.144878] nix-daemon[870]: reaped child process 1449, status = succeeded5623worker2 # [ 85.299245] nix-daemon[870]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5624worker2 # [ 85.311239] nix-daemon[870]: reaped child process 1454, status = succeeded5625lb # [ 85.331053] niks3-server[1027]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures5626worker2 # [ 85.335291] nix-grpc-daemon[1328]: time=2026-09-20T09:33:32.554Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5627worker2 # [ 85.336866] nix-grpc-daemon[1328]: time=2026-09-20T09:33:32.556Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5628lb # [ 85.360494] niks3-server[1027]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5629lb # [ 85.370629] niks3-server[1027]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5630lb # [ 85.377391] niks3-server[1027]: 2026/09/20 09:33:33 INFO Signed narinfos id=31 count=15631worker2 # [ 85.376191] nix-grpc-daemon[1328]: time=2026-09-20T09:33:32.595Z level=INFO msg="Uploading 1 narinfos"5632lb # [ 85.385130] niks3-server[1027]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5633lb # [ 85.394689] niks3-server[1027]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5634lb # [ 85.399878] niks3-server[1027]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5635lb # [ 85.403088] niks3-server[1027]: 2026/09/20 09:33:33 INFO Completed upload id=315636worker2 # [ 85.398673] nix-grpc-daemon[1328]: time=2026-09-20T09:33:32.618Z level=INFO msg="Upload complete. (417ms)"5637worker2 # [ 85.402069] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=0 paths=1 nar_bytes_in=7685638worker2 # [ 85.404547] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145639worker2 # [ 85.410291] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5640worker2 # [ 85.413144] nix-daemon[870]: reaped child process 1444, status = succeeded5641worker2 # [ 85.418058] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5642client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5643client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5644client # farm-top> LOG-farm-top-on-standby5645worker2 # [ 86.231837] nix-daemon[870]: reaped child process 1458, status = succeeded5646worker2 # [ 86.366035] nix-daemon[870]: accepted connection from pid 1473, user nix-grpc-daemon (trusted)5647worker2 # [ 86.376964] nix-daemon[870]: reaped child process 1476, status = succeeded5648lb # [ 86.396818] niks3-server[1027]: 2026/09/20 09:33:34 INFO Received uploads request method=POST path=/api/pending_closures5649worker2 # [ 86.403621] nix-grpc-daemon[1328]: time=2026-09-20T09:33:33.622Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5650worker2 # [ 86.405173] nix-grpc-daemon[1328]: time=2026-09-20T09:33:33.624Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5651lb # [ 86.442223] niks3-server[1027]: 2026/09/20 09:33:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5652lb # [ 86.446234] niks3-server[1027]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5653lb # [ 86.454713] niks3-server[1027]: 2026/09/20 09:33:34 INFO Signed narinfos id=32 count=15654worker2 # [ 86.453091] nix-grpc-daemon[1328]: time=2026-09-20T09:33:33.672Z level=INFO msg="Uploading 1 narinfos"5655lb # [ 86.457657] niks3-server[1027]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5656lb # [ 86.462232] niks3-server[1027]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5657lb # [ 86.471311] niks3-server[1027]: 2026/09/20 09:33:34 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5658lb # [ 86.474428] niks3-server[1027]: 2026/09/20 09:33:34 INFO Completed upload id=325659worker2 # [ 86.470235] nix-grpc-daemon[1328]: time=2026-09-20T09:33:33.689Z level=INFO msg="Upload complete. (246ms)"5660lb # [ 86.476583] niks3-server[1027]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5661worker2 # [ 86.478206] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15662worker2 # [ 86.488838] nix-daemon[870]: reaped child process 1456, status = succeeded5663client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 5.20 seconds)5664client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5665client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5666worker1 # [ 86.740661] systemd[1]: Listening on Nix worker-protocol over gRPC.5667worker1 # [ 86.747891] systemd[1]: Starting Nix worker-protocol over gRPC...5668worker1 # [ 86.892108] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5669worker1 # [ 86.895178] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15670worker1 # [ 86.900647] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5671worker1 # [ 86.904846] systemd[1]: Started Nix worker-protocol over gRPC.5672lb: must succeed: curl -sf localhost:9901/clusters5673worker1 # [ 86.931373] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500515674worker2 # [ 86.964886] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05675lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5676worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5677worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5678lb: must succeed: curl -sf localhost:9901/clusters5679lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5680lb: must succeed: curl -sf localhost:9901/clusters5681lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5682worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5683worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5684(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.04 seconds)5685subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5686client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5687client # [ 87.298857] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5688client # Running as unit: rs.service; invocation ID: 2f630fc736944d2cacc5286441782e7b5689client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5690worker1 # [ 87.479186] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436045691worker1 # [ 87.490875] nix-daemon[847]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)5692client # [ 87.533377] nix[1177]: don't know how to build these paths:5693client # [ 87.534275] nix[1177]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5694worker2 # [ 87.543854] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:34Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05695worker2 # [ 87.547788] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:34Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=15696worker2 # [ 87.586382] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145697worker2 # [ 87.598868] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574145698client # [ 87.609248] nix[1177]: copying 1 paths to 'lb:50051'...5699worker2 # [ 87.609982] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574145700client # [ 87.611093] nix[1177]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5701worker2 # [ 87.622367] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5702worker2 # [ 87.790807] nix-daemon[870]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5703worker2 # [ 87.802928] nix-daemon[870]: reaped child process 1494, status = succeeded5704worker2 # [ 87.956648] nix-daemon[870]: accepted connection from pid 1496, user nix-grpc-daemon (trusted)5705worker2 # [ 87.968358] nix-daemon[870]: reaped child process 1499, status = succeeded5706lb # [ 87.988460] niks3-server[1027]: 2026/09/20 09:33:36 INFO Received uploads request method=POST path=/api/pending_closures5707worker2 # [ 87.992422] nix-grpc-daemon[1328]: time=2026-09-20T09:33:35.211Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5708worker2 # [ 87.993800] nix-grpc-daemon[1328]: time=2026-09-20T09:33:35.211Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5709lb # [ 88.014893] niks3-server[1027]: 2026/09/20 09:33:36 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5710lb # [ 88.025508] niks3-server[1027]: 2026/09/20 09:33:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5711worker2 # [ 88.026340] nix-grpc-daemon[1328]: time=2026-09-20T09:33:35.245Z level=INFO msg="Uploading 1 narinfos"5712lb # [ 88.030674] niks3-server[1027]: 2026/09/20 09:33:36 INFO Signed narinfos id=33 count=15713lb # [ 88.044447] niks3-server[1027]: 2026/09/20 09:33:36 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5714lb # [ 88.050242] niks3-server[1027]: 2026/09/20 09:33:36 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5715lb # [ 88.054703] niks3-server[1027]: 2026/09/20 09:33:36 INFO Completed upload id=335716worker2 # [ 88.052544] nix-grpc-daemon[1328]: time=2026-09-20T09:33:35.271Z level=INFO msg="Upload complete. (419ms)"5717lb # [ 88.057332] niks3-server[1027]: 2026/09/20 09:33:36 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5718worker2 # [ 88.056303] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=0 paths=1 nar_bytes_in=4165719worker2 # [ 88.061397] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574145720worker2 # [ 88.070126] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5721worker2 # [ 88.077153] nix-daemon[870]: reaped child process 1489, status = succeeded5722worker2 # [ 88.080037] nix-daemon[870]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5723client # [ 88.079369] nix[1177]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5724lb # [ 88.683283] envoy[926]: conn peer=[2001:db8:1::1]:57782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9560 tx=3808 ms=49575725lb: must succeed: curl -sf localhost:9901/clusters5726lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5727lb: must succeed: curl -sf localhost:9901/clusters5728lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5729lb: must succeed: curl -sf localhost:9901/clusters5730lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5731lb: must succeed: curl -sf localhost:9901/clusters5732lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5733worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5734worker1 # [ 90.056370] systemd-journald[288]: Received client request to rotate journal, rotating.5735worker1 # [ 90.073585] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/b2b3d2919ee549f4b889bb001c9c78e5.5736worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5737worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5738worker2 # [ 90.023477] systemd[1]: Stopping Nix worker-protocol over gRPC...5739worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5740client: must succeed: sleep 5.05741worker2 # [ 90.777360] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:37Z level=info event=draining5742client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5743worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5744worker2 # [ 95.510779] nix-daemon[870]: reaped child process 1503, status = succeeded5745worker2 # [ 95.664332] nix-daemon[870]: accepted connection from pid 1543, user nix-grpc-daemon (trusted)5746worker2 # [ 95.676166] nix-daemon[870]: reaped child process 1546, status = succeeded5747lb # [ 95.698684] niks3-server[1027]: 2026/09/20 09:33:43 INFO Received uploads request method=POST path=/api/pending_closures5748worker2 # [ 95.704080] nix-grpc-daemon[1328]: time=2026-09-20T09:33:42.923Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5749worker2 # [ 95.705534] nix-grpc-daemon[1328]: time=2026-09-20T09:33:42.924Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5750lb # [ 95.743884] niks3-server[1027]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5751lb # [ 95.751073] niks3-server[1027]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5752lb # [ 95.763731] niks3-server[1027]: 2026/09/20 09:33:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5753lb # [ 95.769223] niks3-server[1027]: 2026/09/20 09:33:43 INFO Signed narinfos id=34 count=15754worker2 # [ 95.765241] nix-grpc-daemon[1328]: time=2026-09-20T09:33:42.984Z level=INFO msg="Uploading 1 narinfos"5755lb # [ 95.775185] niks3-server[1027]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5756lb # [ 95.782752] niks3-server[1027]: 2026/09/20 09:33:43 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5757lb # [ 95.787225] niks3-server[1027]: 2026/09/20 09:33:43 INFO Completed upload id=345758lb # [ 95.788769] niks3-server[1027]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5759worker2 # [ 95.782967] nix-grpc-daemon[1328]: time=2026-09-20T09:33:43.002Z level=INFO msg="Upload complete. (289ms)"5760worker2 # [ 95.792222] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57414 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15761worker2 # [ 95.804812] nix-daemon[870]: reaped child process 1501, status = succeeded5762client # [ 95.826410] systemd[1]: rs.service: Deactivated successfully.5763client # [ 95.830187] systemd[1]: rs.service: Consumed 123ms CPU time over 8.530s wall clock time, 37.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5764worker2 # [ 96.778322] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:43Z level=info event=signal_exit5765worker2 # [ 97.008726] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_yield5766worker1 # [ 96.979907] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_restarting addr=lb:500515767worker2 # [ 97.010743] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_restarting addr=lb:500515768worker2 # [ 97.013125] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:574245769lb # [ 97.017550] niks3-server[1027]: 2026/09/20 09:33:45 INFO lead: released remote=192.168.1.4:424245770worker2 # [ 97.014705] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=worker_gone addr=192.168.1.4:500515771worker2 # [ 97.016146] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:574245772worker2 # [ 97.017725] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=worker_gone addr=192.168.1.3:500515773worker1 # [ 97.179772] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515774worker2 # [ 97.211188] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500515775worker1 # [ 97.181644] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5776worker2 # [ 97.213076] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5777worker1 # [ 97.382056] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515778worker2 # [ 97.413708] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500515779worker1 # [ 97.384582] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5780worker2 # [ 97.415781] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5781worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.14 seconds)5782client: waiting for success: ! systemctl is-active rs5783client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds)5784client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5785client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5786client: must fail: journalctl -u rs | grep -q 'reconnecting'5787client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5788lb: must succeed: curl -sf localhost:9901/clusters5789lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5790worker1 # [ 97.585085] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515791worker2 # [ 97.616961] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500515792worker1 # [ 97.589610] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5793worker2 # [ 97.620897] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5794worker1 # [ 97.790369] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515795worker2 # [ 97.821857] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515796worker1 # [ 97.794855] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5797worker2 # [ 97.827196] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5798worker2 # [ 98.010794] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:45Z level=info event=scheduler_restarting5799worker1 # [ 97.997524] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515800worker1 # [ 98.000771] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5801worker2 # [ 98.041576] nix-grpc-daemon[1272]: ts=2026-09-20T09:33:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5802worker2 # [ 98.045888] nix-daemon[870]: reaped child process 1321, status = succeeded5803worker1 # [ 98.198423] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515804worker1 # [ 98.202451] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5805worker1 # [ 98.402954] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515806worker1 # [ 98.404951] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5807lb: must succeed: curl -sf localhost:9901/clusters5808worker1 # [ 98.605612] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515809worker1 # [ 98.607768] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5810lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5811lb # [ 98.684758] envoy[926]: conn peer=[2001:db8:1::1]:39626 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1327 ms=82965812lb # [ 98.687864] envoy[926]: conn peer=[2001:db8:1::4]:51076 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10170 tx=2175 ms=272315813worker2 # [ 98.827326] nix-grpc-daemon[1272]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5814worker2 # [ 98.831071] nix-grpc-daemon[1272]: E0000 00:00:1789896826.046339 1315 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5815worker2 # [ 98.835827] nix-grpc-daemon[1272]: E0000 00:00:1789896826.050189 1315 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5816worker1 # [ 98.808329] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515817worker1 # [ 98.810375] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5818worker1 # [ 99.012165] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515819worker1 # [ 99.015954] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5820worker2 # [ 99.119152] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5821worker2 # [ 99.121064] systemd[1]: Stopped Nix worker-protocol over gRPC.5822worker2 # [ 99.121859] systemd[1]: nix-grpc-daemon.service: Consumed 1.413s CPU time over 28.541s wall clock time, 35.4M memory peak, 61.4K incoming IP traffic, 137.8K outgoing IP traffic.5823worker2 # [ 99.128579] systemd[1]: Starting Nix worker-protocol over gRPC...5824worker1 # [ 99.216680] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515825worker1 # [ 99.220709] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5826worker2 # [ 99.276874] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5827worker2 # [ 99.279881] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15828worker2 # [ 99.285857] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5829worker2 # [ 99.287547] systemd[1]: Started Nix worker-protocol over gRPC.5830lb # [ 99.299202] niks3-server[1027]: 2026/09/20 09:33:47 INFO lead: acquired remote=192.168.1.4:565845831worker2 # [ 99.298172] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=scheduler_take_over5832worker2 # [ 99.313477] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515833worker2 # [ 99.315227] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5834worker1 # [ 99.421717] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515835worker1 # [ 99.425775] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5836worker2 # [ 99.516265] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515837worker2 # [ 99.520257] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5838worker1 # [ 99.626218] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515839worker1 # [ 99.627940] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5840lb: must succeed: curl -sf localhost:9901/clusters5841worker2 # [ 99.721260] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515842worker2 # [ 99.725344] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5843lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5844worker1 # [ 99.829189] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515845worker1 # [ 99.833341] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5846worker2 # [ 99.926263] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515847worker2 # [ 99.930474] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5848worker1 # [ 100.035495] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:48Z level=info event=scheduler_connected addr=lb:500515849worker1 # [ 100.038855] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5850worker2 # [ 100.130744] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515851worker2 # [ 100.137135] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05852worker1 # [ 100.236748] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:48Z level=info event=scheduler_connected addr=lb:500515853worker2 # [ 100.269675] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05854lb: must succeed: curl -sf localhost:9901/clusters5855lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5856worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5857worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5858(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.63 seconds)5859subtest: scheduler restart mid-build: build finishes, no double build5860client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5861client # [ 100.928121] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5862client # Running as unit: mid.service; invocation ID: 97f8c6d449bf48f685d921bdd5b8de9e5863client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5864worker2 # [ 101.138743] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:333085865worker2 # [ 101.149921] nix-daemon[870]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5866client # [ 101.161641] nix[1213]: don't know how to build these paths:5867client # [ 101.162580] nix[1213]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5868worker2 # [ 101.173777] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:48Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05869worker2 # [ 101.179273] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:48Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15870worker2 # [ 101.217975] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:333085871worker2 # [ 101.229421] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 1/5)5872worker2 # [ 101.283354] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 2/5)5873worker2 # [ 101.381082] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 3/5)5874worker2 # [ 101.479210] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 725 ms (attempt 4/5)5875worker2 # [ 102.210276] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5876worker2 # [ 102.222711] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:333085877client # [ 102.232246] nix[1213]: copying 1 paths to 'lb:50051'...5878client # [ 102.235797] nix[1213]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5879worker2 # [ 102.236593] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:333085880worker2 # [ 102.246333] nix-daemon[870]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5881worker2 # [ 102.259146] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:49Z level=info event=niks3_push_started pid=16245882worker2 # [ 102.587500] nix-daemon[870]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)5883worker2 # [ 102.599919] nix-daemon[870]: reaped child process 1640, status = succeeded5884worker2 # [ 102.751540] nix-daemon[870]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5885worker2 # [ 102.763490] nix-daemon[870]: reaped child process 1645, status = succeeded5886lb # [ 102.784205] niks3-server[1027]: 2026/09/20 09:33:50 INFO Received uploads request method=POST path=/api/pending_closures5887worker2 # [ 102.789811] nix-grpc-daemon[1624]: time=2026-09-20T09:33:50.008Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5888worker2 # [ 102.791375] nix-grpc-daemon[1624]: time=2026-09-20T09:33:50.010Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5889lb # [ 102.821601] niks3-server[1027]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5890lb # [ 102.836119] niks3-server[1027]: 2026/09/20 09:33:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5891worker2 # [ 102.836213] nix-grpc-daemon[1624]: time=2026-09-20T09:33:50.055Z level=INFO msg="Uploading 1 narinfos"5892lb # [ 102.841295] niks3-server[1027]: 2026/09/20 09:33:50 INFO Signed narinfos id=35 count=15893lb # [ 102.849789] niks3-server[1027]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5894lb # [ 102.859950] niks3-server[1027]: 2026/09/20 09:33:50 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5895lb # [ 102.866178] niks3-server[1027]: 2026/09/20 09:33:50 INFO Completed upload id=355896lb # [ 102.868308] niks3-server[1027]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5897worker2 # [ 102.863448] nix-grpc-daemon[1624]: time=2026-09-20T09:33:50.082Z level=INFO msg="Upload complete. (428ms)"5898worker2 # [ 102.867111] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33308 duration_s=0 paths=1 nar_bytes_in=4245899worker2 # [ 102.874391] nix-grpc-daemon[1553]: ts=2026-09-20T09:33:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:333085900worker2 # [ 102.884086] nix-daemon[870]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5901worker2 # [ 102.887552] nix-daemon[870]: reaped child process 1622, status = succeeded5902worker2 # [ 102.892332] nix-daemon[870]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5903client # [ 102.891511] nix[1213]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5904lb: must succeed: curl -sf localhost:9901/clusters5905lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5906lb: must succeed: curl -sf localhost:9901/clusters5907lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5908worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5909worker2 # [ 104.707977] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1553 (nix-grpc-daemon) on client request.5910worker2 # [ 104.710279] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5911lb # [ 104.725742] niks3-server[1027]: 2026/09/20 09:33:52 INFO lead: released remote=192.168.1.4:565845912client # [ 104.727656] nix[1213]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5913client # [ 104.729414] nix[1213]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5914worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5915worker1 # [ 104.697194] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5916client: must succeed: sleep 5.05917worker2 # [ 104.741159] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5918worker2 # [ 104.743255] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5919worker2 # [ 104.746705] systemd[1]: nix-grpc-daemon.service: Consumed 354ms CPU time over 5.610s wall clock time, 33.1M memory peak, 12.4K incoming IP traffic, 19.9K outgoing IP traffic.5920worker2 # [ 104.751624] nix-daemon[870]: reaped child process 1647, status = succeeded5921worker2 # [ 104.753249] nix-daemon[870]: reaped child process 1611, status = succeeded5922worker2 # [ 104.760041] nix-daemon[1649]: unexpected Nix daemon error: error: interrupted by the user5923worker2 # [ 104.764814] nix-daemon[870]: reaped child process 1649, status = failed with exit code 15924worker1 # [ 104.897341] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500515925worker2 # [ 104.930891] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5926worker2 # [ 104.939416] systemd[1]: Starting Nix worker-protocol over gRPC...5927worker2 # [ 105.112069] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5928worker2 # [ 105.115914] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15929worker2 # [ 105.122058] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5930worker2 # [ 105.125137] systemd[1]: Started Nix worker-protocol over gRPC.5931lb # [ 105.140450] niks3-server[1027]: 2026/09/20 09:33:53 INFO lead: acquired remote=192.168.1.4:550645932worker2 # [ 105.137606] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=info event=scheduler_take_over5933worker2 # [ 105.141929] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05934worker2 # [ 105.157866] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500515935worker2 # [ 105.159506] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05936worker2 # [ 105.236791] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05937worker2 # [ 105.240566] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:52Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15938worker1 # [ 105.251401] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436045939worker1 # [ 105.263319] nix-grpc-daemon[1108]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)5940worker1 # [ 105.321219] nix-grpc-daemon[1108]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5)5941worker1 # [ 105.480546] nix-grpc-daemon[1108]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 3/5)5942worker1 # [ 105.552508] nix-grpc-daemon[1108]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 125 ms (attempt 4/5)5943worker1 # [ 105.684223] nix-grpc-daemon[1108]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5944worker1 # [ 105.700912] nix-grpc-daemon[1108]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5945worker1 # [ 105.723782] nix-daemon[847]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)5946client # [ 105.767283] nix[1213]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5947worker1 # [ 105.737862] nix-daemon[847]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)5948lb # [ 108.685921] envoy[926]: conn peer=[2001:db8:1::4]:39350 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1310 tx=411 ms=54185949client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5950client: waiting for success: ! systemctl is-active mid5951worker1 # [ 109.956902] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:58Z level=info event=niks3_push_started pid=12615952worker1 # [ 109.967785] nix-daemon[847]: reaped child process 1237, status = succeeded5953worker1 # [ 110.282910] nix-daemon[847]: accepted connection from pid 1274, user nix-grpc-daemon (trusted)5954worker1 # [ 110.294915] nix-daemon[847]: reaped child process 1277, status = succeeded5955lb # [ 110.347142] niks3-server[1027]: 2026/09/20 09:33:58 INFO Received uploads request method=POST path=/api/pending_closures5956worker1 # [ 110.316470] nix-grpc-daemon[1261]: time=2026-09-20T09:33:58.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5957worker1 # [ 110.319124] nix-grpc-daemon[1261]: time=2026-09-20T09:33:58.411Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5958lb # [ 110.371892] niks3-server[1027]: 2026/09/20 09:33:58 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5959lb # [ 110.383469] niks3-server[1027]: 2026/09/20 09:33:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5960worker1 # [ 110.355194] nix-grpc-daemon[1261]: time=2026-09-20T09:33:58.448Z level=INFO msg="Uploading 1 narinfos"5961lb # [ 110.389847] niks3-server[1027]: 2026/09/20 09:33:58 INFO Signed narinfos id=36 count=15962lb # [ 110.401807] niks3-server[1027]: 2026/09/20 09:33:58 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5963lb # [ 110.405579] niks3-server[1027]: 2026/09/20 09:33:58 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5964lb # [ 110.411294] niks3-server[1027]: 2026/09/20 09:33:58 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5965lb # [ 110.415239] niks3-server[1027]: 2026/09/20 09:33:58 INFO Completed upload id=365966worker1 # [ 110.380087] nix-grpc-daemon[1261]: time=2026-09-20T09:33:58.473Z level=INFO msg="Upload complete. (247ms)"5967worker1 # [ 110.382458] nix-grpc-daemon[1261]: time=2026-09-20T09:33:58.475Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo error="server returned 404: object is not pending upload\n"5968worker1 # [ 110.385102] nix-grpc-daemon[1108]: ts=2026-09-20T09:33:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43604 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15969worker1 # [ 110.391553] nix-daemon[847]: reaped child process 1235, status = succeeded5970client # [ 110.444745] systemd[1]: mid.service: Deactivated successfully.5971client # [ 110.446691] systemd[1]: mid.service: Consumed 121ms CPU time over 9.518s wall clock time, 37.1M memory peak, 9.7K incoming IP traffic, 10.6K outgoing IP traffic.5972client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)5973client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5974client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5975(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.23 seconds)5976subtest: interrupting the client stops the build on the worker5977client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5978client # [ 111.127222] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5979client # Running as unit: intr.service; invocation ID: 726e886c15404140ad82fa4477478b965980client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5981worker2 # [ 111.332832] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:515985982worker2 # [ 111.344532] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5983client # [ 111.356284] nix[1249]: don't know how to build these paths:5984client # [ 111.357232] nix[1249]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5985worker2 # [ 111.365175] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:58Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05986worker2 # [ 111.369958] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:58Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15987worker2 # [ 111.414651] nix-grpc-daemon[1685]: ts=2026-09-20T09:33:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515985988worker2 # [ 111.425864] nix-grpc-daemon[1685]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 1/5)5989worker2 # [ 111.464837] nix-grpc-daemon[1685]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 195 ms (attempt 2/5)5990worker2 # [ 111.665825] nix-grpc-daemon[1685]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 358 ms (attempt 3/5)5991worker2 # [ 112.029792] nix-grpc-daemon[1685]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 784 ms (attempt 4/5)5992worker2 # [ 112.822104] nix-grpc-daemon[1685]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5993worker2 # [ 112.838431] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515985994client # [ 112.848980] nix[1249]: copying 1 paths to 'lb:50051'...5995worker2 # [ 112.851484] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:515985996client # [ 112.853181] nix[1249]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5997worker2 # [ 112.863760] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5998worker2 # [ 112.882400] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:00Z level=info event=niks3_push_started pid=17615999worker2 # [ 113.187416] nix-daemon[870]: accepted connection from pid 1774, user nix-grpc-daemon (trusted)6000worker2 # [ 113.201990] nix-daemon[870]: reaped child process 1777, status = succeeded6001worker2 # [ 113.365489] nix-daemon[870]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)6002worker2 # [ 113.379146] nix-daemon[870]: reaped child process 1782, status = succeeded6003lb # [ 113.399177] niks3-server[1027]: 2026/09/20 09:34:01 INFO Received uploads request method=POST path=/api/pending_closures6004worker2 # [ 113.405815] nix-grpc-daemon[1761]: time=2026-09-20T09:34:00.624Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6005worker2 # [ 113.409030] nix-grpc-daemon[1761]: time=2026-09-20T09:34:00.626Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6006lb # [ 113.442085] niks3-server[1027]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6007lb # [ 113.447602] niks3-server[1027]: 2026/09/20 09:34:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6008lb # [ 113.452800] niks3-server[1027]: 2026/09/20 09:34:01 INFO Signed narinfos id=37 count=16009worker2 # [ 113.451530] nix-grpc-daemon[1761]: time=2026-09-20T09:34:00.670Z level=INFO msg="Uploading 1 narinfos"6010lb # [ 113.463220] niks3-server[1027]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6011lb # [ 113.471080] niks3-server[1027]: 2026/09/20 09:34:01 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6012lb # [ 113.480280] niks3-server[1027]: 2026/09/20 09:34:01 INFO Completed upload id=376013worker2 # [ 113.476252] nix-grpc-daemon[1761]: time=2026-09-20T09:34:00.695Z level=INFO msg="Upload complete. (435ms)"6014lb # [ 113.482364] niks3-server[1027]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6015worker2 # [ 113.478519] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 paths=1 nar_bytes_in=4246016worker2 # [ 113.483396] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986017worker2 # [ 113.490087] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6018worker2 # [ 113.496456] nix-daemon[870]: reaped child process 1759, status = succeeded6019client # [ 113.502884] nix[1249]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6020worker2 # [ 113.507480] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6021client: must succeed: systemctl kill -s INT intr6022client # [ 114.654501] systemd[1]: intr.service: Sent signal SIGINT to main process 1249 (nix) on client request.6023worker2 # [ 114.657261] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:01Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6024client # [ 114.661556] nix[1249]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6025client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)6026client # [ 114.669813] nix[1249]: error: interrupted by the user6027client # [ 114.695567] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6028client # [ 114.697204] systemd[1]: intr.service: Failed with result 'exit-code'.6029client # [ 114.699260] systemd[1]: intr.service: Consumed 111ms CPU time over 3.571s wall clock time, 39.1M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.6030worker2 # [ 114.728683] nix-daemon[870]: reaped child process 1788, status = succeeded6031worker2 # [ 114.730749] nix-daemon[1790]: unexpected Nix daemon error: error: interrupted by the user6032worker2 # [ 114.737347] nix-daemon[870]: reaped child process 1790, status = failed with exit code 16033(finished: subtest: interrupting the client stops the build on the worker, in 3.67 seconds)6034subtest: a deploy mid-build drains: the build finishes, the new generation takes over6035client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw6036client # [ 114.816765] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.6037client # Running as unit: sw.service; invocation ID: 08e2d610866344bb98e36d40b2a04c466038client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.05 seconds)6039client # [ 114.999472] nix[1269]: don't know how to build these paths:6040worker1 # [ 114.967238] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436046041client # [ 115.000920] nix[1269]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6042worker2 # [ 115.009802] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:02Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06043worker2 # [ 115.014842] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:02Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=16044worker1 # [ 115.027649] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436046045worker1 # [ 115.039524] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436046046client # [ 115.080106] nix[1269]: copying 1 paths to 'lb:50051'...6047client # [ 115.080969] nix[1269]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6048worker1 # [ 115.050291] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436046049worker1 # [ 115.061354] nix-daemon[847]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)6050worker1 # [ 115.236495] nix-daemon[847]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)6051worker1 # [ 115.250031] nix-daemon[847]: reaped child process 1308, status = succeeded6052worker1 # [ 115.390284] nix-daemon[847]: accepted connection from pid 1310, user nix-grpc-daemon (trusted)6053worker1 # [ 115.402623] nix-daemon[847]: reaped child process 1313, status = succeeded6054lb # [ 115.447553] niks3-server[1027]: 2026/09/20 09:34:03 INFO Received uploads request method=POST path=/api/pending_closures6055worker1 # [ 115.420951] nix-grpc-daemon[1261]: time=2026-09-20T09:34:03.513Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6056worker1 # [ 115.422376] nix-grpc-daemon[1261]: time=2026-09-20T09:34:03.513Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6057lb # [ 115.474944] niks3-server[1027]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6058lb # [ 115.486060] niks3-server[1027]: 2026/09/20 09:34:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6059worker1 # [ 115.455709] nix-grpc-daemon[1261]: time=2026-09-20T09:34:03.548Z level=INFO msg="Uploading 1 narinfos"6060lb # [ 115.492367] niks3-server[1027]: 2026/09/20 09:34:03 INFO Signed narinfos id=38 count=16061lb # [ 115.496638] niks3-server[1027]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6062lb # [ 115.508335] niks3-server[1027]: 2026/09/20 09:34:03 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6063lb # [ 115.514580] niks3-server[1027]: 2026/09/20 09:34:03 INFO Completed upload id=386064worker1 # [ 115.479561] nix-grpc-daemon[1261]: time=2026-09-20T09:34:03.572Z level=INFO msg="Upload complete. (407ms)"6065lb # [ 115.518145] niks3-server[1027]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6066worker1 # [ 115.483471] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43604 duration_s=0 paths=1 nar_bytes_in=4166067worker1 # [ 115.489697] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436046068worker1 # [ 115.499850] nix-daemon[847]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)6069worker1 # [ 115.502121] nix-daemon[847]: reaped child process 1303, status = succeeded6070worker1 # [ 115.507472] nix-daemon[847]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)6071client # [ 115.537638] nix[1269]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6072worker1: must succeed: systemctl reload nix-grpc-daemon.service6073worker1 # [ 117.325091] systemd[1]: Reloading Nix worker-protocol over gRPC...6074worker1 # [ 117.363687] systemd[1]: Reloaded Nix worker-protocol over gRPC.6075worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds)6076worker1: must succeed: pgrep -f 'read -t [9]0 x'6077worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds)6078client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26079worker2 # [ 117.662840] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:515986080client # don't know how to build these paths:6081client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6082worker2 # [ 117.671953] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986083worker2 # [ 117.693186] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:04Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06084worker2 # [ 117.697278] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:04Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16085worker2 # [ 117.752635] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986086worker2 # [ 117.765850] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986087client # copying 1 paths to 'lb:50051'...6088worker2 # [ 117.778713] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:515986089client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6090worker2 # [ 117.797837] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6091worker1 # [ 117.914367] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:06Z level=info event=draining6092worker2 # [ 117.988389] nix-daemon[870]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6093worker2 # [ 118.003214] nix-daemon[870]: reaped child process 1839, status = succeeded6094worker2 # [ 118.172255] nix-daemon[870]: accepted connection from pid 1841, user nix-grpc-daemon (trusted)6095worker2 # [ 118.184293] nix-daemon[870]: reaped child process 1844, status = succeeded6096lb # [ 118.206581] niks3-server[1027]: 2026/09/20 09:34:06 INFO Received uploads request method=POST path=/api/pending_closures6097worker2 # [ 118.210101] nix-grpc-daemon[1761]: time=2026-09-20T09:34:05.429Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6098worker2 # [ 118.211764] nix-grpc-daemon[1761]: time=2026-09-20T09:34:05.431Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6099lb # [ 118.236720] niks3-server[1027]: 2026/09/20 09:34:06 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6100lb # [ 118.251783] niks3-server[1027]: 2026/09/20 09:34:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6101worker2 # [ 118.252771] nix-grpc-daemon[1761]: time=2026-09-20T09:34:05.471Z level=INFO msg="Uploading 1 narinfos"6102lb # [ 118.257584] niks3-server[1027]: 2026/09/20 09:34:06 INFO Signed narinfos id=39 count=16103lb # [ 118.270099] niks3-server[1027]: 2026/09/20 09:34:06 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6104lb # [ 118.273347] niks3-server[1027]: 2026/09/20 09:34:06 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6105lb # [ 118.279940] niks3-server[1027]: 2026/09/20 09:34:06 INFO Completed upload id=396106worker2 # [ 118.277542] nix-grpc-daemon[1761]: time=2026-09-20T09:34:05.496Z level=INFO msg="Upload complete. (464ms)"6107lb # [ 118.283089] niks3-server[1027]: 2026/09/20 09:34:06 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6108worker2 # [ 118.282139] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 paths=1 nar_bytes_in=5286109worker2 # [ 118.287108] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986110worker2 # [ 118.297131] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6111worker2 # [ 118.303124] nix-daemon[870]: reaped child process 1834, status = succeeded6112worker2 # [ 118.306269] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6113client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6114client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6115lb # [ 118.687945] envoy[926]: conn peer=[2001:db8:1::1]:55412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1662 ms=92946116lb # [ 118.693154] envoy[926]: conn peer=[2001:db8:1::1]:36578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=756 ms=33506117client # farm-a> LOG-farm-a-during-drain6118worker2 # [ 119.734243] nix-daemon[870]: reaped child process 1848, status = succeeded6119worker2 # [ 119.885749] nix-daemon[870]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)6120worker2 # [ 119.896852] nix-daemon[870]: reaped child process 1866, status = succeeded6121lb # [ 119.916523] niks3-server[1027]: 2026/09/20 09:34:08 INFO Received uploads request method=POST path=/api/pending_closures6122worker2 # [ 119.916412] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.135Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6123worker2 # [ 119.917953] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.137Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6124lb # [ 119.935532] niks3-server[1027]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6125lb # [ 119.940345] niks3-server[1027]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6126lb # [ 119.943355] niks3-server[1027]: 2026/09/20 09:34:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6127lb # [ 119.944891] niks3-server[1027]: 2026/09/20 09:34:08 INFO Signed narinfos id=40 count=16128worker2 # [ 119.941646] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.161Z level=INFO msg="Uploading 1 narinfos"6129lb # [ 119.947413] niks3-server[1027]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6130lb # [ 119.953289] niks3-server[1027]: 2026/09/20 09:34:08 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6131lb # [ 119.955693] niks3-server[1027]: 2026/09/20 09:34:08 INFO Completed upload id=406132worker2 # [ 119.952526] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.171Z level=INFO msg="Upload complete. (237ms)"6133lb # [ 119.957930] niks3-server[1027]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6134worker2 # [ 119.954882] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16135worker2 # [ 119.961532] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06136worker2 # [ 119.963487] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16137worker2 # [ 119.967924] nix-daemon[870]: reaped child process 1846, status = succeeded6138worker2 # [ 120.011976] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986139worker2 # [ 120.023329] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986140worker2 # [ 120.034539] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.253Z level=INFO msg="All 1 paths already cached"6141client # copying 1 paths to 'lb:50051'...6142worker2 # [ 120.041924] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:515986143client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6144worker2 # [ 120.060261] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6145worker2 # [ 120.219284] nix-daemon[870]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)6146worker2 # [ 120.231876] nix-daemon[870]: reaped child process 1875, status = succeeded6147worker2 # [ 120.390803] nix-daemon[870]: accepted connection from pid 1877, user nix-grpc-daemon (trusted)6148worker2 # [ 120.403482] nix-daemon[870]: reaped child process 1880, status = succeeded6149lb # [ 120.424254] niks3-server[1027]: 2026/09/20 09:34:08 INFO Received uploads request method=POST path=/api/pending_closures6150worker2 # [ 120.427889] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.646Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6151worker2 # [ 120.429276] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.646Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6152lb # [ 120.449811] niks3-server[1027]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6153lb # [ 120.459843] niks3-server[1027]: 2026/09/20 09:34:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6154worker2 # [ 120.461061] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.680Z level=INFO msg="Uploading 1 narinfos"6155lb # [ 120.465164] niks3-server[1027]: 2026/09/20 09:34:08 INFO Signed narinfos id=41 count=16156lb # [ 120.472405] niks3-server[1027]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6157lb # [ 120.482326] niks3-server[1027]: 2026/09/20 09:34:08 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6158worker2 # [ 120.483575] nix-grpc-daemon[1761]: time=2026-09-20T09:34:07.702Z level=INFO msg="Upload complete. (412ms)"6159lb # [ 120.488246] niks3-server[1027]: 2026/09/20 09:34:08 INFO Completed upload id=416160lb # [ 120.491539] niks3-server[1027]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6161worker2 # [ 120.486234] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 paths=1 nar_bytes_in=6406162worker2 # [ 120.491340] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986163worker2 # [ 120.502272] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6164worker2 # [ 120.504264] nix-daemon[870]: reaped child process 1870, status = succeeded6165worker2 # [ 120.509530] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6166client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6167client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6168client # farm-b> LOG-farm-b-during-drain6169worker2 # [ 121.133851] nix-daemon[870]: reaped child process 1884, status = succeeded6170worker2 # [ 121.289688] nix-daemon[870]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6171worker2 # [ 121.300548] nix-daemon[870]: reaped child process 1902, status = succeeded6172lb # [ 121.321587] niks3-server[1027]: 2026/09/20 09:34:09 INFO Received uploads request method=POST path=/api/pending_closures6173worker2 # [ 121.325206] nix-grpc-daemon[1761]: time=2026-09-20T09:34:08.544Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6174worker2 # [ 121.326873] nix-grpc-daemon[1761]: time=2026-09-20T09:34:08.546Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6175lb # [ 121.353103] niks3-server[1027]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6176lb # [ 121.363540] niks3-server[1027]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6177lb # [ 121.375894] niks3-server[1027]: 2026/09/20 09:34:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6178lb # [ 121.380973] niks3-server[1027]: 2026/09/20 09:34:09 INFO Signed narinfos id=42 count=16179worker2 # [ 121.379654] nix-grpc-daemon[1761]: time=2026-09-20T09:34:08.598Z level=INFO msg="Uploading 1 narinfos"6180lb # [ 121.386452] niks3-server[1027]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6181lb # [ 121.396245] niks3-server[1027]: 2026/09/20 09:34:09 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6182lb # [ 121.401443] niks3-server[1027]: 2026/09/20 09:34:09 INFO Completed upload id=426183worker2 # [ 121.397382] nix-grpc-daemon[1761]: time=2026-09-20T09:34:08.616Z level=INFO msg="Upload complete. (279ms)"6184lb # [ 121.404066] niks3-server[1027]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6185worker2 # [ 121.407455] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16186worker2 # [ 121.416215] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:08Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06187worker2 # [ 121.419374] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:08Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16188worker2 # [ 121.428282] nix-daemon[870]: reaped child process 1882, status = succeeded6189worker2 # [ 121.458363] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986190worker2 # [ 121.470366] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986191worker2 # [ 121.483663] nix-grpc-daemon[1761]: time=2026-09-20T09:34:08.702Z level=INFO msg="All 2 paths already cached"6192client # copying 1 paths to 'lb:50051'...6193worker2 # [ 121.491997] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:515986194client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6195worker2 # [ 121.511155] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6196worker2 # [ 121.664533] nix-daemon[870]: accepted connection from pid 1908, user nix-grpc-daemon (trusted)6197worker2 # [ 121.677185] nix-daemon[870]: reaped child process 1911, status = succeeded6198worker2 # [ 121.822290] nix-daemon[870]: accepted connection from pid 1913, user nix-grpc-daemon (trusted)6199worker2 # [ 121.834374] nix-daemon[870]: reaped child process 1916, status = succeeded6200lb # [ 121.854148] niks3-server[1027]: 2026/09/20 09:34:09 INFO Received uploads request method=POST path=/api/pending_closures6201worker2 # [ 121.857609] nix-grpc-daemon[1761]: time=2026-09-20T09:34:09.076Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6202worker2 # [ 121.859273] nix-grpc-daemon[1761]: time=2026-09-20T09:34:09.078Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6203lb # [ 121.887308] niks3-server[1027]: 2026/09/20 09:34:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6204lb # [ 121.894148] niks3-server[1027]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6205worker2 # [ 121.894722] nix-grpc-daemon[1761]: time=2026-09-20T09:34:09.113Z level=INFO msg="Uploading 1 narinfos"6206lb # [ 121.899165] niks3-server[1027]: 2026/09/20 09:34:10 INFO Signed narinfos id=43 count=16207lb # [ 121.906107] niks3-server[1027]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6208lb # [ 121.916736] niks3-server[1027]: 2026/09/20 09:34:10 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6209worker2 # [ 121.918771] nix-grpc-daemon[1761]: time=2026-09-20T09:34:09.138Z level=INFO msg="Upload complete. (395ms)"6210lb # [ 121.923751] niks3-server[1027]: 2026/09/20 09:34:10 INFO Completed upload id=436211lb # [ 121.927400] niks3-server[1027]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6212worker2 # [ 121.922150] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 paths=1 nar_bytes_in=7686213worker2 # [ 121.927244] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986214worker2 # [ 121.934876] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6215worker2 # [ 121.940209] nix-daemon[870]: reaped child process 1906, status = succeeded6216worker2 # [ 121.945215] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6217client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6218client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6219client # farm-top> LOG-farm-top-during-drain6220worker2 # [ 123.559520] nix-daemon[870]: reaped child process 1920, status = succeeded6221worker2 # [ 123.700201] nix-daemon[870]: accepted connection from pid 1935, user nix-grpc-daemon (trusted)6222worker2 # [ 123.712320] nix-daemon[870]: reaped child process 1938, status = succeeded6223lb # [ 123.732995] niks3-server[1027]: 2026/09/20 09:34:11 INFO Received uploads request method=POST path=/api/pending_closures6224worker2 # [ 123.739732] nix-grpc-daemon[1761]: time=2026-09-20T09:34:10.958Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6225worker2 # [ 123.741226] nix-grpc-daemon[1761]: time=2026-09-20T09:34:10.960Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6226lb # [ 123.777366] niks3-server[1027]: 2026/09/20 09:34:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6227lb # [ 123.785204] niks3-server[1027]: 2026/09/20 09:34:11 INFO Signed narinfos id=44 count=16228worker2 # [ 123.783435] nix-grpc-daemon[1761]: time=2026-09-20T09:34:11.002Z level=INFO msg="Uploading 1 narinfos"6229lb # [ 123.788735] niks3-server[1027]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6230lb # [ 123.797482] niks3-server[1027]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6231lb # [ 123.801260] niks3-server[1027]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6232lb # [ 123.808389] niks3-server[1027]: 2026/09/20 09:34:11 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6233lb # [ 123.813521] niks3-server[1027]: 2026/09/20 09:34:11 INFO Completed upload id=446234lb # [ 123.815063] niks3-server[1027]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6235worker2 # [ 123.810473] nix-grpc-daemon[1761]: time=2026-09-20T09:34:11.029Z level=INFO msg="Upload complete. (257ms)"6236worker2 # [ 123.818304] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16237worker2 # [ 123.828418] nix-daemon[870]: reaped child process 1918, status = succeeded6238client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.42 seconds)6239client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6240client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.21 seconds)6241worker1: must succeed: pkill -f 'read -t [9]0 x'6242worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6243client: waiting for success: ! systemctl is-active sw6244worker1 # [ 124.128734] nix-daemon[847]: reaped child process 1317, status = succeeded6245worker1 # [ 124.245093] nix-daemon[847]: accepted connection from pid 1357, user nix-grpc-daemon (trusted)6246worker1 # [ 124.255553] nix-daemon[847]: reaped child process 1360, status = succeeded6247lb # [ 124.305897] niks3-server[1027]: 2026/09/20 09:34:12 INFO Received uploads request method=POST path=/api/pending_closures6248worker1 # [ 124.280068] nix-grpc-daemon[1261]: time=2026-09-20T09:34:12.373Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6249worker1 # [ 124.282206] nix-grpc-daemon[1261]: time=2026-09-20T09:34:12.374Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6250lb # [ 124.345309] niks3-server[1027]: 2026/09/20 09:34:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6251lb # [ 124.351643] niks3-server[1027]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6252worker1 # [ 124.323106] nix-grpc-daemon[1261]: time=2026-09-20T09:34:12.416Z level=INFO msg="Uploading 1 narinfos"6253lb # [ 124.358381] niks3-server[1027]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6254lb # [ 124.361376] niks3-server[1027]: 2026/09/20 09:34:12 INFO Signed narinfos id=45 count=16255lb # [ 124.366972] niks3-server[1027]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6256lb # [ 124.372057] niks3-server[1027]: 2026/09/20 09:34:12 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6257lb # [ 124.376225] niks3-server[1027]: 2026/09/20 09:34:12 INFO Completed upload id=456258lb # [ 124.377532] niks3-server[1027]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6259worker1 # [ 124.342371] nix-grpc-daemon[1261]: time=2026-09-20T09:34:12.435Z level=INFO msg="Upload complete. (220ms)"6260worker1 # [ 124.345701] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43604 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16261worker1 # [ 124.352707] nix-daemon[847]: reaped child process 1315, status = succeeded6262client # [ 124.417508] systemd[1]: sw.service: Deactivated successfully.6263client # [ 124.421894] systemd[1]: sw.service: Consumed 118ms CPU time over 9.602s wall clock time, 39.1M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.6264worker1 # [ 124.916978] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:13Z level=info event=signal_exit6265client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)6266client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6267client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6268worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6269worker2 # [ 126.193367] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:515606270worker2 # [ 126.197097] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:13Z level=info event=worker_gone addr=192.168.1.3:500516271worker1 # [ 126.170086] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:14Z level=info event=scheduler_restarting6272worker1 # [ 126.176724] nix-grpc-daemon[1108]: ts=2026-09-20T09:34:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6273worker1 # [ 126.193368] nix-daemon[847]: reaped child process 1166, status = succeeded6274worker1 # [ 127.106126] nix-grpc-daemon[1108]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6275worker1 # [ 127.109499] nix-grpc-daemon[1108]: E0000 00:00:1789896855.199262 1151 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6276worker1 # [ 127.114745] nix-grpc-daemon[1108]: E0000 00:00:1789896855.208130 1151 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6277worker1 # [ 127.265957] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6278worker1 # [ 127.267468] systemd[1]: nix-grpc-daemon.service: Consumed 696ms CPU time over 40.518s wall clock time, 32.4M memory peak, 24.7K incoming IP traffic, 37K outgoing IP traffic.6279worker1 # [ 127.278566] systemd[1]: Starting Nix worker-protocol over gRPC...6280worker1 # [ 127.404406] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:15Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6281worker1 # [ 127.408239] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:15Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16282worker1 # [ 127.413675] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:15Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6283worker1 # [ 127.415254] systemd[1]: Started Nix worker-protocol over gRPC.6284worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.22 seconds)6285lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6286lb: must succeed: curl -sf localhost:9901/clusters6287worker1 # [ 127.442922] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:15Z level=info event=scheduler_connected addr=lb:500516288worker2 # [ 127.476862] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06289lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6290lb: must succeed: curl -sf localhost:9901/clusters6291lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6292lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)6293lb: must succeed: curl -sf localhost:9901/clusters6294lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6295worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6296worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)6297lb # [ 128.688205] envoy[926]: conn peer=[2001:db8:1::1]:47018 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9572 tx=3854 ms=61716298(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.91 seconds)6299subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6300client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16301lb # [ 128.689687] envoy[926]: conn peer=[2001:db8:1::1]:47010 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1332 ms=93956302lb # [ 128.691146] envoy[926]: conn peer=[2001:db8:1::3]:35068 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4354 tx=1002 ms=392396303worker2 # [ 128.904990] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:515986304worker1 # [ 128.880755] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306305worker1 # [ 128.891966] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6306worker1 # [ 128.908263] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 1/5)6307worker1 # [ 128.951987] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 2/5)6308worker1 # [ 129.087943] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 249 ms (attempt 3/5)6309worker1 # [ 129.342924] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 363 ms (attempt 4/5)6310worker1 # [ 129.712335] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6311worker2 # [ 129.783623] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:17Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06312worker2 # [ 129.787987] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:17Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16313worker2 # [ 129.792336] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:17Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06314worker2 # [ 129.796182] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:17Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06315worker1 # [ 129.797469] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306316worker1 # [ 129.810978] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306317worker1 # [ 129.823158] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306318worker1 # [ 129.831655] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6319worker1 # [ 129.852978] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:17Z level=info event=niks3_push_started pid=14306320worker1 # [ 130.171801] nix-daemon[847]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)6321worker1 # [ 130.183789] nix-daemon[847]: reaped child process 1446, status = succeeded6322worker1 # [ 130.339225] nix-daemon[847]: accepted connection from pid 1448, user nix-grpc-daemon (trusted)6323worker1 # [ 130.350963] nix-daemon[847]: reaped child process 1451, status = succeeded6324lb # [ 130.401620] niks3-server[1027]: 2026/09/20 09:34:18 INFO Received uploads request method=POST path=/api/pending_closures6325worker1 # [ 130.375893] nix-grpc-daemon[1430]: time=2026-09-20T09:34:18.468Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6326worker1 # [ 130.377557] nix-grpc-daemon[1430]: time=2026-09-20T09:34:18.468Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6327lb # [ 130.434361] niks3-server[1027]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6328lb # [ 130.441836] niks3-server[1027]: 2026/09/20 09:34:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6329lb # [ 130.446647] niks3-server[1027]: 2026/09/20 09:34:18 INFO Signed narinfos id=46 count=16330worker1 # [ 130.414598] nix-grpc-daemon[1430]: time=2026-09-20T09:34:18.507Z level=INFO msg="Uploading 1 narinfos"6331lb # [ 130.457869] niks3-server[1027]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6332lb # [ 130.466358] niks3-server[1027]: 2026/09/20 09:34:18 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6333worker1 # [ 130.437515] nix-grpc-daemon[1430]: time=2026-09-20T09:34:18.530Z level=INFO msg="Upload complete. (417ms)"6334lb # [ 130.472337] niks3-server[1027]: 2026/09/20 09:34:18 INFO Completed upload id=466335lb # [ 130.475846] niks3-server[1027]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6336worker1 # [ 130.439757] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=5046337worker1 # [ 130.445514] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306338worker1 # [ 130.453056] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6339worker1 # [ 130.457404] nix-daemon[847]: reaped child process 1428, status = succeeded6340worker1 # [ 130.462485] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6341worker1 # [ 131.877384] nix-daemon[847]: reaped child process 1455, status = succeeded6342worker1 # [ 132.014928] nix-daemon[847]: accepted connection from pid 1470, user nix-grpc-daemon (trusted)6343worker1 # [ 132.025708] nix-daemon[847]: reaped child process 1473, status = succeeded6344lb # [ 132.075720] niks3-server[1027]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures6345worker1 # [ 132.049067] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6346worker1 # [ 132.050563] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.144Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6347lb # [ 132.112942] niks3-server[1027]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6348lb # [ 132.123204] niks3-server[1027]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6349lb # [ 132.132360] niks3-server[1027]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6350worker1 # [ 132.105942] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.198Z level=INFO msg="Uploading 1 narinfos"6351lb # [ 132.141095] niks3-server[1027]: 2026/09/20 09:34:20 INFO Signed narinfos id=47 count=16352lb # [ 132.144213] niks3-server[1027]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6353lb # [ 132.156395] niks3-server[1027]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6354lb # [ 132.160297] niks3-server[1027]: 2026/09/20 09:34:20 INFO Completed upload id=476355lb # [ 132.161816] niks3-server[1027]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6356worker1 # [ 132.126864] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.220Z level=INFO msg="Upload complete. (255ms)"6357worker1 # [ 132.133308] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16358worker2 # [ 132.167372] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:19Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16359worker2 # [ 132.173211] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:19Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06360worker1 # [ 132.148288] nix-daemon[847]: reaped child process 1453, status = succeeded6361worker1 # [ 132.178205] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306362worker1 # [ 132.189699] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306363worker1 # [ 132.199539] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306364worker1 # [ 132.209183] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6365worker1 # [ 132.374321] nix-daemon[847]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)6366worker1 # [ 132.386809] nix-daemon[847]: reaped child process 1480, status = succeeded6367worker1 # [ 132.536059] nix-daemon[847]: accepted connection from pid 1482, user nix-grpc-daemon (trusted)6368worker1 # [ 132.547836] nix-daemon[847]: reaped child process 1485, status = succeeded6369lb # [ 132.596182] niks3-server[1027]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures6370worker1 # [ 132.565676] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.658Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6371worker1 # [ 132.567168] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.658Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6372lb # [ 132.607899] niks3-server[1027]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6373lb # [ 132.612084] niks3-server[1027]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6374lb # [ 132.614428] niks3-server[1027]: 2026/09/20 09:34:20 INFO Signed narinfos id=48 count=16375worker1 # [ 132.579457] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.672Z level=INFO msg="Uploading 1 narinfos"6376lb # [ 132.617529] niks3-server[1027]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6377lb # [ 132.621333] niks3-server[1027]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6378lb # [ 132.624914] niks3-server[1027]: 2026/09/20 09:34:20 INFO Completed upload id=486379worker1 # [ 132.589728] nix-grpc-daemon[1430]: time=2026-09-20T09:34:20.683Z level=INFO msg="Upload complete. (369ms)"6380lb # [ 132.626146] niks3-server[1027]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6381worker1 # [ 132.591684] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=5046382worker1 # [ 132.594787] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306383worker1 # [ 132.600555] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6384worker1 # [ 132.603978] nix-daemon[847]: reaped child process 1475, status = succeeded6385worker1 # [ 132.609452] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6386worker1 # [ 133.220811] nix-daemon[847]: reaped child process 1489, status = succeeded6387worker1 # [ 133.365907] nix-daemon[847]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)6388worker1 # [ 133.378080] nix-daemon[847]: reaped child process 1507, status = succeeded6389lb # [ 133.429764] niks3-server[1027]: 2026/09/20 09:34:21 INFO Received uploads request method=POST path=/api/pending_closures6390worker1 # [ 133.402227] nix-grpc-daemon[1430]: time=2026-09-20T09:34:21.495Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6391worker1 # [ 133.404244] nix-grpc-daemon[1430]: time=2026-09-20T09:34:21.497Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6392lb # [ 133.467191] niks3-server[1027]: 2026/09/20 09:34:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6393lb # [ 133.472969] niks3-server[1027]: 2026/09/20 09:34:21 INFO Signed narinfos id=49 count=16394worker1 # [ 133.440833] nix-grpc-daemon[1430]: time=2026-09-20T09:34:21.534Z level=INFO msg="Uploading 1 narinfos"6395lb # [ 133.481914] niks3-server[1027]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6396lb # [ 133.487532] niks3-server[1027]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6397lb # [ 133.494129] niks3-server[1027]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6398lb # [ 133.502180] niks3-server[1027]: 2026/09/20 09:34:21 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6399lb # [ 133.507100] niks3-server[1027]: 2026/09/20 09:34:21 INFO Completed upload id=496400worker1 # [ 133.471998] nix-grpc-daemon[1430]: time=2026-09-20T09:34:21.565Z level=INFO msg="Upload complete. (257ms)"6401lb # [ 133.510278] niks3-server[1027]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6402worker1 # [ 133.476700] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16403worker2 # [ 133.509700] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:20Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16404worker1 # [ 133.486462] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306405worker2 # [ 133.519706] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:20Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06406worker1 # [ 133.497384] nix-daemon[847]: reaped child process 1487, status = succeeded6407worker1 # [ 133.499370] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306408worker1 # [ 133.504472] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306409worker1 # [ 133.509200] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6410worker1 # [ 133.653529] nix-daemon[847]: accepted connection from pid 1511, user nix-grpc-daemon (trusted)6411worker1 # [ 133.665459] nix-daemon[847]: reaped child process 1514, status = succeeded6412worker1 # [ 133.812153] nix-daemon[847]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)6413worker1 # [ 133.824332] nix-daemon[847]: reaped child process 1519, status = succeeded6414lb # [ 133.873075] niks3-server[1027]: 2026/09/20 09:34:21 INFO Received uploads request method=POST path=/api/pending_closures6415worker1 # [ 133.847127] nix-grpc-daemon[1430]: time=2026-09-20T09:34:21.940Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6416worker1 # [ 133.848508] nix-grpc-daemon[1430]: time=2026-09-20T09:34:21.940Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6417lb # [ 133.905611] niks3-server[1027]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6418lb # [ 133.913840] niks3-server[1027]: 2026/09/20 09:34:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6419worker1 # [ 133.883648] nix-grpc-daemon[1430]: time=2026-09-20T09:34:21.976Z level=INFO msg="Uploading 1 narinfos"6420lb # [ 133.920282] niks3-server[1027]: 2026/09/20 09:34:22 INFO Signed narinfos id=50 count=16421lb # [ 133.925728] niks3-server[1027]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6422lb # [ 133.940604] niks3-server[1027]: 2026/09/20 09:34:22 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6423worker1 # [ 133.910514] nix-grpc-daemon[1430]: time=2026-09-20T09:34:22.003Z level=INFO msg="Upload complete. (396ms)"6424lb # [ 133.945499] niks3-server[1027]: 2026/09/20 09:34:22 INFO Completed upload id=506425worker1 # [ 133.913367] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=5046426lb # [ 133.948683] niks3-server[1027]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6427worker1 # [ 133.917577] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306428worker1 # [ 133.923059] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6429worker1 # [ 133.925189] nix-daemon[847]: reaped child process 1509, status = succeeded6430worker1 # [ 133.930365] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6431worker1 # [ 135.344531] nix-daemon[847]: reaped child process 1523, status = succeeded6432worker1 # [ 135.486308] nix-daemon[847]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6433worker1 # [ 135.498938] nix-daemon[847]: reaped child process 1541, status = succeeded6434lb # [ 135.547981] niks3-server[1027]: 2026/09/20 09:34:23 INFO Received uploads request method=POST path=/api/pending_closures6435worker1 # [ 135.520323] nix-grpc-daemon[1430]: time=2026-09-20T09:34:23.613Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6436worker1 # [ 135.523240] nix-grpc-daemon[1430]: time=2026-09-20T09:34:23.615Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6437lb # [ 135.587444] niks3-server[1027]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6438lb # [ 135.592975] niks3-server[1027]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6439lb # [ 135.604593] niks3-server[1027]: 2026/09/20 09:34:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6440lb # [ 135.610091] niks3-server[1027]: 2026/09/20 09:34:23 INFO Signed narinfos id=51 count=16441worker1 # [ 135.573751] nix-grpc-daemon[1430]: time=2026-09-20T09:34:23.667Z level=INFO msg="Uploading 1 narinfos"6442lb # [ 135.615895] niks3-server[1027]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6443lb # [ 135.624841] niks3-server[1027]: 2026/09/20 09:34:23 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6444lb # [ 135.628043] niks3-server[1027]: 2026/09/20 09:34:23 INFO Completed upload id=516445lb # [ 135.629713] niks3-server[1027]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6446worker1 # [ 135.594425] nix-grpc-daemon[1430]: time=2026-09-20T09:34:23.687Z level=INFO msg="Upload complete. (257ms)"6447worker1 # [ 135.602176] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16448worker2 # [ 135.631812] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:22Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16449worker1 # [ 135.608395] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306450worker2 # [ 135.641675] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:22Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06451worker1 # [ 135.616955] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306452worker1 # [ 135.625343] nix-daemon[847]: reaped child process 1521, status = succeeded6453worker1 # [ 135.626331] nix-grpc-daemon[1430]: time=2026-09-20T09:34:23.718Z level=INFO msg="All 1 paths already cached"6454worker1 # [ 135.628192] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306455worker1 # [ 135.632868] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6456worker1 # [ 135.782421] nix-daemon[847]: accepted connection from pid 1545, user nix-grpc-daemon (trusted)6457worker1 # [ 135.794572] nix-daemon[847]: reaped child process 1548, status = succeeded6458worker1 # [ 135.946834] nix-daemon[847]: accepted connection from pid 1550, user nix-grpc-daemon (trusted)6459worker1 # [ 135.958637] nix-daemon[847]: reaped child process 1553, status = succeeded6460lb # [ 136.007666] niks3-server[1027]: 2026/09/20 09:34:24 INFO Received uploads request method=POST path=/api/pending_closures6461worker1 # [ 135.980581] nix-grpc-daemon[1430]: time=2026-09-20T09:34:24.074Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6462worker1 # [ 135.982130] nix-grpc-daemon[1430]: time=2026-09-20T09:34:24.075Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6463lb # [ 136.035534] niks3-server[1027]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6464lb # [ 136.049055] niks3-server[1027]: 2026/09/20 09:34:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6465worker1 # [ 136.019986] nix-grpc-daemon[1430]: time=2026-09-20T09:34:24.113Z level=INFO msg="Uploading 1 narinfos"6466lb # [ 136.055205] niks3-server[1027]: 2026/09/20 09:34:24 INFO Signed narinfos id=52 count=16467lb # [ 136.059607] niks3-server[1027]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6468lb # [ 136.068842] niks3-server[1027]: 2026/09/20 09:34:24 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6469lb # [ 136.075314] niks3-server[1027]: 2026/09/20 09:34:24 INFO Completed upload id=526470worker1 # [ 136.040250] nix-grpc-daemon[1430]: time=2026-09-20T09:34:24.133Z level=INFO msg="Upload complete. (402ms)"6471lb # [ 136.076586] niks3-server[1027]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6472worker1 # [ 136.044223] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=6246473worker1 # [ 136.050560] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306474worker1 # [ 136.059124] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6475worker1 # [ 136.064151] nix-daemon[847]: reaped child process 1543, status = succeeded6476worker1 # [ 136.069100] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6477worker1 # [ 137.096848] nix-daemon[847]: reaped child process 1557, status = succeeded6478worker1 # [ 137.247644] nix-daemon[847]: accepted connection from pid 1572, user nix-grpc-daemon (trusted)6479worker1 # [ 137.260492] nix-daemon[847]: reaped child process 1575, status = succeeded6480lb # [ 137.307391] niks3-server[1027]: 2026/09/20 09:34:25 INFO Received uploads request method=POST path=/api/pending_closures6481worker1 # [ 137.280503] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.373Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6482worker1 # [ 137.281982] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.375Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6483lb # [ 137.350996] niks3-server[1027]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6484lb # [ 137.358950] niks3-server[1027]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6485lb # [ 137.371182] niks3-server[1027]: 2026/09/20 09:34:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6486lb # [ 137.374976] niks3-server[1027]: 2026/09/20 09:34:25 INFO Signed narinfos id=53 count=16487worker1 # [ 137.342375] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.435Z level=INFO msg="Uploading 1 narinfos"6488lb # [ 137.379830] niks3-server[1027]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6489lb # [ 137.387987] niks3-server[1027]: 2026/09/20 09:34:25 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6490lb # [ 137.391160] niks3-server[1027]: 2026/09/20 09:34:25 INFO Completed upload id=536491worker1 # [ 137.356290] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.449Z level=INFO msg="Upload complete. (279ms)"6492lb # [ 137.393588] niks3-server[1027]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6493worker1 # [ 137.361287] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16494worker2 # [ 137.395069] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:24Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16495worker2 # [ 137.402231] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:24Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06496worker1 # [ 137.374116] nix-daemon[847]: reaped child process 1555, status = succeeded6497worker1 # [ 137.407776] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306498worker1 # [ 137.419306] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306499worker1 # [ 137.431936] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.525Z level=INFO msg="All 1 paths already cached"6500worker1 # [ 137.438640] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306501worker1 # [ 137.448180] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6502worker1 # [ 137.588823] nix-daemon[847]: accepted connection from pid 1579, user nix-grpc-daemon (trusted)6503worker1 # [ 137.601581] nix-daemon[847]: reaped child process 1582, status = succeeded6504worker1 # [ 137.738666] nix-daemon[847]: accepted connection from pid 1584, user nix-grpc-daemon (trusted)6505worker1 # [ 137.751362] nix-daemon[847]: reaped child process 1587, status = succeeded6506lb # [ 137.796936] niks3-server[1027]: 2026/09/20 09:34:25 INFO Received uploads request method=POST path=/api/pending_closures6507worker1 # [ 137.769086] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.862Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6508worker1 # [ 137.770434] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.862Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6509lb # [ 137.819879] niks3-server[1027]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6510lb # [ 137.831203] niks3-server[1027]: 2026/09/20 09:34:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6511lb # [ 137.837900] niks3-server[1027]: 2026/09/20 09:34:25 INFO Signed narinfos id=54 count=16512worker1 # [ 137.805938] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.899Z level=INFO msg="Uploading 1 narinfos"6513lb # [ 137.842710] niks3-server[1027]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6514lb # [ 137.854196] niks3-server[1027]: 2026/09/20 09:34:25 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6515worker1 # [ 137.824610] nix-grpc-daemon[1430]: time=2026-09-20T09:34:25.918Z level=INFO msg="Upload complete. (365ms)"6516lb # [ 137.860101] niks3-server[1027]: 2026/09/20 09:34:25 INFO Completed upload id=546517worker1 # [ 137.826687] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=6246518lb # [ 137.863660] niks3-server[1027]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6519worker1 # [ 137.832433] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306520worker1 # [ 137.837334] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6521worker1 # [ 137.839654] nix-daemon[847]: reaped child process 1577, status = succeeded6522worker1 # [ 137.844946] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6523worker1 # [ 139.058463] nix-daemon[847]: reaped child process 1591, status = succeeded6524worker1 # [ 139.199735] nix-daemon[847]: accepted connection from pid 1606, user nix-grpc-daemon (trusted)6525worker1 # [ 139.210836] nix-daemon[847]: reaped child process 1609, status = succeeded6526lb # [ 139.261657] niks3-server[1027]: 2026/09/20 09:34:27 INFO Received uploads request method=POST path=/api/pending_closures6527worker1 # [ 139.234649] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.327Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6528worker1 # [ 139.237063] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.329Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6529lb # [ 139.299882] niks3-server[1027]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6530lb # [ 139.314374] niks3-server[1027]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6531lb # [ 139.319298] niks3-server[1027]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6532lb # [ 139.328570] niks3-server[1027]: 2026/09/20 09:34:27 INFO Signed narinfos id=55 count=16533worker1 # [ 139.293960] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.387Z level=INFO msg="Uploading 1 narinfos"6534lb # [ 139.334453] niks3-server[1027]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6535lb # [ 139.343933] niks3-server[1027]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6536lb # [ 139.349430] niks3-server[1027]: 2026/09/20 09:34:27 INFO Completed upload id=556537worker1 # [ 139.314512] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.407Z level=INFO msg="Upload complete. (262ms)"6538lb # [ 139.352209] niks3-server[1027]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6539worker1 # [ 139.319769] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16540worker1 # [ 139.324444] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306541worker2 # [ 139.351845] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:26Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16542worker1 # [ 139.331073] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306543worker1 # [ 139.333306] nix-daemon[847]: reaped child process 1589, status = succeeded6544worker2 # [ 139.361569] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:26Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06545worker1 # [ 139.336857] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.430Z level=INFO msg="All 1 paths already cached"6546worker1 # [ 139.340329] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306547worker1 # [ 139.345346] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6548worker1 # [ 139.504546] nix-daemon[847]: accepted connection from pid 1613, user nix-grpc-daemon (trusted)6549worker1 # [ 139.518212] nix-daemon[847]: reaped child process 1616, status = succeeded6550worker1 # [ 139.673871] nix-daemon[847]: accepted connection from pid 1618, user nix-grpc-daemon (trusted)6551worker1 # [ 139.686767] nix-daemon[847]: reaped child process 1621, status = succeeded6552lb # [ 139.736879] niks3-server[1027]: 2026/09/20 09:34:27 INFO Received uploads request method=POST path=/api/pending_closures6553worker1 # [ 139.710287] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.803Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6554worker1 # [ 139.711689] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.803Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6555lb # [ 139.764232] niks3-server[1027]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6556lb # [ 139.771945] niks3-server[1027]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6557worker1 # [ 139.742966] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.836Z level=INFO msg="Uploading 1 narinfos"6558lb # [ 139.778752] niks3-server[1027]: 2026/09/20 09:34:27 INFO Signed narinfos id=56 count=16559lb # [ 139.786074] niks3-server[1027]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6560lb # [ 139.796429] niks3-server[1027]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6561worker1 # [ 139.766921] nix-grpc-daemon[1430]: time=2026-09-20T09:34:27.860Z level=INFO msg="Upload complete. (416ms)"6562lb # [ 139.802273] niks3-server[1027]: 2026/09/20 09:34:27 INFO Completed upload id=566563worker1 # [ 139.768978] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=6246564lb # [ 139.807376] niks3-server[1027]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6565worker1 # [ 139.773677] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306566worker1 # [ 139.782495] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6567worker1 # [ 139.786864] nix-daemon[847]: reaped child process 1611, status = succeeded6568worker1 # [ 139.793184] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6569worker1 # [ 140.808237] nix-daemon[847]: reaped child process 1625, status = succeeded6570worker1 # [ 140.944345] nix-daemon[847]: accepted connection from pid 1640, user nix-grpc-daemon (trusted)6571worker1 # [ 140.956783] nix-daemon[847]: reaped child process 1643, status = succeeded6572lb # [ 141.003295] niks3-server[1027]: 2026/09/20 09:34:29 INFO Received uploads request method=POST path=/api/pending_closures6573worker1 # [ 140.976796] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.070Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6574worker1 # [ 140.978350] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.071Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6575lb # [ 141.036165] niks3-server[1027]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6576lb # [ 141.052124] niks3-server[1027]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6577lb # [ 141.057102] niks3-server[1027]: 2026/09/20 09:34:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6578worker1 # [ 141.030083] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.123Z level=INFO msg="Uploading 1 narinfos"6579lb # [ 141.064954] niks3-server[1027]: 2026/09/20 09:34:29 INFO Signed narinfos id=57 count=16580lb # [ 141.071135] niks3-server[1027]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6581lb # [ 141.079908] niks3-server[1027]: 2026/09/20 09:34:29 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6582lb # [ 141.085856] niks3-server[1027]: 2026/09/20 09:34:29 INFO Completed upload id=576583worker1 # [ 141.051074] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.144Z level=INFO msg="Upload complete. (251ms)"6584lb # [ 141.088597] niks3-server[1027]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6585worker2 # [ 141.087488] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:28Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16586worker2 # [ 141.092773] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:28Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06587worker1 # [ 141.059439] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16588worker1 # [ 141.066522] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306589worker1 # [ 141.078598] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306590worker1 # [ 141.084324] nix-daemon[847]: reaped child process 1623, status = succeeded6591worker1 # [ 141.090808] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.184Z level=INFO msg="All 2 paths already cached"6592worker1 # [ 141.097556] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306593worker1 # [ 141.106841] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6594worker1 # [ 141.254552] nix-daemon[847]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)6595worker1 # [ 141.267257] nix-daemon[847]: reaped child process 1650, status = succeeded6596worker1 # [ 141.417523] nix-daemon[847]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6597worker1 # [ 141.430702] nix-daemon[847]: reaped child process 1655, status = succeeded6598lb # [ 141.478894] niks3-server[1027]: 2026/09/20 09:34:29 INFO Received uploads request method=POST path=/api/pending_closures6599worker1 # [ 141.452041] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.545Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6600worker1 # [ 141.453941] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.546Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6601lb # [ 141.506977] niks3-server[1027]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6602lb # [ 141.517748] niks3-server[1027]: 2026/09/20 09:34:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6603lb # [ 141.523478] niks3-server[1027]: 2026/09/20 09:34:29 INFO Signed narinfos id=58 count=16604worker1 # [ 141.491725] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.585Z level=INFO msg="Uploading 1 narinfos"6605lb # [ 141.530224] niks3-server[1027]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6606lb # [ 141.542668] niks3-server[1027]: 2026/09/20 09:34:29 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6607lb # [ 141.548057] niks3-server[1027]: 2026/09/20 09:34:29 INFO Completed upload id=586608worker1 # [ 141.515592] nix-grpc-daemon[1430]: time=2026-09-20T09:34:29.608Z level=INFO msg="Upload complete. (403ms)"6609lb # [ 141.551241] niks3-server[1027]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6610worker1 # [ 141.519520] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=7526611worker1 # [ 141.525265] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306612worker1 # [ 141.533378] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6613worker1 # [ 141.540771] nix-daemon[847]: reaped child process 1645, status = succeeded6614worker1 # [ 141.545815] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6615worker1 # [ 142.557707] nix-daemon[847]: reaped child process 1659, status = succeeded6616worker1 # [ 142.697447] nix-daemon[847]: accepted connection from pid 1674, user nix-grpc-daemon (trusted)6617worker1 # [ 142.708655] nix-daemon[847]: reaped child process 1677, status = succeeded6618lb # [ 142.759771] niks3-server[1027]: 2026/09/20 09:34:30 INFO Received uploads request method=POST path=/api/pending_closures6619worker1 # [ 142.734114] nix-grpc-daemon[1430]: time=2026-09-20T09:34:30.827Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6620worker1 # [ 142.735663] nix-grpc-daemon[1430]: time=2026-09-20T09:34:30.829Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6621lb # [ 142.799454] niks3-server[1027]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6622lb # [ 142.808435] niks3-server[1027]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6623lb # [ 142.814942] niks3-server[1027]: 2026/09/20 09:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6624lb # [ 142.819054] niks3-server[1027]: 2026/09/20 09:34:30 INFO Signed narinfos id=59 count=16625worker1 # [ 142.786471] nix-grpc-daemon[1430]: time=2026-09-20T09:34:30.879Z level=INFO msg="Uploading 1 narinfos"6626lb # [ 142.826911] niks3-server[1027]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6627lb # [ 142.832134] niks3-server[1027]: 2026/09/20 09:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6628lb # [ 142.834941] niks3-server[1027]: 2026/09/20 09:34:30 INFO Completed upload id=596629worker1 # [ 142.799954] nix-grpc-daemon[1430]: time=2026-09-20T09:34:30.893Z level=INFO msg="Upload complete. (246ms)"6630lb # [ 142.837063] niks3-server[1027]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6631worker1 # [ 142.804660] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16632worker2 # [ 142.836957] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:30Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16633worker1 # [ 142.817223] nix-daemon[847]: reaped child process 1657, status = succeeded6634worker1 # [ 142.848695] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306635worker1 # [ 142.860726] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306636worker1 # [ 142.873451] nix-grpc-daemon[1430]: time=2026-09-20T09:34:30.966Z level=INFO msg="All 2 paths already cached"6637worker1 # [ 142.880106] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306638worker1 # [ 142.890185] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6639worker1 # [ 143.057943] nix-daemon[847]: accepted connection from pid 1681, user nix-grpc-daemon (trusted)6640worker1 # [ 143.072987] nix-daemon[847]: reaped child process 1684, status = succeeded6641worker1 # [ 143.229590] nix-daemon[847]: accepted connection from pid 1686, user nix-grpc-daemon (trusted)6642worker1 # [ 143.241892] nix-daemon[847]: reaped child process 1689, status = succeeded6643lb # [ 143.292279] niks3-server[1027]: 2026/09/20 09:34:31 INFO Received uploads request method=POST path=/api/pending_closures6644worker1 # [ 143.265233] nix-grpc-daemon[1430]: time=2026-09-20T09:34:31.358Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6645worker1 # [ 143.266668] nix-grpc-daemon[1430]: time=2026-09-20T09:34:31.358Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6646lb # [ 143.318674] niks3-server[1027]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6647lb # [ 143.330406] niks3-server[1027]: 2026/09/20 09:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6648worker1 # [ 143.300544] nix-grpc-daemon[1430]: time=2026-09-20T09:34:31.393Z level=INFO msg="Uploading 1 narinfos"6649lb # [ 143.336243] niks3-server[1027]: 2026/09/20 09:34:31 INFO Signed narinfos id=60 count=16650lb # [ 143.347590] niks3-server[1027]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6651lb # [ 143.353272] niks3-server[1027]: 2026/09/20 09:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6652worker1 # [ 143.323571] nix-grpc-daemon[1430]: time=2026-09-20T09:34:31.416Z level=INFO msg="Upload complete. (421ms)"6653lb # [ 143.358966] niks3-server[1027]: 2026/09/20 09:34:31 INFO Completed upload id=606654worker1 # [ 143.325739] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=7526655lb # [ 143.362841] niks3-server[1027]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6656worker1 # [ 143.331807] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306657worker1 # [ 143.338590] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6658worker1 # [ 143.342360] nix-daemon[847]: reaped child process 1679, status = succeeded6659worker1 # [ 143.347462] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6660worker1 # [ 144.774443] nix-daemon[847]: reaped child process 1693, status = succeeded6661worker1 # [ 144.928246] nix-daemon[847]: accepted connection from pid 1708, user nix-grpc-daemon (trusted)6662worker1 # [ 144.940913] nix-daemon[847]: reaped child process 1711, status = succeeded6663lb # [ 144.993627] niks3-server[1027]: 2026/09/20 09:34:33 INFO Received uploads request method=POST path=/api/pending_closures6664worker1 # [ 144.965941] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.059Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6665worker1 # [ 144.967449] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.060Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6666lb # [ 145.026168] niks3-server[1027]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6667lb # [ 145.038198] niks3-server[1027]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6668lb # [ 145.044657] niks3-server[1027]: 2026/09/20 09:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6669lb # [ 145.052137] niks3-server[1027]: 2026/09/20 09:34:33 INFO Signed narinfos id=61 count=16670worker1 # [ 145.019918] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.113Z level=INFO msg="Uploading 1 narinfos"6671lb # [ 145.054972] niks3-server[1027]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6672lb # [ 145.065700] niks3-server[1027]: 2026/09/20 09:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6673lb # [ 145.071773] niks3-server[1027]: 2026/09/20 09:34:33 INFO Completed upload id=616674worker1 # [ 145.036739] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.130Z level=INFO msg="Upload complete. (282ms)"6675lb # [ 145.074121] niks3-server[1027]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6676worker2 # [ 145.074898] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:32Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16677worker1 # [ 145.042575] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16678worker1 # [ 145.056353] nix-daemon[847]: reaped child process 1691, status = succeeded6679worker1 # [ 145.088254] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306680worker1 # [ 145.099943] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306681worker1 # [ 145.111991] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.205Z level=INFO msg="All 2 paths already cached"6682worker1 # [ 145.119103] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524306683worker1 # [ 145.129249] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6684worker1 # [ 145.288530] nix-daemon[847]: accepted connection from pid 1715, user nix-grpc-daemon (trusted)6685worker1 # [ 145.300786] nix-daemon[847]: reaped child process 1718, status = succeeded6686worker1 # [ 145.457200] nix-daemon[847]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6687worker1 # [ 145.469130] nix-daemon[847]: reaped child process 1723, status = succeeded6688lb # [ 145.521745] niks3-server[1027]: 2026/09/20 09:34:33 INFO Received uploads request method=POST path=/api/pending_closures6689worker1 # [ 145.493793] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.587Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6690worker1 # [ 145.495703] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.588Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6691lb # [ 145.546785] niks3-server[1027]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6692lb # [ 145.558084] niks3-server[1027]: 2026/09/20 09:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6693worker1 # [ 145.527948] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.621Z level=INFO msg="Uploading 1 narinfos"6694lb # [ 145.563127] niks3-server[1027]: 2026/09/20 09:34:33 INFO Signed narinfos id=62 count=16695lb # [ 145.569363] niks3-server[1027]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6696lb # [ 145.580097] niks3-server[1027]: 2026/09/20 09:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6697worker1 # [ 145.551062] nix-grpc-daemon[1430]: time=2026-09-20T09:34:33.644Z level=INFO msg="Upload complete. (410ms)"6698lb # [ 145.586201] niks3-server[1027]: 2026/09/20 09:34:33 INFO Completed upload id=626699worker1 # [ 145.553345] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=0 paths=1 nar_bytes_in=7526700lb # [ 145.589671] niks3-server[1027]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6701worker1 # [ 145.559414] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524306702worker1 # [ 145.564071] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6703worker1 # [ 145.566237] nix-daemon[847]: reaped child process 1713, status = succeeded6704worker1 # [ 145.571834] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)6705worker1 # [ 146.597960] nix-daemon[847]: reaped child process 1727, status = succeeded6706worker1 # [ 146.741977] nix-daemon[847]: accepted connection from pid 1742, user nix-grpc-daemon (trusted)6707worker1 # [ 146.752806] nix-daemon[847]: reaped child process 1745, status = succeeded6708lb # [ 146.798987] niks3-server[1027]: 2026/09/20 09:34:34 INFO Received uploads request method=POST path=/api/pending_closures6709worker1 # [ 146.771858] nix-grpc-daemon[1430]: time=2026-09-20T09:34:34.865Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6710worker1 # [ 146.773497] nix-grpc-daemon[1430]: time=2026-09-20T09:34:34.866Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6711lb # [ 146.833165] niks3-server[1027]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6712lb # [ 146.845061] niks3-server[1027]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6713lb # [ 146.853185] niks3-server[1027]: 2026/09/20 09:34:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6714worker1 # [ 146.823083] nix-grpc-daemon[1430]: time=2026-09-20T09:34:34.916Z level=INFO msg="Uploading 1 narinfos"6715lb # [ 146.858127] niks3-server[1027]: 2026/09/20 09:34:34 INFO Signed narinfos id=63 count=16716lb # [ 146.864057] niks3-server[1027]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6717lb # [ 146.873303] niks3-server[1027]: 2026/09/20 09:34:34 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6718lb # [ 146.877714] niks3-server[1027]: 2026/09/20 09:34:34 INFO Completed upload id=636719worker1 # [ 146.842680] nix-grpc-daemon[1430]: time=2026-09-20T09:34:34.936Z level=INFO msg="Upload complete. (262ms)"6720worker1 # [ 146.847827] nix-grpc-daemon[1430]: time=2026-09-20T09:34:34.939Z level=WARN msg="Failed to register uploaded object" key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo error="server returned 404: object is not pending upload\n"6721worker1 # [ 146.854741] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52430 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16722worker1 # [ 146.865268] nix-daemon[847]: reaped child process 1725, status = succeeded6723client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.28 seconds)6724worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6725worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6726client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]'6727client # [ 147.076718] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6728client # Running as unit: gpu.service; invocation ID: af851b419a11437499bc974014d073d46729client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.07 seconds)6730lb: must succeed: curl -sf localhost:9901/clusters6731lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6732lb: must succeed: curl -sf localhost:9901/clusters6733lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6734worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6735worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.06 seconds)6736worker2 # [ 147.302595] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:515986737client # [ 147.303569] nix[1349]: don't know how to build these paths:6738client # [ 147.304707] nix[1349]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv6739worker1 # [ 147.275587] nix-grpc-daemon[1374]: ts=2026-09-20T09:34:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524306740worker2 # [ 147.324316] nix-grpc-daemon[1685]: ts=2026-09-20T09:34:34Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06741client # [ 147.325070] nix[1349]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker6742lb: must succeed: curl -sf localhost:9901/clusters6743lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6744lb: must succeed: curl -sf localhost:9901/clusters6745lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6746worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6747worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.07 seconds)6748client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6749lb # [ 148.689056] envoy[926]: conn peer=[2001:db8:1::1]:51670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27154 tx=10709 ms=180366750client # [ 177.325872] nix[1349]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}6751client # [ 177.331530] nix[1349]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed6752client # [ 177.357516] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6753client # [ 177.359437] systemd[1]: gpu.service: Failed with result 'exit-code'.6754client # [ 177.361055] systemd[1]: gpu.service: Consumed 118ms CPU time over 30.282s wall clock time, 33.4M memory peak, 6.6K incoming IP traffic, 5.8K outgoing IP traffic.6755client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.60 seconds)6756client: must succeed: journalctl -u gpu -o cat6757client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)6758lb: must succeed: curl -sf localhost:9901/clusters6759lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6760lb: must succeed: curl -sf localhost:9901/clusters6761lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6762worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6763worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.07 seconds)6764(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.52 seconds)6765subtest: low disk drains a worker and builds go to the other6766worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6767lb # [ 178.690991] envoy[926]: conn peer=[2001:db8:1::1]:43890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=300426768worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.93 seconds)6769worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6770worker1 # [ 179.434630] nix-grpc-daemon[1374]: ts=2026-09-20T09:35:07Z level=info event=unhealthy reason=min_free6771worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)6772client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26773worker1 # [ 180.369288] nix-grpc-daemon[1374]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:524306774client # don't know how to build these paths:6775client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6776worker2 # [ 180.409965] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986777worker2 # [ 180.432158] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:07Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06778worker2 # [ 180.437359] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:07Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16779worker2 # [ 180.475718] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986780worker2 # [ 180.487156] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986781client # copying 1 paths to 'lb:50051'...6782client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6783worker2 # [ 180.498115] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:515986784worker2 # [ 180.506735] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6785worker2 # [ 180.662534] nix-daemon[870]: accepted connection from pid 1980, user nix-grpc-daemon (trusted)6786worker2 # [ 180.674430] nix-daemon[870]: reaped child process 1983, status = succeeded6787worker2 # [ 180.836295] nix-daemon[870]: accepted connection from pid 1985, user nix-grpc-daemon (trusted)6788worker2 # [ 180.848373] nix-daemon[870]: reaped child process 1988, status = succeeded6789lb # [ 180.868321] niks3-server[1027]: 2026/09/20 09:35:08 INFO Received uploads request method=POST path=/api/pending_closures6790worker2 # [ 180.873298] nix-grpc-daemon[1761]: time=2026-09-20T09:35:08.092Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6791worker2 # [ 180.874782] nix-grpc-daemon[1761]: time=2026-09-20T09:35:08.092Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6792lb # [ 180.898437] niks3-server[1027]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6793lb # [ 180.910201] niks3-server[1027]: 2026/09/20 09:35:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6794worker2 # [ 180.912437] nix-grpc-daemon[1761]: time=2026-09-20T09:35:08.131Z level=INFO msg="Uploading 1 narinfos"6795lb # [ 180.916787] niks3-server[1027]: 2026/09/20 09:35:09 INFO Signed narinfos id=64 count=16796lb # [ 180.923584] niks3-server[1027]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6797lb # [ 180.934124] niks3-server[1027]: 2026/09/20 09:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6798lb # [ 180.941474] niks3-server[1027]: 2026/09/20 09:35:09 INFO Completed upload id=646799lb # [ 180.944826] niks3-server[1027]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6800worker2 # [ 180.939651] nix-grpc-daemon[1761]: time=2026-09-20T09:35:08.158Z level=INFO msg="Upload complete. (419ms)"6801worker2 # [ 180.945191] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 paths=1 nar_bytes_in=5126802worker2 # [ 180.950629] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986803worker2 # [ 180.960469] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6804worker2 # [ 180.968272] nix-daemon[870]: reaped child process 1978, status = succeeded6805client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6806worker2 # [ 180.975488] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6807client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6808client # farm-a> LOG-farm-a-drain6809worker2 # [ 182.197734] nix-daemon[870]: reaped child process 1992, status = succeeded6810worker2 # [ 182.324086] nix-daemon[870]: accepted connection from pid 2007, user nix-grpc-daemon (trusted)6811worker2 # [ 182.335467] nix-daemon[870]: reaped child process 2010, status = succeeded6812lb # [ 182.356509] niks3-server[1027]: 2026/09/20 09:35:10 INFO Received uploads request method=POST path=/api/pending_closures6813worker2 # [ 182.360831] nix-grpc-daemon[1761]: time=2026-09-20T09:35:09.580Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6814worker2 # [ 182.362325] nix-grpc-daemon[1761]: time=2026-09-20T09:35:09.581Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6815lb # [ 182.396762] niks3-server[1027]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6816lb # [ 182.402441] niks3-server[1027]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6817lb # [ 182.411980] niks3-server[1027]: 2026/09/20 09:35:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6818lb # [ 182.416648] niks3-server[1027]: 2026/09/20 09:35:10 INFO Signed narinfos id=65 count=16819worker2 # [ 182.414645] nix-grpc-daemon[1761]: time=2026-09-20T09:35:09.634Z level=INFO msg="Uploading 1 narinfos"6820lb # [ 182.419433] niks3-server[1027]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6821lb # [ 182.427053] niks3-server[1027]: 2026/09/20 09:35:10 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6822lb # [ 182.431537] niks3-server[1027]: 2026/09/20 09:35:10 INFO Completed upload id=656823worker2 # [ 182.427266] nix-grpc-daemon[1761]: time=2026-09-20T09:35:09.646Z level=INFO msg="Upload complete. (244ms)"6824lb # [ 182.434717] niks3-server[1027]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6825worker2 # [ 182.432859] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16826worker2 # [ 182.443481] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:09Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06827worker2 # [ 182.446849] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:09Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16828worker2 # [ 182.451903] nix-daemon[870]: reaped child process 1990, status = succeeded6829worker2 # [ 182.485506] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986830worker2 # [ 182.495809] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986831worker2 # [ 182.507234] nix-grpc-daemon[1761]: time=2026-09-20T09:35:09.726Z level=INFO msg="All 1 paths already cached"6832client # copying 1 paths to 'lb:50051'...6833client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6834worker2 # [ 182.515241] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:515986835worker2 # [ 182.523742] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6836worker2 # [ 182.676698] nix-daemon[870]: accepted connection from pid 2016, user nix-grpc-daemon (trusted)6837worker2 # [ 182.688721] nix-daemon[870]: reaped child process 2019, status = succeeded6838worker2 # [ 182.839508] nix-daemon[870]: accepted connection from pid 2021, user nix-grpc-daemon (trusted)6839worker2 # [ 182.851748] nix-daemon[870]: reaped child process 2024, status = succeeded6840lb # [ 182.871516] niks3-server[1027]: 2026/09/20 09:35:10 INFO Received uploads request method=POST path=/api/pending_closures6841worker2 # [ 182.874455] nix-grpc-daemon[1761]: time=2026-09-20T09:35:10.093Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6842worker2 # [ 182.876285] nix-grpc-daemon[1761]: time=2026-09-20T09:35:10.095Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6843lb # [ 182.898149] niks3-server[1027]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6844worker2 # [ 182.904199] nix-grpc-daemon[1761]: time=2026-09-20T09:35:10.123Z level=INFO msg="Uploading 1 narinfos"6845lb # [ 182.909072] niks3-server[1027]: 2026/09/20 09:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6846lb # [ 182.912657] niks3-server[1027]: 2026/09/20 09:35:11 INFO Signed narinfos id=66 count=16847lb # [ 182.917927] niks3-server[1027]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6848lb # [ 182.929951] niks3-server[1027]: 2026/09/20 09:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6849worker2 # [ 182.931665] nix-grpc-daemon[1761]: time=2026-09-20T09:35:10.151Z level=INFO msg="Upload complete. (396ms)"6850lb # [ 182.936225] niks3-server[1027]: 2026/09/20 09:35:11 INFO Completed upload id=666851worker2 # [ 182.933721] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 paths=1 nar_bytes_in=6246852lb # [ 182.939440] niks3-server[1027]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6853worker2 # [ 182.939393] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986854worker2 # [ 182.947944] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6855worker2 # [ 182.950237] nix-daemon[870]: reaped child process 2014, status = succeeded6856worker2 # [ 182.955531] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6857client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6858client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6859client # farm-b> LOG-farm-b-drain6860worker2 # [ 184.169568] nix-daemon[870]: reaped child process 2028, status = succeeded6861worker2 # [ 184.307596] nix-daemon[870]: accepted connection from pid 2043, user nix-grpc-daemon (trusted)6862worker2 # [ 184.319518] nix-daemon[870]: reaped child process 2046, status = succeeded6863lb # [ 184.339761] niks3-server[1027]: 2026/09/20 09:35:12 INFO Received uploads request method=POST path=/api/pending_closures6864worker2 # [ 184.344871] nix-grpc-daemon[1761]: time=2026-09-20T09:35:11.564Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6865worker2 # [ 184.346459] nix-grpc-daemon[1761]: time=2026-09-20T09:35:11.565Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6866lb # [ 184.378738] niks3-server[1027]: 2026/09/20 09:35:12 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6867lb # [ 184.390478] niks3-server[1027]: 2026/09/20 09:35:12 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6868lb # [ 184.397477] niks3-server[1027]: 2026/09/20 09:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6869lb # [ 184.404403] niks3-server[1027]: 2026/09/20 09:35:12 INFO Signed narinfos id=67 count=16870worker2 # [ 184.402894] nix-grpc-daemon[1761]: time=2026-09-20T09:35:11.622Z level=INFO msg="Uploading 1 narinfos"6871lb # [ 184.407437] niks3-server[1027]: 2026/09/20 09:35:12 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6872lb # [ 184.419196] niks3-server[1027]: 2026/09/20 09:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6873lb # [ 184.423611] niks3-server[1027]: 2026/09/20 09:35:12 INFO Completed upload id=676874worker2 # [ 184.422124] nix-grpc-daemon[1761]: time=2026-09-20T09:35:11.641Z level=INFO msg="Upload complete. (260ms)"6875lb # [ 184.427896] niks3-server[1027]: 2026/09/20 09:35:12 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6876worker2 # [ 184.425342] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16877worker2 # [ 184.431352] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:11Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06878worker2 # [ 184.435254] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:11Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16879worker2 # [ 184.437568] nix-daemon[870]: reaped child process 2026, status = succeeded6880worker2 # [ 184.474212] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986881worker2 # [ 184.481917] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:515986882worker2 # [ 184.490358] nix-grpc-daemon[1761]: time=2026-09-20T09:35:11.709Z level=INFO msg="All 2 paths already cached"6883client # copying 1 paths to 'lb:50051'...6884client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6885worker2 # [ 184.494520] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:515986886worker2 # [ 184.498387] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6887worker2 # [ 184.640416] nix-daemon[870]: accepted connection from pid 2052, user nix-grpc-daemon (trusted)6888worker2 # [ 184.653103] nix-daemon[870]: reaped child process 2055, status = succeeded6889worker2 # [ 184.812075] nix-daemon[870]: accepted connection from pid 2057, user nix-grpc-daemon (trusted)6890worker2 # [ 184.824279] nix-daemon[870]: reaped child process 2060, status = succeeded6891lb # [ 184.843226] niks3-server[1027]: 2026/09/20 09:35:12 INFO Received uploads request method=POST path=/api/pending_closures6892worker2 # [ 184.846440] nix-grpc-daemon[1761]: time=2026-09-20T09:35:12.065Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6893worker2 # [ 184.847985] nix-grpc-daemon[1761]: time=2026-09-20T09:35:12.067Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6894lb # [ 184.874536] niks3-server[1027]: 2026/09/20 09:35:12 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6895lb # [ 184.883746] niks3-server[1027]: 2026/09/20 09:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6896worker2 # [ 184.884522] nix-grpc-daemon[1761]: time=2026-09-20T09:35:12.103Z level=INFO msg="Uploading 1 narinfos"6897lb # [ 184.889152] niks3-server[1027]: 2026/09/20 09:35:13 INFO Signed narinfos id=68 count=16898lb # [ 184.896115] niks3-server[1027]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6899lb # [ 184.907430] niks3-server[1027]: 2026/09/20 09:35:13 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6900worker2 # [ 184.909299] nix-grpc-daemon[1761]: time=2026-09-20T09:35:12.128Z level=INFO msg="Upload complete. (404ms)"6901lb # [ 184.913992] niks3-server[1027]: 2026/09/20 09:35:13 INFO Completed upload id=686902lb # [ 184.916954] niks3-server[1027]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6903worker2 # [ 184.912945] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=0 paths=1 nar_bytes_in=7526904worker2 # [ 184.918747] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:515986905worker2 # [ 184.927116] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6906worker2 # [ 184.933886] nix-daemon[870]: reaped child process 2050, status = succeeded6907client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6908worker2 # [ 184.939856] nix-daemon[870]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6909client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6910client # farm-top> LOG-farm-top-drain6911worker2 # [ 186.153534] nix-daemon[870]: reaped child process 2064, status = succeeded6912worker2 # [ 186.300688] nix-daemon[870]: accepted connection from pid 2079, user nix-grpc-daemon (trusted)6913worker2 # [ 186.312748] nix-daemon[870]: reaped child process 2082, status = succeeded6914lb # [ 186.334718] niks3-server[1027]: 2026/09/20 09:35:14 INFO Received uploads request method=POST path=/api/pending_closures6915worker2 # [ 186.339424] nix-grpc-daemon[1761]: time=2026-09-20T09:35:13.558Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6916worker2 # [ 186.340952] nix-grpc-daemon[1761]: time=2026-09-20T09:35:13.560Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6917lb # [ 186.385229] niks3-server[1027]: 2026/09/20 09:35:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6918lb # [ 186.389093] niks3-server[1027]: 2026/09/20 09:35:14 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6919lb # [ 186.397080] niks3-server[1027]: 2026/09/20 09:35:14 INFO Signed narinfos id=69 count=16920worker2 # [ 186.392669] nix-grpc-daemon[1761]: time=2026-09-20T09:35:13.611Z level=INFO msg="Uploading 1 narinfos"6921lb # [ 186.400700] niks3-server[1027]: 2026/09/20 09:35:14 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6922lb # [ 186.404347] niks3-server[1027]: 2026/09/20 09:35:14 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6923lb # [ 186.413612] niks3-server[1027]: 2026/09/20 09:35:14 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6924lb # [ 186.416810] niks3-server[1027]: 2026/09/20 09:35:14 INFO Completed upload id=696925lb # [ 186.418903] niks3-server[1027]: 2026/09/20 09:35:14 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6926worker2 # [ 186.414360] nix-grpc-daemon[1761]: time=2026-09-20T09:35:13.633Z level=INFO msg="Upload complete. (268ms)"6927worker2 # [ 186.422515] nix-grpc-daemon[1685]: ts=2026-09-20T09:35:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51598 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16928worker2 # [ 186.433779] nix-daemon[870]: reaped child process 2062, status = succeeded6929client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.25 seconds)6930client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6931client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.19 seconds)6932worker1: must succeed: rm /nix/.rw-store/fill6933worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6934worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6935worker1 # [ 187.441298] nix-grpc-daemon[1374]: ts=2026-09-20T09:35:15Z level=info event=healthy reason=min_free6936worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6937(finished: subtest: low disk drains a worker and builds go to the other, in 9.71 seconds)6938(finished: run the VM test script, in 188.79 seconds)6939test script finished in 189.00s6940cleanup6941kill QemuMachine (pid 49)6942client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6943kill QemuMachine (pid 51)6944lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6945kill QemuMachine (pid 50)6946worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6947kill QemuMachine (pid 52)6948worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6949(finished: cleanup, in 0.90 seconds)6950additionally exposed symbols:6951 client, lb, worker1, worker2,6952 vlan1,6953 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh