vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #277
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.OV5HlugX7O', fmt=raw size=107374182414lb: QEMU running (pid 51)15worker1 # Disk image does not exist, creating the virtualisation disk image...16worker1: QEMU running (pid 50)17worker1 # Formatting '/build/vm-state-worker1/tmp.cJ2tquwzXU', fmt=raw size=107374182418lb # mke2fs 1.47.4 (6-Mar-2025)19worker1 # mke2fs 1.47.4 (6-Mar-2025)20worker2: QEMU running (pid 52)21worker1 # Discarding device blocks: 0/262144 done22worker2 # Disk image does not exist, creating the virtualisation disk image...23worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes24worker2 # Formatting '/build/vm-state-worker2/tmp.BFgYvBxEPE', fmt=raw size=107374182425client: QEMU running (pid 49)26worker1 # Filesystem UUID: 9d17a53a-4785-4192-a45c-1a9ad0b77f8a27worker2 # mke2fs 1.47.4 (6-Mar-2025)28lb # Discarding device blocks: 0/262144 done29client # Disk image does not exist, creating the virtualisation disk image...30worker2 # Discarding device blocks: 0/262144 done31lb # Creating filesystem with 262144 4k blocks and 65536 inodes32worker1 # Superblock backups stored on blocks:33worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Filesystem UUID: 00d9ea46-b3b6-47ad-8d29-6fc142ef2ff135worker1 # 32768, 98304, 163840, 22937636worker2 # Filesystem UUID: 4396098e-55d8-4cc3-8e62-69715884a66737lb # Superblock backups stored on blocks:38worker1 # 39worker2 # Superblock backups stored on blocks:40lb # 32768, 98304, 163840, 22937641worker1 # Allocating group tables: 0/8 done42worker2 # 32768, 98304, 163840, 22937643lb # 44worker1 # Writing inode tables: 0/8 done45worker2 # 46lb # Allocating group tables: 0/8 done47worker1 # Creating journal (8192 blocks): done48worker2 # Allocating group tables: 0/8 done49lb # Writing inode tables: 0/8 done50worker1 # Writing superblocks and filesystem accounting information: 0/8 done51worker2 # Writing inode tables: 0/8 done52lb # Creating journal (8192 blocks): done53worker1 # 54worker2 # Creating journal (8192 blocks): done55lb # Writing superblocks and filesystem accounting information: 0/8 done56worker1 # Virtualisation disk image created.57worker2 # Writing superblocks and filesystem accounting information: 0/8 done58lb # 59worker2 # 60lb # Virtualisation disk image created.61(finished: start all VMs, in 0.19 seconds)62client # Formatting '/build/vm-state-client/tmp.SZy4Nc1MZS', fmt=raw size=107374182463client: waiting for unit network-addresses-eth1.service64client # mke2fs 1.47.4 (6-Mar-2025)65client: waiting for the VM to finish booting66client # Discarding device blocks: 0/262144 done67worker2 # Virtualisation disk image created.68client # Creating filesystem with 262144 4k blocks and 65536 inodes69client # Filesystem UUID: c291bcd6-913d-406d-ba53-ce63fb0875e770client # Superblock backups stored on blocks:71client # 32768, 98304, 163840, 22937672client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086lb # 87lb # 88worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...89worker1 # 90lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0091worker1 # 92worker1 # 93worker1 # 94worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0095lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...96lb # 97lb # 98lb # 99lb # 100worker2 # 101worker2 # 102lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00104worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105worker1 # 106worker1 # 107worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108worker2 # 109worker2 # 110worker2 # 111worker2 # 112lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...113lb # 114lb # 115worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116client # 117client # 118client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00119worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...120worker2 # 121worker2 # 122client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123client # 124client # 125client # 126client # 127client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129client # 130client # 131worker1 # Booting from ROM...132lb # Booting from ROM...133worker2 # Booting from ROM...134client # Booting from ROM...135worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0kr1n537dvgjwic16706vlk6jg70cr08-nixos-system-worker1-test/init regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration console=ttyS0,115200n8 console=tty0137worker1 # [ 0.000000] BIOS-provided physical RAM map:138worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026140worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved141worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved142worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable143worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved144worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved145lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r7i2qny6zxqjgksiw8bnyjrpmwmq2adf-nixos-system-lb-test/init regInfo=/nix/store/nsd6mwhnd72yzbh9syf2drsax74mqqk0-closure-info/registration console=ttyS0,115200n8 console=tty0146lb # [ 0.000000] BIOS-provided physical RAM map:147worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved148lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable149worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved150lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved151worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved152lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved153worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved154worker1 # [ 0.000000] NX (Execute Disable) protection: active155lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable156worker1 # [ 0.000000] APIC: Static calls initialized157worker1 # [ 0.000000] SMBIOS 2.8 present.158lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved159lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved160worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014161worker1 # [ 0.000000] DMI: Memory slots populated: 1/1162lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved163worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026164worker1 # [ 0.000000] Hypervisor detected: KVM165lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved166worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000167lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved168worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00169worker1 # [ 0.000001] kvm-clock: using sched offset of 450108759 cycles170lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved171lb # [ 0.000000] NX (Execute Disable) protection: active172lb # [ 0.000000] APIC: Static calls initialized173worker1 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns174worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0awpqwy2d5xzs80mb1c2bwcn4cfyr0qj-nixos-system-worker2-test/init regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration console=ttyS0,115200n8 console=tty0175lb # [ 0.000000] SMBIOS 2.8 present.176worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor177worker2 # [ 0.000000] BIOS-provided physical RAM map:178worker1 # [ 0.000808] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000179worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable180lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014181lb # [ 0.000000] DMI: Memory slots populated: 1/1182worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved183worker1 # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs184lb # [ 0.000000] Hypervisor detected: KVM185worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved186lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000187worker1 # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT188lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00189worker1 # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f]190worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable191worker1 # [ 0.002748] Using GB pages for direct mapping192lb # [ 0.000000] kvm-clock: using sched offset of 471781581 cycles193worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved194worker1 # [ 0.002907] RAMDISK: [mem 0x5e367000-0x5ffcffff]195client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026196worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved197lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns198worker1 # [ 0.002917] ACPI: Early table checksum verification disabled199lb # [ 0.000004] tsc: Detected 2400.012 MHz processor200worker1 # [ 0.002921] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )201worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved202lb # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000203worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved204worker1 # [ 0.002925] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)205lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs206worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved207worker1 # [ 0.002930] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)208lb # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT209worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved210client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test/init regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration console=ttyS0,115200n8 console=tty0211lb # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f]212worker2 # [ 0.000000] NX (Execute Disable) protection: active213client # [ 0.000000] BIOS-provided physical RAM map:214lb # [ 0.002738] Using GB pages for direct mapping215worker2 # [ 0.000000] APIC: Static calls initialized216worker1 # [ 0.002946] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)217worker2 # [ 0.000000] SMBIOS 2.8 present.218client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable219lb # [ 0.002851] RAMDISK: [mem 0x5e367000-0x5ffcffff]220worker1 # [ 0.002948] ACPI: FACS 0x000000005FFE0000 000040221lb # [ 0.002859] ACPI: Early table checksum verification disabled222client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved223worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014224worker1 # [ 0.002950] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)225lb # [ 0.002861] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )226worker2 # [ 0.000000] DMI: Memory slots populated: 1/1227client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved228worker2 # [ 0.000000] Hypervisor detected: KVM229worker1 # [ 0.002952] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)230lb # [ 0.002865] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)231client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable232worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000233client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved234worker1 # [ 0.002953] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)235lb # [ 0.002869] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)236worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00237client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved238worker2 # [ 0.000000] kvm-clock: using sched offset of 472239980 cycles239lb # [ 0.002876] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)240worker1 # [ 0.002955] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)241lb # [ 0.002878] ACPI: FACS 0x000000005FFE0000 000040242client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved243worker1 # [ 0.002956] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]244worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns245client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved246lb # [ 0.002880] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)247worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor248worker1 # [ 0.002957] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]249worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000250client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved251lb # [ 0.002881] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)252worker1 # [ 0.002958] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]253client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved254worker2 # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs255worker1 # [ 0.002958] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]256lb # [ 0.002883] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)257client # [ 0.000000] NX (Execute Disable) protection: active258worker2 # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT259client # [ 0.000000] APIC: Static calls initialized260worker1 # [ 0.002959] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]261client # [ 0.000000] SMBIOS 2.8 present.262lb # [ 0.002885] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)263worker2 # [ 0.002729] found SMP MP-table at [mem 0x000f5450-0x000f545f]264worker1 # [ 0.002959] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]265worker2 # [ 0.002741] Using GB pages for direct mapping266lb # [ 0.002886] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]267client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014268worker2 # [ 0.002902] RAMDISK: [mem 0x5e367000-0x5ffcffff]269worker1 # [ 0.002960] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]270lb # [ 0.002887] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]271client # [ 0.000000] DMI: Memory slots populated: 1/1272worker1 # [ 0.003198] No NUMA configuration found273client # [ 0.000000] Hypervisor detected: KVM274worker2 # [ 0.002909] ACPI: Early table checksum verification disabled275lb # [ 0.002888] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]276worker2 # [ 0.002912] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )277client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000278worker1 # [ 0.003199] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]279lb # [ 0.002888] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]280worker1 # [ 0.003202] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]281client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00282worker2 # [ 0.002916] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)283worker1 # [ 0.005468] Zone ranges:284client # [ 0.000000] kvm-clock: using sched offset of 488630387 cycles285lb # [ 0.002889] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]286worker1 # [ 0.005469] DMA [mem 0x0000000000001000-0x0000000000ffffff]287worker2 # [ 0.002921] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)288lb # [ 0.002889] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]289worker1 # [ 0.005471] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]290client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns291worker1 # [ 0.005472] Normal empty292worker2 # [ 0.002927] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)293client # [ 0.000005] tsc: Detected 2400.012 MHz processor294lb # [ 0.002890] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]295worker2 # [ 0.002929] ACPI: FACS 0x000000005FFE0000 000040296lb # [ 0.003117] No NUMA configuration found297client # [ 0.000809] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000298worker1 # [ 0.005473] Device empty299lb # [ 0.003118] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]300worker2 # [ 0.002930] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)301worker1 # [ 0.005473] Movable zone start for each node302worker1 # [ 0.005474] Early memory node ranges303client # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs304worker1 # [ 0.005474] node 0: [mem 0x0000000000001000-0x000000000009efff]305lb # [ 0.003120] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]306lb # [ 0.005432] Zone ranges:307worker2 # [ 0.002932] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)308client # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT309worker1 # [ 0.005475] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]310lb # [ 0.005433] DMA [mem 0x0000000000001000-0x0000000000ffffff]311client # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f]312worker1 # [ 0.005477] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]313worker2 # [ 0.002934] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)314client # [ 0.002745] Using GB pages for direct mapping315lb # [ 0.005435] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]316worker1 # [ 0.005497] On node 0, zone DMA: 1 pages in unavailable ranges317lb # [ 0.005436] Normal empty318client # [ 0.002901] RAMDISK: [mem 0x5e366000-0x5ffcffff]319lb # [ 0.005437] Device empty320worker2 # [ 0.002935] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)321worker1 # [ 0.005761] On node 0, zone DMA: 97 pages in unavailable ranges322lb # [ 0.005437] Movable zone start for each node323client # [ 0.002908] ACPI: Early table checksum verification disabled324worker2 # [ 0.002936] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]325lb # [ 0.005438] Early memory node ranges326worker1 # [ 0.032617] On node 0, zone DMA32: 40 pages in unavailable ranges327client # [ 0.002911] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )328worker1 # [ 0.033080] ACPI: PM-Timer IO Port: 0x608329lb # [ 0.005438] node 0: [mem 0x0000000000001000-0x000000000009efff]330worker2 # [ 0.002938] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]331worker1 # [ 0.033092] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])332client # [ 0.002915] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)333lb # [ 0.005439] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]334worker2 # [ 0.002938] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]335worker1 # [ 0.033118] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23336lb # [ 0.005441] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]337client # [ 0.002919] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)338worker2 # [ 0.002939] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]339worker1 # [ 0.033120] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)340lb # [ 0.005464] On node 0, zone DMA: 1 pages in unavailable ranges341client # [ 0.002926] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)342worker2 # [ 0.002939] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]343lb # [ 0.005728] On node 0, zone DMA: 97 pages in unavailable ranges344worker1 # [ 0.033122] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)345client # [ 0.002928] ACPI: FACS 0x000000005FFE0000 000040346worker2 # [ 0.002940] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]347lb # [ 0.032793] On node 0, zone DMA32: 40 pages in unavailable ranges348worker1 # [ 0.033123] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)349client # [ 0.002929] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)350lb # [ 0.033257] ACPI: PM-Timer IO Port: 0x608351worker2 # [ 0.002940] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]352worker1 # [ 0.033124] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)353lb # [ 0.033268] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])354worker2 # [ 0.003163] No NUMA configuration found355client # [ 0.002931] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)356worker1 # [ 0.033125] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)357lb # [ 0.033295] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23358worker2 # [ 0.003164] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]359worker1 # [ 0.033127] ACPI: Using ACPI (MADT) for SMP configuration information360client # [ 0.002932] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)361lb # [ 0.033297] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)362worker2 # [ 0.003167] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]363worker1 # [ 0.033128] ACPI: HPET id: 0x8086a201 base: 0xfed00000364worker2 # [ 0.005432] Zone ranges:365lb # [ 0.033299] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)366client # [ 0.002934] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)367worker2 # [ 0.005433] DMA [mem 0x0000000000001000-0x0000000000ffffff]368worker1 # [ 0.033133] TSC deadline timer available369worker1 # [ 0.033137] CPU topo: Max. logical packages: 1370lb # [ 0.033300] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)371client # [ 0.002935] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]372worker2 # [ 0.005435] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]373worker1 # [ 0.033138] CPU topo: Max. logical dies: 1374worker2 # [ 0.005436] Normal empty375lb # [ 0.033301] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)376worker2 # [ 0.005437] Device empty377client # [ 0.002936] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]378worker1 # [ 0.033138] CPU topo: Max. dies per package: 1379worker2 # [ 0.005438] Movable zone start for each node380worker1 # [ 0.033141] CPU topo: Max. threads per core: 1381lb # [ 0.033302] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)382client # [ 0.002937] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]383worker2 # [ 0.005438] Early memory node ranges384worker1 # [ 0.033142] CPU topo: Num. cores per package: 1385lb # [ 0.033304] ACPI: Using ACPI (MADT) for SMP configuration information386worker2 # [ 0.005439] node 0: [mem 0x0000000000001000-0x000000000009efff]387client # [ 0.002937] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]388worker1 # [ 0.033142] CPU topo: Num. threads per package: 1389lb # [ 0.033305] ACPI: HPET id: 0x8086a201 base: 0xfed00000390worker2 # [ 0.005440] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]391client # [ 0.002938] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]392lb # [ 0.033309] TSC deadline timer available393worker1 # [ 0.033143] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs394lb # [ 0.033313] CPU topo: Max. logical packages: 1395worker2 # [ 0.005441] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]396client # [ 0.002938] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]397worker1 # [ 0.033164] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()398lb # [ 0.033314] CPU topo: Max. logical dies: 1399worker2 # [ 0.005462] On node 0, zone DMA: 1 pages in unavailable ranges400lb # [ 0.033314] CPU topo: Max. dies per package: 1401client # [ 0.002939] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]402worker1 # [ 0.033197] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]403worker2 # [ 0.005726] On node 0, zone DMA: 97 pages in unavailable ranges404lb # [ 0.033318] CPU topo: Max. threads per core: 1405client # [ 0.003161] No NUMA configuration found406lb # [ 0.033318] CPU topo: Num. cores per package: 1407worker1 # [ 0.033198] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]408worker2 # [ 0.032531] On node 0, zone DMA32: 40 pages in unavailable ranges409client # [ 0.003162] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]410lb # [ 0.033319] CPU topo: Num. threads per package: 1411worker2 # [ 0.032991] ACPI: PM-Timer IO Port: 0x608412worker1 # [ 0.033200] [mem 0x60000000-0xafffffff] available for PCI devices413client # [ 0.003164] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]414client # [ 0.005441] Zone ranges:415worker2 # [ 0.033003] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])416worker1 # [ 0.033201] Booting paravirtualized kernel on KVM417lb # [ 0.033319] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs418client # [ 0.005442] DMA [mem 0x0000000000001000-0x0000000000ffffff]419lb # [ 0.033335] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()420worker2 # [ 0.033030] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23421client # [ 0.005443] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]422worker1 # [ 0.033204] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns423worker2 # [ 0.033032] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)424client # [ 0.005444] Normal empty425lb # [ 0.033365] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]426client # [ 0.005445] Device empty427worker1 # [ 0.037655] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1428worker2 # [ 0.033034] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)429client # [ 0.005446] Movable zone start for each node430lb # [ 0.033366] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]431worker1 # [ 0.039832] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152432client # [ 0.005446] Early memory node ranges433worker2 # [ 0.033035] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)434lb # [ 0.033368] [mem 0x60000000-0xafffffff] available for PCI devices435worker1 # [ 0.039875] kvm-guest: PV spinlocks disabled, single CPU436client # [ 0.005447] node 0: [mem 0x0000000000001000-0x000000000009efff]437lb # [ 0.033369] Booting paravirtualized kernel on KVM438worker2 # [ 0.033036] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)439client # [ 0.005448] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]440worker2 # [ 0.033037] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)441lb # [ 0.033372] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns442client # [ 0.005449] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]443worker2 # [ 0.033040] ACPI: Using ACPI (MADT) for SMP configuration information444lb # [ 0.037807] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1445client # [ 0.005468] On node 0, zone DMA: 1 pages in unavailable ranges446worker2 # [ 0.033040] ACPI: HPET id: 0x8086a201 base: 0xfed00000447worker2 # [ 0.033045] TSC deadline timer available448lb # [ 0.040004] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152449client # [ 0.005732] On node 0, zone DMA: 97 pages in unavailable ranges450worker2 # [ 0.033049] CPU topo: Max. logical packages: 1451worker1 # [ 0.039876] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0kr1n537dvgjwic16706vlk6jg70cr08-nixos-system-worker1-test/init regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration console=ttyS0,115200n8 console=tty0452lb # [ 0.040049] kvm-guest: PV spinlocks disabled, single CPU453client # [ 0.032704] On node 0, zone DMA32: 40 pages in unavailable ranges454worker2 # [ 0.033050] CPU topo: Max. logical dies: 1455client # [ 0.033153] ACPI: PM-Timer IO Port: 0x608456worker2 # [ 0.033050] CPU topo: Max. dies per package: 1457client # [ 0.033164] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])458worker2 # [ 0.033053] CPU topo: Max. threads per core: 1459worker1 # [ 0.039977] Unknown kernel command line parameters "regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration", will be passed to user space.460client # [ 0.033189] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23461worker1 # [ 0.039990] random: crng init done462worker2 # [ 0.033054] CPU topo: Num. cores per package: 1463worker2 # [ 0.033054] CPU topo: Num. threads per package: 1464client # [ 0.033191] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)465worker1 # [ 0.039990] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes466worker2 # [ 0.033054] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs467client # [ 0.033193] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)468lb # [ 0.040050] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r7i2qny6zxqjgksiw8bnyjrpmwmq2adf-nixos-system-lb-test/init regInfo=/nix/store/nsd6mwhnd72yzbh9syf2drsax74mqqk0-closure-info/registration console=ttyS0,115200n8 console=tty0469worker1 # [ 0.042121] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)470worker2 # [ 0.033075] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()471client # [ 0.033194] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)472worker1 # [ 0.043184] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)473client # [ 0.033195] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)474worker2 # [ 0.033108] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]475worker1 # [ 0.043225] Fallback order for Node 0: 0476lb # [ 0.040148] Unknown kernel command line parameters "regInfo=/nix/store/nsd6mwhnd72yzbh9syf2drsax74mqqk0-closure-info/registration", will be passed to user space.477lb # [ 0.040161] random: crng init done478client # [ 0.033196] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)479worker1 # [ 0.043228] Built 1 zonelists, mobility grouping on. Total pages: 393078480worker2 # [ 0.033110] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]481worker1 # [ 0.043229] Policy zone: DMA32482lb # [ 0.040162] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes483client # [ 0.033198] ACPI: Using ACPI (MADT) for SMP configuration information484worker2 # [ 0.033112] [mem 0x60000000-0xafffffff] available for PCI devices485client # [ 0.033199] ACPI: HPET id: 0x8086a201 base: 0xfed00000486worker1 # [ 0.046006] mem auto-init: stack:all(zero), heap alloc:on, heap free:off487worker2 # [ 0.033113] Booting paravirtualized kernel on KVM488lb # [ 0.042319] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)489client # [ 0.033203] TSC deadline timer available490worker1 # [ 0.049245] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1491client # [ 0.033207] CPU topo: Max. logical packages: 1492lb # [ 0.043647] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)493worker1 # [ 0.052572] allocated 3145728 bytes of page_ext494worker2 # [ 0.033117] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns495client # [ 0.033208] CPU topo: Max. logical dies: 1496lb # [ 0.043679] Fallback order for Node 0: 0497worker1 # [ 0.062615] ftrace: allocating 48731 entries in 192 pages498client # [ 0.033209] CPU topo: Max. dies per package: 1499worker2 # [ 0.037572] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1500lb # [ 0.043681] Built 1 zonelists, mobility grouping on. Total pages: 393078501client # [ 0.033212] CPU topo: Max. threads per core: 1502worker1 # [ 0.062617] ftrace: allocated 192 pages with 2 groups503lb # [ 0.043682] Policy zone: DMA32504worker1 # [ 0.063480] Dynamic Preempt: lazy505worker2 # [ 0.040007] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152506client # [ 0.033212] CPU topo: Num. cores per package: 1507lb # [ 0.046196] mem auto-init: stack:all(zero), heap alloc:on, heap free:off508worker2 # [ 0.040050] kvm-guest: PV spinlocks disabled, single CPU509client # [ 0.033213] CPU topo: Num. threads per package: 1510worker1 # [ 0.063662] rcu: Preemptible hierarchical RCU implementation.511worker1 # [ 0.063662] rcu: RCU event tracing is enabled.512lb # [ 0.049266] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1513client # [ 0.033213] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs514lb # [ 0.052610] allocated 3145728 bytes of page_ext515worker1 # [ 0.063663] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.516client # [ 0.033235] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()517lb # [ 0.062644] ftrace: allocating 48731 entries in 192 pages518worker1 # [ 0.063665] Trampoline variant of Tasks RCU enabled.519lb # [ 0.062646] ftrace: allocated 192 pages with 2 groups520worker1 # [ 0.063665] Rude variant of Tasks RCU enabled.521client # [ 0.033265] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]522lb # [ 0.063482] Dynamic Preempt: lazy523worker1 # [ 0.063665] Tracing variant of Tasks RCU enabled.524client # [ 0.033266] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]525lb # [ 0.063615] rcu: Preemptible hierarchical RCU implementation.526worker2 # [ 0.040052] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0awpqwy2d5xzs80mb1c2bwcn4cfyr0qj-nixos-system-worker2-test/init regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration console=ttyS0,115200n8 console=tty0527lb # [ 0.063615] rcu: RCU event tracing is enabled.528worker1 # [ 0.063666] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.529client # [ 0.033268] [mem 0x60000000-0xafffffff] available for PCI devices530client # [ 0.033269] Booting paravirtualized kernel on KVM531worker1 # [ 0.063667] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1532lb # [ 0.063616] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.533lb # [ 0.063618] Trampoline variant of Tasks RCU enabled.534worker2 # [ 0.040146] Unknown kernel command line parameters "regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration", will be passed to user space.535client # [ 0.033272] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns536lb # [ 0.063618] Rude variant of Tasks RCU enabled.537worker2 # [ 0.040159] random: crng init done538worker1 # [ 0.063690] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.539lb # [ 0.063618] Tracing variant of Tasks RCU enabled.540worker2 # [ 0.040160] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes541client # [ 0.037750] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1542worker1 # [ 0.063692] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.543lb # [ 0.063619] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.544client # [ 0.040198] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152545worker2 # [ 0.042308] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)546worker1 # [ 0.063693] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.547client # [ 0.040245] kvm-guest: PV spinlocks disabled, single CPU548lb # [ 0.063620] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1549worker2 # [ 0.043379] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)550worker1 # [ 0.068077] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16551lb # [ 0.063674] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.552worker2 # [ 0.043416] Fallback order for Node 0: 0553worker1 # [ 0.068353] rcu: srcu_init: Setting srcu_struct sizes based on contention.554worker2 # [ 0.043419] Built 1 zonelists, mobility grouping on. Total pages: 393078555lb # [ 0.063676] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.556worker2 # [ 0.043420] Policy zone: DMA32557worker1 # [ 0.068359] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns558worker2 # [ 0.045944] mem auto-init: stack:all(zero), heap alloc:on, heap free:off559lb # [ 0.063677] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.560client # [ 0.040247] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test/init regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration console=ttyS0,115200n8 console=tty0561worker2 # [ 0.049192] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1562lb # [ 0.068325] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16563worker1 # [ 0.068466] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)564worker2 # [ 0.052823] allocated 3145728 bytes of page_ext565worker1 # [ 0.071994] Console: colour VGA+ 80x25566lb # [ 0.068599] rcu: srcu_init: Setting srcu_struct sizes based on contention.567worker1 # [ 0.071997] printk: legacy console [tty0] enabled568worker2 # [ 0.062815] ftrace: allocating 48731 entries in 192 pages569client # [ 0.040338] Unknown kernel command line parameters "regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration", will be passed to user space.570worker1 # [ 0.101623] printk: legacy console [ttyS0] enabled571worker2 # [ 0.062817] ftrace: allocated 192 pages with 2 groups572lb # [ 0.068605] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns573client # [ 0.040351] random: crng init done574worker2 # [ 0.063656] Dynamic Preempt: lazy575worker1 # [ 0.200814] ACPI: Core revision 20250807576client # [ 0.040351] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes577worker2 # [ 0.063770] rcu: Preemptible hierarchical RCU implementation.578lb # [ 0.068705] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)579lb # [ 0.072289] Console: colour VGA+ 80x25580worker2 # [ 0.063771] rcu: RCU event tracing is enabled.581client # [ 0.042506] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)582worker1 # [ 0.201654] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns583worker2 # [ 0.063771] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.584lb # [ 0.072292] printk: legacy console [tty0] enabled585lb # [ 0.101672] printk: legacy console [ttyS0] enabled586client # [ 0.043580] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)587worker2 # [ 0.063773] Trampoline variant of Tasks RCU enabled.588worker1 # [ 0.203156] APIC: Switch to symmetric I/O mode setup589client # [ 0.043611] Fallback order for Node 0: 0590worker2 # [ 0.063773] Rude variant of Tasks RCU enabled.591lb # [ 0.197664] ACPI: Core revision 20250807592worker1 # [ 0.204137] x2apic enabled593worker2 # [ 0.063774] Tracing variant of Tasks RCU enabled.594client # [ 0.043614] Built 1 zonelists, mobility grouping on. Total pages: 393078595client # [ 0.043615] Policy zone: DMA32596worker1 # [ 0.204910] APIC: Switched APIC routing to: physical x2apic597worker2 # [ 0.063774] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.598lb # [ 0.198515] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns599client # [ 0.046122] mem auto-init: stack:all(zero), heap alloc:on, heap free:off600worker2 # [ 0.063775] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1601lb # [ 0.200013] APIC: Switch to symmetric I/O mode setup602client # [ 0.049214] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1603client # [ 0.052832] allocated 3145728 bytes of page_ext604lb # [ 0.200950] x2apic enabled605worker2 # [ 0.063834] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.606worker1 # [ 0.206859] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1607client # [ 0.062737] ftrace: allocating 48731 entries in 192 pages608lb # [ 0.201677] APIC: Switched APIC routing to: physical x2apic609client # [ 0.062739] ftrace: allocated 192 pages with 2 groups610worker2 # [ 0.063836] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.611client # [ 0.063572] Dynamic Preempt: lazy612worker1 # [ 0.207839] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns613client # [ 0.063751] rcu: Preemptible hierarchical RCU implementation.614worker2 # [ 0.063837] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.615client # [ 0.063751] rcu: RCU event tracing is enabled.616worker2 # [ 0.068217] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16617lb # [ 0.203534] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1618worker1 # [ 0.209491] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)619client # [ 0.063752] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.620worker2 # [ 0.068486] rcu: srcu_init: Setting srcu_struct sizes based on contention.621client # [ 0.063754] Trampoline variant of Tasks RCU enabled.622worker1 # [ 0.210576] x86/cpu: User Mode Instruction Prevention (UMIP) activated623client # [ 0.063754] Rude variant of Tasks RCU enabled.624lb # [ 0.204507] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns625worker2 # [ 0.068491] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns626client # [ 0.063754] Tracing variant of Tasks RCU enabled.627worker1 # [ 0.212388] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127628lb # [ 0.206143] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)629client # [ 0.063755] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.630worker2 # [ 0.068594] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)631worker1 # [ 0.213181] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0632worker2 # [ 0.072112] Console: colour VGA+ 80x25633client # [ 0.063756] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1634worker2 # [ 0.072115] printk: legacy console [tty0] enabled635lb # [ 0.207227] x86/cpu: User Mode Instruction Prevention (UMIP) activated636worker2 # [ 0.101696] printk: legacy console [ttyS0] enabled637client # [ 0.063771] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.638worker1 # [ 0.214245] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto639lb # [ 0.208277] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127640worker2 # [ 0.198839] ACPI: Core revision 20250807641client # [ 0.063773] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.642lb # [ 0.209141] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0643worker1 # [ 0.215488] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl644worker2 # [ 0.199713] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns645client # [ 0.063774] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.646worker1 # [ 0.216488] Transient Scheduler Attacks: Vulnerable: No microcode647client # [ 0.068158] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16648lb # [ 0.210144] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto649worker2 # [ 0.201242] APIC: Switch to symmetric I/O mode setup650worker1 # [ 0.218206] Spectre V2 : Mitigation: Enhanced / Automatic IBRS651client # [ 0.068439] rcu: srcu_init: Setting srcu_struct sizes based on contention.652worker2 # [ 0.202198] x2apic enabled653worker1 # [ 0.219169] Speculative Return Stack Overflow: Mitigation: Safe RET654lb # [ 0.212141] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl655client # [ 0.068444] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns656worker2 # [ 0.202968] APIC: Switched APIC routing to: physical x2apic657lb # [ 0.213141] Transient Scheduler Attacks: Vulnerable: No microcode658client # [ 0.068544] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)659lb # [ 0.214140] Spectre V2 : Mitigation: Enhanced / Automatic IBRS660client # [ 0.072062] Console: colour VGA+ 80x25661worker2 # [ 0.204839] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1662client # [ 0.072065] printk: legacy console [tty0] enabled663lb # [ 0.215141] Speculative Return Stack Overflow: Mitigation: Safe RET664client # [ 0.101456] printk: legacy console [ttyS0] enabled665client # [ 0.197454] ACPI: Core revision 20250807666worker1 # [ 0.219487] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization667worker2 # [ 0.205851] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns668worker1 # [ 0.221495] Spectre V2 : Enabling IBPB for BPF669worker2 # [ 0.207558] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)670client # [ 0.198361] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns671worker1 # [ 0.223033] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier672client # [ 0.199870] APIC: Switch to symmetric I/O mode setup673worker2 # [ 0.208645] x86/cpu: User Mode Instruction Prevention (UMIP) activated674lb # [ 0.216140] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization675worker1 # [ 0.223489] active return thunk: srso_alias_return_thunk676client # [ 0.200823] x2apic enabled677lb # [ 0.218148] Spectre V2 : Enabling IBPB for BPF678worker2 # [ 0.210490] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127679client # [ 0.201568] APIC: Switched APIC routing to: physical x2apic680worker1 # [ 0.225365] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'681worker2 # [ 0.211248] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0682lb # [ 0.219141] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier683worker1 # [ 0.226488] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'684lb # [ 0.220141] active return thunk: srso_alias_return_thunk685client # [ 0.203363] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1686worker1 # [ 0.227487] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'687worker2 # [ 0.212329] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto688lb # [ 0.221162] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'689worker1 # [ 0.228488] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'690worker2 # [ 0.213556] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl691client # [ 0.204326] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns692lb # [ 0.222140] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'693worker1 # [ 0.229487] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'694worker2 # [ 0.214556] Transient Scheduler Attacks: Vulnerable: No microcode695lb # [ 0.223140] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'696client # [ 0.205946] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)697worker1 # [ 0.230488] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'698worker2 # [ 0.216264] Spectre V2 : Mitigation: Enhanced / Automatic IBRS699lb # [ 0.224141] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'700client # [ 0.207029] x86/cpu: User Mode Instruction Prevention (UMIP) activated701worker2 # [ 0.217239] Speculative Return Stack Overflow: Mitigation: Safe RET702worker1 # [ 0.231488] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'703lb # [ 0.225141] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'704client # [ 0.208071] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127705worker1 # [ 0.232488] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256706lb # [ 0.226140] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'707client # [ 0.208944] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0708worker1 # [ 0.233488] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64709lb # [ 0.227140] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'710worker1 # [ 0.234487] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512711client # [ 0.209947] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto712lb # [ 0.228141] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256713worker2 # [ 0.218283] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization714worker1 # [ 0.235488] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024715lb # [ 0.229839] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64716client # [ 0.210944] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl717worker2 # [ 0.219563] Spectre V2 : Enabling IBPB for BPF718worker1 # [ 0.236488] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8719lb # [ 0.230837] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512720client # [ 0.211943] Transient Scheduler Attacks: Vulnerable: No microcode721worker2 # [ 0.220556] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier722lb # [ 0.231842] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024723client # [ 0.212943] Spectre V2 : Mitigation: Enhanced / Automatic IBRS724worker1 # [ 0.237488] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.725worker2 # [ 0.221556] active return thunk: srso_alias_return_thunk726lb # [ 0.232141] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8727client # [ 0.213943] Speculative Return Stack Overflow: Mitigation: Safe RET728worker2 # [ 0.223201] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'729lb # [ 0.233141] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.730worker2 # [ 0.223556] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'731worker2 # [ 0.225330] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'732worker2 # [ 0.226370] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'733client # [ 0.214943] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization734worker2 # [ 0.227349] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'735client # [ 0.216950] Spectre V2 : Enabling IBPB for BPF736worker2 # [ 0.228322] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'737client # [ 0.217944] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier738worker2 # [ 0.229555] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'739client # [ 0.218944] active return thunk: srso_alias_return_thunk740worker2 # [ 0.230556] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256741client # [ 0.219964] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'742worker2 # [ 0.231555] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64743client # [ 0.220943] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'744worker2 # [ 0.232555] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512745client # [ 0.222712] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'746worker2 # [ 0.233555] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024747client # [ 0.223726] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'748worker2 # [ 0.234555] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8749client # [ 0.224736] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'750client # [ 0.225729] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'751worker2 # [ 0.235555] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.752client # [ 0.226756] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753client # [ 0.227943] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754client # [ 0.228943] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755client # [ 0.229943] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756client # [ 0.230943] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757client # [ 0.231943] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758client # [ 0.232943] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759worker1 # [ 0.270924] Freeing SMP alternatives memory: 44K760worker1 # [ 0.271490] pid_max: default: 32768 minimum: 301761worker1 # [ 0.272575] LSM: initializing lsm=capability,landlock,yama,bpf,ima762lb # [ 0.268081] Freeing SMP alternatives memory: 44K763worker1 # [ 0.273587] landlock: Up and running.764lb # [ 0.268686] pid_max: default: 32768 minimum: 301765worker1 # [ 0.274226] Yama: becoming mindful.766worker1 # [ 0.275125] LSM support for eBPF active767lb # [ 0.269240] LSM: initializing lsm=capability,landlock,yama,bpf,ima768lb # [ 0.270250] landlock: Up and running.769worker1 # [ 0.275617] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)770lb # [ 0.271141] Yama: becoming mindful.771lb # [ 0.272289] LSM support for eBPF active772worker1 # [ 0.276526] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)773lb # [ 0.273041] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)774lb # [ 0.274184] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)775worker1 # [ 0.279677] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)776worker1 # [ 0.281080] Performance Events: Fam17h+ core perfctr, AMD PMU driver.777lb # [ 0.276555] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)778worker1 # [ 0.281497] ... version: 2779worker1 # [ 0.282237] ... bit width: 48780lb # [ 0.277710] Performance Events: Fam17h+ core perfctr, AMD PMU driver.781worker1 # [ 0.282490] ... generic counters: 6782lb # [ 0.278149] ... version: 2783worker1 # [ 0.283171] ... generic bitmap: 000000000000003f784lb # [ 0.278865] ... bit width: 48785worker2 # [ 0.270223] Freeing SMP alternatives memory: 44K786worker1 # [ 0.283490] ... fixed-purpose counters: 0787lb # [ 0.279143] ... generic counters: 6788worker2 # [ 0.270558] pid_max: default: 32768 minimum: 301789worker1 # [ 0.284207] ... fixed-purpose bitmap: 0000000000000000790lb # [ 0.279826] ... generic bitmap: 000000000000003f791worker2 # [ 0.271642] LSM: initializing lsm=capability,landlock,yama,bpf,ima792worker1 # [ 0.284490] ... value mask: 0000ffffffffffff793lb # [ 0.280143] ... fixed-purpose counters: 0794worker2 # [ 0.272649] landlock: Up and running.795worker1 # [ 0.285373] ... max period: 00007fffffffffff796lb # [ 0.280831] ... fixed-purpose bitmap: 0000000000000000797worker2 # [ 0.273556] Yama: becoming mindful.798lb # [ 0.281142] ... value mask: 0000ffffffffffff799worker1 # [ 0.286159] ... global_ctrl mask: 000000000000003f800worker2 # [ 0.274363] LSM support for eBPF active801lb # [ 0.281966] ... max period: 00007fffffffffff802worker1 # [ 0.286635] signal: max sigframe size: 3376803lb # [ 0.282788] ... global_ctrl mask: 000000000000003f804worker1 # [ 0.287420] rcu: Hierarchical SRCU implementation.805worker2 # [ 0.275211] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)806lb # [ 0.283255] signal: max sigframe size: 3376807worker1 # [ 0.288094] rcu: Max phase no-delay instances is 400.808worker2 # [ 0.276487] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)809lb # [ 0.284031] rcu: Hierarchical SRCU implementation.810client # [ 0.267490] Freeing SMP alternatives memory: 44K811lb # [ 0.284735] rcu: Max phase no-delay instances is 400.812client # [ 0.267946] pid_max: default: 32768 minimum: 301813worker2 # [ 0.278806] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)814client # [ 0.269029] LSM: initializing lsm=capability,landlock,yama,bpf,ima815client # [ 0.270050] landlock: Up and running.816worker2 # [ 0.280141] Performance Events: Fam17h+ core perfctr, AMD PMU driver.817client # [ 0.270691] Yama: becoming mindful.818worker1 # [ 0.292970] smp: Bringing up secondary CPUs ...819worker2 # [ 0.280565] ... version: 2820client # [ 0.271584] LSM support for eBPF active821worker1 # [ 0.293504] smp: Brought up 1 node, 1 CPU822worker2 # [ 0.281277] ... bit width: 48823worker2 # [ 0.281558] ... generic counters: 6824client # [ 0.272506] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)825lb # [ 0.289626] smp: Bringing up secondary CPUs ...826worker1 # [ 0.294241] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)827lb # [ 0.290157] smp: Brought up 1 node, 1 CPU828worker2 # [ 0.282264] ... generic bitmap: 000000000000003f829client # [ 0.272984] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)830worker2 # [ 0.282558] ... fixed-purpose counters: 0831lb # [ 0.290794] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)832worker2 # [ 0.283262] ... fixed-purpose bitmap: 0000000000000000833worker1 # [ 0.294622] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)834worker1 # [ 0.295754] devtmpfs: initialized835worker2 # [ 0.283558] ... value mask: 0000ffffffffffff836client # [ 0.275880] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)837lb # [ 0.291349] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)838worker2 # [ 0.284420] ... max period: 00007fffffffffff839worker1 # [ 0.296533] x86/mm: Memory block size: 128MB840lb # [ 0.292389] devtmpfs: initialized841worker2 # [ 0.285226] ... global_ctrl mask: 000000000000003f842client # [ 0.276488] Performance Events: Fam17h+ core perfctr, AMD PMU driver.843lb # [ 0.293186] x86/mm: Memory block size: 128MB844client # [ 0.276947] ... version: 2845worker2 # [ 0.285652] signal: max sigframe size: 3376846client # [ 0.277616] ... bit width: 48847worker1 # [ 0.298304] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)848worker2 # [ 0.286449] rcu: Hierarchical SRCU implementation.849client # [ 0.277946] ... generic counters: 6850worker2 # [ 0.287155] rcu: Max phase no-delay instances is 400.851lb # [ 0.294923] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)852worker1 # [ 0.299419] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).853client # [ 0.278635] ... generic bitmap: 000000000000003f854client # [ 0.278954] ... fixed-purpose counters: 0855worker1 # [ 0.300573] pinctrl core: initialized pinctrl subsystem856lb # [ 0.296020] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).857client # [ 0.279639] ... fixed-purpose bitmap: 0000000000000000858worker1 # [ 0.301651] PM: RTC time: 09:32:06, date: 2026-09-20859lb # [ 0.297233] pinctrl core: initialized pinctrl subsystem860client # [ 0.279945] ... value mask: 0000ffffffffffff861lb # [ 0.298352] PM: RTC time: 09:32:06, date: 2026-09-20862client # [ 0.280850] ... max period: 00007fffffffffff863client # [ 0.281638] ... global_ctrl mask: 000000000000003f864worker2 # [ 0.292033] smp: Bringing up secondary CPUs ...865client # [ 0.282053] signal: max sigframe size: 3376866worker2 # [ 0.292574] smp: Brought up 1 node, 1 CPU867worker1 # [ 0.305369] NET: Registered PF_NETLINK/PF_ROUTE protocol family868client # [ 0.282844] rcu: Hierarchical SRCU implementation.869worker2 # [ 0.293270] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)870client # [ 0.283545] rcu: Max phase no-delay instances is 400.871lb # [ 0.301957] NET: Registered PF_NETLINK/PF_ROUTE protocol family872worker1 # [ 0.306734] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations873lb # [ 0.303361] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations874worker1 # [ 0.307512] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations875worker2 # [ 0.293806] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)876lb # [ 0.304165] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations877worker2 # [ 0.294809] devtmpfs: initialized878worker1 # [ 0.308769] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations879worker2 # [ 0.295608] x86/mm: Memory block size: 128MB880worker1 # [ 0.309500] audit: initializing netlink subsys (disabled)881lb # [ 0.305423] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations882client # [ 0.288421] smp: Bringing up secondary CPUs ...883lb # [ 0.306153] audit: initializing netlink subsys (disabled)884worker1 # [ 0.310741] thermal_sys: Registered thermal governor 'fair_share'885client # [ 0.288959] smp: Brought up 1 node, 1 CPU886worker2 # [ 0.297400] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)887lb # [ 0.307265] thermal_sys: Registered thermal governor 'fair_share'888worker1 # [ 0.310743] thermal_sys: Registered thermal governor 'bang_bang'889client # [ 0.289607] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)890lb # [ 0.307267] thermal_sys: Registered thermal governor 'bang_bang'891worker2 # [ 0.298463] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).892worker1 # [ 0.311495] audit: type=2000 audit(1789896727.275:1): state=initialized audit_enabled=0 res=1893lb # [ 0.308144] thermal_sys: Registered thermal governor 'step_wise'894worker2 # [ 0.299655] pinctrl core: initialized pinctrl subsystem895client # [ 0.290070] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)896worker1 # [ 0.313491] thermal_sys: Registered thermal governor 'step_wise'897lb # [ 0.309061] thermal_sys: Registered thermal governor 'user_space'898worker2 # [ 0.300750] PM: RTC time: 09:32:06, date: 2026-09-20899client # [ 0.291210] devtmpfs: initialized900worker1 # [ 0.313493] thermal_sys: Registered thermal governor 'user_space'901lb # [ 0.309860] audit: type=2000 audit(1789896727.280:1): state=initialized audit_enabled=0 res=1902client # [ 0.292023] x86/mm: Memory block size: 128MB903worker1 # [ 0.314437] thermal_sys: Registered thermal governor 'power_allocator'904lb # [ 0.311146] thermal_sys: Registered thermal governor 'power_allocator'905worker1 # [ 0.315249] cpuidle: using governor menu906lb # [ 0.311160] cpuidle: using governor menu907client # [ 0.293806] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)908worker1 # [ 0.316781] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5909lb # [ 0.313361] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5910worker2 # [ 0.304844] NET: Registered PF_NETLINK/PF_ROUTE protocol family911client # [ 0.294863] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).912worker1 # [ 0.317709] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]913client # [ 0.296022] pinctrl core: initialized pinctrl subsystem914lb # [ 0.314379] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]915worker2 # [ 0.306055] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations916worker1 # [ 0.318493] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry917client # [ 0.297053] PM: RTC time: 09:32:06, date: 2026-09-20918lb # [ 0.315146] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry919worker2 # [ 0.306580] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations920worker1 # [ 0.319502] PCI: Using configuration type 1 for base access921lb # [ 0.316155] PCI: Using configuration type 1 for base access922worker2 # [ 0.307842] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations923worker1 # [ 0.320634] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.924lb # [ 0.317220] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.925worker2 # [ 0.308568] audit: initializing netlink subsys (disabled)926client # [ 0.300882] NET: Registered PF_NETLINK/PF_ROUTE protocol family927worker2 # [ 0.309690] thermal_sys: Registered thermal governor 'fair_share'928worker2 # [ 0.309693] thermal_sys: Registered thermal governor 'bang_bang'929client # [ 0.302250] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations930worker2 # [ 0.310559] thermal_sys: Registered thermal governor 'step_wise'931client # [ 0.302966] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations932worker2 # [ 0.311533] thermal_sys: Registered thermal governor 'user_space'933worker1 # [ 0.325913] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages934lb # [ 0.322404] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages935worker2 # [ 0.312304] audit: type=2000 audit(1789896727.292:1): state=initialized audit_enabled=0 res=1936client # [ 0.304223] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations937lb # [ 0.323145] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page938worker1 # [ 0.326492] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page939client # [ 0.304955] audit: initializing netlink subsys (disabled)940worker2 # [ 0.313561] thermal_sys: Registered thermal governor 'power_allocator'941worker1 # [ 0.327491] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages942worker2 # [ 0.313584] cpuidle: using governor menu943client # [ 0.306054] thermal_sys: Registered thermal governor 'fair_share'944client # [ 0.306056] thermal_sys: Registered thermal governor 'bang_bang'945worker2 # [ 0.315782] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5946client # [ 0.306947] thermal_sys: Registered thermal governor 'step_wise'947worker2 # [ 0.316799] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]948client # [ 0.307905] thermal_sys: Registered thermal governor 'user_space'949lb # [ 0.328143] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages950worker2 # [ 0.317561] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry951client # [ 0.308712] audit: type=2000 audit(1789896727.298:1): state=initialized audit_enabled=0 res=1952lb # [ 0.329143] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page953worker2 # [ 0.318570] PCI: Using configuration type 1 for base access954client # [ 0.309948] thermal_sys: Registered thermal governor 'power_allocator'955client # [ 0.309962] cpuidle: using governor menu956worker2 # [ 0.319658] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.957worker1 # [ 0.334492] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page958client # [ 0.312126] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5959client # [ 0.313180] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]960client # [ 0.313948] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry961client # [ 0.314958] PCI: Using configuration type 1 for base access962worker2 # [ 0.324815] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages963worker2 # [ 0.325560] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page964client # [ 0.316059] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.965lb # [ 0.339553] ACPI: Added _OSI(Module Device)966worker1 # [ 0.342835] ACPI: Added _OSI(Module Device)967lb # [ 0.340144] ACPI: Added _OSI(Processor Device)968worker1 # [ 0.343492] ACPI: Added _OSI(Processor Device)969lb # [ 0.340888] ACPI: Added _OSI(Processor Aggregator Device)970worker1 # [ 0.344249] ACPI: Added _OSI(Processor Aggregator Device)971worker2 # [ 0.330559] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages972worker2 # [ 0.331558] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page973client # [ 0.323229] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages974client # [ 0.323947] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page975lb # [ 0.349731] ACPI: 1 ACPI AML tables successfully acquired and loaded976worker1 # [ 0.353021] ACPI: 1 ACPI AML tables successfully acquired and loaded977client # [ 0.328947] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages978client # [ 0.329946] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page979worker2 # [ 0.341933] ACPI: Added _OSI(Module Device)980lb # [ 0.353544] ACPI: Interpreter enabled981worker1 # [ 0.356892] ACPI: Interpreter enabled982worker2 # [ 0.342560] ACPI: Added _OSI(Processor Device)983lb # [ 0.354158] ACPI: PM: (supports S0 S3 S4 S5)984worker1 # [ 0.357505] ACPI: PM: (supports S0 S3 S4 S5)985worker2 # [ 0.343296] ACPI: Added _OSI(Processor Aggregator Device)986lb # [ 0.354830] ACPI: Using IOAPIC for interrupt routing987worker1 # [ 0.358216] ACPI: Using IOAPIC for interrupt routing988lb # [ 0.355193] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug989worker1 # [ 0.358573] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug990lb # [ 0.356187] PCI: Using E820 reservations for host bridge windows991worker1 # [ 0.359491] PCI: Using E820 reservations for host bridge windows992client # [ 0.338550] ACPI: Added _OSI(Module Device)993client # [ 0.338947] ACPI: Added _OSI(Processor Device)994lb # [ 0.359228] ACPI: Enabled 2 GPEs in block 00 to 3F995worker1 # [ 0.362611] ACPI: Enabled 2 GPEs in block 00 to 3F996client # [ 0.339680] ACPI: Added _OSI(Processor Aggregator Device)997worker2 # [ 0.351693] ACPI: 1 ACPI AML tables successfully acquired and loaded998worker2 # [ 0.355962] ACPI: Interpreter enabled999worker2 # [ 0.356574] ACPI: PM: (supports S0 S3 S4 S5)1000client # [ 0.346481] ACPI: 1 ACPI AML tables successfully acquired and loaded1001lb # [ 0.367770] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1002worker2 # [ 0.357299] ACPI: Using IOAPIC for interrupt routing1003worker1 # [ 0.371303] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1004lb # [ 0.368149] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1005worker2 # [ 0.357608] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1006worker1 # [ 0.372274] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1007worker2 # [ 0.358559] PCI: Using E820 reservations for host bridge windows1008lb # [ 0.369582] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1009client # [ 0.349825] ACPI: Interpreter enabled1010worker1 # [ 0.373786] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1011client # [ 0.350385] ACPI: PM: (supports S0 S3 S4 S5)1012lb # [ 0.370269] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1013client # [ 0.350946] ACPI: Using IOAPIC for interrupt routing1014worker1 # [ 0.374614] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1015lb # [ 0.371537] PCI host bridge to bus 0000:001016worker2 # [ 0.361692] ACPI: Enabled 2 GPEs in block 00 to 3F1017worker1 # [ 0.375830] PCI host bridge to bus 0000:001018client # [ 0.351788] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1019lb # [ 0.372147] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1020worker1 # [ 0.376495] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1021lb # [ 0.373143] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1022worker1 # [ 0.377491] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1023lb # [ 0.374143] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1024worker1 # [ 0.378490] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1025lb # [ 0.375143] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1026worker1 # [ 0.379490] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1027client # [ 0.356946] PCI: Using E820 reservations for host bridge windows1028lb # [ 0.376144] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1029worker1 # [ 0.380490] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1030client # [ 0.358006] ACPI: Enabled 2 GPEs in block 00 to 3F1031lb # [ 0.377143] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1032worker1 # [ 0.381490] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1033lb # [ 0.378148] pci_bus 0000:00: root bus resource [bus 00-ff]1034worker1 # [ 0.382490] pci_bus 0000:00: root bus resource [bus 00-ff]1035worker2 # [ 0.370331] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1036lb # [ 0.379218] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1037worker1 # [ 0.383508] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1038worker2 # [ 0.371342] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1039lb # [ 0.380581] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1040worker1 # [ 0.384974] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1041worker2 # [ 0.373394] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1042worker2 # [ 0.374611] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1043worker2 # [ 0.375907] PCI host bridge to bus 0000:001044client # [ 0.366595] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1045worker2 # [ 0.376563] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1046client # [ 0.367385] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1047worker2 # [ 0.377558] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1048client # [ 0.368023] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1049worker2 # [ 0.378558] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1050client # [ 0.369066] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1051worker2 # [ 0.379558] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1052lb # [ 0.383209] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1053worker1 # [ 0.387573] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1054client # [ 0.370290] PCI host bridge to bus 0000:001055worker2 # [ 0.380558] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1056lb # [ 0.384156] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1057client # [ 0.370950] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1058worker1 # [ 0.388619] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1059lb # [ 0.385095] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1060worker2 # [ 0.381558] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1061client # [ 0.371946] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1062worker2 # [ 0.382558] pci_bus 0000:00: root bus resource [bus 00-ff]1063worker1 # [ 0.389555] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1064client # [ 0.372946] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1065lb # [ 0.386391] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1066worker2 # [ 0.383548] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1067worker1 # [ 0.390807] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1068client # [ 0.373945] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1069lb # [ 0.387857] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1070client # [ 0.374945] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1071worker2 # [ 0.385021] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1072worker1 # [ 0.392208] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1073client # [ 0.375945] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1074client # [ 0.376946] pci_bus 0000:00: root bus resource [bus 00-ff]1075lb # [ 0.391176] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1076client # [ 0.377973] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1077worker1 # [ 0.394551] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1078lb # [ 0.392069] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1079worker1 # [ 0.395373] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1080lb # [ 0.392911] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1081client # [ 0.379381] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1082worker1 # [ 0.396215] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1083lb # [ 0.393967] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1084worker1 # [ 0.396496] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1085lb # [ 0.395962] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1086worker1 # [ 0.398044] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1087worker2 # [ 0.387721] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1088worker2 # [ 0.388570] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1089lb # [ 0.399175] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1090worker2 # [ 0.389544] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1091worker1 # [ 0.399520] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1092lb # [ 0.400094] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1093worker1 # [ 0.400409] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1094worker2 # [ 0.390889] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1095lb # [ 0.400913] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1096worker1 # [ 0.401263] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1097client # [ 0.382009] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1098client # [ 0.382958] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1099lb # [ 0.402595] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1100worker2 # [ 0.392314] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1101worker1 # [ 0.402952] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1102client # [ 0.383867] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1103client # [ 0.385167] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1104worker2 # [ 0.395566] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1105lb # [ 0.405177] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1106worker1 # [ 0.405498] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1107worker2 # [ 0.396451] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1108lb # [ 0.406052] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1109client # [ 0.386718] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1110worker1 # [ 0.406336] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1111worker2 # [ 0.397287] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1112lb # [ 0.406872] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1113worker1 # [ 0.407194] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1114worker2 # [ 0.397564] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1115client # [ 0.388954] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1116lb # [ 0.407691] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117worker1 # [ 0.408064] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118client # [ 0.389782] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1119worker2 # [ 0.399136] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1120client # [ 0.390668] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1121lb # [ 0.410114] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1122client # [ 0.390951] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1123worker1 # [ 0.409521] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1124worker2 # [ 0.401448] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1125lb # [ 0.410800] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1126worker1 # [ 0.410365] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1127worker2 # [ 0.402195] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1128client # [ 0.393058] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1129worker2 # [ 0.402581] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1130lb # [ 0.411165] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1131worker1 # [ 0.411279] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1132worker2 # [ 0.404124] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133lb # [ 0.412707] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1134worker1 # [ 0.413056] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1135client # [ 0.394954] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1136client # [ 0.395838] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1137client # [ 0.396722] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1138worker1 # [ 0.414497] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1139lb # [ 0.415019] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1140worker1 # [ 0.415314] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1141lb # [ 0.415758] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1142worker2 # [ 0.407444] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1143client # [ 0.398317] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1144worker1 # [ 0.416297] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1145lb # [ 0.416165] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1146worker2 # [ 0.408206] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1147worker2 # [ 0.408582] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1148lb # [ 0.417729] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1149worker1 # [ 0.417956] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1150worker2 # [ 0.410125] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1151client # [ 0.400953] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1152client # [ 0.402590] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1153lb # [ 0.420176] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1154client # [ 0.402967] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1155worker1 # [ 0.420867] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1156worker2 # [ 0.412567] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1157lb # [ 0.421062] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1158worker1 # [ 0.422140] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1159worker2 # [ 0.413412] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1160lb # [ 0.421897] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1161client # [ 0.404540] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1162worker1 # [ 0.422514] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1163worker2 # [ 0.414285] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1164lb # [ 0.422730] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1165worker1 # [ 0.424035] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1166client # [ 0.405953] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1167worker2 # [ 0.415120] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1168client # [ 0.406803] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1169lb # [ 0.424175] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1170client # [ 0.407679] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1171worker1 # [ 0.425520] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1172lb # [ 0.425059] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1173worker1 # [ 0.426389] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1174worker2 # [ 0.417281] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1175worker1 # [ 0.427299] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1176worker2 # [ 0.417565] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1177client # [ 0.408502] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1178lb # [ 0.425929] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1179worker2 # [ 0.418523] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1180lb # [ 0.427149] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1181worker1 # [ 0.428346] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1182client # [ 0.409953] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1183worker2 # [ 0.419984] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1184lb # [ 0.428691] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1185client # [ 0.410780] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1186worker1 # [ 0.430071] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1187client # [ 0.411680] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1188lb # [ 0.430180] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1189worker1 # [ 0.431491] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1190client # [ 0.412499] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1191lb # [ 0.431166] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1192worker1 # [ 0.432490] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1193worker2 # [ 0.423566] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1194worker2 # [ 0.424480] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1195lb # [ 0.432674] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1196worker1 # [ 0.434040] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1197worker2 # [ 0.425302] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1198client # [ 0.414953] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1199worker1 # [ 0.435498] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1200client # [ 0.415798] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1201worker2 # [ 0.426160] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1202lb # [ 0.435114] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1203client # [ 0.416644] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1204worker1 # [ 0.436367] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1205lb # [ 0.435769] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1206worker2 # [ 0.427565] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1207worker1 # [ 0.437512] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1208client # [ 0.417540] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1209lb # [ 0.436165] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1210worker2 # [ 0.428400] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1211worker1 # [ 0.439074] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1212lb # [ 0.437719] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1213client # [ 0.418953] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1214worker2 # [ 0.429335] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1215client # [ 0.419809] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1216worker2 # [ 0.430564] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1217worker1 # [ 0.440498] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1218client # [ 0.420698] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1219lb # [ 0.439177] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1220worker1 # [ 0.441364] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1221client # [ 0.420952] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1222lb # [ 0.440052] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1223worker2 # [ 0.432128] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1224worker1 # [ 0.442253] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1225lb # [ 0.440871] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1226client # [ 0.422406] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1227worker2 # [ 0.433571] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1228worker1 # [ 0.443971] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1229worker2 # [ 0.434582] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1230lb # [ 0.441711] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1231client # [ 0.423904] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1232worker1 # [ 0.445919] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1233client # [ 0.424670] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1234lb # [ 0.443936] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1235worker2 # [ 0.436116] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1236worker1 # [ 0.446694] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1237client # [ 0.425477] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1238lb # [ 0.444958] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1239worker1 # [ 0.448094] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1240lb # [ 0.446799] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1241worker2 # [ 0.437566] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1242client # [ 0.426954] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1243worker2 # [ 0.439241] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1244client # [ 0.427847] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1245worker2 # [ 0.439581] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1246client # [ 0.428696] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1247worker2 # [ 0.441125] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1248client # [ 0.430221] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1249worker2 # [ 0.442575] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1250client # [ 0.431952] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1251worker2 # [ 0.443487] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1252client # [ 0.432820] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1253worker2 # [ 0.444315] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1254client # [ 0.433699] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1255client # [ 0.434504] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1256worker2 # [ 0.446624] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1257worker1 # [ 0.448679] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1258lb # [ 0.447390] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1259client # [ 0.435656] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1260worker2 # [ 0.448352] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1261worker1 # [ 0.451147] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1262lb # [ 0.449899] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1263worker2 # [ 0.449446] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1264client # [ 0.436157] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1265worker1 # [ 0.451781] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1266lb # [ 0.450386] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1267worker2 # [ 0.451253] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1268client # [ 0.438562] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1269worker1 # [ 0.453435] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1270lb # [ 0.451798] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1271lb # [ 0.452413] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1272worker1 # [ 0.454513] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1273lb # [ 0.453445] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1274worker1 # [ 0.455819] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1275lb # [ 0.454399] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1276worker1 # [ 0.456787] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1277lb # [ 0.456172] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1278worker1 # [ 0.458468] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1279worker1 # [ 0.459215] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1280lb # [ 0.457057] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1281lb # [ 0.458469] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1282worker1 # [ 0.459820] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1283lb # [ 0.459885] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1284worker1 # [ 0.462189] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1285client # [ 0.439144] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1286worker2 # [ 0.451775] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1287client # [ 0.441512] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1288worker2 # [ 0.454320] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1289client # [ 0.442178] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1290lb # [ 0.463130] ACPI: PCI: Interrupt link LNKA configured for IRQ 101291worker2 # [ 0.454809] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1292worker1 # [ 0.465536] ACPI: PCI: Interrupt link LNKA configured for IRQ 101293client # [ 0.443497] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1294lb # [ 0.463966] ACPI: PCI: Interrupt link LNKB configured for IRQ 101295worker1 # [ 0.466598] ACPI: PCI: Interrupt link LNKB configured for IRQ 101296worker2 # [ 0.456255] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1297lb # [ 0.464941] ACPI: PCI: Interrupt link LNKC configured for IRQ 111298worker1 # [ 0.467593] ACPI: PCI: Interrupt link LNKC configured for IRQ 111299client # [ 0.444209] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1300lb # [ 0.465969] ACPI: PCI: Interrupt link LNKD configured for IRQ 111301worker2 # [ 0.456865] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1302worker1 # [ 0.468589] ACPI: PCI: Interrupt link LNKD configured for IRQ 111303client # [ 0.445245] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1304lb # [ 0.466962] ACPI: PCI: Interrupt link LNKE configured for IRQ 101305worker1 # [ 0.469591] ACPI: PCI: Interrupt link LNKE configured for IRQ 101306worker2 # [ 0.457850] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1307lb # [ 0.467971] ACPI: PCI: Interrupt link LNKF configured for IRQ 101308worker1 # [ 0.470592] ACPI: PCI: Interrupt link LNKF configured for IRQ 101309client # [ 0.446211] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1310lb # [ 0.468973] ACPI: PCI: Interrupt link LNKG configured for IRQ 111311worker2 # [ 0.458819] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1312worker1 # [ 0.471600] ACPI: PCI: Interrupt link LNKG configured for IRQ 111313lb # [ 0.469950] ACPI: PCI: Interrupt link LNKH configured for IRQ 111314client # [ 0.447981] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1315worker1 # [ 0.472587] ACPI: PCI: Interrupt link LNKH configured for IRQ 111316lb # [ 0.470914] ACPI: PCI: Interrupt link GSIA configured for IRQ 161317client # [ 0.448793] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1318worker1 # [ 0.473525] ACPI: PCI: Interrupt link GSIA configured for IRQ 161319worker2 # [ 0.460588] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1320lb # [ 0.471159] ACPI: PCI: Interrupt link GSIB configured for IRQ 171321worker1 # [ 0.474446] ACPI: PCI: Interrupt link GSIB configured for IRQ 171322worker2 # [ 0.461566] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1323client # [ 0.449952] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1324lb # [ 0.472094] ACPI: PCI: Interrupt link GSIC configured for IRQ 181325worker1 # [ 0.475203] ACPI: PCI: Interrupt link GSIC configured for IRQ 181326lb # [ 0.472855] ACPI: PCI: Interrupt link GSID configured for IRQ 191327worker2 # [ 0.462825] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1328client # [ 0.451544] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1329worker1 # [ 0.475505] ACPI: PCI: Interrupt link GSID configured for IRQ 191330lb # [ 0.473155] ACPI: PCI: Interrupt link GSIE configured for IRQ 201331worker1 # [ 0.476456] ACPI: PCI: Interrupt link GSIE configured for IRQ 201332worker2 # [ 0.464352] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1333lb # [ 0.474120] ACPI: PCI: Interrupt link GSIF configured for IRQ 211334worker1 # [ 0.477270] ACPI: PCI: Interrupt link GSIF configured for IRQ 211335lb # [ 0.475006] ACPI: PCI: Interrupt link GSIG configured for IRQ 221336worker1 # [ 0.478254] ACPI: PCI: Interrupt link GSIG configured for IRQ 221337lb # [ 0.475936] ACPI: PCI: Interrupt link GSIH configured for IRQ 231338worker1 # [ 0.479266] ACPI: PCI: Interrupt link GSIH configured for IRQ 231339client # [ 0.455198] ACPI: PCI: Interrupt link LNKA configured for IRQ 101340client # [ 0.456054] ACPI: PCI: Interrupt link LNKB configured for IRQ 101341lb # [ 0.478059] iommu: Default domain type: Translated1342worker2 # [ 0.468313] ACPI: PCI: Interrupt link LNKA configured for IRQ 101343worker1 # [ 0.481330] iommu: Default domain type: Translated1344client # [ 0.457044] ACPI: PCI: Interrupt link LNKC configured for IRQ 111345lb # [ 0.478796] iommu: DMA domain TLB invalidation policy: lazy mode1346worker2 # [ 0.468672] ACPI: PCI: Interrupt link LNKB configured for IRQ 101347worker1 # [ 0.482120] iommu: DMA domain TLB invalidation policy: lazy mode1348client # [ 0.458043] ACPI: PCI: Interrupt link LNKD configured for IRQ 111349lb # [ 0.479410] ACPI: bus type USB registered1350worker1 # [ 0.482765] ACPI: bus type USB registered1351worker2 # [ 0.469666] ACPI: PCI: Interrupt link LNKC configured for IRQ 111352client # [ 0.459040] ACPI: PCI: Interrupt link LNKE configured for IRQ 101353lb # [ 0.480169] usbcore: registered new interface driver usbfs1354worker1 # [ 0.483527] usbcore: registered new interface driver usbfs1355worker2 # [ 0.470663] ACPI: PCI: Interrupt link LNKD configured for IRQ 111356client # [ 0.460041] ACPI: PCI: Interrupt link LNKF configured for IRQ 101357lb # [ 0.481068] usbcore: registered new interface driver hub1358worker1 # [ 0.484458] usbcore: registered new interface driver hub1359lb # [ 0.481843] usbcore: registered new device driver usb1360client # [ 0.461043] ACPI: PCI: Interrupt link LNKG configured for IRQ 111361worker2 # [ 0.471662] ACPI: PCI: Interrupt link LNKE configured for IRQ 101362worker1 # [ 0.485153] usbcore: registered new device driver usb1363worker2 # [ 0.472661] ACPI: PCI: Interrupt link LNKF configured for IRQ 101364client # [ 0.462037] ACPI: PCI: Interrupt link LNKH configured for IRQ 111365lb # [ 0.483195] NetLabel: Initializing1366worker1 # [ 0.486419] NetLabel: Initializing1367worker2 # [ 0.473661] ACPI: PCI: Interrupt link LNKG configured for IRQ 111368client # [ 0.462987] ACPI: PCI: Interrupt link GSIA configured for IRQ 161369lb # [ 0.483879] NetLabel: domain hash size = 1281370worker1 # [ 0.486911] NetLabel: domain hash size = 1281371worker2 # [ 0.474657] ACPI: PCI: Interrupt link LNKH configured for IRQ 111372client # [ 0.463959] ACPI: PCI: Interrupt link GSIB configured for IRQ 171373lb # [ 0.484143] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1374worker1 # [ 0.487490] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1375client # [ 0.464890] ACPI: PCI: Interrupt link GSIC configured for IRQ 181376worker2 # [ 0.475596] ACPI: PCI: Interrupt link GSIA configured for IRQ 161377lb # [ 0.485153] NetLabel: unlabeled traffic allowed by default1378worker1 # [ 0.488556] NetLabel: unlabeled traffic allowed by default1379lb # [ 0.486063] PCI: Using ACPI for IRQ routing1380client # [ 0.465667] ACPI: PCI: Interrupt link GSID configured for IRQ 191381worker2 # [ 0.476570] ACPI: PCI: Interrupt link GSIB configured for IRQ 171382worker1 # [ 0.489480] PCI: Using ACPI for IRQ routing1383client # [ 0.465958] ACPI: PCI: Interrupt link GSIE configured for IRQ 201384worker2 # [ 0.477542] ACPI: PCI: Interrupt link GSIC configured for IRQ 181385client # [ 0.466918] ACPI: PCI: Interrupt link GSIF configured for IRQ 211386worker2 # [ 0.478345] ACPI: PCI: Interrupt link GSID configured for IRQ 191387client # [ 0.467707] ACPI: PCI: Interrupt link GSIG configured for IRQ 221388worker2 # [ 0.479542] ACPI: PCI: Interrupt link GSIE configured for IRQ 201389client # [ 0.467961] ACPI: PCI: Interrupt link GSIH configured for IRQ 231390worker2 # [ 0.480337] ACPI: PCI: Interrupt link GSIF configured for IRQ 211391worker2 # [ 0.481331] ACPI: PCI: Interrupt link GSIG configured for IRQ 221392client # [ 0.469921] iommu: Default domain type: Translated1393worker2 # [ 0.482344] ACPI: PCI: Interrupt link GSIH configured for IRQ 231394client # [ 0.470534] iommu: DMA domain TLB invalidation policy: lazy mode1395client # [ 0.471216] ACPI: bus type USB registered1396worker2 # [ 0.484460] iommu: Default domain type: Translated1397client # [ 0.471981] usbcore: registered new interface driver usbfs1398worker2 # [ 0.485174] iommu: DMA domain TLB invalidation policy: lazy mode1399client # [ 0.472871] usbcore: registered new interface driver hub1400client # [ 0.473602] usbcore: registered new device driver usb1401worker2 # [ 0.485846] ACPI: bus type USB registered1402worker2 # [ 0.486601] usbcore: registered new interface driver usbfs1403client # [ 0.474790] NetLabel: Initializing1404worker2 # [ 0.487552] usbcore: registered new interface driver hub1405client # [ 0.475396] NetLabel: domain hash size = 1281406client # [ 0.475945] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1407worker2 # [ 0.488570] usbcore: registered new device driver usb1408client # [ 0.476923] NetLabel: unlabeled traffic allowed by default1409worker2 # [ 0.490551] NetLabel: Initializing1410client # [ 0.477672] PCI: Using ACPI for IRQ routing1411worker2 # [ 0.491268] NetLabel: domain hash size = 1281412worker2 # [ 0.491559] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker2 # [ 0.492642] NetLabel: unlabeled traffic allowed by default1414worker2 # [ 0.493572] PCI: Using ACPI for IRQ routing1415lb # [ 0.530519] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416lb # [ 0.531139] pci 0000:00:01.0: vgaarb: bridge control possible1417lb # [ 0.531139] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker1 # [ 0.535906] pci 0000:00:01.0: vgaarb: setting as boot VGA device1419lb # [ 0.531148] vgaarb: loaded1420worker1 # [ 0.536486] pci 0000:00:01.0: vgaarb: bridge control possible1421lb # [ 0.531902] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01422lb # [ 0.532145] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1423worker1 # [ 0.536486] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1424worker1 # [ 0.536495] vgaarb: loaded1425worker1 # [ 0.537266] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01426worker1 # [ 0.537493] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1427lb # [ 0.536235] clocksource: Switched to clocksource kvm-clock1428lb # [ 0.539917] VFS: Disk quotas dquot_6.6.01429client # [ 0.520544] pci 0000:00:01.0: vgaarb: setting as boot VGA device1430lb # [ 0.540640] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1431client # [ 0.520942] pci 0000:00:01.0: vgaarb: bridge control possible1432worker1 # [ 0.544588] clocksource: Switched to clocksource kvm-clock1433lb # [ 0.541947] pnp: PnP ACPI init1434client # [ 0.520942] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435lb # [ 0.542754] ACPI: IRQ 4 override to edge(!), high(!)1436client # [ 0.520950] vgaarb: loaded1437client # [ 0.521673] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01438lb # [ 0.543736] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1439worker1 # [ 0.548030] VFS: Disk quotas dquot_6.6.01440client # [ 0.521948] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1441lb # [ 0.545279] pnp: PnP ACPI: found 6 devices1442worker1 # [ 0.548781] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1443worker1 # [ 0.550200] pnp: PnP ACPI init1444worker1 # [ 0.551013] ACPI: IRQ 4 override to edge(!), high(!)1445worker2 # [ 0.540112] pci 0000:00:01.0: vgaarb: setting as boot VGA device1446worker2 # [ 0.540554] pci 0000:00:01.0: vgaarb: bridge control possible1447worker1 # [ 0.552090] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1448client # [ 0.526033] clocksource: Switched to clocksource kvm-clock1449worker2 # [ 0.540554] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1450worker1 # [ 0.553666] pnp: PnP ACPI: found 6 devices1451worker2 # [ 0.540563] vgaarb: loaded1452worker2 # [ 0.541312] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01453worker2 # [ 0.541561] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1454client # [ 0.529441] VFS: Disk quotas dquot_6.6.01455lb # [ 0.552852] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1456client # [ 0.530148] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1457lb # [ 0.554333] clocksource: Switched to clocksource acpi_pm1458client # [ 0.531543] pnp: PnP ACPI init1459lb # [ 0.555310] NET: Registered PF_INET protocol family1460client # [ 0.532304] ACPI: IRQ 4 override to edge(!), high(!)1461worker2 # [ 0.544674] clocksource: Switched to clocksource kvm-clock1462lb # [ 0.556471] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1463client # [ 0.533281] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1464client # [ 0.534818] pnp: PnP ACPI: found 6 devices1465worker1 # [ 0.561276] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1466worker1 # [ 0.562829] clocksource: Switched to clocksource acpi_pm1467worker2 # [ 0.548155] VFS: Disk quotas dquot_6.6.01468worker1 # [ 0.563854] NET: Registered PF_INET protocol family1469worker2 # [ 0.548898] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1470worker1 # [ 0.565075] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1471worker2 # [ 0.550304] pnp: PnP ACPI init1472worker2 # [ 0.551135] ACPI: IRQ 4 override to edge(!), high(!)1473worker2 # [ 0.552166] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1474worker2 # [ 0.553736] pnp: PnP ACPI: found 6 devices1475client # [ 0.542394] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1476client # [ 0.543882] clocksource: Switched to clocksource acpi_pm1477client # [ 0.544893] NET: Registered PF_INET protocol family1478client # [ 0.546073] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1479lb # [ 0.572868] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1480worker2 # [ 0.561421] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1481lb # [ 0.574421] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1482worker2 # [ 0.562852] clocksource: Switched to clocksource acpi_pm1483worker2 # [ 0.563783] NET: Registered PF_INET protocol family1484lb # [ 0.575747] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1485lb # [ 0.577097] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1486worker2 # [ 0.564930] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1487lb # [ 0.578323] TCP: Hash tables configured (established 16384 bind 16384)1488worker1 # [ 0.581911] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1489lb # [ 0.579467] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1490worker1 # [ 0.583616] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1491lb # [ 0.580760] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1492lb # [ 0.581829] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1493worker1 # [ 0.584985] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1494lb # [ 0.583057] NET: Registered PF_UNIX/PF_LOCAL protocol family1495worker1 # [ 0.586429] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1496lb # [ 0.584019] NET: Registered PF_XDP protocol family1497worker1 # [ 0.587724] TCP: Hash tables configured (established 16384 bind 16384)1498lb # [ 0.584864] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1499worker1 # [ 0.588888] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1500lb # [ 0.585910] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1501lb # [ 0.586926] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1502worker1 # [ 0.590211] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1503client # [ 0.562853] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1504lb # [ 0.587975] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1505worker1 # [ 0.591282] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1506client # [ 0.564326] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1507lb # [ 0.589051] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1508worker1 # [ 0.592536] NET: Registered PF_UNIX/PF_LOCAL protocol family1509client # [ 0.565611] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1510worker1 # [ 0.593482] NET: Registered PF_XDP protocol family1511lb # [ 0.590142] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1512client # [ 0.566892] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1513worker1 # [ 0.594307] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1514lb # [ 0.591840] ACPI: \_SB_.GSIA: Enabled at IRQ 161515worker1 # [ 0.595330] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1516client # [ 0.568126] TCP: Hash tables configured (established 16384 bind 16384)1517worker1 # [ 0.596338] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1518client # [ 0.569240] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1519worker1 # [ 0.597492] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1520lb # [ 0.594507] ACPI: \_SB_.GSIB: Enabled at IRQ 171521worker2 # [ 0.581801] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1522client # [ 0.570479] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1523worker1 # [ 0.598580] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1524client # [ 0.571525] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1525worker2 # [ 0.583314] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1526lb # [ 0.596500] ACPI: \_SB_.GSIC: Enabled at IRQ 181527worker1 # [ 0.599708] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1528client # [ 0.572708] NET: Registered PF_UNIX/PF_LOCAL protocol family1529worker2 # [ 0.584603] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1530client # [ 0.573617] NET: Registered PF_XDP protocol family1531worker1 # [ 0.601451] ACPI: \_SB_.GSIA: Enabled at IRQ 161532client # [ 0.574424] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1533worker2 # [ 0.585951] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1534lb # [ 0.598503] ACPI: \_SB_.GSID: Enabled at IRQ 191535client # [ 0.575372] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1536worker2 # [ 0.587193] TCP: Hash tables configured (established 16384 bind 16384)1537lb # [ 0.600312] PCI: CLS 0 bytes, default 641538worker1 # [ 0.603667] ACPI: \_SB_.GSIB: Enabled at IRQ 171539client # [ 0.576338] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1540worker2 # [ 0.588316] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1541client # [ 0.577412] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1542lb # [ 0.601172] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1543worker2 # [ 0.589582] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1544client # [ 0.578478] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1545worker1 # [ 0.605990] ACPI: \_SB_.GSIC: Enabled at IRQ 181546lb # [ 0.602821] Trying to unpack rootfs image as initramfs...1547worker2 # [ 0.590615] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1548client # [ 0.579546] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1549worker2 # [ 0.591771] NET: Registered PF_UNIX/PF_LOCAL protocol family1550worker1 # [ 0.608002] ACPI: \_SB_.GSID: Enabled at IRQ 191551worker2 # [ 0.592731] NET: Registered PF_XDP protocol family1552client # [ 0.581228] ACPI: \_SB_.GSIA: Enabled at IRQ 161553worker2 # [ 0.593577] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1554worker1 # [ 0.609703] PCI: CLS 0 bytes, default 641555worker2 # [ 0.594607] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1556client # [ 0.583343] ACPI: \_SB_.GSIB: Enabled at IRQ 171557worker1 # [ 0.610583] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1558worker2 # [ 0.595641] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1559worker1 # [ 0.612379] Trying to unpack rootfs image as initramfs...1560worker2 # [ 0.596765] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1561client # [ 0.585788] ACPI: \_SB_.GSIC: Enabled at IRQ 181562worker2 # [ 0.597888] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1563worker2 # [ 0.599020] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1564client # [ 0.587793] ACPI: \_SB_.GSID: Enabled at IRQ 191565client # [ 0.589525] PCI: CLS 0 bytes, default 641566worker2 # [ 0.600828] ACPI: \_SB_.GSIA: Enabled at IRQ 161567client # [ 0.590455] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1568worker2 # [ 0.603399] ACPI: \_SB_.GSIB: Enabled at IRQ 171569client # [ 0.592347] Trying to unpack rootfs image as initramfs...1570worker2 # [ 0.605310] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker2 # [ 0.607281] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker2 # [ 0.608977] PCI: CLS 0 bytes, default 641573worker2 # [ 0.609895] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574worker2 # [ 0.611693] Trying to unpack rootfs image as initramfs...1575lb # [ 0.646647] Initialise system trusted keyrings1576lb # [ 0.649602] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker1 # [ 0.658172] Initialise system trusted keyrings1578worker1 # [ 0.661195] workingset: timestamp_bits=40 max_order=19 bucket_order=01579client # [ 0.637849] Initialise system trusted keyrings1580client # [ 0.640571] workingset: timestamp_bits=40 max_order=19 bucket_order=01581worker2 # [ 0.655916] Initialise system trusted keyrings1582worker2 # [ 0.659134] workingset: timestamp_bits=40 max_order=19 bucket_order=01583lb # [ 0.672715] Key type asymmetric registered1584lb # [ 0.673482] Asymmetric key parser 'x509' registered1585lb # [ 0.674307] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1586worker1 # [ 0.680551] Key type asymmetric registered1587lb # [ 0.677731] io scheduler mq-deadline registered1588lb # [ 0.678486] io scheduler kyber registered1589lb # [ 0.681117] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1590worker1 # [ 0.685188] Asymmetric key parser 'x509' registered1591lb # [ 0.682401] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1592worker1 # [ 0.686158] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1593worker1 # [ 0.689285] io scheduler mq-deadline registered1594worker1 # [ 0.690092] io scheduler kyber registered1595client # [ 0.663556] Key type asymmetric registered1596client # [ 0.664244] Asymmetric key parser 'x509' registered1597lb # [ 0.688340] Linux agpgart interface v0.1031598lb # [ 0.689077] ACPI: bus type drm_connector registered1599client # [ 0.665060] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1600worker1 # [ 0.693703] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1601client # [ 0.667658] io scheduler mq-deadline registered1602client # [ 0.668424] io scheduler kyber registered1603lb # [ 0.692005] usbcore: registered new interface driver usbserial_generic1604worker1 # [ 0.695038] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1605worker2 # [ 0.680278] Key type asymmetric registered1606lb # [ 0.693049] usbserial: USB Serial support registered for generic1607worker2 # [ 0.680993] Asymmetric key parser 'x509' registered1608worker2 # [ 0.681878] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1609client # [ 0.671148] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1610client # [ 0.672485] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1611worker1 # [ 0.700322] Linux agpgart interface v0.1031612lb # [ 0.696568] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1613worker1 # [ 0.701091] ACPI: bus type drm_connector registered1614lb # [ 0.696568] Please enable it if your BIOS has the CPPC option.1615lb # [ 0.698759] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1616worker2 # [ 0.687274] io scheduler mq-deadline registered1617worker2 # [ 0.688107] io scheduler kyber registered1618worker1 # [ 0.704433] usbcore: registered new interface driver usbserial_generic1619lb # [ 0.701679] drop_monitor: Initializing network drop monitor service1620client # [ 0.678298] Linux agpgart interface v0.1031621worker1 # [ 0.705553] usbserial: USB Serial support registered for generic1622lb # [ 0.702815] NET: Registered PF_INET6 protocol family1623client # [ 0.679040] ACPI: bus type drm_connector registered1624worker2 # [ 0.691583] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1625worker2 # [ 0.692892] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1626lb # [ 0.706017] Segment Routing with IPv61627client # [ 0.681723] usbcore: registered new interface driver usbserial_generic1628worker1 # [ 0.709153] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1629client # [ 0.682763] usbserial: USB Serial support registered for generic1630worker1 # [ 0.709153] Please enable it if your BIOS has the CPPC option.1631lb # [ 0.708589] In-situ OAM (IOAM) with IPv61632worker1 # [ 0.711462] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1633worker2 # [ 0.696863] Linux agpgart interface v0.1031634lb # [ 0.709653] IPI shorthand broadcast: enabled1635worker2 # [ 0.697658] ACPI: bus type drm_connector registered1636client # [ 0.685534] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1637client # [ 0.685534] Please enable it if your BIOS has the CPPC option.1638worker1 # [ 0.714276] drop_monitor: Initializing network drop monitor service1639client # [ 0.687700] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1640worker1 # [ 0.715498] NET: Registered PF_INET6 protocol family1641worker2 # [ 0.701615] usbcore: registered new interface driver usbserial_generic1642worker1 # [ 0.718649] Segment Routing with IPv61643worker2 # [ 0.702724] usbserial: USB Serial support registered for generic1644client # [ 0.691641] drop_monitor: Initializing network drop monitor service1645client # [ 0.692807] NET: Registered PF_INET6 protocol family1646worker1 # [ 0.721174] In-situ OAM (IOAM) with IPv61647lb # [ 0.717948] sched_clock: Marking stable (584014018, 133535113)->(790228389, -72679258)1648worker1 # [ 0.722234] IPI shorthand broadcast: enabled1649worker2 # [ 0.706089] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1650client # [ 0.695953] Segment Routing with IPv61651worker2 # [ 0.706089] Please enable it if your BIOS has the CPPC option.1652worker2 # [ 0.708391] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1653client # [ 0.698591] In-situ OAM (IOAM) with IPv61654lb # [ 0.722740] registered taskstats version 11655client # [ 0.699651] IPI shorthand broadcast: enabled1656lb # [ 0.723702] Loading compiled-in X.509 certificates1657worker2 # [ 0.712225] drop_monitor: Initializing network drop monitor service1658worker2 # [ 0.713459] NET: Registered PF_INET6 protocol family1659worker1 # [ 0.730500] sched_clock: Marking stable (594014854, 136128185)->(805657872, -75514833)1660worker2 # [ 0.718543] Segment Routing with IPv61661worker2 # [ 0.719392] In-situ OAM (IOAM) with IPv61662worker1 # [ 0.735386] registered taskstats version 11663client # [ 0.707911] sched_clock: Marking stable (574014179, 133497913)->(784527747, -77015655)1664worker1 # [ 0.736373] Loading compiled-in X.509 certificates1665worker2 # [ 0.722438] IPI shorthand broadcast: enabled1666client # [ 0.711750] registered taskstats version 11667client # [ 0.712716] Loading compiled-in X.509 certificates1668lb # [ 0.740064] Demotion targets for Node 0: null1669worker2 # [ 0.730654] sched_clock: Marking stable (596015794, 134063285)->(804561967, -74482888)1670lb # [ 0.743604] Key type .fscrypt registered1671lb # [ 0.744249] Key type fscrypt-provisioning registered1672lb # [ 0.745154] ima: No TPM chip found, activating TPM-bypass!1673worker2 # [ 0.734237] registered taskstats version 11674lb # [ 0.747567] ima: Allocated hash algorithm: sha11675worker2 # [ 0.735257] Loading compiled-in X.509 certificates1676lb # [ 0.748326] ima: No architecture policies found1677lb # [ 0.750561] PM: Magic number: 10:951:5251678lb # [ 0.751241] PM: hash matches drivers/base/power/main.c:8931679worker1 # [ 0.755164] Demotion targets for Node 0: null1680worker1 # [ 0.756078] Key type .fscrypt registered1681worker1 # [ 0.756826] Key type fscrypt-provisioning registered1682worker1 # [ 0.757822] ima: No TPM chip found, activating TPM-bypass!1683lb # [ 0.755031] RAS: Correctable Errors collector initialized.1684client # [ 0.732529] Demotion targets for Node 0: null1685client # [ 0.733395] Key type .fscrypt registered1686worker1 # [ 0.761166] ima: Allocated hash algorithm: sha11687client # [ 0.734093] Key type fscrypt-provisioning registered1688worker1 # [ 0.762023] ima: No architecture policies found1689client # [ 0.737652] ima: No TPM chip found, activating TPM-bypass!1690client # [ 0.738583] ima: Allocated hash algorithm: sha11691worker1 # [ 0.766166] PM: Magic number: 10:951:5251692client # [ 0.739393] ima: No architecture policies found1693lb # [ 0.763632] clk: Disabling unused clocks1694worker1 # [ 0.766929] PM: hash matches drivers/base/power/main.c:8931695lb # [ 0.764289] PM: genpd: Disabling unused power domains1696client # [ 0.741696] PM: Magic number: 10:951:5251697client # [ 0.742429] PM: hash matches drivers/base/power/main.c:8931698worker2 # [ 0.755093] Demotion targets for Node 0: null1699worker1 # [ 0.770768] RAS: Correctable Errors collector initialized.1700worker2 # [ 0.755994] Key type .fscrypt registered1701worker2 # [ 0.756684] Key type fscrypt-provisioning registered1702client # [ 0.746274] RAS: Correctable Errors collector initialized.1703worker2 # [ 0.760203] ima: No TPM chip found, activating TPM-bypass!1704worker2 # [ 0.761182] ima: Allocated hash algorithm: sha11705worker2 # [ 0.762012] ima: No architecture policies found1706worker1 # [ 0.779451] clk: Disabling unused clocks1707worker2 # [ 0.766104] PM: Magic number: 10:951:5251708client # [ 0.754893] clk: Disabling unused clocks1709worker1 # [ 0.782155] PM: genpd: Disabling unused power domains1710worker2 # [ 0.766854] PM: hash matches drivers/base/power/main.c:8931711client # [ 0.757526] PM: genpd: Disabling unused power domains1712worker2 # [ 0.770671] RAS: Correctable Errors collector initialized.1713worker2 # [ 0.779347] clk: Disabling unused clocks1714worker2 # [ 0.782091] PM: genpd: Disabling unused power domains1715lb # [ 0.929939] Freeing initrd memory: 29092K1716lb # [ 0.933076] Freeing unused decrypted memory: 2028K1717lb # [ 0.935763] Freeing unused kernel image (initmem) memory: 3644K1718lb # [ 0.936834] Write protecting the kernel read-only data: 32768k1719lb # [ 0.938683] Freeing unused kernel image (text/rodata gap) memory: 1208K1720lb # [ 0.940179] Freeing unused kernel image (rodata/data gap) memory: 752K1721worker1 # [ 0.943817] Freeing initrd memory: 29092K1722worker1 # [ 0.946960] Freeing unused decrypted memory: 2028K1723client # [ 0.922403] Freeing initrd memory: 29096K1724worker1 # [ 0.949671] Freeing unused kernel image (initmem) memory: 3644K1725worker1 # [ 0.950786] Write protecting the kernel read-only data: 32768k1726client # [ 0.925592] Freeing unused decrypted memory: 2028K1727worker1 # [ 0.952707] Freeing unused kernel image (text/rodata gap) memory: 1208K1728worker1 # [ 0.954299] Freeing unused kernel image (rodata/data gap) memory: 752K1729client # [ 0.928150] Freeing unused kernel image (initmem) memory: 3644K1730client # [ 0.929304] Write protecting the kernel read-only data: 32768k1731worker2 # [ 0.942022] Freeing initrd memory: 29092K1732client # [ 0.931168] Freeing unused kernel image (text/rodata gap) memory: 1208K1733client # [ 0.932729] Freeing unused kernel image (rodata/data gap) memory: 752K1734worker2 # [ 0.945238] Freeing unused decrypted memory: 2028K1735worker2 # [ 0.947867] Freeing unused kernel image (initmem) memory: 3644K1736worker2 # [ 0.949016] Write protecting the kernel read-only data: 32768k1737worker2 # [ 0.950904] Freeing unused kernel image (text/rodata gap) memory: 1208K1738worker2 # [ 0.952480] Freeing unused kernel image (rodata/data gap) memory: 752K1739lb # [ 0.991379] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740lb # [ 0.992439] Run /init as init process1741worker1 # [ 1.005637] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742lb # [ 1.002656] systemd[1]: Inserted module 'autofs4'1743worker1 # [ 1.006712] Run /init as init process1744client # [ 0.983893] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745client # [ 0.984985] Run /init as init process1746worker1 # [ 1.016812] systemd[1]: Inserted module 'autofs4'1747worker2 # [ 1.003782] x86/mm: Checked W+X mappings: passed, no W+X pages found.1748worker2 # [ 1.004904] Run /init as init process1749lb # [ 1.018800] fuse: init (API version 7.45)1750client # [ 0.995200] systemd[1]: Inserted module 'autofs4'1751lb # [ 1.024511] ACPI: \_SB_.GSIG: Enabled at IRQ 221752lb # [ 1.026866] ACPI: \_SB_.GSIH: Enabled at IRQ 231753worker2 # [ 1.015185] systemd[1]: Inserted module 'autofs4'1754worker1 # [ 1.032958] fuse: init (API version 7.45)1755lb # [ 1.030041] ACPI: \_SB_.GSIE: Enabled at IRQ 201756lb # [ 1.032273] ACPI: \_SB_.GSIF: Enabled at IRQ 211757worker1 # [ 1.038737] ACPI: \_SB_.GSIG: Enabled at IRQ 221758client # [ 1.011708] fuse: init (API version 7.45)1759worker1 # [ 1.041394] ACPI: \_SB_.GSIH: Enabled at IRQ 231760worker1 # [ 1.044482] ACPI: \_SB_.GSIE: Enabled at IRQ 201761client # [ 1.017420] ACPI: \_SB_.GSIG: Enabled at IRQ 221762worker1 # [ 1.046682] ACPI: \_SB_.GSIF: Enabled at IRQ 211763client # [ 1.019745] ACPI: \_SB_.GSIH: Enabled at IRQ 231764worker2 # [ 1.031533] fuse: init (API version 7.45)1765client # [ 1.022663] ACPI: \_SB_.GSIE: Enabled at IRQ 201766client # [ 1.024843] ACPI: \_SB_.GSIF: Enabled at IRQ 211767worker2 # [ 1.037412] ACPI: \_SB_.GSIG: Enabled at IRQ 221768worker2 # [ 1.039869] ACPI: \_SB_.GSIH: Enabled at IRQ 231769worker2 # [ 1.043219] ACPI: \_SB_.GSIE: Enabled at IRQ 201770worker2 # [ 1.045832] ACPI: \_SB_.GSIF: Enabled at IRQ 211771lb # [ 1.059773] systemd[1]: Successfully made /usr/ read-only.1772worker1 # [ 1.074361] systemd[1]: Successfully made /usr/ read-only.1773client # [ 1.049176] systemd[1]: Successfully made /usr/ read-only.1774worker2 # [ 1.071816] systemd[1]: Successfully made /usr/ read-only.1775lb # [ 1.395410] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1776lb # [ 1.400569] systemd[1]: Detected virtualization kvm.1777lb # [ 1.401456] systemd[1]: Detected architecture x86-64.1778lb # [ 1.402423] systemd[1]: Running in initrd.1779lb # [ 1.403692] systemd[1]: Initializing machine ID from random generator.1780lb # [ 1.404918] systemd[1]: Hostname set to <lb>.1781client # [ 1.384601] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1782client # [ 1.389425] systemd[1]: Detected virtualization kvm.1783client # [ 1.390254] systemd[1]: Detected architecture x86-64.1784client # [ 1.391114] systemd[1]: Running in initrd.1785client # [ 1.392181] systemd[1]: Initializing machine ID from random generator.1786client # [ 1.393375] systemd[1]: Hostname set to <client>.1787worker1 # [ 1.411290] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1788worker1 # [ 1.423438] systemd[1]: Detected virtualization kvm.1789worker1 # [ 1.425623] systemd[1]: Detected architecture x86-64.1790worker2 # [ 1.407456] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1791worker2 # [ 1.412683] systemd[1]: Detected virtualization kvm.1792worker1 # [ 1.427884] systemd[1]: Running in initrd.1793worker2 # [ 1.413580] systemd[1]: Detected architecture x86-64.1794worker2 # [ 1.414488] systemd[1]: Running in initrd.1795worker2 # [ 1.415578] systemd[1]: Initializing machine ID from random generator.1796worker2 # [ 1.416803] systemd[1]: Hostname set to <worker2>.1797worker1 # [ 1.430705] systemd[1]: Initializing machine ID from random generator.1798worker1 # [ 1.433664] systemd[1]: Hostname set to <worker1>.1799lb # [ 1.597211] systemd[1]: bpf-restrict-fs: LSM BPF program attached1800client # [ 1.594329] systemd[1]: bpf-restrict-fs: LSM BPF program attached1801worker2 # [ 1.618754] systemd[1]: bpf-restrict-fs: LSM BPF program attached1802lb # [ 1.637965] systemd[1]: Queued start job for default target Initrd Default Target.1803lb # [ 1.641948] systemd[1]: Created slice Slice /system/modprobe.1804lb # [ 1.643205] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1805lb # [ 1.644676] systemd[1]: Expecting device /dev/disk/by-label/nixos...1806lb # [ 1.645829] systemd[1]: Reached target Path Units.1807lb # [ 1.646730] systemd[1]: Reached target Slice Units.1808lb # [ 1.647647] systemd[1]: Reached target Swaps.1809lb # [ 1.648511] systemd[1]: Reached target Timer Units.1810lb # [ 1.649567] systemd[1]: Listening on D-Bus System Message Bus Socket.1811lb # [ 1.650868] systemd[1]: Listening on Journal Socket (/dev/log).1812lb # [ 1.652068] systemd[1]: Listening on Journal Sockets.1813lb # [ 1.653119] systemd[1]: Listening on udev Control Socket.1814lb # [ 1.654204] systemd[1]: Listening on udev Kernel Socket.1815lb # [ 1.655177] systemd[1]: Reached target Socket Units.1816lb # [ 1.657044] systemd[1]: Starting Create List of Static Device Nodes...1817worker1 # [ 1.661501] systemd[1]: bpf-restrict-fs: LSM BPF program attached1818lb # [ 1.662632] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1819client # [ 1.640824] systemd[1]: Queued start job for default target Initrd Default Target.1820lb # [ 1.668290] systemd[1]: Starting Load Kernel Module configfs...1821client # [ 1.644789] systemd[1]: Created slice Slice /system/modprobe.1822client # [ 1.645926] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1823client # [ 1.647355] systemd[1]: Expecting device /dev/disk/by-label/nixos...1824client # [ 1.648519] systemd[1]: Reached target Path Units.1825client # [ 1.649371] systemd[1]: Reached target Slice Units.1826client # [ 1.650247] systemd[1]: Reached target Swaps.1827client # [ 1.651053] systemd[1]: Reached target Timer Units.1828client # [ 1.652013] systemd[1]: Listening on D-Bus System Message Bus Socket.1829client # [ 1.653227] systemd[1]: Listening on Journal Socket (/dev/log).1830client # [ 1.654392] systemd[1]: Listening on Journal Sockets.1831client # [ 1.655393] systemd[1]: Listening on udev Control Socket.1832client # [ 1.656425] systemd[1]: Listening on udev Kernel Socket.1833client # [ 1.657382] systemd[1]: Reached target Socket Units.1834client # [ 1.659159] systemd[1]: Starting Create List of Static Device Nodes...1835worker2 # [ 1.671088] systemd[1]: Queued start job for default target Initrd Default Target.1836lb # [ 1.684672] systemd[1]: Starting Journal Service...1837client # [ 1.663582] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1838worker2 # [ 1.675364] systemd[1]: Created slice Slice /system/modprobe.1839worker2 # [ 1.676555] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1840worker2 # [ 1.678001] systemd[1]: Expecting device /dev/disk/by-label/nixos...1841worker2 # [ 1.679162] systemd[1]: Reached target Path Units.1842worker2 # [ 1.680031] systemd[1]: Reached target Slice Units.1843worker2 # [ 1.680928] systemd[1]: Reached target Swaps.1844worker2 # [ 1.681791] systemd[1]: Reached target Timer Units.1845worker2 # [ 1.682765] systemd[1]: Listening on D-Bus System Message Bus Socket.1846client # [ 1.671590] systemd[1]: Starting Load Kernel Module configfs...1847worker2 # [ 1.683975] systemd[1]: Listening on Journal Socket (/dev/log).1848worker2 # [ 1.685174] systemd[1]: Listening on Journal Sockets.1849worker2 # [ 1.686189] systemd[1]: Listening on udev Control Socket.1850worker2 # [ 1.687226] systemd[1]: Listening on udev Kernel Socket.1851worker2 # [ 1.688208] systemd[1]: Reached target Socket Units.1852worker2 # [ 1.690019] systemd[1]: Starting Create List of Static Device Nodes...1853worker2 # [ 1.693889] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1854client # [ 1.684134] systemd[1]: Starting Journal Service...1855lb # [ 1.698650] systemd[1]: Starting Load Kernel Modules...1856worker1 # [ 1.715618] systemd[1]: Queued start job for default target Initrd Default Target.1857worker2 # [ 1.701150] systemd[1]: Starting Load Kernel Module configfs...1858worker1 # [ 1.719551] systemd[1]: Created slice Slice /system/modprobe.1859lb # [ 1.718079] netfs: FS-Cache loaded1860worker1 # [ 1.720745] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1861worker1 # [ 1.722184] systemd[1]: Expecting device /dev/disk/by-label/nixos...1862worker1 # [ 1.723321] systemd[1]: Reached target Path Units.1863worker1 # [ 1.724230] systemd[1]: Reached target Slice Units.1864worker1 # [ 1.725151] systemd[1]: Reached target Swaps.1865worker1 # [ 1.726009] systemd[1]: Reached target Timer Units.1866lb # [ 1.722875] 9pnet: Installing 9P2000 support1867worker1 # [ 1.727022] systemd[1]: Listening on D-Bus System Message Bus Socket.1868worker1 # [ 1.728306] systemd[1]: Listening on Journal Socket (/dev/log).1869worker1 # [ 1.729544] systemd[1]: Listening on Journal Sockets.1870worker2 # [ 1.714206] systemd[1]: Starting Journal Service...1871worker1 # [ 1.730592] systemd[1]: Listening on udev Control Socket.1872worker1 # [ 1.731661] systemd[1]: Listening on udev Kernel Socket.1873worker1 # [ 1.732633] systemd[1]: Reached target Socket Units.1874client # [ 1.694594] systemd[1]: Starting Load Kernel Modules...1875lb # [ 1.730506] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1876worker1 # [ 1.734543] systemd[1]: Starting Create List of Static Device Nodes...1877worker1 # [ 1.740225] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1878client # [ 1.713672] netfs: FS-Cache loaded1879lb # [ 1.739956] systemd[1]: Starting Coldplug All udev Devices...1880client # [ 1.718385] 9pnet: Installing 9P2000 support1881worker1 # [ 1.747215] systemd[1]: Starting Load Kernel Module configfs...1882client # [ 1.725663] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1883worker2 # [ 1.728157] systemd[1]: Starting Load Kernel Modules...1884lb # [ 1.753606] systemd[1]: Finished Create List of Static Device Nodes.1885worker1 # [ 1.759355] systemd[1]: Starting Journal Service...1886client # [ 1.733184] systemd[1]: Starting Coldplug All udev Devices...1887worker2 # [ 1.747972] netfs: FS-Cache loaded1888lb # [ 1.760299] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1889worker2 # [ 1.752513] 9pnet: Installing 9P2000 support1890lb # [ 1.765410] systemd-journald[67]: Collecting audit messages is disabled.1891lb # [ 1.768943] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1892client # [ 1.746988] systemd[1]: Finished Create List of Static Device Nodes.1893worker2 # [ 1.759182] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1894lb # [ 1.774004] systemd[1]: modprobe@configfs.service: Deactivated successfully.1895worker1 # [ 1.770214] systemd[1]: Starting Load Kernel Modules...1896client # [ 1.755084] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1897lb # [ 1.779950] systemd[1]: Finished Load Kernel Module configfs.1898worker2 # [ 1.767811] systemd[1]: Starting Coldplug All udev Devices...1899lb # [ 1.782015] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1900client # [ 1.761903] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1901lb # [ 1.787008] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1902client # [ 1.765992] systemd-journald[67]: Collecting audit messages is disabled.1903worker1 # [ 1.794642] netfs: FS-Cache loaded1904lb # [ 1.791749] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1905client # [ 1.768917] systemd[1]: modprobe@configfs.service: Deactivated successfully.1906worker2 # [ 1.781378] systemd[1]: Finished Create List of Static Device Nodes.1907lb # [ 1.796503] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1908worker1 # [ 1.802657] 9pnet: Installing 9P2000 support1909worker2 # [ 1.786638] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1910client # [ 1.775880] systemd[1]: Finished Load Kernel Module configfs.1911worker1 # [ 1.803978] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1912client # [ 1.779956] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1913worker2 # [ 1.793467] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1914client # [ 1.783557] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1915worker2 # [ 1.796454] systemd-journald[67]: Collecting audit messages is disabled.1916worker1 # [ 1.814348] systemd[1]: Starting Coldplug All udev Devices...1917worker2 # [ 1.799506] systemd[1]: modprobe@configfs.service: Deactivated successfully.1918client # [ 1.789261] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1919client # [ 1.791593] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1920worker2 # [ 1.808471] systemd[1]: Finished Load Kernel Module configfs.1921lb # [ 1.823363] systemd[1]: Finished Load Kernel Modules.1922worker2 # [ 1.810302] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1923worker2 # [ 1.813536] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1924worker1 # [ 1.832440] systemd[1]: Finished Create List of Static Device Nodes.1925lb # [ 1.830776] systemd[1]: Starting Apply Kernel Variables...1926worker2 # [ 1.820109] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1927worker1 # [ 1.836806] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1928worker2 # [ 1.825163] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1929client # [ 1.819047] systemd[1]: Finished Load Kernel Modules.1930worker1 # [ 1.846628] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1931worker1 # [ 1.848527] systemd-journald[67]: Collecting audit messages is disabled.1932lb # [ 1.845701] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1933worker1 # [ 1.851606] systemd[1]: modprobe@configfs.service: Deactivated successfully.1934client # [ 1.826699] systemd[1]: Starting Apply Kernel Variables...1935worker1 # [ 1.858525] systemd[1]: Finished Load Kernel Module configfs.1936lb # [ 1.856767] systemd[1]: Starting Create Static Device Nodes in /dev...1937worker1 # [ 1.860797] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1938client # [ 1.836058] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1939worker1 # [ 1.865670] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1940worker2 # [ 1.852159] systemd[1]: Finished Load Kernel Modules.1941worker1 # [ 1.871340] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1942lb # [ 1.870197] systemd[1]: Finished Apply Kernel Variables.1943client # [ 1.846721] systemd[1]: Starting Create Static Device Nodes in /dev...1944worker2 # [ 1.860284] systemd[1]: Starting Apply Kernel Variables...1945worker1 # [ 1.876372] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1946worker2 # [ 1.871241] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1947lb # [ 1.887669] systemd[1]: Started Journal Service.1948lb # [ 1.752803] systemd-modules-load[68]: Inserted module 'dm_mod'1949lb # [ 1.755941] systemd-modules-load[68]: Inserted module 'virtio_balloon'1950client # [ 1.865651] systemd[1]: Finished Apply Kernel Variables.1951lb # [ 1.758296] systemd-modules-load[68]: Inserted module 'virtio_gpu'1952worker2 # [ 1.880336] systemd[1]: Starting Create Static Device Nodes in /dev...1953lb # [ 1.764845] systemd[1]: Finished Create Static Device Nodes in /dev.1954worker1 # [ 1.903736] systemd[1]: Finished Load Kernel Modules.1955client # [ 1.879039] systemd[1]: Finished Create Static Device Nodes in /dev.1956lb # [ 1.771081] systemd[1]: Reached target Preparation for Local File Systems.1957lb # [ 1.772114] systemd[1]: Reached target Local File Systems.1958client # [ 1.748205] systemd-modules-load[68]: Inserted module 'dm_mod'1959client # [ 1.750441] systemd-modules-load[68]: Inserted module 'virtio_balloon'1960lb # [ 1.775079] systemd[1]: Starting Create System Files and Directories...1961client # [ 1.884959] systemd[1]: Started Journal Service.1962worker1 # [ 1.912334] systemd[1]: Starting Apply Kernel Variables...1963client # [ 1.752396] systemd-modules-load[68]: Inserted module 'virtio_gpu'1964worker2 # [ 1.899389] systemd[1]: Finished Apply Kernel Variables.1965lb # [ 1.779831] systemd[1]: Starting Rule-based Manager for Device Events and Files...1966client # [ 1.762126] systemd[1]: Reached target Preparation for Local File Systems.1967client # [ 1.763115] systemd[1]: Reached target Local File Systems.1968client # [ 1.766094] systemd[1]: Starting Create System Files and Directories...1969worker1 # [ 1.926698] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1970worker2 # [ 1.911732] systemd[1]: Started Journal Service.1971worker2 # [ 1.779255] systemd-modules-load[68]: Inserted module 'dm_mod'1972client # [ 1.770807] systemd[1]: Starting Rule-based Manager for Device Events and Files...1973worker2 # [ 1.783322] systemd-modules-load[68]: Inserted module 'virtio_balloon'1974worker2 # [ 1.784489] systemd-modules-load[68]: Inserted module 'virtio_gpu'1975worker2 # [ 1.786263] systemd[1]: Finished Create Static Device Nodes in /dev.1976worker1 # [ 1.936422] systemd[1]: Starting Create Static Device Nodes in /dev...1977worker2 # [ 1.789354] systemd[1]: Reached target Preparation for Local File Systems.1978worker2 # [ 1.790514] systemd[1]: Reached target Local File Systems.1979worker2 # [ 1.792264] systemd[1]: Starting Create System Files and Directories...1980lb # [ 1.808496] systemd[1]: Finished Create System Files and Directories.1981worker2 # [ 1.797971] systemd[1]: Starting Rule-based Manager for Device Events and Files...1982worker1 # [ 1.950269] systemd[1]: Finished Apply Kernel Variables.1983client # [ 1.795983] systemd[1]: Finished Create System Files and Directories.1984worker1 # [ 1.968117] systemd[1]: Started Journal Service.1985lb # [ 1.832411] systemd-udevd[83]: Using default interface naming scheme 'v261'.1986worker1 # [ 1.835253] systemd-modules-load[68]: Inserted module 'dm_mod'1987worker2 # [ 1.826212] systemd[1]: Finished Create System Files and Directories.1988worker1 # [ 1.839845] systemd-modules-load[68]: Inserted module 'virtio_balloon'1989worker1 # [ 1.840950] systemd-modules-load[68]: Inserted module 'virtio_gpu'1990client # [ 1.819312] systemd-udevd[83]: Using default interface naming scheme 'v261'.1991worker1 # [ 1.846899] systemd[1]: Finished Create Static Device Nodes in /dev.1992worker1 # [ 1.852099] systemd[1]: Reached target Preparation for Local File Systems.1993worker1 # [ 1.853176] systemd[1]: Reached target Local File Systems.1994worker1 # [ 1.856095] systemd[1]: Starting Create System Files and Directories...1995lb # [ 1.857130] systemd[1]: Started Rule-based Manager for Device Events and Files.1996worker1 # [ 1.862476] systemd[1]: Starting Rule-based Manager for Device Events and Files...1997worker2 # [ 1.851352] systemd-udevd[77]: Using default interface naming scheme 'v261'.1998client # [ 1.842589] systemd[1]: Started Rule-based Manager for Device Events and Files.1999worker2 # [ 1.876324] systemd[1]: Started Rule-based Manager for Device Events and Files.2000worker1 # [ 1.891374] systemd[1]: Finished Create System Files and Directories.
loading 1,902 hidden lines…
3903worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3904worker2: waiting for unit network-addresses-eth1.service3905worker2: waiting for the VM to finish booting3906worker2: Guest shell says: b'Spawning backdoor root shell...\n'3907worker2: connected to guest root shell3908worker2: (connecting took 0.00 seconds)3909worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3910worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3911worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3912worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3913lb: waiting for unit niks3.service3914lb # [ 11.868549] dhcpcd[717]: eth0: soliciting an IPv6 router3915lb # [ 11.869339] dhcpcd[717]: eth0: Router Advertisement from fe80::23916lb # [ 11.870113] dhcpcd[717]: eth0: adding address fec0::5054:ff:fe12:3456/643917lb # [ 11.871186] dhcpcd[717]: eth0: adding route to fec0::/643918lb # [ 11.872062] dhcpcd[717]: eth0: adding default route via fe80::23919worker2 # [ 11.893477] dhcpcd[693]: eth0: soliciting an IPv6 router3920worker2 # [ 11.896457] dhcpcd[693]: eth0: Router Advertisement from fe80::23921worker2 # [ 11.898548] dhcpcd[693]: eth0: adding address fec0::5054:ff:fe12:3456/643922worker2 # [ 11.900713] dhcpcd[693]: eth0: adding route to fec0::/643923worker2 # [ 11.902619] dhcpcd[693]: eth0: adding default route via fe80::23924lb # [ 12.061274] dhcpcd[717]: eth0: soliciting a DHCP lease3925lb # [ 12.215461] NET: Registered PF_PACKET protocol family3926lb # [ 12.087335] dhcpcd[717]: eth0: offered 10.0.2.15 from 10.0.2.23927lb # [ 12.090160] dhcpcd[717]: eth0: probing address 10.0.2.15/243928lb # [ 12.260584] postgresql-pre-start[729]: selecting default time zone ... UTC3929lb # [ 12.265065] postgresql-pre-start[729]: creating configuration files ... ok3930lb # [ 12.474167] postgresql-pre-start[729]: running bootstrap script ... ok3931worker1 # [ 12.792669] dhcpcd[698]: eth0: soliciting a DHCP lease3932worker1 # [ 12.951532] NET: Registered PF_PACKET protocol family3933worker1 # [ 12.820941] dhcpcd[698]: eth0: offered 10.0.2.15 from 10.0.2.23934worker1 # [ 12.826141] dhcpcd[698]: eth0: probing address 10.0.2.15/243935lb # [ 13.038090] postgresql-pre-start[729]: performing post-bootstrap initialization ... ok3936lb # [ 13.164835] postgresql-pre-start[729]: syncing data to disk ... ok3937lb # [ 13.165843] postgresql-pre-start[729]: initdb: warning: enabling "trust" authentication for local connections3938lb # [ 13.167164] postgresql-pre-start[729]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3939lb # [ 13.169071] postgresql-pre-start[729]: Success. You can now start the database server using:3940lb # [ 13.170072] postgresql-pre-start[729]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3941worker1 # [ 13.283046] dhcpcd[698]: eth0: soliciting an IPv6 router3942worker1 # [ 13.284328] dhcpcd[698]: eth0: Router Advertisement from fe80::23943worker1 # [ 13.285393] dhcpcd[698]: eth0: adding address fec0::5054:ff:fe12:3456/643944worker1 # [ 13.286597] dhcpcd[698]: eth0: adding route to fec0::/643945worker1 # [ 13.287367] dhcpcd[698]: eth0: adding default route via fe80::23946lb # [ 13.291671] postgres[798]: [798] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3947lb # [ 13.297355] postgres[798]: [798] LOG: listening on IPv6 address "::1", port 54323948lb # [ 13.298394] postgres[798]: [798] LOG: listening on IPv4 address "127.0.0.1", port 54323949lb # [ 13.301080] postgres[798]: [798] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3950lb # [ 13.315467] postgres[807]: [807] LOG: database system was shut down at 2026-09-20 09:32:19 GMT3951lb # [ 13.320688] postgres[798]: [798] LOG: database system is ready to accept connections3952lb # [ 13.325658] systemd[1]: Started PostgreSQL Server.3953lb # [ 13.331746] systemd[1]: Starting PostgreSQL Setup Scripts...3954lb # [ 13.529611] postgresql-setup-start[818]: CREATE DATABASE3955lb # [ 13.576964] postgresql-setup-start[823]: CREATE ROLE3956lb # [ 13.597532] postgresql-setup-start[825]: ALTER DATABASE3957lb # [ 13.602843] systemd[1]: Finished PostgreSQL Setup Scripts.3958lb # [ 13.604474] systemd[1]: Reached target PostgreSQL.3959client # [ 15.489581] dhcpcd[562]: eth0: leased 10.0.2.15 for 86400 seconds3960client # [ 15.492350] dhcpcd[562]: eth0: adding route to 10.0.2.0/243961client # [ 15.494783] dhcpcd[562]: eth0: adding default route via 10.0.2.23962client # [ 15.614695] systemd[1]: Started DHCP Client.3963client # [ 15.616668] systemd[1]: Reached target Multi-User System.3964client # [ 15.617662] systemd[1]: Startup finished in 854ms (kernel) + 3.936s (initrd) + 10.826s (userspace) = 15.617s.3965worker2 # [ 16.013242] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds3966worker2 # [ 16.015889] dhcpcd[693]: eth0: adding route to 10.0.2.0/243967worker2 # [ 16.018140] dhcpcd[693]: eth0: adding default route via 10.0.2.23968worker2 # [ 16.141877] systemd[1]: Started DHCP Client.3969worker2 # [ 16.143820] systemd[1]: Reached target Multi-User System.3970worker2 # [ 16.144747] systemd[1]: Startup finished in 874ms (kernel) + 3.975s (initrd) + 11.294s (userspace) = 16.143s.3971lb # [ 17.254402] dhcpcd[717]: eth0: leased 10.0.2.15 for 86400 seconds3972lb # [ 17.256127] dhcpcd[717]: eth0: adding route to 10.0.2.0/243973lb # [ 17.256993] dhcpcd[717]: eth0: adding default route via 10.0.2.23974lb # [ 17.356729] systemd[1]: Started DHCP Client.3975lb # [ 17.359240] systemd[1]: Reached target Network is Online.3976lb # [ 17.362850] systemd[1]: Started Envoy reverse proxy.3977lb # [ 17.366363] systemd[1]: Started mock-oidc.service.3978lb # [ 17.469175] mock-oidc-server[921]: Mock OIDC Server running3979lb # [ 17.470173] mock-oidc-server[921]: OIDC Address: 192.168.1.2:80803980lb # [ 17.471419] mock-oidc-server[921]: Issue Address: 0.0.0.0:80813981lb # [ 17.472469] mock-oidc-server[921]: Issuer: http://192.168.1.2:8080/oidc3982lb # [ 17.473434] mock-oidc-server[921]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3983lb # [ 17.474662] mock-oidc-server[921]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3984lb # [ 17.476140] mock-oidc-server[921]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3985lb # [ 17.905268] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3986lb # [ 17.907083] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:469] statically linked extensions:3987lb # [ 17.908488] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3988lb # [ 17.911066] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3989lb # [ 17.913627] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3990lb # [ 17.916341] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3991lb # [ 17.919520] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3992lb # [ 17.921333] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3993lb # [ 17.923066] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23994lb # [ 17.924866] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3995lb # [ 17.926416] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3996lb # [ 17.928707] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3997lb # [ 17.930966] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3998lb # [ 17.932817] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3999lb # [ 17.934577] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4000lb # [ 17.952059] envoy[920]: [2026-09-20 09:32:24.869][920][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4001lb # [ 17.953669] envoy[920]: [2026-09-20 09:32:24.875][920][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4002lb # [ 17.955254] envoy[920]: [2026-09-20 09:32:24.875][920][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4003lb # [ 17.956910] envoy[920]: [2026-09-20 09:32:24.875][920][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4004lb # [ 17.963166] envoy[920]: [2026-09-20 09:32:24.875][920][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4005lb # [ 17.964831] envoy[920]: [2026-09-20 09:32:24.875][920][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4006lb # [ 17.967122] envoy[920]: [2026-09-20 09:32:24.875][920][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4007lb # [ 17.968893] envoy[920]: [2026-09-20 09:32:24.875][920][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4008lb # [ 17.970958] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4009lb # [ 17.973080] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4010lb # [ 17.975453] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4011lb # [ 17.979301] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4012lb # [ 17.981051] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4013lb # [ 17.982721] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4014lb # [ 17.985177] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4015lb # [ 17.986869] envoy[920]: [2026-09-20 09:32:24.878][920][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4016lb # [ 17.988629] envoy[920]: [2026-09-20 09:32:24.880][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4017lb # [ 17.992387] envoy[920]: [2026-09-20 09:32:24.880][920][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4018lb # [ 17.994301] envoy[920]: [2026-09-20 09:32:24.880][920][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4019lb # [ 17.996616] envoy[920]: [2026-09-20 09:32:24.880][920][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4020lb # [ 17.998115] envoy[920]: [2026-09-20 09:32:24.880][920][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4021lb # [ 18.000719] envoy[920]: [2026-09-20 09:32:24.880][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4022lb # [ 18.003225] envoy[920]: [2026-09-20 09:32:24.880][920][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4023lb # [ 18.005563] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4024lb # [ 18.008517] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4025lb # [ 18.012608] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4026lb # [ 18.015674] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4027lb # [ 18.017993] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4028lb # [ 18.019891] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4029lb # [ 18.022687] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4030lb # [ 18.024312] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4031lb # [ 18.026256] envoy[920]: [2026-09-20 09:32:24.883][920][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4032lb # [ 18.032667] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4033lb # [ 18.034938] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4034lb # [ 18.042948] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4035lb # [ 18.045242] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4036lb # [ 18.049547] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4037lb # [ 18.051483] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4038lb # [ 18.053857] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4039lb # [ 18.058342] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4040lb # [ 18.060132] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4041lb # [ 18.061628] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4042lb # [ 18.063332] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4043lb # [ 18.065081] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4044lb # [ 18.068280] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4045lb # [ 18.071106] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4046lb # [ 18.073148] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4047lb # [ 18.079057] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4048lb # [ 18.080986] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4049lb # [ 18.084844] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4050lb # [ 18.086763] envoy[920]: [2026-09-20 09:32:24.885][920][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4051lb # [ 18.089425] envoy[920]: [2026-09-20 09:32:24.887][920][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4052lb # [ 18.095412] envoy[920]: [2026-09-20 09:32:24.887][920][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4053lb # [ 18.097738] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4054lb # [ 18.099435] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4055lb # [ 18.103489] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4056lb # [ 18.105118] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4057lb # [ 18.107203] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4058worker1 # [ 18.109502] dhcpcd[698]: eth0: leased 10.0.2.15 for 86400 seconds4059lb # [ 18.109190] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4060worker1 # [ 18.110838] dhcpcd[698]: eth0: adding route to 10.0.2.0/244061worker1 # [ 18.111868] dhcpcd[698]: eth0: adding default route via 10.0.2.24062lb # [ 18.110756] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4063lb # [ 18.112505] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4064lb # [ 18.114900] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4065lb # [ 18.120118] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84066lb # [ 18.121937] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4067lb # [ 18.125162] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4068lb # [ 18.149940] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4069lb # [ 18.152897] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4070lb # [ 18.155170] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4071lb # [ 18.165887] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24072lb # [ 18.167388] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4073lb # [ 18.168878] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4074lb # [ 18.170681] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4075lb # [ 18.172849] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4076lb # [ 18.175029] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14077lb # [ 18.177097] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4078lb # [ 18.178746] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4079lb # [ 18.180780] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4080lb # [ 18.183178] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4081lb # [ 18.186221] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4082lb # [ 18.190600] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24083lb # [ 18.192783] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4084lb # [ 18.194936] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4085lb # [ 18.196823] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4086lb # [ 18.198572] envoy[920]: [2026-09-20 09:32:24.889][920][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4087lb # [ 18.200806] envoy[920]: [2026-09-20 09:32:24.908][920][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4088worker1 # [ 18.203726] systemd[1]: Started DHCP Client.4089worker1 # [ 18.205258] systemd[1]: Reached target Multi-User System.4090worker1 # [ 18.205993] systemd[1]: Startup finished in 874ms (kernel) + 4.988s (initrd) + 12.342s (userspace) = 18.204s.4091lb # [ 18.203434] envoy[920]: [2026-09-20 09:32:24.908][920][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4092lb # [ 18.207844] envoy[920]: [2026-09-20 09:32:24.908][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4093lb # [ 18.210485] envoy[920]: [2026-09-20 09:32:24.908][920][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4094lb # [ 18.215987] envoy[920]: [2026-09-20 09:32:24.908][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4095lb # [ 18.217676] envoy[920]: [2026-09-20 09:32:24.908][920][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4096lb # [ 18.219784] envoy[920]: [2026-09-20 09:32:24.908][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4097lb # [ 18.221268] envoy[920]: [2026-09-20 09:32:25.045][920][info][main] [source/server/server.cc:531] HTTP header map info:4098lb # [ 18.222631] envoy[920]: [2026-09-20 09:32:25.086][920][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4099lb # [ 18.235245] envoy[920]: [2026-09-20 09:32:25.086][920][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4100lb # [ 18.236817] envoy[920]: [2026-09-20 09:32:25.086][920][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4101lb # [ 18.244195] envoy[920]: [2026-09-20 09:32:25.086][920][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4102lb # [ 18.281024] envoy[920]: [2026-09-20 09:32:25.245][920][info][main] [source/server/server.cc:968] runtime: {}4103lb # [ 18.287790] envoy[920]: [2026-09-20 09:32:25.252][920][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4104lb # [ 18.290162] envoy[920]: [2026-09-20 09:32:25.254][920][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014105lb # [ 18.292853] envoy[920]: [2026-09-20 09:32:25.257][920][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014106lb # [ 18.295583] envoy[920]: [2026-09-20 09:32:25.260][920][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4107lb # [ 18.297361] envoy[920]: [2026-09-20 09:32:25.262][920][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4108lb # [ 18.299118] envoy[920]: [2026-09-20 09:32:25.262][920][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4109lb # [ 18.357060] envoy[920]: [2026-09-20 09:32:25.321][920][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4110worker1 # [ 18.360511] systemd[1]: Starting Nix worker-protocol over gRPC...4111worker2 # [ 18.351884] systemd[1]: Starting Nix worker-protocol over gRPC...4112lb # [ 18.381126] envoy[920]: [2026-09-20 09:32:25.345][920][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4113lb # [ 18.383442] envoy[920]: [2026-09-20 09:32:25.348][920][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4114lb # [ 18.386241] envoy[920]: [2026-09-20 09:32:25.350][920][info][main] [source/server/server.cc:1077] starting main dispatch loop4115worker2 # [ 18.552440] nix-grpc-daemon[787]: ts=2026-09-20T09:32:24Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4116worker2 # [ 18.563251] nix-grpc-daemon[787]: ts=2026-09-20T09:32:24Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14117worker1 # [ 18.580687] nix-grpc-daemon[789]: ts=2026-09-20T09:32:24Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4118worker1 # [ 18.591778] nix-grpc-daemon[789]: ts=2026-09-20T09:32:24Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14119worker2 # [ 18.602832] nix-grpc-daemon[787]: ts=2026-09-20T09:32:24Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4120worker2 # [ 18.607085] systemd[1]: Started Nix worker-protocol over gRPC.4121worker1 # [ 18.630374] nix-grpc-daemon[789]: ts=2026-09-20T09:32:24Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4122worker1 # [ 18.633284] systemd[1]: Started Nix worker-protocol over gRPC.4123lb # [ 18.672139] envoy[920]: [2026-09-20 09:32:25.636][920][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4124lb # [ 18.676679] envoy[920]: [2026-09-20 09:32:25.641][920][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4125lb # [ 18.681281] envoy[920]: [2026-09-20 09:32:25.641][920][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4126lb # [ 18.686114] envoy[920]: [2026-09-20 09:32:25.645][920][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4127worker2 # [ 18.675303] nix-grpc-daemon[787]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4128worker1 # [ 18.709331] nix-grpc-daemon[789]: ts=2026-09-20T09:32:24Z level=info event=scheduler_connected addr=lb:500514129worker1 # [ 18.719869] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4130worker2 # [ 18.876769] nix-grpc-daemon[787]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4131worker1 # [ 18.920607] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_connected addr=lb:500514132worker1 # [ 18.922379] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4133worker1 # [ 19.123241] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_connected addr=lb:500514134worker1 # [ 19.127176] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4135worker2 # [ 19.277430] nix-grpc-daemon[787]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4136worker1 # [ 19.328059] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_connected addr=lb:500514137worker1 # [ 19.331948] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4138worker1 # [ 19.532724] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_connected addr=lb:500514139worker1 # [ 19.536486] nix-grpc-daemon[789]: ts=2026-09-20T09:32:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4140worker1 # [ 19.738579] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 19.741835] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4142worker1 # [ 19.939232] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514143worker1 # [ 19.943310] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4144worker2 # [ 20.081467] nix-grpc-daemon[787]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514145worker2 # [ 20.086326] nix-grpc-daemon[787]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4146worker1 # [ 20.143713] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514147worker1 # [ 20.147529] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4148worker2 # [ 20.287436] nix-grpc-daemon[787]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514149worker2 # [ 20.291156] nix-grpc-daemon[787]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4150worker1 # [ 20.348425] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514151worker1 # [ 20.352316] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4152worker2 # [ 20.491963] nix-grpc-daemon[787]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514153worker2 # [ 20.495729] nix-grpc-daemon[787]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4154worker1 # [ 20.553258] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_connected addr=lb:500514155worker1 # [ 20.557173] nix-grpc-daemon[789]: ts=2026-09-20T09:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4156worker2 # [ 20.696444] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514157worker2 # [ 20.700805] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4158worker1 # [ 20.759153] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514159worker1 # [ 20.762337] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4160worker2 # [ 20.901668] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514161worker2 # [ 20.905948] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4162worker1 # [ 20.960404] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514163worker1 # [ 20.964663] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4164worker2 # [ 21.107294] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514165worker2 # [ 21.111512] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4166worker1 # [ 21.165232] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514167worker1 # [ 21.169142] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4168worker2 # [ 21.312497] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514169worker2 # [ 21.315496] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4170worker1 # [ 21.370181] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514171worker1 # [ 21.374097] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4172worker2 # [ 21.516331] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514173worker2 # [ 21.519521] nix-grpc-daemon[787]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4174worker1 # [ 21.574800] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500514175worker1 # [ 21.578606] nix-grpc-daemon[789]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4176worker2 # [ 21.720422] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 21.724092] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4178worker1 # [ 21.780862] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514179worker1 # [ 21.784092] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4180worker2 # [ 21.924808] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 21.928579] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4182worker1 # [ 21.981643] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514183worker1 # [ 21.985765] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4184worker2 # [ 22.129436] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514185worker2 # [ 22.131124] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4186worker1 # [ 22.186663] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514187worker1 # [ 22.190579] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4188worker2 # [ 22.332102] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514189worker2 # [ 22.336105] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4190worker1 # [ 22.391333] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514191worker1 # [ 22.395305] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4192worker2 # [ 22.536926] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514193worker2 # [ 22.540696] nix-grpc-daemon[787]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4194worker1 # [ 22.596253] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500514195worker1 # [ 22.600284] nix-grpc-daemon[789]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4196worker2 # [ 22.741781] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514197worker2 # [ 22.745513] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4198worker1 # [ 22.802160] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514199worker1 # [ 22.805417] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4200worker2 # [ 22.943533] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 22.947327] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4202worker1 # [ 23.002903] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514203worker1 # [ 23.006910] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4204worker2 # [ 23.148990] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514205worker2 # [ 23.152725] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4206worker1 # [ 23.207587] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514207worker1 # [ 23.211379] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4208worker2 # [ 23.353731] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514209worker2 # [ 23.357763] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4210worker1 # [ 23.412418] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 23.416194] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4212worker2 # [ 23.558651] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514213worker2 # [ 23.562564] nix-grpc-daemon[787]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4214worker1 # [ 23.616851] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500514215worker1 # [ 23.621236] nix-grpc-daemon[789]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4216worker2 # [ 23.763677] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514217worker2 # [ 23.768131] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4218worker1 # [ 23.823256] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514219worker1 # [ 23.826507] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4220worker2 # [ 23.969177] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514221worker2 # [ 23.973888] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4222worker1 # [ 24.023685] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514223worker1 # [ 24.027596] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4224worker2 # [ 24.175985] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 24.179168] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4226worker1 # [ 24.228117] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514227worker1 # [ 24.230218] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4228worker2 # [ 24.376694] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514229worker2 # [ 24.380354] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4230worker1 # [ 24.430768] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514231worker1 # [ 24.432536] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4232worker2 # [ 24.581406] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514233worker2 # [ 24.585059] nix-grpc-daemon[787]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4234worker1 # [ 24.633150] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500514235worker1 # [ 24.634912] nix-grpc-daemon[789]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4236worker2 # [ 24.785734] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 24.789740] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4238worker1 # [ 24.837281] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514239worker1 # [ 24.840416] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4240worker2 # [ 24.990660] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 24.994500] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4242worker1 # [ 25.038477] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514243worker1 # [ 25.042363] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4244worker2 # [ 25.196829] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514245worker2 # [ 25.199874] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4246worker1 # [ 25.243088] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514247worker1 # [ 25.246914] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4248worker2 # [ 25.398071] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 25.402494] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4250worker1 # [ 25.447762] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514251worker1 # [ 25.451956] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4252worker2 # [ 25.603178] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514253worker2 # [ 25.607190] nix-grpc-daemon[787]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4254worker1 # [ 25.652279] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500514255worker1 # [ 25.654080] nix-grpc-daemon[789]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4256worker2 # [ 25.808247] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514257worker2 # [ 25.812358] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4258worker1 # [ 25.856748] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514259worker1 # [ 25.860319] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4260worker2 # [ 26.012439] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 26.014184] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4262worker1 # [ 26.057191] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514263worker1 # [ 26.058877] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4264worker2 # [ 26.215915] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514265worker2 # [ 26.219888] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4266worker1 # [ 26.259482] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514267worker1 # [ 26.261187] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4268worker2 # [ 26.417613] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 26.421478] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4270worker1 # [ 26.461695] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514271worker1 # [ 26.463624] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4272worker2 # [ 26.622402] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514273worker2 # [ 26.626134] nix-grpc-daemon[787]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4274worker1 # [ 26.664229] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500514275worker1 # [ 26.665997] nix-grpc-daemon[789]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4276worker2 # [ 26.826916] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514277worker2 # [ 26.831059] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4278worker1 # [ 26.866717] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514279worker1 # [ 26.868337] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4280worker2 # [ 27.031908] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514281worker2 # [ 27.035707] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4282worker1 # [ 27.069481] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514283worker1 # [ 27.073340] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4284worker2 # [ 27.237416] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514285worker2 # [ 27.241135] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4286worker1 # [ 27.271086] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514287worker1 # [ 27.274829] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4288worker2 # [ 27.442054] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514289worker2 # [ 27.446055] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4290worker1 # [ 27.475545] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514291worker1 # [ 27.478566] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4292worker2 # [ 27.646629] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514293worker2 # [ 27.648645] nix-grpc-daemon[787]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4294worker1 # [ 27.679347] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500514295worker1 # [ 27.683072] nix-grpc-daemon[789]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4296lb # [ 27.777260] rustfs-bucket-start[1021]: mb s3://farm4297lb # [ 27.783133] systemd[1]: Finished rustfs-bucket.service.4298lb # [ 27.789624] systemd[1]: Starting niks3 server...4299worker2 # [ 27.849304] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514300worker2 # [ 27.851144] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4301worker1 # [ 27.885308] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514302worker1 # [ 27.888420] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4303lb # [ 27.998745] postgres[1037]: [1037] ERROR: relation "goose_db_version" does not exist at character 364304lb # [ 27.999944] postgres[1037]: [1037] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4305lb # [ 28.037732] niks3-server[1030]: 2026/09/20 09:32:35 OK 20241026095416_initial_model.sql (19.64ms)4306lb # [ 28.041722] niks3-server[1030]: 2026/09/20 09:32:35 OK 20251210153512_drop_unused_gin_index.sql (4.78ms)4307lb # [ 28.048814] niks3-server[1030]: 2026/09/20 09:32:35 OK 20251218171726_add_pins.sql (7.01ms)4308lb # [ 28.056252] niks3-server[1030]: 2026/09/20 09:32:35 OK 20260628120000_add_object_size_and_stats.sql (7.41ms)4309lb # [ 28.062063] niks3-server[1030]: 2026/09/20 09:32:35 OK 20260905000000_add_claims.sql (5.79ms)4310worker2 # [ 28.051676] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514311worker2 # [ 28.053488] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4312lb # [ 28.067438] niks3-server[1030]: 2026/09/20 09:32:35 OK 20260920000000_drop_claims.sql (5.4ms)4313lb # [ 28.069450] niks3-server[1030]: 2026/09/20 09:32:35 goose: successfully migrated database to version: 202609200000004314lb # [ 28.074744] niks3-server[1030]: 2026/09/20 09:32:35 OK 1_commit_pending_closure.sql (6.42ms)4315lb # [ 28.078248] niks3-server[1030]: 2026/09/20 09:32:35 OK 2_object_stats_trigger.sql (3.5ms)4316lb # [ 28.080088] niks3-server[1030]: 2026/09/20 09:32:35 goose: up to current file version: 24317worker1 # [ 28.085239] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514318worker1 # [ 28.086926] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4319lb # [ 28.086910] niks3-server[1030]: 2026/09/20 09:32:35 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4320lb # [ 28.157817] niks3-server[1030]: 2026/09/20 09:32:35 INFO Read proxy enabled — serving cache objects from S34321lb # [ 28.159882] niks3-server[1030]: 2026/09/20 09:32:35 INFO Using socket-activated listener address=0.0.0.0:57514322lb # [ 28.164782] systemd[1]: Started niks3 server.4323lb # [ 28.165436] niks3-server[1030]: 2026/09/20 09:32:35 INFO systemd watchdog enabled interval=15s4324lb # [ 28.166607] systemd[1]: Reached target Multi-User System.4325lb # [ 28.168581] systemd[1]: Startup finished in 862ms (kernel) + 4.032s (initrd) + 23.273s (userspace) = 28.168s.4326lb # [ 28.170565] niks3-server[1030]: 2026/09/20 09:32:35 INFO Starting HTTP server address=0.0.0.0:57514327lb # [ 28.178069] niks3-server[1030]: 2026/09/20 09:32:35 INFO lead: acquired remote=192.168.1.3:480584328worker1 # [ 28.185268] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_take_over4329worker2 # [ 28.254525] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514330worker2 # [ 28.256150] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4331worker1 # [ 28.287459] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514332worker1 # [ 28.289268] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4333worker2 # [ 28.456629] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514334worker2 # [ 28.458406] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4335worker1 # [ 28.489925] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514336worker1 # [ 28.491633] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4337worker2 # [ 28.658967] nix-grpc-daemon[787]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514338worker2 # [ 28.660574] nix-grpc-daemon[787]: ts=2026-09-20T09:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4339worker1 # [ 28.692143] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500514340worker1 # [ 28.693856] nix-grpc-daemon[789]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4341worker2 # [ 28.861596] nix-grpc-daemon[787]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514342worker1 # [ 28.886318] nix-grpc-daemon[789]: ts=2026-09-20T09:32:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04343worker1 # [ 28.894140] nix-grpc-daemon[789]: ts=2026-09-20T09:32:35Z level=info event=scheduler_connected addr=lb:500514344worker1 # [ 28.895676] nix-grpc-daemon[789]: ts=2026-09-20T09:32:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04345lb: (finished: waiting for unit niks3.service, in 17.39 seconds)4346lb: waiting for TCP port 5751 on localhost4347lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4348lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4349lb: waiting for unit envoy.service4350lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4351lb: waiting for TCP port 50051 on localhost4352lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4353lb # [ 29.349544] envoy[920]: conn peer=[::1]:40378 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24354lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4355lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4356??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4357 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284358lb: must succeed: curl -sf localhost:9901/clusters4359lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4360lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4361subtest: one node schedules and both builders hold a WorkerSession on it4362lb: must succeed: curl -sf localhost:9901/clusters4363lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4364worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4365worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4366(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.12 seconds)4367subtest: balancer auth: client cert, bearer token, nothing, unknown CN4368worker2 # [ 29.942970] nix-grpc-daemon[787]: ts=2026-09-20T09:32:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:428764369worker2 # [ 29.954568] systemd[1]: Started Nix Daemon.4370worker2 # [ 30.156731] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4371worker2 # [ 30.209316] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5)4372worker2 # [ 30.285785] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 149 ms (attempt 2/5)4373worker2 # [ 30.439905] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 237 ms (attempt 3/5)4374worker2 # [ 30.682887] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 4/5)4375worker2 # [ 30.750168] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4376worker2 # [ 30.787365] nix-grpc-daemon[787]: ts=2026-09-20T09:32:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:428764377worker2 # [ 30.806169] nix-grpc-daemon[787]: ts=2026-09-20T09:32:37Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4378worker1 # [ 30.835826] nix-grpc-daemon[789]: ts=2026-09-20T09:32:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:466284379worker1 # [ 30.849860] systemd[1]: Started Nix Daemon.4380worker1 # [ 31.067257] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4381worker1 # [ 31.092601] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 1/5)4382worker1 # [ 31.122070] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 2/5)4383worker1 # [ 31.235849] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 217 ms (attempt 3/5)4384worker1 # [ 31.458806] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 410 ms (attempt 4/5)4385worker1 # [ 31.881567] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4386worker1 # [ 31.898169] nix-grpc-daemon[789]: ts=2026-09-20T09:32:38Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4387client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4388client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)4389client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4390client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4391worker1 # [ 32.277738] nix-grpc-daemon[789]: ts=2026-09-20T09:32:38Z level=info event=oidc_jwks provider=mock keys=14392worker1 # [ 32.283611] nix-grpc-daemon[789]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:466284393worker1 # [ 32.304466] nix-grpc-daemon[789]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:466284394worker1 # [ 32.313971] nix-grpc-daemon[789]: ts=2026-09-20T09:32:38Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4395worker2 # [ 32.316988] nix-grpc-daemon[787]: ts=2026-09-20T09:32:38Z level=info event=oidc_jwks provider=mock keys=14396worker2 # [ 32.319898] nix-grpc-daemon[787]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:428764397worker2 # [ 32.327215] nix-grpc-daemon[787]: ts=2026-09-20T09:32:38Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4398client: must succeed: rm -r /var/lib/nix-grpc-store4399client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4400worker1 # [ 32.562827] nix-grpc-daemon[789]: ts=2026-09-20T09:32:38Z level=info event=denied method=QueryMissing cn=- role=none4401worker1 # [ 32.755697] nix-grpc-daemon[789]: ts=2026-09-20T09:32:39Z level=info event=denied method=QueryMissing cn=stranger role=none4402(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.08 seconds)4403subtest: DAG build is scheduled across workers and lands in the cache4404client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24405worker1 # [ 32.948801] nix-grpc-daemon[789]: ts=2026-09-20T09:32:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:466284406client # don't know how to build these paths:4407client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4408worker1 # [ 32.961663] nix-grpc-daemon[789]: ts=2026-09-20T09:32:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284409worker1 # [ 32.994403] nix-grpc-daemon[789]: ts=2026-09-20T09:32:39Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04410worker1 # [ 32.998802] nix-grpc-daemon[789]: ts=2026-09-20T09:32:39Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14411worker2 # [ 33.031892] nix-grpc-daemon[787]: ts=2026-09-20T09:32:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764412worker2 # [ 33.054269] nix-grpc-daemon[787]: ts=2026-09-20T09:32:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764413client # copying 1 paths to 'lb:50051'...4414worker2 # [ 33.067215] nix-grpc-daemon[787]: ts=2026-09-20T09:32:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428764415client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4416worker2 # [ 33.095942] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4417worker2 # [ 33.121501] nix-grpc-daemon[787]: ts=2026-09-20T09:32:39Z level=info event=niks3_push_started pid=8554418worker2 # [ 33.566542] nix-daemon[845]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4419worker2 # [ 33.581645] nix-daemon[845]: reaped child process 870, status = succeeded4420worker2 # [ 33.726515] nix-daemon[845]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4421worker2 # [ 33.739658] nix-daemon[845]: reaped child process 875, status = succeeded4422lb # [ 33.763759] niks3-server[1030]: 2026/09/20 09:32:40 INFO Received uploads request method=POST path=/api/pending_closures4423worker2 # [ 33.780300] nix-grpc-daemon[855]: time=2026-09-20T09:32:40.118Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4424worker2 # [ 33.784093] nix-grpc-daemon[855]: time=2026-09-20T09:32:40.122Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4425lb # [ 33.824339] niks3-server[1030]: 2026/09/20 09:32:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4426lb # [ 33.832919] niks3-server[1030]: 2026/09/20 09:32:40 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4427lb # [ 33.843418] niks3-server[1030]: 2026/09/20 09:32:40 INFO Signed narinfos id=1 count=14428worker2 # [ 33.832489] nix-grpc-daemon[855]: time=2026-09-20T09:32:40.172Z level=INFO msg="Uploading 1 narinfos"4429lb # [ 33.854668] niks3-server[1030]: 2026/09/20 09:32:40 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4430lb # [ 33.857274] niks3-server[1030]: 2026/09/20 09:32:40 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4431lb # [ 33.863648] niks3-server[1030]: 2026/09/20 09:32:40 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4432lb # [ 33.871175] niks3-server[1030]: 2026/09/20 09:32:40 INFO Completed upload id=14433worker2 # [ 33.860043] nix-grpc-daemon[855]: time=2026-09-20T09:32:40.199Z level=INFO msg="Upload complete. (453ms)"4434worker2 # [ 33.866337] nix-grpc-daemon[787]: ts=2026-09-20T09:32:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_in=5044435worker2 # [ 33.872335] nix-grpc-daemon[787]: ts=2026-09-20T09:32:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764436worker2 # [ 33.883435] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4437worker2 # [ 33.890723] nix-daemon[845]: reaped child process 853, status = succeeded4438client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4439client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4440worker2 # [ 33.898227] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4441client # farm-a> LOG-farm-a-t14442worker2 # [ 35.311177] nix-daemon[845]: reaped child process 879, status = succeeded4443worker2 # [ 35.464671] nix-daemon[845]: accepted connection from pid 894, user nix-grpc-daemon (trusted)4444worker2 # [ 35.479590] nix-daemon[845]: reaped child process 897, status = succeeded4445lb # [ 35.504829] niks3-server[1030]: 2026/09/20 09:32:42 INFO Received uploads request method=POST path=/api/pending_closures4446worker2 # [ 35.503388] nix-grpc-daemon[855]: time=2026-09-20T09:32:41.842Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4447worker2 # [ 35.506118] nix-grpc-daemon[855]: time=2026-09-20T09:32:41.843Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4448lb # [ 35.550199] niks3-server[1030]: 2026/09/20 09:32:42 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4449lb # [ 35.562687] niks3-server[1030]: 2026/09/20 09:32:42 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4450lb # [ 35.575286] niks3-server[1030]: 2026/09/20 09:32:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4451lb # [ 35.578360] niks3-server[1030]: 2026/09/20 09:32:42 INFO Signed narinfos id=2 count=14452lb # [ 35.583392] niks3-server[1030]: 2026/09/20 09:32:42 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4453worker2 # [ 35.571121] nix-grpc-daemon[855]: time=2026-09-20T09:32:41.909Z level=INFO msg="Uploading 1 narinfos"4454lb # [ 35.593040] niks3-server[1030]: 2026/09/20 09:32:42 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4455lb # [ 35.596533] niks3-server[1030]: 2026/09/20 09:32:42 INFO Completed upload id=24456worker2 # [ 35.584179] nix-grpc-daemon[855]: time=2026-09-20T09:32:41.923Z level=INFO msg="Upload complete. (278ms)"4457lb # [ 35.598019] niks3-server[1030]: 2026/09/20 09:32:42 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4458worker2 # [ 35.589980] nix-grpc-daemon[787]: ts=2026-09-20T09:32:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14459worker1 # [ 35.614726] nix-grpc-daemon[789]: ts=2026-09-20T09:32:41Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04460worker2 # [ 35.602541] nix-daemon[845]: reaped child process 877, status = succeeded4461worker1 # [ 35.616588] nix-grpc-daemon[789]: ts=2026-09-20T09:32:41Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14462worker2 # [ 35.651633] nix-grpc-daemon[787]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764463worker2 # [ 35.662725] nix-grpc-daemon[787]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764464worker2 # [ 35.674310] nix-grpc-daemon[855]: time=2026-09-20T09:32:42.013Z level=INFO msg="All 1 paths already cached"4465client # copying 1 paths to 'lb:50051'...4466worker2 # [ 35.681893] nix-grpc-daemon[787]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428764467client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4468worker2 # [ 35.699699] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4469worker2 # [ 35.864669] nix-daemon[845]: accepted connection from pid 902, user nix-grpc-daemon (trusted)4470worker2 # [ 35.877913] nix-daemon[845]: reaped child process 905, status = succeeded4471worker2 # [ 36.024418] nix-daemon[845]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4472worker2 # [ 36.035819] nix-daemon[845]: reaped child process 911, status = succeeded4473lb # [ 36.062429] niks3-server[1030]: 2026/09/20 09:32:43 INFO Received uploads request method=POST path=/api/pending_closures4474worker2 # [ 36.061867] nix-grpc-daemon[855]: time=2026-09-20T09:32:42.401Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4475worker2 # [ 36.063757] nix-grpc-daemon[855]: time=2026-09-20T09:32:42.403Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4476lb # [ 36.094211] niks3-server[1030]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4477lb # [ 36.106285] niks3-server[1030]: 2026/09/20 09:32:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4478worker2 # [ 36.101087] nix-grpc-daemon[855]: time=2026-09-20T09:32:42.440Z level=INFO msg="Uploading 1 narinfos"4479lb # [ 36.113510] niks3-server[1030]: 2026/09/20 09:32:43 INFO Signed narinfos id=3 count=14480lb # [ 36.118056] niks3-server[1030]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4481lb # [ 36.127578] niks3-server[1030]: 2026/09/20 09:32:43 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4482worker2 # [ 36.122403] nix-grpc-daemon[855]: time=2026-09-20T09:32:42.462Z level=INFO msg="Upload complete. (407ms)"4483lb # [ 36.134941] niks3-server[1030]: 2026/09/20 09:32:43 INFO Completed upload id=34484worker2 # [ 36.124505] nix-grpc-daemon[787]: ts=2026-09-20T09:32:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_in=6244485lb # [ 36.138958] niks3-server[1030]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4486worker2 # [ 36.128460] nix-grpc-daemon[787]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764487worker2 # [ 36.134531] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4488worker2 # [ 36.136792] nix-daemon[845]: reaped child process 900, status = succeeded4489worker2 # [ 36.141875] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4490client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4491client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4492client # farm-b> LOG-farm-b-t14493worker2 # [ 37.162927] nix-daemon[845]: reaped child process 915, status = succeeded4494worker2 # [ 37.294914] nix-daemon[845]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4495worker2 # [ 37.305768] nix-daemon[845]: reaped child process 933, status = succeeded4496lb # [ 37.331513] niks3-server[1030]: 2026/09/20 09:32:44 INFO Received uploads request method=POST path=/api/pending_closures4497worker2 # [ 37.331675] nix-grpc-daemon[855]: time=2026-09-20T09:32:43.671Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4498worker2 # [ 37.333271] nix-grpc-daemon[855]: time=2026-09-20T09:32:43.672Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4499lb # [ 37.371375] niks3-server[1030]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4500lb # [ 37.382844] niks3-server[1030]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4501lb # [ 37.387564] niks3-server[1030]: 2026/09/20 09:32:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4502lb # [ 37.391819] niks3-server[1030]: 2026/09/20 09:32:44 INFO Signed narinfos id=4 count=14503worker2 # [ 37.381732] nix-grpc-daemon[855]: time=2026-09-20T09:32:43.721Z level=INFO msg="Uploading 1 narinfos"4504lb # [ 37.402411] niks3-server[1030]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4505lb # [ 37.404286] niks3-server[1030]: 2026/09/20 09:32:44 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4506lb # [ 37.408570] niks3-server[1030]: 2026/09/20 09:32:44 INFO Completed upload id=44507worker2 # [ 37.396207] nix-grpc-daemon[855]: time=2026-09-20T09:32:43.735Z level=INFO msg="Upload complete. (247ms)"4508lb # [ 37.409677] niks3-server[1030]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4509worker2 # [ 37.400981] nix-grpc-daemon[787]: ts=2026-09-20T09:32:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14510worker1 # [ 37.421789] nix-grpc-daemon[789]: ts=2026-09-20T09:32:43Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04511worker2 # [ 37.412334] nix-daemon[845]: reaped child process 913, status = succeeded4512worker1 # [ 37.426166] nix-grpc-daemon[789]: ts=2026-09-20T09:32:43Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14513worker2 # [ 37.458817] nix-grpc-daemon[787]: ts=2026-09-20T09:32:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764514worker2 # [ 37.469800] nix-grpc-daemon[787]: ts=2026-09-20T09:32:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764515worker2 # [ 37.481634] nix-grpc-daemon[855]: time=2026-09-20T09:32:43.821Z level=INFO msg="All 2 paths already cached"4516client # copying 1 paths to 'lb:50051'...4517worker2 # [ 37.489642] nix-grpc-daemon[787]: ts=2026-09-20T09:32:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428764518client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4519worker2 # [ 37.507307] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4520worker2 # [ 37.664860] nix-daemon[845]: accepted connection from pid 937, user nix-grpc-daemon (trusted)4521worker2 # [ 37.676949] nix-daemon[845]: reaped child process 940, status = succeeded4522worker2 # [ 37.831842] nix-daemon[845]: accepted connection from pid 942, user nix-grpc-daemon (trusted)4523worker2 # [ 37.843579] nix-daemon[845]: reaped child process 945, status = succeeded4524lb # [ 37.870732] niks3-server[1030]: 2026/09/20 09:32:44 INFO Received uploads request method=POST path=/api/pending_closures4525worker2 # [ 37.866095] nix-grpc-daemon[855]: time=2026-09-20T09:32:44.205Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4526worker2 # [ 37.867575] nix-grpc-daemon[855]: time=2026-09-20T09:32:44.207Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4527lb # [ 37.900211] niks3-server[1030]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4528lb # [ 37.910603] niks3-server[1030]: 2026/09/20 09:32:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4529worker2 # [ 37.902653] nix-grpc-daemon[855]: time=2026-09-20T09:32:44.242Z level=INFO msg="Uploading 1 narinfos"4530lb # [ 37.915161] niks3-server[1030]: 2026/09/20 09:32:44 INFO Signed narinfos id=5 count=14531lb # [ 37.921811] niks3-server[1030]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4532lb # [ 37.931946] niks3-server[1030]: 2026/09/20 09:32:44 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4533lb # [ 37.938052] niks3-server[1030]: 2026/09/20 09:32:44 INFO Completed upload id=54534worker2 # [ 37.925437] nix-grpc-daemon[855]: time=2026-09-20T09:32:44.265Z level=INFO msg="Upload complete. (403ms)"4535worker2 # [ 37.928835] nix-grpc-daemon[787]: ts=2026-09-20T09:32:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_in=7524536lb # [ 37.942731] niks3-server[1030]: 2026/09/20 09:32:44 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4537worker2 # [ 37.934465] nix-grpc-daemon[787]: ts=2026-09-20T09:32:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764538worker2 # [ 37.944501] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4539worker2 # [ 37.947564] nix-daemon[845]: reaped child process 935, status = succeeded4540worker2 # [ 37.952767] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4541client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4542client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4543lb # [ 38.368832] envoy[920]: conn peer=[2001:db8:1::1]:59940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=19964544lb # [ 38.372488] envoy[920]: conn peer=[2001:db8:1::1]:59946 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=934545lb # [ 38.375859] envoy[920]: conn peer=[2001:db8:1::1]:59948 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=74546lb # [ 38.379162] envoy[920]: conn peer=[2001:db8:1::1]:59954 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=74547client # farm-top> LOG-farm-top-t14548worker2 # [ 38.977544] nix-daemon[845]: reaped child process 949, status = succeeded4549worker2 # [ 39.111184] nix-daemon[845]: accepted connection from pid 965, user nix-grpc-daemon (trusted)4550worker2 # [ 39.122399] nix-daemon[845]: reaped child process 968, status = succeeded4551lb # [ 39.148285] niks3-server[1030]: 2026/09/20 09:32:46 INFO Received uploads request method=POST path=/api/pending_closures4552worker2 # [ 39.141175] nix-grpc-daemon[855]: time=2026-09-20T09:32:45.480Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4553worker2 # [ 39.144026] nix-grpc-daemon[855]: time=2026-09-20T09:32:45.482Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4554lb # [ 39.168103] niks3-server[1030]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4555lb # [ 39.171683] niks3-server[1030]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4556lb # [ 39.175612] niks3-server[1030]: 2026/09/20 09:32:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4557worker2 # [ 39.165780] nix-grpc-daemon[855]: time=2026-09-20T09:32:45.505Z level=INFO msg="Uploading 1 narinfos"4558lb # [ 39.178142] niks3-server[1030]: 2026/09/20 09:32:46 INFO Signed narinfos id=6 count=14559lb # [ 39.180257] niks3-server[1030]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4560lb # [ 39.185284] niks3-server[1030]: 2026/09/20 09:32:46 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4561lb # [ 39.188397] niks3-server[1030]: 2026/09/20 09:32:46 INFO Completed upload id=64562worker2 # [ 39.176954] nix-grpc-daemon[855]: time=2026-09-20T09:32:45.516Z level=INFO msg="Upload complete. (215ms)"4563lb # [ 39.190190] niks3-server[1030]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4564worker2 # [ 39.179506] nix-grpc-daemon[787]: ts=2026-09-20T09:32:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14565worker2 # [ 39.186058] nix-daemon[845]: reaped child process 947, status = succeeded4566client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.45 seconds)4567client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4568client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds)4569client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4570client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4571client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4572client # copying 3 paths...4573client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4574client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4575client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4576client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4577(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.95 seconds)4578subtest: repeat is answered Cached by the scheduler without building4579worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4580worker1 # finding garbage collector roots...4581worker1 # deleting specified paths...4582worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4583worker1 # deleting unused links...4584worker1 # note: hard linking is currently saving 0.0 KiB4585worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4586worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4587worker2 # finding garbage collector roots...4588worker2 # deleting specified paths...4589worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4590worker2 # deleting unused links...4591worker2 # note: hard linking is currently saving 0.0 KiB4592worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.22 seconds)4593client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24594worker2 # [ 40.388309] nix-grpc-daemon[787]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:428764595client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4596client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4597worker1 # [ 40.414524] nix-grpc-daemon[789]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284598worker1 # [ 40.434606] nix-grpc-daemon[789]: ts=2026-09-20T09:32:46Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14599client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.27 seconds)4600client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4601client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds)4602lb: must succeed: curl -sf localhost:9901/clusters4603lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4604lb: must succeed: curl -sf localhost:9901/clusters4605lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4606worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4607worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.07 seconds)4608(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.17 seconds)4609subtest: inputs already in the cache are not sent to the scheduler4610lb: must succeed: curl -sf localhost:9901/clusters4611lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4612lb: must succeed: curl -sf localhost:9901/clusters4613lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4614worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4615worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4616client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24617worker1 # [ 41.211933] nix-grpc-daemon[789]: ts=2026-09-20T09:32:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:466284618client # don't know how to build these paths:4619client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4620worker1 # [ 41.219826] nix-grpc-daemon[789]: ts=2026-09-20T09:32:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284621worker1 # [ 41.231155] nix-grpc-daemon[789]: ts=2026-09-20T09:32:47Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04622worker1 # [ 41.235413] nix-grpc-daemon[789]: ts=2026-09-20T09:32:47Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14623worker2 # [ 41.261737] nix-grpc-daemon[787]: ts=2026-09-20T09:32:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764624worker2 # [ 41.274421] nix-grpc-daemon[787]: ts=2026-09-20T09:32:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764625worker2 # [ 41.286776] nix-grpc-daemon[855]: time=2026-09-20T09:32:47.626Z level=INFO msg="All 2 paths already cached"4626client # copying 1 paths to 'lb:50051'...4627client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4628worker2 # [ 41.294835] nix-grpc-daemon[787]: ts=2026-09-20T09:32:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428764629worker2 # [ 41.305720] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4630worker2 # [ 41.451340] nix-daemon[845]: accepted connection from pid 985, user nix-grpc-daemon (trusted)4631worker2 # [ 41.465551] nix-daemon[845]: reaped child process 988, status = succeeded4632worker2 # [ 41.604797] nix-daemon[845]: accepted connection from pid 990, user nix-grpc-daemon (trusted)4633worker2 # [ 41.617274] nix-daemon[845]: reaped child process 993, status = succeeded4634lb # [ 41.643722] niks3-server[1030]: 2026/09/20 09:32:48 INFO Received uploads request method=POST path=/api/pending_closures4635worker2 # [ 41.635135] nix-grpc-daemon[855]: time=2026-09-20T09:32:47.974Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4636worker2 # [ 41.636586] nix-grpc-daemon[855]: time=2026-09-20T09:32:47.976Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4637lb # [ 41.659406] niks3-server[1030]: 2026/09/20 09:32:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4638lb # [ 41.660981] niks3-server[1030]: 2026/09/20 09:32:48 INFO Signed narinfos id=7 count=14639worker2 # [ 41.649566] nix-grpc-daemon[855]: time=2026-09-20T09:32:47.989Z level=INFO msg="Uploading 1 narinfos"4640lb # [ 41.663775] niks3-server[1030]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4641lb # [ 41.667755] niks3-server[1030]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4642lb # [ 41.672930] niks3-server[1030]: 2026/09/20 09:32:48 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4643lb # [ 41.677992] niks3-server[1030]: 2026/09/20 09:32:48 INFO Completed upload id=74644worker2 # [ 41.665367] nix-grpc-daemon[855]: time=2026-09-20T09:32:48.005Z level=INFO msg="Upload complete. (347ms)"4645lb # [ 41.679553] niks3-server[1030]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4646worker2 # [ 41.667587] nix-grpc-daemon[787]: ts=2026-09-20T09:32:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_in=7524647worker2 # [ 41.670819] nix-grpc-daemon[787]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764648worker2 # [ 41.677184] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4649worker2 # [ 41.679500] nix-daemon[845]: reaped child process 983, status = succeeded4650client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4651client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4652worker2 # [ 41.684965] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4653client # farm-top> LOG-farm-top-t1b4654worker2 # [ 42.910834] nix-daemon[845]: reaped child process 997, status = succeeded4655worker2 # [ 43.065953] nix-daemon[845]: accepted connection from pid 1013, user nix-grpc-daemon (trusted)4656worker2 # [ 43.078072] nix-daemon[845]: reaped child process 1016, status = succeeded4657lb # [ 43.105065] niks3-server[1030]: 2026/09/20 09:32:50 INFO Received uploads request method=POST path=/api/pending_closures4658worker2 # [ 43.100513] nix-grpc-daemon[855]: time=2026-09-20T09:32:49.440Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4659worker2 # [ 43.103421] nix-grpc-daemon[855]: time=2026-09-20T09:32:49.441Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4660lb # [ 43.145751] niks3-server[1030]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4661lb # [ 43.151790] niks3-server[1030]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4662lb # [ 43.162389] niks3-server[1030]: 2026/09/20 09:32:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4663lb # [ 43.168983] niks3-server[1030]: 2026/09/20 09:32:50 INFO Signed narinfos id=8 count=14664worker2 # [ 43.159247] nix-grpc-daemon[855]: time=2026-09-20T09:32:49.498Z level=INFO msg="Uploading 1 narinfos"4665lb # [ 43.173891] niks3-server[1030]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4666lb # [ 43.186435] niks3-server[1030]: 2026/09/20 09:32:50 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4667lb # [ 43.192202] niks3-server[1030]: 2026/09/20 09:32:50 INFO Completed upload id=84668lb # [ 43.193677] niks3-server[1030]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4669worker2 # [ 43.179705] nix-grpc-daemon[855]: time=2026-09-20T09:32:49.519Z level=INFO msg="Upload complete. (287ms)"4670worker2 # [ 43.186217] nix-grpc-daemon[787]: ts=2026-09-20T09:32:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14671worker2 # [ 43.198578] nix-daemon[845]: reaped child process 995, status = succeeded4672client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.20 seconds)4673client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4674client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.17 seconds)4675lb: must succeed: curl -sf localhost:9901/clusters4676lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4677lb: must succeed: curl -sf localhost:9901/clusters4678lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4679worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4680worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4681(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.63 seconds)4682subtest: two clients wanting the same drv build it once4683client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4684client # [ 43.532359] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4685client # Running as unit: dedup1.service; invocation ID: ccf06d5f4231414f91bc278d1e2976f14686client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4687client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4688client # [ 43.729597] nix[878]: don't know how to build these paths:4689client # [ 43.730541] nix[878]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4690worker1 # [ 43.753376] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:466284691worker1 # [ 43.763711] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04692worker1 # [ 43.769606] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14693worker1 # [ 43.774346] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:466284694worker1 # [ 43.786176] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284695client # [ 43.769879] nix[878]: copying 1 paths to 'lb:50051'...4696client # [ 43.770714] nix[878]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4697worker1 # [ 43.794944] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:466284698worker1 # [ 43.806472] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4699worker1 # [ 43.823373] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=info event=niks3_push_started pid=9054700worker1 # [ 44.225197] nix-daemon[852]: accepted connection from pid 917, user nix-grpc-daemon (trusted)4701worker1 # [ 44.239899] nix-daemon[852]: reaped child process 920, status = succeeded4702worker1 # [ 44.394875] nix-daemon[852]: accepted connection from pid 922, user nix-grpc-daemon (trusted)4703worker1 # [ 44.406968] nix-daemon[852]: reaped child process 925, status = succeeded4704lb # [ 44.420359] niks3-server[1030]: 2026/09/20 09:32:51 INFO Received uploads request method=POST path=/api/pending_closures4705worker1 # [ 44.432407] nix-grpc-daemon[905]: time=2026-09-20T09:32:50.714Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4706worker1 # [ 44.435282] nix-grpc-daemon[905]: time=2026-09-20T09:32:50.717Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4707lb # [ 44.461131] niks3-server[1030]: 2026/09/20 09:32:51 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4708lb # [ 44.469756] niks3-server[1030]: 2026/09/20 09:32:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4709lb # [ 44.474949] niks3-server[1030]: 2026/09/20 09:32:51 INFO Signed narinfos id=9 count=14710worker1 # [ 44.480217] nix-grpc-daemon[905]: time=2026-09-20T09:32:50.763Z level=INFO msg="Uploading 1 narinfos"4711lb # [ 44.482169] niks3-server[1030]: 2026/09/20 09:32:51 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4712lb # [ 44.491475] niks3-server[1030]: 2026/09/20 09:32:51 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4713lb # [ 44.495052] niks3-server[1030]: 2026/09/20 09:32:51 INFO Completed upload id=94714worker1 # [ 44.497131] nix-grpc-daemon[905]: time=2026-09-20T09:32:50.780Z level=INFO msg="Upload complete. (436ms)"4715lb # [ 44.496676] niks3-server[1030]: 2026/09/20 09:32:51 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4716worker1 # [ 44.499376] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=0 paths=1 nar_bytes_in=4324717worker1 # [ 44.502426] nix-grpc-daemon[789]: ts=2026-09-20T09:32:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:466284718worker1 # [ 44.507595] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4719worker1 # [ 44.511615] nix-daemon[852]: reaped child process 903, status = succeeded4720worker1 # [ 44.517505] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4721client # [ 44.491445] nix[878]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4722client # [ 44.602625] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4723client # Running as unit: dedup2.service; invocation ID: cfa8b6656ce642fa8bd4ada1a86b1ec84724client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4725client # [ 44.837397] nix[893]: don't know how to build these paths:4726client # [ 44.838406] nix[893]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4727worker2 # [ 44.847809] nix-grpc-daemon[787]: ts=2026-09-20T09:32:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:428764728worker1 # [ 44.872238] nix-grpc-daemon[789]: ts=2026-09-20T09:32:51Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04729worker1 # [ 44.880752] nix-grpc-daemon[789]: ts=2026-09-20T09:32:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:466284730client # [ 44.861198] nix[893]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4731client: must succeed: sleep 24732client: (finished: must succeed: sleep 2, in 2.04 seconds)4733??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4734 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394735client: waiting for success: ! systemctl is-active dedup1 dedup24736??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4737 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394738worker1 # [ 48.143628] nix-daemon[852]: reaped child process 929, status = succeeded4739worker1 # [ 48.289949] nix-daemon[852]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4740worker1 # [ 48.300732] nix-daemon[852]: reaped child process 964, status = succeeded4741lb # [ 48.311930] niks3-server[1030]: 2026/09/20 09:32:55 INFO Received uploads request method=POST path=/api/pending_closures4742worker1 # [ 48.324727] nix-grpc-daemon[905]: time=2026-09-20T09:32:54.607Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4743worker1 # [ 48.326252] nix-grpc-daemon[905]: time=2026-09-20T09:32:54.609Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4744lb # [ 48.355293] niks3-server[1030]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4745lb # [ 48.368092] niks3-server[1030]: 2026/09/20 09:32:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4746lb # [ 48.376107] envoy[920]: conn peer=[2001:db8:1::1]:46844 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=3796 ms=62884747lb # [ 48.379319] envoy[920]: conn peer=[2001:db8:1::1]:46856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=434748lb # [ 48.383085] envoy[920]: conn peer=[2001:db8:1::1]:46866 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1729 ms=19944749lb # [ 48.388193] niks3-server[1030]: 2026/09/20 09:32:55 INFO Signed narinfos id=10 count=14750worker1 # [ 48.392708] nix-grpc-daemon[905]: time=2026-09-20T09:32:54.675Z level=INFO msg="Uploading 1 narinfos"4751lb # [ 48.391614] niks3-server[1030]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4752lb # [ 48.400722] niks3-server[1030]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4753lb # [ 48.404241] niks3-server[1030]: 2026/09/20 09:32:55 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4754lb # [ 48.406768] niks3-server[1030]: 2026/09/20 09:32:55 INFO Completed upload id=104755worker1 # [ 48.407850] nix-grpc-daemon[905]: time=2026-09-20T09:32:54.691Z level=INFO msg="Upload complete. (278ms)"4756lb # [ 48.408753] niks3-server[1030]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4757worker1 # [ 48.414773] nix-grpc-daemon[789]: ts=2026-09-20T09:32:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14758worker1 # [ 48.424291] nix-grpc-daemon[789]: ts=2026-09-20T09:32:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14759worker1 # [ 48.433772] nix-daemon[852]: reaped child process 927, status = succeeded4760client # [ 48.423990] systemd[1]: dedup2.service: Deactivated successfully.4761client # [ 48.425764] systemd[1]: dedup2.service: Consumed 114ms CPU time over 3.823s wall clock time, 31.2M memory peak, 7.5K incoming IP traffic, 6.5K outgoing IP traffic.4762client # [ 48.428939] systemd[1]: dedup1.service: Deactivated successfully.4763client # [ 48.430233] systemd[1]: dedup1.service: Consumed 99ms CPU time over 4.896s wall clock time, 37.3M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4764client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4765client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4766client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4767worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4768worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4769worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4770worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4771worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4772worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4773worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4774worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4775(finished: subtest: two clients wanting the same drv build it once, in 5.88 seconds)4776subtest: build hook: nix-daemon with builders = grpc://lb4777client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4778client # [ 49.570198] systemd[1]: Started Nix Daemon.4779client # [ 49.738436] nix-daemon[935]: accepted connection from pid 932, user root (trusted)4780worker2 # [ 49.936836] nix-grpc-daemon[787]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:428764781worker1 # [ 49.956717] nix-grpc-daemon[789]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284782worker1 # [ 49.971603] nix-grpc-daemon[789]: ts=2026-09-20T09:32:56Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04783worker1 # [ 49.975746] nix-grpc-daemon[789]: ts=2026-09-20T09:32:56Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14784worker2 # [ 50.001402] nix-grpc-daemon[787]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764785worker2 # [ 50.012196] nix-grpc-daemon[787]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764786worker2 # [ 50.021873] nix-grpc-daemon[787]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428764787worker2 # [ 50.033145] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4788worker2 # [ 50.190455] nix-daemon[845]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4789worker2 # [ 50.204069] nix-daemon[845]: reaped child process 1046, status = succeeded4790worker2 # [ 50.364588] nix-daemon[845]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4791worker2 # [ 50.376527] nix-daemon[845]: reaped child process 1051, status = succeeded4792lb # [ 50.405842] niks3-server[1030]: 2026/09/20 09:32:57 INFO Received uploads request method=POST path=/api/pending_closures4793worker2 # [ 50.401144] nix-grpc-daemon[855]: time=2026-09-20T09:32:56.740Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4794worker2 # [ 50.402545] nix-grpc-daemon[855]: time=2026-09-20T09:32:56.740Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4795lb # [ 50.428064] niks3-server[1030]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4796lb # [ 50.437229] niks3-server[1030]: 2026/09/20 09:32:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4797lb # [ 50.439645] niks3-server[1030]: 2026/09/20 09:32:57 INFO Signed narinfos id=11 count=14798worker2 # [ 50.428644] nix-grpc-daemon[855]: time=2026-09-20T09:32:56.768Z level=INFO msg="Uploading 1 narinfos"4799lb # [ 50.442669] niks3-server[1030]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4800lb # [ 50.447106] niks3-server[1030]: 2026/09/20 09:32:57 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4801lb # [ 50.451929] niks3-server[1030]: 2026/09/20 09:32:57 INFO Completed upload id=114802worker2 # [ 50.439367] nix-grpc-daemon[855]: time=2026-09-20T09:32:56.779Z level=INFO msg="Upload complete. (395ms)"4803lb # [ 50.453114] niks3-server[1030]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4804worker2 # [ 50.441344] nix-grpc-daemon[787]: ts=2026-09-20T09:32:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_in=5124805worker2 # [ 50.445327] nix-grpc-daemon[787]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764806worker2 # [ 50.451502] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4807worker2 # [ 50.453794] nix-daemon[845]: reaped child process 1041, status = succeeded4808worker2 # [ 50.458914] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4809worker2 # [ 51.672618] nix-daemon[845]: reaped child process 1055, status = succeeded4810worker2 # [ 51.817025] nix-daemon[845]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4811worker2 # [ 51.829323] nix-daemon[845]: reaped child process 1073, status = succeeded4812lb # [ 51.858346] niks3-server[1030]: 2026/09/20 09:32:58 INFO Received uploads request method=POST path=/api/pending_closures4813worker2 # [ 51.853625] nix-grpc-daemon[855]: time=2026-09-20T09:32:58.193Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4814worker2 # [ 51.855323] nix-grpc-daemon[855]: time=2026-09-20T09:32:58.194Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4815lb # [ 51.896161] niks3-server[1030]: 2026/09/20 09:32:58 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4816lb # [ 51.908234] niks3-server[1030]: 2026/09/20 09:32:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4817lb # [ 51.913100] niks3-server[1030]: 2026/09/20 09:32:58 INFO Signed narinfos id=12 count=14818worker2 # [ 51.903568] nix-grpc-daemon[855]: time=2026-09-20T09:32:58.243Z level=INFO msg="Uploading 1 narinfos"4819lb # [ 51.920746] niks3-server[1030]: 2026/09/20 09:32:58 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4820lb # [ 51.927471] niks3-server[1030]: 2026/09/20 09:32:58 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4821lb # [ 51.934614] niks3-server[1030]: 2026/09/20 09:32:58 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4822lb # [ 51.939984] niks3-server[1030]: 2026/09/20 09:32:58 INFO Completed upload id=124823worker2 # [ 51.927635] nix-grpc-daemon[855]: time=2026-09-20T09:32:58.267Z level=INFO msg="Upload complete. (261ms)"4824lb # [ 51.942821] niks3-server[1030]: 2026/09/20 09:32:58 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4825worker2 # [ 51.932813] nix-grpc-daemon[787]: ts=2026-09-20T09:32:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14826worker1 # [ 51.951624] nix-grpc-daemon[789]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:466284827worker2 # [ 51.944151] nix-daemon[845]: reaped child process 1053, status = succeeded4828worker1 # [ 51.962665] nix-grpc-daemon[789]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4829worker1 # [ 51.998850] nix-grpc-daemon[789]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:466284830worker1 # [ 52.004570] nix-grpc-daemon[789]: ts=2026-09-20T09:32:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=0 paths=1 nar_bytes_out=1284831worker1 # [ 52.268832] nix-grpc-daemon[789]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:466284832worker2 # [ 52.259338] nix-grpc-daemon[787]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764833worker2 # [ 52.268149] nix-grpc-daemon[855]: time=2026-09-20T09:32:58.607Z level=INFO msg="All 1 paths already cached"4834worker1 # [ 52.295879] nix-grpc-daemon[789]: ts=2026-09-20T09:32:58Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04835worker2 # [ 52.284826] nix-grpc-daemon[787]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764836worker1 # [ 52.300388] nix-grpc-daemon[789]: ts=2026-09-20T09:32:58Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14837worker2 # [ 52.296459] nix-grpc-daemon[787]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764838worker2 # [ 52.308157] nix-grpc-daemon[855]: time=2026-09-20T09:32:58.647Z level=INFO msg="All 1 paths already cached"4839worker2 # [ 52.315369] nix-grpc-daemon[787]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428764840worker2 # [ 52.325163] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4841worker2 # [ 52.504115] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4842worker2 # [ 52.517975] nix-daemon[845]: reaped child process 1080, status = succeeded4843worker2 # [ 52.679826] nix-daemon[845]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4844worker2 # [ 52.692773] nix-daemon[845]: reaped child process 1085, status = succeeded4845lb # [ 52.723330] niks3-server[1030]: 2026/09/20 09:32:59 INFO Received uploads request method=POST path=/api/pending_closures4846worker2 # [ 52.721316] nix-grpc-daemon[855]: time=2026-09-20T09:32:59.060Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4847worker2 # [ 52.722734] nix-grpc-daemon[855]: time=2026-09-20T09:32:59.060Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4848lb # [ 52.754950] niks3-server[1030]: 2026/09/20 09:32:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4849lb # [ 52.760221] niks3-server[1030]: 2026/09/20 09:32:59 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4850lb # [ 52.768788] niks3-server[1030]: 2026/09/20 09:32:59 INFO Signed narinfos id=13 count=14851worker2 # [ 52.759489] nix-grpc-daemon[855]: time=2026-09-20T09:32:59.099Z level=INFO msg="Uploading 1 narinfos"4852lb # [ 52.773581] niks3-server[1030]: 2026/09/20 09:32:59 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4853lb # [ 52.783891] niks3-server[1030]: 2026/09/20 09:32:59 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4854lb # [ 52.793412] niks3-server[1030]: 2026/09/20 09:32:59 INFO Completed upload id=134855worker2 # [ 52.780592] nix-grpc-daemon[855]: time=2026-09-20T09:32:59.120Z level=INFO msg="Upload complete. (443ms)"4856lb # [ 52.796155] niks3-server[1030]: 2026/09/20 09:32:59 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4857worker2 # [ 52.785107] nix-grpc-daemon[787]: ts=2026-09-20T09:32:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_in=6244858worker2 # [ 52.789681] nix-grpc-daemon[787]: ts=2026-09-20T09:32:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764859worker2 # [ 52.799924] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4860worker2 # [ 52.805656] nix-daemon[845]: reaped child process 1075, status = succeeded4861worker2 # [ 52.808777] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4862worker2 # [ 53.620059] nix-daemon[845]: reaped child process 1089, status = succeeded4863worker2 # [ 53.769573] nix-daemon[845]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4864worker2 # [ 53.782336] nix-daemon[845]: reaped child process 1107, status = succeeded4865lb # [ 53.811766] niks3-server[1030]: 2026/09/20 09:33:00 INFO Received uploads request method=POST path=/api/pending_closures4866worker2 # [ 53.807957] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.146Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4867worker2 # [ 53.809723] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.146Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4868lb # [ 53.845293] niks3-server[1030]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4869lb # [ 53.850641] niks3-server[1030]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4870lb # [ 53.864527] niks3-server[1030]: 2026/09/20 09:33:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4871lb # [ 53.869650] niks3-server[1030]: 2026/09/20 09:33:00 INFO Signed narinfos id=14 count=14872worker2 # [ 53.859609] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.199Z level=INFO msg="Uploading 1 narinfos"4873lb # [ 53.872310] niks3-server[1030]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4874lb # [ 53.882840] niks3-server[1030]: 2026/09/20 09:33:00 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4875lb # [ 53.887260] niks3-server[1030]: 2026/09/20 09:33:00 INFO Completed upload id=144876lb # [ 53.889470] niks3-server[1030]: 2026/09/20 09:33:00 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4877worker2 # [ 53.876365] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.215Z level=INFO msg="Upload complete. (260ms)"4878worker2 # [ 53.882339] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14879worker2 # [ 53.889073] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:428764880worker2 # [ 53.897321] nix-daemon[845]: reaped child process 1087, status = succeeded4881worker2 # [ 53.900197] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:428764882worker2 # [ 53.904444] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_out=1764883worker2 # [ 54.146294] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:428764884worker1 # [ 54.163720] nix-grpc-daemon[789]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284885worker1 # [ 54.174917] nix-grpc-daemon[905]: time=2026-09-20T09:33:00.458Z level=INFO msg="All 1 paths already cached"4886worker1 # [ 54.184672] nix-grpc-daemon[789]: ts=2026-09-20T09:33:00Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04887worker1 # [ 54.186551] nix-grpc-daemon[789]: ts=2026-09-20T09:33:00Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14888worker2 # [ 54.177830] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764889worker2 # [ 54.189395] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428764890worker2 # [ 54.201481] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.541Z level=INFO msg="All 2 paths already cached"4891worker2 # [ 54.208505] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428764892worker2 # [ 54.218157] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4893worker2 # [ 54.368572] nix-daemon[845]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4894worker2 # [ 54.382979] nix-daemon[845]: reaped child process 1114, status = succeeded4895worker2 # [ 54.531960] nix-daemon[845]: accepted connection from pid 1116, user nix-grpc-daemon (trusted)4896worker2 # [ 54.545641] nix-daemon[845]: reaped child process 1119, status = succeeded4897lb # [ 54.566156] niks3-server[1030]: 2026/09/20 09:33:01 INFO Received uploads request method=POST path=/api/pending_closures4898worker2 # [ 54.573378] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.912Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4899worker2 # [ 54.574716] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.912Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4900lb # [ 54.597719] niks3-server[1030]: 2026/09/20 09:33:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4901lb # [ 54.599972] niks3-server[1030]: 2026/09/20 09:33:01 INFO Signed narinfos id=15 count=14902worker2 # [ 54.587368] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.926Z level=INFO msg="Uploading 1 narinfos"4903lb # [ 54.602060] niks3-server[1030]: 2026/09/20 09:33:01 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4904lb # [ 54.606691] niks3-server[1030]: 2026/09/20 09:33:01 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4905lb # [ 54.610203] niks3-server[1030]: 2026/09/20 09:33:01 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4906lb # [ 54.627906] niks3-server[1030]: 2026/09/20 09:33:01 INFO Completed upload id=154907lb # [ 54.629454] niks3-server[1030]: 2026/09/20 09:33:01 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4908worker2 # [ 54.616972] nix-grpc-daemon[855]: time=2026-09-20T09:33:00.956Z level=INFO msg="Upload complete. (386ms)"4909worker2 # [ 54.619985] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_in=7524910worker2 # [ 54.622638] nix-grpc-daemon[787]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428764911worker2 # [ 54.629695] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4912worker2 # [ 54.634369] nix-daemon[845]: reaped child process 1109, status = succeeded4913worker2 # [ 54.639361] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4914worker2 # [ 55.664620] nix-daemon[845]: reaped child process 1123, status = succeeded4915worker2 # [ 55.819559] nix-daemon[845]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)4916worker2 # [ 55.832579] nix-daemon[845]: reaped child process 1141, status = succeeded4917lb # [ 55.862325] niks3-server[1030]: 2026/09/20 09:33:02 INFO Received uploads request method=POST path=/api/pending_closures4918worker2 # [ 55.858370] nix-grpc-daemon[855]: time=2026-09-20T09:33:02.197Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4919worker2 # [ 55.864318] nix-grpc-daemon[855]: time=2026-09-20T09:33:02.197Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4920lb # [ 55.901547] niks3-server[1030]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4921lb # [ 55.908676] niks3-server[1030]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4922lb # [ 55.922350] niks3-server[1030]: 2026/09/20 09:33:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4923lb # [ 55.927644] niks3-server[1030]: 2026/09/20 09:33:02 INFO Signed narinfos id=16 count=14924worker2 # [ 55.918327] nix-grpc-daemon[855]: time=2026-09-20T09:33:02.257Z level=INFO msg="Uploading 1 narinfos"4925lb # [ 55.933059] niks3-server[1030]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4926lb # [ 55.943359] niks3-server[1030]: 2026/09/20 09:33:02 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4927lb # [ 55.951542] niks3-server[1030]: 2026/09/20 09:33:02 INFO Completed upload id=164928lb # [ 55.953124] niks3-server[1030]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4929worker2 # [ 55.939242] nix-grpc-daemon[855]: time=2026-09-20T09:33:02.278Z level=INFO msg="Upload complete. (291ms)"4930worker2 # [ 55.944713] nix-grpc-daemon[787]: ts=2026-09-20T09:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14931worker2 # [ 55.957201] nix-daemon[845]: reaped child process 1121, status = succeeded4932worker2 # [ 55.990904] nix-grpc-daemon[787]: ts=2026-09-20T09:33:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:428764933worker2 # [ 56.006148] nix-grpc-daemon[787]: ts=2026-09-20T09:33:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:428764934worker2 # [ 56.010330] nix-grpc-daemon[787]: ts=2026-09-20T09:33:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_out=2324935client # [ 56.104995] nix-daemon[935]: reaped child process 937, status = succeeded4936client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.74 seconds)4937client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4938client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4939client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4940client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4941client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4942client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4943(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.83 seconds)4944subtest: an input only one worker has still reaches the builder4945client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4946client # this derivation will be built:4947client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4948client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4949client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.38 seconds)4950client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4951client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4952worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4953worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)4954worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4955worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4956client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24957client # [ 57.182225] nix-daemon[935]: accepted connection from pid 1015, user root (trusted)4958client # this derivation will be built:4959client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4960worker2 # [ 57.360121] nix-grpc-daemon[787]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:428764961client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4962worker1 # [ 57.382399] nix-grpc-daemon[789]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284963worker1 # [ 57.557788] nix-daemon[852]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4964worker1 # [ 57.568515] nix-daemon[852]: reaped child process 992, status = succeeded4965lb # [ 57.585627] niks3-server[1030]: 2026/09/20 09:33:04 INFO Received uploads request method=POST path=/api/pending_closures4966worker1 # [ 57.592902] nix-grpc-daemon[905]: time=2026-09-20T09:33:03.875Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4967worker1 # [ 57.594278] nix-grpc-daemon[905]: time=2026-09-20T09:33:03.875Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4968lb # [ 57.607716] niks3-server[1030]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4969lb # [ 57.619310] niks3-server[1030]: 2026/09/20 09:33:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4970lb # [ 57.625472] niks3-server[1030]: 2026/09/20 09:33:04 INFO Signed narinfos id=17 count=14971worker1 # [ 57.629395] nix-grpc-daemon[905]: time=2026-09-20T09:33:03.912Z level=INFO msg="Uploading 1 narinfos"4972lb # [ 57.632072] niks3-server[1030]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4973lb # [ 57.641717] niks3-server[1030]: 2026/09/20 09:33:04 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4974worker1 # [ 57.647814] nix-grpc-daemon[905]: time=2026-09-20T09:33:03.931Z level=INFO msg="Upload complete. (261ms)"4975lb # [ 57.647564] niks3-server[1030]: 2026/09/20 09:33:04 INFO Completed upload id=174976lb # [ 57.652478] niks3-server[1030]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4977worker1 # [ 57.663869] nix-grpc-daemon[789]: ts=2026-09-20T09:33:03Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04978worker1 # [ 57.668383] nix-grpc-daemon[789]: ts=2026-09-20T09:33:03Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14979worker1 # [ 57.708475] nix-grpc-daemon[789]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:466284980worker1 # [ 57.720758] nix-grpc-daemon[789]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466284981client # copying 2 paths to 'lb:50051'...4982worker1 # [ 57.737103] nix-grpc-daemon[789]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:466284983client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4984client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4985worker1 # [ 57.752129] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4986worker1 # [ 57.916150] nix-daemon[852]: accepted connection from pid 998, user nix-grpc-daemon (trusted)4987worker1 # [ 57.928881] nix-daemon[852]: reaped child process 1001, status = succeeded4988worker1 # [ 58.083249] nix-daemon[852]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)4989worker1 # [ 58.094893] nix-daemon[852]: reaped child process 1006, status = succeeded4990lb # [ 58.109522] niks3-server[1030]: 2026/09/20 09:33:05 INFO Received uploads request method=POST path=/api/pending_closures4991lb # [ 58.114577] niks3-server[1030]: 2026/09/20 09:33:05 INFO Received uploads request method=POST path=/api/pending_closures4992worker1 # [ 58.119174] nix-grpc-daemon[905]: time=2026-09-20T09:33:04.402Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4993worker1 # [ 58.120710] nix-grpc-daemon[905]: time=2026-09-20T09:33:04.404Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4994worker1 # [ 58.122987] nix-grpc-daemon[905]: time=2026-09-20T09:33:04.405Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4995lb # [ 58.134424] niks3-server[1030]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4996lb # [ 58.139894] niks3-server[1030]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4997lb # [ 58.147475] niks3-server[1030]: 2026/09/20 09:33:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4998lb # [ 58.149537] niks3-server[1030]: 2026/09/20 09:33:05 INFO Signed narinfos id=18 count=14999lb # [ 58.152913] niks3-server[1030]: 2026/09/20 09:33:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5000lb # [ 58.155921] niks3-server[1030]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5001lb # [ 58.158250] niks3-server[1030]: 2026/09/20 09:33:05 INFO Signed narinfos id=19 count=25002worker1 # [ 58.159246] nix-grpc-daemon[905]: time=2026-09-20T09:33:04.442Z level=INFO msg="Uploading 3 narinfos"5003lb # [ 58.161465] niks3-server[1030]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5004lb # [ 58.171925] niks3-server[1030]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5005lb # [ 58.178871] niks3-server[1030]: 2026/09/20 09:33:05 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5006lb # [ 58.181118] niks3-server[1030]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5007lb # [ 58.183571] niks3-server[1030]: 2026/09/20 09:33:05 INFO Completed upload id=185008lb # [ 58.185156] niks3-server[1030]: 2026/09/20 09:33:05 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5009lb # [ 58.186920] niks3-server[1030]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5010lb # [ 58.189198] niks3-server[1030]: 2026/09/20 09:33:05 INFO Completed upload id=195011worker1 # [ 58.191354] nix-grpc-daemon[905]: time=2026-09-20T09:33:04.474Z level=INFO msg="Upload complete. (424ms)"5012worker1 # [ 58.196132] nix-grpc-daemon[789]: ts=2026-09-20T09:33:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=0 paths=2 nar_bytes_in=9765013worker1 # [ 58.200603] nix-grpc-daemon[789]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:466285014worker1 # [ 58.208319] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5015worker1 # [ 58.214113] nix-daemon[852]: reaped child process 996, status = succeeded5016worker1 # [ 58.217512] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5017client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5018client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5019lb # [ 58.373669] envoy[920]: conn peer=[2001:db8:1::1]:46254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=35775020lb # [ 58.377343] envoy[920]: conn peer=[2001:db8:1::1]:46252 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2998 tx=1369 ms=46785021lb # [ 58.380852] envoy[920]: conn peer=[2001:db8:1::1]:46262 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3397 tx=1772 ms=21075022lb # [ 58.384320] envoy[920]: conn peer=[2001:db8:1::1]:46272 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=645023lb # [ 58.387740] envoy[920]: conn peer=[2001:db8:1::1]:46274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1863 ms=17005024lb # [ 58.391433] envoy[920]: conn peer=[2001:db8:1::1]:59376 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=545025lb # [ 58.395493] envoy[920]: conn peer=[2001:db8:1::1]:59392 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2104 ms=19125026lb # [ 58.399164] envoy[920]: conn peer=[2001:db8:1::1]:59396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=545027worker1 # [ 59.230827] nix-daemon[852]: reaped child process 1010, status = succeeded5028worker1 # [ 59.385084] nix-daemon[852]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)5029worker1 # [ 59.397396] nix-daemon[852]: reaped child process 1028, status = succeeded5030lb # [ 59.409214] niks3-server[1030]: 2026/09/20 09:33:06 INFO Received uploads request method=POST path=/api/pending_closures5031worker1 # [ 59.417919] nix-grpc-daemon[905]: time=2026-09-20T09:33:05.701Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5032lb # [ 59.440725] niks3-server[1030]: 2026/09/20 09:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5033lb # [ 59.445683] niks3-server[1030]: 2026/09/20 09:33:06 INFO Signed narinfos id=20 count=15034worker1 # [ 59.449500] nix-grpc-daemon[905]: time=2026-09-20T09:33:05.732Z level=INFO msg="Uploading 1 narinfos"5035lb # [ 59.452676] niks3-server[1030]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5036lb # [ 59.460096] niks3-server[1030]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5037lb # [ 59.471434] niks3-server[1030]: 2026/09/20 09:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5038worker1 # [ 59.478699] nix-grpc-daemon[905]: time=2026-09-20T09:33:05.762Z level=INFO msg="Upload complete. (255ms)"5039lb # [ 59.477885] niks3-server[1030]: 2026/09/20 09:33:06 INFO Completed upload id=205040lb # [ 59.480993] niks3-server[1030]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5041worker1 # [ 59.483113] nix-grpc-daemon[789]: ts=2026-09-20T09:33:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15042worker1 # [ 59.493748] nix-daemon[852]: reaped child process 1008, status = succeeded5043client # copying 1 paths...5044worker2 # [ 59.514550] nix-grpc-daemon[787]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:428765045worker2 # [ 59.532926] nix-grpc-daemon[787]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5046client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5047worker1 # [ 59.578153] nix-grpc-daemon[789]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:466285048worker1 # [ 59.582798] nix-grpc-daemon[789]: ts=2026-09-20T09:33:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=0 paths=1 nar_bytes_out=1205049client # [ 59.621699] nix-daemon[935]: reaped child process 1018, status = succeeded5050client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.64 seconds)5051client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25052client # [ 59.778681] nix-daemon[935]: accepted connection from pid 1036, user root (trusted)5053client # this derivation will be built:5054client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5055worker1 # [ 59.964324] nix-grpc-daemon[789]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:466285056worker1 # [ 59.969691] nix-grpc-daemon[789]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466285057client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5058worker1 # [ 59.975265] nix-grpc-daemon[905]: time=2026-09-20T09:33:06.258Z level=INFO msg="All 1 paths already cached"5059worker1 # [ 59.985221] nix-grpc-daemon[789]: ts=2026-09-20T09:33:06Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05060worker1 # [ 59.987335] nix-grpc-daemon[789]: ts=2026-09-20T09:33:06Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15061worker2 # [ 59.976159] nix-grpc-daemon[787]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428765062worker2 # [ 59.983621] nix-grpc-daemon[787]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428765063client # copying 1 paths to 'lb:50051'...5064client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5065worker2 # [ 59.996540] nix-grpc-daemon[787]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428765066worker2 # [ 60.000548] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5067worker2 # [ 60.009182] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5)5068worker2 # [ 60.023528] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 157 ms (attempt 2/5)5069worker2 # [ 60.183595] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 3/5)5070worker2 # [ 60.197393] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 473 ms (attempt 4/5)5071worker2 # [ 60.678076] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5072worker2 # [ 60.683263] nix-grpc-daemon[787]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5073worker2 # [ 60.887092] nix-daemon[845]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)5074worker2 # [ 60.899138] nix-daemon[845]: reaped child process 1156, status = succeeded5075worker2 # [ 61.028486] nix-daemon[845]: accepted connection from pid 1158, user nix-grpc-daemon (trusted)5076worker2 # [ 61.041330] nix-daemon[845]: reaped child process 1161, status = succeeded5077lb # [ 61.065094] niks3-server[1030]: 2026/09/20 09:33:08 INFO Received uploads request method=POST path=/api/pending_closures5078worker2 # [ 61.060673] nix-grpc-daemon[855]: time=2026-09-20T09:33:07.399Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5079worker2 # [ 61.062021] nix-grpc-daemon[855]: time=2026-09-20T09:33:07.400Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5080lb # [ 61.090560] niks3-server[1030]: 2026/09/20 09:33:08 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5081lb # [ 61.099178] niks3-server[1030]: 2026/09/20 09:33:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5082lb # [ 61.103363] niks3-server[1030]: 2026/09/20 09:33:08 INFO Signed narinfos id=21 count=15083worker2 # [ 61.093687] nix-grpc-daemon[855]: time=2026-09-20T09:33:07.433Z level=INFO msg="Uploading 1 narinfos"5084lb # [ 61.116072] niks3-server[1030]: 2026/09/20 09:33:08 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5085lb # [ 61.122439] niks3-server[1030]: 2026/09/20 09:33:08 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5086worker2 # [ 61.114868] nix-grpc-daemon[855]: time=2026-09-20T09:33:07.454Z level=INFO msg="Upload complete. (412ms)"5087lb # [ 61.127851] niks3-server[1030]: 2026/09/20 09:33:08 INFO Completed upload id=215088worker2 # [ 61.116747] nix-grpc-daemon[787]: ts=2026-09-20T09:33:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 paths=1 nar_bytes_in=5605089lb # [ 61.132688] niks3-server[1030]: 2026/09/20 09:33:08 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5090worker2 # [ 61.123216] nix-daemon[845]: reaped child process 1147, status = succeeded5091worker2 # [ 61.124821] nix-grpc-daemon[787]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428765092worker2 # [ 61.129044] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5093worker2 # [ 61.137156] nix-grpc-daemon[787]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5094worker2 # [ 61.145475] nix-daemon[845]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5095client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5096client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5097worker2 # [ 62.173619] nix-daemon[845]: reaped child process 1166, status = succeeded5098worker2 # [ 62.340243] nix-daemon[845]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5099worker2 # [ 62.352892] nix-daemon[845]: reaped child process 1184, status = succeeded5100lb # [ 62.377998] niks3-server[1030]: 2026/09/20 09:33:09 INFO Received uploads request method=POST path=/api/pending_closures5101worker2 # [ 62.369209] nix-grpc-daemon[855]: time=2026-09-20T09:33:08.708Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5102lb # [ 62.394445] niks3-server[1030]: 2026/09/20 09:33:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5103lb # [ 62.397045] niks3-server[1030]: 2026/09/20 09:33:09 INFO Signed narinfos id=22 count=15104worker2 # [ 62.385903] nix-grpc-daemon[855]: time=2026-09-20T09:33:08.725Z level=INFO msg="Uploading 1 narinfos"5105lb # [ 62.401193] niks3-server[1030]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5106lb # [ 62.403551] niks3-server[1030]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5107lb # [ 62.407835] niks3-server[1030]: 2026/09/20 09:33:09 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5108lb # [ 62.411550] niks3-server[1030]: 2026/09/20 09:33:09 INFO Completed upload id=225109worker2 # [ 62.400117] nix-grpc-daemon[855]: time=2026-09-20T09:33:08.739Z level=INFO msg="Upload complete. (244ms)"5110lb # [ 62.412905] niks3-server[1030]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5111worker2 # [ 62.402556] nix-grpc-daemon[787]: ts=2026-09-20T09:33:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15112worker2 # [ 62.409221] nix-daemon[845]: reaped child process 1163, status = succeeded5113client # copying 1 paths...5114worker1 # [ 62.459983] nix-grpc-daemon[789]: ts=2026-09-20T09:33:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:466285115worker1 # [ 62.466578] nix-grpc-daemon[789]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5116client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5117worker2 # [ 62.471037] nix-grpc-daemon[787]: ts=2026-09-20T09:33:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:428765118worker2 # [ 62.473208] nix-grpc-daemon[787]: ts=2026-09-20T09:33:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_out=1205119client # [ 62.549587] nix-daemon[935]: reaped child process 1039, status = succeeded5120client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.92 seconds)5121client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25122client # [ 62.683064] nix-daemon[935]: accepted connection from pid 1057, user root (trusted)5123client # this derivation will be built:5124client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5125worker1 # [ 62.853039] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466285126worker2 # [ 62.837542] nix-grpc-daemon[787]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:428765127client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5128worker1 # [ 62.858964] nix-grpc-daemon[905]: time=2026-09-20T09:33:09.141Z level=INFO msg="All 1 paths already cached"5129worker1 # [ 62.873289] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05130worker1 # [ 62.879261] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15131worker1 # [ 62.885315] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:466285132worker1 # [ 62.896121] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:466285133worker1 # [ 62.908273] nix-grpc-daemon[905]: time=2026-09-20T09:33:09.191Z level=INFO msg="All 1 paths already cached"5134client # copying 1 paths to 'lb:50051'...5135client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5136worker1 # [ 62.915124] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:466285137worker1 # [ 62.925738] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5138worker1 # [ 63.077324] nix-daemon[852]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5139worker1 # [ 63.089923] nix-daemon[852]: reaped child process 1040, status = succeeded5140worker1 # [ 63.241645] nix-daemon[852]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)5141worker1 # [ 63.253502] nix-daemon[852]: reaped child process 1045, status = succeeded5142lb # [ 63.266904] niks3-server[1030]: 2026/09/20 09:33:10 INFO Received uploads request method=POST path=/api/pending_closures5143worker1 # [ 63.275469] nix-grpc-daemon[905]: time=2026-09-20T09:33:09.558Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5144worker1 # [ 63.276984] nix-grpc-daemon[905]: time=2026-09-20T09:33:09.560Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5145lb # [ 63.293567] niks3-server[1030]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5146lb # [ 63.305768] niks3-server[1030]: 2026/09/20 09:33:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5147lb # [ 63.312245] niks3-server[1030]: 2026/09/20 09:33:10 INFO Signed narinfos id=23 count=15148worker1 # [ 63.316101] nix-grpc-daemon[905]: time=2026-09-20T09:33:09.599Z level=INFO msg="Uploading 1 narinfos"5149lb # [ 63.315680] niks3-server[1030]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5150lb # [ 63.328374] niks3-server[1030]: 2026/09/20 09:33:10 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5151lb # [ 63.332995] niks3-server[1030]: 2026/09/20 09:33:10 INFO Completed upload id=235152worker1 # [ 63.336602] nix-grpc-daemon[905]: time=2026-09-20T09:33:09.619Z level=INFO msg="Upload complete. (400ms)"5153lb # [ 63.338058] niks3-server[1030]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5154worker1 # [ 63.339672] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=0 paths=1 nar_bytes_in=5605155worker1 # [ 63.345626] nix-grpc-daemon[789]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:466285156worker1 # [ 63.355265] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5157worker1 # [ 63.358090] nix-daemon[852]: reaped child process 1035, status = succeeded5158worker1 # [ 63.363961] nix-daemon[852]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5159client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5160client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5161worker1 # [ 64.577423] nix-daemon[852]: reaped child process 1049, status = succeeded5162worker1 # [ 64.692072] nix-daemon[852]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)5163worker1 # [ 64.703462] nix-daemon[852]: reaped child process 1067, status = succeeded5164lb # [ 64.717446] niks3-server[1030]: 2026/09/20 09:33:11 INFO Received uploads request method=POST path=/api/pending_closures5165worker1 # [ 64.727273] nix-grpc-daemon[905]: time=2026-09-20T09:33:11.009Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5166lb # [ 64.743722] niks3-server[1030]: 2026/09/20 09:33:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5167lb # [ 64.749889] niks3-server[1030]: 2026/09/20 09:33:11 INFO Signed narinfos id=24 count=15168worker1 # [ 64.754139] nix-grpc-daemon[905]: time=2026-09-20T09:33:11.037Z level=INFO msg="Uploading 1 narinfos"5169lb # [ 64.758611] niks3-server[1030]: 2026/09/20 09:33:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5170lb # [ 64.766804] niks3-server[1030]: 2026/09/20 09:33:11 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5171lb # [ 64.776093] niks3-server[1030]: 2026/09/20 09:33:11 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5172worker1 # [ 64.783762] nix-grpc-daemon[905]: time=2026-09-20T09:33:11.067Z level=INFO msg="Upload complete. (213ms)"5173lb # [ 64.782936] niks3-server[1030]: 2026/09/20 09:33:11 INFO Completed upload id=245174lb # [ 64.785202] niks3-server[1030]: 2026/09/20 09:33:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5175worker1 # [ 64.786156] nix-grpc-daemon[789]: ts=2026-09-20T09:33:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46628 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15176worker1 # [ 64.799202] nix-daemon[852]: reaped child process 1047, status = succeeded5177client # copying 1 paths...5178worker2 # [ 64.820162] nix-grpc-daemon[787]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:428765179worker2 # [ 64.831777] nix-grpc-daemon[787]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5180client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5181worker2 # [ 64.863740] nix-grpc-daemon[787]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:428765182worker2 # [ 64.868356] nix-grpc-daemon[787]: ts=2026-09-20T09:33:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42876 duration_s=0 paths=1 nar_bytes_out=1205183client # [ 64.952061] nix-daemon[935]: reaped child process 1060, status = succeeded5184client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.41 seconds)5185(finished: subtest: an input only one worker has still reaches the builder, in 8.76 seconds)5186subtest: upload whose reference the worker lacks is completed from the cache5187client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5188client # this derivation will be built:5189client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5190client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5191client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds)5192client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5193client # this derivation will be built:5194client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5195client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5196client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds)5197client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5198client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5199worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5200worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds)5201worker2 # [ 66.140162] systemd[1]: Stopping Nix worker-protocol over gRPC...5202worker2 # [ 66.625178] nix-grpc-daemon[787]: ts=2026-09-20T09:33:12Z level=info event=signal_exit5203worker2 # [ 67.884426] nix-grpc-daemon[787]: ts=2026-09-20T09:33:14Z level=info event=scheduler_restarting5204worker1 # [ 67.908559] nix-grpc-daemon[789]: ts=2026-09-20T09:33:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:466145205worker1 # [ 67.911953] nix-grpc-daemon[789]: ts=2026-09-20T09:33:14Z level=info event=worker_gone addr=192.168.1.4:500515206worker2 # [ 67.906585] nix-grpc-daemon[787]: ts=2026-09-20T09:33:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5207worker2 # [ 67.980120] nix-daemon[845]: reaped child process 847, status = succeeded5208lb # [ 68.372935] envoy[920]: conn peer=[2001:db8:1::1]:59408 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3832 tx=1858 ms=22195209lb # [ 68.374559] envoy[920]: conn peer=[2001:db8:1::1]:59412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=175210lb # [ 68.375990] envoy[920]: conn peer=[2001:db8:1::1]:59418 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1917 ms=25745211lb # [ 68.377557] envoy[920]: conn peer=[2001:db8:1::1]:59428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=485212lb # [ 68.379047] envoy[920]: conn peer=[2001:db8:1::1]:37056 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1893 ms=20825213lb # [ 68.380463] envoy[920]: conn peer=[2001:db8:1::1]:37064 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=585214lb # [ 68.381889] envoy[920]: conn peer=192.168.1.4:48486 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10410 tx=2287 ms=483625215worker2 # [ 68.744360] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5216worker2 # [ 68.747829] nix-grpc-daemon[787]: E0000 00:00:1789896795.083492 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5217worker2 # [ 68.752448] nix-grpc-daemon[787]: E0000 00:00:1789896795.084024 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5218worker2 # [ 69.438680] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5219worker2 # [ 69.444256] systemd[1]: Stopped Nix worker-protocol over gRPC.5220worker2 # [ 69.447335] systemd[1]: nix-grpc-daemon.service: Consumed 2.497s CPU time over 51.087s wall clock time, 60.7M memory peak, 79.4K incoming IP traffic, 147.4K outgoing IP traffic.5221worker2 # [ 69.458879] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5222worker2 # [ 69.462661] systemd[1]: Closed Nix worker-protocol over gRPC.5223worker2 # [ 69.465616] systemd[1]: nix-grpc-daemon.socket: Consumed 292us CPU time over 1min 364ms wall clock time, 256K memory peak, 71.4K incoming IP traffic, 58.8K outgoing IP traffic.5224lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5225lb: must succeed: curl -sf localhost:9901/clusters5226lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5227lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5228client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25229worker1 # [ 69.757980] nix-grpc-daemon[789]: ts=2026-09-20T09:33:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:466285230client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5231worker1 # [ 69.760289] nix-grpc-daemon[789]: ts=2026-09-20T09:33:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:466285232client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.22 seconds)5233worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5234worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5235worker2 # [ 69.848603] systemd[1]: Listening on Nix worker-protocol over gRPC.5236worker1 # [ 69.919591] systemd[1]: Stopping Nix worker-protocol over gRPC...5237worker2 # [ 70.427188] systemd[1]: Starting Nix worker-protocol over gRPC...5238worker2 # [ 70.597819] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5239worker2 # [ 70.601439] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15240worker2 # [ 70.608097] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5241worker2 # [ 70.612302] systemd[1]: Started Nix worker-protocol over gRPC.5242worker2 # [ 70.639467] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:16Z level=info event=scheduler_connected addr=lb:500515243worker1 # [ 70.653827] nix-grpc-daemon[789]: ts=2026-09-20T09:33:16Z level=info event=signal_exit5244worker1 # [ 70.657950] nix-grpc-daemon[789]: ts=2026-09-20T09:33:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05245worker1 # [ 70.911764] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_yield5246lb # [ 70.913982] niks3-server[1030]: 2026/09/20 09:33:17 INFO lead: released remote=192.168.1.3:480585247worker2 # [ 70.900387] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:17Z level=info event=scheduler_restarting addr=lb:500515248worker1 # [ 70.917065] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:466145249worker1 # [ 70.920394] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=worker_gone addr=192.168.1.4:500515250worker1 # [ 70.925683] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:466145251worker1 # [ 70.928941] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=worker_gone addr=192.168.1.3:500515252worker1 # [ 70.931910] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_restarting addr=lb:500515253worker2 # [ 71.101435] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:17Z level=info event=scheduler_connected addr=lb:500515254worker2 # [ 71.106145] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5255worker1 # [ 71.126314] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_connected addr=lb:500515256worker1 # [ 71.130159] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5257worker2 # [ 71.306820] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:17Z level=info event=scheduler_connected addr=lb:500515258worker2 # [ 71.311357] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5259worker1 # [ 71.331166] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_connected addr=lb:500515260worker1 # [ 71.335499] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5261worker2 # [ 71.511981] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:17Z level=info event=scheduler_connected addr=lb:500515262worker2 # [ 71.516163] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5263worker1 # [ 71.535602] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_connected addr=lb:500515264worker1 # [ 71.537319] nix-grpc-daemon[789]: ts=2026-09-20T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5265worker2 # [ 71.718513] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515266worker2 # [ 71.721707] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5267worker1 # [ 71.738369] nix-grpc-daemon[789]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515268worker1 # [ 71.742209] nix-grpc-daemon[789]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5269worker1 # [ 71.912605] nix-grpc-daemon[789]: ts=2026-09-20T09:33:18Z level=info event=scheduler_restarting5270worker1 # [ 71.932946] nix-daemon[852]: reaped child process 854, status = succeeded5271worker2 # [ 71.919252] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515272worker2 # [ 71.923177] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5273worker1 # [ 71.953982] nix-grpc-daemon[789]: ts=2026-09-20T09:33:18Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5274worker2 # [ 72.123844] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515275worker2 # [ 72.127650] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5276worker2 # [ 72.328469] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515277worker2 # [ 72.332368] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5278worker2 # [ 72.533482] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_connected addr=lb:500515279worker2 # [ 72.537185] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5280worker2 # [ 72.738680] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515281worker2 # [ 72.742472] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5282worker1 # [ 72.805606] nix-grpc-daemon[789]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5283worker1 # [ 72.808911] nix-grpc-daemon[789]: E0000 00:00:1789896799.088027 832 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5284worker1 # [ 72.813582] nix-grpc-daemon[789]: E0000 00:00:1789896799.088844 832 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5285worker2 # [ 72.943512] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515286worker2 # [ 72.947389] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5287worker2 # [ 73.147726] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515288worker2 # [ 73.149433] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5289worker2 # [ 73.349896] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515290worker2 # [ 73.351631] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5291worker1 # [ 73.383642] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5292worker1 # [ 73.387821] systemd[1]: Stopped Nix worker-protocol over gRPC.5293worker1 # [ 73.391660] systemd[1]: nix-grpc-daemon.service: Consumed 1.425s CPU time over 55.022s wall clock time, 52.9M memory peak, 58.3K incoming IP traffic, 109.8K outgoing IP traffic.5294worker1 # [ 73.401607] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5295worker1 # [ 73.405790] systemd[1]: Closed Nix worker-protocol over gRPC.5296worker1 # [ 73.408974] systemd[1]: nix-grpc-daemon.socket: Consumed 292us CPU time over 1min 3.283s wall clock time, 256K memory peak, 75.1K incoming IP traffic, 63.6K outgoing IP traffic.5297lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5298lb: must succeed: curl -sf localhost:9901/clusters5299lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5300lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5301client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25302worker2 # [ 73.552195] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_connected addr=lb:500515303worker2 # [ 73.553933] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5304worker2 # [ 73.689869] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:569805305worker2 # [ 73.695195] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5306worker2 # [ 73.703044] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 1/5)5307worker2 # [ 73.719361] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 2/5)5308worker2 # [ 73.731645] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 3/5)5309worker2 # [ 73.755712] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515310worker2 # [ 73.757476] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 724 ms (attempt 4/5)5311worker2 # [ 73.759536] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5312worker2 # [ 73.958597] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515313worker2 # [ 73.962489] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5314worker2 # [ 74.163426] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515315worker2 # [ 74.167250] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5316worker2 # [ 74.368061] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515317worker2 # [ 74.371873] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5318worker2 # [ 74.485919] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5319client # copying 2 paths...5320client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5321worker2 # [ 74.507608] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:569805322client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5323worker2 # [ 74.517440] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5324worker2 # [ 74.539176] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=niks3_push_started pid=12625325worker2 # [ 74.572600] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_connected addr=lb:500515326worker2 # [ 74.575972] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5327worker2 # [ 74.776978] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515328worker2 # [ 74.778879] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5329worker2 # [ 74.893702] nix-daemon[845]: accepted connection from pid 1275, user nix-grpc-daemon (trusted)5330worker2 # [ 74.904343] nix-daemon[845]: reaped child process 1278, status = succeeded5331lb # [ 74.934485] niks3-server[1030]: 2026/09/20 09:33:21 INFO Received uploads request method=POST path=/api/pending_closures5332lb # [ 74.944359] niks3-server[1030]: 2026/09/20 09:33:21 INFO Received uploads request method=POST path=/api/pending_closures5333worker2 # [ 74.939025] nix-grpc-daemon[1262]: time=2026-09-20T09:33:21.278Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5334worker2 # [ 74.942053] nix-grpc-daemon[1262]: time=2026-09-20T09:33:21.280Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5335worker2 # [ 74.943690] nix-grpc-daemon[1262]: time=2026-09-20T09:33:21.280Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5336worker2 # [ 74.979184] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515337worker2 # [ 74.980823] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5338lb # [ 74.997784] niks3-server[1030]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5339lb # [ 75.002408] niks3-server[1030]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5340lb # [ 75.018696] niks3-server[1030]: 2026/09/20 09:33:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5341lb # [ 75.020838] niks3-server[1030]: 2026/09/20 09:33:21 INFO Signed narinfos id=25 count=15342lb # [ 75.023467] niks3-server[1030]: 2026/09/20 09:33:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5343lb # [ 75.025589] niks3-server[1030]: 2026/09/20 09:33:21 INFO Signed narinfos id=26 count=25344worker2 # [ 75.014123] nix-grpc-daemon[1262]: time=2026-09-20T09:33:21.353Z level=INFO msg="Uploading 3 narinfos"5345lb # [ 75.028302] niks3-server[1030]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5346lb # [ 75.031834] niks3-server[1030]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5347lb # [ 75.041150] niks3-server[1030]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5348lb # [ 75.045632] niks3-server[1030]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5349lb # [ 75.049449] niks3-server[1030]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5350lb # [ 75.052435] niks3-server[1030]: 2026/09/20 09:33:22 INFO Completed upload id=255351lb # [ 75.054280] niks3-server[1030]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5352lb # [ 75.056948] niks3-server[1030]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5353lb # [ 75.059200] niks3-server[1030]: 2026/09/20 09:33:22 INFO Completed upload id=265354worker2 # [ 75.047137] nix-grpc-daemon[1262]: time=2026-09-20T09:33:21.386Z level=INFO msg="Upload complete. (315ms)"5355worker2 # [ 75.051813] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=2 nar_bytes_in=3125356worker2 # [ 75.063612] nix-daemon[845]: reaped child process 1260, status = succeeded5357client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.61 seconds)5358worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5359worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5360worker1 # [ 75.183928] systemd[1]: Listening on Nix worker-protocol over gRPC.5361worker1 # [ 75.191517] systemd[1]: Starting Nix worker-protocol over gRPC...5362worker2 # [ 75.181704] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515363worker2 # [ 75.185539] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5364worker1 # [ 75.322646] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5365worker1 # [ 75.325142] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15366worker1 # [ 75.330959] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5367worker1 # [ 75.336305] systemd[1]: Started Nix worker-protocol over gRPC.5368lb # [ 75.338972] niks3-server[1030]: 2026/09/20 09:33:22 INFO lead: acquired remote=192.168.1.3:481205369worker1 # [ 75.344330] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=scheduler_take_over5370lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5371lb: must succeed: curl -sf localhost:9901/clusters5372worker1 # [ 75.369850] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515373worker1 # [ 75.373976] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5374worker2 # [ 75.386386] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515375worker1 # [ 75.401723] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05376lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5377lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5378(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.43 seconds)5379subtest: scheduler down: the other node takes the lock and keeps it5380lb: must succeed: curl -sf localhost:9901/clusters5381lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5382lb: must succeed: curl -sf localhost:9901/clusters5383lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5384lb: must succeed: curl -sf localhost:9901/clusters5385lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5386lb: must succeed: curl -sf localhost:9901/clusters5387worker1 # [ 75.575216] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=scheduler_connected addr=lb:500515388worker1 # [ 75.579798] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05389lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5390worker1 # [ 75.640708] systemd[1]: Stopping Nix worker-protocol over gRPC...5391worker1 # [ 76.332222] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:22Z level=info event=signal_exit5392worker1 # [ 76.539721] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:22Z level=info event=scheduler_yield5393lb # [ 76.542167] niks3-server[1030]: 2026/09/20 09:33:23 INFO lead: released remote=192.168.1.3:481205394worker1 # [ 76.543924] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:22Z level=info event=scheduler_restarting addr=lb:500515395worker1 # [ 76.547948] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:368225396worker2 # [ 76.537341] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:22Z level=info event=scheduler_restarting addr=lb:500515397worker1 # [ 76.552547] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:22Z level=info event=worker_gone addr=192.168.1.3:500515398worker1 # [ 76.555642] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:368225399worker1 # [ 76.558866] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:22Z level=info event=worker_gone addr=192.168.1.4:500515400worker1 # [ 76.744681] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515401worker1 # [ 76.748587] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5402worker2 # [ 76.737271] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515403worker2 # [ 76.741159] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5404worker1 # [ 76.949354] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515405worker2 # [ 76.941527] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515406worker1 # [ 76.953171] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5407worker2 # [ 76.943414] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5408worker1 # [ 77.154061] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515409worker2 # [ 77.144387] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515410worker1 # [ 77.158341] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5411worker2 # [ 77.148307] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5412worker1 # [ 77.359762] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515413worker2 # [ 77.348577] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515414worker2 # [ 77.350352] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5415worker1 # [ 77.363605] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5416worker1 # [ 77.540937] nix-grpc-daemon[1090]: ts=2026-09-20T09:33:23Z level=info event=scheduler_restarting5417worker2 # [ 77.552626] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_connected addr=lb:500515418worker2 # [ 77.555674] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5419worker2 # [ 77.753550] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515420worker2 # [ 77.757601] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5421worker2 # [ 77.958399] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515422worker2 # [ 77.962309] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5423worker2 # [ 78.163073] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515424worker2 # [ 78.167145] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5425lb # [ 78.373664] envoy[920]: conn peer=[2001:db8:1::1]:37076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=95426worker2 # [ 78.367272] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515427lb # [ 78.377447] envoy[920]: conn peer=[2001:db8:1::3]:41450 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11926 tx=2299 ms=532565428worker2 # [ 78.369433] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5429lb # [ 78.382279] envoy[920]: conn peer=[2001:db8:1::1]:38166 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=282 ms=13725430lb # [ 78.388167] envoy[920]: conn peer=[2001:db8:1::3]:43552 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1547 tx=377 ms=22065431worker1 # [ 78.390470] nix-grpc-daemon[1090]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5432worker1 # [ 78.394141] nix-grpc-daemon[1090]: E0000 00:00:1789896804.672649 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5433worker1 # [ 78.398833] nix-grpc-daemon[1090]: E0000 00:00:1789896804.672860 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5434worker2 # [ 78.571452] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_connected addr=lb:500515435worker2 # [ 78.575179] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5436worker2 # [ 78.775917] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515437worker2 # [ 78.779774] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5438worker2 # [ 78.980589] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515439worker2 # [ 78.984414] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5440worker2 # [ 79.184755] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515441worker2 # [ 79.186581] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5442worker1 # [ 79.361538] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5443worker1 # [ 79.364896] systemd[1]: Stopped Nix worker-protocol over gRPC.5444worker1 # [ 79.369387] systemd[1]: nix-grpc-daemon.service: Consumed 129ms CPU time over 4.170s wall clock time, 12.3M memory peak, 7.4K incoming IP traffic, 7.8K outgoing IP traffic.5445worker1 # [ 79.379804] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5446worker1 # [ 79.383162] systemd[1]: Closed Nix worker-protocol over gRPC.5447worker1 # [ 79.385913] systemd[1]: nix-grpc-daemon.socket: Consumed 528us CPU time over 4.205s wall clock time, 256K memory peak, 13K incoming IP traffic, 10.5K outgoing IP traffic.5448worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5449worker2 # [ 79.387226] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515450worker2 # [ 79.389066] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5451worker2 # [ 79.590660] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_connected addr=lb:500515452worker2 # [ 79.594365] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5453worker2 # [ 79.795362] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515454worker2 # [ 79.799547] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5455worker2 # [ 79.999876] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515456worker2 # [ 80.001621] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5457worker2 # [ 80.202594] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515458worker2 # [ 80.206535] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5459worker2 # [ 80.407282] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515460worker2 # [ 80.411202] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5461worker2 # [ 80.612926] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500515462worker2 # [ 80.616567] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5463worker2 # [ 80.621148] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:26Z level=info event=scheduler_take_over5464lb # [ 80.634174] niks3-server[1030]: 2026/09/20 09:33:27 INFO lead: acquired remote=192.168.1.4:512925465worker2 # [ 80.817408] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500515466worker2 # [ 80.831272] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05467worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.19 seconds)5468worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5469worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5470client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25471worker2 # [ 81.824570] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:569805472client # don't know how to build these paths:5473client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5474worker2 # [ 81.833098] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:569805475worker2 # [ 81.854371] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05476worker2 # [ 81.859483] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=15477worker2 # [ 81.898944] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805478worker2 # [ 81.911408] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:569805479client # copying 1 paths to 'lb:50051'...5480client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5481worker2 # [ 81.924073] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:569805482worker2 # [ 81.935142] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5483worker2 # [ 82.134875] nix-daemon[845]: accepted connection from pid 1310, user nix-grpc-daemon (trusted)5484worker2 # [ 82.147324] nix-daemon[845]: reaped child process 1313, status = succeeded5485worker2 # [ 82.303186] nix-daemon[845]: accepted connection from pid 1315, user nix-grpc-daemon (trusted)5486worker2 # [ 82.314913] nix-daemon[845]: reaped child process 1318, status = succeeded5487lb # [ 82.339909] niks3-server[1030]: 2026/09/20 09:33:29 INFO Received uploads request method=POST path=/api/pending_closures5488worker2 # [ 82.336414] nix-grpc-daemon[1262]: time=2026-09-20T09:33:28.675Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5489worker2 # [ 82.338259] nix-grpc-daemon[1262]: time=2026-09-20T09:33:28.677Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5490lb # [ 82.369854] niks3-server[1030]: 2026/09/20 09:33:29 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5491lb # [ 82.381386] niks3-server[1030]: 2026/09/20 09:33:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5492lb # [ 82.393806] niks3-server[1030]: 2026/09/20 09:33:29 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5493lb # [ 82.402727] niks3-server[1030]: 2026/09/20 09:33:29 INFO Signed narinfos id=27 count=15494worker2 # [ 82.393268] nix-grpc-daemon[1262]: time=2026-09-20T09:33:28.732Z level=INFO msg="Uploading 1 narinfos"5495lb # [ 82.414386] niks3-server[1030]: 2026/09/20 09:33:29 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5496lb # [ 82.417669] niks3-server[1030]: 2026/09/20 09:33:29 INFO Completed upload id=275497worker2 # [ 82.406631] nix-grpc-daemon[1262]: time=2026-09-20T09:33:28.746Z level=INFO msg="Upload complete. (460ms)"5498worker2 # [ 82.408607] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=5205499lb # [ 82.424049] niks3-server[1030]: 2026/09/20 09:33:29 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5500worker2 # [ 82.411640] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805501worker2 # [ 82.417762] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5502worker2 # [ 82.420799] nix-daemon[845]: reaped child process 1308, status = succeeded5503worker2 # [ 82.425511] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5504client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5505client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5506client # farm-a> LOG-farm-a-on-standby5507worker2 # [ 84.039935] nix-daemon[845]: reaped child process 1322, status = succeeded5508worker2 # [ 84.188592] nix-daemon[845]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5509worker2 # [ 84.200889] nix-daemon[845]: reaped child process 1340, status = succeeded5510lb # [ 84.230894] niks3-server[1030]: 2026/09/20 09:33:31 INFO Received uploads request method=POST path=/api/pending_closures5511worker2 # [ 84.228986] nix-grpc-daemon[1262]: time=2026-09-20T09:33:30.568Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5512worker2 # [ 84.230526] nix-grpc-daemon[1262]: time=2026-09-20T09:33:30.570Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5513lb # [ 84.272164] niks3-server[1030]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5514lb # [ 84.278621] niks3-server[1030]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5515lb # [ 84.289649] niks3-server[1030]: 2026/09/20 09:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5516lb # [ 84.294499] niks3-server[1030]: 2026/09/20 09:33:31 INFO Signed narinfos id=28 count=15517worker2 # [ 84.284436] nix-grpc-daemon[1262]: time=2026-09-20T09:33:30.624Z level=INFO msg="Uploading 1 narinfos"5518lb # [ 84.298588] niks3-server[1030]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5519lb # [ 84.308790] niks3-server[1030]: 2026/09/20 09:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5520lb # [ 84.314398] niks3-server[1030]: 2026/09/20 09:33:31 INFO Completed upload id=285521worker2 # [ 84.302148] nix-grpc-daemon[1262]: time=2026-09-20T09:33:30.641Z level=INFO msg="Upload complete. (268ms)"5522lb # [ 84.319233] niks3-server[1030]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5523worker2 # [ 84.310748] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15524worker2 # [ 84.330101] nix-daemon[845]: reaped child process 1320, status = succeeded5525worker2 # [ 84.331539] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:30Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05526worker2 # [ 84.333494] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:30Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=15527worker2 # [ 84.376266] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805528worker2 # [ 84.388434] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:569805529worker2 # [ 84.401217] nix-grpc-daemon[1262]: time=2026-09-20T09:33:30.740Z level=INFO msg="All 1 paths already cached"5530client # copying 1 paths to 'lb:50051'...5531client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5532worker2 # [ 84.409066] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:569805533worker2 # [ 84.417371] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5534worker2 # [ 84.585968] nix-daemon[845]: accepted connection from pid 1346, user nix-grpc-daemon (trusted)5535worker2 # [ 84.598190] nix-daemon[845]: reaped child process 1349, status = succeeded5536worker2 # [ 84.749809] nix-daemon[845]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5537worker2 # [ 84.762104] nix-daemon[845]: reaped child process 1354, status = succeeded5538lb # [ 84.790637] niks3-server[1030]: 2026/09/20 09:33:31 INFO Received uploads request method=POST path=/api/pending_closures5539worker2 # [ 84.785099] nix-grpc-daemon[1262]: time=2026-09-20T09:33:31.124Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5540worker2 # [ 84.786591] nix-grpc-daemon[1262]: time=2026-09-20T09:33:31.126Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5541lb # [ 84.818286] niks3-server[1030]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5542lb # [ 84.830196] niks3-server[1030]: 2026/09/20 09:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5543worker2 # [ 84.822221] nix-grpc-daemon[1262]: time=2026-09-20T09:33:31.161Z level=INFO msg="Uploading 1 narinfos"5544lb # [ 84.835251] niks3-server[1030]: 2026/09/20 09:33:31 INFO Signed narinfos id=29 count=15545lb # [ 84.841161] niks3-server[1030]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5546lb # [ 84.852791] niks3-server[1030]: 2026/09/20 09:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5547worker2 # [ 84.846160] nix-grpc-daemon[1262]: time=2026-09-20T09:33:31.185Z level=INFO msg="Upload complete. (415ms)"5548lb # [ 84.858841] niks3-server[1030]: 2026/09/20 09:33:31 INFO Completed upload id=295549lb # [ 84.862477] niks3-server[1030]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5550worker2 # [ 84.849180] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=6405551worker2 # [ 84.854267] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805552worker2 # [ 84.862880] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5553worker2 # [ 84.868292] nix-daemon[845]: reaped child process 1344, status = succeeded5554client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5555worker2 # [ 84.874329] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5556client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5557client # farm-b> LOG-farm-b-on-standby5558worker2 # [ 86.296893] nix-daemon[845]: reaped child process 1358, status = succeeded5559worker2 # [ 86.430322] nix-daemon[845]: accepted connection from pid 1373, user nix-grpc-daemon (trusted)5560worker2 # [ 86.440770] nix-daemon[845]: reaped child process 1376, status = succeeded5561lb # [ 86.469077] niks3-server[1030]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures5562worker2 # [ 86.467669] nix-grpc-daemon[1262]: time=2026-09-20T09:33:32.807Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5563worker2 # [ 86.469166] nix-grpc-daemon[1262]: time=2026-09-20T09:33:32.808Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5564lb # [ 86.509240] niks3-server[1030]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5565lb # [ 86.520235] niks3-server[1030]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5566lb # [ 86.527163] niks3-server[1030]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5567lb # [ 86.538794] niks3-server[1030]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5568lb # [ 86.545995] niks3-server[1030]: 2026/09/20 09:33:33 INFO Signed narinfos id=30 count=15569worker2 # [ 86.536631] nix-grpc-daemon[1262]: time=2026-09-20T09:33:32.876Z level=INFO msg="Uploading 1 narinfos"5570lb # [ 86.555441] niks3-server[1030]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5571lb # [ 86.560321] niks3-server[1030]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5572lb # [ 86.565435] niks3-server[1030]: 2026/09/20 09:33:33 INFO Completed upload id=305573worker2 # [ 86.553304] nix-grpc-daemon[1262]: time=2026-09-20T09:33:32.892Z level=INFO msg="Upload complete. (272ms)"5574worker2 # [ 86.563306] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15575worker2 # [ 86.570992] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:32Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05576worker2 # [ 86.575969] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:32Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=15577worker2 # [ 86.585863] nix-daemon[845]: reaped child process 1356, status = succeeded5578worker2 # [ 86.614131] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805579worker2 # [ 86.625794] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:569805580worker2 # [ 86.638806] nix-grpc-daemon[1262]: time=2026-09-20T09:33:32.978Z level=INFO msg="All 2 paths already cached"5581client # copying 1 paths to 'lb:50051'...5582client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5583worker2 # [ 86.646756] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:569805584worker2 # [ 86.656641] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5585worker2 # [ 86.815759] nix-daemon[845]: accepted connection from pid 1382, user nix-grpc-daemon (trusted)5586worker2 # [ 86.828326] nix-daemon[845]: reaped child process 1385, status = succeeded5587worker2 # [ 86.959508] nix-daemon[845]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5588worker2 # [ 86.970947] nix-daemon[845]: reaped child process 1390, status = succeeded5589lb # [ 86.994396] niks3-server[1030]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures5590worker2 # [ 86.992421] nix-grpc-daemon[1262]: time=2026-09-20T09:33:33.332Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5591worker2 # [ 86.994228] nix-grpc-daemon[1262]: time=2026-09-20T09:33:33.333Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5592lb # [ 87.028200] niks3-server[1030]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5593lb # [ 87.037672] niks3-server[1030]: 2026/09/20 09:33:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5594lb # [ 87.044302] niks3-server[1030]: 2026/09/20 09:33:34 INFO Signed narinfos id=31 count=15595worker2 # [ 87.034867] nix-grpc-daemon[1262]: time=2026-09-20T09:33:33.374Z level=INFO msg="Uploading 1 narinfos"5596lb # [ 87.048907] niks3-server[1030]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5597lb # [ 87.059727] niks3-server[1030]: 2026/09/20 09:33:34 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5598worker2 # [ 87.053080] nix-grpc-daemon[1262]: time=2026-09-20T09:33:33.392Z level=INFO msg="Upload complete. (384ms)"5599lb # [ 87.065852] niks3-server[1030]: 2026/09/20 09:33:34 INFO Completed upload id=315600worker2 # [ 87.055284] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=7685601lb # [ 87.069117] niks3-server[1030]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5602worker2 # [ 87.060781] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805603worker2 # [ 87.068286] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5604worker2 # [ 87.073237] nix-daemon[845]: reaped child process 1380, status = succeeded5605client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5606worker2 # [ 87.078383] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5607client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5608client # farm-top> LOG-farm-top-on-standby5609worker2 # [ 88.494671] nix-daemon[845]: reaped child process 1394, status = succeeded5610worker2 # [ 88.610186] nix-daemon[845]: accepted connection from pid 1409, user nix-grpc-daemon (trusted)5611worker2 # [ 88.622769] nix-daemon[845]: reaped child process 1412, status = succeeded5612lb # [ 88.645834] niks3-server[1030]: 2026/09/20 09:33:35 INFO Received uploads request method=POST path=/api/pending_closures5613worker2 # [ 88.643515] nix-grpc-daemon[1262]: time=2026-09-20T09:33:34.983Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5614worker2 # [ 88.645258] nix-grpc-daemon[1262]: time=2026-09-20T09:33:34.984Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5615lb # [ 88.677076] niks3-server[1030]: 2026/09/20 09:33:35 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5616lb # [ 88.680860] niks3-server[1030]: 2026/09/20 09:33:35 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5617lb # [ 88.686716] niks3-server[1030]: 2026/09/20 09:33:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5618lb # [ 88.688394] niks3-server[1030]: 2026/09/20 09:33:35 INFO Signed narinfos id=32 count=15619worker2 # [ 88.677186] nix-grpc-daemon[1262]: time=2026-09-20T09:33:35.016Z level=INFO msg="Uploading 1 narinfos"5620lb # [ 88.692896] niks3-server[1030]: 2026/09/20 09:33:35 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5621lb # [ 88.697087] niks3-server[1030]: 2026/09/20 09:33:35 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5622lb # [ 88.703986] niks3-server[1030]: 2026/09/20 09:33:35 INFO Completed upload id=325623worker2 # [ 88.691425] nix-grpc-daemon[1262]: time=2026-09-20T09:33:35.031Z level=INFO msg="Upload complete. (206ms)"5624lb # [ 88.706248] niks3-server[1030]: 2026/09/20 09:33:35 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5625worker2 # [ 88.694202] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15626worker2 # [ 88.700874] nix-daemon[845]: reaped child process 1392, status = succeeded5627client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 7.13 seconds)5628client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5629client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.21 seconds)5630worker1 # [ 89.004922] systemd[1]: Listening on Nix worker-protocol over gRPC.5631worker1 # [ 89.009116] systemd[1]: Starting Nix worker-protocol over gRPC...5632worker1 # [ 89.167199] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5633worker1 # [ 89.170524] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15634worker1 # [ 89.177138] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5635worker1 # [ 89.178742] systemd[1]: Started Nix worker-protocol over gRPC.5636lb: must succeed: curl -sf localhost:9901/clusters5637worker1 # [ 89.213229] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500515638worker2 # [ 89.202740] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05639lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5640worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5641worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5642lb: must succeed: curl -sf localhost:9901/clusters5643lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5644lb: must succeed: curl -sf localhost:9901/clusters5645lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5646worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5647worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5648(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.09 seconds)5649subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5650client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5651client # [ 89.520391] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5652client # Running as unit: rs.service; invocation ID: 4f9cd20bfc684a90a99df2874f8388445653client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5654client # [ 89.716431] nix[1158]: don't know how to build these paths:5655client # [ 89.718103] nix[1158]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5656worker2 # [ 89.727108] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:569805657worker2 # [ 89.737556] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05658worker2 # [ 89.742684] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=15659worker2 # [ 89.782114] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805660worker2 # [ 89.793740] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:569805661client # [ 89.793264] nix[1158]: copying 1 paths to 'lb:50051'...5662worker2 # [ 89.805364] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:569805663client # [ 89.795136] nix[1158]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5664worker2 # [ 89.817786] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5665worker2 # [ 89.987557] nix-daemon[845]: accepted connection from pid 1427, user nix-grpc-daemon (trusted)5666worker2 # [ 89.999807] nix-daemon[845]: reaped child process 1430, status = succeeded5667worker2 # [ 90.157451] nix-daemon[845]: accepted connection from pid 1432, user nix-grpc-daemon (trusted)5668worker2 # [ 90.169285] nix-daemon[845]: reaped child process 1435, status = succeeded5669lb # [ 90.197545] niks3-server[1030]: 2026/09/20 09:33:37 INFO Received uploads request method=POST path=/api/pending_closures5670worker2 # [ 90.192635] nix-grpc-daemon[1262]: time=2026-09-20T09:33:36.531Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5671worker2 # [ 90.194077] nix-grpc-daemon[1262]: time=2026-09-20T09:33:36.531Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5672lb # [ 90.220659] niks3-server[1030]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5673lb # [ 90.232996] niks3-server[1030]: 2026/09/20 09:33:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5674lb # [ 90.238359] niks3-server[1030]: 2026/09/20 09:33:37 INFO Signed narinfos id=33 count=15675worker2 # [ 90.229124] nix-grpc-daemon[1262]: time=2026-09-20T09:33:36.568Z level=INFO msg="Uploading 1 narinfos"5676lb # [ 90.252849] niks3-server[1030]: 2026/09/20 09:33:37 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5677lb # [ 90.267896] niks3-server[1030]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5678lb # [ 90.276239] niks3-server[1030]: 2026/09/20 09:33:37 INFO Completed upload id=335679worker2 # [ 90.263788] nix-grpc-daemon[1262]: time=2026-09-20T09:33:36.603Z level=INFO msg="Upload complete. (435ms)"5680worker2 # [ 90.268148] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=4165681lb # [ 90.283496] niks3-server[1030]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5682worker2 # [ 90.274325] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:569805683worker2 # [ 90.285256] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5684worker2 # [ 90.293660] nix-daemon[845]: reaped child process 1425, status = succeeded5685client # [ 90.289305] nix[1158]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5686worker2 # [ 90.301259] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5687lb: must succeed: curl -sf localhost:9901/clusters5688lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5689lb: must succeed: curl -sf localhost:9901/clusters5690lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5691lb: must succeed: curl -sf localhost:9901/clusters5692lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5693lb: must succeed: curl -sf localhost:9901/clusters5694lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5695worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5696worker1 # [ 92.357906] systemd-journald[288]: Received client request to rotate journal, rotating.5697worker1 # [ 92.371554] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/0419b933cbbe4e838f9951dd1142d609.5698worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5699worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5700worker2 # [ 92.267616] systemd[1]: Stopping Nix worker-protocol over gRPC...5701worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5702??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5703 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735704client: must succeed: sleep 5.05705worker2 # [ 92.614399] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:38Z level=info event=draining5706client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5707worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5708worker2 # [ 97.733473] nix-daemon[845]: reaped child process 1439, status = succeeded5709worker2 # [ 97.897506] nix-daemon[845]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5710worker2 # [ 97.909376] nix-daemon[845]: reaped child process 1482, status = succeeded5711lb # [ 97.933725] niks3-server[1030]: 2026/09/20 09:33:44 INFO Received uploads request method=POST path=/api/pending_closures5712worker2 # [ 97.931252] nix-grpc-daemon[1262]: time=2026-09-20T09:33:44.270Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5713worker2 # [ 97.932684] nix-grpc-daemon[1262]: time=2026-09-20T09:33:44.272Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5714lb # [ 97.975567] niks3-server[1030]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5715lb # [ 97.982926] niks3-server[1030]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5716lb # [ 97.993861] niks3-server[1030]: 2026/09/20 09:33:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5717lb # [ 97.999087] niks3-server[1030]: 2026/09/20 09:33:44 INFO Signed narinfos id=34 count=15718worker2 # [ 97.989270] nix-grpc-daemon[1262]: time=2026-09-20T09:33:44.328Z level=INFO msg="Uploading 1 narinfos"5719lb # [ 98.004185] niks3-server[1030]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5720lb # [ 98.012338] niks3-server[1030]: 2026/09/20 09:33:44 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5721lb # [ 98.023208] niks3-server[1030]: 2026/09/20 09:33:44 INFO Completed upload id=345722lb # [ 98.024792] niks3-server[1030]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5723worker2 # [ 98.010913] nix-grpc-daemon[1262]: time=2026-09-20T09:33:44.350Z level=INFO msg="Upload complete. (296ms)"5724worker2 # [ 98.019669] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15725worker2 # [ 98.032705] nix-daemon[845]: reaped child process 1437, status = succeeded5726client # [ 98.039150] systemd[1]: rs.service: Deactivated successfully.5727client # [ 98.042598] systemd[1]: rs.service: Consumed 112ms CPU time over 8.521s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.5728lb # [ 98.374179] envoy[920]: conn peer=[2001:db8:1::1]:38168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9590 tx=3839 ms=68865729lb # [ 98.378475] envoy[920]: conn peer=[2001:db8:1::1]:36090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1326 ms=83025730worker2 # [ 98.616444] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:44Z level=info event=signal_exit5731worker2 # [ 98.845387] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_yield5732lb # [ 98.860085] niks3-server[1030]: 2026/09/20 09:33:45 INFO lead: released remote=192.168.1.4:512925733worker1 # [ 98.864154] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_restarting addr=lb:500515734worker2 # [ 98.849911] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_restarting addr=lb:500515735worker2 # [ 98.854300] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:569865736worker2 # [ 98.858561] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=worker_gone addr=192.168.1.3:500515737worker2 # [ 98.861767] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:569865738worker2 # [ 98.864923] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=worker_gone addr=192.168.1.4:500515739worker1 # [ 99.064427] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515740worker2 # [ 99.051690] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515741worker1 # [ 99.068506] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5742worker2 # [ 99.055579] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5743lb # [ 99.187609] niks3-server[1030]: 2026/09/20 09:33:46 INFO lead: acquired remote=192.168.1.3:344785744worker1 # [ 99.190422] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_take_over5745worker1 # [ 99.268952] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515746worker2 # [ 99.256688] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515747worker1 # [ 99.273129] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5748worker2 # [ 99.260624] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5749worker1 # [ 99.474081] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515750worker2 # [ 99.461523] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515751worker1 # [ 99.477989] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5752worker2 # [ 99.465783] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5753worker1 # [ 99.678975] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500515754worker2 # [ 99.666593] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515755worker1 # [ 99.684364] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5756worker2 # [ 99.671664] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5757worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.17 seconds)5758client: waiting for success: ! systemctl is-active rs5759client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5760client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5761client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5762client: must fail: journalctl -u rs | grep -q 'reconnecting'5763client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5764lb: must succeed: curl -sf localhost:9901/clusters5765worker2 # [ 99.849197] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:46Z level=info event=scheduler_restarting5766worker2 # [ 99.869911] nix-daemon[845]: reaped child process 1255, status = succeeded5767worker1 # [ 99.886134] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515768worker1 # [ 99.889770] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5769worker2 # [ 99.885823] nix-grpc-daemon[1206]: ts=2026-09-20T09:33:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5770lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5771worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5772worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5773worker1 # [ 100.086907] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515774worker1 # [ 100.091290] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5775worker1 # [ 100.291920] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515776worker1 # [ 100.296247] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5777worker1 # [ 100.496544] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500515778worker1 # [ 100.502695] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05779worker2 # [ 100.673235] nix-grpc-daemon[1206]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5780worker2 # [ 100.677193] nix-grpc-daemon[1206]: E0000 00:00:1789896827.012114 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5781worker2 # [ 100.681905] nix-grpc-daemon[1206]: E0000 00:00:1789896827.016752 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5782lb: must succeed: curl -sf localhost:9901/clusters5783lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5784worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5785worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5786worker2 # [ 101.364519] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5787worker2 # [ 101.368185] systemd[1]: Stopped Nix worker-protocol over gRPC.5788worker2 # [ 101.371508] systemd[1]: nix-grpc-daemon.service: Consumed 1.424s CPU time over 30.937s wall clock time, 35.7M memory peak, 60.2K incoming IP traffic, 117.5K outgoing IP traffic.5789worker2 # [ 101.387138] systemd[1]: Starting Nix worker-protocol over gRPC...5790worker2 # [ 101.536023] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5791worker2 # [ 101.538573] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15792worker2 # [ 101.544077] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5793worker2 # [ 101.547804] systemd[1]: Started Nix worker-protocol over gRPC.5794worker2 # [ 101.571615] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515795worker1 # [ 101.587267] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05796lb: must succeed: curl -sf localhost:9901/clusters5797lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5798worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5799worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5800(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.71 seconds)5801subtest: scheduler restart mid-build: build finishes, no double build5802client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5803client # [ 102.245691] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5804client # Running as unit: mid.service; invocation ID: dde54528bc9c4eb0a3973d6a44d702625805client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.06 seconds)5806worker1 # [ 102.446512] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552705807worker1 # [ 102.457711] nix-daemon[852]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5808client # [ 102.444435] nix[1193]: don't know how to build these paths:5809client # [ 102.445352] nix[1193]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5810worker1 # [ 102.477893] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:48Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05811worker1 # [ 102.483630] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:48Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15812worker1 # [ 102.525819] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552705813worker1 # [ 102.536635] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)5814worker1 # [ 102.553315] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 149 ms (attempt 2/5)5815worker1 # [ 102.708179] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 316 ms (attempt 3/5)5816worker1 # [ 103.026762] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 672 ms (attempt 4/5)5817worker1 # [ 103.701662] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5818worker1 # [ 103.715812] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552705819client # [ 103.699582] nix[1193]: copying 1 paths to 'lb:50051'...5820worker1 # [ 103.727582] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552705821client # [ 103.702748] nix[1193]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5822worker1 # [ 103.734410] nix-daemon[852]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5823worker1 # [ 103.749107] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:50Z level=info event=niks3_push_started pid=12875824worker1 # [ 104.081771] nix-daemon[852]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)5825worker1 # [ 104.094222] nix-daemon[852]: reaped child process 1303, status = succeeded5826worker1 # [ 104.242537] nix-daemon[852]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5827worker1 # [ 104.253324] nix-daemon[852]: reaped child process 1308, status = succeeded5828lb # [ 104.267737] niks3-server[1030]: 2026/09/20 09:33:51 INFO Received uploads request method=POST path=/api/pending_closures5829worker1 # [ 104.275039] nix-grpc-daemon[1287]: time=2026-09-20T09:33:50.558Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5830worker1 # [ 104.277058] nix-grpc-daemon[1287]: time=2026-09-20T09:33:50.559Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5831lb # [ 104.295792] niks3-server[1030]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5832lb # [ 104.297853] niks3-server[1030]: 2026/09/20 09:33:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5833lb # [ 104.301523] niks3-server[1030]: 2026/09/20 09:33:51 INFO Signed narinfos id=35 count=15834worker1 # [ 104.302768] nix-grpc-daemon[1287]: time=2026-09-20T09:33:50.585Z level=INFO msg="Uploading 1 narinfos"5835lb # [ 104.304928] niks3-server[1030]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5836lb # [ 104.310100] niks3-server[1030]: 2026/09/20 09:33:51 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5837lb # [ 104.313163] niks3-server[1030]: 2026/09/20 09:33:51 INFO Completed upload id=355838worker1 # [ 104.314127] nix-grpc-daemon[1287]: time=2026-09-20T09:33:50.597Z level=INFO msg="Upload complete. (390ms)"5839worker1 # [ 104.316116] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55270 duration_s=0 paths=1 nar_bytes_in=4245840lb # [ 104.316036] niks3-server[1030]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5841worker1 # [ 104.319484] nix-grpc-daemon[1154]: ts=2026-09-20T09:33:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552705842worker1 # [ 104.324310] nix-daemon[852]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5843worker1 # [ 104.328507] nix-daemon[852]: reaped child process 1285, status = succeeded5844client # [ 104.308094] nix[1193]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5845worker1 # [ 104.333597] nix-daemon[852]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5846lb: must succeed: curl -sf localhost:9901/clusters5847lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5848lb: must succeed: curl -sf localhost:9901/clusters5849lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5850worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5851worker1 # [ 106.031303] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1154 (nix-grpc-daemon) on client request.5852worker1 # [ 106.032965] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5853lb # [ 106.038208] niks3-server[1030]: 2026/09/20 09:33:52 INFO lead: released remote=192.168.1.3:344785854client # [ 106.019768] nix[1193]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5855worker2 # [ 106.030230] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5856client # [ 106.024454] nix[1193]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5857worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.05 seconds)5858client: must succeed: sleep 5.05859worker1 # [ 106.061114] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5860worker1 # [ 106.062715] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5861worker1 # [ 106.064362] systemd[1]: nix-grpc-daemon.service: Consumed 450ms CPU time over 17.051s wall clock time, 33.2M memory peak, 15.1K incoming IP traffic, 24.1K outgoing IP traffic.5862worker1 # [ 106.069515] nix-daemon[852]: reaped child process 1310, status = succeeded5863worker1 # [ 106.070756] nix-daemon[852]: reaped child process 1274, status = succeeded5864worker1 # [ 106.077558] nix-daemon[1312]: unexpected Nix daemon error: error: interrupted by the user5865worker1 # [ 106.082104] nix-daemon[852]: reaped child process 1312, status = failed with exit code 15866worker1 # [ 106.239246] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5867worker2 # [ 106.230439] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500515868worker1 # [ 106.247893] systemd[1]: Starting Nix worker-protocol over gRPC...5869worker1 # [ 106.421491] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5870worker1 # [ 106.424781] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15871worker1 # [ 106.431381] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5872worker1 # [ 106.434158] systemd[1]: Started Nix worker-protocol over gRPC.5873worker1 # [ 106.442982] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=info event=scheduler_take_over5874lb # [ 106.442304] niks3-server[1030]: 2026/09/20 09:33:53 INFO lead: acquired remote=192.168.1.3:538225875worker1 # [ 106.447759] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05876worker1 # [ 106.466124] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500515877worker1 # [ 106.467671] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05878worker1 # [ 106.559163] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05879worker1 # [ 106.563596] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:52Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15880worker2 # [ 106.597990] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327765881worker2 # [ 106.609445] nix-daemon[845]: accepted connection from pid 1489, user nix-grpc-daemon (trusted)5882worker2 # [ 106.626108] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 1/5)5883worker2 # [ 106.665096] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 2/5)5884worker2 # [ 106.720890] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 3/5)5885worker2 # [ 106.788844] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 379 ms (attempt 4/5)5886worker2 # [ 107.175471] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5887worker2 # [ 107.190362] nix-grpc-daemon[1489]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5888worker2 # [ 107.209157] nix-daemon[845]: accepted connection from pid 1489, user nix-grpc-daemon (trusted)5889client # [ 107.210990] nix[1193]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5890worker2 # [ 107.223278] nix-daemon[845]: accepted connection from pid 1489, user nix-grpc-daemon (trusted)5891lb # [ 108.374885] envoy[920]: conn peer=[2001:db8:1::4]:50556 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10558 tx=2179 ms=292425892lb # [ 108.377034] envoy[920]: conn peer=[2001:db8:1::3]:42316 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2187 tx=567 ms=168345893client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5894client: waiting for success: ! systemctl is-active mid5895worker2 # [ 111.446736] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:57Z level=info event=niks3_push_started pid=15905896worker2 # [ 111.473418] nix-daemon[845]: reaped child process 1566, status = succeeded5897worker2 # [ 111.792472] nix-daemon[845]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5898worker2 # [ 111.804292] nix-daemon[845]: reaped child process 1606, status = succeeded5899lb # [ 111.833340] niks3-server[1030]: 2026/09/20 09:33:58 INFO Received uploads request method=POST path=/api/pending_closures5900worker2 # [ 111.830048] nix-grpc-daemon[1590]: time=2026-09-20T09:33:58.169Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5901worker2 # [ 111.832022] nix-grpc-daemon[1590]: time=2026-09-20T09:33:58.171Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5902lb # [ 111.862862] niks3-server[1030]: 2026/09/20 09:33:58 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5903lb # [ 111.867364] niks3-server[1030]: 2026/09/20 09:33:58 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5904lb # [ 111.874129] niks3-server[1030]: 2026/09/20 09:33:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5905lb # [ 111.879900] niks3-server[1030]: 2026/09/20 09:33:58 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5906lb # [ 111.883895] niks3-server[1030]: 2026/09/20 09:33:58 INFO Signed narinfos id=36 count=15907worker2 # [ 111.871972] nix-grpc-daemon[1590]: time=2026-09-20T09:33:58.211Z level=INFO msg="Uploading 1 narinfos"5908lb # [ 111.889869] niks3-server[1030]: 2026/09/20 09:33:58 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5909lb # [ 111.893070] niks3-server[1030]: 2026/09/20 09:33:58 INFO Completed upload id=365910worker2 # [ 111.880505] nix-grpc-daemon[1590]: time=2026-09-20T09:33:58.220Z level=INFO msg="Upload complete. (240ms)"5911worker2 # [ 111.882716] nix-grpc-daemon[1489]: ts=2026-09-20T09:33:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32776 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15912lb # [ 111.897938] niks3-server[1030]: 2026/09/20 09:33:58 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5913worker2 # [ 111.890100] nix-daemon[845]: reaped child process 1564, status = succeeded5914client # [ 111.901934] systemd[1]: mid.service: Deactivated successfully.5915client # [ 111.903685] systemd[1]: mid.service: Consumed 118ms CPU time over 9.657s wall clock time, 39.1M memory peak, 9.7K incoming IP traffic, 10.5K outgoing IP traffic.5916client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds)5917client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5918client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5919(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.24 seconds)5920subtest: interrupting the client stops the build on the worker5921client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5922client # [ 112.465418] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5923client # Running as unit: intr.service; invocation ID: 88afb65dec56499daad77d6364fefb555924client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5925worker1 # [ 112.687586] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346305926worker1 # [ 112.699372] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5927client # [ 112.686427] nix[1228]: don't know how to build these paths:5928client # [ 112.687281] nix[1228]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5929worker1 # [ 112.720269] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:59Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05930worker1 # [ 112.724975] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:59Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15931worker1 # [ 112.769059] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305932worker1 # [ 112.780765] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)5933worker1 # [ 112.840763] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 2/5)5934worker1 # [ 112.959732] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 345 ms (attempt 3/5)5935worker1 # [ 113.310375] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 4/5)5936worker1 # [ 113.569357] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5937worker1 # [ 113.582842] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346305938client # [ 113.568572] nix[1228]: copying 1 paths to 'lb:50051'...5939client # [ 113.572137] nix[1228]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5940worker1 # [ 113.597442] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346305941worker1 # [ 113.605689] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5942worker1 # [ 113.633772] nix-grpc-daemon[1348]: ts=2026-09-20T09:33:59Z level=info event=niks3_push_started pid=14235943worker1 # [ 113.958755] nix-daemon[852]: accepted connection from pid 1437, user nix-grpc-daemon (trusted)5944worker1 # [ 113.970607] nix-daemon[852]: reaped child process 1440, status = succeeded5945worker1 # [ 114.127367] nix-daemon[852]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5946worker1 # [ 114.138861] nix-daemon[852]: reaped child process 1445, status = succeeded5947lb # [ 114.154284] niks3-server[1030]: 2026/09/20 09:34:01 INFO Received uploads request method=POST path=/api/pending_closures5948worker1 # [ 114.166076] nix-grpc-daemon[1423]: time=2026-09-20T09:34:00.449Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5949worker1 # [ 114.167550] nix-grpc-daemon[1423]: time=2026-09-20T09:34:00.450Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5950lb # [ 114.196627] niks3-server[1030]: 2026/09/20 09:34:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5951lb # [ 114.202234] niks3-server[1030]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5952lb # [ 114.207502] niks3-server[1030]: 2026/09/20 09:34:01 INFO Signed narinfos id=37 count=15953worker1 # [ 114.211207] nix-grpc-daemon[1423]: time=2026-09-20T09:34:00.494Z level=INFO msg="Uploading 1 narinfos"5954lb # [ 114.213868] niks3-server[1030]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5955lb # [ 114.223426] niks3-server[1030]: 2026/09/20 09:34:01 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5956lb # [ 114.228760] niks3-server[1030]: 2026/09/20 09:34:01 INFO Completed upload id=375957worker1 # [ 114.231889] nix-grpc-daemon[1423]: time=2026-09-20T09:34:00.515Z level=INFO msg="Upload complete. (421ms)"5958lb # [ 114.232928] niks3-server[1030]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5959worker1 # [ 114.237116] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=4245960worker1 # [ 114.242137] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305961worker1 # [ 114.252075] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5962worker1 # [ 114.255730] nix-daemon[852]: reaped child process 1420, status = succeeded5963worker1 # [ 114.260376] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5964client # [ 114.236179] nix[1228]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5965client: must succeed: systemctl kill -s INT intr5966client # [ 116.007583] systemd[1]: intr.service: Sent signal SIGINT to main process 1228 (nix) on client request.5967client # [ 116.014460] nix[1228]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5968client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5969client # [ 116.021933] nix[1228]: error: interrupted by the user5970client # [ 116.051308] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5971client # [ 116.053352] systemd[1]: intr.service: Failed with result 'exit-code'.5972client # [ 116.055080] systemd[1]: intr.service: Consumed 108ms CPU time over 3.587s wall clock time, 37.1M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5973worker1 # [ 116.081565] nix-daemon[1449]: unexpected Nix daemon error: error: interrupted by the user5974worker1 # [ 116.086143] nix-daemon[852]: reaped child process 1447, status = succeeded5975worker1 # [ 116.091158] nix-daemon[852]: reaped child process 1449, status = failed with exit code 15976(finished: subtest: interrupting the client stops the build on the worker, in 3.69 seconds)5977subtest: a deploy mid-build drains: the build finishes, the new generation takes over5978client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5979client # [ 116.184925] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5980client # Running as unit: sw.service; invocation ID: d079a64b91174d3d90e72a54da284c225981client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5982worker2 # [ 116.385601] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:327765983client # [ 116.378292] nix[1248]: don't know how to build these paths:5984client # [ 116.379159] nix[1248]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5985worker1 # [ 116.413640] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:02Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05986worker1 # [ 116.417716] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:02Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15987worker2 # [ 116.443241] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327765988worker2 # [ 116.451195] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327765989worker2 # [ 116.458411] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327765990client # [ 116.447171] nix[1248]: copying 1 paths to 'lb:50051'...5991client # [ 116.449167] nix[1248]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5992worker2 # [ 116.467943] nix-daemon[845]: accepted connection from pid 1489, user nix-grpc-daemon (trusted)5993worker2 # [ 116.596922] nix-daemon[845]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)5994worker2 # [ 116.608798] nix-daemon[845]: reaped child process 1637, status = succeeded5995worker2 # [ 116.736618] nix-daemon[845]: accepted connection from pid 1639, user nix-grpc-daemon (trusted)5996worker2 # [ 116.748781] nix-daemon[845]: reaped child process 1642, status = succeeded5997lb # [ 116.770741] niks3-server[1030]: 2026/09/20 09:34:03 INFO Received uploads request method=POST path=/api/pending_closures5998worker2 # [ 116.766643] nix-grpc-daemon[1590]: time=2026-09-20T09:34:03.105Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5999worker2 # [ 116.768201] nix-grpc-daemon[1590]: time=2026-09-20T09:34:03.105Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6000lb # [ 116.794510] niks3-server[1030]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6001lb # [ 116.806103] niks3-server[1030]: 2026/09/20 09:34:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6002worker2 # [ 116.798180] nix-grpc-daemon[1590]: time=2026-09-20T09:34:03.137Z level=INFO msg="Uploading 1 narinfos"6003lb # [ 116.810887] niks3-server[1030]: 2026/09/20 09:34:03 INFO Signed narinfos id=38 count=16004lb # [ 116.817272] niks3-server[1030]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6005lb # [ 116.828711] niks3-server[1030]: 2026/09/20 09:34:03 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6006lb # [ 116.833934] niks3-server[1030]: 2026/09/20 09:34:03 INFO Completed upload id=386007worker2 # [ 116.821436] nix-grpc-daemon[1590]: time=2026-09-20T09:34:03.161Z level=INFO msg="Upload complete. (348ms)"6008worker2 # [ 116.824189] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32776 duration_s=0 paths=1 nar_bytes_in=4166009lb # [ 116.836798] niks3-server[1030]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6010worker2 # [ 116.830392] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327766011worker2 # [ 116.832201] nix-daemon[845]: reaped child process 1632, status = succeeded6012worker2 # [ 116.835406] nix-daemon[845]: accepted connection from pid 1489, user nix-grpc-daemon (trusted)6013client # [ 116.829976] nix[1248]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6014worker2 # [ 116.841912] nix-daemon[845]: accepted connection from pid 1489, user nix-grpc-daemon (trusted)6015lb # [ 118.376809] envoy[920]: conn peer=[2001:db8:1::1]:58814 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1637 ms=94696016lb # [ 118.380921] envoy[920]: conn peer=[2001:db8:1::1]:56566 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=731 ms=33776017worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26018worker2 # Checking switch inhibitors... done6019worker2 # [ 119.286684] nixos[1677]: switching to system configuration /nix/store/6g30yw275g3z68c3b2rynsxxjndb53dv-nixos-system-worker2-test6020worker2 # [ 119.289170] systemd[1]: Stopped target Local File Systems.6021worker2 # activating the configuration...6022worker2 # [ 119.292098] systemd[1]: Stopped target Remote File Systems.6023worker2 # setting up /etc...6024worker2 # [ 119.830902] systemd[1]: Reload requested from client PID 1677 ('.switch-to-conf') (unit backdoor.service)...6025worker2 # [ 119.832541] systemd[1]: Reloading...6026worker2 # [ 120.498835] systemd[1]: Reloading finished in 662 ms.6027worker2 # restarting sysinit-reactivation.target6028worker2 # [ 120.550322] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6029worker2 # [ 120.681371] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6030worker2 # [ 120.683751] systemd[1]: Reached target Reactivate sysinit units.6031worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6032worker2 # [ 120.688352] dbus-broker-launch[537]: Caught SIGHUP, trigger reload.6033worker2 # [ 120.690528] systemd[1]: Reloading D-Bus System Message Bus...6034worker2 # [ 120.693569] systemd[1]: Reloading Nix worker-protocol over gRPC...6035worker2 # [ 120.722066] dbus-broker-launch[537]: Looking up NSS user entry for 'systemd-timesync'...6036worker2 # [ 120.724119] dbus-broker-launch[537]: NSS returned no entry for 'systemd-timesync'6037worker2 # [ 120.726077] dbus-broker-launch[537]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6038worker2 # [ 120.740310] systemd[1]: Reloaded Nix worker-protocol over gRPC.6039worker2 # [ 120.757682] systemd[1]: Reloaded D-Bus System Message Bus.6040worker2 # [ 120.763967] systemd[1]: Reached target Local File Systems.6041worker2 # [ 120.766147] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6042worker2 # [ 120.770755] systemd[1]: Starting Create SUID/SGID Wrappers...6043worker2 # [ 120.772634] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6044worker2 # [ 120.774121] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676045worker2 # [ 120.776083] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6046worker2 # [ 120.777487] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6047worker2 # [ 120.778665] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6048worker2 # [ 120.784739] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6049worker2 # [ 120.786027] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6050worker2 # [ 120.790409] systemd[1]: Reached target Remote File Systems.6051worker2 # [ 121.188433] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6052worker2 # [ 121.193194] systemd[1]: Finished Create SUID/SGID Wrappers.6053worker2 # [ 121.197025] systemd[1]: Starting linger-users.service...6054worker2 # [ 121.236455] systemd[1]: linger-users.service: Deactivated successfully.6055worker2 # [ 121.239917] systemd[1]: Finished linger-users.service.6056worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6057worker2 # [ 121.496393] nixos[1677]: finished switching to system configuration /nix/store/6g30yw275g3z68c3b2rynsxxjndb53dv-nixos-system-worker2-test6058worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.82 seconds)6059worker2: must succeed: pgrep -f 'read -t [9]0 x'6060worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6061client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26062worker2 # [ 121.552439] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:07Z level=info event=draining6063client # don't know how to build these paths:6064client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6065worker1 # [ 121.768569] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346306066worker1 # [ 121.775282] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306067worker1 # [ 121.794831] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06068worker1 # [ 121.797281] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16069worker1 # [ 121.842954] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306070worker1 # [ 121.851937] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306071client # copying 1 paths to 'lb:50051'...6072worker1 # [ 121.860796] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306073client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6074worker1 # [ 121.872551] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6075worker1 # [ 122.035363] nix-daemon[852]: accepted connection from pid 1499, user nix-grpc-daemon (trusted)6076worker1 # [ 122.047759] nix-daemon[852]: reaped child process 1502, status = succeeded6077worker1 # [ 122.195979] nix-daemon[852]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)6078worker1 # [ 122.207974] nix-daemon[852]: reaped child process 1507, status = succeeded6079lb # [ 122.217807] niks3-server[1030]: 2026/09/20 09:34:09 INFO Received uploads request method=POST path=/api/pending_closures6080worker1 # [ 122.227722] nix-grpc-daemon[1423]: time=2026-09-20T09:34:08.510Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6081worker1 # [ 122.229687] nix-grpc-daemon[1423]: time=2026-09-20T09:34:08.512Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6082lb # [ 122.248376] niks3-server[1030]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6083lb # [ 122.260517] niks3-server[1030]: 2026/09/20 09:34:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6084lb # [ 122.265856] niks3-server[1030]: 2026/09/20 09:34:09 INFO Signed narinfos id=39 count=16085worker1 # [ 122.269711] nix-grpc-daemon[1423]: time=2026-09-20T09:34:08.552Z level=INFO msg="Uploading 1 narinfos"6086lb # [ 122.273497] niks3-server[1030]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6087lb # [ 122.283755] niks3-server[1030]: 2026/09/20 09:34:09 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6088lb # [ 122.291265] niks3-server[1030]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6089lb # [ 122.296515] niks3-server[1030]: 2026/09/20 09:34:09 INFO Completed upload id=396090worker1 # [ 122.297593] nix-grpc-daemon[1423]: time=2026-09-20T09:34:08.580Z level=INFO msg="Upload complete. (413ms)"6091worker1 # [ 122.302170] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=5286092worker1 # [ 122.308373] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306093worker1 # [ 122.320283] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6094worker1 # [ 122.329373] nix-daemon[852]: reaped child process 1497, status = succeeded6095client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6096client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6097worker1 # [ 122.333573] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6098worker1 # [ 122.945761] nix-daemon[852]: reaped child process 1511, status = succeeded6099client # farm-a> LOG-farm-a-during-drain6100worker1 # [ 123.088089] nix-daemon[852]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6101worker1 # [ 123.099604] nix-daemon[852]: reaped child process 1529, status = succeeded6102lb # [ 123.112987] niks3-server[1030]: 2026/09/20 09:34:10 INFO Received uploads request method=POST path=/api/pending_closures6103worker1 # [ 123.120983] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.404Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6104worker1 # [ 123.122622] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.405Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6105lb # [ 123.137928] niks3-server[1030]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6106lb # [ 123.142617] niks3-server[1030]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6107lb # [ 123.147224] niks3-server[1030]: 2026/09/20 09:34:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6108lb # [ 123.150587] niks3-server[1030]: 2026/09/20 09:34:10 INFO Signed narinfos id=40 count=16109worker1 # [ 123.151515] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.434Z level=INFO msg="Uploading 1 narinfos"6110lb # [ 123.153955] niks3-server[1030]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6111lb # [ 123.159244] niks3-server[1030]: 2026/09/20 09:34:10 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6112lb # [ 123.163899] niks3-server[1030]: 2026/09/20 09:34:10 INFO Completed upload id=406113worker1 # [ 123.165995] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.449Z level=INFO msg="Upload complete. (226ms)"6114lb # [ 123.165377] niks3-server[1030]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6115worker1 # [ 123.169169] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16116worker1 # [ 123.174969] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06117worker1 # [ 123.176912] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16118worker1 # [ 123.181278] nix-daemon[852]: reaped child process 1509, status = succeeded6119worker1 # [ 123.224759] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306120worker1 # [ 123.233984] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306121worker1 # [ 123.243129] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.526Z level=INFO msg="All 1 paths already cached"6122client # copying 1 paths to 'lb:50051'...6123worker1 # [ 123.249324] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306124client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6125worker1 # [ 123.267134] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6126worker1 # [ 123.404237] nix-daemon[852]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6127worker1 # [ 123.416225] nix-daemon[852]: reaped child process 1538, status = succeeded6128worker1 # [ 123.550783] nix-daemon[852]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)6129worker1 # [ 123.562628] nix-daemon[852]: reaped child process 1543, status = succeeded6130lb # [ 123.572671] niks3-server[1030]: 2026/09/20 09:34:10 INFO Received uploads request method=POST path=/api/pending_closures6131worker1 # [ 123.577824] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.861Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6132worker1 # [ 123.579316] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.862Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6133lb # [ 123.587986] niks3-server[1030]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6134lb # [ 123.591979] niks3-server[1030]: 2026/09/20 09:34:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6135lb # [ 123.594540] niks3-server[1030]: 2026/09/20 09:34:10 INFO Signed narinfos id=41 count=16136worker1 # [ 123.595452] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.878Z level=INFO msg="Uploading 1 narinfos"6137lb # [ 123.597506] niks3-server[1030]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6138lb # [ 123.601500] niks3-server[1030]: 2026/09/20 09:34:10 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6139lb # [ 123.604473] niks3-server[1030]: 2026/09/20 09:34:10 INFO Completed upload id=416140worker1 # [ 123.606483] nix-grpc-daemon[1423]: time=2026-09-20T09:34:09.889Z level=INFO msg="Upload complete. (329ms)"6141lb # [ 123.607045] niks3-server[1030]: 2026/09/20 09:34:10 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6142worker1 # [ 123.608447] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=6406143worker1 # [ 123.612047] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306144worker1 # [ 123.618267] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6145worker1 # [ 123.620507] nix-daemon[852]: reaped child process 1533, status = succeeded6146worker1 # [ 123.625665] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6147client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6148client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6149worker1 # [ 124.439201] nix-daemon[852]: reaped child process 1547, status = succeeded6150client # farm-b> LOG-farm-b-during-drain6151worker1 # [ 124.578541] nix-daemon[852]: accepted connection from pid 1562, user nix-grpc-daemon (trusted)6152worker1 # [ 124.590549] nix-daemon[852]: reaped child process 1565, status = succeeded6153lb # [ 124.603836] niks3-server[1030]: 2026/09/20 09:34:11 INFO Received uploads request method=POST path=/api/pending_closures6154worker1 # [ 124.609451] nix-grpc-daemon[1423]: time=2026-09-20T09:34:10.892Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6155worker1 # [ 124.610943] nix-grpc-daemon[1423]: time=2026-09-20T09:34:10.892Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6156lb # [ 124.621442] niks3-server[1030]: 2026/09/20 09:34:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6157lb # [ 124.624055] niks3-server[1030]: 2026/09/20 09:34:11 INFO Signed narinfos id=42 count=16158worker1 # [ 124.625102] nix-grpc-daemon[1423]: time=2026-09-20T09:34:10.908Z level=INFO msg="Uploading 1 narinfos"6159lb # [ 124.628791] niks3-server[1030]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6160lb # [ 124.636752] niks3-server[1030]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6161lb # [ 124.639626] niks3-server[1030]: 2026/09/20 09:34:11 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6162lb # [ 124.643261] niks3-server[1030]: 2026/09/20 09:34:11 INFO Completed upload id=426163worker1 # [ 124.643985] nix-grpc-daemon[1423]: time=2026-09-20T09:34:10.927Z level=INFO msg="Upload complete. (212ms)"6164lb # [ 124.644968] niks3-server[1030]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6165worker1 # [ 124.647383] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16166lb # [ 124.650976] niks3-server[1030]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6167worker1 # [ 124.655211] nix-daemon[852]: reaped child process 1545, status = succeeded6168worker1 # [ 124.656852] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:10Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06169worker1 # [ 124.658883] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:10Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16170worker1 # [ 124.701382] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306171worker1 # [ 124.710606] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306172worker1 # [ 124.719758] nix-grpc-daemon[1423]: time=2026-09-20T09:34:11.003Z level=INFO msg="All 2 paths already cached"6173client # copying 1 paths to 'lb:50051'...6174worker1 # [ 124.726278] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306175client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6176worker1 # [ 124.745102] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6177worker1 # [ 124.902843] nix-daemon[852]: accepted connection from pid 1571, user nix-grpc-daemon (trusted)6178worker1 # [ 124.915109] nix-daemon[852]: reaped child process 1574, status = succeeded6179worker1 # [ 125.071391] nix-daemon[852]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)6180worker1 # [ 125.083109] nix-daemon[852]: reaped child process 1579, status = succeeded6181lb # [ 125.098686] niks3-server[1030]: 2026/09/20 09:34:12 INFO Received uploads request method=POST path=/api/pending_closures6182worker1 # [ 125.104730] nix-grpc-daemon[1423]: time=2026-09-20T09:34:11.388Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6183worker1 # [ 125.106312] nix-grpc-daemon[1423]: time=2026-09-20T09:34:11.389Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6184lb # [ 125.115782] niks3-server[1030]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6185lb # [ 125.120077] niks3-server[1030]: 2026/09/20 09:34:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6186lb # [ 125.122153] niks3-server[1030]: 2026/09/20 09:34:12 INFO Signed narinfos id=43 count=16187worker1 # [ 125.122773] nix-grpc-daemon[1423]: time=2026-09-20T09:34:11.406Z level=INFO msg="Uploading 1 narinfos"6188lb # [ 125.124560] niks3-server[1030]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6189lb # [ 125.130050] niks3-server[1030]: 2026/09/20 09:34:12 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6190lb # [ 125.134824] niks3-server[1030]: 2026/09/20 09:34:12 INFO Completed upload id=436191worker1 # [ 125.135689] nix-grpc-daemon[1423]: time=2026-09-20T09:34:11.419Z level=INFO msg="Upload complete. (380ms)"6192lb # [ 125.136074] niks3-server[1030]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6193worker1 # [ 125.137279] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=7686194worker1 # [ 125.143414] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306195worker1 # [ 125.147536] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6196worker1 # [ 125.149798] nix-daemon[852]: reaped child process 1569, status = succeeded6197worker1 # [ 125.155119] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6198client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6199client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6200worker1 # [ 126.569603] nix-daemon[852]: reaped child process 1583, status = succeeded6201client # farm-top> LOG-farm-top-during-drain6202worker1 # [ 126.707840] nix-daemon[852]: accepted connection from pid 1598, user nix-grpc-daemon (trusted)6203worker1 # [ 126.719745] nix-daemon[852]: reaped child process 1601, status = succeeded6204lb # [ 126.734922] niks3-server[1030]: 2026/09/20 09:34:13 INFO Received uploads request method=POST path=/api/pending_closures6205worker1 # [ 126.739697] nix-grpc-daemon[1423]: time=2026-09-20T09:34:13.022Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6206worker1 # [ 126.741213] nix-grpc-daemon[1423]: time=2026-09-20T09:34:13.024Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6207lb # [ 126.752836] niks3-server[1030]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6208lb # [ 126.756257] niks3-server[1030]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6209lb # [ 126.760055] niks3-server[1030]: 2026/09/20 09:34:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6210lb # [ 126.762362] niks3-server[1030]: 2026/09/20 09:34:13 INFO Signed narinfos id=44 count=16211worker1 # [ 126.763382] nix-grpc-daemon[1423]: time=2026-09-20T09:34:13.046Z level=INFO msg="Uploading 1 narinfos"6212lb # [ 126.765259] niks3-server[1030]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6213lb # [ 126.770240] niks3-server[1030]: 2026/09/20 09:34:13 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6214lb # [ 126.773540] niks3-server[1030]: 2026/09/20 09:34:13 INFO Completed upload id=446215worker1 # [ 126.774381] nix-grpc-daemon[1423]: time=2026-09-20T09:34:13.057Z level=INFO msg="Upload complete. (211ms)"6216lb # [ 126.775273] niks3-server[1030]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6217worker1 # [ 126.778089] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16218worker1 # [ 126.784518] nix-daemon[852]: reaped child process 1581, status = succeeded6219client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 5.26 seconds)6220client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6221client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.20 seconds)6222worker2: must succeed: pkill -f 'read -t [9]0 x'6223worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6224client: waiting for success: ! systemctl is-active sw6225worker2 # [ 127.063722] nix-daemon[845]: reaped child process 1646, status = succeeded6226worker2 # [ 127.202841] nix-daemon[845]: accepted connection from pid 1817, user nix-grpc-daemon (trusted)6227worker2 # [ 127.214699] nix-daemon[845]: reaped child process 1820, status = succeeded6228lb # [ 127.242808] niks3-server[1030]: 2026/09/20 09:34:14 INFO Received uploads request method=POST path=/api/pending_closures6229worker2 # [ 127.234215] nix-grpc-daemon[1590]: time=2026-09-20T09:34:13.573Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6230worker2 # [ 127.235650] nix-grpc-daemon[1590]: time=2026-09-20T09:34:13.575Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6231lb # [ 127.263144] niks3-server[1030]: 2026/09/20 09:34:14 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6232lb # [ 127.265654] niks3-server[1030]: 2026/09/20 09:34:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6233lb # [ 127.268342] niks3-server[1030]: 2026/09/20 09:34:14 INFO Signed narinfos id=45 count=16234worker2 # [ 127.256287] nix-grpc-daemon[1590]: time=2026-09-20T09:34:13.595Z level=INFO msg="Uploading 1 narinfos"6235lb # [ 127.270019] niks3-server[1030]: 2026/09/20 09:34:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6236lb # [ 127.273443] niks3-server[1030]: 2026/09/20 09:34:14 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6237lb # [ 127.278074] niks3-server[1030]: 2026/09/20 09:34:14 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6238lb # [ 127.281345] niks3-server[1030]: 2026/09/20 09:34:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6239lb # [ 127.283402] niks3-server[1030]: 2026/09/20 09:34:14 INFO Completed upload id=456240worker2 # [ 127.271923] nix-grpc-daemon[1590]: time=2026-09-20T09:34:13.611Z level=INFO msg="Upload complete. (213ms)"6241worker2 # [ 127.275145] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32776 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16242worker2 # [ 127.280826] nix-daemon[845]: reaped child process 1644, status = succeeded6243client # [ 127.298173] systemd[1]: sw.service: Deactivated successfully.6244client # [ 127.301139] systemd[1]: sw.service: Consumed 104ms CPU time over 11.115s wall clock time, 39.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.6245worker2 # [ 127.556354] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:13Z level=info event=signal_exit6246client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6247client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6248client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6249worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6250lb # [ 128.377118] envoy[920]: conn peer=[2001:db8:1::1]:59650 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9555 tx=3803 ms=50316251lb # [ 128.381232] envoy[920]: conn peer=[2001:db8:1::1]:59646 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2919 tx=1333 ms=108996252worker1 # [ 128.798393] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:345886253worker1 # [ 128.801939] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:15Z level=info event=worker_gone addr=192.168.1.4:500516254worker2 # [ 128.785556] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:15Z level=info event=scheduler_restarting6255worker2 # [ 128.798512] nix-grpc-daemon[1489]: ts=2026-09-20T09:34:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6256worker2 # [ 128.815769] nix-daemon[845]: reaped child process 1558, status = succeeded6257worker2 # [ 129.397254] nix-grpc-daemon[1489]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6258worker2 # [ 129.400596] nix-grpc-daemon[1489]: E0000 00:00:1789896855.736708 1532 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6259worker2 # [ 129.405450] nix-grpc-daemon[1489]: E0000 00:00:1789896855.736921 1532 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6260worker2 # [ 129.596975] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6261worker2 # [ 129.600939] systemd[1]: nix-grpc-daemon.service: Consumed 594ms CPU time over 28.209s wall clock time, 32.3M memory peak, 21K incoming IP traffic, 27.7K outgoing IP traffic.6262worker2 # [ 129.617448] systemd[1]: Starting Nix worker-protocol over gRPC...6263worker2 # [ 129.782803] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6264worker2 # [ 129.786105] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16265worker2 # [ 129.792059] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6266worker2 # [ 129.796466] systemd[1]: Started Nix worker-protocol over gRPC.6267worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.64 seconds)6268lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6269lb: must succeed: curl -sf localhost:9901/clusters6270worker2 # [ 129.823607] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500516271worker1 # [ 129.839737] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06272lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6273lb: must succeed: curl -sf localhost:9901/clusters6274lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6275lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.09 seconds)6276lb: must succeed: curl -sf localhost:9901/clusters6277lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6278worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6279worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)6280(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.86 seconds)6281subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6282client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16283worker1 # [ 131.206926] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346306284worker2 # [ 131.206599] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504246285worker2 # [ 131.217942] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6286worker2 # [ 131.234332] nix-grpc-daemon[1834]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)6287worker2 # [ 131.263250] nix-grpc-daemon[1834]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 137 ms (attempt 2/5)6288worker2 # [ 131.406652] nix-grpc-daemon[1834]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 3/5)6289worker2 # [ 131.482734] nix-grpc-daemon[1834]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 457 ms (attempt 4/5)6290worker2 # [ 131.945690] nix-grpc-daemon[1834]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6291worker1 # [ 131.997093] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06292worker1 # [ 131.999247] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16293worker1 # [ 132.001139] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06294worker1 # [ 132.002622] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06295worker1 # [ 132.041178] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306296worker1 # [ 132.049531] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306297worker1 # [ 132.056391] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306298worker1 # [ 132.061633] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6299worker1 # [ 132.221137] nix-daemon[852]: accepted connection from pid 1612, user nix-grpc-daemon (trusted)6300worker1 # [ 132.232871] nix-daemon[852]: reaped child process 1615, status = succeeded6301worker1 # [ 132.400614] nix-daemon[852]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)6302worker1 # [ 132.412214] nix-daemon[852]: reaped child process 1620, status = succeeded6303lb # [ 132.424448] niks3-server[1030]: 2026/09/20 09:34:19 INFO Received uploads request method=POST path=/api/pending_closures6304worker1 # [ 132.433593] nix-grpc-daemon[1423]: time=2026-09-20T09:34:18.716Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6305worker1 # [ 132.434920] nix-grpc-daemon[1423]: time=2026-09-20T09:34:18.716Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6306lb # [ 132.449127] niks3-server[1030]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6307lb # [ 132.466672] niks3-server[1030]: 2026/09/20 09:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6308worker1 # [ 132.472526] nix-grpc-daemon[1423]: time=2026-09-20T09:34:18.755Z level=INFO msg="Uploading 1 narinfos"6309lb # [ 132.471489] niks3-server[1030]: 2026/09/20 09:34:19 INFO Signed narinfos id=46 count=16310lb # [ 132.479803] niks3-server[1030]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6311lb # [ 132.489620] niks3-server[1030]: 2026/09/20 09:34:19 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6312lb # [ 132.496633] niks3-server[1030]: 2026/09/20 09:34:19 INFO Completed upload id=466313worker1 # [ 132.497255] nix-grpc-daemon[1423]: time=2026-09-20T09:34:18.780Z level=INFO msg="Upload complete. (430ms)"6314lb # [ 132.498768] niks3-server[1030]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6315worker1 # [ 132.500189] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=5046316worker1 # [ 132.504063] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306317worker1 # [ 132.511320] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6318worker1 # [ 132.513950] nix-daemon[852]: reaped child process 1610, status = succeeded6319worker1 # [ 132.519870] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6320worker1 # [ 133.333844] nix-daemon[852]: reaped child process 1624, status = succeeded6321worker1 # [ 133.475208] nix-daemon[852]: accepted connection from pid 1639, user nix-grpc-daemon (trusted)6322worker1 # [ 133.486816] nix-daemon[852]: reaped child process 1642, status = succeeded6323lb # [ 133.504488] niks3-server[1030]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures6324worker1 # [ 133.516304] nix-grpc-daemon[1423]: time=2026-09-20T09:34:19.799Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6325worker1 # [ 133.517871] nix-grpc-daemon[1423]: time=2026-09-20T09:34:19.801Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6326lb # [ 133.540407] niks3-server[1030]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6327lb # [ 133.542992] niks3-server[1030]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6328lb # [ 133.546188] niks3-server[1030]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6329lb # [ 133.548041] niks3-server[1030]: 2026/09/20 09:34:20 INFO Signed narinfos id=47 count=16330worker1 # [ 133.549086] nix-grpc-daemon[1423]: time=2026-09-20T09:34:19.832Z level=INFO msg="Uploading 1 narinfos"6331lb # [ 133.553613] niks3-server[1030]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6332lb # [ 133.556118] niks3-server[1030]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6333lb # [ 133.559342] niks3-server[1030]: 2026/09/20 09:34:20 INFO Completed upload id=476334worker1 # [ 133.560263] nix-grpc-daemon[1423]: time=2026-09-20T09:34:19.843Z level=INFO msg="Upload complete. (233ms)"6335lb # [ 133.560565] niks3-server[1030]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6336worker1 # [ 133.563277] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16337worker1 # [ 133.566430] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:19Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16338worker1 # [ 133.568783] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306339worker1 # [ 133.573587] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:19Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06340worker1 # [ 133.578553] nix-daemon[852]: reaped child process 1622, status = succeeded6341worker1 # [ 133.612583] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306342worker1 # [ 133.623246] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306343worker1 # [ 133.630309] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6344worker1 # [ 133.783931] nix-daemon[852]: accepted connection from pid 1648, user nix-grpc-daemon (trusted)6345worker1 # [ 133.796740] nix-daemon[852]: reaped child process 1651, status = succeeded6346worker1 # [ 133.952592] nix-daemon[852]: accepted connection from pid 1653, user nix-grpc-daemon (trusted)6347worker1 # [ 133.964165] nix-daemon[852]: reaped child process 1656, status = succeeded6348lb # [ 133.978766] niks3-server[1030]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures6349worker1 # [ 133.987233] nix-grpc-daemon[1423]: time=2026-09-20T09:34:20.270Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6350worker1 # [ 133.988616] nix-grpc-daemon[1423]: time=2026-09-20T09:34:20.270Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6351lb # [ 134.001358] niks3-server[1030]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6352lb # [ 134.014253] niks3-server[1030]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6353worker1 # [ 134.021173] nix-grpc-daemon[1423]: time=2026-09-20T09:34:20.304Z level=INFO msg="Uploading 1 narinfos"6354lb # [ 134.020268] niks3-server[1030]: 2026/09/20 09:34:20 INFO Signed narinfos id=48 count=16355lb # [ 134.024700] niks3-server[1030]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6356lb # [ 134.037107] niks3-server[1030]: 2026/09/20 09:34:21 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6357lb # [ 134.042494] niks3-server[1030]: 2026/09/20 09:34:21 INFO Completed upload id=486358worker1 # [ 134.045593] nix-grpc-daemon[1423]: time=2026-09-20T09:34:20.328Z level=INFO msg="Upload complete. (405ms)"6359lb # [ 134.044863] niks3-server[1030]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6360worker1 # [ 134.047533] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=5046361worker1 # [ 134.051632] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306362worker1 # [ 134.057438] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6363worker1 # [ 134.059731] nix-daemon[852]: reaped child process 1646, status = succeeded6364worker1 # [ 134.064942] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6365worker1 # [ 135.289846] nix-daemon[852]: reaped child process 1660, status = succeeded6366worker1 # [ 135.445161] nix-daemon[852]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)6367worker1 # [ 135.457443] nix-daemon[852]: reaped child process 1678, status = succeeded6368lb # [ 135.472502] niks3-server[1030]: 2026/09/20 09:34:22 INFO Received uploads request method=POST path=/api/pending_closures6369worker1 # [ 135.481518] nix-grpc-daemon[1423]: time=2026-09-20T09:34:21.764Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6370worker1 # [ 135.483245] nix-grpc-daemon[1423]: time=2026-09-20T09:34:21.766Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6371lb # [ 135.513714] niks3-server[1030]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6372lb # [ 135.523238] niks3-server[1030]: 2026/09/20 09:34:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6373lb # [ 135.530423] niks3-server[1030]: 2026/09/20 09:34:22 INFO Signed narinfos id=49 count=16374worker1 # [ 135.534352] nix-grpc-daemon[1423]: time=2026-09-20T09:34:21.817Z level=INFO msg="Uploading 1 narinfos"6375lb # [ 135.537546] niks3-server[1030]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6376lb # [ 135.541495] niks3-server[1030]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6377lb # [ 135.550873] niks3-server[1030]: 2026/09/20 09:34:22 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6378lb # [ 135.555443] niks3-server[1030]: 2026/09/20 09:34:22 INFO Completed upload id=496379worker1 # [ 135.556655] nix-grpc-daemon[1423]: time=2026-09-20T09:34:21.839Z level=INFO msg="Upload complete. (284ms)"6380lb # [ 135.557606] niks3-server[1030]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6381worker1 # [ 135.568563] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16382worker1 # [ 135.574215] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:21Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16383worker1 # [ 135.579233] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306384worker1 # [ 135.582901] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:21Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06385worker1 # [ 135.592167] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306386worker1 # [ 135.594431] nix-daemon[852]: reaped child process 1658, status = succeeded6387worker1 # [ 135.599474] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306388worker1 # [ 135.603529] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6389worker1 # [ 135.765581] nix-daemon[852]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)6390worker1 # [ 135.777560] nix-daemon[852]: reaped child process 1687, status = succeeded6391worker1 # [ 135.937836] nix-daemon[852]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6392worker1 # [ 135.949545] nix-daemon[852]: reaped child process 1692, status = succeeded6393lb # [ 135.965117] niks3-server[1030]: 2026/09/20 09:34:22 INFO Received uploads request method=POST path=/api/pending_closures6394worker1 # [ 135.973753] nix-grpc-daemon[1423]: time=2026-09-20T09:34:22.257Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6395worker1 # [ 135.976191] nix-grpc-daemon[1423]: time=2026-09-20T09:34:22.259Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6396lb # [ 135.994307] niks3-server[1030]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6397lb # [ 136.004502] niks3-server[1030]: 2026/09/20 09:34:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6398lb # [ 136.010125] niks3-server[1030]: 2026/09/20 09:34:22 INFO Signed narinfos id=50 count=16399worker1 # [ 136.014099] nix-grpc-daemon[1423]: time=2026-09-20T09:34:22.297Z level=INFO msg="Uploading 1 narinfos"6400lb # [ 136.013624] niks3-server[1030]: 2026/09/20 09:34:22 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6401lb # [ 136.026961] niks3-server[1030]: 2026/09/20 09:34:22 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6402lb # [ 136.032655] niks3-server[1030]: 2026/09/20 09:34:22 INFO Completed upload id=506403worker1 # [ 136.033235] nix-grpc-daemon[1423]: time=2026-09-20T09:34:22.316Z level=INFO msg="Upload complete. (424ms)"6404lb # [ 136.035414] niks3-server[1030]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6405worker1 # [ 136.036900] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=5046406worker1 # [ 136.042879] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306407worker1 # [ 136.053741] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6408worker1 # [ 136.056373] nix-daemon[852]: reaped child process 1682, status = succeeded6409worker1 # [ 136.061430] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6410worker1 # [ 137.486308] nix-daemon[852]: reaped child process 1696, status = succeeded6411worker1 # [ 137.635696] nix-daemon[852]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6412worker1 # [ 137.647742] nix-daemon[852]: reaped child process 1714, status = succeeded6413lb # [ 137.662183] niks3-server[1030]: 2026/09/20 09:34:24 INFO Received uploads request method=POST path=/api/pending_closures6414worker1 # [ 137.668348] nix-grpc-daemon[1423]: time=2026-09-20T09:34:23.951Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6415worker1 # [ 137.669945] nix-grpc-daemon[1423]: time=2026-09-20T09:34:23.953Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6416lb # [ 137.681691] niks3-server[1030]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6417lb # [ 137.684440] niks3-server[1030]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6418lb # [ 137.687933] niks3-server[1030]: 2026/09/20 09:34:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6419lb # [ 137.690375] niks3-server[1030]: 2026/09/20 09:34:24 INFO Signed narinfos id=51 count=16420worker1 # [ 137.691147] nix-grpc-daemon[1423]: time=2026-09-20T09:34:23.974Z level=INFO msg="Uploading 1 narinfos"6421lb # [ 137.693341] niks3-server[1030]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6422lb # [ 137.698491] niks3-server[1030]: 2026/09/20 09:34:24 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6423lb # [ 137.701155] niks3-server[1030]: 2026/09/20 09:34:24 INFO Completed upload id=516424worker1 # [ 137.703251] nix-grpc-daemon[1423]: time=2026-09-20T09:34:23.986Z level=INFO msg="Upload complete. (232ms)"6425lb # [ 137.703107] niks3-server[1030]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6426worker1 # [ 137.705496] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16427worker1 # [ 137.710348] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:23Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16428worker1 # [ 137.712474] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306429worker1 # [ 137.715367] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:23Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06430worker1 # [ 137.721137] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306431worker1 # [ 137.723318] nix-daemon[852]: reaped child process 1694, status = succeeded6432worker1 # [ 137.726680] nix-grpc-daemon[1423]: time=2026-09-20T09:34:24.010Z level=INFO msg="All 1 paths already cached"6433worker1 # [ 137.730164] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306434worker1 # [ 137.735098] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6435worker1 # [ 137.890979] nix-daemon[852]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6436worker1 # [ 137.902972] nix-daemon[852]: reaped child process 1723, status = succeeded6437worker1 # [ 138.067401] nix-daemon[852]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6438worker1 # [ 138.077946] nix-daemon[852]: reaped child process 1728, status = succeeded6439lb # [ 138.092494] niks3-server[1030]: 2026/09/20 09:34:25 INFO Received uploads request method=POST path=/api/pending_closures6440worker1 # [ 138.101352] nix-grpc-daemon[1423]: time=2026-09-20T09:34:24.384Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6441worker1 # [ 138.102839] nix-grpc-daemon[1423]: time=2026-09-20T09:34:24.386Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6442lb # [ 138.120113] niks3-server[1030]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6443lb # [ 138.132093] niks3-server[1030]: 2026/09/20 09:34:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6444lb # [ 138.136625] niks3-server[1030]: 2026/09/20 09:34:25 INFO Signed narinfos id=52 count=16445worker1 # [ 138.140234] nix-grpc-daemon[1423]: time=2026-09-20T09:34:24.423Z level=INFO msg="Uploading 1 narinfos"6446lb # [ 138.142613] niks3-server[1030]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6447lb # [ 138.154167] niks3-server[1030]: 2026/09/20 09:34:25 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6448worker1 # [ 138.160892] nix-grpc-daemon[1423]: time=2026-09-20T09:34:24.444Z level=INFO msg="Upload complete. (421ms)"6449lb # [ 138.160310] niks3-server[1030]: 2026/09/20 09:34:25 INFO Completed upload id=526450worker1 # [ 138.162792] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=6246451lb # [ 138.163557] niks3-server[1030]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6452worker1 # [ 138.168613] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306453worker1 # [ 138.178245] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6454worker1 # [ 138.180498] nix-daemon[852]: reaped child process 1718, status = succeeded6455worker1 # [ 138.185834] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6456lb # [ 138.377437] envoy[920]: conn peer=[2001:db8:1::4]:43898 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1104 tx=448 ms=272206457worker1 # [ 139.410276] nix-daemon[852]: reaped child process 1732, status = succeeded6458worker1 # [ 139.564744] nix-daemon[852]: accepted connection from pid 1747, user nix-grpc-daemon (trusted)6459worker1 # [ 139.576252] nix-daemon[852]: reaped child process 1750, status = succeeded6460lb # [ 139.591974] niks3-server[1030]: 2026/09/20 09:34:26 INFO Received uploads request method=POST path=/api/pending_closures6461worker1 # [ 139.601484] nix-grpc-daemon[1423]: time=2026-09-20T09:34:25.884Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6462worker1 # [ 139.602962] nix-grpc-daemon[1423]: time=2026-09-20T09:34:25.886Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6463lb # [ 139.628143] niks3-server[1030]: 2026/09/20 09:34:26 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6464lb # [ 139.638497] niks3-server[1030]: 2026/09/20 09:34:26 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6465lb # [ 139.647556] niks3-server[1030]: 2026/09/20 09:34:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6466lb # [ 139.651624] niks3-server[1030]: 2026/09/20 09:34:26 INFO Signed narinfos id=53 count=16467worker1 # [ 139.654932] nix-grpc-daemon[1423]: time=2026-09-20T09:34:25.938Z level=INFO msg="Uploading 1 narinfos"6468lb # [ 139.661398] niks3-server[1030]: 2026/09/20 09:34:26 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6469lb # [ 139.663227] niks3-server[1030]: 2026/09/20 09:34:26 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6470lb # [ 139.666775] niks3-server[1030]: 2026/09/20 09:34:26 INFO Completed upload id=536471worker1 # [ 139.667836] nix-grpc-daemon[1423]: time=2026-09-20T09:34:25.951Z level=INFO msg="Upload complete. (275ms)"6472lb # [ 139.667923] niks3-server[1030]: 2026/09/20 09:34:26 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6473worker1 # [ 139.678388] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16474worker1 # [ 139.683826] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:25Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16475worker1 # [ 139.687704] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306476worker1 # [ 139.690983] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:25Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06477worker1 # [ 139.698982] nix-daemon[852]: reaped child process 1730, status = succeeded6478worker1 # [ 139.700719] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306479worker1 # [ 139.706594] nix-grpc-daemon[1423]: time=2026-09-20T09:34:25.989Z level=INFO msg="All 1 paths already cached"6480worker1 # [ 139.710263] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306481worker1 # [ 139.713966] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6482worker1 # [ 139.858973] nix-daemon[852]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6483worker1 # [ 139.872181] nix-daemon[852]: reaped child process 1759, status = succeeded6484worker1 # [ 140.023906] nix-daemon[852]: accepted connection from pid 1761, user nix-grpc-daemon (trusted)6485worker1 # [ 140.035644] nix-daemon[852]: reaped child process 1764, status = succeeded6486lb # [ 140.049794] niks3-server[1030]: 2026/09/20 09:34:27 INFO Received uploads request method=POST path=/api/pending_closures6487worker1 # [ 140.058038] nix-grpc-daemon[1423]: time=2026-09-20T09:34:26.341Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6488worker1 # [ 140.059598] nix-grpc-daemon[1423]: time=2026-09-20T09:34:26.342Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6489lb # [ 140.080132] niks3-server[1030]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6490lb # [ 140.087058] niks3-server[1030]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6491lb # [ 140.089739] niks3-server[1030]: 2026/09/20 09:34:27 INFO Signed narinfos id=54 count=16492worker1 # [ 140.091907] nix-grpc-daemon[1423]: time=2026-09-20T09:34:26.375Z level=INFO msg="Uploading 1 narinfos"6493lb # [ 140.094258] niks3-server[1030]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6494lb # [ 140.098889] niks3-server[1030]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6495lb # [ 140.101411] niks3-server[1030]: 2026/09/20 09:34:27 INFO Completed upload id=546496worker1 # [ 140.103454] nix-grpc-daemon[1423]: time=2026-09-20T09:34:26.386Z level=INFO msg="Upload complete. (383ms)"6497lb # [ 140.103844] niks3-server[1030]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6498worker1 # [ 140.105424] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=6246499worker1 # [ 140.108409] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306500worker1 # [ 140.115135] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6501worker1 # [ 140.117740] nix-daemon[852]: reaped child process 1754, status = succeeded6502worker1 # [ 140.122737] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6503worker1 # [ 140.534268] nix-daemon[852]: reaped child process 1768, status = succeeded6504worker1 # [ 140.672687] nix-daemon[852]: accepted connection from pid 1783, user nix-grpc-daemon (trusted)6505worker1 # [ 140.684501] nix-daemon[852]: reaped child process 1786, status = succeeded6506lb # [ 140.698767] niks3-server[1030]: 2026/09/20 09:34:27 INFO Received uploads request method=POST path=/api/pending_closures6507worker1 # [ 140.704920] nix-grpc-daemon[1423]: time=2026-09-20T09:34:26.987Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6508worker1 # [ 140.706376] nix-grpc-daemon[1423]: time=2026-09-20T09:34:26.987Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6509lb # [ 140.715666] niks3-server[1030]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6510lb # [ 140.718304] niks3-server[1030]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6511lb # [ 140.722260] niks3-server[1030]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6512lb # [ 140.724568] niks3-server[1030]: 2026/09/20 09:34:27 INFO Signed narinfos id=55 count=16513worker1 # [ 140.725602] nix-grpc-daemon[1423]: time=2026-09-20T09:34:27.008Z level=INFO msg="Uploading 1 narinfos"6514lb # [ 140.730306] niks3-server[1030]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6515lb # [ 140.733287] niks3-server[1030]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6516lb # [ 140.737185] niks3-server[1030]: 2026/09/20 09:34:27 INFO Completed upload id=556517worker1 # [ 140.737989] nix-grpc-daemon[1423]: time=2026-09-20T09:34:27.021Z level=INFO msg="Upload complete. (210ms)"6518lb # [ 140.738791] niks3-server[1030]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6519worker1 # [ 140.740270] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16520worker1 # [ 140.745209] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16521worker1 # [ 140.747669] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306522worker1 # [ 140.750759] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06523worker1 # [ 140.756291] nix-daemon[852]: reaped child process 1766, status = succeeded6524worker1 # [ 140.757615] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306525worker1 # [ 140.763061] nix-grpc-daemon[1423]: time=2026-09-20T09:34:27.046Z level=INFO msg="All 1 paths already cached"6526worker1 # [ 140.766265] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306527worker1 # [ 140.769932] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6528worker1 # [ 140.917181] nix-daemon[852]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6529worker1 # [ 140.928864] nix-daemon[852]: reaped child process 1795, status = succeeded6530worker1 # [ 141.086983] nix-daemon[852]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6531worker1 # [ 141.098865] nix-daemon[852]: reaped child process 1800, status = succeeded6532lb # [ 141.111779] niks3-server[1030]: 2026/09/20 09:34:28 INFO Received uploads request method=POST path=/api/pending_closures6533worker1 # [ 141.119807] nix-grpc-daemon[1423]: time=2026-09-20T09:34:27.403Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6534worker1 # [ 141.121240] nix-grpc-daemon[1423]: time=2026-09-20T09:34:27.404Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6535lb # [ 141.137229] niks3-server[1030]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6536lb # [ 141.148913] niks3-server[1030]: 2026/09/20 09:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6537lb # [ 141.154258] niks3-server[1030]: 2026/09/20 09:34:28 INFO Signed narinfos id=56 count=16538worker1 # [ 141.158665] nix-grpc-daemon[1423]: time=2026-09-20T09:34:27.441Z level=INFO msg="Uploading 1 narinfos"6539lb # [ 141.158640] niks3-server[1030]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6540lb # [ 141.171084] niks3-server[1030]: 2026/09/20 09:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6541lb # [ 141.180508] niks3-server[1030]: 2026/09/20 09:34:28 INFO Completed upload id=566542worker1 # [ 141.184137] nix-grpc-daemon[1423]: time=2026-09-20T09:34:27.467Z level=INFO msg="Upload complete. (408ms)"6543lb # [ 141.185097] niks3-server[1030]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6544worker1 # [ 141.187910] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=6246545worker1 # [ 141.193284] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306546worker1 # [ 141.201774] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6547worker1 # [ 141.208790] nix-daemon[852]: reaped child process 1790, status = succeeded6548worker1 # [ 141.213565] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6549worker1 # [ 142.840696] nix-daemon[852]: reaped child process 1804, status = succeeded6550worker1 # [ 142.989449] nix-daemon[852]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)6551worker1 # [ 143.001154] nix-daemon[852]: reaped child process 1822, status = succeeded6552lb # [ 143.015912] niks3-server[1030]: 2026/09/20 09:34:29 INFO Received uploads request method=POST path=/api/pending_closures6553worker1 # [ 143.024703] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.307Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6554worker1 # [ 143.026194] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.309Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6555lb # [ 143.053429] niks3-server[1030]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6556lb # [ 143.059315] niks3-server[1030]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6557lb # [ 143.073118] niks3-server[1030]: 2026/09/20 09:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6558lb # [ 143.079871] niks3-server[1030]: 2026/09/20 09:34:30 INFO Signed narinfos id=57 count=16559worker1 # [ 143.080852] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.364Z level=INFO msg="Uploading 1 narinfos"6560lb # [ 143.083205] niks3-server[1030]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6561lb # [ 143.094326] niks3-server[1030]: 2026/09/20 09:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6562lb # [ 143.100287] niks3-server[1030]: 2026/09/20 09:34:30 INFO Completed upload id=576563lb # [ 143.101612] niks3-server[1030]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6564worker1 # [ 143.101496] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.384Z level=INFO msg="Upload complete. (279ms)"6565worker1 # [ 143.113937] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16566worker1 # [ 143.119370] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16567worker1 # [ 143.124224] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306568worker1 # [ 143.127413] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06569worker1 # [ 143.138282] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306570worker1 # [ 143.140549] nix-daemon[852]: reaped child process 1802, status = succeeded6571worker1 # [ 143.145857] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.429Z level=INFO msg="All 2 paths already cached"6572worker1 # [ 143.150110] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306573worker1 # [ 143.153808] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6574worker1 # [ 143.307220] nix-daemon[852]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)6575worker1 # [ 143.318935] nix-daemon[852]: reaped child process 1831, status = succeeded6576worker1 # [ 143.475289] nix-daemon[852]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6577worker1 # [ 143.486664] nix-daemon[852]: reaped child process 1836, status = succeeded6578lb # [ 143.500568] niks3-server[1030]: 2026/09/20 09:34:30 INFO Received uploads request method=POST path=/api/pending_closures6579worker1 # [ 143.505845] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.788Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6580worker1 # [ 143.507228] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.788Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6581lb # [ 143.513204] niks3-server[1030]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6582lb # [ 143.517318] niks3-server[1030]: 2026/09/20 09:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6583worker1 # [ 143.520735] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.803Z level=INFO msg="Uploading 1 narinfos"6584lb # [ 143.520102] niks3-server[1030]: 2026/09/20 09:34:30 INFO Signed narinfos id=58 count=16585lb # [ 143.524257] niks3-server[1030]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6586lb # [ 143.527908] niks3-server[1030]: 2026/09/20 09:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6587lb # [ 143.530499] niks3-server[1030]: 2026/09/20 09:34:30 INFO Completed upload id=586588worker1 # [ 143.531343] nix-grpc-daemon[1423]: time=2026-09-20T09:34:29.814Z level=INFO msg="Upload complete. (372ms)"6589worker1 # [ 143.533316] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=7526590lb # [ 143.533151] niks3-server[1030]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6591worker1 # [ 143.536313] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306592worker1 # [ 143.541695] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6593worker1 # [ 143.545258] nix-daemon[852]: reaped child process 1826, status = succeeded6594worker1 # [ 143.549983] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6595worker1 # [ 144.173839] nix-daemon[852]: reaped child process 1840, status = succeeded6596worker1 # [ 144.323567] nix-daemon[852]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)6597worker1 # [ 144.335625] nix-daemon[852]: reaped child process 1858, status = succeeded6598lb # [ 144.351512] niks3-server[1030]: 2026/09/20 09:34:31 INFO Received uploads request method=POST path=/api/pending_closures6599worker1 # [ 144.361283] nix-grpc-daemon[1423]: time=2026-09-20T09:34:30.643Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6600worker1 # [ 144.362719] nix-grpc-daemon[1423]: time=2026-09-20T09:34:30.643Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6601lb # [ 144.383195] niks3-server[1030]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6602lb # [ 144.388634] niks3-server[1030]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6603lb # [ 144.400578] niks3-server[1030]: 2026/09/20 09:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6604lb # [ 144.405065] niks3-server[1030]: 2026/09/20 09:34:31 INFO Signed narinfos id=59 count=16605worker1 # [ 144.408868] nix-grpc-daemon[1423]: time=2026-09-20T09:34:30.692Z level=INFO msg="Uploading 1 narinfos"6606lb # [ 144.415453] niks3-server[1030]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6607lb # [ 144.422346] niks3-server[1030]: 2026/09/20 09:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6608lb # [ 144.428469] niks3-server[1030]: 2026/09/20 09:34:31 INFO Completed upload id=596609worker1 # [ 144.429462] nix-grpc-daemon[1423]: time=2026-09-20T09:34:30.712Z level=INFO msg="Upload complete. (273ms)"6610lb # [ 144.431147] niks3-server[1030]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6611worker1 # [ 144.436871] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16612worker1 # [ 144.444477] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:30Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16613worker1 # [ 144.448551] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306614worker1 # [ 144.458533] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306615worker1 # [ 144.462188] nix-daemon[852]: reaped child process 1838, status = succeeded6616worker1 # [ 144.466921] nix-grpc-daemon[1423]: time=2026-09-20T09:34:30.750Z level=INFO msg="All 2 paths already cached"6617worker1 # [ 144.470580] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306618worker1 # [ 144.474317] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6619worker1 # [ 144.622926] nix-daemon[852]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)6620worker1 # [ 144.634773] nix-daemon[852]: reaped child process 1865, status = succeeded6621worker1 # [ 144.787752] nix-daemon[852]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6622worker1 # [ 144.799261] nix-daemon[852]: reaped child process 1870, status = succeeded6623lb # [ 144.813628] niks3-server[1030]: 2026/09/20 09:34:31 INFO Received uploads request method=POST path=/api/pending_closures6624worker1 # [ 144.822728] nix-grpc-daemon[1423]: time=2026-09-20T09:34:31.106Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6625worker1 # [ 144.824250] nix-grpc-daemon[1423]: time=2026-09-20T09:34:31.107Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6626lb # [ 144.840103] niks3-server[1030]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6627lb # [ 144.853060] niks3-server[1030]: 2026/09/20 09:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6628worker1 # [ 144.860341] nix-grpc-daemon[1423]: time=2026-09-20T09:34:31.143Z level=INFO msg="Uploading 1 narinfos"6629lb # [ 144.859987] niks3-server[1030]: 2026/09/20 09:34:31 INFO Signed narinfos id=60 count=16630lb # [ 144.864380] niks3-server[1030]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6631lb # [ 144.876062] niks3-server[1030]: 2026/09/20 09:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6632worker1 # [ 144.881277] nix-grpc-daemon[1423]: time=2026-09-20T09:34:31.164Z level=INFO msg="Upload complete. (401ms)"6633lb # [ 144.880560] niks3-server[1030]: 2026/09/20 09:34:31 INFO Completed upload id=606634worker1 # [ 144.883249] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=7526635lb # [ 144.883627] niks3-server[1030]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6636worker1 # [ 144.888416] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306637worker1 # [ 144.893304] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6638worker1 # [ 144.895568] nix-daemon[852]: reaped child process 1860, status = succeeded6639worker1 # [ 144.900881] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6640worker1 # [ 146.114358] nix-daemon[852]: reaped child process 1874, status = succeeded6641worker1 # [ 146.253743] nix-daemon[852]: accepted connection from pid 1889, user nix-grpc-daemon (trusted)6642worker1 # [ 146.264557] nix-daemon[852]: reaped child process 1892, status = succeeded6643lb # [ 146.278515] niks3-server[1030]: 2026/09/20 09:34:33 INFO Received uploads request method=POST path=/api/pending_closures6644worker1 # [ 146.283401] nix-grpc-daemon[1423]: time=2026-09-20T09:34:32.566Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6645worker1 # [ 146.284854] nix-grpc-daemon[1423]: time=2026-09-20T09:34:32.568Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6646lb # [ 146.296373] niks3-server[1030]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6647lb # [ 146.300629] niks3-server[1030]: 2026/09/20 09:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6648lb # [ 146.303371] niks3-server[1030]: 2026/09/20 09:34:33 INFO Signed narinfos id=61 count=16649worker1 # [ 146.304366] nix-grpc-daemon[1423]: time=2026-09-20T09:34:32.587Z level=INFO msg="Uploading 1 narinfos"6650lb # [ 146.305328] niks3-server[1030]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6651lb # [ 146.309440] niks3-server[1030]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6652lb # [ 146.313144] niks3-server[1030]: 2026/09/20 09:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6653lb # [ 146.316945] niks3-server[1030]: 2026/09/20 09:34:33 INFO Completed upload id=616654worker1 # [ 146.317750] nix-grpc-daemon[1423]: time=2026-09-20T09:34:32.601Z level=INFO msg="Upload complete. (210ms)"6655lb # [ 146.318159] niks3-server[1030]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6656worker1 # [ 146.320137] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16657worker1 # [ 146.324368] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:32Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16658worker1 # [ 146.328967] nix-daemon[852]: reaped child process 1872, status = succeeded6659worker1 # [ 146.365706] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306660worker1 # [ 146.371188] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306661worker1 # [ 146.376845] nix-grpc-daemon[1423]: time=2026-09-20T09:34:32.660Z level=INFO msg="All 2 paths already cached"6662worker1 # [ 146.379840] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306663worker1 # [ 146.383505] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6664worker1 # [ 146.534040] nix-daemon[852]: accepted connection from pid 1896, user nix-grpc-daemon (trusted)6665worker1 # [ 146.545723] nix-daemon[852]: reaped child process 1899, status = succeeded6666worker1 # [ 146.705095] nix-daemon[852]: accepted connection from pid 1901, user nix-grpc-daemon (trusted)6667worker1 # [ 146.716785] nix-daemon[852]: reaped child process 1904, status = succeeded6668lb # [ 146.731239] niks3-server[1030]: 2026/09/20 09:34:33 INFO Received uploads request method=POST path=/api/pending_closures6669worker1 # [ 146.736147] nix-grpc-daemon[1423]: time=2026-09-20T09:34:33.019Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6670worker1 # [ 146.737510] nix-grpc-daemon[1423]: time=2026-09-20T09:34:33.019Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6671lb # [ 146.743405] niks3-server[1030]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6672lb # [ 146.746207] niks3-server[1030]: 2026/09/20 09:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6673lb # [ 146.748588] niks3-server[1030]: 2026/09/20 09:34:33 INFO Signed narinfos id=62 count=16674worker1 # [ 146.749650] nix-grpc-daemon[1423]: time=2026-09-20T09:34:33.032Z level=INFO msg="Uploading 1 narinfos"6675lb # [ 146.751645] niks3-server[1030]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6676lb # [ 146.755845] niks3-server[1030]: 2026/09/20 09:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6677lb # [ 146.758193] niks3-server[1030]: 2026/09/20 09:34:33 INFO Completed upload id=626678worker1 # [ 146.759056] nix-grpc-daemon[1423]: time=2026-09-20T09:34:33.042Z level=INFO msg="Upload complete. (369ms)"6679worker1 # [ 146.760954] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=7526680lb # [ 146.760701] niks3-server[1030]: 2026/09/20 09:34:33 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6681worker1 # [ 146.763739] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306682worker1 # [ 146.768515] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6683worker1 # [ 146.772844] nix-daemon[852]: reaped child process 1894, status = succeeded6684worker1 # [ 146.777214] nix-daemon[852]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6685worker1 # [ 147.590876] nix-daemon[852]: reaped child process 1908, status = succeeded6686worker1 # [ 147.723784] nix-daemon[852]: accepted connection from pid 1923, user nix-grpc-daemon (trusted)6687worker1 # [ 147.735460] nix-daemon[852]: reaped child process 1926, status = succeeded6688lb # [ 147.751072] niks3-server[1030]: 2026/09/20 09:34:34 INFO Received uploads request method=POST path=/api/pending_closures6689worker1 # [ 147.760085] nix-grpc-daemon[1423]: time=2026-09-20T09:34:34.042Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6690worker1 # [ 147.761414] nix-grpc-daemon[1423]: time=2026-09-20T09:34:34.042Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6691lb # [ 147.782215] niks3-server[1030]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6692lb # [ 147.790498] niks3-server[1030]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6693lb # [ 147.800390] niks3-server[1030]: 2026/09/20 09:34:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6694worker1 # [ 147.807479] nix-grpc-daemon[1423]: time=2026-09-20T09:34:34.090Z level=INFO msg="Uploading 1 narinfos"6695lb # [ 147.806567] niks3-server[1030]: 2026/09/20 09:34:34 INFO Signed narinfos id=63 count=16696lb # [ 147.810149] niks3-server[1030]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6697lb # [ 147.821798] niks3-server[1030]: 2026/09/20 09:34:34 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6698lb # [ 147.826068] niks3-server[1030]: 2026/09/20 09:34:34 INFO Completed upload id=636699lb # [ 147.828716] niks3-server[1030]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6700worker1 # [ 147.829267] nix-grpc-daemon[1423]: time=2026-09-20T09:34:34.112Z level=INFO msg="Upload complete. (246ms)"6701worker1 # [ 147.835354] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16702worker1 # [ 147.846420] nix-daemon[852]: reaped child process 1906, status = succeeded6703client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.86 seconds)6704worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6705worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6706client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16707worker2 # [ 148.092657] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504246708worker1 # [ 148.108834] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306709worker1 # [ 148.128466] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:34Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06710client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.23 seconds)6711(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 17.15 seconds)6712subtest: low disk drains a worker and builds go to the other6713worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6714lb # [ 148.378326] envoy[920]: conn peer=[2001:db8:1::1]:44892 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27124 tx=10653 ms=166456715lb # [ 148.382176] envoy[920]: conn peer=[2001:db8:1::1]:41970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=481 ms=406716worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.92 seconds)6717worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6718worker1 # [ 149.446208] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:35Z level=info event=unhealthy reason=min_free6719worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds)6720client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26721client # don't know how to build these paths:6722client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6723worker2 # [ 150.328753] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504246724worker2 # [ 150.334459] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504246725worker1 # [ 150.368261] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:36Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06726worker1 # [ 150.372836] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:36Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16727worker2 # [ 150.399089] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504246728worker2 # [ 150.408931] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504246729client # copying 1 paths to 'lb:50051'...6730client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6731worker2 # [ 150.420744] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504246732worker2 # [ 150.430881] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6733worker2 # [ 150.447202] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:36Z level=info event=niks3_push_started pid=18906734worker2 # [ 150.763628] nix-daemon[845]: accepted connection from pid 1903, user nix-grpc-daemon (trusted)6735worker2 # [ 150.775355] nix-daemon[845]: reaped child process 1906, status = succeeded6736worker2 # [ 150.937295] nix-daemon[845]: accepted connection from pid 1908, user nix-grpc-daemon (trusted)6737worker2 # [ 150.948781] nix-daemon[845]: reaped child process 1911, status = succeeded6738lb # [ 150.977198] niks3-server[1030]: 2026/09/20 09:34:37 INFO Received uploads request method=POST path=/api/pending_closures6739worker2 # [ 150.972293] nix-grpc-daemon[1890]: time=2026-09-20T09:34:37.311Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6740worker2 # [ 150.975429] nix-grpc-daemon[1890]: time=2026-09-20T09:34:37.313Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6741lb # [ 151.014121] niks3-server[1030]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6742lb # [ 151.026293] niks3-server[1030]: 2026/09/20 09:34:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6743lb # [ 151.031133] niks3-server[1030]: 2026/09/20 09:34:37 INFO Signed narinfos id=64 count=16744worker2 # [ 151.022143] nix-grpc-daemon[1890]: time=2026-09-20T09:34:37.361Z level=INFO msg="Uploading 1 narinfos"6745lb # [ 151.045365] niks3-server[1030]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6746lb # [ 151.050193] niks3-server[1030]: 2026/09/20 09:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6747lb # [ 151.056814] niks3-server[1030]: 2026/09/20 09:34:38 INFO Completed upload id=646748worker2 # [ 151.044332] nix-grpc-daemon[1890]: time=2026-09-20T09:34:37.383Z level=INFO msg="Upload complete. (414ms)"6749lb # [ 151.058872] niks3-server[1030]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6750worker2 # [ 151.048236] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50424 duration_s=0 paths=1 nar_bytes_in=5126751worker2 # [ 151.053744] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504246752worker2 # [ 151.063104] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6753worker2 # [ 151.069948] nix-daemon[845]: reaped child process 1888, status = succeeded6754client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6755client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6756worker2 # [ 151.074361] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6757client # farm-a> LOG-farm-a-drain6758worker2 # [ 152.087622] nix-daemon[845]: reaped child process 1915, status = succeeded6759worker2 # [ 152.226117] nix-daemon[845]: accepted connection from pid 1930, user nix-grpc-daemon (trusted)6760worker2 # [ 152.237121] nix-daemon[845]: reaped child process 1933, status = succeeded6761lb # [ 152.263248] niks3-server[1030]: 2026/09/20 09:34:39 INFO Received uploads request method=POST path=/api/pending_closures6762worker2 # [ 152.259405] nix-grpc-daemon[1890]: time=2026-09-20T09:34:38.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6763worker2 # [ 152.261251] nix-grpc-daemon[1890]: time=2026-09-20T09:34:38.600Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6764lb # [ 152.301242] niks3-server[1030]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6765lb # [ 152.306709] niks3-server[1030]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6766lb # [ 152.316646] niks3-server[1030]: 2026/09/20 09:34:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6767lb # [ 152.322210] niks3-server[1030]: 2026/09/20 09:34:39 INFO Signed narinfos id=65 count=16768worker2 # [ 152.312133] nix-grpc-daemon[1890]: time=2026-09-20T09:34:38.651Z level=INFO msg="Uploading 1 narinfos"6769lb # [ 152.324660] niks3-server[1030]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6770lb # [ 152.330453] niks3-server[1030]: 2026/09/20 09:34:39 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6771lb # [ 152.333231] niks3-server[1030]: 2026/09/20 09:34:39 INFO Completed upload id=656772worker2 # [ 152.320560] nix-grpc-daemon[1890]: time=2026-09-20T09:34:38.660Z level=INFO msg="Upload complete. (239ms)"6773lb # [ 152.335814] niks3-server[1030]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6774worker2 # [ 152.323706] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50424 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16775worker2 # [ 152.334754] nix-daemon[845]: reaped child process 1913, status = succeeded6776worker1 # [ 152.345606] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:38Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06777worker1 # [ 152.349602] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:38Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16778worker2 # [ 152.375662] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504246779worker2 # [ 152.386802] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504246780worker2 # [ 152.397427] nix-grpc-daemon[1890]: time=2026-09-20T09:34:38.737Z level=INFO msg="All 1 paths already cached"6781client # copying 1 paths to 'lb:50051'...6782client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6783worker2 # [ 152.404743] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504246784worker2 # [ 152.413296] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6785worker2 # [ 152.576532] nix-daemon[845]: accepted connection from pid 1937, user nix-grpc-daemon (trusted)6786worker2 # [ 152.588433] nix-daemon[845]: reaped child process 1940, status = succeeded6787worker2 # [ 152.747606] nix-daemon[845]: accepted connection from pid 1942, user nix-grpc-daemon (trusted)6788worker2 # [ 152.759352] nix-daemon[845]: reaped child process 1945, status = succeeded6789lb # [ 152.785854] niks3-server[1030]: 2026/09/20 09:34:39 INFO Received uploads request method=POST path=/api/pending_closures6790worker2 # [ 152.780861] nix-grpc-daemon[1890]: time=2026-09-20T09:34:39.120Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6791worker2 # [ 152.782235] nix-grpc-daemon[1890]: time=2026-09-20T09:34:39.120Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6792lb # [ 152.812737] niks3-server[1030]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6793lb # [ 152.820998] niks3-server[1030]: 2026/09/20 09:34:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6794lb # [ 152.827654] niks3-server[1030]: 2026/09/20 09:34:39 INFO Signed narinfos id=66 count=16795worker2 # [ 152.818524] nix-grpc-daemon[1890]: time=2026-09-20T09:34:39.158Z level=INFO msg="Uploading 1 narinfos"6796lb # [ 152.832430] niks3-server[1030]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6797lb # [ 152.844820] niks3-server[1030]: 2026/09/20 09:34:39 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6798worker2 # [ 152.838459] nix-grpc-daemon[1890]: time=2026-09-20T09:34:39.178Z level=INFO msg="Upload complete. (412ms)"6799lb # [ 152.851256] niks3-server[1030]: 2026/09/20 09:34:39 INFO Completed upload id=666800worker2 # [ 152.840469] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50424 duration_s=0 paths=1 nar_bytes_in=6246801lb # [ 152.854800] niks3-server[1030]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6802worker2 # [ 152.846304] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504246803worker2 # [ 152.855559] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6804worker2 # [ 152.858387] nix-daemon[845]: reaped child process 1935, status = succeeded6805worker2 # [ 152.863244] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6806client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6807client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6808client # farm-b> LOG-farm-b-drain6809worker2 # [ 153.675810] nix-daemon[845]: reaped child process 1949, status = succeeded6810worker2 # [ 153.810315] nix-daemon[845]: accepted connection from pid 1964, user nix-grpc-daemon (trusted)6811worker2 # [ 153.822269] nix-daemon[845]: reaped child process 1967, status = succeeded6812lb # [ 153.851480] niks3-server[1030]: 2026/09/20 09:34:40 INFO Received uploads request method=POST path=/api/pending_closures6813worker2 # [ 153.846641] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.186Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6814worker2 # [ 153.848130] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.187Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6815lb # [ 153.887655] niks3-server[1030]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6816lb # [ 153.893834] niks3-server[1030]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6817lb # [ 153.906263] niks3-server[1030]: 2026/09/20 09:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6818lb # [ 153.912772] niks3-server[1030]: 2026/09/20 09:34:40 INFO Signed narinfos id=67 count=16819worker2 # [ 153.902889] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.242Z level=INFO msg="Uploading 1 narinfos"6820lb # [ 153.915357] niks3-server[1030]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6821lb # [ 153.926651] niks3-server[1030]: 2026/09/20 09:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6822lb # [ 153.932411] niks3-server[1030]: 2026/09/20 09:34:40 INFO Completed upload id=676823lb # [ 153.934241] niks3-server[1030]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6824worker2 # [ 153.921243] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.260Z level=INFO msg="Upload complete. (251ms)"6825worker2 # [ 153.926811] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50424 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16826worker1 # [ 153.945830] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:40Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06827worker1 # [ 153.950409] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:40Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16828worker2 # [ 153.941529] nix-daemon[845]: reaped child process 1947, status = succeeded6829worker2 # [ 153.975619] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504246830worker2 # [ 153.986198] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504246831worker2 # [ 153.996720] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.336Z level=INFO msg="All 2 paths already cached"6832client # copying 1 paths to 'lb:50051'...6833client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6834worker2 # [ 154.004144] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504246835worker2 # [ 154.012342] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6836worker2 # [ 154.173767] nix-daemon[845]: accepted connection from pid 1971, user nix-grpc-daemon (trusted)6837worker2 # [ 154.185815] nix-daemon[845]: reaped child process 1974, status = succeeded6838worker2 # [ 154.337950] nix-daemon[845]: accepted connection from pid 1976, user nix-grpc-daemon (trusted)6839worker2 # [ 154.349446] nix-daemon[845]: reaped child process 1979, status = succeeded6840lb # [ 154.375526] niks3-server[1030]: 2026/09/20 09:34:41 INFO Received uploads request method=POST path=/api/pending_closures6841worker2 # [ 154.371244] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.710Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6842worker2 # [ 154.372717] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.712Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6843lb # [ 154.407146] niks3-server[1030]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6844lb # [ 154.415828] niks3-server[1030]: 2026/09/20 09:34:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6845lb # [ 154.420610] niks3-server[1030]: 2026/09/20 09:34:41 INFO Signed narinfos id=68 count=16846worker2 # [ 154.411696] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.751Z level=INFO msg="Uploading 1 narinfos"6847lb # [ 154.425258] niks3-server[1030]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6848lb # [ 154.437718] niks3-server[1030]: 2026/09/20 09:34:41 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6849lb # [ 154.443694] niks3-server[1030]: 2026/09/20 09:34:41 INFO Completed upload id=686850worker2 # [ 154.431175] nix-grpc-daemon[1890]: time=2026-09-20T09:34:40.770Z level=INFO msg="Upload complete. (406ms)"6851lb # [ 154.447901] niks3-server[1030]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6852worker2 # [ 154.433937] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50424 duration_s=0 paths=1 nar_bytes_in=7526853worker2 # [ 154.442434] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504246854worker2 # [ 154.451874] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6855worker2 # [ 154.455268] nix-daemon[845]: reaped child process 1969, status = succeeded6856worker2 # [ 154.460208] nix-daemon[845]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6857client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6858client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6859worker2 # [ 155.873499] nix-daemon[845]: reaped child process 1983, status = succeeded6860client # farm-top> LOG-farm-top-drain6861worker2 # [ 155.992176] nix-daemon[845]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)6862worker2 # [ 156.004143] nix-daemon[845]: reaped child process 2001, status = succeeded6863lb # [ 156.027404] niks3-server[1030]: 2026/09/20 09:34:42 INFO Received uploads request method=POST path=/api/pending_closures6864worker2 # [ 156.024198] nix-grpc-daemon[1890]: time=2026-09-20T09:34:42.362Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6865worker2 # [ 156.025499] nix-grpc-daemon[1890]: time=2026-09-20T09:34:42.362Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6866lb # [ 156.061474] niks3-server[1030]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6867lb # [ 156.067178] niks3-server[1030]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6868lb # [ 156.081243] niks3-server[1030]: 2026/09/20 09:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6869lb # [ 156.085788] niks3-server[1030]: 2026/09/20 09:34:43 INFO Signed narinfos id=69 count=16870worker2 # [ 156.076201] nix-grpc-daemon[1890]: time=2026-09-20T09:34:42.415Z level=INFO msg="Uploading 1 narinfos"6871lb # [ 156.091660] niks3-server[1030]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6872lb # [ 156.099858] niks3-server[1030]: 2026/09/20 09:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6873lb # [ 156.106302] niks3-server[1030]: 2026/09/20 09:34:43 INFO Completed upload id=696874lb # [ 156.107654] niks3-server[1030]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6875worker2 # [ 156.095045] nix-grpc-daemon[1890]: time=2026-09-20T09:34:42.434Z level=INFO msg="Upload complete. (227ms)"6876worker2 # [ 156.101160] nix-grpc-daemon[1834]: ts=2026-09-20T09:34:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50424 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16877worker2 # [ 156.111870] nix-daemon[845]: reaped child process 1981, status = succeeded6878client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 5.98 seconds)6879client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6880client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.18 seconds)6881worker1: must succeed: rm /nix/.rw-store/fill6882worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6883worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6884worker1 # [ 157.454184] nix-grpc-daemon[1348]: ts=2026-09-20T09:34:43Z level=info event=healthy reason=min_free6885worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6886(finished: subtest: low disk drains a worker and builds go to the other, in 9.48 seconds)6887(finished: run the VM test script, in 158.49 seconds)6888test script finished in 158.71s6889cleanup6890kill QemuMachine (pid 49)6891client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6892kill QemuMachine (pid 51)6893lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6894kill QemuMachine (pid 50)6895worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6896kill QemuMachine (pid 52)6897worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6898(finished: cleanup, in 0.93 seconds)6899additionally exposed symbols:6900 client, lb, worker1, worker2,6901 vlan1,6902 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh