vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #230
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client: QEMU running (pid 49)13client # Disk image does not exist, creating the virtualisation disk image...14worker1: QEMU running (pid 52)15client # Formatting '/build/vm-state-client/tmp.DsL5TEYWey', fmt=raw size=107374182416worker1 # Disk image does not exist, creating the virtualisation disk image...17client # mke2fs 1.47.4 (6-Mar-2025)18worker1 # Formatting '/build/vm-state-worker1/tmp.1QQe1D3r5P', fmt=raw size=107374182419client # Discarding device blocks: 0/262144 done20worker1 # mke2fs 1.47.4 (6-Mar-2025)21client # Creating filesystem with 262144 4k blocks and 65536 inodes22worker1 # Discarding device blocks: 0/262144 done23client # Filesystem UUID: 508d8a46-b569-4517-8fe9-0ce4a3d9881624worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes25worker1 # Filesystem UUID: c63c3165-ade2-498d-9553-7be578ece02626worker1 # Superblock backups stored on blocks:27worker2 # Disk image does not exist, creating the virtualisation disk image...28worker2: QEMU running (pid 51)29client # Superblock backups stored on blocks:30worker1 # 32768, 98304, 163840, 22937631client # 32768, 98304, 163840, 22937632worker1 # 33client # 34worker1 # Allocating group tables: 0/8 done35client # Allocating group tables: 0/8 done36worker1 # Writing inode tables: 0/8 done37client # Writing inode tables: 0/8 done38worker1 # Creating journal (8192 blocks): done39client # Creating journal (8192 blocks): done40worker1 # Writing superblocks and filesystem accounting information: 0/8 done41client # Writing superblocks and filesystem accounting information: 0/8 done42worker1 # 43client # 44worker1 # Virtualisation disk image created.45client # Virtualisation disk image created.46worker2 # Formatting '/build/vm-state-worker2/tmp.vomlPddvA7', fmt=raw size=107374182447worker2 # mke2fs 1.47.4 (6-Mar-2025)48worker2 # Discarding device blocks: 0/262144 done49worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes50worker2 # Filesystem UUID: 0683312e-89f5-4077-afd4-a233d03dbcc751worker2 # Superblock backups stored on blocks:52worker2 # 32768, 98304, 163840, 22937653worker2 # 54worker2 # Allocating group tables: 0/8 done55worker2 # Writing inode tables: 0/8 done56worker2 # Creating journal (8192 blocks): done57worker2 # Writing superblocks and filesystem accounting information: 0/8 done58worker2 # 59worker2 # Virtualisation disk image created.60lb # Disk image does not exist, creating the virtualisation disk image...61lb: QEMU running (pid 50)62lb # Formatting '/build/vm-state-lb/tmp.Kjc2pqSLsc', fmt=raw size=107374182463lb # mke2fs 1.47.4 (6-Mar-2025)64lb # Discarding device blocks: 0/262144 done65lb # Creating filesystem with 262144 4k blocks and 65536 inodes66lb # Filesystem UUID: 06975070-7680-483e-8dde-b1b91d4d75f467lb # Superblock backups stored on blocks:68lb # 32768, 98304, 163840, 22937669(finished: start all VMs, in 0.38 seconds)70lb # 71lb # Allocating group tables: 0/8 done72lb # Writing inode tables: 0/8 done73lb # Creating journal (8192 blocks): done74lb # Writing superblocks and filesystem accounting information: 0/8 done75lb # 76lb # Virtualisation disk image created.77client: waiting for unit network-addresses-eth1.service78client: waiting for the VM to finish booting79client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83client # 84client # 85client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086lb # 87lb # 88client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...89client # 90client # 91client # 92client # 93lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0094client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0095lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...96lb # 97lb # 98lb # 99lb # 100worker1 # 101worker1 # 102lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00104client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105client # 106client # 107worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108worker1 # 109worker1 # 110worker1 # 111worker1 # 112lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...113lb # 114lb # 115worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117worker1 # 118worker1 # 119worker2 # 120worker2 # 121worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123worker2 # 124worker2 # 125worker2 # 126worker2 # 127worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker2 # 130worker2 # 131lb # Booting from ROM...132client # Booting from ROM...133worker1 # Booting from ROM...134worker2 # Booting from ROM...135lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0137lb # [ 0.000000] BIOS-provided physical RAM map:138lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker1 # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026142lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable143lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved144lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved145lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved146lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved147worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vp7y4ay4sa33a6v1s4gpmx09kwbsi0c3-nixos-system-worker1-test/init regInfo=/nix/store/sy8zjgmidl0x90xc5f3sn0iw1nnxll56-closure-info/registration console=ttyS0,115200n8 console=tty0148worker1 # [ 0.000000] BIOS-provided physical RAM map:149lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved150worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable151lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved152lb # [ 0.000000] NX (Execute Disable) protection: active153worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved154lb # [ 0.000000] APIC: Static calls initialized155lb # [ 0.000000] SMBIOS 2.8 present.156worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved157worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable158lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014159lb # [ 0.000000] DMI: Memory slots populated: 1/1160worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved161lb # [ 0.000000] Hypervisor detected: KVM162lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000163worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved164lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00165worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved166lb # [ 0.000000] kvm-clock: using sched offset of 452472868 cycles167worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved168lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns169worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved170lb # [ 0.000005] tsc: Detected 2400.012 MHz processor171worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved172lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000173worker1 # [ 0.000000] NX (Execute Disable) protection: active174worker1 # [ 0.000000] APIC: Static calls initialized175lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs176worker1 # [ 0.000000] SMBIOS 2.8 present.177client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026178lb # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT179worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014180lb # [ 0.002743] found SMP MP-table at [mem 0x000f5450-0x000f545f]181lb # [ 0.002753] Using GB pages for direct mapping182worker1 # [ 0.000000] DMI: Memory slots populated: 1/1183worker1 # [ 0.000000] Hypervisor detected: KVM184lb # [ 0.002873] RAMDISK: [mem 0x5e367000-0x5ffcffff]185worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026186worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000187lb # [ 0.002881] ACPI: Early table checksum verification disabled188worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00189lb # [ 0.002883] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )190client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test/init regInfo=/nix/store/v3nhx5y8n442sy6f0rpqs0hcz2kqcw2i-closure-info/registration console=ttyS0,115200n8 console=tty0191worker1 # [ 0.000000] kvm-clock: using sched offset of 460532837 cycles192client # [ 0.000000] BIOS-provided physical RAM map:193lb # [ 0.002887] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)194client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable195worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns196lb # [ 0.002892] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)197worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor198worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/29wvwacdyvpg20jr5pggcm533l539zs3-nixos-system-worker2-test/init regInfo=/nix/store/fp5i8d25csfaa7415waaqnnmaih5p7nv-closure-info/registration console=ttyS0,115200n8 console=tty0199client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved200worker2 # [ 0.000000] BIOS-provided physical RAM map:201worker1 # [ 0.000823] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000202lb # [ 0.002899] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)203client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved204lb # [ 0.002901] ACPI: FACS 0x000000005FFE0000 000040205worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable206worker1 # [ 0.000851] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs207client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable208worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved209lb # [ 0.002902] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)210worker1 # [ 0.000853] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT211client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved212worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved213worker1 # [ 0.002757] found SMP MP-table at [mem 0x000f5450-0x000f545f]214client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved215lb # [ 0.002904] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)216worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable217worker1 # [ 0.002769] Using GB pages for direct mapping218worker1 # [ 0.002882] RAMDISK: [mem 0x5e367000-0x5ffcffff]219client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved220lb # [ 0.002906] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)221worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved222worker1 # [ 0.002890] ACPI: Early table checksum verification disabled223client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved224lb # [ 0.002907] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)225worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved226worker1 # [ 0.002893] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )227client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved228lb # [ 0.002908] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]229worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved230worker1 # [ 0.002897] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)231client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved232lb # [ 0.002910] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]233worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved234client # [ 0.000000] NX (Execute Disable) protection: active235worker1 # [ 0.002902] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)236worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved237lb # [ 0.002910] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]238client # [ 0.000000] APIC: Static calls initialized239client # [ 0.000000] SMBIOS 2.8 present.240worker1 # [ 0.002910] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)241lb # [ 0.002910] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]242worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved243worker1 # [ 0.002913] ACPI: FACS 0x000000005FFE0000 000040244worker2 # [ 0.000000] NX (Execute Disable) protection: active245lb # [ 0.002911] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]246client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014247worker2 # [ 0.000000] APIC: Static calls initialized248client # [ 0.000000] DMI: Memory slots populated: 1/1249worker1 # [ 0.002915] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)250worker2 # [ 0.000000] SMBIOS 2.8 present.251lb # [ 0.002911] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]252client # [ 0.000000] Hypervisor detected: KVM253client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000254lb # [ 0.002912] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]255worker1 # [ 0.002918] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)256worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014257lb # [ 0.003129] No NUMA configuration found258client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00259worker2 # [ 0.000000] DMI: Memory slots populated: 1/1260worker1 # [ 0.002920] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)261worker2 # [ 0.000000] Hypervisor detected: KVM262lb # [ 0.003130] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]263client # [ 0.000001] kvm-clock: using sched offset of 470340148 cycles264worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000265lb # [ 0.003132] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]266worker1 # [ 0.002922] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)267lb # [ 0.005207] Zone ranges:268worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00269client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns270worker1 # [ 0.002923] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]271lb # [ 0.005208] DMA [mem 0x0000000000001000-0x0000000000ffffff]272client # [ 0.000005] tsc: Detected 2400.012 MHz processor273worker2 # [ 0.000001] kvm-clock: using sched offset of 498779487 cycles274worker1 # [ 0.002924] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]275client # [ 0.000819] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000276lb # [ 0.005209] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]277lb # [ 0.005210] Normal empty278worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns279lb # [ 0.005211] Device empty280worker1 # [ 0.002925] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]281client # [ 0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs282lb # [ 0.005212] Movable zone start for each node283worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor284worker1 # [ 0.002925] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]285lb # [ 0.005213] Early memory node ranges286worker2 # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000287client # [ 0.000850] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT288lb # [ 0.005213] node 0: [mem 0x0000000000001000-0x000000000009efff]289worker1 # [ 0.002926] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]290client # [ 0.002759] found SMP MP-table at [mem 0x000f5450-0x000f545f]291worker2 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs292client # [ 0.002771] Using GB pages for direct mapping293lb # [ 0.005214] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]294worker1 # [ 0.002926] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]295client # [ 0.002921] RAMDISK: [mem 0x5e366000-0x5ffcffff]296worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT297lb # [ 0.005215] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]298worker1 # [ 0.002927] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]299client # [ 0.002930] ACPI: Early table checksum verification disabled300worker2 # [ 0.002758] found SMP MP-table at [mem 0x000f5450-0x000f545f]301worker1 # [ 0.003154] No NUMA configuration found302lb # [ 0.005236] On node 0, zone DMA: 1 pages in unavailable ranges303worker2 # [ 0.002770] Using GB pages for direct mapping304client # [ 0.002933] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )305worker1 # [ 0.003155] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]306lb # [ 0.005483] On node 0, zone DMA: 97 pages in unavailable ranges307worker2 # [ 0.002915] RAMDISK: [mem 0x5e367000-0x5ffcffff]308worker1 # [ 0.003157] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]309worker2 # [ 0.002926] ACPI: Early table checksum verification disabled310client # [ 0.002937] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)311lb # [ 0.030596] On node 0, zone DMA32: 40 pages in unavailable ranges312worker1 # [ 0.005368] Zone ranges:313lb # [ 0.031056] ACPI: PM-Timer IO Port: 0x608314worker2 # [ 0.002929] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )315worker1 # [ 0.005369] DMA [mem 0x0000000000001000-0x0000000000ffffff]316client # [ 0.002942] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)317lb # [ 0.031067] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])318worker1 # [ 0.005371] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]319worker2 # [ 0.002934] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)320worker1 # [ 0.005372] Normal empty321client # [ 0.002949] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)322lb # [ 0.031094] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23323worker1 # [ 0.005373] Device empty324worker2 # [ 0.002940] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)325worker1 # [ 0.005373] Movable zone start for each node326lb # [ 0.031097] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)327worker1 # [ 0.005374] Early memory node ranges328client # [ 0.002951] ACPI: FACS 0x000000005FFE0000 000040329lb # [ 0.031099] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)330client # [ 0.002953] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)331worker2 # [ 0.002948] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)332worker1 # [ 0.005374] node 0: [mem 0x0000000000001000-0x000000000009efff]333lb # [ 0.031100] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)334worker2 # [ 0.002950] ACPI: FACS 0x000000005FFE0000 000040335client # [ 0.002954] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)336worker1 # [ 0.005375] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]337lb # [ 0.031101] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)338worker2 # [ 0.002952] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)339worker1 # [ 0.005377] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]340client # [ 0.002956] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)341lb # [ 0.031102] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)342worker1 # [ 0.005396] On node 0, zone DMA: 1 pages in unavailable ranges343worker2 # [ 0.002953] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)344lb # [ 0.031104] ACPI: Using ACPI (MADT) for SMP configuration information345client # [ 0.002957] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)346worker1 # [ 0.005651] On node 0, zone DMA: 97 pages in unavailable ranges347lb # [ 0.031105] ACPI: HPET id: 0x8086a201 base: 0xfed00000348worker2 # [ 0.002955] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)349client # [ 0.002959] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]350worker1 # [ 0.031578] On node 0, zone DMA32: 40 pages in unavailable ranges351lb # [ 0.031109] TSC deadline timer available352worker1 # [ 0.032034] ACPI: PM-Timer IO Port: 0x608353lb # [ 0.031113] CPU topo: Max. logical packages: 1354client # [ 0.002960] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]355worker2 # [ 0.002956] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)356lb # [ 0.031113] CPU topo: Max. logical dies: 1357worker1 # [ 0.032045] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])358client # [ 0.002960] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]359worker2 # [ 0.002957] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]360lb # [ 0.031114] CPU topo: Max. dies per package: 1361worker1 # [ 0.032070] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23362lb # [ 0.031117] CPU topo: Max. threads per core: 1363client # [ 0.002961] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]364worker2 # [ 0.002959] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]365worker1 # [ 0.032073] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)366lb # [ 0.031118] CPU topo: Num. cores per package: 1367client # [ 0.002961] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]368worker2 # [ 0.002959] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]369lb # [ 0.031118] CPU topo: Num. threads per package: 1370worker1 # [ 0.032075] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)371lb # [ 0.031118] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs372client # [ 0.002962] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]373worker1 # [ 0.032076] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)374worker2 # [ 0.002960] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]375worker2 # [ 0.002960] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]376client # [ 0.002962] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]377lb # [ 0.031136] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()378worker1 # [ 0.032077] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)379client # [ 0.003190] No NUMA configuration found380worker2 # [ 0.002961] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]381worker1 # [ 0.032078] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)382lb # [ 0.031165] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]383client # [ 0.003191] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]384worker1 # [ 0.032080] ACPI: Using ACPI (MADT) for SMP configuration information385worker2 # [ 0.002961] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]386lb # [ 0.031166] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]387client # [ 0.003193] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]388worker2 # [ 0.003187] No NUMA configuration found389worker1 # [ 0.032081] ACPI: HPET id: 0x8086a201 base: 0xfed00000390client # [ 0.005559] Zone ranges:391lb # [ 0.031168] [mem 0x60000000-0xafffffff] available for PCI devices392worker1 # [ 0.032084] TSC deadline timer available393worker2 # [ 0.003188] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]394client # [ 0.005560] DMA [mem 0x0000000000001000-0x0000000000ffffff]395lb # [ 0.031169] Booting paravirtualized kernel on KVM396worker1 # [ 0.032089] CPU topo: Max. logical packages: 1397worker2 # [ 0.003191] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]398client # [ 0.005562] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]399worker1 # [ 0.032089] CPU topo: Max. logical dies: 1400worker2 # [ 0.005371] Zone ranges:401client # [ 0.005563] Normal empty402lb # [ 0.031172] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns403client # [ 0.005564] Device empty404worker1 # [ 0.032090] CPU topo: Max. dies per package: 1405worker2 # [ 0.005372] DMA [mem 0x0000000000001000-0x0000000000ffffff]406worker1 # [ 0.032094] CPU topo: Max. threads per core: 1407client # [ 0.005564] Movable zone start for each node408lb # [ 0.035611] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1409worker2 # [ 0.005373] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]410client # [ 0.005565] Early memory node ranges411worker1 # [ 0.032094] CPU topo: Num. cores per package: 1412worker2 # [ 0.005374] Normal empty413worker2 # [ 0.005375] Device empty414lb # [ 0.037645] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152415client # [ 0.005566] node 0: [mem 0x0000000000001000-0x000000000009efff]416worker1 # [ 0.032094] CPU topo: Num. threads per package: 1417lb # [ 0.037686] kvm-guest: PV spinlocks disabled, single CPU418worker2 # [ 0.005376] Movable zone start for each node419worker1 # [ 0.032095] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs420client # [ 0.005567] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]421worker2 # [ 0.005376] Early memory node ranges422worker1 # [ 0.032112] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()423worker2 # [ 0.005377] node 0: [mem 0x0000000000001000-0x000000000009efff]424client # [ 0.005568] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]425worker1 # [ 0.032142] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]426client # [ 0.005588] On node 0, zone DMA: 1 pages in unavailable ranges427worker2 # [ 0.005378] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]428client # [ 0.005864] On node 0, zone DMA: 97 pages in unavailable ranges429worker1 # [ 0.032144] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]430worker2 # [ 0.005379] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]431client # [ 0.034099] On node 0, zone DMA32: 40 pages in unavailable ranges432worker1 # [ 0.032145] [mem 0x60000000-0xafffffff] available for PCI devices433worker2 # [ 0.005398] On node 0, zone DMA: 1 pages in unavailable ranges434lb # [ 0.037688] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0435client # [ 0.034572] ACPI: PM-Timer IO Port: 0x608436worker1 # [ 0.032147] Booting paravirtualized kernel on KVM437worker2 # [ 0.005649] On node 0, zone DMA: 97 pages in unavailable ranges438client # [ 0.034586] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])439worker2 # [ 0.030938] On node 0, zone DMA32: 40 pages in unavailable ranges440worker1 # [ 0.032149] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns441client # [ 0.034613] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23442lb # [ 0.037786] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.443worker2 # [ 0.031405] ACPI: PM-Timer IO Port: 0x608444lb # [ 0.037799] random: crng init done445client # [ 0.034616] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)446worker1 # [ 0.036624] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1447worker2 # [ 0.031416] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])448lb # [ 0.037799] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes449client # [ 0.034618] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)450worker1 # [ 0.038708] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152451worker2 # [ 0.031440] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23452lb # [ 0.039943] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)453client # [ 0.034619] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)454worker1 # [ 0.038748] kvm-guest: PV spinlocks disabled, single CPU455worker2 # [ 0.031443] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)456client # [ 0.034620] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)457lb # [ 0.040950] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)458worker2 # [ 0.031444] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)459lb # [ 0.040980] Fallback order for Node 0: 0460client # [ 0.034621] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)461worker2 # [ 0.031446] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)462lb # [ 0.040983] Built 1 zonelists, mobility grouping on. Total pages: 393078463client # [ 0.034624] ACPI: Using ACPI (MADT) for SMP configuration information464lb # [ 0.040984] Policy zone: DMA32465worker2 # [ 0.031446] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)466client # [ 0.034625] ACPI: HPET id: 0x8086a201 base: 0xfed00000467lb # [ 0.043342] mem auto-init: stack:all(zero), heap alloc:on, heap free:off468client # [ 0.034629] TSC deadline timer available469worker2 # [ 0.031447] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)470worker1 # [ 0.038750] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vp7y4ay4sa33a6v1s4gpmx09kwbsi0c3-nixos-system-worker1-test/init regInfo=/nix/store/sy8zjgmidl0x90xc5f3sn0iw1nnxll56-closure-info/registration console=ttyS0,115200n8 console=tty0471client # [ 0.034634] CPU topo: Max. logical packages: 1472lb # [ 0.046284] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1473worker2 # [ 0.031450] ACPI: Using ACPI (MADT) for SMP configuration information474client # [ 0.034634] CPU topo: Max. logical dies: 1475lb # [ 0.049405] allocated 3145728 bytes of page_ext476worker2 # [ 0.031450] ACPI: HPET id: 0x8086a201 base: 0xfed00000477client # [ 0.034635] CPU topo: Max. dies per package: 1478lb # [ 0.059144] ftrace: allocating 48731 entries in 192 pages479worker2 # [ 0.031454] TSC deadline timer available480worker1 # [ 0.038842] Unknown kernel command line parameters "regInfo=/nix/store/sy8zjgmidl0x90xc5f3sn0iw1nnxll56-closure-info/registration", will be passed to user space.481client # [ 0.034640] CPU topo: Max. threads per core: 1482worker1 # [ 0.038855] random: crng init done483lb # [ 0.059146] ftrace: allocated 192 pages with 2 groups484worker2 # [ 0.031459] CPU topo: Max. logical packages: 1485client # [ 0.034641] CPU topo: Num. cores per package: 1486lb # [ 0.059938] Dynamic Preempt: lazy487worker2 # [ 0.031459] CPU topo: Max. logical dies: 1488worker1 # [ 0.038856] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes489client # [ 0.034641] CPU topo: Num. threads per package: 1490lb # [ 0.060090] rcu: Preemptible hierarchical RCU implementation.491worker2 # [ 0.031460] CPU topo: Max. dies per package: 1492client # [ 0.034642] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs493lb # [ 0.060091] rcu: RCU event tracing is enabled.494worker2 # [ 0.031463] CPU topo: Max. threads per core: 1495worker1 # [ 0.040899] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)496worker2 # [ 0.031463] CPU topo: Num. cores per package: 1497lb # [ 0.060091] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.498client # [ 0.034666] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()499worker1 # [ 0.041932] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)500worker2 # [ 0.031464] CPU topo: Num. threads per package: 1501lb # [ 0.060093] Trampoline variant of Tasks RCU enabled.502worker1 # [ 0.041964] Fallback order for Node 0: 0503client # [ 0.034702] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]504lb # [ 0.060093] Rude variant of Tasks RCU enabled.505worker2 # [ 0.031464] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs506worker1 # [ 0.041966] Built 1 zonelists, mobility grouping on. Total pages: 393078507lb # [ 0.060093] Tracing variant of Tasks RCU enabled.508client # [ 0.034704] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]509worker1 # [ 0.041968] Policy zone: DMA32510worker2 # [ 0.031482] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()511client # [ 0.034705] [mem 0x60000000-0xafffffff] available for PCI devices512lb # [ 0.060094] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.513worker1 # [ 0.044511] mem auto-init: stack:all(zero), heap alloc:on, heap free:off514worker2 # [ 0.031517] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]515client # [ 0.034707] Booting paravirtualized kernel on KVM516worker1 # [ 0.047514] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1517lb # [ 0.060095] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1518worker2 # [ 0.031518] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]519worker1 # [ 0.050636] allocated 3145728 bytes of page_ext520client # [ 0.034711] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns521lb # [ 0.060110] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.522worker2 # [ 0.031520] [mem 0x60000000-0xafffffff] available for PCI devices523worker1 # [ 0.060275] ftrace: allocating 48731 entries in 192 pages524worker1 # [ 0.060276] ftrace: allocated 192 pages with 2 groups525worker2 # [ 0.031521] Booting paravirtualized kernel on KVM526client # [ 0.039206] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1527lb # [ 0.060111] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.528worker1 # [ 0.061106] Dynamic Preempt: lazy529client # [ 0.041506] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152530worker1 # [ 0.061239] rcu: Preemptible hierarchical RCU implementation.531worker2 # [ 0.031524] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns532client # [ 0.041559] kvm-guest: PV spinlocks disabled, single CPU533lb # [ 0.060112] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.534worker1 # [ 0.061239] rcu: RCU event tracing is enabled.535worker2 # [ 0.036003] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1536lb # [ 0.064402] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16537worker1 # [ 0.061240] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.538worker2 # [ 0.038059] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152539lb # [ 0.064664] rcu: srcu_init: Setting srcu_struct sizes based on contention.540worker1 # [ 0.061241] Trampoline variant of Tasks RCU enabled.541worker1 # [ 0.061242] Rude variant of Tasks RCU enabled.542worker2 # [ 0.038099] kvm-guest: PV spinlocks disabled, single CPU543lb # [ 0.064670] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns544worker1 # [ 0.061242] Tracing variant of Tasks RCU enabled.545worker1 # [ 0.061243] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.546client # [ 0.041560] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test/init regInfo=/nix/store/v3nhx5y8n442sy6f0rpqs0hcz2kqcw2i-closure-info/registration console=ttyS0,115200n8 console=tty0547lb # [ 0.064780] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)548lb # [ 0.068317] Console: colour VGA+ 80x25549worker1 # [ 0.061243] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1550lb # [ 0.068320] printk: legacy console [tty0] enabled551worker1 # [ 0.061300] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.552client # [ 0.041662] Unknown kernel command line parameters "regInfo=/nix/store/v3nhx5y8n442sy6f0rpqs0hcz2kqcw2i-closure-info/registration", will be passed to user space.553lb # [ 0.097824] printk: legacy console [ttyS0] enabled554worker2 # [ 0.038101] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/29wvwacdyvpg20jr5pggcm533l539zs3-nixos-system-worker2-test/init regInfo=/nix/store/fp5i8d25csfaa7415waaqnnmaih5p7nv-closure-info/registration console=ttyS0,115200n8 console=tty0555client # [ 0.041675] random: crng init done556lb # [ 0.193251] ACPI: Core revision 20250807557worker1 # [ 0.061302] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.558client # [ 0.041676] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes559worker1 # [ 0.061303] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.560client # [ 0.043921] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)561worker2 # [ 0.038190] Unknown kernel command line parameters "regInfo=/nix/store/fp5i8d25csfaa7415waaqnnmaih5p7nv-closure-info/registration", will be passed to user space.562lb # [ 0.194101] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns563worker2 # [ 0.038203] random: crng init done564worker1 # [ 0.065634] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16565client # [ 0.045043] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)566lb # [ 0.195637] APIC: Switch to symmetric I/O mode setup567worker2 # [ 0.038204] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes568client # [ 0.045077] Fallback order for Node 0: 0569worker1 # [ 0.065916] rcu: srcu_init: Setting srcu_struct sizes based on contention.570lb # [ 0.196560] x2apic enabled571client # [ 0.045080] Built 1 zonelists, mobility grouping on. Total pages: 393078572worker2 # [ 0.040242] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)573worker1 # [ 0.065922] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns574client # [ 0.045082] Policy zone: DMA32575lb # [ 0.197293] APIC: Switched APIC routing to: physical x2apic576worker2 # [ 0.041383] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)577client # [ 0.048019] mem auto-init: stack:all(zero), heap alloc:on, heap free:off578worker2 # [ 0.041413] Fallback order for Node 0: 0579worker1 # [ 0.066025] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)580client # [ 0.051577] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1581worker1 # [ 0.069549] Console: colour VGA+ 80x25582worker2 # [ 0.041416] Built 1 zonelists, mobility grouping on. Total pages: 393078583client # [ 0.055093] allocated 3145728 bytes of page_ext584worker1 # [ 0.069552] printk: legacy console [tty0] enabled585lb # [ 0.199065] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1586worker2 # [ 0.041417] Policy zone: DMA32587client # [ 0.065158] ftrace: allocating 48731 entries in 192 pages588worker1 # [ 0.099274] printk: legacy console [ttyS0] enabled589worker2 # [ 0.043798] mem auto-init: stack:all(zero), heap alloc:on, heap free:off590client # [ 0.065160] ftrace: allocated 192 pages with 2 groups591worker1 # [ 0.195033] ACPI: Core revision 20250807592client # [ 0.066090] Dynamic Preempt: lazy593lb # [ 0.200031] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns594worker2 # [ 0.046799] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1595client # [ 0.066254] rcu: Preemptible hierarchical RCU implementation.596worker2 # [ 0.049978] allocated 3145728 bytes of page_ext597client # [ 0.066255] rcu: RCU event tracing is enabled.598worker1 # [ 0.195881] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns599worker2 # [ 0.059631] ftrace: allocating 48731 entries in 192 pages600lb # [ 0.201610] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)601worker2 # [ 0.059633] ftrace: allocated 192 pages with 2 groups602client # [ 0.066255] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.603worker1 # [ 0.197361] APIC: Switch to symmetric I/O mode setup604worker2 # [ 0.060458] Dynamic Preempt: lazy605client # [ 0.066257] Trampoline variant of Tasks RCU enabled.606lb # [ 0.203693] x86/cpu: User Mode Instruction Prevention (UMIP) activated607worker1 # [ 0.198282] x2apic enabled608worker2 # [ 0.060637] rcu: Preemptible hierarchical RCU implementation.609client # [ 0.066258] Rude variant of Tasks RCU enabled.610worker2 # [ 0.060638] rcu: RCU event tracing is enabled.611client # [ 0.066258] Tracing variant of Tasks RCU enabled.612lb # [ 0.204757] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127613worker1 # [ 0.198999] APIC: Switched APIC routing to: physical x2apic614worker2 # [ 0.060639] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.615client # [ 0.066259] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.616lb # [ 0.205608] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0617worker2 # [ 0.060640] Trampoline variant of Tasks RCU enabled.618client # [ 0.066259] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1619worker2 # [ 0.060640] Rude variant of Tasks RCU enabled.620worker1 # [ 0.200762] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1621worker2 # [ 0.060641] Tracing variant of Tasks RCU enabled.622client # [ 0.066276] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.623lb # [ 0.206611] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto624worker2 # [ 0.060641] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.625worker1 # [ 0.201702] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns626client # [ 0.066278] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.627lb # [ 0.207608] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl628worker2 # [ 0.060642] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1629client # [ 0.066279] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.630lb # [ 0.208608] Transient Scheduler Attacks: Vulnerable: No microcode631worker1 # [ 0.203272] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)632worker2 # [ 0.060659] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.633client # [ 0.070736] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16634lb # [ 0.209608] Spectre V2 : Mitigation: Enhanced / Automatic IBRS635worker1 # [ 0.205355] x86/cpu: User Mode Instruction Prevention (UMIP) activated636worker2 # [ 0.060660] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.637client # [ 0.071025] rcu: srcu_init: Setting srcu_struct sizes based on contention.638lb # [ 0.210607] Speculative Return Stack Overflow: Mitigation: Safe RET639worker1 # [ 0.206516] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127640worker2 # [ 0.060661] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.641client # [ 0.071033] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns642worker2 # [ 0.065193] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16643worker1 # [ 0.207270] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0644client # [ 0.071148] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)645worker2 # [ 0.065485] rcu: srcu_init: Setting srcu_struct sizes based on contention.646client # [ 0.074740] Console: colour VGA+ 80x25647client # [ 0.074744] printk: legacy console [tty0] enabled648worker1 # [ 0.208273] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto649worker2 # [ 0.065490] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns650client # [ 0.104188] printk: legacy console [ttyS0] enabled651lb # [ 0.211607] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization652client # [ 0.200017] ACPI: Core revision 20250807653worker2 # [ 0.065593] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)654worker1 # [ 0.209270] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl655lb # [ 0.213615] Spectre V2 : Enabling IBPB for BPF656worker2 # [ 0.069154] Console: colour VGA+ 80x25657worker2 # [ 0.069157] printk: legacy console [tty0] enabled658worker1 # [ 0.210269] Transient Scheduler Attacks: Vulnerable: No microcode659client # [ 0.200914] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns660worker2 # [ 0.099053] printk: legacy console [ttyS0] enabled661lb # [ 0.214313] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier662worker1 # [ 0.211269] Spectre V2 : Mitigation: Enhanced / Automatic IBRS663worker2 # [ 0.195341] ACPI: Core revision 20250807664client # [ 0.202538] APIC: Switch to symmetric I/O mode setup665lb # [ 0.215608] active return thunk: srso_alias_return_thunk666worker1 # [ 0.212270] Speculative Return Stack Overflow: Mitigation: Safe RET667client # [ 0.203530] x2apic enabled668lb # [ 0.216620] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'669worker2 # [ 0.196254] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns670client # [ 0.204263] APIC: Switched APIC routing to: physical x2apic671lb # [ 0.217608] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'672worker2 # [ 0.197860] APIC: Switch to symmetric I/O mode setup673worker2 # [ 0.198851] x2apic enabled674lb # [ 0.218607] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'675client # [ 0.206119] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1676lb # [ 0.219608] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'677worker1 # [ 0.213269] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization678worker2 # [ 0.199621] APIC: Switched APIC routing to: physical x2apic679worker1 # [ 0.215277] Spectre V2 : Enabling IBPB for BPF680lb # [ 0.220608] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'681client # [ 0.207115] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns682worker2 # [ 0.201414] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1683lb # [ 0.221607] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'684worker1 # [ 0.215981] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier685client # [ 0.208795] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)686worker1 # [ 0.217270] active return thunk: srso_alias_return_thunk687lb # [ 0.222607] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'688worker2 # [ 0.202377] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns689client # [ 0.209892] x86/cpu: User Mode Instruction Prevention (UMIP) activated690lb # [ 0.223608] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256691worker1 # [ 0.218102] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'692client # [ 0.211715] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127693worker2 # [ 0.204003] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)694lb # [ 0.224607] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64695worker1 # [ 0.219269] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'696client # [ 0.212460] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0697worker2 # [ 0.205087] x86/cpu: User Mode Instruction Prevention (UMIP) activated698lb # [ 0.225608] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512699worker1 # [ 0.220269] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'700lb # [ 0.226608] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024701worker2 # [ 0.206124] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127702worker1 # [ 0.221269] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'703client # [ 0.213521] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto704lb # [ 0.227607] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8705worker1 # [ 0.222259] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'706worker2 # [ 0.207001] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0707client # [ 0.214792] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl708worker1 # [ 0.223269] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'709lb # [ 0.228607] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.710client # [ 0.215793] Transient Scheduler Attacks: Vulnerable: No microcode711worker2 # [ 0.208003] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto712worker1 # [ 0.224269] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'713client # [ 0.217515] Spectre V2 : Mitigation: Enhanced / Automatic IBRS714worker2 # [ 0.210000] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl715worker1 # [ 0.225270] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256716client # [ 0.218495] Speculative Return Stack Overflow: Mitigation: Safe RET717worker2 # [ 0.211000] Transient Scheduler Attacks: Vulnerable: No microcode718worker1 # [ 0.226269] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64719worker1 # [ 0.227269] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512720worker2 # [ 0.212000] Spectre V2 : Mitigation: Enhanced / Automatic IBRS721worker1 # [ 0.228269] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024722worker2 # [ 0.213000] Speculative Return Stack Overflow: Mitigation: Safe RET723worker1 # [ 0.229269] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8724client # [ 0.219517] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization725worker1 # [ 0.230269] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.726client # [ 0.220804] Spectre V2 : Enabling IBPB for BPF727client # [ 0.222353] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier728worker2 # [ 0.214000] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization729client # [ 0.223793] active return thunk: srso_alias_return_thunk730worker2 # [ 0.216007] Spectre V2 : Enabling IBPB for BPF731client # [ 0.224654] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'732worker2 # [ 0.217001] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier733client # [ 0.225792] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'734worker2 # [ 0.218001] active return thunk: srso_alias_return_thunk735client # [ 0.226792] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'736worker2 # [ 0.219683] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'737client # [ 0.227792] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'738worker2 # [ 0.221000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'739client # [ 0.228792] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'740worker2 # [ 0.222000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'741client # [ 0.229793] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'742worker2 # [ 0.223000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'743client # [ 0.230793] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'744worker2 # [ 0.224000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'745client # [ 0.231793] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256746worker2 # [ 0.224999] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'747client # [ 0.232792] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64748worker2 # [ 0.226000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'749client # [ 0.233792] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512750worker2 # [ 0.227000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256751client # [ 0.234792] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024752worker2 # [ 0.228000] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64753client # [ 0.235793] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8754worker2 # [ 0.229000] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512755client # [ 0.236793] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.756worker2 # [ 0.230000] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757worker2 # [ 0.231000] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758worker2 # [ 0.232000] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759lb # [ 0.262182] Freeing SMP alternatives memory: 44K760lb # [ 0.262610] pid_max: default: 32768 minimum: 301761lb # [ 0.263693] LSM: initializing lsm=capability,landlock,yama,bpf,ima762lb # [ 0.264716] landlock: Up and running.763lb # [ 0.265349] Yama: becoming mindful.764lb # [ 0.266279] LSM support for eBPF active765lb # [ 0.267226] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766lb # [ 0.267642] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker1 # [ 0.264623] Freeing SMP alternatives memory: 44K768worker1 # [ 0.265272] pid_max: default: 32768 minimum: 301769lb # [ 0.270828] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)770worker1 # [ 0.266298] LSM: initializing lsm=capability,landlock,yama,bpf,ima771worker1 # [ 0.267371] landlock: Up and running.772lb # [ 0.272187] Performance Events: Fam17h+ core perfctr, AMD PMU driver.773worker1 # [ 0.268003] Yama: becoming mindful.774lb # [ 0.272618] ... version: 2775worker1 # [ 0.268915] LSM support for eBPF active776lb # [ 0.273363] ... bit width: 48777lb # [ 0.273610] ... generic counters: 6778worker1 # [ 0.269392] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)779lb # [ 0.274352] ... generic bitmap: 000000000000003f780lb # [ 0.274610] ... fixed-purpose counters: 0781worker1 # [ 0.270305] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)782lb # [ 0.275328] ... fixed-purpose bitmap: 0000000000000000783lb # [ 0.275610] ... value mask: 0000ffffffffffff784worker1 # [ 0.273181] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)785lb # [ 0.276550] ... max period: 00007fffffffffff786lb # [ 0.277336] ... global_ctrl mask: 000000000000003f787worker1 # [ 0.273838] Performance Events: Fam17h+ core perfctr, AMD PMU driver.788lb # [ 0.277725] signal: max sigframe size: 3376789worker1 # [ 0.274274] ... version: 2790worker1 # [ 0.274964] ... bit width: 48791lb # [ 0.278495] rcu: Hierarchical SRCU implementation.792worker1 # [ 0.275272] ... generic counters: 6793lb # [ 0.279202] rcu: Max phase no-delay instances is 400.794worker1 # [ 0.275975] ... generic bitmap: 000000000000003f795worker1 # [ 0.276281] ... fixed-purpose counters: 0796worker1 # [ 0.277005] ... fixed-purpose bitmap: 0000000000000000797worker1 # [ 0.277271] ... value mask: 0000ffffffffffff798worker1 # [ 0.278203] ... max period: 00007fffffffffff799client # [ 0.273454] Freeing SMP alternatives memory: 44K800worker1 # [ 0.278982] ... global_ctrl mask: 000000000000003f801lb # [ 0.284081] smp: Bringing up secondary CPUs ...802worker2 # [ 0.266816] Freeing SMP alternatives memory: 44K803client # [ 0.273796] pid_max: default: 32768 minimum: 301804lb # [ 0.284624] smp: Brought up 1 node, 1 CPU805worker1 # [ 0.279381] signal: max sigframe size: 3376806worker2 # [ 0.267540] pid_max: default: 32768 minimum: 301807worker1 # [ 0.280123] rcu: Hierarchical SRCU implementation.808client # [ 0.274886] LSM: initializing lsm=capability,landlock,yama,bpf,ima809lb # [ 0.285291] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)810client # [ 0.275901] landlock: Up and running.811worker2 # [ 0.268097] LSM: initializing lsm=capability,landlock,yama,bpf,ima812worker1 # [ 0.280817] rcu: Max phase no-delay instances is 400.813client # [ 0.276505] Yama: becoming mindful.814worker2 # [ 0.269098] landlock: Up and running.815worker2 # [ 0.270001] Yama: becoming mindful.816client # [ 0.277412] LSM support for eBPF active817lb # [ 0.285737] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)818worker2 # [ 0.270785] LSM support for eBPF active819lb # [ 0.286830] devtmpfs: initialized820client # [ 0.278389] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)821lb # [ 0.287603] x86/mm: Memory block size: 128MB822worker2 # [ 0.271582] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)823client # [ 0.278837] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)824worker2 # [ 0.273010] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)825worker1 # [ 0.285848] smp: Bringing up secondary CPUs ...826lb # [ 0.289209] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)827worker1 # [ 0.286286] smp: Brought up 1 node, 1 CPU828client # [ 0.281974] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)829lb # [ 0.289635] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).830worker1 # [ 0.286972] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)831worker2 # [ 0.275326] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)832lb # [ 0.290690] pinctrl core: initialized pinctrl subsystem833client # [ 0.283413] Performance Events: Fam17h+ core perfctr, AMD PMU driver.834client # [ 0.283801] ... version: 2835lb # [ 0.291808] PM: RTC time: 08:07:23, date: 2026-09-20836worker2 # [ 0.276635] Performance Events: Fam17h+ core perfctr, AMD PMU driver.837worker1 # [ 0.287449] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)838client # [ 0.284460] ... bit width: 48839worker2 # [ 0.277010] ... version: 2840worker1 # [ 0.288501] devtmpfs: initialized841client # [ 0.284794] ... generic counters: 6842worker2 # [ 0.277748] ... bit width: 48843worker1 # [ 0.289296] x86/mm: Memory block size: 128MB844client # [ 0.285515] ... generic bitmap: 000000000000003f845worker2 # [ 0.278002] ... generic counters: 6846client # [ 0.285794] ... fixed-purpose counters: 0847worker2 # [ 0.278732] ... generic bitmap: 000000000000003f848lb # [ 0.295201] NET: Registered PF_NETLINK/PF_ROUTE protocol family849client # [ 0.286498] ... fixed-purpose bitmap: 0000000000000000850worker2 # [ 0.279002] ... fixed-purpose counters: 0851worker1 # [ 0.291058] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)852client # [ 0.286794] ... value mask: 0000ffffffffffff853worker2 # [ 0.279695] ... fixed-purpose bitmap: 0000000000000000854lb # [ 0.296095] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations855client # [ 0.287656] ... max period: 00007fffffffffff856worker1 # [ 0.292143] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).857worker2 # [ 0.280002] ... value mask: 0000ffffffffffff858lb # [ 0.296629] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations859client # [ 0.288450] ... global_ctrl mask: 000000000000003f860worker2 # [ 0.280884] ... max period: 00007fffffffffff861worker1 # [ 0.293342] pinctrl core: initialized pinctrl subsystem862worker2 # [ 0.281634] ... global_ctrl mask: 000000000000003f863client # [ 0.288906] signal: max sigframe size: 3376864worker1 # [ 0.294435] PM: RTC time: 08:07:23, date: 2026-09-20865lb # [ 0.297867] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations866client # [ 0.289685] rcu: Hierarchical SRCU implementation.867worker2 # [ 0.282109] signal: max sigframe size: 3376868lb # [ 0.298619] audit: initializing netlink subsys (disabled)869client # [ 0.290363] rcu: Max phase no-delay instances is 400.870worker2 # [ 0.282878] rcu: Hierarchical SRCU implementation.871worker2 # [ 0.283633] rcu: Max phase no-delay instances is 400.872lb # [ 0.299716] thermal_sys: Registered thermal governor 'fair_share'873lb # [ 0.299718] thermal_sys: Registered thermal governor 'bang_bang'874worker1 # [ 0.297778] NET: Registered PF_NETLINK/PF_ROUTE protocol family875lb # [ 0.300611] thermal_sys: Registered thermal governor 'step_wise'876worker1 # [ 0.298734] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations877lb # [ 0.301612] audit: type=2000 audit(1789891644.432:1): state=initialized audit_enabled=0 res=1878worker1 # [ 0.299289] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations879client # [ 0.295435] smp: Bringing up secondary CPUs ...880lb # [ 0.303614] thermal_sys: Registered thermal governor 'user_space'881client # [ 0.295809] smp: Brought up 1 node, 1 CPU882worker2 # [ 0.288450] smp: Bringing up secondary CPUs ...883worker1 # [ 0.300536] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations884lb # [ 0.303615] thermal_sys: Registered thermal governor 'power_allocator'885worker2 # [ 0.289016] smp: Brought up 1 node, 1 CPU886client # [ 0.296460] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)887lb # [ 0.304631] cpuidle: using governor menu888worker1 # [ 0.301281] audit: initializing netlink subsys (disabled)889worker2 # [ 0.289683] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)890worker1 # [ 0.302346] thermal_sys: Registered thermal governor 'fair_share'891lb # [ 0.306821] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5892worker1 # [ 0.302348] thermal_sys: Registered thermal governor 'bang_bang'893client # [ 0.297013] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)894client # [ 0.298055] devtmpfs: initialized895worker2 # [ 0.290205] Memory: 1454536K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)896worker1 # [ 0.303272] thermal_sys: Registered thermal governor 'step_wise'897lb # [ 0.307855] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]898worker2 # [ 0.291231] devtmpfs: initialized899client # [ 0.298816] x86/mm: Memory block size: 128MB900worker1 # [ 0.304176] thermal_sys: Registered thermal governor 'user_space'901lb # [ 0.308613] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry902worker2 # [ 0.291996] x86/mm: Memory block size: 128MB903lb # [ 0.309622] PCI: Using configuration type 1 for base access904worker1 # [ 0.304965] audit: type=2000 audit(1789891644.440:1): state=initialized audit_enabled=0 res=1905client # [ 0.300609] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)906worker1 # [ 0.306274] thermal_sys: Registered thermal governor 'power_allocator'907lb # [ 0.310697] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.908worker1 # [ 0.306294] cpuidle: using governor menu909worker2 # [ 0.293559] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)910client # [ 0.301709] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).911worker2 # [ 0.294029] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).912worker1 # [ 0.308431] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5913client # [ 0.302887] pinctrl core: initialized pinctrl subsystem914worker2 # [ 0.295093] pinctrl core: initialized pinctrl subsystem915client # [ 0.304116] PM: RTC time: 08:07:23, date: 2026-09-20916worker1 # [ 0.309473] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]917worker2 # [ 0.296204] PM: RTC time: 08:07:23, date: 2026-09-20918worker1 # [ 0.310274] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry919lb # [ 0.315849] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages920worker1 # [ 0.311285] PCI: Using configuration type 1 for base access921lb # [ 0.316611] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page922worker1 # [ 0.312400] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.923client # [ 0.307854] NET: Registered PF_NETLINK/PF_ROUTE protocol family924worker2 # [ 0.299646] NET: Registered PF_NETLINK/PF_ROUTE protocol family925client # [ 0.309327] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations926worker2 # [ 0.300464] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations927client # [ 0.309826] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations928worker2 # [ 0.301021] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations929lb # [ 0.321611] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages930client # [ 0.311091] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations931worker2 # [ 0.302258] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations932lb # [ 0.322610] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page933client # [ 0.311804] audit: initializing netlink subsys (disabled)934worker2 # [ 0.303011] audit: initializing netlink subsys (disabled)935client # [ 0.312975] thermal_sys: Registered thermal governor 'fair_share'936worker2 # [ 0.304185] thermal_sys: Registered thermal governor 'fair_share'937worker1 # [ 0.319544] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages938client # [ 0.312977] thermal_sys: Registered thermal governor 'bang_bang'939worker2 # [ 0.304188] thermal_sys: Registered thermal governor 'bang_bang'940worker1 # [ 0.320273] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page941client # [ 0.313796] thermal_sys: Registered thermal governor 'step_wise'942worker2 # [ 0.305004] thermal_sys: Registered thermal governor 'step_wise'943client # [ 0.314739] thermal_sys: Registered thermal governor 'user_space'944worker2 # [ 0.305990] thermal_sys: Registered thermal governor 'user_space'945client # [ 0.315537] audit: type=2000 audit(1789891644.462:1): state=initialized audit_enabled=0 res=1946worker2 # [ 0.306764] audit: type=2000 audit(1789891644.457:1): state=initialized audit_enabled=0 res=1947client # [ 0.316797] thermal_sys: Registered thermal governor 'power_allocator'948worker2 # [ 0.308005] thermal_sys: Registered thermal governor 'power_allocator'949client # [ 0.316813] cpuidle: using governor menu950worker2 # [ 0.308019] cpuidle: using governor menu951worker1 # [ 0.325273] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages952client # [ 0.319025] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5953worker1 # [ 0.326272] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page954worker2 # [ 0.310236] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5955lb # [ 0.332977] ACPI: Added _OSI(Module Device)956client # [ 0.320021] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]957lb # [ 0.333612] ACPI: Added _OSI(Processor Device)958worker2 # [ 0.311239] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]959client # [ 0.320798] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry960lb # [ 0.334357] ACPI: Added _OSI(Processor Aggregator Device)961worker2 # [ 0.312005] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry962client # [ 0.321807] PCI: Using configuration type 1 for base access963worker2 # [ 0.313014] PCI: Using configuration type 1 for base access964client # [ 0.322923] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.965worker2 # [ 0.314111] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.966worker1 # [ 0.334870] ACPI: Added _OSI(Module Device)967worker1 # [ 0.335273] ACPI: Added _OSI(Processor Device)968worker1 # [ 0.336026] ACPI: Added _OSI(Processor Aggregator Device)969client # [ 0.328040] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages970worker2 # [ 0.319262] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages971client # [ 0.328796] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page972worker2 # [ 0.320004] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page973lb # [ 0.343173] ACPI: 1 ACPI AML tables successfully acquired and loaded974lb # [ 0.347033] ACPI: Interpreter enabled975client # [ 0.333795] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages976lb # [ 0.347625] ACPI: PM: (supports S0 S3 S4 S5)977worker2 # [ 0.325004] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages978worker1 # [ 0.342848] ACPI: 1 ACPI AML tables successfully acquired and loaded979client # [ 0.334794] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page980lb # [ 0.348304] ACPI: Using IOAPIC for interrupt routing981worker2 # [ 0.326002] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page982lb # [ 0.348646] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug983lb # [ 0.349611] PCI: Using E820 reservations for host bridge windows984worker1 # [ 0.346169] ACPI: Interpreter enabled985worker1 # [ 0.346746] ACPI: PM: (supports S0 S3 S4 S5)986worker1 # [ 0.347272] ACPI: Using IOAPIC for interrupt routing987lb # [ 0.352756] ACPI: Enabled 2 GPEs in block 00 to 3F988worker1 # [ 0.348152] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug989client # [ 0.345148] ACPI: Added _OSI(Module Device)990worker2 # [ 0.336426] ACPI: Added _OSI(Module Device)991client # [ 0.345796] ACPI: Added _OSI(Processor Device)992worker1 # [ 0.353272] PCI: Using E820 reservations for host bridge windows993worker2 # [ 0.337004] ACPI: Added _OSI(Processor Device)994client # [ 0.346530] ACPI: Added _OSI(Processor Aggregator Device)995worker1 # [ 0.354323] ACPI: Enabled 2 GPEs in block 00 to 3F996worker2 # [ 0.337714] ACPI: Added _OSI(Processor Aggregator Device)997lb # [ 0.361405] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])998lb # [ 0.362419] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]999lb # [ 0.364105] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1000lb # [ 0.364734] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1001lb # [ 0.365945] PCI host bridge to bus 0000:001002worker1 # [ 0.362917] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1003client # [ 0.355358] ACPI: 1 ACPI AML tables successfully acquired and loaded1004lb # [ 0.366614] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1005worker2 # [ 0.346537] ACPI: 1 ACPI AML tables successfully acquired and loaded1006lb # [ 0.367610] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1007worker1 # [ 0.363757] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1008lb # [ 0.368611] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1009worker1 # [ 0.364374] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1010lb # [ 0.369611] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1011client # [ 0.359245] ACPI: Interpreter enabled1012worker1 # [ 0.365406] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1013worker2 # [ 0.350265] ACPI: Interpreter enabled1014client # [ 0.359811] ACPI: PM: (supports S0 S3 S4 S5)1015lb # [ 0.370610] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1016worker2 # [ 0.350928] ACPI: PM: (supports S0 S3 S4 S5)1017worker1 # [ 0.366632] PCI host bridge to bus 0000:001018client # [ 0.360516] ACPI: Using IOAPIC for interrupt routing1019worker2 # [ 0.351489] ACPI: Using IOAPIC for interrupt routing1020worker1 # [ 0.367277] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1021lb # [ 0.371611] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1022client # [ 0.360843] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1023worker1 # [ 0.368271] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1024lb # [ 0.372611] pci_bus 0000:00: root bus resource [bus 00-ff]1025worker2 # [ 0.352074] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1026client # [ 0.361795] PCI: Using E820 reservations for host bridge windows1027worker1 # [ 0.369265] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1028worker2 # [ 0.353003] PCI: Using E820 reservations for host bridge windows1029lb # [ 0.373568] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1030worker1 # [ 0.370272] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1031lb # [ 0.375082] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1032client # [ 0.364853] ACPI: Enabled 2 GPEs in block 00 to 3F1033worker1 # [ 0.371271] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1034worker2 # [ 0.356096] ACPI: Enabled 2 GPEs in block 00 to 3F1035worker1 # [ 0.372272] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1036worker1 # [ 0.373272] pci_bus 0000:00: root bus resource [bus 00-ff]1037worker1 # [ 0.374290] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1038worker1 # [ 0.375716] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1039lb # [ 0.377625] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1040lb # [ 0.378622] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1041lb # [ 0.379615] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1042client # [ 0.373483] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1043worker2 # [ 0.364688] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1044lb # [ 0.380826] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1045client # [ 0.373802] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1046worker2 # [ 0.365009] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1047client # [ 0.375428] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1048worker2 # [ 0.366367] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1049lb # [ 0.382335] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1050worker1 # [ 0.378294] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1051client # [ 0.375921] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1052worker1 # [ 0.379284] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1053worker2 # [ 0.367125] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1054client # [ 0.377145] PCI host bridge to bus 0000:001055worker1 # [ 0.380213] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1056worker2 # [ 0.368342] PCI host bridge to bus 0000:001057client # [ 0.377799] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1058lb # [ 0.385645] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1059worker2 # [ 0.369007] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1060worker1 # [ 0.381208] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1061client # [ 0.378794] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1062lb # [ 0.386453] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1063worker2 # [ 0.370003] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1064client # [ 0.379794] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1065lb # [ 0.387310] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1066worker2 # [ 0.371003] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1067worker1 # [ 0.382972] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1068lb # [ 0.387616] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1069client # [ 0.380795] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1070worker2 # [ 0.372003] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1071client # [ 0.381794] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1072worker2 # [ 0.373003] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1073lb # [ 0.389127] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1074client # [ 0.382794] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1075worker2 # [ 0.374003] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1076worker1 # [ 0.386280] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1077client # [ 0.383795] pci_bus 0000:00: root bus resource [bus 00-ff]1078worker2 # [ 0.375003] pci_bus 0000:00: root bus resource [bus 00-ff]1079worker1 # [ 0.387105] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1080client # [ 0.384758] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1081worker1 # [ 0.387986] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1082worker2 # [ 0.375980] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1083lb # [ 0.391645] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1084worker1 # [ 0.388277] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1085lb # [ 0.392617] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1086client # [ 0.386277] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1087worker2 # [ 0.377467] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1088lb # [ 0.393555] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1089worker1 # [ 0.389903] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1090lb # [ 0.395145] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1091worker1 # [ 0.392391] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1092lb # [ 0.397514] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1093worker1 # [ 0.393902] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1094lb # [ 0.398277] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1095worker2 # [ 0.380086] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1096worker1 # [ 0.394293] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1097lb # [ 0.398632] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1098worker2 # [ 0.381015] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1099client # [ 0.388955] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1100worker1 # [ 0.395805] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1101worker2 # [ 0.382018] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1102client # [ 0.389807] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1103lb # [ 0.400873] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1104client # [ 0.390757] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1105worker2 # [ 0.383219] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1106worker1 # [ 0.398279] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1107client # [ 0.392059] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1108lb # [ 0.402618] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1109worker1 # [ 0.399096] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1110worker2 # [ 0.384796] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1111lb # [ 0.403486] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1112worker1 # [ 0.399981] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1113client # [ 0.393539] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1114lb # [ 0.404366] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1115worker2 # [ 0.388037] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1116lb # [ 0.405167] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117worker1 # [ 0.401751] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118worker2 # [ 0.388877] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1119client # [ 0.395816] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1120worker2 # [ 0.389782] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1121client # [ 0.396667] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1122worker2 # [ 0.390877] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1123client # [ 0.397539] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1124worker1 # [ 0.404059] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1125lb # [ 0.406640] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1126worker1 # [ 0.404279] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1127client # [ 0.397800] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1128lb # [ 0.407617] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1129worker1 # [ 0.405204] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1130worker2 # [ 0.392457] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1131lb # [ 0.408533] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1132client # [ 0.399576] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1133worker1 # [ 0.406633] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1134lb # [ 0.410026] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1135worker2 # [ 0.394013] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1136client # [ 0.401813] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1137worker2 # [ 0.394905] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1138client # [ 0.402673] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1139lb # [ 0.411621] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1140worker2 # [ 0.395785] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1141worker1 # [ 0.409232] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1142client # [ 0.403548] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1143lb # [ 0.412504] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1144worker1 # [ 0.410279] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1145worker2 # [ 0.397446] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1146lb # [ 0.413388] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1147client # [ 0.404359] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1148worker1 # [ 0.411208] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1149worker1 # [ 0.412645] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1150lb # [ 0.415018] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1151worker2 # [ 0.400039] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1152client # [ 0.407111] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1153lb # [ 0.416618] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1154worker2 # [ 0.401016] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1155worker1 # [ 0.415190] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1156client # [ 0.407801] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1157lb # [ 0.417496] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1158worker1 # [ 0.415876] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1159worker2 # [ 0.402033] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1160client # [ 0.408755] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1161lb # [ 0.418343] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1162worker1 # [ 0.416294] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1163lb # [ 0.418616] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1164worker2 # [ 0.403569] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1165client # [ 0.410182] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1166lb # [ 0.420146] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1167worker1 # [ 0.417849] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1168worker2 # [ 0.405011] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1169client # [ 0.411818] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1170worker2 # [ 0.405916] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1171client # [ 0.412695] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1172worker1 # [ 0.419280] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1173lb # [ 0.421623] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1174worker2 # [ 0.406753] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1175client # [ 0.413542] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1176worker1 # [ 0.420108] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1177lb # [ 0.422633] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1178worker1 # [ 0.420968] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1179client # [ 0.414357] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1180worker1 # [ 0.421278] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1181worker2 # [ 0.408389] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1182lb # [ 0.424167] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1183worker1 # [ 0.422754] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1184client # [ 0.416801] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1185lb # [ 0.425618] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1186worker2 # [ 0.411032] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1187client # [ 0.417641] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1188lb # [ 0.426444] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1189worker2 # [ 0.411926] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1190client # [ 0.418494] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1191worker1 # [ 0.424285] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1192lb # [ 0.427360] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1193worker2 # [ 0.412793] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1194client # [ 0.419394] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1195worker1 # [ 0.425194] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1196lb # [ 0.428190] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1197worker2 # [ 0.414562] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1198worker1 # [ 0.426612] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1199client # [ 0.420802] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1200lb # [ 0.430352] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1201client # [ 0.421672] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1202worker2 # [ 0.416012] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1203worker1 # [ 0.429029] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1204lb # [ 0.430618] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1205client # [ 0.422817] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1206worker2 # [ 0.417012] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1207worker1 # [ 0.429279] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1208lb # [ 0.431588] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1209worker1 # [ 0.430187] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1210worker2 # [ 0.417989] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1211client # [ 0.424380] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1212lb # [ 0.433025] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1213worker1 # [ 0.431618] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1214worker2 # [ 0.419534] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1215lb # [ 0.434267] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1216client # [ 0.425810] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1217client # [ 0.426673] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1218lb # [ 0.434845] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1219worker2 # [ 0.421036] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1220client # [ 0.427548] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1221worker1 # [ 0.433279] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1222worker2 # [ 0.421933] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1223client # [ 0.427800] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1224worker1 # [ 0.434877] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1225lb # [ 0.436252] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1226worker2 # [ 0.422792] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1227worker1 # [ 0.435294] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1228worker2 # [ 0.423869] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1229client # [ 0.429284] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1230worker1 # [ 0.436836] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1231client # [ 0.430606] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1232worker2 # [ 0.425688] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1233worker1 # [ 0.438133] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1234client # [ 0.431599] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1235worker2 # [ 0.428041] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1236worker1 # [ 0.439108] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1237client # [ 0.433196] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1238worker2 # [ 0.429032] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1239worker1 # [ 0.440941] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1240client # [ 0.434802] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1241worker2 # [ 0.430557] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1242client # [ 0.435651] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1243client # [ 0.436553] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1244worker2 # [ 0.432011] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1245lb # [ 0.436845] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1246client # [ 0.437506] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1247worker2 # [ 0.432902] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1248worker2 # [ 0.434027] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1249client # [ 0.439802] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1250lb # [ 0.440178] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1251client # [ 0.440682] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1252worker2 # [ 0.435582] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1253client # [ 0.441538] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1254lb # [ 0.440845] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1255worker2 # [ 0.437035] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1256client # [ 0.442349] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1257lb # [ 0.442642] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1258worker2 # [ 0.437911] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1259client # [ 0.443366] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1260worker2 # [ 0.438719] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1261worker1 # [ 0.441462] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1262lb # [ 0.443783] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1263lb # [ 0.444899] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1264client # [ 0.444003] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1265worker2 # [ 0.439598] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1266client # [ 0.445312] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1267lb # [ 0.445853] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1268worker2 # [ 0.441345] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1269worker1 # [ 0.444856] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1270worker2 # [ 0.442204] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1271worker1 # [ 0.445500] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1272lb # [ 0.448627] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1273lb # [ 0.449469] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1274worker2 # [ 0.443640] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1275worker1 # [ 0.447279] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1276lb # [ 0.450695] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1277worker1 # [ 0.448451] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1278lb # [ 0.452537] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1279worker1 # [ 0.449551] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1280worker1 # [ 0.450547] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1281lb # [ 0.456200] ACPI: PCI: Interrupt link LNKA configured for IRQ 101282client # [ 0.445985] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1283worker1 # [ 0.452961] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1284lb # [ 0.456717] ACPI: PCI: Interrupt link LNKB configured for IRQ 101285worker1 # [ 0.453279] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1286client # [ 0.448312] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1287lb # [ 0.457711] ACPI: PCI: Interrupt link LNKC configured for IRQ 111288lb # [ 0.458705] ACPI: PCI: Interrupt link LNKD configured for IRQ 111289worker1 # [ 0.454510] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1290client # [ 0.449026] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1291lb # [ 0.459707] ACPI: PCI: Interrupt link LNKE configured for IRQ 101292worker1 # [ 0.456082] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1293client # [ 0.450288] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1294lb # [ 0.460707] ACPI: PCI: Interrupt link LNKF configured for IRQ 101295worker2 # [ 0.444192] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1296lb # [ 0.461701] ACPI: PCI: Interrupt link LNKG configured for IRQ 111297client # [ 0.451057] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1298worker2 # [ 0.446738] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1299lb # [ 0.462727] ACPI: PCI: Interrupt link LNKH configured for IRQ 111300lb # [ 0.463648] ACPI: PCI: Interrupt link GSIA configured for IRQ 161301client # [ 0.452360] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1302worker1 # [ 0.459723] ACPI: PCI: Interrupt link LNKA configured for IRQ 101303worker2 # [ 0.447253] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1304lb # [ 0.464569] ACPI: PCI: Interrupt link GSIB configured for IRQ 171305client # [ 0.453039] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1306lb # [ 0.465336] ACPI: PCI: Interrupt link GSIC configured for IRQ 181307worker1 # [ 0.460379] ACPI: PCI: Interrupt link LNKB configured for IRQ 101308worker2 # [ 0.448666] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1309worker1 # [ 0.461373] ACPI: PCI: Interrupt link LNKC configured for IRQ 111310lb # [ 0.465623] ACPI: PCI: Interrupt link GSID configured for IRQ 191311client # [ 0.454648] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1312worker2 # [ 0.449269] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1313worker1 # [ 0.462370] ACPI: PCI: Interrupt link LNKD configured for IRQ 111314lb # [ 0.466634] ACPI: PCI: Interrupt link GSIE configured for IRQ 201315client # [ 0.455434] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1316worker1 # [ 0.463362] ACPI: PCI: Interrupt link LNKE configured for IRQ 101317lb # [ 0.467626] ACPI: PCI: Interrupt link GSIF configured for IRQ 211318worker2 # [ 0.450369] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1319client # [ 0.456110] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1320worker1 # [ 0.464370] ACPI: PCI: Interrupt link LNKF configured for IRQ 101321lb # [ 0.468594] ACPI: PCI: Interrupt link GSIG configured for IRQ 221322lb # [ 0.469330] ACPI: PCI: Interrupt link GSIH configured for IRQ 231323worker1 # [ 0.465371] ACPI: PCI: Interrupt link LNKG configured for IRQ 111324worker2 # [ 0.451326] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1325client # [ 0.457426] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1326worker1 # [ 0.466373] ACPI: PCI: Interrupt link LNKH configured for IRQ 111327lb # [ 0.470736] iommu: Default domain type: Translated1328worker1 # [ 0.467311] ACPI: PCI: Interrupt link GSIA configured for IRQ 161329worker2 # [ 0.453033] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1330lb # [ 0.471514] iommu: DMA domain TLB invalidation policy: lazy mode1331worker1 # [ 0.468253] ACPI: PCI: Interrupt link GSIB configured for IRQ 171332worker2 # [ 0.453936] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1333lb # [ 0.472593] ACPI: bus type USB registered1334worker1 # [ 0.468992] ACPI: PCI: Interrupt link GSIC configured for IRQ 181335lb # [ 0.473151] usbcore: registered new interface driver usbfs1336client # [ 0.461221] ACPI: PCI: Interrupt link LNKA configured for IRQ 101337worker1 # [ 0.469284] ACPI: PCI: Interrupt link GSID configured for IRQ 191338worker2 # [ 0.455358] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1339lb # [ 0.473622] usbcore: registered new interface driver hub1340client # [ 0.461901] ACPI: PCI: Interrupt link LNKB configured for IRQ 101341worker1 # [ 0.470286] ACPI: PCI: Interrupt link GSIE configured for IRQ 201342lb # [ 0.474474] usbcore: registered new device driver usb1343client # [ 0.462892] ACPI: PCI: Interrupt link LNKC configured for IRQ 111344worker1 # [ 0.471296] ACPI: PCI: Interrupt link GSIF configured for IRQ 211345worker2 # [ 0.456775] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1346lb # [ 0.476137] NetLabel: Initializing1347client # [ 0.463894] ACPI: PCI: Interrupt link LNKD configured for IRQ 111348worker1 # [ 0.472264] ACPI: PCI: Interrupt link GSIG configured for IRQ 221349lb # [ 0.476611] NetLabel: domain hash size = 1281350client # [ 0.464889] ACPI: PCI: Interrupt link LNKE configured for IRQ 101351worker1 # [ 0.472974] ACPI: PCI: Interrupt link GSIH configured for IRQ 231352lb # [ 0.477310] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1353client # [ 0.465881] ACPI: PCI: Interrupt link LNKF configured for IRQ 101354lb # [ 0.477678] NetLabel: unlabeled traffic allowed by default1355worker1 # [ 0.474313] iommu: Default domain type: Translated1356client # [ 0.466893] ACPI: PCI: Interrupt link LNKG configured for IRQ 111357worker2 # [ 0.460007] ACPI: PCI: Interrupt link LNKA configured for IRQ 101358lb # [ 0.478594] PCI: Using ACPI for IRQ routing1359worker1 # [ 0.475071] iommu: DMA domain TLB invalidation policy: lazy mode1360client # [ 0.467896] ACPI: PCI: Interrupt link LNKH configured for IRQ 111361worker2 # [ 0.461108] ACPI: PCI: Interrupt link LNKB configured for IRQ 101362worker1 # [ 0.476227] ACPI: bus type USB registered1363client # [ 0.468829] ACPI: PCI: Interrupt link GSIA configured for IRQ 161364worker2 # [ 0.462112] ACPI: PCI: Interrupt link LNKC configured for IRQ 111365worker1 # [ 0.476807] usbcore: registered new interface driver usbfs1366client # [ 0.469812] ACPI: PCI: Interrupt link GSIB configured for IRQ 171367worker1 # [ 0.477293] usbcore: registered new interface driver hub1368worker2 # [ 0.463103] ACPI: PCI: Interrupt link LNKD configured for IRQ 111369worker1 # [ 0.478126] usbcore: registered new device driver usb1370client # [ 0.470808] ACPI: PCI: Interrupt link GSIC configured for IRQ 181371worker2 # [ 0.464124] ACPI: PCI: Interrupt link LNKE configured for IRQ 101372client # [ 0.471803] ACPI: PCI: Interrupt link GSID configured for IRQ 191373worker1 # [ 0.479714] NetLabel: Initializing1374worker2 # [ 0.465122] ACPI: PCI: Interrupt link LNKF configured for IRQ 101375client # [ 0.472809] ACPI: PCI: Interrupt link GSIE configured for IRQ 201376worker1 # [ 0.480273] NetLabel: domain hash size = 1281377worker2 # [ 0.466106] ACPI: PCI: Interrupt link LNKG configured for IRQ 111378worker1 # [ 0.480968] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1379client # [ 0.473754] ACPI: PCI: Interrupt link GSIF configured for IRQ 211380worker2 # [ 0.467116] ACPI: PCI: Interrupt link LNKH configured for IRQ 111381worker1 # [ 0.481310] NetLabel: unlabeled traffic allowed by default1382client # [ 0.474540] ACPI: PCI: Interrupt link GSIG configured for IRQ 221383worker1 # [ 0.482168] PCI: Using ACPI for IRQ routing1384client # [ 0.474812] ACPI: PCI: Interrupt link GSIH configured for IRQ 231385worker2 # [ 0.468044] ACPI: PCI: Interrupt link GSIA configured for IRQ 161386worker2 # [ 0.469023] ACPI: PCI: Interrupt link GSIB configured for IRQ 171387client # [ 0.476835] iommu: Default domain type: Translated1388worker2 # [ 0.470018] ACPI: PCI: Interrupt link GSIC configured for IRQ 181389client # [ 0.477626] iommu: DMA domain TLB invalidation policy: lazy mode1390worker2 # [ 0.471007] ACPI: PCI: Interrupt link GSID configured for IRQ 191391client # [ 0.478845] ACPI: bus type USB registered1392worker2 # [ 0.472005] ACPI: PCI: Interrupt link GSIE configured for IRQ 201393client # [ 0.479549] usbcore: registered new interface driver usbfs1394worker2 # [ 0.473009] ACPI: PCI: Interrupt link GSIF configured for IRQ 211395client # [ 0.479809] usbcore: registered new interface driver hub1396worker2 # [ 0.474015] ACPI: PCI: Interrupt link GSIG configured for IRQ 221397client # [ 0.480707] usbcore: registered new device driver usb1398worker2 # [ 0.475018] ACPI: PCI: Interrupt link GSIH configured for IRQ 231399client # [ 0.482386] NetLabel: Initializing1400client # [ 0.482795] NetLabel: domain hash size = 1281401worker2 # [ 0.476983] iommu: Default domain type: Translated1402client # [ 0.483524] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1403worker2 # [ 0.477664] iommu: DMA domain TLB invalidation policy: lazy mode1404client # [ 0.483849] NetLabel: unlabeled traffic allowed by default1405worker2 # [ 0.478261] ACPI: bus type USB registered1406client # [ 0.484764] PCI: Using ACPI for IRQ routing1407worker2 # [ 0.479064] usbcore: registered new interface driver usbfs1408worker2 # [ 0.480018] usbcore: registered new interface driver hub1409worker2 # [ 0.480967] usbcore: registered new device driver usb1410worker2 # [ 0.482582] NetLabel: Initializing1411worker2 # [ 0.483004] NetLabel: domain hash size = 1281412worker2 # [ 0.483808] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker2 # [ 0.484857] NetLabel: unlabeled traffic allowed by default1414worker2 # [ 0.485767] PCI: Using ACPI for IRQ routing1415lb # [ 0.523211] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416lb # [ 0.523606] pci 0000:00:01.0: vgaarb: bridge control possible1417lb # [ 0.523606] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418lb # [ 0.523615] vgaarb: loaded1419lb # [ 0.524353] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420lb # [ 0.524612] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker1 # [ 0.524830] pci 0000:00:01.0: vgaarb: setting as boot VGA device1422worker1 # [ 0.525268] pci 0000:00:01.0: vgaarb: bridge control possible1423worker1 # [ 0.525268] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1424lb # [ 0.528686] clocksource: Switched to clocksource kvm-clock1425worker1 # [ 0.525277] vgaarb: loaded1426worker1 # [ 0.525979] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01427worker1 # [ 0.526273] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1428lb # [ 0.532134] VFS: Disk quotas dquot_6.6.01429lb # [ 0.532828] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1430lb # [ 0.534177] pnp: PnP ACPI init1431worker1 # [ 0.529372] clocksource: Switched to clocksource kvm-clock1432lb # [ 0.534976] ACPI: IRQ 4 override to edge(!), high(!)1433lb # [ 0.535920] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1434lb # [ 0.537563] pnp: PnP ACPI: found 6 devices1435worker1 # [ 0.532721] VFS: Disk quotas dquot_6.6.01436worker1 # [ 0.533425] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1437client # [ 0.529541] pci 0000:00:01.0: vgaarb: setting as boot VGA device1438worker1 # [ 0.534739] pnp: PnP ACPI init1439client # [ 0.529790] pci 0000:00:01.0: vgaarb: bridge control possible1440worker1 # [ 0.535509] ACPI: IRQ 4 override to edge(!), high(!)1441client # [ 0.529790] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1442worker1 # [ 0.536441] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1443client # [ 0.529799] vgaarb: loaded1444worker1 # [ 0.537940] pnp: PnP ACPI: found 6 devices1445client # [ 0.530559] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01446client # [ 0.530797] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1447lb # [ 0.545144] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1448lb # [ 0.546655] clocksource: Switched to clocksource acpi_pm1449lb # [ 0.547677] NET: Registered PF_INET protocol family1450worker2 # [ 0.530132] pci 0000:00:01.0: vgaarb: setting as boot VGA device1451client # [ 0.534888] clocksource: Switched to clocksource kvm-clock1452worker2 # [ 0.530999] pci 0000:00:01.0: vgaarb: bridge control possible1453lb # [ 0.548895] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1454client # [ 0.536632] VFS: Disk quotas dquot_6.6.01455worker2 # [ 0.530999] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1456worker2 # [ 0.531009] vgaarb: loaded1457worker1 # [ 0.545493] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1458worker2 # [ 0.531824] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01459worker1 # [ 0.546909] clocksource: Switched to clocksource acpi_pm1460worker2 # [ 0.532669] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1461worker1 # [ 0.547860] NET: Registered PF_INET protocol family1462client # [ 0.539267] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1463client # [ 0.540629] pnp: PnP ACPI init1464worker1 # [ 0.548957] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1465client # [ 0.541466] ACPI: IRQ 4 override to edge(!), high(!)1466client # [ 0.542477] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1467worker2 # [ 0.536115] clocksource: Switched to clocksource kvm-clock1468client # [ 0.544067] pnp: PnP ACPI: found 6 devices1469worker2 # [ 0.539559] VFS: Disk quotas dquot_6.6.01470worker2 # [ 0.540283] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1471worker2 # [ 0.541680] pnp: PnP ACPI init1472worker2 # [ 0.542460] ACPI: IRQ 4 override to edge(!), high(!)1473worker2 # [ 0.543481] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1474lb # [ 0.565564] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1475worker2 # [ 0.545083] pnp: PnP ACPI: found 6 devices1476client # [ 0.551750] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1477client # [ 0.553170] clocksource: Switched to clocksource acpi_pm1478lb # [ 0.567113] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1479client # [ 0.554093] NET: Registered PF_INET protocol family1480lb # [ 0.568430] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1481client # [ 0.555363] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1482lb # [ 0.569795] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1483worker1 # [ 0.564970] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1484lb # [ 0.571085] TCP: Hash tables configured (established 16384 bind 16384)1485worker1 # [ 0.566476] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1486lb # [ 0.572234] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1487worker1 # [ 0.567748] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1488lb # [ 0.573514] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1489worker2 # [ 0.552659] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1490lb # [ 0.574589] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1491worker1 # [ 0.569035] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1492worker2 # [ 0.554110] clocksource: Switched to clocksource acpi_pm1493lb # [ 0.575809] NET: Registered PF_UNIX/PF_LOCAL protocol family1494worker1 # [ 0.570224] TCP: Hash tables configured (established 16384 bind 16384)1495worker2 # [ 0.555091] NET: Registered PF_INET protocol family1496lb # [ 0.576766] NET: Registered PF_XDP protocol family1497worker1 # [ 0.571287] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1498lb # [ 0.577610] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1499worker2 # [ 0.556258] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1500worker1 # [ 0.572518] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1501lb # [ 0.578634] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1502worker1 # [ 0.573565] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1503lb # [ 0.579670] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1504worker1 # [ 0.574734] NET: Registered PF_UNIX/PF_LOCAL protocol family1505lb # [ 0.580781] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1506worker1 # [ 0.575663] NET: Registered PF_XDP protocol family1507lb # [ 0.581844] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1508worker1 # [ 0.576470] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1509worker1 # [ 0.577443] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1510lb # [ 0.582919] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1511worker1 # [ 0.578418] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1512lb # [ 0.584633] ACPI: \_SB_.GSIA: Enabled at IRQ 161513worker1 # [ 0.579482] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1514worker1 # [ 0.580549] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1515client # [ 0.572242] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1516lb # [ 0.586895] ACPI: \_SB_.GSIB: Enabled at IRQ 171517worker1 # [ 0.581608] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1518client # [ 0.573781] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1519worker1 # [ 0.583195] ACPI: \_SB_.GSIA: Enabled at IRQ 161520lb # [ 0.589155] ACPI: \_SB_.GSIC: Enabled at IRQ 181521client # [ 0.575172] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1522client # [ 0.576512] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1523lb # [ 0.591116] ACPI: \_SB_.GSID: Enabled at IRQ 191524worker1 # [ 0.585652] ACPI: \_SB_.GSIB: Enabled at IRQ 171525client # [ 0.577795] TCP: Hash tables configured (established 16384 bind 16384)1526lb # [ 0.592800] PCI: CLS 0 bytes, default 641527worker1 # [ 0.587479] ACPI: \_SB_.GSIC: Enabled at IRQ 181528client # [ 0.578978] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1529worker2 # [ 0.572262] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1530lb # [ 0.593774] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1531client # [ 0.580262] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1532worker1 # [ 0.589410] ACPI: \_SB_.GSID: Enabled at IRQ 191533lb # [ 0.595444] Trying to unpack rootfs image as initramfs...1534worker2 # [ 0.573799] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1535client # [ 0.581342] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1536worker1 # [ 0.590982] PCI: CLS 0 bytes, default 641537client # [ 0.582537] NET: Registered PF_UNIX/PF_LOCAL protocol family1538worker2 # [ 0.575090] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1539client # [ 0.583490] NET: Registered PF_XDP protocol family1540worker1 # [ 0.591819] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1541worker2 # [ 0.576467] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1542client # [ 0.584340] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1543worker1 # [ 0.593512] Trying to unpack rootfs image as initramfs...1544worker2 # [ 0.577799] TCP: Hash tables configured (established 16384 bind 16384)1545client # [ 0.585368] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1546client # [ 0.586362] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1547worker2 # [ 0.578979] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1548client # [ 0.587479] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1549worker2 # [ 0.580249] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1550client # [ 0.588626] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1551worker2 # [ 0.581382] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1552client # [ 0.589810] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1553worker2 # [ 0.582724] NET: Registered PF_UNIX/PF_LOCAL protocol family1554worker2 # [ 0.583731] NET: Registered PF_XDP protocol family1555client # [ 0.591534] ACPI: \_SB_.GSIA: Enabled at IRQ 161556worker2 # [ 0.584630] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1557worker2 # [ 0.585699] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1558client # [ 0.594109] ACPI: \_SB_.GSIB: Enabled at IRQ 171559worker2 # [ 0.586769] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1560worker2 # [ 0.587899] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1561client # [ 0.596043] ACPI: \_SB_.GSIC: Enabled at IRQ 181562worker2 # [ 0.589064] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1563worker2 # [ 0.590195] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1564client # [ 0.598105] ACPI: \_SB_.GSID: Enabled at IRQ 191565worker2 # [ 0.591903] ACPI: \_SB_.GSIA: Enabled at IRQ 161566client # [ 0.599741] PCI: CLS 0 bytes, default 641567client # [ 0.600667] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1568worker2 # [ 0.594309] ACPI: \_SB_.GSIB: Enabled at IRQ 171569client # [ 0.602520] Trying to unpack rootfs image as initramfs...1570worker2 # [ 0.596564] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker2 # [ 0.598581] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker2 # [ 0.600270] PCI: CLS 0 bytes, default 641573worker2 # [ 0.601255] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574worker2 # [ 0.603045] Trying to unpack rootfs image as initramfs...1575worker1 # [ 0.635772] Initialise system trusted keyrings1576lb # [ 0.641491] Initialise system trusted keyrings1577lb # [ 0.642439] workingset: timestamp_bits=40 max_order=19 bucket_order=01578worker1 # [ 0.639411] workingset: timestamp_bits=40 max_order=19 bucket_order=01579client # [ 0.647039] Initialise system trusted keyrings1580lb # [ 0.664058] Key type asymmetric registered1581client # [ 0.649944] workingset: timestamp_bits=40 max_order=19 bucket_order=01582lb # [ 0.664752] Asymmetric key parser 'x509' registered1583lb # [ 0.665602] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584worker1 # [ 0.660552] Key type asymmetric registered1585worker1 # [ 0.661234] Asymmetric key parser 'x509' registered1586worker1 # [ 0.662077] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1587lb # [ 0.671097] io scheduler mq-deadline registered1588worker2 # [ 0.649939] Initialise system trusted keyrings1589lb # [ 0.671827] io scheduler kyber registered1590worker1 # [ 0.666526] io scheduler mq-deadline registered1591worker2 # [ 0.650905] workingset: timestamp_bits=40 max_order=19 bucket_order=01592worker1 # [ 0.667259] io scheduler kyber registered1593lb # [ 0.675510] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1594worker1 # [ 0.670621] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1595lb # [ 0.676745] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1596worker1 # [ 0.671854] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1597lb # [ 0.680788] Linux agpgart interface v0.1031598lb # [ 0.681569] ACPI: bus type drm_connector registered1599worker1 # [ 0.677142] Linux agpgart interface v0.1031600worker1 # [ 0.677897] ACPI: bus type drm_connector registered1601client # [ 0.671798] Key type asymmetric registered1602worker1 # [ 0.680805] usbcore: registered new interface driver usbserial_generic1603lb # [ 0.686430] usbcore: registered new interface driver usbserial_generic1604client # [ 0.672575] Asymmetric key parser 'x509' registered1605worker1 # [ 0.681822] usbserial: USB Serial support registered for generic1606lb # [ 0.687463] usbserial: USB Serial support registered for generic1607client # [ 0.673431] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1608lb # [ 0.688437] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1609lb # [ 0.688437] Please enable it if your BIOS has the CPPC option.1610lb # [ 0.690567] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1611worker1 # [ 0.685376] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1612worker1 # [ 0.685376] Please enable it if your BIOS has the CPPC option.1613worker1 # [ 0.687517] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1614client # [ 0.679917] io scheduler mq-deadline registered1615client # [ 0.680668] io scheduler kyber registered1616worker2 # [ 0.673812] Key type asymmetric registered1617worker2 # [ 0.674601] Asymmetric key parser 'x509' registered1618lb # [ 0.696098] drop_monitor: Initializing network drop monitor service1619worker1 # [ 0.691501] drop_monitor: Initializing network drop monitor service1620lb # [ 0.697266] NET: Registered PF_INET6 protocol family1621worker2 # [ 0.675488] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1622client # [ 0.683348] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1623worker1 # [ 0.692600] NET: Registered PF_INET6 protocol family1624client # [ 0.684618] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1625lb # [ 0.700394] Segment Routing with IPv61626lb # [ 0.701080] In-situ OAM (IOAM) with IPv61627worker1 # [ 0.695546] Segment Routing with IPv61628worker1 # [ 0.696186] In-situ OAM (IOAM) with IPv61629worker2 # [ 0.680669] io scheduler mq-deadline registered1630worker1 # [ 0.697192] IPI shorthand broadcast: enabled1631worker2 # [ 0.681476] io scheduler kyber registered1632lb # [ 0.704250] IPI shorthand broadcast: enabled1633client # [ 0.690418] Linux agpgart interface v0.1031634client # [ 0.691187] ACPI: bus type drm_connector registered1635worker2 # [ 0.685080] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1636worker2 # [ 0.686437] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1637client # [ 0.694211] usbcore: registered new interface driver usbserial_generic1638client # [ 0.695250] usbserial: USB Serial support registered for generic1639worker1 # [ 0.705452] sched_clock: Marking stable (572014921, 133346514)->(779056914, -73695479)1640worker2 # [ 0.690284] Linux agpgart interface v0.1031641client # [ 0.697800] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1642worker2 # [ 0.691076] ACPI: bus type drm_connector registered1643lb # [ 0.712225] sched_clock: Marking stable (579015496, 132937355)->(785587622, -73634771)1644client # [ 0.697800] Please enable it if your BIOS has the CPPC option.1645lb # [ 0.713851] registered taskstats version 11646client # [ 0.699916] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1647lb # [ 0.714829] Loading compiled-in X.509 certificates1648worker2 # [ 0.693976] usbcore: registered new interface driver usbserial_generic1649worker1 # [ 0.710572] registered taskstats version 11650worker2 # [ 0.695091] usbserial: USB Serial support registered for generic1651worker1 # [ 0.711504] Loading compiled-in X.509 certificates1652client # [ 0.703927] drop_monitor: Initializing network drop monitor service1653client # [ 0.705037] NET: Registered PF_INET6 protocol family1654worker2 # [ 0.698544] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1655worker2 # [ 0.698544] Please enable it if your BIOS has the CPPC option.1656client # [ 0.708263] Segment Routing with IPv61657worker2 # [ 0.700907] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1658client # [ 0.710807] In-situ OAM (IOAM) with IPv61659client # [ 0.711859] IPI shorthand broadcast: enabled1660worker2 # [ 0.704670] drop_monitor: Initializing network drop monitor service1661worker2 # [ 0.705866] NET: Registered PF_INET6 protocol family1662worker2 # [ 0.708997] Segment Routing with IPv61663lb # [ 0.732705] Demotion targets for Node 0: null1664worker2 # [ 0.712544] In-situ OAM (IOAM) with IPv61665worker1 # [ 0.728376] Demotion targets for Node 0: null1666client # [ 0.720098] sched_clock: Marking stable (587013530, 132758461)->(792173909, -72401918)1667worker1 # [ 0.729235] Key type .fscrypt registered1668worker2 # [ 0.713562] IPI shorthand broadcast: enabled1669lb # [ 0.735006] Key type .fscrypt registered1670worker1 # [ 0.729899] Key type fscrypt-provisioning registered1671lb # [ 0.735643] Key type fscrypt-provisioning registered1672worker1 # [ 0.730814] ima: No TPM chip found, activating TPM-bypass!1673lb # [ 0.736566] ima: No TPM chip found, activating TPM-bypass!1674client # [ 0.724965] registered taskstats version 11675worker1 # [ 0.733379] ima: Allocated hash algorithm: sha11676worker1 # [ 0.734140] ima: No architecture policies found1677client # [ 0.725905] Loading compiled-in X.509 certificates1678lb # [ 0.740988] ima: Allocated hash algorithm: sha11679lb # [ 0.741754] ima: No architecture policies found1680worker2 # [ 0.721633] sched_clock: Marking stable (587014207, 134509138)->(794052709, -72529364)1681worker1 # [ 0.738375] PM: Magic number: 10:433:1191682lb # [ 0.743967] PM: Magic number: 10:433:1191683worker1 # [ 0.739902] RAS: Correctable Errors collector initialized.1684lb # [ 0.745515] RAS: Correctable Errors collector initialized.1685worker2 # [ 0.726678] registered taskstats version 11686worker2 # [ 0.727672] Loading compiled-in X.509 certificates1687worker1 # [ 0.748017] clk: Disabling unused clocks1688lb # [ 0.753621] clk: Disabling unused clocks1689worker1 # [ 0.750374] PM: genpd: Disabling unused power domains1690lb # [ 0.757964] PM: genpd: Disabling unused power domains1691client # [ 0.744784] Demotion targets for Node 0: null1692client # [ 0.745727] Key type .fscrypt registered1693client # [ 0.746432] Key type fscrypt-provisioning registered1694client # [ 0.749891] ima: No TPM chip found, activating TPM-bypass!1695client # [ 0.750785] ima: Allocated hash algorithm: sha11696worker2 # [ 0.744163] Demotion targets for Node 0: null1697client # [ 0.751559] ima: No architecture policies found1698worker2 # [ 0.746581] Key type .fscrypt registered1699client # [ 0.753955] PM: Magic number: 10:433:1191700worker2 # [ 0.747238] Key type fscrypt-provisioning registered1701worker2 # [ 0.748201] ima: No TPM chip found, activating TPM-bypass!1702client # [ 0.755592] RAS: Correctable Errors collector initialized.1703worker2 # [ 0.752549] ima: Allocated hash algorithm: sha11704worker2 # [ 0.753417] ima: No architecture policies found1705worker2 # [ 0.754411] PM: Magic number: 10:433:1191706client # [ 0.765445] clk: Disabling unused clocks1707worker2 # [ 0.758039] RAS: Correctable Errors collector initialized.1708client # [ 0.767787] PM: genpd: Disabling unused power domains1709worker2 # [ 0.766699] clk: Disabling unused clocks1710worker2 # [ 0.767426] PM: genpd: Disabling unused power domains1711lb # [ 0.913247] Freeing initrd memory: 29092K1712worker1 # [ 0.908108] Freeing initrd memory: 29092K1713lb # [ 0.916356] Freeing unused decrypted memory: 2028K1714worker1 # [ 0.911216] Freeing unused decrypted memory: 2028K1715lb # [ 0.918866] Freeing unused kernel image (initmem) memory: 3644K1716worker1 # [ 0.913710] Freeing unused kernel image (initmem) memory: 3644K1717lb # [ 0.919983] Write protecting the kernel read-only data: 32768k1718worker1 # [ 0.914753] Write protecting the kernel read-only data: 32768k1719lb # [ 0.921837] Freeing unused kernel image (text/rodata gap) memory: 1208K1720worker1 # [ 0.916571] Freeing unused kernel image (text/rodata gap) memory: 1208K1721lb # [ 0.923353] Freeing unused kernel image (rodata/data gap) memory: 752K1722worker1 # [ 0.918050] Freeing unused kernel image (rodata/data gap) memory: 752K1723worker2 # [ 0.928036] Freeing initrd memory: 29092K1724worker2 # [ 0.931169] Freeing unused decrypted memory: 2028K1725worker2 # [ 0.933753] Freeing unused kernel image (initmem) memory: 3644K1726worker2 # [ 0.934864] Write protecting the kernel read-only data: 32768k1727worker2 # [ 0.936753] Freeing unused kernel image (text/rodata gap) memory: 1208K1728worker2 # [ 0.938260] Freeing unused kernel image (rodata/data gap) memory: 752K1729client # [ 0.950346] Freeing initrd memory: 29096K1730client # [ 0.953617] Freeing unused decrypted memory: 2028K1731client # [ 0.956318] Freeing unused kernel image (initmem) memory: 3644K1732client # [ 0.957374] Write protecting the kernel read-only data: 32768k1733client # [ 0.959262] Freeing unused kernel image (text/rodata gap) memory: 1208K1734lb # [ 0.974453] x86/mm: Checked W+X mappings: passed, no W+X pages found.1735worker1 # [ 0.969195] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736client # [ 0.960740] Freeing unused kernel image (rodata/data gap) memory: 752K1737lb # [ 0.975518] Run /init as init process1738worker1 # [ 0.970217] Run /init as init process1739lb # [ 0.985300] systemd[1]: Inserted module 'autofs4'1740worker1 # [ 0.979998] systemd[1]: Inserted module 'autofs4'1741lb # [ 1.001393] fuse: init (API version 7.45)1742worker1 # [ 0.996045] fuse: init (API version 7.45)1743lb # [ 1.007169] ACPI: \_SB_.GSIG: Enabled at IRQ 221744worker1 # [ 1.001786] ACPI: \_SB_.GSIG: Enabled at IRQ 221745lb # [ 1.009499] ACPI: \_SB_.GSIH: Enabled at IRQ 231746worker1 # [ 1.004165] ACPI: \_SB_.GSIH: Enabled at IRQ 231747worker2 # [ 0.989567] x86/mm: Checked W+X mappings: passed, no W+X pages found.1748worker2 # [ 0.990661] Run /init as init process1749lb # [ 1.012498] ACPI: \_SB_.GSIE: Enabled at IRQ 201750worker1 # [ 1.008018] ACPI: \_SB_.GSIE: Enabled at IRQ 201751lb # [ 1.014921] ACPI: \_SB_.GSIF: Enabled at IRQ 211752worker1 # [ 1.010810] ACPI: \_SB_.GSIF: Enabled at IRQ 211753worker2 # [ 1.000613] systemd[1]: Inserted module 'autofs4'1754client # [ 1.011788] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755client # [ 1.012894] Run /init as init process1756client # [ 1.023740] systemd[1]: Inserted module 'autofs4'1757worker2 # [ 1.017483] fuse: init (API version 7.45)1758lb # [ 1.043252] systemd[1]: Successfully made /usr/ read-only.1759worker2 # [ 1.023249] ACPI: \_SB_.GSIG: Enabled at IRQ 221760worker2 # [ 1.025613] ACPI: \_SB_.GSIH: Enabled at IRQ 231761worker1 # [ 1.041518] systemd[1]: Successfully made /usr/ read-only.1762worker2 # [ 1.028426] ACPI: \_SB_.GSIE: Enabled at IRQ 201763worker2 # [ 1.030680] ACPI: \_SB_.GSIF: Enabled at IRQ 211764client # [ 1.039989] fuse: init (API version 7.45)1765client # [ 1.045806] ACPI: \_SB_.GSIG: Enabled at IRQ 221766client # [ 1.048561] ACPI: \_SB_.GSIH: Enabled at IRQ 231767client # [ 1.051929] ACPI: \_SB_.GSIE: Enabled at IRQ 201768client # [ 1.054171] ACPI: \_SB_.GSIF: Enabled at IRQ 211769worker2 # [ 1.059780] systemd[1]: Successfully made /usr/ read-only.1770client # [ 1.083579] systemd[1]: Successfully made /usr/ read-only.1771lb # [ 1.379045] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772lb # [ 1.383897] systemd[1]: Detected virtualization kvm.1773lb # [ 1.384735] systemd[1]: Detected architecture x86-64.1774lb # [ 1.385668] systemd[1]: Running in initrd.1775worker1 # [ 1.377188] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1776lb # [ 1.386916] systemd[1]: Initializing machine ID from random generator.1777worker1 # [ 1.382066] systemd[1]: Detected virtualization kvm.1778lb # [ 1.388066] systemd[1]: Hostname set to <lb>.1779worker1 # [ 1.382930] systemd[1]: Detected architecture x86-64.1780worker1 # [ 1.383790] systemd[1]: Running in initrd.1781worker1 # [ 1.385035] systemd[1]: Initializing machine ID from random generator.1782worker1 # [ 1.386237] systemd[1]: Hostname set to <worker1>.1783worker2 # [ 1.395473] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784worker2 # [ 1.400652] systemd[1]: Detected virtualization kvm.1785worker2 # [ 1.401562] systemd[1]: Detected architecture x86-64.1786worker2 # [ 1.402454] systemd[1]: Running in initrd.1787worker2 # [ 1.403722] systemd[1]: Initializing machine ID from random generator.1788worker2 # [ 1.405024] systemd[1]: Hostname set to <worker2>.1789client # [ 1.419399] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790client # [ 1.425408] systemd[1]: Detected virtualization kvm.1791client # [ 1.426434] systemd[1]: Detected architecture x86-64.1792client # [ 1.427493] systemd[1]: Running in initrd.1793client # [ 1.428982] systemd[1]: Initializing machine ID from random generator.1794client # [ 1.430442] systemd[1]: Hostname set to <client>.1795worker1 # [ 1.577785] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796lb # [ 1.584524] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker1 # [ 1.618492] systemd[1]: Queued start job for default target Initrd Default Target.1798worker1 # [ 1.621851] systemd[1]: Created slice Slice /system/modprobe.1799worker1 # [ 1.623067] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1800worker1 # [ 1.624470] systemd[1]: Expecting device /dev/disk/by-label/nixos...1801lb # [ 1.629906] systemd[1]: Queued start job for default target Initrd Default Target.1802worker1 # [ 1.625545] systemd[1]: Reached target Path Units.1803worker2 # [ 1.608916] systemd[1]: bpf-restrict-fs: LSM BPF program attached1804worker1 # [ 1.626384] systemd[1]: Reached target Slice Units.1805worker1 # [ 1.627225] systemd[1]: Reached target Swaps.1806worker1 # [ 1.628019] systemd[1]: Reached target Timer Units.1807lb # [ 1.634394] systemd[1]: Created slice Slice /system/modprobe.1808worker1 # [ 1.629010] systemd[1]: Listening on D-Bus System Message Bus Socket.1809worker1 # [ 1.630285] systemd[1]: Listening on Journal Socket (/dev/log).1810lb # [ 1.635643] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1811worker1 # [ 1.631511] systemd[1]: Listening on Journal Sockets.1812client # [ 1.622992] systemd[1]: bpf-restrict-fs: LSM BPF program attached1813lb # [ 1.637080] systemd[1]: Expecting device /dev/disk/by-label/nixos...1814worker1 # [ 1.632463] systemd[1]: Listening on udev Control Socket.1815lb # [ 1.638155] systemd[1]: Reached target Path Units.1816lb # [ 1.639012] systemd[1]: Reached target Slice Units.1817worker1 # [ 1.633522] systemd[1]: Listening on udev Kernel Socket.1818lb # [ 1.639866] systemd[1]: Reached target Swaps.1819worker1 # [ 1.634461] systemd[1]: Reached target Socket Units.1820lb # [ 1.640662] systemd[1]: Reached target Timer Units.1821lb # [ 1.641708] systemd[1]: Listening on D-Bus System Message Bus Socket.1822worker1 # [ 1.636288] systemd[1]: Starting Create List of Static Device Nodes...1823lb # [ 1.642976] systemd[1]: Listening on Journal Socket (/dev/log).1824lb # [ 1.644236] systemd[1]: Listening on Journal Sockets.1825lb # [ 1.645254] systemd[1]: Listening on udev Control Socket.1826worker1 # [ 1.640272] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1827lb # [ 1.646293] systemd[1]: Listening on udev Kernel Socket.1828lb # [ 1.647277] systemd[1]: Reached target Socket Units.1829lb # [ 1.649287] systemd[1]: Starting Create List of Static Device Nodes...1830lb # [ 1.653029] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1831worker1 # [ 1.648445] systemd[1]: Starting Load Kernel Module configfs...1832lb # [ 1.662031] systemd[1]: Starting Load Kernel Module configfs...1833worker1 # [ 1.661619] systemd[1]: Starting Journal Service...1834client # [ 1.661377] systemd[1]: Queued start job for default target Initrd Default Target.1835worker1 # [ 1.671556] systemd[1]: Starting Load Kernel Modules...1836lb # [ 1.677677] systemd[1]: Starting Journal Service...1837client # [ 1.665118] systemd[1]: Created slice Slice /system/modprobe.1838client # [ 1.666363] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1839client # [ 1.667821] systemd[1]: Expecting device /dev/disk/by-label/nixos...1840client # [ 1.668996] systemd[1]: Reached target Path Units.1841client # [ 1.669870] systemd[1]: Reached target Slice Units.1842client # [ 1.670799] systemd[1]: Reached target Swaps.1843client # [ 1.671674] systemd[1]: Reached target Timer Units.1844worker2 # [ 1.664186] systemd[1]: Queued start job for default target Initrd Default Target.1845client # [ 1.672668] systemd[1]: Listening on D-Bus System Message Bus Socket.1846client # [ 1.673915] systemd[1]: Listening on Journal Socket (/dev/log).1847client # [ 1.675079] systemd[1]: Listening on Journal Sockets.1848client # [ 1.676097] systemd[1]: Listening on udev Control Socket.1849worker2 # [ 1.668944] systemd[1]: Created slice Slice /system/modprobe.1850lb # [ 1.691055] systemd[1]: Starting Load Kernel Modules...1851client # [ 1.677142] systemd[1]: Listening on udev Kernel Socket.1852worker2 # [ 1.670071] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1853client # [ 1.678070] systemd[1]: Reached target Socket Units.1854worker2 # [ 1.671496] systemd[1]: Expecting device /dev/disk/by-label/nixos...1855worker2 # [ 1.672647] systemd[1]: Reached target Path Units.1856client # [ 1.679840] systemd[1]: Starting Create List of Static Device Nodes...1857worker1 # [ 1.677449] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1858worker2 # [ 1.673490] systemd[1]: Reached target Slice Units.1859worker2 # [ 1.674391] systemd[1]: Reached target Swaps.1860worker2 # [ 1.675263] systemd[1]: Reached target Timer Units.1861worker2 # [ 1.676263] systemd[1]: Listening on D-Bus System Message Bus Socket.1862client # [ 1.683609] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1863worker2 # [ 1.677434] systemd[1]: Listening on Journal Socket (/dev/log).1864worker2 # [ 1.678646] systemd[1]: Listening on Journal Sockets.1865worker2 # [ 1.679680] systemd[1]: Listening on udev Control Socket.1866worker2 # [ 1.680785] systemd[1]: Listening on udev Kernel Socket.1867worker2 # [ 1.681821] systemd[1]: Reached target Socket Units.1868worker1 # [ 1.699179] netfs: FS-Cache loaded1869client # [ 1.690537] systemd[1]: Starting Load Kernel Module configfs...1870worker2 # [ 1.683735] systemd[1]: Starting Create List of Static Device Nodes...1871worker2 # [ 1.687596] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1872lb # [ 1.698041] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1873worker1 # [ 1.704968] 9pnet: Installing 9P2000 support1874lb # [ 1.713997] netfs: FS-Cache loaded1875worker2 # [ 1.696602] systemd[1]: Starting Load Kernel Module configfs...1876lb # [ 1.718960] 9pnet: Installing 9P2000 support1877worker1 # [ 1.713587] systemd[1]: Starting Coldplug All udev Devices...1878client # [ 1.705844] systemd[1]: Starting Journal Service...1879lb # [ 1.730036] systemd[1]: Starting Coldplug All udev Devices...1880client # [ 1.718190] systemd[1]: Starting Load Kernel Modules...1881worker2 # [ 1.712610] systemd[1]: Starting Journal Service...1882worker1 # [ 1.730462] systemd[1]: Finished Create List of Static Device Nodes.1883worker1 # [ 1.735238] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1884lb # [ 1.742351] systemd[1]: Finished Create List of Static Device Nodes.1885worker2 # [ 1.727620] systemd[1]: Starting Load Kernel Modules...1886client # [ 1.722918] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1887worker1 # [ 1.743841] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1888lb # [ 1.750681] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1889client # [ 1.741880] netfs: FS-Cache loaded1890worker1 # [ 1.750851] systemd[1]: modprobe@configfs.service: Deactivated successfully.1891worker1 # [ 1.752119] systemd-journald[67]: Collecting audit messages is disabled.1892lb # [ 1.760421] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1893client # [ 1.749671] 9pnet: Installing 9P2000 support1894worker1 # [ 1.758525] systemd[1]: Finished Load Kernel Module configfs.1895lb # [ 1.765463] systemd[1]: modprobe@configfs.service: Deactivated successfully.1896worker2 # [ 1.732625] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1897lb # [ 1.766790] systemd-journald[67]: Collecting audit messages is disabled.1898worker1 # [ 1.761905] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1899worker2 # [ 1.749312] netfs: FS-Cache loaded1900worker1 # [ 1.765965] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1901lb # [ 1.773379] systemd[1]: Finished Load Kernel Module configfs.1902worker2 # [ 1.754363] 9pnet: Installing 9P2000 support1903lb # [ 1.778486] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1904worker1 # [ 1.774598] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1905client # [ 1.767283] systemd[1]: Starting Coldplug All udev Devices...1906worker1 # [ 1.776084] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1907lb # [ 1.783078] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1908worker2 # [ 1.765607] systemd[1]: Starting Coldplug All udev Devices...1909lb # [ 1.791196] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1910lb # [ 1.792516] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1911client # [ 1.779374] systemd-journald[67]: Collecting audit messages is disabled.1912client # [ 1.786884] systemd[1]: Finished Create List of Static Device Nodes.1913worker2 # [ 1.782612] systemd[1]: Finished Create List of Static Device Nodes.1914client # [ 1.791467] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1915worker2 # [ 1.786479] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1916worker1 # [ 1.806044] systemd[1]: Finished Load Kernel Modules.1917client # [ 1.800192] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1918worker2 # [ 1.795609] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1919client # [ 1.805185] systemd[1]: modprobe@configfs.service: Deactivated successfully.1920worker1 # [ 1.814588] systemd[1]: Starting Apply Kernel Variables...1921lb # [ 1.822601] systemd[1]: Finished Load Kernel Modules.1922worker2 # [ 1.802024] systemd[1]: modprobe@configfs.service: Deactivated successfully.1923worker2 # [ 1.803566] systemd-journald[67]: Collecting audit messages is disabled.1924client # [ 1.814193] systemd[1]: Finished Load Kernel Module configfs.1925lb # [ 1.831160] systemd[1]: Starting Apply Kernel Variables...1926worker2 # [ 1.810935] systemd[1]: Finished Load Kernel Module configfs.1927client # [ 1.818225] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1928worker1 # [ 1.828969] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1929worker2 # [ 1.813363] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1930client # [ 1.822540] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1931worker2 # [ 1.817132] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1932lb # [ 1.844072] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1933worker1 # [ 1.838801] systemd[1]: Starting Create Static Device Nodes in /dev...1934client # [ 1.831011] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1935worker2 # [ 1.824469] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1936client # [ 1.832544] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1937worker2 # [ 1.827790] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1938lb # [ 1.853572] systemd[1]: Starting Create Static Device Nodes in /dev...1939worker1 # [ 1.862045] systemd[1]: Finished Apply Kernel Variables.1940lb # [ 1.873288] systemd[1]: Finished Apply Kernel Variables.1941worker1 # [ 1.870692] systemd[1]: Started Journal Service.1942client # [ 1.864850] systemd[1]: Finished Load Kernel Modules.1943worker2 # [ 1.858143] systemd[1]: Finished Load Kernel Modules.1944worker1 # [ 1.739262] systemd-modules-load[68]: Inserted module 'dm_mod'1945worker1 # [ 1.742686] systemd-modules-load[68]: Inserted module 'virtio_balloon'1946worker1 # [ 1.744305] systemd-modules-load[68]: Inserted module 'virtio_gpu'1947lb # [ 1.885877] systemd[1]: Started Journal Service.1948client # [ 1.873610] systemd[1]: Starting Apply Kernel Variables...1949worker2 # [ 1.867749] systemd[1]: Starting Apply Kernel Variables...1950lb # [ 1.756257] systemd-modules-load[68]: Inserted module 'dm_mod'1951worker1 # [ 1.752223] systemd[1]: Finished Create Static Device Nodes in /dev.1952lb # [ 1.759905] systemd-modules-load[68]: Inserted module 'virtio_balloon'1953lb # [ 1.762075] systemd-modules-load[68]: Inserted module 'virtio_gpu'1954worker1 # [ 1.756952] systemd[1]: Reached target Preparation for Local File Systems.1955worker1 # [ 1.758176] systemd[1]: Reached target Local File Systems.1956client # [ 1.884900] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1957lb # [ 1.767127] systemd[1]: Finished Create Static Device Nodes in /dev.1958worker1 # [ 1.762100] systemd[1]: Starting Create System Files and Directories...1959lb # [ 1.771797] systemd[1]: Reached target Preparation for Local File Systems.1960worker2 # [ 1.883873] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1961lb # [ 1.774096] systemd[1]: Reached target Local File Systems.1962worker1 # [ 1.769078] systemd[1]: Starting Rule-based Manager for Device Events and Files...1963client # [ 1.894981] systemd[1]: Starting Create Static Device Nodes in /dev...1964lb # [ 1.778960] systemd[1]: Starting Create System Files and Directories...1965lb # [ 1.781469] systemd[1]: Starting Rule-based Manager for Device Events and Files...1966client # [ 1.765966] systemd-modules-load[68]: Inserted module 'dm_mod'1967worker2 # [ 1.895729] systemd[1]: Starting Create Static Device Nodes in /dev...1968client # [ 1.770944] systemd-modules-load[68]: Inserted module 'virtio_balloon'1969client # [ 1.773294] systemd-modules-load[68]: Inserted module 'virtio_gpu'1970client # [ 1.910932] systemd[1]: Started Journal Service.1971worker2 # [ 1.908202] systemd[1]: Finished Apply Kernel Variables.1972client # [ 1.784243] systemd[1]: Finished Apply Kernel Variables.1973worker1 # [ 1.797232] systemd[1]: Finished Create System Files and Directories.1974worker2 # [ 1.922066] systemd[1]: Started Journal Service.1975lb # [ 1.813227] systemd[1]: Finished Create System Files and Directories.1976worker2 # [ 1.788609] systemd-modules-load[68]: Inserted module 'dm_mod'1977client # [ 1.801204] systemd[1]: Finished Create Static Device Nodes in /dev.1978worker2 # [ 1.792733] systemd-modules-load[68]: Inserted module 'virtio_balloon'1979client # [ 1.802756] systemd[1]: Reached target Preparation for Local File Systems.1980worker2 # [ 1.793817] systemd-modules-load[68]: Inserted module 'virtio_gpu'1981client # [ 1.806064] systemd[1]: Reached target Local File Systems.1982client # [ 1.807098] systemd[1]: Starting Create System Files and Directories...1983worker1 # [ 1.820402] systemd-udevd[84]: Using default interface naming scheme 'v261'.1984client # [ 1.815074] systemd[1]: Starting Rule-based Manager for Device Events and Files...1985worker2 # [ 1.806189] systemd[1]: Finished Create Static Device Nodes in /dev.1986worker2 # [ 1.808825] systemd[1]: Reached target Preparation for Local File Systems.1987worker2 # [ 1.812065] systemd[1]: Reached target Local File Systems.1988lb # [ 1.836461] systemd-udevd[83]: Using default interface naming scheme 'v261'.1989worker2 # [ 1.813895] systemd[1]: Starting Create System Files and Directories...1990worker2 # [ 1.821076] systemd[1]: Starting Rule-based Manager for Device Events and Files...1991worker1 # [ 1.845080] systemd[1]: Started Rule-based Manager for Device Events and Files.1992client # [ 1.841068] systemd[1]: Finished Create System Files and Directories.1993lb # [ 1.862085] systemd[1]: Started Rule-based Manager for Device Events and Files.1994worker2 # [ 1.851291] systemd[1]: Finished Create System Files and Directories.1995client # [ 1.864336] systemd-udevd[83]: Using default interface naming scheme 'v261'.1996worker2 # [ 1.875301] systemd-udevd[83]: Using default interface naming scheme 'v261'.1997client # [ 1.887288] systemd[1]: Started Rule-based Manager for Device Events and Files.1998worker1 # [ 1.895765] systemd[1]: Finished Coldplug All udev Devices.1999worker1 # [ 1.898441] systemd[1]: Reached target System Initialization.2000worker1 # [ 1.899328] systemd[1]: Reached target Basic System.
loading 1,827 hidden lines…
3828worker2 # [ 10.566766] systemd[1]: Finished resolvconf update.3829worker2 # [ 10.568519] systemd[1]: Reached target Preparation for Network.3830client # [ 10.582931] network-addresses-eth1-start[579]: adding address 2001:db8:1::1/64... done3831worker2 # [ 10.574458] systemd[1]: Starting DHCP Client...3832worker2 # [ 10.577079] systemd[1]: Starting Address configuration of eth1...3833worker2 # [ 10.581600] systemd[1]: Starting Extra networking commands....3834worker2 # [ 10.586946] systemd[1]: linger-users.service: Deactivated successfully.3835client # [ 10.597640] systemd[1]: Finished Address configuration of eth1.3836worker2 # [ 10.589149] systemd[1]: Finished linger-users.service.3837client # [ 10.623660] systemd[1]: Finished Extra networking commands..3838client # [ 10.625441] systemd[1]: Reached target Network.3839client # [ 10.628331] systemd[1]: Starting Permit User Sessions...3840client # [ 10.652163] systemd[1]: Finished Permit User Sessions.3841client # [ 10.656672] systemd[1]: Started Getty on tty1.3842client # [ 10.657701] systemd[1]: Reached target Login Prompts.3843worker2 # [ 10.677797] network-addresses-eth1-start[629]: adding address 192.168.1.4/24... done3844worker2 # [ 10.696285] network-addresses-eth1-start[629]: adding address 2001:db8:1::4/64... done3845worker2 # [ 10.717927] systemd[1]: Finished Address configuration of eth1.3846worker2 # [ 10.743304] dhcpcd[637]: dhcpcd-10.3.2 starting3847worker2 # [ 10.752837] dhcpcd[692]: dev: loaded udev3848worker2 # [ 10.760696] systemd[1]: Finished Extra networking commands..3849worker2 # [ 10.762607] systemd[1]: Reached target Network.3850worker2 # [ 10.766575] systemd[1]: Starting Permit User Sessions...3851worker2 # [ 10.917491] 8021q: 802.1Q VLAN Support v1.83852worker2 # [ 10.918000] 8021q: adding VLAN 0 to HW filter on device eth13853worker2 # [ 10.797798] systemd[1]: Finished Permit User Sessions.3854worker2 # [ 10.800865] systemd[1]: Started Getty on tty1.3855worker2 # [ 10.802157] systemd[1]: Reached target Login Prompts.3856worker2 # [ 10.818247] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3857worker2 # [ 11.009321] cfg80211: Loading compiled-in X.509 certificates for regulatory database3858worker2 # [ 11.039256] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3859worker2 # [ 11.040158] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3860worker2 # [ 11.043671] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23861worker2 # [ 11.044702] cfg80211: failed to load regulatory.db3862worker2 # [ 11.098690] 8021q: adding VLAN 0 to HW filter on device eth03863worker2 # [ 10.965763] dhcpcd[692]: eth0: waiting for carrier3864worker2 # [ 10.966685] dhcpcd[692]: eth0: carrier acquired3865worker2 # [ 10.977062] dhcpcd[692]: DUID 00:01:00:01:32:42:50:c6:52:54:00:12:34:563866worker2 # [ 10.978455] dhcpcd[692]: eth0: IAID 00:12:34:563867worker2 # [ 10.979307] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:34563868client: (finished: waiting for unit network-addresses-eth1.service, in 11.87 seconds)3869client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3870client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3871lb: waiting for unit network-addresses-eth1.service3872lb: waiting for the VM to finish booting3873lb: Guest shell says: b'Spawning backdoor root shell...\n'3874lb: connected to guest root shell3875lb: (connecting took 0.00 seconds)3876lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3877lb: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3878lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3879lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3880worker1: waiting for unit network-addresses-eth1.service3881worker1: waiting for the VM to finish booting3882worker1: Guest shell says: b'Spawning backdoor root shell...\n'3883worker1: connected to guest root shell3884worker1: (connecting took 0.00 seconds)3885worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3886worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3887worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3888worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3889worker2: waiting for unit network-addresses-eth1.service3890worker2: waiting for the VM to finish booting3891worker2: Guest shell says: b'Spawning backdoor root shell...\n'3892worker2: connected to guest root shell3893worker2: (connecting took 0.00 seconds)3894worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3895worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3896worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3897worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3898lb: waiting for unit niks3.service3899worker1 # [ 11.981771] dhcpcd[694]: eth0: soliciting a DHCP lease3900worker1 # [ 12.138926] NET: Registered PF_PACKET protocol family3901worker1 # [ 12.011968] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.23902worker1 # [ 12.015410] dhcpcd[694]: eth0: probing address 10.0.2.15/243903worker2 # [ 12.073942] dhcpcd[692]: eth0: soliciting an IPv6 router3904worker2 # [ 12.077349] dhcpcd[692]: eth0: Router Advertisement from fe80::23905worker2 # [ 12.079770] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643906worker2 # [ 12.082384] dhcpcd[692]: eth0: adding route to fec0::/643907lb # [ 12.108245] postgresql-pre-start[728]: selecting default time zone ... UTC3908worker2 # [ 12.084458] dhcpcd[692]: eth0: adding default route via fe80::23909lb # [ 12.112340] postgresql-pre-start[728]: creating configuration files ... ok3910lb # [ 12.258556] dhcpcd[711]: eth0: soliciting an IPv6 router3911lb # [ 12.259374] dhcpcd[711]: eth0: Router Advertisement from fe80::23912lb # [ 12.260200] dhcpcd[711]: eth0: adding address fec0::5054:ff:fe12:3456/643913lb # [ 12.261617] dhcpcd[711]: eth0: adding route to fec0::/643914lb # [ 12.262381] dhcpcd[711]: eth0: adding default route via fe80::23915client # [ 12.324068] dhcpcd[564]: eth0: soliciting an IPv6 router3916client # [ 12.325559] dhcpcd[564]: eth0: Router Advertisement from fe80::23917client # [ 12.326509] dhcpcd[564]: eth0: adding address fec0::5054:ff:fe12:3456/643918client # [ 12.327535] dhcpcd[564]: eth0: adding route to fec0::/643919client # [ 12.328411] dhcpcd[564]: eth0: adding default route via fe80::23920lb # [ 12.343871] postgresql-pre-start[728]: running bootstrap script ... ok3921client # [ 12.360304] dhcpcd[564]: eth0: soliciting a DHCP lease3922client # [ 12.517822] NET: Registered PF_PACKET protocol family3923client # [ 12.390660] dhcpcd[564]: eth0: offered 10.0.2.15 from 10.0.2.23924client # [ 12.394349] dhcpcd[564]: eth0: probing address 10.0.2.15/243925worker2 # [ 12.542394] dhcpcd[692]: eth0: soliciting a DHCP lease3926worker1 # [ 12.570589] dhcpcd[694]: eth0: soliciting an IPv6 router3927worker1 # [ 12.571680] dhcpcd[694]: eth0: Router Advertisement from fe80::23928worker1 # [ 12.572660] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/643929worker1 # [ 12.573540] dhcpcd[694]: eth0: adding route to fec0::/643930worker1 # [ 12.574298] dhcpcd[694]: eth0: adding default route via fe80::23931worker2 # [ 12.699919] NET: Registered PF_PACKET protocol family3932worker2 # [ 12.571795] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.23933worker2 # [ 12.576284] dhcpcd[692]: eth0: probing address 10.0.2.15/243934lb # [ 12.914087] postgresql-pre-start[728]: performing post-bootstrap initialization ... ok3935lb # [ 13.038159] postgresql-pre-start[728]: syncing data to disk ... ok3936lb # [ 13.039891] postgresql-pre-start[728]: initdb: warning: enabling "trust" authentication for local connections3937lb # [ 13.041082] postgresql-pre-start[728]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3938lb # [ 13.042851] postgresql-pre-start[728]: Success. You can now start the database server using:3939lb # [ 13.043836] postgresql-pre-start[728]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3940lb # [ 13.137154] postgres[793]: [793] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3941lb # [ 13.141279] postgres[793]: [793] LOG: listening on IPv6 address "::1", port 54323942lb # [ 13.142262] postgres[793]: [793] LOG: listening on IPv4 address "127.0.0.1", port 54323943lb # [ 13.144255] postgres[793]: [793] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3944lb # [ 13.155847] postgres[802]: [802] LOG: database system was shut down at 2026-09-20 08:07:36 GMT3945lb # [ 13.159933] postgres[793]: [793] LOG: database system is ready to accept connections3946lb # [ 13.163851] systemd[1]: Started PostgreSQL Server.3947lb # [ 13.170327] systemd[1]: Starting PostgreSQL Setup Scripts...3948lb # [ 13.331084] postgresql-setup-start[813]: CREATE DATABASE3949lb # [ 13.374986] postgresql-setup-start[818]: CREATE ROLE3950lb # [ 13.392718] postgresql-setup-start[820]: ALTER DATABASE3951lb # [ 13.397717] systemd[1]: Finished PostgreSQL Setup Scripts.3952lb # [ 13.399396] systemd[1]: Reached target PostgreSQL.3953lb # [ 15.426680] dhcpcd[711]: eth0: leased 10.0.2.15 for 86400 seconds3954lb # [ 15.429484] dhcpcd[711]: eth0: adding route to 10.0.2.0/243955lb # [ 15.431716] dhcpcd[711]: eth0: adding default route via 10.0.2.23956lb # [ 15.548954] systemd[1]: Started DHCP Client.3957lb # [ 15.550943] systemd[1]: Reached target Network is Online.3958lb # [ 15.555065] systemd[1]: Started Envoy reverse proxy.3959lb # [ 15.557977] systemd[1]: Started mock-oidc.service.3960lb # [ 15.650772] mock-oidc-server[902]: Mock OIDC Server running3961lb # [ 15.652146] mock-oidc-server[902]: OIDC Address: 192.168.1.2:80803962lb # [ 15.653458] mock-oidc-server[902]: Issue Address: 0.0.0.0:80813963lb # [ 15.654516] mock-oidc-server[902]: Issuer: http://192.168.1.2:8080/oidc3964lb # [ 15.655538] mock-oidc-server[902]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3965lb # [ 15.656768] mock-oidc-server[902]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3966lb # [ 15.658362] mock-oidc-server[902]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3967lb # [ 16.108943] envoy[901]: [2026-09-20 08:07:40.172][901][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3968lb # [ 16.111087] envoy[901]: [2026-09-20 08:07:40.175][901][info][main] [source/server/server.cc:469] statically linked extensions:3969lb # [ 16.112644] envoy[901]: [2026-09-20 08:07:40.176][901][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3970lb # [ 16.114563] envoy[901]: [2026-09-20 08:07:40.176][901][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3971lb # [ 16.116643] envoy[901]: [2026-09-20 08:07:40.176][901][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3972lb # [ 16.119070] envoy[901]: [2026-09-20 08:07:40.176][901][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3973lb # [ 16.121469] envoy[901]: [2026-09-20 08:07:40.176][901][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3974lb # [ 16.123253] envoy[901]: [2026-09-20 08:07:40.176][901][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3975lb # [ 16.125820] envoy[901]: [2026-09-20 08:07:40.178][901][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3976lb # [ 16.128293] envoy[901]: [2026-09-20 08:07:40.178][901][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23977lb # [ 16.129794] envoy[901]: [2026-09-20 08:07:40.178][901][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3978lb # [ 16.133694] envoy[901]: [2026-09-20 08:07:40.178][901][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3979lb # [ 16.168548] envoy[901]: [2026-09-20 08:07:40.178][901][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3980lb # [ 16.173375] envoy[901]: [2026-09-20 08:07:40.180][901][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3981lb # [ 16.176114] envoy[901]: [2026-09-20 08:07:40.180][901][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3982lb # [ 16.178672] envoy[901]: [2026-09-20 08:07:40.183][901][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3983lb # [ 16.180888] envoy[901]: [2026-09-20 08:07:40.185][901][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3984lb # [ 16.184607] envoy[901]: [2026-09-20 08:07:40.185][901][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3985lb # [ 16.186671] envoy[901]: [2026-09-20 08:07:40.185][901][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3986lb # [ 16.189551] envoy[901]: [2026-09-20 08:07:40.185][901][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3987lb # [ 16.191537] envoy[901]: [2026-09-20 08:07:40.185][901][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83988lb # [ 16.193312] envoy[901]: [2026-09-20 08:07:40.185][901][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3989lb # [ 16.195204] envoy[901]: [2026-09-20 08:07:40.185][901][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3990lb # [ 16.197254] envoy[901]: [2026-09-20 08:07:40.187][901][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3991lb # [ 16.203289] envoy[901]: [2026-09-20 08:07:40.187][901][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3992lb # [ 16.205288] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3993lb # [ 16.206976] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3994lb # [ 16.208707] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3995lb # [ 16.210834] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3996lb # [ 16.212448] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3997lb # [ 16.214473] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3998lb # [ 16.216275] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3999lb # [ 16.218624] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4000lb # [ 16.221271] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4001lb # [ 16.222938] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4002lb # [ 16.229091] envoy[901]: [2026-09-20 08:07:40.190][901][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4003lb # [ 16.232103] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4004lb # [ 16.234861] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4005lb # [ 16.238344] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4006lb # [ 16.240688] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4007lb # [ 16.242478] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4008lb # [ 16.245118] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4009lb # [ 16.246846] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4010lb # [ 16.253363] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4011lb # [ 16.255096] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4012lb # [ 16.256860] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4013lb # [ 16.261065] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4014lb # [ 16.263033] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4015lb # [ 16.265050] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4016lb # [ 16.267919] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4017lb # [ 16.269590] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4018lb # [ 16.272692] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4019lb # [ 16.277451] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4020lb # [ 16.279401] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4021lb # [ 16.282105] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4022lb # [ 16.283810] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4023lb # [ 16.285496] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4024lb # [ 16.288309] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4025lb # [ 16.290489] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4026lb # [ 16.295807] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4027lb # [ 16.298072] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4028lb # [ 16.300203] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4029lb # [ 16.305039] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4030lb # [ 16.307091] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4031lb # [ 16.311825] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4032lb # [ 16.313666] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4033lb # [ 16.316177] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4034lb # [ 16.319437] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24035lb # [ 16.321622] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4036lb # [ 16.325626] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4037lb # [ 16.328097] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4038lb # [ 16.330279] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4039lb # [ 16.332774] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4040lb # [ 16.335120] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4041lb # [ 16.337701] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4042lb # [ 16.339365] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4043lb # [ 16.341236] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4044lb # [ 16.344041] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4045lb # [ 16.345562] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24046lb # [ 16.347209] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4047lb # [ 16.349443] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4048lb # [ 16.351066] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4049lb # [ 16.353834] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4050lb # [ 16.355676] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4051lb # [ 16.362779] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4052lb # [ 16.364575] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4053lb # [ 16.375870] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4054lb # [ 16.380122] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4055lb # [ 16.382781] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4056lb # [ 16.386087] envoy[901]: [2026-09-20 08:07:40.192][901][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4057lb # [ 16.388536] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4058lb # [ 16.390149] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14059lb # [ 16.392390] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4060lb # [ 16.395075] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4061lb # [ 16.397558] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4062lb # [ 16.403918] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4063lb # [ 16.406344] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4064lb # [ 16.415277] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4065lb # [ 16.421668] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4066lb # [ 16.423767] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4067lb # [ 16.425590] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4068lb # [ 16.427642] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4069lb # [ 16.429766] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4070lb # [ 16.432808] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4071lb # [ 16.434845] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4072worker1 # [ 16.428685] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds4073lb # [ 16.436502] envoy[901]: [2026-09-20 08:07:40.224][901][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4074lb # [ 16.439060] envoy[901]: [2026-09-20 08:07:40.341][901][info][main] [source/server/server.cc:531] HTTP header map info:4075worker1 # [ 16.432882] dhcpcd[694]: eth0: adding route to 10.0.2.0/244076worker1 # [ 16.435375] dhcpcd[694]: eth0: adding default route via 10.0.2.24077lb # [ 16.440701] envoy[901]: [2026-09-20 08:07:40.371][901][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4078lb # [ 16.453429] envoy[901]: [2026-09-20 08:07:40.371][901][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4079lb # [ 16.454961] envoy[901]: [2026-09-20 08:07:40.371][901][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4080lb # [ 16.463944] envoy[901]: [2026-09-20 08:07:40.371][901][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4081lb # [ 16.500233] envoy[901]: [2026-09-20 08:07:40.564][901][info][main] [source/server/server.cc:968] runtime: {}4082lb # [ 16.506542] envoy[901]: [2026-09-20 08:07:40.570][901][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4083lb # [ 16.508635] envoy[901]: [2026-09-20 08:07:40.573][901][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014084lb # [ 16.511631] envoy[901]: [2026-09-20 08:07:40.575][901][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014085lb # [ 16.514398] envoy[901]: [2026-09-20 08:07:40.578][901][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4086lb # [ 16.516236] envoy[901]: [2026-09-20 08:07:40.580][901][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4087lb # [ 16.517804] envoy[901]: [2026-09-20 08:07:40.580][901][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4088worker1 # [ 16.554680] systemd[1]: Started DHCP Client.4089worker1 # [ 16.556712] systemd[1]: Reached target Multi-User System.4090lb # [ 16.564078] envoy[901]: [2026-09-20 08:07:40.628][901][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4091worker1 # [ 16.560692] systemd[1]: Starting Nix worker-protocol over gRPC...4092worker2 # [ 16.548758] systemd[1]: Starting Nix worker-protocol over gRPC...4093lb # [ 16.587150] envoy[901]: [2026-09-20 08:07:40.651][901][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4094lb # [ 16.589489] envoy[901]: [2026-09-20 08:07:40.653][901][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4095lb # [ 16.592284] envoy[901]: [2026-09-20 08:07:40.656][901][info][main] [source/server/server.cc:1077] starting main dispatch loop4096worker1 # [ 16.760493] nix-grpc-daemon[785]: ts=2026-09-20T08:07:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4097worker1 # [ 16.773031] nix-grpc-daemon[785]: ts=2026-09-20T08:07:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14098worker2 # [ 16.775492] nix-grpc-daemon[728]: ts=2026-09-20T08:07:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4099worker2 # [ 16.786747] nix-grpc-daemon[728]: ts=2026-09-20T08:07:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14100worker1 # [ 16.815331] nix-grpc-daemon[785]: ts=2026-09-20T08:07:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4101worker1 # [ 16.818337] systemd[1]: Started Nix worker-protocol over gRPC.4102worker1 # [ 16.821200] systemd[1]: Startup finished in 840ms (kernel) + 4.104s (initrd) + 11.874s (userspace) = 16.819s.4103worker2 # [ 16.824732] nix-grpc-daemon[728]: ts=2026-09-20T08:07:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4104worker2 # [ 16.828156] systemd[1]: Started Nix worker-protocol over gRPC.4105worker1 # [ 16.867136] nix-grpc-daemon[785]: ts=2026-09-20T08:07:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4106lb # [ 16.877538] envoy[901]: [2026-09-20 08:07:40.941][901][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4107lb # [ 16.882152] envoy[901]: [2026-09-20 08:07:40.946][901][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4108worker2 # [ 16.862037] nix-grpc-daemon[728]: ts=2026-09-20T08:07:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4109lb # [ 16.886511] envoy[901]: [2026-09-20 08:07:40.950][901][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4110lb # [ 16.890593] envoy[901]: [2026-09-20 08:07:40.950][901][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4111worker2 # [ 16.968661] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds4112worker2 # [ 16.971128] dhcpcd[692]: eth0: adding route to 10.0.2.0/244113worker2 # [ 16.973485] dhcpcd[692]: eth0: adding default route via 10.0.2.24114worker1 # [ 17.068703] nix-grpc-daemon[785]: ts=2026-09-20T08:07:41Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4115worker2 # [ 17.062744] nix-grpc-daemon[728]: ts=2026-09-20T08:07:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4116client # [ 17.090949] dhcpcd[564]: eth0: leased 10.0.2.15 for 86400 seconds4117client # [ 17.093814] dhcpcd[564]: eth0: adding route to 10.0.2.0/244118client # [ 17.096097] dhcpcd[564]: eth0: adding default route via 10.0.2.24119worker2 # [ 17.091688] systemd[1]: Started DHCP Client.4120worker2 # [ 17.093533] systemd[1]: Reached target Multi-User System.4121worker2 # [ 17.094662] systemd[1]: Startup finished in 859ms (kernel) + 5.032s (initrd) + 11.202s (userspace) = 17.094s.4122client # [ 17.209890] systemd[1]: Started DHCP Client.4123client # [ 17.211674] systemd[1]: Reached target Multi-User System.4124client # [ 17.212688] systemd[1]: Startup finished in 883ms (kernel) + 5.001s (initrd) + 11.327s (userspace) = 17.212s.4125worker1 # [ 17.469386] nix-grpc-daemon[785]: ts=2026-09-20T08:07:41Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4126worker2 # [ 17.463547] nix-grpc-daemon[728]: ts=2026-09-20T08:07:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4127lb # [ 17.943417] envoy[901]: conn peer=[2001:db8:1::4]:39054 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=91 tx=55 ms=184128worker1 # [ 18.273757] nix-grpc-daemon[785]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514129worker2 # [ 18.267916] nix-grpc-daemon[728]: ts=2026-09-20T08:07:41Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 18.297820] nix-grpc-daemon[785]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4131worker2 # [ 18.280764] nix-grpc-daemon[728]: ts=2026-09-20T08:07:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4132worker1 # [ 18.498968] nix-grpc-daemon[785]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514133worker2 # [ 18.486085] nix-grpc-daemon[728]: ts=2026-09-20T08:07:41Z level=info event=scheduler_connected addr=lb:500514134worker1 # [ 18.504801] nix-grpc-daemon[785]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4135worker2 # [ 18.491729] nix-grpc-daemon[728]: ts=2026-09-20T08:07:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker1 # [ 18.705901] nix-grpc-daemon[785]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 18.692410] nix-grpc-daemon[728]: ts=2026-09-20T08:07:41Z level=info event=scheduler_connected addr=lb:500514138worker2 # [ 18.695314] nix-grpc-daemon[728]: ts=2026-09-20T08:07:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4139worker1 # [ 18.710875] nix-grpc-daemon[785]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker1 # [ 18.911688] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 18.896209] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514142worker1 # [ 18.916508] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker2 # [ 18.901218] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker1 # [ 19.117443] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514145worker2 # [ 19.102262] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514146worker1 # [ 19.122058] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4147worker2 # [ 19.107576] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 19.323685] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514149worker2 # [ 19.309463] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514150worker1 # [ 19.328597] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4151worker2 # [ 19.314123] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 19.529954] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514153worker2 # [ 19.515995] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514154worker1 # [ 19.534971] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4155worker2 # [ 19.520113] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 19.735528] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 19.738084] nix-grpc-daemon[785]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 19.721063] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 19.726450] nix-grpc-daemon[728]: ts=2026-09-20T08:07:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 19.939168] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514161worker2 # [ 19.927081] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514162worker1 # [ 19.944105] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4163worker2 # [ 19.929785] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 20.144980] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514165worker2 # [ 20.130524] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514166worker2 # [ 20.132956] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4167worker1 # [ 20.149865] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 20.352785] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514169worker2 # [ 20.335874] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514170worker2 # [ 20.339824] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4171worker1 # [ 20.356894] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker2 # [ 20.537610] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 20.557345] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514174worker1 # [ 20.561257] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4175worker2 # [ 20.543331] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker2 # [ 20.743830] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 20.762484] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514178worker2 # [ 20.750192] nix-grpc-daemon[728]: ts=2026-09-20T08:07:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4179worker1 # [ 20.767334] nix-grpc-daemon[785]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 20.966900] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 20.951007] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 20.969891] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4183worker2 # [ 20.956058] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 21.171144] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514185worker2 # [ 21.157209] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514186worker1 # [ 21.176400] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4187worker2 # [ 21.162223] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 21.378949] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514189worker2 # [ 21.365305] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 21.383092] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4191worker2 # [ 21.368471] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker2 # [ 21.566173] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 21.584133] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 21.588453] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4195worker2 # [ 21.572079] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker2 # [ 21.772728] nix-grpc-daemon[728]: ts=2026-09-20T08:07:44Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 21.789413] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514198worker2 # [ 21.775816] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4199worker1 # [ 21.794316] nix-grpc-daemon[785]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker2 # [ 21.976735] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 21.995978] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514202worker2 # [ 21.981528] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4203worker1 # [ 21.999883] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker2 # [ 22.181901] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 22.201467] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514206worker2 # [ 22.186795] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4207worker1 # [ 22.205343] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker2 # [ 22.388164] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 22.407854] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514210worker2 # [ 22.392760] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4211worker1 # [ 22.411617] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker2 # [ 22.593790] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 22.612504] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 22.616566] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4215worker2 # [ 22.600390] nix-grpc-daemon[728]: ts=2026-09-20T08:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker1 # [ 22.817649] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514217worker2 # [ 22.801473] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514218worker2 # [ 22.806388] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4219worker1 # [ 22.823915] nix-grpc-daemon[785]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker1 # [ 23.023974] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514221worker2 # [ 23.007387] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514222worker1 # [ 23.029293] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker2 # [ 23.012285] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker1 # [ 23.230441] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 23.213418] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 23.235420] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4227worker2 # [ 23.218417] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 23.437923] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514229worker2 # [ 23.421100] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 23.441618] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4231worker2 # [ 23.424922] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker2 # [ 23.622701] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 23.641809] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 23.643947] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235worker2 # [ 23.627339] nix-grpc-daemon[728]: ts=2026-09-20T08:07:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker2 # [ 23.827397] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514237worker1 # [ 23.844861] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514238worker2 # [ 23.832485] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4239worker1 # [ 23.849212] nix-grpc-daemon[785]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker1 # [ 24.049977] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 24.033583] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 24.054883] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243worker2 # [ 24.038632] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker1 # [ 24.255755] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514245worker2 # [ 24.239665] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 24.260891] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4247worker2 # [ 24.244583] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 24.464249] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 24.447545] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 24.467463] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4251worker2 # [ 24.450707] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker2 # [ 24.647590] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_connected addr=lb:500514253worker1 # [ 24.664948] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514254worker2 # [ 24.652635] nix-grpc-daemon[728]: ts=2026-09-20T08:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4255worker1 # [ 24.669779] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker1 # [ 24.870145] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514257worker2 # [ 24.853608] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 24.873170] nix-grpc-daemon[785]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4259worker2 # [ 24.858583] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker1 # [ 25.074158] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 25.059943] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514262worker1 # [ 25.079159] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4263worker2 # [ 25.064936] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker1 # [ 25.280211] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514265worker2 # [ 25.266398] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 25.285494] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4267worker2 # [ 25.271918] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker1 # [ 25.488150] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 25.473507] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 25.491896] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4271worker2 # [ 25.477882] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker1 # [ 25.692555] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514273worker2 # [ 25.678912] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_connected addr=lb:500514274worker1 # [ 25.697720] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4275worker2 # [ 25.683718] nix-grpc-daemon[728]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker1 # [ 25.898542] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514277worker2 # [ 25.884702] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514278worker1 # [ 25.902876] nix-grpc-daemon[785]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4279worker2 # [ 25.889317] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4280worker1 # [ 26.103737] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514281worker1 # [ 26.107714] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4282worker2 # [ 26.090082] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514283worker2 # [ 26.094646] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4284worker1 # [ 26.308793] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514285worker2 # [ 26.295711] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 26.314555] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287worker2 # [ 26.300716] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4288worker1 # [ 26.516523] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514289worker2 # [ 26.503609] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514290worker1 # [ 26.521769] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4291worker2 # [ 26.507685] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4292worker1 # [ 26.722763] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514293worker2 # [ 26.708772] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500514294worker1 # [ 26.728209] nix-grpc-daemon[785]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4295worker2 # [ 26.715283] nix-grpc-daemon[728]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4296worker1 # [ 26.929200] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514297worker2 # [ 26.915956] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514298worker1 # [ 26.934210] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4299worker2 # [ 26.921302] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4300worker1 # [ 27.135182] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514301worker2 # [ 27.122091] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514302worker1 # [ 27.141133] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4303worker2 # [ 27.127070] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304worker1 # [ 27.342100] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514305worker2 # [ 27.328164] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514306worker1 # [ 27.346786] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4307worker2 # [ 27.333377] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4308worker1 # [ 27.548352] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514309worker2 # [ 27.535734] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514310worker1 # [ 27.554641] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4311worker2 # [ 27.540267] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4312worker1 # [ 27.755628] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514313worker2 # [ 27.740922] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500514314worker1 # [ 27.760629] nix-grpc-daemon[785]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4315worker2 # [ 27.746070] nix-grpc-daemon[728]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4316worker2 # [ 27.946549] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514317worker1 # [ 27.961622] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500514318worker2 # [ 27.948959] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4319worker1 # [ 27.967440] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4320worker2 # [ 28.149531] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514321worker1 # [ 28.168150] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500514322worker1 # [ 28.170226] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4323worker2 # [ 28.153727] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4324lb # [ 28.330374] rustfs-bucket-start[1030]: mb s3://farm4325lb # [ 28.335687] systemd[1]: Finished rustfs-bucket.service.4326lb # [ 28.341543] systemd[1]: Starting niks3 server...4327worker1 # [ 28.371355] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500514328worker2 # [ 28.354851] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514329worker1 # [ 28.376611] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4330worker2 # [ 28.359738] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4331lb # [ 28.550994] postgres[1046]: [1046] ERROR: relation "goose_db_version" does not exist at character 364332lb # [ 28.552215] postgres[1046]: [1046] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4333worker1 # [ 28.578487] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500514334worker2 # [ 28.561644] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514335worker1 # [ 28.583515] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4336lb # [ 28.592435] niks3-server[1040]: 2026/09/20 08:07:52 OK 20241026095416_initial_model.sql (21.76ms)4337worker2 # [ 28.566629] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4338lb # [ 28.595638] niks3-server[1040]: 2026/09/20 08:07:52 OK 20251210153512_drop_unused_gin_index.sql (3.23ms)4339lb # [ 28.600621] niks3-server[1040]: 2026/09/20 08:07:52 OK 20251218171726_add_pins.sql (4.91ms)4340lb # [ 28.605397] niks3-server[1040]: 2026/09/20 08:07:52 OK 20260628120000_add_object_size_and_stats.sql (4.85ms)4341lb # [ 28.610107] niks3-server[1040]: 2026/09/20 08:07:52 OK 20260905000000_add_claims.sql (3.28ms)4342lb # [ 28.614269] niks3-server[1040]: 2026/09/20 08:07:52 OK 20260920000000_drop_claims.sql (4.04ms)4343lb # [ 28.615381] niks3-server[1040]: 2026/09/20 08:07:52 goose: successfully migrated database to version: 202609200000004344lb # [ 28.620255] niks3-server[1040]: 2026/09/20 08:07:52 OK 1_commit_pending_closure.sql (6.05ms)4345lb # [ 28.622719] niks3-server[1040]: 2026/09/20 08:07:52 OK 2_object_stats_trigger.sql (1.32ms)4346lb # [ 28.623910] niks3-server[1040]: 2026/09/20 08:07:52 goose: up to current file version: 24347lb # [ 28.629980] niks3-server[1040]: 2026/09/20 08:07:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4348lb # [ 28.700894] niks3-server[1040]: 2026/09/20 08:07:52 INFO Read proxy enabled — serving cache objects from S34349lb # [ 28.702863] niks3-server[1040]: 2026/09/20 08:07:52 INFO Using socket-activated listener address=0.0.0.0:57514350lb # [ 28.706703] systemd[1]: Started niks3 server.4351lb # [ 28.707631] niks3-server[1040]: 2026/09/20 08:07:52 INFO systemd watchdog enabled interval=15s4352lb # [ 28.710353] systemd[1]: Reached target Multi-User System.4353lb # [ 28.712059] systemd[1]: Startup finished in 845ms (kernel) + 3.997s (initrd) + 23.867s (userspace) = 28.711s.4354lb # [ 28.715112] niks3-server[1040]: 2026/09/20 08:07:52 INFO Starting HTTP server address=0.0.0.0:57514355lb # [ 28.720059] niks3-server[1040]: 2026/09/20 08:07:52 INFO lead: acquired remote=192.168.1.4:550904356worker2 # [ 28.705138] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_take_over4357worker1 # [ 28.784517] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500514358worker2 # [ 28.767618] nix-grpc-daemon[728]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500514359worker1 # [ 28.789348] nix-grpc-daemon[785]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4360worker2 # [ 28.774144] nix-grpc-daemon[728]: ts=2026-09-20T08:07:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04361lb: (finished: waiting for unit niks3.service, in 17.42 seconds)4362lb: waiting for TCP port 5751 on localhost4363worker1 # [ 28.990460] nix-grpc-daemon[785]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500514364worker2 # [ 28.974771] nix-grpc-daemon[728]: ts=2026-09-20T08:07:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04365lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4366lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4367lb: waiting for unit envoy.service4368lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4369lb: waiting for TCP port 50051 on localhost4370lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4371lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4372lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4373??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4374 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284375lb: must succeed: curl -sf localhost:9901/clusters4376lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4377lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4378subtest: one node schedules and both builders hold a WorkerSession on it4379lb: must succeed: curl -sf localhost:9901/clusters4380lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4381worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4382worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4383(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.13 seconds)4384subtest: balancer auth: client cert, bearer token, nothing, unknown CN4385worker1 # [ 29.769341] nix-grpc-daemon[785]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:424404386worker1 # [ 29.781538] systemd[1]: Started Nix Daemon.4387worker1 # [ 30.008057] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4388worker1 # [ 30.057584] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5)4389worker1 # [ 30.141377] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 2/5)4390worker1 # [ 30.281125] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 274 ms (attempt 3/5)4391worker1 # [ 30.560653] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 747 ms (attempt 4/5)4392worker1 # [ 31.316089] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4393worker1 # [ 31.350782] nix-grpc-daemon[785]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:424404394worker1 # [ 31.368217] nix-grpc-daemon[785]: ts=2026-09-20T08:07:55Z level=debug event=path_info_miss path=3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test error="error: path '/nix/store/3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test' is required, but there is no substituter that can build it"4395worker2 # [ 31.366978] nix-grpc-daemon[728]: ts=2026-09-20T08:07:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:578984396worker2 # [ 31.378836] systemd[1]: Started Nix Daemon.4397worker2 # [ 31.580922] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4398worker2 # [ 31.608390] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5)4399worker2 # [ 31.709945] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 2/5)4400worker2 # [ 31.804771] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 383 ms (attempt 3/5)4401worker2 # [ 32.193564] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 391 ms (attempt 4/5)4402worker2 # [ 32.597738] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4403worker2 # [ 32.616283] nix-grpc-daemon[728]: ts=2026-09-20T08:07:55Z level=debug event=path_info_miss path=3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test error="error: path '/nix/store/3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test' is required, but there is no substituter that can build it"4404client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4405client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4406client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4407client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4408worker2 # [ 32.971528] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=info event=oidc_jwks provider=mock keys=14409worker2 # [ 32.973753] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:578984410worker2 # [ 32.986485] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:578984411worker2 # [ 32.991421] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=path_info_miss path=3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test error="error: path '/nix/store/3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test' is required, but there is no substituter that can build it"4412worker2 # [ 32.995097] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:578984413worker2 # [ 33.000261] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=path_info_miss path=3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test error="error: path '/nix/store/3m2ahp8i50324ccf0gkhmn21dd1bfkag-nixos-system-client-test' is required, but there is no substituter that can build it"4414client: must succeed: rm -r /var/lib/nix-grpc-store4415client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds)4416worker1 # [ 33.221160] nix-grpc-daemon[785]: ts=2026-09-20T08:07:57Z level=info event=denied method=QueryMissing cn=- role=none4417worker1 # [ 33.407174] nix-grpc-daemon[785]: ts=2026-09-20T08:07:57Z level=info event=denied method=QueryMissing cn=stranger role=none4418(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.93 seconds)4419subtest: DAG build is scheduled across workers and lands in the cache4420client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24421worker1 # [ 33.655687] nix-grpc-daemon[785]: ts=2026-09-20T08:07:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:424404422client # don't know how to build these paths:4423client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4424worker2 # [ 33.671738] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04425worker2 # [ 33.677535] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14426worker2 # [ 33.718374] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984427worker2 # [ 33.739974] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578984428client # copying 1 paths to 'lb:50051'...4429worker2 # [ 33.753153] nix-grpc-daemon[728]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578984430client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4431worker2 # [ 33.781278] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4432worker2 # [ 33.807467] nix-grpc-daemon[728]: ts=2026-09-20T08:07:57Z level=info event=niks3_push_started pid=8594433worker2 # [ 34.249088] nix-daemon[847]: accepted connection from pid 870, user nix-grpc-daemon (trusted)4434worker2 # [ 34.264266] nix-daemon[847]: reaped child process 874, status = succeeded4435worker2 # [ 34.441864] nix-daemon[847]: accepted connection from pid 876, user nix-grpc-daemon (trusted)4436worker2 # [ 34.453753] nix-daemon[847]: reaped child process 879, status = succeeded4437lb # [ 34.489892] niks3-server[1040]: 2026/09/20 08:07:58 INFO Received uploads request method=POST path=/api/pending_closures4438worker2 # [ 34.484459] nix-grpc-daemon[859]: time=2026-09-20T08:07:57.709Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4439worker2 # [ 34.487142] nix-grpc-daemon[859]: time=2026-09-20T08:07:57.712Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4440lb # [ 34.532078] niks3-server[1040]: 2026/09/20 08:07:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4441lb # [ 34.538965] niks3-server[1040]: 2026/09/20 08:07:58 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4442lb # [ 34.554904] niks3-server[1040]: 2026/09/20 08:07:58 INFO Signed narinfos id=1 count=14443worker2 # [ 34.533949] nix-grpc-daemon[859]: time=2026-09-20T08:07:57.760Z level=INFO msg="Uploading 1 narinfos"4444lb # [ 34.565536] niks3-server[1040]: 2026/09/20 08:07:58 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4445lb # [ 34.567980] niks3-server[1040]: 2026/09/20 08:07:58 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4446lb # [ 34.576595] niks3-server[1040]: 2026/09/20 08:07:58 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4447lb # [ 34.581684] niks3-server[1040]: 2026/09/20 08:07:58 INFO Completed upload id=14448worker2 # [ 34.559152] nix-grpc-daemon[859]: time=2026-09-20T08:07:57.785Z level=INFO msg="Upload complete. (483ms)"4449worker2 # [ 34.564141] nix-grpc-daemon[728]: ts=2026-09-20T08:07:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_in=5044450worker2 # [ 34.569367] nix-grpc-daemon[728]: ts=2026-09-20T08:07:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984451worker2 # [ 34.580245] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4452worker2 # [ 34.586098] nix-daemon[847]: reaped child process 857, status = succeeded4453client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4454worker2 # [ 34.589734] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4455client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4456client # farm-a> LOG-farm-a-t14457worker2 # [ 36.002869] nix-daemon[847]: reaped child process 883, status = succeeded4458worker2 # [ 36.132286] nix-daemon[847]: accepted connection from pid 899, user nix-grpc-daemon (trusted)4459worker2 # [ 36.143987] nix-daemon[847]: reaped child process 902, status = succeeded4460lb # [ 36.179280] niks3-server[1040]: 2026/09/20 08:08:00 INFO Received uploads request method=POST path=/api/pending_closures4461worker2 # [ 36.167465] nix-grpc-daemon[859]: time=2026-09-20T08:07:59.393Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4462worker2 # [ 36.169083] nix-grpc-daemon[859]: time=2026-09-20T08:07:59.395Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4463lb # [ 36.228317] niks3-server[1040]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4464lb # [ 36.234556] niks3-server[1040]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4465lb # [ 36.246389] niks3-server[1040]: 2026/09/20 08:08:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4466lb # [ 36.253198] niks3-server[1040]: 2026/09/20 08:08:00 INFO Signed narinfos id=2 count=14467worker2 # [ 36.231136] nix-grpc-daemon[859]: time=2026-09-20T08:07:59.456Z level=INFO msg="Uploading 1 narinfos"4468lb # [ 36.255762] niks3-server[1040]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4469lb # [ 36.265884] niks3-server[1040]: 2026/09/20 08:08:00 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4470lb # [ 36.273442] niks3-server[1040]: 2026/09/20 08:08:00 INFO Completed upload id=24471worker2 # [ 36.250621] nix-grpc-daemon[859]: time=2026-09-20T08:07:59.476Z level=INFO msg="Upload complete. (252ms)"4472lb # [ 36.275087] niks3-server[1040]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4473worker2 # [ 36.259409] nix-grpc-daemon[728]: ts=2026-09-20T08:07:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14474worker2 # [ 36.276821] nix-grpc-daemon[728]: ts=2026-09-20T08:07:59Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04475worker2 # [ 36.278947] nix-grpc-daemon[728]: ts=2026-09-20T08:07:59Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14476worker2 # [ 36.282143] nix-daemon[847]: reaped child process 881, status = succeeded4477worker2 # [ 36.327326] nix-grpc-daemon[728]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984478worker2 # [ 36.339515] nix-grpc-daemon[728]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578984479worker2 # [ 36.352754] nix-grpc-daemon[859]: time=2026-09-20T08:07:59.579Z level=INFO msg="All 1 paths already cached"4480client # copying 1 paths to 'lb:50051'...4481worker2 # [ 36.360433] nix-grpc-daemon[728]: ts=2026-09-20T08:07:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578984482client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4483worker2 # [ 36.379315] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4484lb # [ 36.573215] envoy[901]: conn peer=[::1]:49860 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34485lb # [ 36.576331] envoy[901]: conn peer=[2001:db8:1::1]:36708 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=29234486lb # [ 36.579754] envoy[901]: conn peer=[2001:db8:1::1]:46684 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=514487worker2 # [ 36.559809] nix-daemon[847]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4488lb # [ 36.583233] envoy[901]: conn peer=[2001:db8:1::1]:46686 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94489lb # [ 36.586405] envoy[901]: conn peer=[2001:db8:1::1]:46698 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=94490worker2 # [ 36.586725] nix-daemon[847]: reaped child process 911, status = succeeded4491worker2 # [ 36.739659] nix-daemon[847]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4492worker2 # [ 36.751873] nix-daemon[847]: reaped child process 917, status = succeeded4493lb # [ 36.786957] niks3-server[1040]: 2026/09/20 08:08:00 INFO Received uploads request method=POST path=/api/pending_closures4494worker2 # [ 36.775094] nix-grpc-daemon[859]: time=2026-09-20T08:08:00.001Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4495worker2 # [ 36.776565] nix-grpc-daemon[859]: time=2026-09-20T08:08:00.002Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4496lb # [ 36.818194] niks3-server[1040]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4497lb # [ 36.829056] niks3-server[1040]: 2026/09/20 08:08:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4498lb # [ 36.836058] niks3-server[1040]: 2026/09/20 08:08:00 INFO Signed narinfos id=3 count=14499worker2 # [ 36.816131] nix-grpc-daemon[859]: time=2026-09-20T08:08:00.042Z level=INFO msg="Uploading 1 narinfos"4500lb # [ 36.839585] niks3-server[1040]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4501lb # [ 36.852503] niks3-server[1040]: 2026/09/20 08:08:00 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4502lb # [ 36.859232] niks3-server[1040]: 2026/09/20 08:08:00 INFO Completed upload id=34503worker2 # [ 36.836586] nix-grpc-daemon[859]: time=2026-09-20T08:08:00.062Z level=INFO msg="Upload complete. (442ms)"4504lb # [ 36.861889] niks3-server[1040]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4505worker2 # [ 36.840063] nix-grpc-daemon[728]: ts=2026-09-20T08:08:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_in=6244506worker2 # [ 36.845357] nix-grpc-daemon[728]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984507worker2 # [ 36.853495] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4508worker2 # [ 36.861150] nix-daemon[847]: reaped child process 906, status = succeeded4509worker2 # [ 36.864931] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4510client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4511client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4512client # farm-b> LOG-farm-b-t14513worker2 # [ 38.091801] nix-daemon[847]: reaped child process 921, status = succeeded4514worker2 # [ 38.239721] nix-daemon[847]: accepted connection from pid 936, user nix-grpc-daemon (trusted)4515worker2 # [ 38.250861] nix-daemon[847]: reaped child process 939, status = succeeded4516lb # [ 38.288926] niks3-server[1040]: 2026/09/20 08:08:02 INFO Received uploads request method=POST path=/api/pending_closures4517worker2 # [ 38.410343] nix-grpc-daemon[859]: time=2026-09-20T08:08:01.635Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4518worker2 # [ 38.416626] nix-grpc-daemon[859]: time=2026-09-20T08:08:01.640Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4519lb # [ 38.472471] niks3-server[1040]: 2026/09/20 08:08:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4520lb # [ 38.479177] niks3-server[1040]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4521lb # [ 38.487094] niks3-server[1040]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4522lb # [ 38.492988] niks3-server[1040]: 2026/09/20 08:08:02 INFO Signed narinfos id=4 count=14523lb # [ 38.495858] niks3-server[1040]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4524worker2 # [ 38.473479] nix-grpc-daemon[859]: time=2026-09-20T08:08:01.699Z level=INFO msg="Uploading 1 narinfos"4525lb # [ 38.506420] niks3-server[1040]: 2026/09/20 08:08:02 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4526lb # [ 38.510066] niks3-server[1040]: 2026/09/20 08:08:02 INFO Completed upload id=44527lb # [ 38.512727] niks3-server[1040]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4528worker2 # [ 38.488641] nix-grpc-daemon[859]: time=2026-09-20T08:08:01.714Z level=INFO msg="Upload complete. (416ms)"4529worker2 # [ 38.498442] nix-grpc-daemon[728]: ts=2026-09-20T08:08:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14530worker2 # [ 38.507186] nix-grpc-daemon[728]: ts=2026-09-20T08:08:01Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04531worker2 # [ 38.512217] nix-grpc-daemon[728]: ts=2026-09-20T08:08:01Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14532worker2 # [ 38.522652] nix-daemon[847]: reaped child process 919, status = succeeded4533worker2 # [ 38.549151] nix-grpc-daemon[728]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984534worker2 # [ 38.559570] nix-grpc-daemon[728]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578984535worker2 # [ 38.573895] nix-grpc-daemon[859]: time=2026-09-20T08:08:01.800Z level=INFO msg="All 2 paths already cached"4536client # copying 1 paths to 'lb:50051'...4537client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4538worker2 # [ 38.581950] nix-grpc-daemon[728]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578984539worker2 # [ 38.596155] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4540worker2 # [ 38.751495] nix-daemon[847]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4541worker2 # [ 38.763659] nix-daemon[847]: reaped child process 948, status = succeeded4542worker2 # [ 38.919752] nix-daemon[847]: accepted connection from pid 950, user nix-grpc-daemon (trusted)4543worker2 # [ 38.933577] nix-daemon[847]: reaped child process 953, status = succeeded4544lb # [ 38.970641] niks3-server[1040]: 2026/09/20 08:08:03 INFO Received uploads request method=POST path=/api/pending_closures4545worker2 # [ 38.958536] nix-grpc-daemon[859]: time=2026-09-20T08:08:02.184Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4546worker2 # [ 38.960424] nix-grpc-daemon[859]: time=2026-09-20T08:08:02.186Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4547lb # [ 39.005791] niks3-server[1040]: 2026/09/20 08:08:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4548lb # [ 39.010918] niks3-server[1040]: 2026/09/20 08:08:03 INFO Signed narinfos id=5 count=14549worker2 # [ 38.991060] nix-grpc-daemon[859]: time=2026-09-20T08:08:02.217Z level=INFO msg="Uploading 1 narinfos"4550lb # [ 39.016133] niks3-server[1040]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4551lb # [ 39.026100] niks3-server[1040]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4552lb # [ 39.039649] niks3-server[1040]: 2026/09/20 08:08:03 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4553lb # [ 39.045939] niks3-server[1040]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4554lb # [ 39.048945] niks3-server[1040]: 2026/09/20 08:08:03 INFO Completed upload id=54555worker2 # [ 39.026489] nix-grpc-daemon[859]: time=2026-09-20T08:08:02.252Z level=INFO msg="Upload complete. (418ms)"4556worker2 # [ 39.031154] nix-grpc-daemon[728]: ts=2026-09-20T08:08:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_in=7524557worker2 # [ 39.036535] nix-grpc-daemon[728]: ts=2026-09-20T08:08:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984558worker2 # [ 39.048068] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4559worker2 # [ 39.056214] nix-daemon[847]: reaped child process 943, status = succeeded4560worker2 # [ 39.062825] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4561client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4562client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4563client # farm-top> LOG-farm-top-t14564worker2 # [ 39.876089] nix-daemon[847]: reaped child process 957, status = succeeded4565worker2 # [ 40.017049] nix-daemon[847]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4566worker2 # [ 40.029277] nix-daemon[847]: reaped child process 976, status = succeeded4567lb # [ 40.067968] niks3-server[1040]: 2026/09/20 08:08:04 INFO Received uploads request method=POST path=/api/pending_closures4568worker2 # [ 40.053815] nix-grpc-daemon[859]: time=2026-09-20T08:08:03.279Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4569worker2 # [ 40.055332] nix-grpc-daemon[859]: time=2026-09-20T08:08:03.281Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4570lb # [ 40.108374] niks3-server[1040]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4571lb # [ 40.122059] niks3-server[1040]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4572lb # [ 40.134413] niks3-server[1040]: 2026/09/20 08:08:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4573lb # [ 40.139044] niks3-server[1040]: 2026/09/20 08:08:04 INFO Signed narinfos id=6 count=14574worker2 # [ 40.118984] nix-grpc-daemon[859]: time=2026-09-20T08:08:03.345Z level=INFO msg="Uploading 1 narinfos"4575lb # [ 40.144126] niks3-server[1040]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4576lb # [ 40.152601] niks3-server[1040]: 2026/09/20 08:08:04 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4577lb # [ 40.155624] niks3-server[1040]: 2026/09/20 08:08:04 INFO Completed upload id=64578worker2 # [ 40.132930] nix-grpc-daemon[859]: time=2026-09-20T08:08:03.359Z level=INFO msg="Upload complete. (264ms)"4579lb # [ 40.157367] niks3-server[1040]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4580worker2 # [ 40.135396] nix-grpc-daemon[728]: ts=2026-09-20T08:08:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14581worker2 # [ 40.142548] nix-daemon[847]: reaped child process 955, status = succeeded4582client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.75 seconds)4583client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4584client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4585client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4586client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4587client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4588client # copying 3 paths...4589client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4590client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4591client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4592client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.29 seconds)4593(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.33 seconds)4594subtest: repeat is answered Cached by the scheduler without building4595worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4596worker1 # finding garbage collector roots...4597worker1 # deleting specified paths...4598worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4599worker1 # deleting unused links...4600worker1 # note: hard linking is currently saving 0.0 KiB4601worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4602worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4603worker2 # finding garbage collector roots...4604worker2 # deleting specified paths...4605worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4606worker2 # deleting unused links...4607worker2 # note: hard linking is currently saving 0.0 KiB4608worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4609client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24610worker1 # [ 41.513723] nix-grpc-daemon[785]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:424404611client # don't know how to build these paths:4612client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4613worker2 # [ 41.514746] nix-grpc-daemon[728]: ts=2026-09-20T08:08:04Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14614worker2 # [ 41.526548] nix-grpc-daemon[728]: ts=2026-09-20T08:08:04Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14615worker2 # [ 41.537748] nix-grpc-daemon[728]: ts=2026-09-20T08:08:04Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14616client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.29 seconds)4617client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4618client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4619lb: must succeed: curl -sf localhost:9901/clusters4620lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4621lb: must succeed: curl -sf localhost:9901/clusters4622lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4623worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4624worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.06 seconds)4625(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.27 seconds)4626subtest: two clients wanting the same drv build it once4627client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4628client # [ 42.065380] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4629client # Running as unit: dedup1.service; invocation ID: 61f16b95561b4d5d8c8e7ba76889bb614630client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.05 seconds)4631client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4632worker1 # [ 42.275154] nix-grpc-daemon[785]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:424404633client # [ 42.273148] nix[871]: don't know how to build these paths:4634client # [ 42.274042] nix[871]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4635worker2 # [ 42.271184] nix-grpc-daemon[728]: ts=2026-09-20T08:08:05Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04636worker2 # [ 42.275536] nix-grpc-daemon[728]: ts=2026-09-20T08:08:05Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14637worker1 # [ 42.300797] nix-grpc-daemon[785]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:424404638worker1 # [ 42.317384] nix-grpc-daemon[785]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:424404639client # [ 42.319151] nix[871]: copying 1 paths to 'lb:50051'...4640client # [ 42.319949] nix[871]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4641worker1 # [ 42.327787] nix-grpc-daemon[785]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:424404642worker1 # [ 42.339688] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4643worker1 # [ 42.362883] nix-grpc-daemon[785]: ts=2026-09-20T08:08:06Z level=info event=niks3_push_started pid=8694644worker1 # [ 42.820052] nix-daemon[843]: accepted connection from pid 881, user nix-grpc-daemon (trusted)4645worker1 # [ 42.836136] nix-daemon[843]: reaped child process 884, status = succeeded4646worker1 # [ 42.997275] nix-daemon[843]: accepted connection from pid 887, user nix-grpc-daemon (trusted)4647worker1 # [ 43.010457] nix-daemon[843]: reaped child process 890, status = succeeded4648lb # [ 43.031473] niks3-server[1040]: 2026/09/20 08:08:07 INFO Received uploads request method=POST path=/api/pending_closures4649worker1 # [ 43.036286] nix-grpc-daemon[869]: time=2026-09-20T08:08:07.127Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4650worker1 # [ 43.038282] nix-grpc-daemon[869]: time=2026-09-20T08:08:07.129Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4651lb # [ 43.065726] niks3-server[1040]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4652lb # [ 43.076290] niks3-server[1040]: 2026/09/20 08:08:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4653lb # [ 43.081239] niks3-server[1040]: 2026/09/20 08:08:07 INFO Signed narinfos id=7 count=14654worker1 # [ 43.078299] nix-grpc-daemon[869]: time=2026-09-20T08:08:07.171Z level=INFO msg="Uploading 1 narinfos"4655lb # [ 43.095279] niks3-server[1040]: 2026/09/20 08:08:07 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4656lb # [ 43.102204] niks3-server[1040]: 2026/09/20 08:08:07 INFO Completed upload id=74657worker1 # [ 43.098517] nix-grpc-daemon[869]: time=2026-09-20T08:08:07.191Z level=INFO msg="Upload complete. (462ms)"4658worker1 # [ 43.100871] nix-grpc-daemon[785]: ts=2026-09-20T08:08:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=0 paths=1 nar_bytes_in=4324659lb # [ 43.107736] niks3-server[1040]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4660lb # [ 43.112206] niks3-server[1040]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4661worker1 # [ 43.108091] nix-grpc-daemon[785]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:424404662worker1 # [ 43.111565] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4663worker1 # [ 43.113880] nix-daemon[843]: reaped child process 867, status = succeeded4664worker1 # [ 43.119469] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4665client # [ 43.110917] nix[871]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4666client # [ 43.143147] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4667client # Running as unit: dedup2.service; invocation ID: d24be56142f24119847b8a21abe97dd04668client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4669client # [ 43.401138] nix[888]: don't know how to build these paths:4670client # [ 43.402112] nix[888]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4671worker2 # [ 43.391322] nix-grpc-daemon[728]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:578984672worker2 # [ 43.401376] nix-grpc-daemon[728]: ts=2026-09-20T08:08:06Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04673worker1 # [ 43.423740] nix-grpc-daemon[785]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:424404674client # [ 43.421059] nix[888]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4675client: must succeed: sleep 24676client: (finished: must succeed: sleep 2, in 2.05 seconds)4677worker1 # [ 46.535805] nix-daemon[843]: reaped child process 894, status = succeeded4678??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4679 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394680client: waiting for success: ! systemctl is-active dedup1 dedup24681??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4682 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394683lb # [ 46.573857] envoy[901]: conn peer=[2001:db8:1::1]:46704 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9342 tx=3759 ms=65474684lb # [ 46.575651] envoy[901]: conn peer=[2001:db8:1::1]:46710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=564685worker1 # [ 46.673889] nix-daemon[843]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4686worker1 # [ 46.684701] nix-daemon[843]: reaped child process 926, status = succeeded4687lb # [ 46.706285] niks3-server[1040]: 2026/09/20 08:08:10 INFO Received uploads request method=POST path=/api/pending_closures4688worker1 # [ 46.706569] nix-grpc-daemon[869]: time=2026-09-20T08:08:10.799Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4689worker1 # [ 46.708050] nix-grpc-daemon[869]: time=2026-09-20T08:08:10.801Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4690lb # [ 46.747804] niks3-server[1040]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4691lb # [ 46.752215] niks3-server[1040]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4692lb # [ 46.759393] niks3-server[1040]: 2026/09/20 08:08:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4693lb # [ 46.764799] niks3-server[1040]: 2026/09/20 08:08:10 INFO Signed narinfos id=8 count=14694worker1 # [ 46.762718] nix-grpc-daemon[869]: time=2026-09-20T08:08:10.855Z level=INFO msg="Uploading 1 narinfos"4695lb # [ 46.770663] niks3-server[1040]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4696lb # [ 46.775743] niks3-server[1040]: 2026/09/20 08:08:10 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4697lb # [ 46.780458] niks3-server[1040]: 2026/09/20 08:08:10 INFO Completed upload id=84698worker1 # [ 46.774687] nix-grpc-daemon[869]: time=2026-09-20T08:08:10.868Z level=INFO msg="Upload complete. (243ms)"4699lb # [ 46.781845] niks3-server[1040]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4700worker1 # [ 46.779510] nix-grpc-daemon[785]: ts=2026-09-20T08:08:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14701worker1 # [ 46.785266] nix-grpc-daemon[785]: ts=2026-09-20T08:08:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14702worker1 # [ 46.791981] nix-daemon[843]: reaped child process 892, status = succeeded4703client # [ 46.803138] systemd[1]: dedup2.service: Deactivated successfully.4704client # [ 46.805399] systemd[1]: dedup2.service: Consumed 131ms CPU time over 3.661s wall clock time, 33.2M memory peak, 7.4K incoming IP traffic, 6.3K outgoing IP traffic.4705client # [ 46.841056] systemd[1]: dedup1.service: Deactivated successfully.4706client # [ 46.842735] systemd[1]: dedup1.service: Consumed 100ms CPU time over 4.778s wall clock time, 39.3M memory peak, 8.7K incoming IP traffic, 8.9K outgoing IP traffic.4707client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4708client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4709client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4710worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4711worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4712worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4713worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4714worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4715worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4716worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4717worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4718(finished: subtest: two clients wanting the same drv build it once, in 5.89 seconds)4719subtest: build hook: nix-daemon with builders = grpc://lb4720client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4721client # [ 48.094102] systemd[1]: Started Nix Daemon.4722client # [ 48.236771] nix-daemon[930]: accepted connection from pid 927, user root (trusted)4723worker2 # [ 48.381598] nix-grpc-daemon[728]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:578984724worker2 # [ 48.386368] nix-grpc-daemon[728]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578984725worker2 # [ 48.402207] nix-grpc-daemon[728]: ts=2026-09-20T08:08:11Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04726worker2 # [ 48.407600] nix-grpc-daemon[728]: ts=2026-09-20T08:08:11Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14727worker2 # [ 48.413314] nix-grpc-daemon[728]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984728worker2 # [ 48.423860] nix-grpc-daemon[728]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578984729worker2 # [ 48.434575] nix-grpc-daemon[728]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578984730worker2 # [ 48.445405] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4731worker2 # [ 48.616389] nix-daemon[847]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4732worker2 # [ 48.630989] nix-daemon[847]: reaped child process 1037, status = succeeded4733worker2 # [ 48.789608] nix-daemon[847]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)4734worker2 # [ 48.803097] nix-daemon[847]: reaped child process 1042, status = succeeded4735lb # [ 48.841598] niks3-server[1040]: 2026/09/20 08:08:12 INFO Received uploads request method=POST path=/api/pending_closures4736worker2 # [ 48.826466] nix-grpc-daemon[859]: time=2026-09-20T08:08:12.052Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4737worker2 # [ 48.828046] nix-grpc-daemon[859]: time=2026-09-20T08:08:12.054Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4738lb # [ 48.871304] niks3-server[1040]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4739lb # [ 48.880617] niks3-server[1040]: 2026/09/20 08:08:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4740lb # [ 48.887859] niks3-server[1040]: 2026/09/20 08:08:12 INFO Signed narinfos id=9 count=14741worker2 # [ 48.868265] nix-grpc-daemon[859]: time=2026-09-20T08:08:12.094Z level=INFO msg="Uploading 1 narinfos"4742lb # [ 48.890912] niks3-server[1040]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4743lb # [ 48.904641] niks3-server[1040]: 2026/09/20 08:08:12 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4744worker2 # [ 48.889062] nix-grpc-daemon[859]: time=2026-09-20T08:08:12.115Z level=INFO msg="Upload complete. (433ms)"4745lb # [ 48.911962] niks3-server[1040]: 2026/09/20 08:08:12 INFO Completed upload id=94746worker2 # [ 48.891041] nix-grpc-daemon[728]: ts=2026-09-20T08:08:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_in=5124747lb # [ 48.915826] niks3-server[1040]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4748worker2 # [ 48.897033] nix-daemon[847]: reaped child process 1032, status = succeeded4749worker2 # [ 48.898680] nix-grpc-daemon[728]: ts=2026-09-20T08:08:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984750worker2 # [ 48.901912] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4751worker2 # [ 48.908198] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4752worker2 # [ 49.921764] nix-daemon[847]: reaped child process 1046, status = succeeded4753worker2 # [ 50.038939] nix-daemon[847]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)4754worker2 # [ 50.050085] nix-daemon[847]: reaped child process 1064, status = succeeded4755lb # [ 50.084563] niks3-server[1040]: 2026/09/20 08:08:14 INFO Received uploads request method=POST path=/api/pending_closures4756worker2 # [ 50.069969] nix-grpc-daemon[859]: time=2026-09-20T08:08:13.296Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4757worker2 # [ 50.071549] nix-grpc-daemon[859]: time=2026-09-20T08:08:13.297Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4758lb # [ 50.124580] niks3-server[1040]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4759lb # [ 50.133465] niks3-server[1040]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4760lb # [ 50.141653] niks3-server[1040]: 2026/09/20 08:08:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4761lb # [ 50.148290] niks3-server[1040]: 2026/09/20 08:08:14 INFO Signed narinfos id=10 count=14762worker2 # [ 50.128043] nix-grpc-daemon[859]: time=2026-09-20T08:08:13.354Z level=INFO msg="Uploading 1 narinfos"4763lb # [ 50.151211] niks3-server[1040]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4764lb # [ 50.161554] niks3-server[1040]: 2026/09/20 08:08:14 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4765lb # [ 50.166839] niks3-server[1040]: 2026/09/20 08:08:14 INFO Completed upload id=104766worker2 # [ 50.144207] nix-grpc-daemon[859]: time=2026-09-20T08:08:13.370Z level=INFO msg="Upload complete. (229ms)"4767lb # [ 50.169816] niks3-server[1040]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4768worker2 # [ 50.150537] nix-grpc-daemon[728]: ts=2026-09-20T08:08:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14769worker1 # [ 50.177488] nix-grpc-daemon[785]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:424404770worker2 # [ 50.163123] nix-daemon[847]: reaped child process 1044, status = succeeded4771worker1 # [ 50.190618] nix-grpc-daemon[785]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4772worker1 # [ 50.217239] nix-grpc-daemon[785]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:424404773worker1 # [ 50.219877] nix-grpc-daemon[785]: ts=2026-09-20T08:08:14Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=0 paths=1 nar_bytes_out=1284774worker2 # [ 50.417811] nix-grpc-daemon[728]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:578984775worker1 # [ 50.438111] nix-grpc-daemon[785]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:424404776worker1 # [ 50.446222] nix-grpc-daemon[869]: time=2026-09-20T08:08:14.538Z level=INFO msg="All 1 paths already cached"4777worker2 # [ 50.443195] nix-grpc-daemon[728]: ts=2026-09-20T08:08:13Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04778worker2 # [ 50.448423] nix-grpc-daemon[728]: ts=2026-09-20T08:08:13Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14779worker2 # [ 50.453947] nix-grpc-daemon[728]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984780worker2 # [ 50.465638] nix-grpc-daemon[728]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578984781worker2 # [ 50.478144] nix-grpc-daemon[859]: time=2026-09-20T08:08:13.704Z level=INFO msg="All 1 paths already cached"4782worker2 # [ 50.484725] nix-grpc-daemon[728]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578984783worker2 # [ 50.494159] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4784worker2 # [ 50.662205] nix-daemon[847]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4785worker2 # [ 50.675485] nix-daemon[847]: reaped child process 1073, status = succeeded4786worker2 # [ 50.829721] nix-daemon[847]: accepted connection from pid 1075, user nix-grpc-daemon (trusted)4787worker2 # [ 50.842626] nix-daemon[847]: reaped child process 1078, status = succeeded4788lb # [ 50.880882] niks3-server[1040]: 2026/09/20 08:08:14 INFO Received uploads request method=POST path=/api/pending_closures4789worker2 # [ 50.866142] nix-grpc-daemon[859]: time=2026-09-20T08:08:14.092Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4790worker2 # [ 50.867538] nix-grpc-daemon[859]: time=2026-09-20T08:08:14.092Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4791lb # [ 50.907971] niks3-server[1040]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4792lb # [ 50.920075] niks3-server[1040]: 2026/09/20 08:08:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4793worker2 # [ 50.902728] nix-grpc-daemon[859]: time=2026-09-20T08:08:14.128Z level=INFO msg="Uploading 1 narinfos"4794lb # [ 50.925619] niks3-server[1040]: 2026/09/20 08:08:14 INFO Signed narinfos id=11 count=14795lb # [ 50.931851] niks3-server[1040]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4796lb # [ 50.943195] niks3-server[1040]: 2026/09/20 08:08:15 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4797lb # [ 50.948630] niks3-server[1040]: 2026/09/20 08:08:15 INFO Completed upload id=114798worker2 # [ 50.925763] nix-grpc-daemon[859]: time=2026-09-20T08:08:14.151Z level=INFO msg="Upload complete. (420ms)"4799lb # [ 50.951311] niks3-server[1040]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4800worker2 # [ 50.930132] nix-grpc-daemon[728]: ts=2026-09-20T08:08:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_in=6244801worker2 # [ 50.934796] nix-grpc-daemon[728]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984802worker2 # [ 50.943946] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4803worker2 # [ 50.951119] nix-daemon[847]: reaped child process 1068, status = succeeded4804worker2 # [ 50.954433] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4805worker2 # [ 51.967429] nix-daemon[847]: reaped child process 1082, status = succeeded4806worker2 # [ 52.105489] nix-daemon[847]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4807worker2 # [ 52.117778] nix-daemon[847]: reaped child process 1100, status = succeeded4808lb # [ 52.152124] niks3-server[1040]: 2026/09/20 08:08:16 INFO Received uploads request method=POST path=/api/pending_closures4809worker2 # [ 52.138280] nix-grpc-daemon[859]: time=2026-09-20T08:08:15.363Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4810worker2 # [ 52.139628] nix-grpc-daemon[859]: time=2026-09-20T08:08:15.363Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4811lb # [ 52.189103] niks3-server[1040]: 2026/09/20 08:08:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4812lb # [ 52.192526] niks3-server[1040]: 2026/09/20 08:08:16 INFO Signed narinfos id=12 count=14813worker2 # [ 52.172220] nix-grpc-daemon[859]: time=2026-09-20T08:08:15.398Z level=INFO msg="Uploading 1 narinfos"4814lb # [ 52.199696] niks3-server[1040]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4815lb # [ 52.203685] niks3-server[1040]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4816lb # [ 52.208520] niks3-server[1040]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4817lb # [ 52.216859] niks3-server[1040]: 2026/09/20 08:08:16 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4818lb # [ 52.220652] niks3-server[1040]: 2026/09/20 08:08:16 INFO Completed upload id=124819worker2 # [ 52.197953] nix-grpc-daemon[859]: time=2026-09-20T08:08:15.424Z level=INFO msg="Upload complete. (236ms)"4820lb # [ 52.222202] niks3-server[1040]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4821worker2 # [ 52.202508] nix-grpc-daemon[728]: ts=2026-09-20T08:08:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14822worker2 # [ 52.213855] nix-daemon[847]: reaped child process 1080, status = succeeded4823worker1 # [ 52.228087] nix-grpc-daemon[785]: ts=2026-09-20T08:08:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:424404824worker1 # [ 52.236414] nix-grpc-daemon[785]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4825worker1 # [ 52.260742] nix-grpc-daemon[785]: ts=2026-09-20T08:08:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:424404826worker1 # [ 52.265604] nix-grpc-daemon[785]: ts=2026-09-20T08:08:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=0 paths=1 nar_bytes_out=1764827worker1 # [ 52.511152] nix-grpc-daemon[785]: ts=2026-09-20T08:08:16Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:424404828worker1 # [ 52.513584] nix-grpc-daemon[785]: ts=2026-09-20T08:08:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:424404829worker1 # [ 52.518974] nix-grpc-daemon[869]: time=2026-09-20T08:08:16.612Z level=INFO msg="All 2 paths already cached"4830worker2 # [ 52.513930] nix-grpc-daemon[728]: ts=2026-09-20T08:08:15Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04831worker2 # [ 52.520283] nix-grpc-daemon[728]: ts=2026-09-20T08:08:15Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14832worker2 # [ 52.524945] nix-grpc-daemon[728]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984833worker2 # [ 52.535393] nix-grpc-daemon[728]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578984834worker2 # [ 52.546499] nix-grpc-daemon[859]: time=2026-09-20T08:08:15.772Z level=INFO msg="All 2 paths already cached"4835worker2 # [ 52.552950] nix-grpc-daemon[728]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578984836worker2 # [ 52.563155] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4837worker2 # [ 52.730342] nix-daemon[847]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4838worker2 # [ 52.743076] nix-daemon[847]: reaped child process 1109, status = succeeded4839worker2 # [ 52.888471] nix-daemon[847]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4840worker2 # [ 52.899289] nix-daemon[847]: reaped child process 1114, status = succeeded4841lb # [ 52.932888] niks3-server[1040]: 2026/09/20 08:08:16 INFO Received uploads request method=POST path=/api/pending_closures4842worker2 # [ 52.920386] nix-grpc-daemon[859]: time=2026-09-20T08:08:16.146Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4843worker2 # [ 52.922054] nix-grpc-daemon[859]: time=2026-09-20T08:08:16.148Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4844lb # [ 52.965845] niks3-server[1040]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4845lb # [ 52.975273] niks3-server[1040]: 2026/09/20 08:08:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4846lb # [ 52.979972] niks3-server[1040]: 2026/09/20 08:08:17 INFO Signed narinfos id=13 count=14847worker2 # [ 52.960115] nix-grpc-daemon[859]: time=2026-09-20T08:08:16.186Z level=INFO msg="Uploading 1 narinfos"4848lb # [ 52.985756] niks3-server[1040]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4849lb # [ 52.996495] niks3-server[1040]: 2026/09/20 08:08:17 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4850lb # [ 53.000288] niks3-server[1040]: 2026/09/20 08:08:17 INFO Completed upload id=134851worker2 # [ 52.979464] nix-grpc-daemon[859]: time=2026-09-20T08:08:16.205Z level=INFO msg="Upload complete. (405ms)"4852lb # [ 53.002277] niks3-server[1040]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4853worker2 # [ 52.981413] nix-grpc-daemon[728]: ts=2026-09-20T08:08:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_in=7524854worker2 # [ 52.984141] nix-grpc-daemon[728]: ts=2026-09-20T08:08:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578984855worker2 # [ 52.988706] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4856worker2 # [ 52.993722] nix-daemon[847]: reaped child process 1104, status = succeeded4857worker2 # [ 52.998460] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4858worker2 # [ 53.824718] nix-daemon[847]: reaped child process 1118, status = succeeded4859worker2 # [ 53.960422] nix-daemon[847]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4860worker2 # [ 53.973977] nix-daemon[847]: reaped child process 1136, status = succeeded4861lb # [ 54.009349] niks3-server[1040]: 2026/09/20 08:08:18 INFO Received uploads request method=POST path=/api/pending_closures4862worker2 # [ 53.991363] nix-grpc-daemon[859]: time=2026-09-20T08:08:17.217Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4863worker2 # [ 53.992976] nix-grpc-daemon[859]: time=2026-09-20T08:08:17.219Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4864lb # [ 54.033710] niks3-server[1040]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4865lb # [ 54.036854] niks3-server[1040]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4866lb # [ 54.042186] niks3-server[1040]: 2026/09/20 08:08:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4867worker2 # [ 54.021954] nix-grpc-daemon[859]: time=2026-09-20T08:08:17.248Z level=INFO msg="Uploading 1 narinfos"4868lb # [ 54.044739] niks3-server[1040]: 2026/09/20 08:08:18 INFO Signed narinfos id=14 count=14869lb # [ 54.052899] niks3-server[1040]: 2026/09/20 08:08:18 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4870lb # [ 54.057033] niks3-server[1040]: 2026/09/20 08:08:18 INFO Completed upload id=144871worker2 # [ 54.033991] nix-grpc-daemon[859]: time=2026-09-20T08:08:17.260Z level=WARN msg="Failed to register uploaded object" key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo error="server returned 404: object is not pending upload\n"4872lb # [ 54.058800] niks3-server[1040]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4873worker2 # [ 54.037356] nix-grpc-daemon[859]: time=2026-09-20T08:08:17.262Z level=INFO msg="Upload complete. (231ms)"4874worker2 # [ 54.039631] nix-grpc-daemon[728]: ts=2026-09-20T08:08:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14875worker2 # [ 54.045918] nix-daemon[847]: reaped child process 1116, status = succeeded4876worker1 # [ 54.102266] nix-grpc-daemon[785]: ts=2026-09-20T08:08:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:424404877worker1 # [ 54.112518] nix-grpc-daemon[785]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4878worker2 # [ 54.121325] nix-grpc-daemon[728]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:578984879worker2 # [ 54.127130] nix-grpc-daemon[728]: ts=2026-09-20T08:08:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_out=2324880client # [ 54.190182] nix-daemon[930]: reaped child process 932, status = succeeded4881client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.29 seconds)4882client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4883client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4884client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4885client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4886client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4887client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4888(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.38 seconds)4889subtest: an input only one worker has still reaches the builder4890client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4891client # this derivation will be built:4892client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4893client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4894client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.40 seconds)4895client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4896client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds)4897worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4898worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.23 seconds)4899worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4900worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4901client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24902client # [ 55.272440] nix-daemon[930]: accepted connection from pid 1013, user root (trusted)4903client # this derivation will be built:4904client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4905worker2 # [ 55.441080] nix-grpc-daemon[728]: ts=2026-09-20T08:08:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:578984906client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4907worker1 # [ 55.462423] nix-grpc-daemon[785]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:424404908worker1 # [ 55.622891] nix-daemon[843]: accepted connection from pid 947, user nix-grpc-daemon (trusted)4909worker1 # [ 55.634331] nix-daemon[843]: reaped child process 950, status = succeeded4910lb # [ 55.657652] niks3-server[1040]: 2026/09/20 08:08:19 INFO Received uploads request method=POST path=/api/pending_closures4911worker1 # [ 55.658220] nix-grpc-daemon[869]: time=2026-09-20T08:08:19.751Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4912worker1 # [ 55.659838] nix-grpc-daemon[869]: time=2026-09-20T08:08:19.751Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4913lb # [ 55.674528] niks3-server[1040]: 2026/09/20 08:08:19 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4914lb # [ 55.679604] niks3-server[1040]: 2026/09/20 08:08:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4915lb # [ 55.683189] niks3-server[1040]: 2026/09/20 08:08:19 INFO Signed narinfos id=15 count=14916worker1 # [ 55.679219] nix-grpc-daemon[869]: time=2026-09-20T08:08:19.772Z level=INFO msg="Uploading 1 narinfos"4917lb # [ 55.687226] niks3-server[1040]: 2026/09/20 08:08:19 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4918lb # [ 55.695585] niks3-server[1040]: 2026/09/20 08:08:19 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4919lb # [ 55.698948] niks3-server[1040]: 2026/09/20 08:08:19 INFO Completed upload id=154920worker1 # [ 55.693152] nix-grpc-daemon[869]: time=2026-09-20T08:08:19.786Z level=INFO msg="Upload complete. (225ms)"4921lb # [ 55.700939] niks3-server[1040]: 2026/09/20 08:08:19 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4922worker2 # [ 55.690854] nix-grpc-daemon[728]: ts=2026-09-20T08:08:18Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04923worker2 # [ 55.695391] nix-grpc-daemon[728]: ts=2026-09-20T08:08:18Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14924worker1 # [ 55.751888] nix-grpc-daemon[785]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:424404925worker1 # [ 55.760050] nix-grpc-daemon[785]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:424404926client # copying 2 paths to 'lb:50051'...4927client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4928worker1 # [ 55.772898] nix-grpc-daemon[785]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:424404929client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4930worker1 # [ 55.784247] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4931worker1 # [ 55.955063] nix-daemon[843]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4932worker1 # [ 55.968410] nix-daemon[843]: reaped child process 957, status = succeeded4933worker1 # [ 56.132528] nix-daemon[843]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4934worker1 # [ 56.144951] nix-daemon[843]: reaped child process 962, status = succeeded4935lb # [ 56.164788] niks3-server[1040]: 2026/09/20 08:08:20 INFO Received uploads request method=POST path=/api/pending_closures4936lb # [ 56.195591] niks3-server[1040]: 2026/09/20 08:08:20 INFO Received uploads request method=POST path=/api/pending_closures4937worker1 # [ 56.198111] nix-grpc-daemon[869]: time=2026-09-20T08:08:20.290Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4938worker1 # [ 56.199496] nix-grpc-daemon[869]: time=2026-09-20T08:08:20.291Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4939worker1 # [ 56.201191] nix-grpc-daemon[869]: time=2026-09-20T08:08:20.291Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4940lb # [ 56.216355] niks3-server[1040]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4941lb # [ 56.226244] niks3-server[1040]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4942lb # [ 56.230925] niks3-server[1040]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4943lb # [ 56.232374] niks3-server[1040]: 2026/09/20 08:08:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4944lb # [ 56.234705] niks3-server[1040]: 2026/09/20 08:08:20 INFO Signed narinfos id=17 count=24945lb # [ 56.236844] niks3-server[1040]: 2026/09/20 08:08:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4946lb # [ 56.238623] niks3-server[1040]: 2026/09/20 08:08:20 INFO Signed narinfos id=16 count=14947worker1 # [ 56.233455] nix-grpc-daemon[869]: time=2026-09-20T08:08:20.326Z level=INFO msg="Uploading 3 narinfos"4948lb # [ 56.240589] niks3-server[1040]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4949lb # [ 56.254535] niks3-server[1040]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4950lb # [ 56.257158] niks3-server[1040]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4951lb # [ 56.259477] niks3-server[1040]: 2026/09/20 08:08:20 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4952lb # [ 56.263572] niks3-server[1040]: 2026/09/20 08:08:20 INFO Completed upload id=174953lb # [ 56.264941] niks3-server[1040]: 2026/09/20 08:08:20 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4954lb # [ 56.267038] niks3-server[1040]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4955lb # [ 56.269104] niks3-server[1040]: 2026/09/20 08:08:20 INFO Completed upload id=164956worker1 # [ 56.264464] nix-grpc-daemon[869]: time=2026-09-20T08:08:20.357Z level=INFO msg="Upload complete. (465ms)"4957worker1 # [ 56.268084] nix-grpc-daemon[785]: ts=2026-09-20T08:08:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=0 paths=2 nar_bytes_in=9764958worker1 # [ 56.270489] nix-grpc-daemon[785]: ts=2026-09-20T08:08:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:424404959worker1 # [ 56.275593] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4960worker1 # [ 56.278730] nix-daemon[843]: reaped child process 952, status = succeeded4961worker1 # [ 56.284306] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4962client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4963client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4964lb # [ 56.574468] envoy[901]: conn peer=[2001:db8:1::1]:40636 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=33924965lb # [ 56.578108] envoy[901]: conn peer=[2001:db8:1::1]:46718 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1353 ms=45584966lb # [ 56.581567] envoy[901]: conn peer=[2001:db8:1::1]:40654 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=524967lb # [ 56.584900] envoy[901]: conn peer=[2001:db8:1::1]:40640 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3395 tx=1750 ms=18734968lb # [ 56.588564] envoy[901]: conn peer=[2001:db8:1::1]:40674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=554969lb # [ 56.591864] envoy[901]: conn peer=[2001:db8:1::1]:40662 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3836 tx=1952 ms=18824970lb # [ 56.595751] envoy[901]: conn peer=[2001:db8:1::1]:40688 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4297 tx=2182 ms=16444971lb # [ 56.599255] envoy[901]: conn peer=[2001:db8:1::1]:32782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=144972worker1 # [ 57.111585] nix-daemon[843]: reaped child process 966, status = succeeded4973worker1 # [ 57.246528] nix-daemon[843]: accepted connection from pid 981, user nix-grpc-daemon (trusted)4974worker1 # [ 57.258290] nix-daemon[843]: reaped child process 984, status = succeeded4975lb # [ 57.278890] niks3-server[1040]: 2026/09/20 08:08:21 INFO Received uploads request method=POST path=/api/pending_closures4976worker1 # [ 57.280858] nix-grpc-daemon[869]: time=2026-09-20T08:08:21.374Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4977lb # [ 57.309149] niks3-server[1040]: 2026/09/20 08:08:21 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4978lb # [ 57.313483] niks3-server[1040]: 2026/09/20 08:08:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4979worker1 # [ 57.314236] nix-grpc-daemon[869]: time=2026-09-20T08:08:21.407Z level=INFO msg="Uploading 1 narinfos"4980lb # [ 57.320119] niks3-server[1040]: 2026/09/20 08:08:21 INFO Signed narinfos id=18 count=14981lb # [ 57.326323] niks3-server[1040]: 2026/09/20 08:08:21 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4982lb # [ 57.337232] niks3-server[1040]: 2026/09/20 08:08:21 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4983worker1 # [ 57.338165] nix-grpc-daemon[869]: time=2026-09-20T08:08:21.431Z level=INFO msg="Upload complete. (247ms)"4984lb # [ 57.343994] niks3-server[1040]: 2026/09/20 08:08:21 INFO Completed upload id=184985worker1 # [ 57.340821] nix-grpc-daemon[785]: ts=2026-09-20T08:08:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14986lb # [ 57.349092] niks3-server[1040]: 2026/09/20 08:08:21 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4987worker1 # [ 57.351509] nix-daemon[843]: reaped child process 964, status = succeeded4988client # copying 1 paths...4989worker1 # [ 57.388860] nix-grpc-daemon[785]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:424404990client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4991worker1 # [ 57.417463] nix-grpc-daemon[785]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:424404992worker1 # [ 57.421858] nix-grpc-daemon[785]: ts=2026-09-20T08:08:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=0 paths=1 nar_bytes_out=1204993client # [ 57.522857] nix-daemon[930]: reaped child process 1016, status = succeeded4994client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.42 seconds)4995client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24996client # [ 57.691830] nix-daemon[930]: accepted connection from pid 1035, user root (trusted)4997client # this derivation will be built:4998client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4999worker2 # [ 57.887615] nix-grpc-daemon[728]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:578985000client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5001worker2 # [ 57.891339] nix-grpc-daemon[728]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578985002worker2 # [ 57.912715] nix-grpc-daemon[728]: ts=2026-09-20T08:08:21Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05003worker2 # [ 57.918140] nix-grpc-daemon[728]: ts=2026-09-20T08:08:21Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15004worker2 # [ 57.957348] nix-grpc-daemon[728]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578985005worker2 # [ 57.971250] nix-grpc-daemon[728]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578985006client # copying 1 paths to 'lb:50051'...5007client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5008worker2 # [ 57.989570] nix-grpc-daemon[728]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578985009worker2 # [ 57.998910] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5010worker2 # [ 58.017398] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5)5011worker2 # [ 58.049952] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5)5012worker2 # [ 58.058317] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 384 ms (attempt 3/5)5013worker2 # [ 58.448321] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 695 ms (attempt 4/5)5014worker2 # [ 59.144417] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5015worker2 # [ 59.150838] nix-grpc-daemon[728]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5016worker2 # [ 59.353432] nix-daemon[847]: accepted connection from pid 1151, user nix-grpc-daemon (trusted)5017worker2 # [ 59.365582] nix-daemon[847]: reaped child process 1154, status = succeeded5018worker2 # [ 59.525753] nix-daemon[847]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)5019worker2 # [ 59.538183] nix-daemon[847]: reaped child process 1159, status = succeeded5020lb # [ 59.576730] niks3-server[1040]: 2026/09/20 08:08:23 INFO Received uploads request method=POST path=/api/pending_closures5021worker2 # [ 59.562950] nix-grpc-daemon[859]: time=2026-09-20T08:08:22.788Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5022worker2 # [ 59.564344] nix-grpc-daemon[859]: time=2026-09-20T08:08:22.788Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5023lb # [ 59.601691] niks3-server[1040]: 2026/09/20 08:08:23 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5024lb # [ 59.614723] niks3-server[1040]: 2026/09/20 08:08:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5025lb # [ 59.618893] niks3-server[1040]: 2026/09/20 08:08:23 INFO Signed narinfos id=19 count=15026worker2 # [ 59.599250] nix-grpc-daemon[859]: time=2026-09-20T08:08:22.825Z level=INFO msg="Uploading 1 narinfos"5027lb # [ 59.625642] niks3-server[1040]: 2026/09/20 08:08:23 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5028lb # [ 59.636105] niks3-server[1040]: 2026/09/20 08:08:23 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5029worker2 # [ 59.620084] nix-grpc-daemon[859]: time=2026-09-20T08:08:22.846Z level=INFO msg="Upload complete. (444ms)"5030lb # [ 59.642817] niks3-server[1040]: 2026/09/20 08:08:23 INFO Completed upload id=195031worker2 # [ 59.622580] nix-grpc-daemon[728]: ts=2026-09-20T08:08:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 paths=1 nar_bytes_in=5605032worker2 # [ 59.625602] nix-grpc-daemon[728]: ts=2026-09-20T08:08:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578985033lb # [ 59.648418] niks3-server[1040]: 2026/09/20 08:08:23 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5034worker2 # [ 59.630789] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5035worker2 # [ 59.635183] nix-daemon[847]: reaped child process 1145, status = succeeded5036worker2 # [ 59.642087] nix-grpc-daemon[728]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5037client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5038worker2 # [ 59.652199] nix-daemon[847]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5039client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5040worker2 # [ 60.878408] nix-daemon[847]: reaped child process 1164, status = succeeded5041worker2 # [ 61.038325] nix-daemon[847]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5042worker2 # [ 61.051133] nix-daemon[847]: reaped child process 1182, status = succeeded5043lb # [ 61.085667] niks3-server[1040]: 2026/09/20 08:08:25 INFO Received uploads request method=POST path=/api/pending_closures5044worker2 # [ 61.072224] nix-grpc-daemon[859]: time=2026-09-20T08:08:24.298Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5045lb # [ 61.116787] niks3-server[1040]: 2026/09/20 08:08:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5046lb # [ 61.122839] niks3-server[1040]: 2026/09/20 08:08:25 INFO Signed narinfos id=20 count=15047worker2 # [ 61.103335] nix-grpc-daemon[859]: time=2026-09-20T08:08:24.329Z level=INFO msg="Uploading 1 narinfos"5048lb # [ 61.129667] niks3-server[1040]: 2026/09/20 08:08:25 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5049lb # [ 61.137842] niks3-server[1040]: 2026/09/20 08:08:25 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5050lb # [ 61.149127] niks3-server[1040]: 2026/09/20 08:08:25 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5051lb # [ 61.155760] niks3-server[1040]: 2026/09/20 08:08:25 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5052lb # [ 61.161042] niks3-server[1040]: 2026/09/20 08:08:25 INFO Completed upload id=205053worker2 # [ 61.138184] nix-grpc-daemon[859]: time=2026-09-20T08:08:24.364Z level=INFO msg="Upload complete. (276ms)"5054worker2 # [ 61.143528] nix-grpc-daemon[728]: ts=2026-09-20T08:08:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15055worker2 # [ 61.154123] nix-daemon[847]: reaped child process 1161, status = succeeded5056client # copying 1 paths...5057worker2 # [ 61.187554] nix-grpc-daemon[728]: ts=2026-09-20T08:08:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:578985058client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5059worker2 # [ 61.206156] nix-grpc-daemon[728]: ts=2026-09-20T08:08:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:578985060worker2 # [ 61.210690] nix-grpc-daemon[728]: ts=2026-09-20T08:08:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_out=1205061client # [ 61.316538] nix-daemon[930]: reaped child process 1038, status = succeeded5062client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.79 seconds)5063client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25064client # [ 61.496260] nix-daemon[930]: accepted connection from pid 1057, user root (trusted)5065client # this derivation will be built:5066client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5067worker1 # [ 61.692574] nix-grpc-daemon[785]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:424405068worker2 # [ 61.678197] nix-grpc-daemon[728]: ts=2026-09-20T08:08:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578985069client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5070worker2 # [ 61.683876] nix-grpc-daemon[859]: time=2026-09-20T08:08:24.910Z level=INFO msg="All 1 paths already cached"5071worker2 # [ 61.693261] nix-grpc-daemon[728]: ts=2026-09-20T08:08:24Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05072worker2 # [ 61.695388] nix-grpc-daemon[728]: ts=2026-09-20T08:08:24Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15073worker1 # [ 61.714272] nix-grpc-daemon[785]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:424405074worker1 # [ 61.722989] nix-grpc-daemon[785]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:424405075worker1 # [ 61.731861] nix-grpc-daemon[869]: time=2026-09-20T08:08:25.824Z level=INFO msg="All 1 paths already cached"5076client # copying 1 paths to 'lb:50051'...5077client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5078worker1 # [ 61.737052] nix-grpc-daemon[785]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:424405079worker1 # [ 61.743702] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5080worker1 # [ 61.902049] nix-daemon[843]: accepted connection from pid 988, user nix-grpc-daemon (trusted)5081worker1 # [ 61.915783] nix-daemon[843]: reaped child process 991, status = succeeded5082worker1 # [ 62.076085] nix-daemon[843]: accepted connection from pid 993, user nix-grpc-daemon (trusted)5083worker1 # [ 62.088683] nix-daemon[843]: reaped child process 996, status = succeeded5084lb # [ 62.105957] niks3-server[1040]: 2026/09/20 08:08:26 INFO Received uploads request method=POST path=/api/pending_closures5085worker1 # [ 62.110637] nix-grpc-daemon[869]: time=2026-09-20T08:08:26.203Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5086worker1 # [ 62.112047] nix-grpc-daemon[869]: time=2026-09-20T08:08:26.203Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5087lb # [ 62.136646] niks3-server[1040]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5088lb # [ 62.145787] niks3-server[1040]: 2026/09/20 08:08:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5089worker1 # [ 62.145343] nix-grpc-daemon[869]: time=2026-09-20T08:08:26.238Z level=INFO msg="Uploading 1 narinfos"5090lb # [ 62.150872] niks3-server[1040]: 2026/09/20 08:08:26 INFO Signed narinfos id=21 count=15091lb # [ 62.161634] niks3-server[1040]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5092lb # [ 62.163977] niks3-server[1040]: 2026/09/20 08:08:26 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5093lb # [ 62.168108] niks3-server[1040]: 2026/09/20 08:08:26 INFO Completed upload id=215094worker1 # [ 62.163566] nix-grpc-daemon[869]: time=2026-09-20T08:08:26.256Z level=INFO msg="Upload complete. (413ms)"5095lb # [ 62.169544] niks3-server[1040]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5096worker1 # [ 62.165795] nix-grpc-daemon[785]: ts=2026-09-20T08:08:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=0 paths=1 nar_bytes_in=5605097worker1 # [ 62.169125] nix-grpc-daemon[785]: ts=2026-09-20T08:08:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:424405098worker1 # [ 62.173291] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5099worker1 # [ 62.178093] nix-daemon[843]: reaped child process 986, status = succeeded5100client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5101worker1 # [ 62.182829] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5102client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5103worker1 # [ 63.397491] nix-daemon[843]: reaped child process 1000, status = succeeded5104worker1 # [ 63.511504] nix-daemon[843]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)5105worker1 # [ 63.523819] nix-daemon[843]: reaped child process 1018, status = succeeded5106lb # [ 63.543639] niks3-server[1040]: 2026/09/20 08:08:27 INFO Received uploads request method=POST path=/api/pending_closures5107worker1 # [ 63.545626] nix-grpc-daemon[869]: time=2026-09-20T08:08:27.638Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5108lb # [ 63.574200] niks3-server[1040]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5109lb # [ 63.579700] niks3-server[1040]: 2026/09/20 08:08:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5110lb # [ 63.586637] niks3-server[1040]: 2026/09/20 08:08:27 INFO Signed narinfos id=22 count=15111worker1 # [ 63.584046] nix-grpc-daemon[869]: time=2026-09-20T08:08:27.677Z level=INFO msg="Uploading 1 narinfos"5112lb # [ 63.594457] niks3-server[1040]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5113lb # [ 63.605486] niks3-server[1040]: 2026/09/20 08:08:27 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5114worker1 # [ 63.607784] nix-grpc-daemon[869]: time=2026-09-20T08:08:27.701Z level=INFO msg="Upload complete. (218ms)"5115lb # [ 63.613807] niks3-server[1040]: 2026/09/20 08:08:27 INFO Completed upload id=225116worker1 # [ 63.611330] nix-grpc-daemon[785]: ts=2026-09-20T08:08:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42440 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15117lb # [ 63.617282] niks3-server[1040]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5118worker1 # [ 63.617253] nix-daemon[843]: reaped child process 998, status = succeeded5119client # copying 1 paths...5120worker1 # [ 63.654446] nix-grpc-daemon[785]: ts=2026-09-20T08:08:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:424405121client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5122worker2 # [ 63.651560] nix-grpc-daemon[728]: ts=2026-09-20T08:08:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:578985123worker2 # [ 63.659767] nix-grpc-daemon[728]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5124worker2 # [ 63.668526] nix-grpc-daemon[728]: ts=2026-09-20T08:08:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57898 duration_s=0 paths=1 nar_bytes_out=1205125client # [ 63.768480] nix-daemon[930]: reaped child process 1060, status = succeeded5126client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.45 seconds)5127(finished: subtest: an input only one worker has still reaches the builder, in 9.49 seconds)5128subtest: upload whose reference the worker lacks is completed from the cache5129client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5130client # this derivation will be built:5131client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5132client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5133client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.34 seconds)5134client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5135client # this derivation will be built:5136client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5137client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5138client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.40 seconds)5139client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5140client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.19 seconds)5141worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5142worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5143worker2 # [ 64.962400] systemd[1]: Stopping Nix worker-protocol over gRPC...5144worker2 # [ 65.844222] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=signal_exit5145worker2 # [ 66.099517] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_yield5146lb # [ 66.124255] niks3-server[1040]: 2026/09/20 08:08:30 INFO lead: released remote=192.168.1.4:550905147worker1 # [ 66.119200] nix-grpc-daemon[785]: ts=2026-09-20T08:08:30Z level=info event=scheduler_restarting addr=lb:500515148worker2 # [ 66.105200] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_restarting addr=lb:500515149worker2 # [ 66.109408] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479005150worker2 # [ 66.112849] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=worker_gone addr=192.168.1.3:500515151worker2 # [ 66.115895] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479005152worker2 # [ 66.119185] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=worker_gone addr=192.168.1.4:500515153worker1 # [ 66.319419] nix-grpc-daemon[785]: ts=2026-09-20T08:08:30Z level=info event=scheduler_connected addr=lb:500515154worker2 # [ 66.305217] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_connected addr=lb:500515155worker1 # [ 66.324880] nix-grpc-daemon[785]: ts=2026-09-20T08:08:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5156worker2 # [ 66.310838] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5157worker1 # [ 66.525921] nix-grpc-daemon[785]: ts=2026-09-20T08:08:30Z level=info event=scheduler_connected addr=lb:500515158worker2 # [ 66.513120] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_connected addr=lb:500515159worker1 # [ 66.530857] nix-grpc-daemon[785]: ts=2026-09-20T08:08:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5160worker2 # [ 66.517069] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5161lb # [ 66.573898] envoy[901]: conn peer=[2001:db8:1::1]:32802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=585162lb # [ 66.575414] envoy[901]: conn peer=[2001:db8:1::1]:32798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3836 tx=1762 ms=20155163lb # [ 66.576803] envoy[901]: conn peer=[2001:db8:1::1]:32818 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3697 tx=1806 ms=33755164lb # [ 66.578276] envoy[901]: conn peer=[2001:db8:1::1]:32830 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=565165lb # [ 66.579727] envoy[901]: conn peer=[2001:db8:1::1]:32832 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1802 ms=20475166lb # [ 66.581196] envoy[901]: conn peer=[2001:db8:1::1]:60778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=675167worker1 # [ 66.731472] nix-grpc-daemon[785]: ts=2026-09-20T08:08:30Z level=info event=scheduler_connected addr=lb:500515168worker1 # [ 66.734276] nix-grpc-daemon[785]: ts=2026-09-20T08:08:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5169worker2 # [ 66.717640] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_connected addr=lb:500515170worker2 # [ 66.722200] nix-grpc-daemon[728]: ts=2026-09-20T08:08:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5171worker1 # [ 66.935325] nix-grpc-daemon[785]: ts=2026-09-20T08:08:31Z level=info event=scheduler_connected addr=lb:500515172worker2 # [ 66.924982] nix-grpc-daemon[728]: ts=2026-09-20T08:08:30Z level=info event=scheduler_connected addr=lb:500515173worker1 # [ 66.940722] nix-grpc-daemon[785]: ts=2026-09-20T08:08:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5174worker2 # [ 66.928259] nix-grpc-daemon[728]: ts=2026-09-20T08:08:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5175worker2 # [ 67.103429] nix-grpc-daemon[728]: ts=2026-09-20T08:08:30Z level=info event=scheduler_restarting5176worker2 # [ 67.125566] nix-daemon[847]: reaped child process 849, status = succeeded5177worker1 # [ 67.143970] nix-grpc-daemon[785]: ts=2026-09-20T08:08:31Z level=info event=scheduler_connected addr=lb:500515178worker1 # [ 67.147286] nix-grpc-daemon[785]: ts=2026-09-20T08:08:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5179worker2 # [ 67.140157] nix-grpc-daemon[728]: ts=2026-09-20T08:08:30Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5180worker1 # [ 67.344540] nix-grpc-daemon[785]: ts=2026-09-20T08:08:31Z level=info event=scheduler_connected addr=lb:500515181worker2 # [ 67.330271] nix-grpc-daemon[728]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5182worker2 # [ 67.333610] nix-grpc-daemon[728]: E0000 00:00:1789891710.555951 771 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5183worker1 # [ 67.951094] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5184worker2 # [ 67.942261] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5185worker2 # [ 67.943979] systemd[1]: Stopped Nix worker-protocol over gRPC.5186worker2 # [ 67.945311] systemd[1]: nix-grpc-daemon.service: Consumed 2.326s CPU time over 51.394s wall clock time, 54.3M memory peak, 86.2K incoming IP traffic, 163.6K outgoing IP traffic.5187worker2 # [ 67.949796] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5188worker2 # [ 67.951554] systemd[1]: Closed Nix worker-protocol over gRPC.5189worker2 # [ 67.952692] systemd[1]: nix-grpc-daemon.socket: Consumed 291us CPU time over 57.745s wall clock time, 256K memory peak, 109.5K incoming IP traffic, 86.5K outgoing IP traffic.5190lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5191lb: must succeed: curl -sf localhost:9901/clusters5192lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5193lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.04 seconds)5194client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25195worker1 # [ 68.154446] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=info event=scheduler_connected addr=lb:500515196worker1 # [ 68.156717] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5197worker1 # [ 68.197677] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:424405198worker1 # [ 68.200252] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:424405199client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5200client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.20 seconds)5201worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5202worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5203worker2 # [ 68.265328] systemd[1]: Listening on Nix worker-protocol over gRPC.5204worker1 # [ 68.343488] systemd[1]: Stopping Nix worker-protocol over gRPC...5205worker1 # [ 68.357507] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=info event=scheduler_connected addr=lb:500515206worker2 # [ 68.346377] systemd[1]: Starting Nix worker-protocol over gRPC...5207worker2 # [ 68.499450] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5208worker2 # [ 68.502117] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15209worker2 # [ 68.508536] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5210worker2 # [ 68.510127] systemd[1]: Started Nix worker-protocol over gRPC.5211worker1 # [ 68.534516] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5212lb # [ 68.542152] niks3-server[1040]: 2026/09/20 08:08:32 INFO lead: acquired remote=192.168.1.4:526785213worker2 # [ 68.520985] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=scheduler_take_over5214worker2 # [ 68.524525] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=scheduler_connected addr=lb:500515215worker2 # [ 68.526199] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5216worker1 # [ 68.735450] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=info event=scheduler_connected addr=lb:500515217worker2 # [ 68.720555] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05218worker2 # [ 68.727402] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=scheduler_connected addr=lb:500515219worker2 # [ 68.730964] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5220worker1 # [ 68.839953] nix-grpc-daemon[785]: ts=2026-09-20T08:08:32Z level=info event=signal_exit5221worker2 # [ 68.931224] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:32Z level=info event=scheduler_connected addr=lb:500515222worker2 # [ 68.933124] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05223worker1 # [ 70.100872] nix-grpc-daemon[785]: ts=2026-09-20T08:08:34Z level=info event=scheduler_restarting5224worker2 # [ 70.092448] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422485225worker2 # [ 70.096138] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:33Z level=info event=worker_gone addr=192.168.1.3:500515226worker1 # [ 70.119592] nix-grpc-daemon[785]: ts=2026-09-20T08:08:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5227worker1 # [ 70.141676] nix-daemon[843]: reaped child process 845, status = succeeded5228worker1 # [ 70.961890] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5229worker1 # [ 70.965504] nix-grpc-daemon[785]: E0000 00:00:1789891715.054781 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5230worker1 # [ 70.970181] nix-grpc-daemon[785]: E0000 00:00:1789891715.055218 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5231worker1 # [ 71.919736] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5232worker1 # [ 71.924532] systemd[1]: Stopped Nix worker-protocol over gRPC.5233worker1 # [ 71.926799] systemd[1]: nix-grpc-daemon.service: Consumed 1.401s CPU time over 55.358s wall clock time, 47.4M memory peak, 49K incoming IP traffic, 92.9K outgoing IP traffic.5234worker1 # [ 71.938410] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5235worker1 # [ 71.942428] systemd[1]: Closed Nix worker-protocol over gRPC.5236worker1 # [ 71.945221] systemd[1]: nix-grpc-daemon.socket: Consumed 317us CPU time over 1min 2.599s wall clock time, 256K memory peak, 87.8K incoming IP traffic, 75K outgoing IP traffic.5237lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5238lb: must succeed: curl -sf localhost:9901/clusters5239lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5240lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5241client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25242worker2 # [ 72.219429] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422725243worker2 # [ 72.231694] nix-daemon[847]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5244worker2 # [ 72.247869] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5)5245worker2 # [ 72.273686] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 168 ms (attempt 2/5)5246worker2 # [ 72.447605] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 280 ms (attempt 3/5)5247worker2 # [ 72.733479] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 800 ms (attempt 4/5)5248worker2 # [ 73.540702] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5249client # copying 2 paths...5250client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5251worker2 # [ 73.558604] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422725252client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5253worker2 # [ 73.569814] nix-daemon[847]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5254worker2 # [ 73.592254] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:36Z level=info event=niks3_push_started pid=12625255worker2 # [ 73.939325] nix-daemon[847]: accepted connection from pid 1275, user nix-grpc-daemon (trusted)5256worker2 # [ 73.950531] nix-daemon[847]: reaped child process 1278, status = succeeded5257lb # [ 73.989954] niks3-server[1040]: 2026/09/20 08:08:38 INFO Received uploads request method=POST path=/api/pending_closures5258lb # [ 73.999859] niks3-server[1040]: 2026/09/20 08:08:38 INFO Received uploads request method=POST path=/api/pending_closures5259worker2 # [ 73.985322] nix-grpc-daemon[1262]: time=2026-09-20T08:08:37.211Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5260worker2 # [ 73.988061] nix-grpc-daemon[1262]: time=2026-09-20T08:08:37.213Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5261worker2 # [ 73.989711] nix-grpc-daemon[1262]: time=2026-09-20T08:08:37.213Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5262lb # [ 74.046254] niks3-server[1040]: 2026/09/20 08:08:38 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5263lb # [ 74.052237] niks3-server[1040]: 2026/09/20 08:08:38 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5264lb # [ 74.067399] niks3-server[1040]: 2026/09/20 08:08:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5265lb # [ 74.071232] niks3-server[1040]: 2026/09/20 08:08:38 INFO Signed narinfos id=23 count=15266lb # [ 74.074086] niks3-server[1040]: 2026/09/20 08:08:38 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5267lb # [ 74.077566] niks3-server[1040]: 2026/09/20 08:08:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5268lb # [ 74.080527] niks3-server[1040]: 2026/09/20 08:08:38 INFO Signed narinfos id=24 count=25269worker2 # [ 74.060118] nix-grpc-daemon[1262]: time=2026-09-20T08:08:37.285Z level=INFO msg="Uploading 3 narinfos"5270lb # [ 74.085397] niks3-server[1040]: 2026/09/20 08:08:38 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5271lb # [ 74.097911] niks3-server[1040]: 2026/09/20 08:08:38 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5272lb # [ 74.102158] niks3-server[1040]: 2026/09/20 08:08:38 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5273lb # [ 74.105674] niks3-server[1040]: 2026/09/20 08:08:38 INFO Completed upload id=235274lb # [ 74.106685] niks3-server[1040]: 2026/09/20 08:08:38 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5275lb # [ 74.110580] niks3-server[1040]: 2026/09/20 08:08:38 INFO Completed upload id=245276worker2 # [ 74.088068] nix-grpc-daemon[1262]: time=2026-09-20T08:08:37.314Z level=INFO msg="Upload complete. (307ms)"5277lb # [ 74.113841] niks3-server[1040]: 2026/09/20 08:08:38 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5278lb # [ 74.120064] niks3-server[1040]: 2026/09/20 08:08:38 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5279worker2 # [ 74.094156] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42272 duration_s=0 paths=2 nar_bytes_in=3125280worker2 # [ 74.105074] nix-daemon[847]: reaped child process 1260, status = succeeded5281client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 2.14 seconds)5282worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5283worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5284worker1 # [ 74.232783] systemd[1]: Listening on Nix worker-protocol over gRPC.5285worker1 # [ 74.239750] systemd[1]: Starting Nix worker-protocol over gRPC...5286worker1 # [ 74.401920] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5287worker1 # [ 74.405930] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15288worker1 # [ 74.412351] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5289worker1 # [ 74.416263] systemd[1]: Started Nix worker-protocol over gRPC.5290lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5291lb: must succeed: curl -sf localhost:9901/clusters5292worker1 # [ 74.427083] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:38Z level=info event=scheduler_connected addr=lb:500515293worker2 # [ 74.411438] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05294lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5295lb: must succeed: curl -sf localhost:9901/clusters5296lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5297lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.09 seconds)5298(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.73 seconds)5299subtest: scheduler down: the other node takes the lock and keeps it5300lb: must succeed: curl -sf localhost:9901/clusters5301lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5302lb: must succeed: curl -sf localhost:9901/clusters5303lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5304lb: must succeed: curl -sf localhost:9901/clusters5305lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5306lb: must succeed: curl -sf localhost:9901/clusters5307lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5308worker2 # [ 75.721598] systemd[1]: Stopping Nix worker-protocol over gRPC...5309worker2 # [ 76.516859] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:39Z level=info event=signal_exit5310lb # [ 76.575113] envoy[901]: conn peer=192.168.1.4:50712 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=12586 tx=2633 ms=492235311lb # [ 76.578973] envoy[901]: conn peer=[2001:db8:1::1]:60790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=125312lb # [ 76.582551] envoy[901]: conn peer=192.168.1.3:49578 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=13332 tx=2573 ms=521765313lb # [ 76.586370] envoy[901]: conn peer=[2001:db8:1::1]:60802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=282 ms=18875314worker2 # [ 76.728836] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:39Z level=info event=scheduler_yield5315worker1 # [ 76.749259] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:40Z level=info event=scheduler_restarting addr=lb:500515316worker2 # [ 76.733366] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422485317lb # [ 76.754971] niks3-server[1040]: 2026/09/20 08:08:40 INFO lead: released remote=192.168.1.4:526785318worker2 # [ 76.737815] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:39Z level=info event=worker_gone addr=192.168.1.3:500515319worker2 # [ 76.741770] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:39Z level=info event=scheduler_restarting addr=lb:500515320worker2 # [ 76.744702] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422485321worker2 # [ 76.748106] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:39Z level=info event=worker_gone addr=192.168.1.4:500515322worker1 # [ 76.949409] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_connected addr=lb:500515323worker1 # [ 76.952654] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5324worker2 # [ 76.938482] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_connected addr=lb:500515325worker2 # [ 76.943308] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5326worker1 # [ 77.153421] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_connected addr=lb:500515327worker1 # [ 77.158652] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5328worker2 # [ 77.144132] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_connected addr=lb:500515329worker2 # [ 77.156785] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5330worker1 # [ 77.359416] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_connected addr=lb:500515331worker1 # [ 77.362859] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5332worker2 # [ 77.357759] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_connected addr=lb:500515333worker2 # [ 77.363287] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5334worker1 # [ 77.563633] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_connected addr=lb:500515335worker1 # [ 77.566567] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5336worker2 # [ 77.565962] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_connected addr=lb:500515337worker2 # [ 77.569718] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5338worker2 # [ 77.733307] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:40Z level=info event=scheduler_restarting5339worker1 # [ 77.768795] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_connected addr=lb:500515340worker1 # [ 77.770428] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5341worker2 # [ 77.754887] nix-daemon[847]: reaped child process 1255, status = succeeded5342worker2 # [ 77.776678] nix-grpc-daemon[1206]: ts=2026-09-20T08:08:41Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5343worker1 # [ 77.969340] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:42Z level=info event=scheduler_connected addr=lb:500515344worker2 # [ 77.954071] nix-grpc-daemon[1206]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5345worker2 # [ 77.957434] nix-grpc-daemon[1206]: E0000 00:00:1789891721.180154 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5346worker2 # [ 78.013206] nix-grpc-daemon[1206]: E0000 00:00:1789891721.239192 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5347worker2 # [ 78.018221] nix-grpc-daemon[1206]: E0000 00:00:1789891721.239324 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5348worker1 # [ 78.543776] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5349worker2 # [ 78.547543] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5350worker2 # [ 78.551183] systemd[1]: Stopped Nix worker-protocol over gRPC.5351worker2 # [ 78.554842] systemd[1]: nix-grpc-daemon.service: Consumed 337ms CPU time over 10.200s wall clock time, 30.3M memory peak, 17.8K incoming IP traffic, 23.2K outgoing IP traffic.5352worker2 # [ 78.566867] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5353worker2 # [ 78.570299] systemd[1]: Closed Nix worker-protocol over gRPC.5354worker2 # [ 78.572968] systemd[1]: nix-grpc-daemon.socket: Consumed 386us CPU time over 10.309s wall clock time, 256K memory peak, 28.1K incoming IP traffic, 21.7K outgoing IP traffic.5355worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5356worker1 # [ 78.744396] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:42Z level=info event=scheduler_connected addr=lb:500515357worker1 # [ 78.747025] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5358worker1 # [ 78.948565] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_connected addr=lb:500515359worker1 # [ 78.952469] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5360worker1 # [ 79.153093] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_connected addr=lb:500515361worker1 # [ 79.157722] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5362worker1 # [ 79.358630] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_connected addr=lb:500515363worker1 # [ 79.362603] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5364lb # [ 79.427747] niks3-server[1040]: 2026/09/20 08:08:43 INFO lead: acquired remote=192.168.1.3:443365365worker1 # [ 79.424100] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_take_over5366worker1 # [ 79.563398] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=scheduler_connected addr=lb:500515367worker1 # [ 79.567919] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05368worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.10 seconds)5369worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5370worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5371client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25372worker1 # [ 79.969750] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:426765373worker1 # [ 79.980860] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5374client # don't know how to build these paths:5375client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5376worker1 # [ 80.000739] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:44Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05377worker1 # [ 80.006672] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:44Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15378worker1 # [ 80.049370] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765379worker1 # [ 80.060600] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5)5380worker1 # [ 80.147590] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 132 ms (attempt 2/5)5381worker1 # [ 80.285302] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 261 ms (attempt 3/5)5382worker1 # [ 80.552550] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 559 ms (attempt 4/5)5383worker1 # [ 81.112178] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5384worker1 # [ 81.125166] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426765385client # copying 1 paths to 'lb:50051'...5386worker1 # [ 81.135434] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426765387client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5388worker1 # [ 81.142473] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5389worker1 # [ 81.153858] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:45Z level=info event=niks3_push_started pid=11165390worker1 # [ 81.516448] nix-daemon[843]: accepted connection from pid 1129, user nix-grpc-daemon (trusted)5391worker1 # [ 81.533959] nix-daemon[843]: reaped child process 1132, status = succeeded5392worker1 # [ 81.711902] nix-daemon[843]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5393worker1 # [ 81.728528] nix-daemon[843]: reaped child process 1137, status = succeeded5394lb # [ 81.750397] niks3-server[1040]: 2026/09/20 08:08:45 INFO Received uploads request method=POST path=/api/pending_closures5395worker1 # [ 81.752744] nix-grpc-daemon[1116]: time=2026-09-20T08:08:45.845Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5396worker1 # [ 81.754917] nix-grpc-daemon[1116]: time=2026-09-20T08:08:45.847Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5397lb # [ 81.784775] niks3-server[1040]: 2026/09/20 08:08:45 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5398lb # [ 81.795848] niks3-server[1040]: 2026/09/20 08:08:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5399lb # [ 81.802757] niks3-server[1040]: 2026/09/20 08:08:45 INFO Signed narinfos id=25 count=15400worker1 # [ 81.800503] nix-grpc-daemon[1116]: time=2026-09-20T08:08:45.893Z level=INFO msg="Uploading 1 narinfos"5401lb # [ 81.815522] niks3-server[1040]: 2026/09/20 08:08:45 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5402lb # [ 81.820634] niks3-server[1040]: 2026/09/20 08:08:45 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5403worker1 # [ 81.821051] nix-grpc-daemon[1116]: time=2026-09-20T08:08:45.914Z level=INFO msg="Upload complete. (474ms)"5404lb # [ 81.827337] niks3-server[1040]: 2026/09/20 08:08:45 INFO Completed upload id=255405worker1 # [ 81.823617] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=0 paths=1 nar_bytes_in=5205406worker1 # [ 81.826913] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765407lb # [ 81.833116] niks3-server[1040]: 2026/09/20 08:08:45 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5408worker1 # [ 81.833639] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5409worker1 # [ 81.839862] nix-daemon[843]: reaped child process 1114, status = succeeded5410client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5411client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5412worker1 # [ 81.845572] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5413client # farm-a> LOG-farm-a-on-standby5414worker1 # [ 83.282849] nix-daemon[843]: reaped child process 1141, status = succeeded5415worker1 # [ 83.427116] nix-daemon[843]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)5416worker1 # [ 83.443492] nix-daemon[843]: reaped child process 1159, status = succeeded5417lb # [ 83.462465] niks3-server[1040]: 2026/09/20 08:08:47 INFO Received uploads request method=POST path=/api/pending_closures5418worker1 # [ 83.464525] nix-grpc-daemon[1116]: time=2026-09-20T08:08:47.557Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5419worker1 # [ 83.469533] nix-grpc-daemon[1116]: time=2026-09-20T08:08:47.559Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5420lb # [ 83.497752] niks3-server[1040]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5421lb # [ 83.511664] niks3-server[1040]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5422lb # [ 83.520766] niks3-server[1040]: 2026/09/20 08:08:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5423worker1 # [ 83.520888] nix-grpc-daemon[1116]: time=2026-09-20T08:08:47.613Z level=INFO msg="Uploading 1 narinfos"5424lb # [ 83.526127] niks3-server[1040]: 2026/09/20 08:08:47 INFO Signed narinfos id=26 count=15425lb # [ 83.531485] niks3-server[1040]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5426lb # [ 83.542141] niks3-server[1040]: 2026/09/20 08:08:47 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5427lb # [ 83.546901] niks3-server[1040]: 2026/09/20 08:08:47 INFO Completed upload id=265428worker1 # [ 83.541230] nix-grpc-daemon[1116]: time=2026-09-20T08:08:47.634Z level=INFO msg="Upload complete. (284ms)"5429lb # [ 83.548390] niks3-server[1040]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5430worker1 # [ 83.545917] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15431worker1 # [ 83.558382] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:47Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05432worker1 # [ 83.560798] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:47Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15433worker1 # [ 83.566048] nix-daemon[843]: reaped child process 1139, status = succeeded5434worker1 # [ 83.602376] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765435worker1 # [ 83.610575] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426765436worker1 # [ 83.618722] nix-grpc-daemon[1116]: time=2026-09-20T08:08:47.712Z level=INFO msg="All 1 paths already cached"5437client # copying 1 paths to 'lb:50051'...5438client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5439worker1 # [ 83.623199] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426765440worker1 # [ 83.628964] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5441worker1 # [ 83.788816] nix-daemon[843]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5442worker1 # [ 83.805085] nix-daemon[843]: reaped child process 1168, status = succeeded5443worker1 # [ 83.976977] nix-daemon[843]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5444worker1 # [ 83.994413] nix-daemon[843]: reaped child process 1173, status = succeeded5445lb # [ 84.014292] niks3-server[1040]: 2026/09/20 08:08:48 INFO Received uploads request method=POST path=/api/pending_closures5446worker1 # [ 84.016068] nix-grpc-daemon[1116]: time=2026-09-20T08:08:48.109Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5447worker1 # [ 84.017442] nix-grpc-daemon[1116]: time=2026-09-20T08:08:48.109Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5448lb # [ 84.038440] niks3-server[1040]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5449lb # [ 84.049767] niks3-server[1040]: 2026/09/20 08:08:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5450worker1 # [ 84.049241] nix-grpc-daemon[1116]: time=2026-09-20T08:08:48.142Z level=INFO msg="Uploading 1 narinfos"5451lb # [ 84.055140] niks3-server[1040]: 2026/09/20 08:08:48 INFO Signed narinfos id=27 count=15452lb # [ 84.060297] niks3-server[1040]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5453lb # [ 84.071336] niks3-server[1040]: 2026/09/20 08:08:48 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5454lb # [ 84.076472] niks3-server[1040]: 2026/09/20 08:08:48 INFO Completed upload id=275455worker1 # [ 84.072869] nix-grpc-daemon[1116]: time=2026-09-20T08:08:48.166Z level=INFO msg="Upload complete. (438ms)"5456worker1 # [ 84.074958] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=0 paths=1 nar_bytes_in=6405457lb # [ 84.081648] niks3-server[1040]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5458worker1 # [ 84.079552] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765459worker1 # [ 84.085485] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5460worker1 # [ 84.087938] nix-daemon[843]: reaped child process 1163, status = succeeded5461client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5462worker1 # [ 84.093162] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5463client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5464client # farm-b> LOG-farm-b-on-standby5465worker1 # [ 84.913116] nix-daemon[843]: reaped child process 1177, status = succeeded5466worker1 # [ 85.053199] nix-daemon[843]: accepted connection from pid 1192, user nix-grpc-daemon (trusted)5467worker1 # [ 85.063597] nix-daemon[843]: reaped child process 1195, status = succeeded5468lb # [ 85.081662] niks3-server[1040]: 2026/09/20 08:08:49 INFO Received uploads request method=POST path=/api/pending_closures5469worker1 # [ 85.080274] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.173Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5470worker1 # [ 85.081716] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.175Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5471lb # [ 85.103161] niks3-server[1040]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5472lb # [ 85.108318] niks3-server[1040]: 2026/09/20 08:08:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5473lb # [ 85.112428] niks3-server[1040]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5474worker1 # [ 85.112098] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.205Z level=INFO msg="Uploading 1 narinfos"5475lb # [ 85.117792] niks3-server[1040]: 2026/09/20 08:08:49 INFO Signed narinfos id=28 count=15476lb # [ 85.123568] niks3-server[1040]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5477lb # [ 85.130635] niks3-server[1040]: 2026/09/20 08:08:49 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5478lb # [ 85.133729] niks3-server[1040]: 2026/09/20 08:08:49 INFO Completed upload id=285479worker1 # [ 85.127953] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.221Z level=INFO msg="Upload complete. (228ms)"5480lb # [ 85.136531] niks3-server[1040]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5481worker1 # [ 85.131175] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15482worker1 # [ 85.137388] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05483worker1 # [ 85.139414] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15484worker1 # [ 85.143619] nix-daemon[843]: reaped child process 1175, status = succeeded5485worker1 # [ 85.183268] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765486worker1 # [ 85.193681] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426765487worker1 # [ 85.204786] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.298Z level=INFO msg="All 2 paths already cached"5488client # copying 1 paths to 'lb:50051'...5489client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5490worker1 # [ 85.212124] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426765491worker1 # [ 85.218852] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5492worker1 # [ 85.354679] nix-daemon[843]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5493worker1 # [ 85.366500] nix-daemon[843]: reaped child process 1204, status = succeeded5494worker1 # [ 85.506587] nix-daemon[843]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5495worker1 # [ 85.517833] nix-daemon[843]: reaped child process 1209, status = succeeded5496lb # [ 85.538313] niks3-server[1040]: 2026/09/20 08:08:49 INFO Received uploads request method=POST path=/api/pending_closures5497worker1 # [ 85.541833] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.635Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5498worker1 # [ 85.543628] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.637Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5499lb # [ 85.568866] niks3-server[1040]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5500lb # [ 85.583290] niks3-server[1040]: 2026/09/20 08:08:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5501lb # [ 85.590074] niks3-server[1040]: 2026/09/20 08:08:49 INFO Signed narinfos id=29 count=15502worker1 # [ 85.587605] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.681Z level=INFO msg="Uploading 1 narinfos"5503lb # [ 85.593980] niks3-server[1040]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5504lb # [ 85.606903] niks3-server[1040]: 2026/09/20 08:08:49 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5505lb # [ 85.611391] niks3-server[1040]: 2026/09/20 08:08:49 INFO Completed upload id=295506worker1 # [ 85.605983] nix-grpc-daemon[1116]: time=2026-09-20T08:08:49.699Z level=INFO msg="Upload complete. (375ms)"5507lb # [ 85.616682] niks3-server[1040]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5508worker1 # [ 85.609928] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=0 paths=1 nar_bytes_in=7685509worker1 # [ 85.615453] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765510worker1 # [ 85.625488] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5511worker1 # [ 85.630127] nix-daemon[843]: reaped child process 1199, status = succeeded5512worker1 # [ 85.635225] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5513client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5514client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5515lb # [ 86.574647] envoy[901]: conn peer=[2001:db8:1::4]:54204 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1711 tx=441 ms=92475516client # farm-top> LOG-farm-top-on-standby5517worker1 # [ 87.061676] nix-daemon[843]: reaped child process 1213, status = succeeded5518worker1 # [ 87.210476] nix-daemon[843]: accepted connection from pid 1228, user nix-grpc-daemon (trusted)5519worker1 # [ 87.221208] nix-daemon[843]: reaped child process 1231, status = succeeded5520lb # [ 87.243677] niks3-server[1040]: 2026/09/20 08:08:51 INFO Received uploads request method=POST path=/api/pending_closures5521worker1 # [ 87.247536] nix-grpc-daemon[1116]: time=2026-09-20T08:08:51.340Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5522worker1 # [ 87.249140] nix-grpc-daemon[1116]: time=2026-09-20T08:08:51.342Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5523lb # [ 87.285120] niks3-server[1040]: 2026/09/20 08:08:51 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5524lb # [ 87.289539] niks3-server[1040]: 2026/09/20 08:08:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5525worker1 # [ 87.290859] nix-grpc-daemon[1116]: time=2026-09-20T08:08:51.384Z level=INFO msg="Uploading 1 narinfos"5526lb # [ 87.296271] niks3-server[1040]: 2026/09/20 08:08:51 INFO Signed narinfos id=30 count=15527lb # [ 87.300670] niks3-server[1040]: 2026/09/20 08:08:51 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5528lb # [ 87.304424] niks3-server[1040]: 2026/09/20 08:08:51 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5529lb # [ 87.312731] niks3-server[1040]: 2026/09/20 08:08:51 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5530lb # [ 87.315255] niks3-server[1040]: 2026/09/20 08:08:51 INFO Completed upload id=305531worker1 # [ 87.309579] nix-grpc-daemon[1116]: time=2026-09-20T08:08:51.402Z level=INFO msg="Upload complete. (266ms)"5532lb # [ 87.317563] niks3-server[1040]: 2026/09/20 08:08:51 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5533worker1 # [ 87.315825] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15534worker1 # [ 87.326990] nix-daemon[843]: reaped child process 1211, status = succeeded5535client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 7.62 seconds)5536client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5537client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5538worker2 # [ 87.582863] systemd[1]: Listening on Nix worker-protocol over gRPC.5539worker2 # [ 87.587134] systemd[1]: Starting Nix worker-protocol over gRPC...5540worker2 # [ 87.753446] nix-grpc-daemon[1299]: ts=2026-09-20T08:08:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5541worker2 # [ 87.757391] nix-grpc-daemon[1299]: ts=2026-09-20T08:08:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15542worker2 # [ 87.763692] nix-grpc-daemon[1299]: ts=2026-09-20T08:08:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5543worker2 # [ 87.767575] systemd[1]: Started Nix worker-protocol over gRPC.5544lb: must succeed: curl -sf localhost:9901/clusters5545worker2 # [ 87.783194] nix-grpc-daemon[1299]: ts=2026-09-20T08:08:51Z level=info event=scheduler_connected addr=lb:500515546worker1 # [ 87.803341] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05547lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5548worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5549worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5550lb: must succeed: curl -sf localhost:9901/clusters5551lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5552lb: must succeed: curl -sf localhost:9901/clusters5553lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5554worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5555worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5556(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.54 seconds)5557subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5558client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5559client # [ 88.098476] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5560client # Running as unit: rs.service; invocation ID: 26025c1101d54ca798dfd006481367035561client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5562client # [ 88.289258] nix[1161]: don't know how to build these paths:5563client # [ 88.290102] nix[1161]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5564worker1 # [ 88.295927] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:426765565worker1 # [ 88.306637] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05566worker1 # [ 88.311907] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15567worker1 # [ 88.318977] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765568worker1 # [ 88.326690] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426765569client # [ 88.328703] nix[1161]: copying 1 paths to 'lb:50051'...5570client # [ 88.329662] nix[1161]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5571worker1 # [ 88.337828] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426765572worker1 # [ 88.348264] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5573worker1 # [ 88.507315] nix-daemon[843]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5574worker1 # [ 88.519824] nix-daemon[843]: reaped child process 1249, status = succeeded5575worker1 # [ 88.676072] nix-daemon[843]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5576worker1 # [ 88.689293] nix-daemon[843]: reaped child process 1254, status = succeeded5577lb # [ 88.710704] niks3-server[1040]: 2026/09/20 08:08:52 INFO Received uploads request method=POST path=/api/pending_closures5578worker1 # [ 88.726218] nix-grpc-daemon[1116]: time=2026-09-20T08:08:52.819Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5579worker1 # [ 88.728317] nix-grpc-daemon[1116]: time=2026-09-20T08:08:52.821Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5580lb # [ 88.758427] niks3-server[1040]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5581lb # [ 88.762082] niks3-server[1040]: 2026/09/20 08:08:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5582lb # [ 88.766329] niks3-server[1040]: 2026/09/20 08:08:52 INFO Signed narinfos id=31 count=15583worker1 # [ 88.762909] nix-grpc-daemon[1116]: time=2026-09-20T08:08:52.856Z level=INFO msg="Uploading 1 narinfos"5584lb # [ 88.774418] niks3-server[1040]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5585lb # [ 88.781358] niks3-server[1040]: 2026/09/20 08:08:52 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5586lb # [ 88.787994] niks3-server[1040]: 2026/09/20 08:08:52 INFO Completed upload id=315587worker1 # [ 88.782356] nix-grpc-daemon[1116]: time=2026-09-20T08:08:52.875Z level=INFO msg="Upload complete. (423ms)"5588lb # [ 88.789622] niks3-server[1040]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5589worker1 # [ 88.786463] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=0 paths=1 nar_bytes_in=4165590worker1 # [ 88.792428] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426765591worker1 # [ 88.802270] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5592worker1 # [ 88.810880] nix-daemon[843]: reaped child process 1244, status = succeeded5593worker1 # [ 88.816691] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5594client # [ 88.807669] nix[1161]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5595lb: must succeed: curl -sf localhost:9901/clusters5596lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5597lb: must succeed: curl -sf localhost:9901/clusters5598lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5599lb: must succeed: curl -sf localhost:9901/clusters5600lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5601lb: must succeed: curl -sf localhost:9901/clusters5602lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5603worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5604worker2 # [ 90.911989] systemd-journald[287]: Received client request to rotate journal, rotating.5605worker2 # [ 90.928833] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/0ef0edfcfc2342c8915e1b6b96d2babc.5606worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5607worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5608worker1 # [ 90.860342] systemd[1]: Stopping Nix worker-protocol over gRPC...5609worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5610??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5611 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735612client: must succeed: sleep 5.05613worker1 # [ 91.422767] nix-grpc-daemon[1041]: ts=2026-09-20T08:08:55Z level=info event=draining5614client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5615worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5616worker1 # [ 96.253880] nix-daemon[843]: reaped child process 1258, status = succeeded5617worker1 # [ 96.383471] nix-daemon[843]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5618worker1 # [ 96.396308] nix-daemon[843]: reaped child process 1301, status = succeeded5619lb # [ 96.416698] niks3-server[1040]: 2026/09/20 08:09:00 INFO Received uploads request method=POST path=/api/pending_closures5620worker1 # [ 96.423181] nix-grpc-daemon[1116]: time=2026-09-20T08:09:00.516Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5621worker1 # [ 96.425877] nix-grpc-daemon[1116]: time=2026-09-20T08:09:00.518Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5622lb # [ 96.472727] niks3-server[1040]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5623lb # [ 96.478853] niks3-server[1040]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5624lb # [ 96.489877] niks3-server[1040]: 2026/09/20 08:09:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5625lb # [ 96.494578] niks3-server[1040]: 2026/09/20 08:09:00 INFO Signed narinfos id=32 count=15626worker1 # [ 96.488837] nix-grpc-daemon[1116]: time=2026-09-20T08:09:00.581Z level=INFO msg="Uploading 1 narinfos"5627lb # [ 96.500127] niks3-server[1040]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5628lb # [ 96.505059] niks3-server[1040]: 2026/09/20 08:09:00 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5629lb # [ 96.510105] niks3-server[1040]: 2026/09/20 08:09:00 INFO Completed upload id=325630lb # [ 96.511824] niks3-server[1040]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5631worker1 # [ 96.505909] nix-grpc-daemon[1116]: time=2026-09-20T08:09:00.599Z level=INFO msg="Upload complete. (273ms)"5632worker1 # [ 96.515774] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42676 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15633worker1 # [ 96.528830] nix-daemon[843]: reaped child process 1256, status = succeeded5634client # [ 96.538482] systemd[1]: rs.service: Deactivated successfully.5635client # [ 96.542081] systemd[1]: rs.service: Consumed 109ms CPU time over 8.442s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5636lb # [ 96.576231] envoy[901]: conn peer=[2001:db8:1::1]:40512 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9464 tx=3804 ms=73675637lb # [ 96.579872] envoy[901]: conn peer=[2001:db8:1::1]:57782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2934 tx=1324 ms=82265638worker1 # [ 97.425866] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=signal_exit5639lb # [ 97.649470] niks3-server[1040]: 2026/09/20 08:09:01 INFO lead: released remote=192.168.1.3:443365640worker1 # [ 97.643880] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=scheduler_yield5641worker1 # [ 97.647705] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=scheduler_restarting addr=lb:500515642worker2 # [ 97.631840] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:00Z level=info event=scheduler_restarting addr=lb:500515643worker1 # [ 97.650114] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:426705644worker1 # [ 97.651592] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=worker_gone addr=192.168.1.3:500515645worker1 # [ 97.653067] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:426705646worker1 # [ 97.654592] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=worker_gone addr=192.168.1.4:500515647lb # [ 97.797851] niks3-server[1040]: 2026/09/20 08:09:01 INFO lead: acquired remote=192.168.1.4:407985648worker2 # [ 97.775999] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=scheduler_take_over5649worker2 # [ 97.831842] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=scheduler_connected addr=lb:500515650worker1 # [ 97.850534] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=scheduler_connected addr=lb:500515651worker2 # [ 97.840443] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5652worker1 # [ 97.858574] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5653worker2 # [ 98.041874] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=scheduler_connected addr=lb:500515654worker1 # [ 98.059686] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500515655worker2 # [ 98.052399] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05656worker1 # [ 98.076512] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5657worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.14 seconds)5658client: waiting for success: ! systemctl is-active rs5659worker1 # [ 98.277199] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500515660worker2 # [ 98.262676] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05661client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5662client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5663client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5664client: must fail: journalctl -u rs | grep -q 'reconnecting'5665client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5666lb: must succeed: curl -sf localhost:9901/clusters5667lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5668worker2 # [ 98.635653] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:520725669worker1 # [ 98.655564] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:02Z level=info event=scheduler_restarting5670worker2 # [ 98.639631] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:01Z level=info event=worker_gone addr=192.168.1.3:500515671worker1 # [ 98.668666] nix-grpc-daemon[1041]: ts=2026-09-20T08:09:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5672worker1 # [ 98.689818] nix-daemon[843]: reaped child process 1107, status = succeeded5673worker1 # [ 98.945748] nix-grpc-daemon[1041]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5674worker1 # [ 98.947232] nix-grpc-daemon[1041]: E0000 00:00:1789891743.038867 1084 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5675worker1 # [ 98.949107] nix-grpc-daemon[1041]: E0000 00:00:1789891743.039075 1084 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5676lb: must succeed: curl -sf localhost:9901/clusters5677lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5678worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5679worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5680worker1 # [ 99.955826] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5681worker1 # [ 99.957574] systemd[1]: Stopped Nix worker-protocol over gRPC.5682worker1 # [ 99.958446] systemd[1]: nix-grpc-daemon.service: Consumed 1.335s CPU time over 25.716s wall clock time, 33.4M memory peak, 45K incoming IP traffic, 84.2K outgoing IP traffic.5683worker1 # [ 99.966389] systemd[1]: Starting Nix worker-protocol over gRPC...5684worker1 # [ 100.108745] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5685worker1 # [ 100.112942] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15686worker1 # [ 100.119073] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5687worker1 # [ 100.122273] systemd[1]: Started Nix worker-protocol over gRPC.5688worker1 # [ 100.135988] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:04Z level=info event=scheduler_connected addr=lb:500515689worker2 # [ 100.122351] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05690lb: must succeed: curl -sf localhost:9901/clusters5691lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5692worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5693worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5694(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.68 seconds)5695subtest: scheduler restart mid-build: build finishes, no double build5696client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5697client # [ 100.783856] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5698client # Running as unit: mid.service; invocation ID: 6c433d7d6fcf47e6aebb9efb70c1b5035699client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5700worker2 # [ 100.992159] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:520805701worker2 # [ 101.006087] nix-daemon[847]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)5702client # [ 101.030117] nix[1197]: don't know how to build these paths:5703client # [ 101.031243] nix[1197]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5704worker2 # [ 101.028217] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:04Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05705worker2 # [ 101.033991] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:04Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15706worker2 # [ 101.076964] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520805707worker2 # [ 101.085485] nix-grpc-daemon[1299]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)5708worker2 # [ 101.172868] nix-grpc-daemon[1299]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 2/5)5709worker2 # [ 101.187420] nix-grpc-daemon[1299]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 227 ms (attempt 3/5)5710worker2 # [ 101.420106] nix-grpc-daemon[1299]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 301 ms (attempt 4/5)5711worker2 # [ 101.727663] nix-grpc-daemon[1299]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5712worker2 # [ 101.747862] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520805713client # [ 101.767179] nix[1197]: copying 1 paths to 'lb:50051'...5714client # [ 101.771149] nix[1197]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5715worker2 # [ 101.762342] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520805716worker2 # [ 101.771991] nix-daemon[847]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)5717worker2 # [ 101.796411] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:05Z level=info event=niks3_push_started pid=14235718worker2 # [ 102.183107] nix-daemon[847]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5719worker2 # [ 102.196080] nix-daemon[847]: reaped child process 1443, status = succeeded5720worker2 # [ 102.356765] nix-daemon[847]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)5721worker2 # [ 102.367374] nix-daemon[847]: reaped child process 1448, status = succeeded5722lb # [ 102.407412] niks3-server[1040]: 2026/09/20 08:09:06 INFO Received uploads request method=POST path=/api/pending_closures5723worker2 # [ 102.394369] nix-grpc-daemon[1423]: time=2026-09-20T08:09:05.620Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5724worker2 # [ 102.396705] nix-grpc-daemon[1423]: time=2026-09-20T08:09:05.622Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5725lb # [ 102.445540] niks3-server[1040]: 2026/09/20 08:09:06 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5726lb # [ 102.456415] niks3-server[1040]: 2026/09/20 08:09:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5727worker2 # [ 102.440502] nix-grpc-daemon[1423]: time=2026-09-20T08:09:05.666Z level=INFO msg="Uploading 1 narinfos"5728lb # [ 102.462637] niks3-server[1040]: 2026/09/20 08:09:06 INFO Signed narinfos id=33 count=15729lb # [ 102.475450] niks3-server[1040]: 2026/09/20 08:09:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5730lb # [ 102.481783] niks3-server[1040]: 2026/09/20 08:09:06 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5731lb # [ 102.491761] niks3-server[1040]: 2026/09/20 08:09:06 INFO Completed upload id=335732worker2 # [ 102.469336] nix-grpc-daemon[1423]: time=2026-09-20T08:09:05.695Z level=INFO msg="Upload complete. (449ms)"5733lb # [ 102.493255] niks3-server[1040]: 2026/09/20 08:09:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5734worker2 # [ 102.473617] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52080 duration_s=0 paths=1 nar_bytes_in=4245735worker2 # [ 102.479325] nix-grpc-daemon[1299]: ts=2026-09-20T08:09:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520805736worker2 # [ 102.489107] nix-daemon[847]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)5737worker2 # [ 102.493345] nix-daemon[847]: reaped child process 1421, status = succeeded5738worker2 # [ 102.498622] nix-daemon[847]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)5739client # [ 102.508116] nix[1197]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5740lb: must succeed: curl -sf localhost:9901/clusters5741lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5742lb: must succeed: curl -sf localhost:9901/clusters5743lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5744worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5745worker2 # [ 104.530628] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1299 (nix-grpc-daemon) on client request.5746worker2 # [ 104.538184] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5747lb # [ 104.561409] niks3-server[1040]: 2026/09/20 08:09:08 INFO lead: released remote=192.168.1.4:407985748worker1 # [ 104.555676] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5749client # [ 104.549233] nix[1197]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5750client # [ 104.551329] nix[1197]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5751worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5752client: must succeed: sleep 5.05753worker2 # [ 104.567089] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5754worker2 # [ 104.569606] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5755worker2 # [ 104.571351] systemd[1]: nix-grpc-daemon.service: Consumed 432ms CPU time over 16.979s wall clock time, 30.8M memory peak, 13.3K incoming IP traffic, 19.3K outgoing IP traffic.5756worker2 # [ 104.574754] nix-daemon[847]: reaped child process 1450, status = succeeded5757worker2 # [ 104.577704] nix-daemon[847]: reaped child process 1414, status = succeeded5758worker2 # [ 104.585251] nix-daemon[1452]: unexpected Nix daemon error: error: interrupted by the user5759worker2 # [ 104.589201] nix-daemon[847]: reaped child process 1452, status = failed with exit code 15760worker1 # [ 104.755857] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:08Z level=info event=scheduler_connected addr=lb:500515761worker2 # [ 104.842622] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5762worker2 # [ 104.854223] systemd[1]: Starting Nix worker-protocol over gRPC...5763worker2 # [ 105.034158] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5764worker2 # [ 105.037896] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15765worker2 # [ 105.045057] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5766worker2 # [ 105.047802] systemd[1]: Started Nix worker-protocol over gRPC.5767worker2 # [ 105.058845] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:08Z level=info event=scheduler_take_over5768lb # [ 105.081691] niks3-server[1040]: 2026/09/20 08:09:09 INFO lead: acquired remote=192.168.1.4:578085769worker1 # [ 105.085212] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5770worker2 # [ 105.069559] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:08Z level=info event=scheduler_connected addr=lb:500515771client # [ 105.077422] nix[1197]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting5772worker2 # [ 105.071229] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05773worker1 # [ 105.285821] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:09Z level=info event=scheduler_connected addr=lb:500515774worker2 # [ 105.270953] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05775worker2 # [ 106.081771] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:09Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05776worker2 # [ 106.087704] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:09Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15777worker2 # [ 106.133809] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565085778worker2 # [ 106.142806] nix-daemon[847]: accepted connection from pid 1488, user nix-grpc-daemon (trusted)5779worker2 # [ 106.158835] nix-daemon[847]: accepted connection from pid 1488, user nix-grpc-daemon (trusted)5780client # [ 106.181690] nix[1197]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5781worker2 # [ 106.173875] nix-daemon[847]: accepted connection from pid 1488, user nix-grpc-daemon (trusted)5782lb # [ 106.576805] envoy[901]: conn peer=[2001:db8:1::3]:43890 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4177 tx=1105 ms=242295783lb # [ 106.580877] envoy[901]: conn peer=[2001:db8:1::4]:33064 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=978 tx=389 ms=167625784client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5785client: waiting for success: ! systemctl is-active mid5786worker2 # [ 109.991770] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:13Z level=info event=niks3_push_started pid=15685787worker2 # [ 110.022464] nix-daemon[847]: reaped child process 1544, status = succeeded5788worker2 # [ 110.358297] nix-daemon[847]: accepted connection from pid 1581, user nix-grpc-daemon (trusted)5789worker2 # [ 110.368708] nix-daemon[847]: reaped child process 1584, status = succeeded5790lb # [ 110.411230] niks3-server[1040]: 2026/09/20 08:09:14 INFO Received uploads request method=POST path=/api/pending_closures5791worker2 # [ 110.400067] nix-grpc-daemon[1568]: time=2026-09-20T08:09:13.626Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5792worker2 # [ 110.402058] nix-grpc-daemon[1568]: time=2026-09-20T08:09:13.627Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5793lb # [ 110.462265] niks3-server[1040]: 2026/09/20 08:09:14 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5794worker2 # [ 110.455403] nix-grpc-daemon[1568]: time=2026-09-20T08:09:13.681Z level=INFO msg="Uploading 1 narinfos"5795lb # [ 110.477488] niks3-server[1040]: 2026/09/20 08:09:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5796lb # [ 110.480547] niks3-server[1040]: 2026/09/20 08:09:14 INFO Signed narinfos id=34 count=15797lb # [ 110.492145] niks3-server[1040]: 2026/09/20 08:09:14 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5798lb # [ 110.498814] niks3-server[1040]: 2026/09/20 08:09:14 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5799lb # [ 110.502699] niks3-server[1040]: 2026/09/20 08:09:14 INFO Completed upload id=345800worker2 # [ 110.480249] nix-grpc-daemon[1568]: time=2026-09-20T08:09:13.706Z level=INFO msg="Upload complete. (280ms)"5801lb # [ 110.511263] niks3-server[1040]: 2026/09/20 08:09:14 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5802worker2 # [ 110.486633] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56508 duration_s=4 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15803lb # [ 110.515825] niks3-server[1040]: 2026/09/20 08:09:14 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5804worker2 # [ 110.499313] nix-daemon[847]: reaped child process 1542, status = succeeded5805client # [ 110.544320] systemd[1]: mid.service: Deactivated successfully.5806client # [ 110.548322] systemd[1]: mid.service: Consumed 141ms CPU time over 9.764s wall clock time, 37.3M memory peak, 9.9K incoming IP traffic, 11.1K outgoing IP traffic.5807client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)5808client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5809client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5810(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.27 seconds)5811subtest: interrupting the client stops the build on the worker5812client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5813client # [ 111.025934] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5814client # Running as unit: intr.service; invocation ID: 9b8d3a317ba64add8686cd325dfe7fd45815client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5816worker1 # [ 111.262958] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488565817worker1 # [ 111.275917] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5818client # [ 111.282710] nix[1233]: don't know how to build these paths:5819client # [ 111.283811] nix[1233]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5820worker2 # [ 111.284750] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:14Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05821worker2 # [ 111.289219] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:14Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15822worker1 # [ 111.345915] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488565823worker1 # [ 111.361676] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)5824worker1 # [ 111.399296] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 2/5)5825worker1 # [ 111.446748] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 3/5)5826worker1 # [ 111.576715] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 147 ms (attempt 4/5)5827worker1 # [ 111.725234] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5828worker1 # [ 111.746098] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488565829client # [ 111.749228] nix[1233]: copying 1 paths to 'lb:50051'...5830client # [ 111.753150] nix[1233]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5831worker1 # [ 111.761713] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488565832worker1 # [ 111.770643] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5833worker1 # [ 111.793888] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:15Z level=info event=niks3_push_started pid=13965834worker1 # [ 112.148667] nix-daemon[843]: accepted connection from pid 1409, user nix-grpc-daemon (trusted)5835worker1 # [ 112.166204] nix-daemon[843]: reaped child process 1412, status = succeeded5836worker1 # [ 112.337810] nix-daemon[843]: accepted connection from pid 1416, user nix-grpc-daemon (trusted)5837worker1 # [ 112.352713] nix-daemon[843]: reaped child process 1421, status = succeeded5838lb # [ 112.374361] niks3-server[1040]: 2026/09/20 08:09:16 INFO Received uploads request method=POST path=/api/pending_closures5839worker1 # [ 112.382484] nix-grpc-daemon[1396]: time=2026-09-20T08:09:16.475Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5840worker1 # [ 112.385714] nix-grpc-daemon[1396]: time=2026-09-20T08:09:16.477Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5841lb # [ 112.415098] niks3-server[1040]: 2026/09/20 08:09:16 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5842lb # [ 112.426119] niks3-server[1040]: 2026/09/20 08:09:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5843worker1 # [ 112.428440] nix-grpc-daemon[1396]: time=2026-09-20T08:09:16.521Z level=INFO msg="Uploading 1 narinfos"5844lb # [ 112.434637] niks3-server[1040]: 2026/09/20 08:09:16 INFO Signed narinfos id=35 count=15845lb # [ 112.442118] niks3-server[1040]: 2026/09/20 08:09:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5846lb # [ 112.450217] niks3-server[1040]: 2026/09/20 08:09:16 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5847lb # [ 112.459069] niks3-server[1040]: 2026/09/20 08:09:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5848lb # [ 112.461362] niks3-server[1040]: 2026/09/20 08:09:16 INFO Completed upload id=355849worker1 # [ 112.455643] nix-grpc-daemon[1396]: time=2026-09-20T08:09:16.549Z level=INFO msg="Upload complete. (460ms)"5850worker1 # [ 112.458311] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=4245851worker1 # [ 112.461850] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488565852worker1 # [ 112.467592] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5853worker1 # [ 112.473054] nix-daemon[843]: reaped child process 1394, status = succeeded5854worker1 # [ 112.478409] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5855client # [ 112.470685] nix[1233]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5856client: must succeed: systemctl kill -s INT intr5857client # [ 113.462766] systemd[1]: intr.service: Sent signal SIGINT to main process 1233 (nix) on client request.5858client # [ 113.469173] nix[1233]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5859client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5860client # [ 113.477968] nix[1233]: error: interrupted by the user5861worker1 # [ 113.503992] nix-daemon[843]: reaped child process 1423, status = succeeded5862worker1 # [ 113.508179] nix-daemon[1425]: unexpected Nix daemon error: error: interrupted by the user5863worker1 # [ 113.513630] nix-daemon[843]: reaped child process 1425, status = failed with exit code 15864client # [ 113.507965] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5865client # [ 113.509928] systemd[1]: intr.service: Failed with result 'exit-code'.5866client # [ 113.511588] systemd[1]: intr.service: Consumed 117ms CPU time over 2.484s wall clock time, 37.3M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5867(finished: subtest: interrupting the client stops the build on the worker, in 2.57 seconds)5868subtest: a deploy mid-build drains: the build finishes, the new generation takes over5869client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5870client # [ 113.602105] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5871client # Running as unit: sw.service; invocation ID: b867cd35f6b74bf68fb41725f32e77a55872client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5873worker1 # [ 113.803687] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488565874client # [ 113.802262] nix[1254]: don't know how to build these paths:5875client # [ 113.803282] nix[1254]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5876worker2 # [ 113.803170] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:17Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05877worker2 # [ 113.807216] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:17Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15878worker2 # [ 113.845474] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565085879worker2 # [ 113.857734] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5)5880worker2 # [ 113.891500] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 129 ms (attempt 2/5)5881worker2 # [ 114.026484] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 237 ms (attempt 3/5)5882worker2 # [ 114.269454] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 4/5)5883worker2 # [ 114.275777] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5884worker2 # [ 114.292624] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565085885client # [ 114.312136] nix[1254]: copying 1 paths to 'lb:50051'...5886client # [ 114.316170] nix[1254]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5887worker2 # [ 114.307170] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565085888worker2 # [ 114.318292] nix-daemon[847]: accepted connection from pid 1488, user nix-grpc-daemon (trusted)5889worker2 # [ 114.502426] nix-daemon[847]: accepted connection from pid 1615, user nix-grpc-daemon (trusted)5890worker2 # [ 114.514390] nix-daemon[847]: reaped child process 1618, status = succeeded5891worker2 # [ 114.655984] nix-daemon[847]: accepted connection from pid 1620, user nix-grpc-daemon (trusted)5892worker2 # [ 114.667728] nix-daemon[847]: reaped child process 1623, status = succeeded5893lb # [ 114.703086] niks3-server[1040]: 2026/09/20 08:09:18 INFO Received uploads request method=POST path=/api/pending_closures5894worker2 # [ 114.685404] nix-grpc-daemon[1568]: time=2026-09-20T08:09:17.911Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5895worker2 # [ 114.686884] nix-grpc-daemon[1568]: time=2026-09-20T08:09:17.913Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5896lb # [ 114.720435] niks3-server[1040]: 2026/09/20 08:09:18 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5897lb # [ 114.725086] niks3-server[1040]: 2026/09/20 08:09:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5898lb # [ 114.727548] niks3-server[1040]: 2026/09/20 08:09:18 INFO Signed narinfos id=36 count=15899worker2 # [ 114.704755] nix-grpc-daemon[1568]: time=2026-09-20T08:09:17.930Z level=INFO msg="Uploading 1 narinfos"5900lb # [ 114.730829] niks3-server[1040]: 2026/09/20 08:09:18 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5901lb # [ 114.736248] niks3-server[1040]: 2026/09/20 08:09:18 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5902lb # [ 114.740316] niks3-server[1040]: 2026/09/20 08:09:18 INFO Completed upload id=365903worker2 # [ 114.717546] nix-grpc-daemon[1568]: time=2026-09-20T08:09:17.943Z level=INFO msg="Upload complete. (387ms)"5904worker2 # [ 114.719537] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56508 duration_s=0 paths=1 nar_bytes_in=4165905lb # [ 114.742663] niks3-server[1040]: 2026/09/20 08:09:18 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5906worker2 # [ 114.722414] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565085907worker2 # [ 114.729804] nix-daemon[847]: accepted connection from pid 1488, user nix-grpc-daemon (trusted)5908worker2 # [ 114.731146] nix-daemon[847]: reaped child process 1613, status = succeeded5909worker2 # [ 114.736212] nix-daemon[847]: accepted connection from pid 1488, user nix-grpc-daemon (trusted)5910client # [ 114.744805] nix[1254]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5911worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25912worker2 # Checking switch inhibitors... done5913lb # [ 116.577797] envoy[901]: conn peer=[2001:db8:1::1]:50368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4020 tx=1770 ms=95245914lb # [ 116.582320] envoy[901]: conn peer=[2001:db8:1::1]:40918 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=732 ms=22475915worker2 # [ 116.781644] nixos[1658]: switching to system configuration /nix/store/3qi7dqlcbg1rm3cl2pz9yd7hgp4rwgl9-nixos-system-worker2-test5916worker2 # activating the configuration...5917worker2 # [ 116.785475] systemd[1]: Stopped target Local File Systems.5918worker2 # [ 116.787487] systemd[1]: Stopped target Remote File Systems.5919worker2 # setting up /etc...5920worker2 # [ 117.498621] systemd[1]: Reload requested from client PID 1658 ('.switch-to-conf') (unit backdoor.service)...5921worker2 # [ 117.500347] systemd[1]: Reloading...5922worker2 # [ 118.242639] systemd[1]: Reloading finished in 738 ms.5923worker2 # restarting sysinit-reactivation.target5924worker2 # [ 118.297343] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5925worker2 # [ 118.437822] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5926worker2 # [ 118.442380] systemd[1]: Reached target Reactivate sysinit units.5927worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5928worker2 # [ 118.446736] systemd[1]: Reloading D-Bus System Message Bus...5929worker2 # [ 118.447817] dbus-broker-launch[534]: Caught SIGHUP, trigger reload.5930worker2 # [ 118.452625] systemd[1]: Reloading Nix worker-protocol over gRPC...5931worker2 # [ 118.481181] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'...5932worker2 # [ 118.487048] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync'5933worker2 # [ 118.488142] dbus-broker-launch[534]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5934worker2 # [ 118.502039] systemd[1]: Reloaded Nix worker-protocol over gRPC.5935worker2 # [ 118.524450] systemd[1]: Reloaded D-Bus System Message Bus.5936worker2 # [ 118.532924] systemd[1]: Reached target Remote File Systems.5937worker2 # [ 118.543093] systemd[1]: Starting linger-users.service...5938worker2 # [ 118.547465] systemd[1]: Reached target Local File Systems.5939worker2 # [ 118.548330] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5940worker2 # [ 118.554558] systemd[1]: Starting Create SUID/SGID Wrappers...5941worker2 # [ 118.555722] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5942worker2 # [ 118.557000] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675943worker2 # [ 118.558944] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5944worker2 # [ 118.560341] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5945worker2 # [ 118.566212] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5946worker2 # [ 118.567371] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5947worker2 # [ 118.568547] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5948worker2 # [ 118.608909] systemd[1]: linger-users.service: Deactivated successfully.5949worker2 # [ 118.611116] systemd[1]: Finished linger-users.service.5950worker2 # [ 118.973506] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5951worker2 # [ 118.978085] systemd[1]: Finished Create SUID/SGID Wrappers.5952worker2 # [ 119.048790] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:22Z level=info event=draining5953worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5954worker2 # [ 119.233398] nixos[1658]: finished switching to system configuration /nix/store/3qi7dqlcbg1rm3cl2pz9yd7hgp4rwgl9-nixos-system-worker2-test5955worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.19 seconds)5956worker2: must succeed: pgrep -f 'read -t [9]0 x'5957worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5958client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25959worker1 # [ 119.528376] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488565960client # don't know how to build these paths:5961client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5962worker2 # [ 119.525228] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:22Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05963worker2 # [ 119.527046] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:22Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15964worker1 # [ 119.588094] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488565965worker1 # [ 119.599975] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488565966client # copying 1 paths to 'lb:50051'...5967worker1 # [ 119.611722] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488565968client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5969worker1 # [ 119.632237] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5970worker1 # [ 119.829616] nix-daemon[843]: accepted connection from pid 1467, user nix-grpc-daemon (trusted)5971worker1 # [ 119.841514] nix-daemon[843]: reaped child process 1470, status = succeeded5972worker1 # [ 119.987392] nix-daemon[843]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5973worker1 # [ 119.999513] nix-daemon[843]: reaped child process 1475, status = succeeded5974lb # [ 120.017402] niks3-server[1040]: 2026/09/20 08:09:24 INFO Received uploads request method=POST path=/api/pending_closures5975worker1 # [ 120.021922] nix-grpc-daemon[1396]: time=2026-09-20T08:09:24.114Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5976worker1 # [ 120.023223] nix-grpc-daemon[1396]: time=2026-09-20T08:09:24.114Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5977lb # [ 120.052307] niks3-server[1040]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5978lb # [ 120.060770] niks3-server[1040]: 2026/09/20 08:09:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5979worker1 # [ 120.060984] nix-grpc-daemon[1396]: time=2026-09-20T08:09:24.154Z level=INFO msg="Uploading 1 narinfos"5980lb # [ 120.066643] niks3-server[1040]: 2026/09/20 08:09:24 INFO Signed narinfos id=37 count=15981lb # [ 120.072354] niks3-server[1040]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5982lb # [ 120.082823] niks3-server[1040]: 2026/09/20 08:09:24 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5983lb # [ 120.087778] niks3-server[1040]: 2026/09/20 08:09:24 INFO Completed upload id=375984worker1 # [ 120.081999] nix-grpc-daemon[1396]: time=2026-09-20T08:09:24.175Z level=INFO msg="Upload complete. (438ms)"5985lb # [ 120.090124] niks3-server[1040]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5986worker1 # [ 120.085453] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=5285987worker1 # [ 120.090286] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488565988worker1 # [ 120.101036] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5989worker1 # [ 120.104128] nix-daemon[843]: reaped child process 1465, status = succeeded5990worker1 # [ 120.107769] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5991client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5992client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5993client # farm-a> LOG-farm-a-during-drain5994worker1 # [ 121.532841] nix-daemon[843]: reaped child process 1479, status = succeeded5995worker1 # [ 121.699992] nix-daemon[843]: accepted connection from pid 1494, user nix-grpc-daemon (trusted)5996worker1 # [ 121.711715] nix-daemon[843]: reaped child process 1497, status = succeeded5997lb # [ 121.735118] niks3-server[1040]: 2026/09/20 08:09:25 INFO Received uploads request method=POST path=/api/pending_closures5998worker1 # [ 121.733698] nix-grpc-daemon[1396]: time=2026-09-20T08:09:25.826Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5999worker1 # [ 121.735262] nix-grpc-daemon[1396]: time=2026-09-20T08:09:25.828Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6000lb # [ 121.753619] niks3-server[1040]: 2026/09/20 08:09:25 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6001lb # [ 121.767407] niks3-server[1040]: 2026/09/20 08:09:25 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6002lb # [ 121.777825] niks3-server[1040]: 2026/09/20 08:09:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6003lb # [ 121.782468] niks3-server[1040]: 2026/09/20 08:09:25 INFO Signed narinfos id=38 count=16004worker1 # [ 121.779516] nix-grpc-daemon[1396]: time=2026-09-20T08:09:25.872Z level=INFO msg="Uploading 1 narinfos"6005lb # [ 121.790293] niks3-server[1040]: 2026/09/20 08:09:25 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6006lb # [ 121.799162] niks3-server[1040]: 2026/09/20 08:09:25 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6007lb # [ 121.803852] niks3-server[1040]: 2026/09/20 08:09:25 INFO Completed upload id=386008worker1 # [ 121.798214] nix-grpc-daemon[1396]: time=2026-09-20T08:09:25.891Z level=INFO msg="Upload complete. (282ms)"6009lb # [ 121.806356] niks3-server[1040]: 2026/09/20 08:09:25 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6010worker1 # [ 121.801297] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16011worker2 # [ 121.790571] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:25Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06012worker1 # [ 121.809075] nix-daemon[843]: reaped child process 1477, status = succeeded6013worker2 # [ 121.792539] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:25Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16014worker1 # [ 121.857766] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566015worker1 # [ 121.870132] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566016worker1 # [ 121.882924] nix-grpc-daemon[1396]: time=2026-09-20T08:09:25.976Z level=INFO msg="All 1 paths already cached"6017client # copying 1 paths to 'lb:50051'...6018worker1 # [ 121.890911] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566019client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6020worker1 # [ 121.908393] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6021worker1 # [ 122.097108] nix-daemon[843]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6022worker1 # [ 122.109151] nix-daemon[843]: reaped child process 1504, status = succeeded6023worker1 # [ 122.277300] nix-daemon[843]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)6024worker1 # [ 122.288887] nix-daemon[843]: reaped child process 1509, status = succeeded6025lb # [ 122.312061] niks3-server[1040]: 2026/09/20 08:09:26 INFO Received uploads request method=POST path=/api/pending_closures6026worker1 # [ 122.313750] nix-grpc-daemon[1396]: time=2026-09-20T08:09:26.407Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6027worker1 # [ 122.315285] nix-grpc-daemon[1396]: time=2026-09-20T08:09:26.408Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6028lb # [ 122.341747] niks3-server[1040]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6029lb # [ 122.350874] niks3-server[1040]: 2026/09/20 08:09:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6030lb # [ 122.356064] niks3-server[1040]: 2026/09/20 08:09:26 INFO Signed narinfos id=39 count=16031worker1 # [ 122.353574] nix-grpc-daemon[1396]: time=2026-09-20T08:09:26.446Z level=INFO msg="Uploading 1 narinfos"6032lb # [ 122.362421] niks3-server[1040]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6033lb # [ 122.373336] niks3-server[1040]: 2026/09/20 08:09:26 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6034worker1 # [ 122.373844] nix-grpc-daemon[1396]: time=2026-09-20T08:09:26.467Z level=INFO msg="Upload complete. (451ms)"6035lb # [ 122.379873] niks3-server[1040]: 2026/09/20 08:09:26 INFO Completed upload id=396036worker1 # [ 122.375801] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=6406037lb # [ 122.383415] niks3-server[1040]: 2026/09/20 08:09:26 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6038worker1 # [ 122.381397] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566039worker1 # [ 122.386120] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6040worker1 # [ 122.388304] nix-daemon[843]: reaped child process 1499, status = succeeded6041worker1 # [ 122.393582] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6042client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6043client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6044client # farm-b> LOG-farm-b-during-drain6045worker1 # [ 123.813591] nix-daemon[843]: reaped child process 1513, status = succeeded6046worker1 # [ 123.967520] nix-daemon[843]: accepted connection from pid 1528, user nix-grpc-daemon (trusted)6047worker1 # [ 123.979371] nix-daemon[843]: reaped child process 1531, status = succeeded6048lb # [ 124.002634] niks3-server[1040]: 2026/09/20 08:09:28 INFO Received uploads request method=POST path=/api/pending_closures6049worker1 # [ 124.001529] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.094Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6050worker1 # [ 124.004097] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.096Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6051lb # [ 124.020251] niks3-server[1040]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6052lb # [ 124.022758] niks3-server[1040]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6053lb # [ 124.027233] niks3-server[1040]: 2026/09/20 08:09:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6054lb # [ 124.029994] niks3-server[1040]: 2026/09/20 08:09:28 INFO Signed narinfos id=40 count=16055worker1 # [ 124.024403] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.117Z level=INFO msg="Uploading 1 narinfos"6056lb # [ 124.033630] niks3-server[1040]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6057lb # [ 124.037058] niks3-server[1040]: 2026/09/20 08:09:28 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6058lb # [ 124.040752] niks3-server[1040]: 2026/09/20 08:09:28 INFO Completed upload id=406059worker1 # [ 124.034959] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.128Z level=INFO msg="Upload complete. (233ms)"6060lb # [ 124.042269] niks3-server[1040]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6061worker1 # [ 124.037438] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16062worker1 # [ 124.046143] nix-daemon[843]: reaped child process 1511, status = succeeded6063worker2 # [ 124.027699] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:27Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06064worker2 # [ 124.030286] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:27Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16065worker1 # [ 124.087977] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566066worker1 # [ 124.096148] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566067worker1 # [ 124.104897] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.198Z level=INFO msg="All 2 paths already cached"6068client # copying 1 paths to 'lb:50051'...6069client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6070worker1 # [ 124.112378] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566071worker1 # [ 124.127113] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6072worker1 # [ 124.301878] nix-daemon[843]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6073worker1 # [ 124.316721] nix-daemon[843]: reaped child process 1538, status = succeeded6074worker1 # [ 124.486076] nix-daemon[843]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)6075worker1 # [ 124.497803] nix-daemon[843]: reaped child process 1543, status = succeeded6076lb # [ 124.520574] niks3-server[1040]: 2026/09/20 08:09:28 INFO Received uploads request method=POST path=/api/pending_closures6077worker1 # [ 124.523024] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.616Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6078worker1 # [ 124.524460] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.616Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6079lb # [ 124.547250] niks3-server[1040]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6080lb # [ 124.556202] niks3-server[1040]: 2026/09/20 08:09:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6081lb # [ 124.560791] niks3-server[1040]: 2026/09/20 08:09:28 INFO Signed narinfos id=41 count=16082worker1 # [ 124.558360] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.651Z level=INFO msg="Uploading 1 narinfos"6083lb # [ 124.568509] niks3-server[1040]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6084lb # [ 124.581947] niks3-server[1040]: 2026/09/20 08:09:28 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6085lb # [ 124.586594] niks3-server[1040]: 2026/09/20 08:09:28 INFO Completed upload id=416086worker1 # [ 124.583288] nix-grpc-daemon[1396]: time=2026-09-20T08:09:28.676Z level=INFO msg="Upload complete. (445ms)"6087lb # [ 124.589287] niks3-server[1040]: 2026/09/20 08:09:28 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6088worker1 # [ 124.587568] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=7686089worker1 # [ 124.593319] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566090worker1 # [ 124.602514] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6091worker1 # [ 124.609412] nix-daemon[843]: reaped child process 1533, status = succeeded6092client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6093client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6094worker1 # [ 124.615833] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6095worker1 # [ 125.830993] nix-daemon[843]: reaped child process 1547, status = succeeded6096client # farm-top> LOG-farm-top-during-drain6097worker1 # [ 125.976332] nix-daemon[843]: accepted connection from pid 1562, user nix-grpc-daemon (trusted)6098worker1 # [ 125.991235] nix-daemon[843]: reaped child process 1565, status = succeeded6099lb # [ 126.009263] niks3-server[1040]: 2026/09/20 08:09:30 INFO Received uploads request method=POST path=/api/pending_closures6100worker1 # [ 126.009174] nix-grpc-daemon[1396]: time=2026-09-20T08:09:30.102Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6101worker1 # [ 126.011125] nix-grpc-daemon[1396]: time=2026-09-20T08:09:30.104Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6102lb # [ 126.039444] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6103lb # [ 126.043061] niks3-server[1040]: 2026/09/20 08:09:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6104lb # [ 126.044451] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6105lb # [ 126.047173] niks3-server[1040]: 2026/09/20 08:09:30 INFO Signed narinfos id=42 count=16106lb # [ 126.048558] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6107worker1 # [ 126.042945] nix-grpc-daemon[1396]: time=2026-09-20T08:09:30.136Z level=INFO msg="Uploading 1 narinfos"6108lb # [ 126.055902] niks3-server[1040]: 2026/09/20 08:09:30 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6109lb # [ 126.059109] niks3-server[1040]: 2026/09/20 08:09:30 INFO Completed upload id=426110worker1 # [ 126.053321] nix-grpc-daemon[1396]: time=2026-09-20T08:09:30.146Z level=INFO msg="Upload complete. (231ms)"6111lb # [ 126.060716] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6112worker1 # [ 126.055983] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16113worker1 # [ 126.063582] nix-daemon[843]: reaped child process 1545, status = succeeded6114client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 6.79 seconds)6115client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6116client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.20 seconds)6117worker2: must succeed: pkill -f 'read -t [9]0 x'6118worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6119client: waiting for success: ! systemctl is-active sw6120worker2 # [ 126.359467] nix-daemon[847]: reaped child process 1627, status = succeeded6121worker2 # [ 126.500088] nix-daemon[847]: accepted connection from pid 1804, user nix-grpc-daemon (trusted)6122worker2 # [ 126.510620] nix-daemon[847]: reaped child process 1807, status = succeeded6123lb # [ 126.546296] niks3-server[1040]: 2026/09/20 08:09:30 INFO Received uploads request method=POST path=/api/pending_closures6124worker2 # [ 126.532280] nix-grpc-daemon[1568]: time=2026-09-20T08:09:29.758Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6125worker2 # [ 126.534446] nix-grpc-daemon[1568]: time=2026-09-20T08:09:29.760Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6126lb # [ 126.575736] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6127lb # [ 126.580880] envoy[901]: conn peer=[2001:db8:1::1]:57410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9502 tx=3823 ms=65456128lb # [ 126.590854] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6129lb # [ 126.602188] niks3-server[1040]: 2026/09/20 08:09:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6130lb # [ 126.606446] niks3-server[1040]: 2026/09/20 08:09:30 INFO Signed narinfos id=43 count=16131worker2 # [ 126.587367] nix-grpc-daemon[1568]: time=2026-09-20T08:09:29.813Z level=INFO msg="Uploading 1 narinfos"6132lb # [ 126.610755] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6133lb # [ 126.617926] niks3-server[1040]: 2026/09/20 08:09:30 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6134lb # [ 126.622261] niks3-server[1040]: 2026/09/20 08:09:30 INFO Completed upload id=436135worker2 # [ 126.599695] nix-grpc-daemon[1568]: time=2026-09-20T08:09:29.825Z level=INFO msg="Upload complete. (246ms)"6136lb # [ 126.624111] niks3-server[1040]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6137worker2 # [ 126.606828] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56508 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16138worker2 # [ 126.617869] nix-daemon[847]: reaped child process 1625, status = succeeded6139client # [ 126.641771] systemd[1]: sw.service: Deactivated successfully.6140client # [ 126.643666] systemd[1]: sw.service: Consumed 106ms CPU time over 13.041s wall clock time, 37.1M memory peak, 8.8K incoming IP traffic, 9K outgoing IP traffic.6141worker2 # [ 127.051753] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=signal_exit6142worker2 # [ 127.283536] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=scheduler_yield6143worker1 # [ 127.304183] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:31Z level=info event=scheduler_restarting addr=lb:500516144lb # [ 127.309297] niks3-server[1040]: 2026/09/20 08:09:31 INFO lead: released remote=192.168.1.4:578086145worker2 # [ 127.290725] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:564986146worker2 # [ 127.294889] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=worker_gone addr=192.168.1.3:500516147worker2 # [ 127.299201] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=scheduler_restarting addr=lb:500516148worker2 # [ 127.302265] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:564986149worker2 # [ 127.305553] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=worker_gone addr=192.168.1.4:500516150client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6151client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6152client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6153worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6154worker1 # [ 127.505203] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:31Z level=info event=scheduler_connected addr=lb:500516155worker2 # [ 127.496161] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=scheduler_connected addr=lb:500516156worker1 # [ 127.519431] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6157worker2 # [ 127.505391] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6158worker1 # [ 127.720362] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:31Z level=info event=scheduler_connected addr=lb:500516159worker1 # [ 127.723225] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6160worker2 # [ 127.708604] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=scheduler_connected addr=lb:500516161worker2 # [ 127.712661] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6162worker1 # [ 127.923942] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:32Z level=info event=scheduler_connected addr=lb:500516163worker1 # [ 127.926604] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6164worker2 # [ 127.913497] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:31Z level=info event=scheduler_connected addr=lb:500516165worker2 # [ 127.918677] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6166worker1 # [ 128.127350] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:32Z level=info event=scheduler_connected addr=lb:500516167worker1 # [ 128.129876] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6168worker2 # [ 128.119446] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:31Z level=info event=scheduler_connected addr=lb:500516169worker2 # [ 128.124479] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6170worker2 # [ 128.284286] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:31Z level=info event=scheduler_restarting6171worker2 # [ 128.306957] nix-daemon[847]: reaped child process 1540, status = succeeded6172worker1 # [ 128.331887] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:32Z level=info event=scheduler_connected addr=lb:500516173worker1 # [ 128.337161] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6174worker2 # [ 128.334622] nix-grpc-daemon[1488]: ts=2026-09-20T08:09:31Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6175worker1 # [ 128.538509] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:32Z level=info event=scheduler_connected addr=lb:500516176worker2 # [ 128.523660] nix-grpc-daemon[1488]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6177worker2 # [ 128.527163] nix-grpc-daemon[1488]: E0000 00:00:1789891771.749735 1531 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true6178worker1 # [ 129.089834] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"6179worker2 # [ 129.089651] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6180worker2 # [ 129.093662] systemd[1]: nix-grpc-daemon.service: Consumed 671ms CPU time over 24.519s wall clock time, 31.1M memory peak, 23.7K incoming IP traffic, 32.4K outgoing IP traffic.6181worker2 # [ 129.109651] systemd[1]: Starting Nix worker-protocol over gRPC...6182worker2 # [ 129.275196] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6183worker1 # [ 129.291139] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:33Z level=info event=scheduler_connected addr=lb:500516184worker2 # [ 129.277152] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16185worker1 # [ 129.296952] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6186worker2 # [ 129.283056] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6187worker2 # [ 129.286910] systemd[1]: Started Nix worker-protocol over gRPC.6188worker2 # [ 129.297686] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:32Z level=info event=scheduler_take_over6189worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.86 seconds)6190lb # [ 129.321605] niks3-server[1040]: 2026/09/20 08:09:33 INFO lead: acquired remote=192.168.1.4:530246191lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6192lb: must succeed: curl -sf localhost:9901/clusters6193worker2 # [ 129.309163] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:32Z level=info event=scheduler_connected addr=lb:500516194worker2 # [ 129.312917] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06195lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6196lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)6197lb: must succeed: curl -sf localhost:9901/clusters6198lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6199worker1 # [ 129.498868] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:33Z level=info event=scheduler_connected addr=lb:500516200worker1 # [ 129.504118] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6201worker1 # [ 129.705367] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:33Z level=info event=scheduler_connected addr=lb:500516202worker2 # [ 129.689910] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:32Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06203lb: must succeed: curl -sf localhost:9901/clusters6204lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6205worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6206worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6207(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.98 seconds)6208subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6209client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16210worker2 # [ 130.760784] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:369186211worker2 # [ 130.771847] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6212worker2 # [ 130.792266] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:34Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06213worker2 # [ 130.796969] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:34Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16214worker2 # [ 130.801452] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:34Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06215worker2 # [ 130.805288] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:34Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06216worker1 # [ 130.859937] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566217worker1 # [ 130.874591] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566218worker1 # [ 130.886607] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566219worker1 # [ 130.897965] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6220worker1 # [ 131.074905] nix-daemon[843]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)6221worker1 # [ 131.089642] nix-daemon[843]: reaped child process 1572, status = succeeded6222worker1 # [ 131.267893] nix-daemon[843]: accepted connection from pid 1574, user nix-grpc-daemon (trusted)6223worker1 # [ 131.282417] nix-daemon[843]: reaped child process 1577, status = succeeded6224lb # [ 131.305555] niks3-server[1040]: 2026/09/20 08:09:35 INFO Received uploads request method=POST path=/api/pending_closures6225worker1 # [ 131.310459] nix-grpc-daemon[1396]: time=2026-09-20T08:09:35.403Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6226worker1 # [ 131.311988] nix-grpc-daemon[1396]: time=2026-09-20T08:09:35.405Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6227lb # [ 131.337944] niks3-server[1040]: 2026/09/20 08:09:35 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6228lb # [ 131.349401] niks3-server[1040]: 2026/09/20 08:09:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6229lb # [ 131.355382] niks3-server[1040]: 2026/09/20 08:09:35 INFO Signed narinfos id=44 count=16230worker1 # [ 131.352729] nix-grpc-daemon[1396]: time=2026-09-20T08:09:35.445Z level=INFO msg="Uploading 1 narinfos"6231lb # [ 131.361703] niks3-server[1040]: 2026/09/20 08:09:35 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6232lb # [ 131.372298] niks3-server[1040]: 2026/09/20 08:09:35 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6233lb # [ 131.377884] niks3-server[1040]: 2026/09/20 08:09:35 INFO Completed upload id=446234worker1 # [ 131.373750] nix-grpc-daemon[1396]: time=2026-09-20T08:09:35.465Z level=INFO msg="Upload complete. (468ms)"6235lb # [ 131.383264] niks3-server[1040]: 2026/09/20 08:09:35 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6236worker1 # [ 131.376390] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=5046237worker1 # [ 131.381463] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566238worker1 # [ 131.393080] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6239worker1 # [ 131.397481] nix-daemon[843]: reaped child process 1567, status = succeeded6240worker1 # [ 131.402908] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6241worker1 # [ 132.623928] nix-daemon[843]: reaped child process 1581, status = succeeded6242worker1 # [ 132.783631] nix-daemon[843]: accepted connection from pid 1596, user nix-grpc-daemon (trusted)6243worker1 # [ 132.794182] nix-daemon[843]: reaped child process 1599, status = succeeded6244lb # [ 132.818847] niks3-server[1040]: 2026/09/20 08:09:36 INFO Received uploads request method=POST path=/api/pending_closures6245worker1 # [ 132.821261] nix-grpc-daemon[1396]: time=2026-09-20T08:09:36.914Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6246worker1 # [ 132.822936] nix-grpc-daemon[1396]: time=2026-09-20T08:09:36.916Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6247lb # [ 132.858447] niks3-server[1040]: 2026/09/20 08:09:36 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6248lb # [ 132.864589] niks3-server[1040]: 2026/09/20 08:09:36 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6249lb # [ 132.879486] niks3-server[1040]: 2026/09/20 08:09:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6250lb # [ 132.884676] niks3-server[1040]: 2026/09/20 08:09:36 INFO Signed narinfos id=45 count=16251worker1 # [ 132.881295] nix-grpc-daemon[1396]: time=2026-09-20T08:09:36.974Z level=INFO msg="Uploading 1 narinfos"6252lb # [ 132.886922] niks3-server[1040]: 2026/09/20 08:09:36 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6253lb # [ 132.895985] niks3-server[1040]: 2026/09/20 08:09:36 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6254lb # [ 132.900293] niks3-server[1040]: 2026/09/20 08:09:36 INFO Completed upload id=456255lb # [ 132.901839] niks3-server[1040]: 2026/09/20 08:09:36 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6256worker1 # [ 132.894698] nix-grpc-daemon[1396]: time=2026-09-20T08:09:36.988Z level=INFO msg="Upload complete. (284ms)"6257worker2 # [ 132.884320] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:36Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16258worker1 # [ 132.901465] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16259worker2 # [ 132.890232] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:36Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06260worker1 # [ 132.914562] nix-daemon[843]: reaped child process 1579, status = succeeded6261worker1 # [ 132.945076] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566262worker1 # [ 132.956889] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566263worker1 # [ 132.968390] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566264worker1 # [ 132.978141] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6265worker1 # [ 133.147380] nix-daemon[843]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)6266worker1 # [ 133.160142] nix-daemon[843]: reaped child process 1606, status = succeeded6267worker1 # [ 133.317166] nix-daemon[843]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6268worker1 # [ 133.328497] nix-daemon[843]: reaped child process 1611, status = succeeded6269lb # [ 133.350209] niks3-server[1040]: 2026/09/20 08:09:37 INFO Received uploads request method=POST path=/api/pending_closures6270worker1 # [ 133.354418] nix-grpc-daemon[1396]: time=2026-09-20T08:09:37.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6271worker1 # [ 133.355927] nix-grpc-daemon[1396]: time=2026-09-20T08:09:37.449Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6272lb # [ 133.380882] niks3-server[1040]: 2026/09/20 08:09:37 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6273lb # [ 133.394075] niks3-server[1040]: 2026/09/20 08:09:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6274lb # [ 133.399335] niks3-server[1040]: 2026/09/20 08:09:37 INFO Signed narinfos id=46 count=16275worker1 # [ 133.396706] nix-grpc-daemon[1396]: time=2026-09-20T08:09:37.489Z level=INFO msg="Uploading 1 narinfos"6276lb # [ 133.406945] niks3-server[1040]: 2026/09/20 08:09:37 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6277lb # [ 133.417109] niks3-server[1040]: 2026/09/20 08:09:37 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6278worker1 # [ 133.417983] nix-grpc-daemon[1396]: time=2026-09-20T08:09:37.511Z level=INFO msg="Upload complete. (429ms)"6279lb # [ 133.424207] niks3-server[1040]: 2026/09/20 08:09:37 INFO Completed upload id=466280lb # [ 133.427088] niks3-server[1040]: 2026/09/20 08:09:37 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6281worker1 # [ 133.421402] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=5046282worker1 # [ 133.427171] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566283worker1 # [ 133.437127] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6284worker1 # [ 133.440805] nix-daemon[843]: reaped child process 1601, status = succeeded6285worker1 # [ 133.446096] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6286worker1 # [ 134.459974] nix-daemon[843]: reaped child process 1615, status = succeeded6287worker1 # [ 134.611802] nix-daemon[843]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)6288worker1 # [ 134.622478] nix-daemon[843]: reaped child process 1633, status = succeeded6289lb # [ 134.644272] niks3-server[1040]: 2026/09/20 08:09:38 INFO Received uploads request method=POST path=/api/pending_closures6290worker1 # [ 134.643438] nix-grpc-daemon[1396]: time=2026-09-20T08:09:38.736Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6291worker1 # [ 134.644950] nix-grpc-daemon[1396]: time=2026-09-20T08:09:38.738Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6292lb # [ 134.667203] niks3-server[1040]: 2026/09/20 08:09:38 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6293lb # [ 134.671883] niks3-server[1040]: 2026/09/20 08:09:38 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6294lb # [ 134.675621] niks3-server[1040]: 2026/09/20 08:09:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6295lb # [ 134.677600] niks3-server[1040]: 2026/09/20 08:09:38 INFO Signed narinfos id=47 count=16296worker1 # [ 134.673032] nix-grpc-daemon[1396]: time=2026-09-20T08:09:38.766Z level=INFO msg="Uploading 1 narinfos"6297lb # [ 134.679792] niks3-server[1040]: 2026/09/20 08:09:38 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6298lb # [ 134.685132] niks3-server[1040]: 2026/09/20 08:09:38 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6299lb # [ 134.688643] niks3-server[1040]: 2026/09/20 08:09:38 INFO Completed upload id=476300worker1 # [ 134.682751] nix-grpc-daemon[1396]: time=2026-09-20T08:09:38.776Z level=INFO msg="Upload complete. (230ms)"6301lb # [ 134.690317] niks3-server[1040]: 2026/09/20 08:09:38 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6302worker1 # [ 134.685172] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16303worker1 # [ 134.691833] nix-daemon[843]: reaped child process 1613, status = succeeded6304worker2 # [ 134.671261] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:37Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16305worker1 # [ 134.730788] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566306worker2 # [ 134.716587] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:37Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06307worker1 # [ 134.740539] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566308worker1 # [ 134.749666] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566309worker1 # [ 134.758132] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6310worker1 # [ 134.923129] nix-daemon[843]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6311worker1 # [ 134.935748] nix-daemon[843]: reaped child process 1640, status = succeeded6312worker1 # [ 135.100962] nix-daemon[843]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6313worker1 # [ 135.112637] nix-daemon[843]: reaped child process 1645, status = succeeded6314lb # [ 135.134158] niks3-server[1040]: 2026/09/20 08:09:39 INFO Received uploads request method=POST path=/api/pending_closures6315worker1 # [ 135.133315] nix-grpc-daemon[1396]: time=2026-09-20T08:09:39.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6316worker1 # [ 135.135325] nix-grpc-daemon[1396]: time=2026-09-20T08:09:39.228Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6317lb # [ 135.150585] niks3-server[1040]: 2026/09/20 08:09:39 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6318lb # [ 135.154233] niks3-server[1040]: 2026/09/20 08:09:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6319lb # [ 135.156721] niks3-server[1040]: 2026/09/20 08:09:39 INFO Signed narinfos id=48 count=16320worker1 # [ 135.151108] nix-grpc-daemon[1396]: time=2026-09-20T08:09:39.244Z level=INFO msg="Uploading 1 narinfos"6321lb # [ 135.159049] niks3-server[1040]: 2026/09/20 08:09:39 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6322lb # [ 135.164268] niks3-server[1040]: 2026/09/20 08:09:39 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6323lb # [ 135.167896] niks3-server[1040]: 2026/09/20 08:09:39 INFO Completed upload id=486324worker1 # [ 135.162231] nix-grpc-daemon[1396]: time=2026-09-20T08:09:39.255Z level=INFO msg="Upload complete. (395ms)"6325lb # [ 135.169713] niks3-server[1040]: 2026/09/20 08:09:39 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6326worker1 # [ 135.164378] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=5046327worker1 # [ 135.168282] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566328worker1 # [ 135.173807] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6329worker1 # [ 135.176053] nix-daemon[843]: reaped child process 1635, status = succeeded6330worker1 # [ 135.181307] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6331lb # [ 136.581442] envoy[901]: conn peer=[2001:db8:1::1]:57398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1352 ms=128286332lb # [ 136.586429] envoy[901]: conn peer=[2001:db8:1::4]:52800 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1721 tx=529 ms=232686333worker1 # [ 136.803636] nix-daemon[843]: reaped child process 1649, status = succeeded6334worker1 # [ 136.961602] nix-daemon[843]: accepted connection from pid 1664, user nix-grpc-daemon (trusted)6335worker1 # [ 136.973453] nix-daemon[843]: reaped child process 1667, status = succeeded6336lb # [ 136.996687] niks3-server[1040]: 2026/09/20 08:09:41 INFO Received uploads request method=POST path=/api/pending_closures6337worker1 # [ 137.000556] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.093Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6338worker1 # [ 137.003579] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.095Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6339lb # [ 137.031996] niks3-server[1040]: 2026/09/20 08:09:41 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6340lb # [ 137.045615] niks3-server[1040]: 2026/09/20 08:09:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6341worker1 # [ 137.047516] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.140Z level=INFO msg="Uploading 1 narinfos"6342lb # [ 137.053640] niks3-server[1040]: 2026/09/20 08:09:41 INFO Signed narinfos id=49 count=16343lb # [ 137.061089] niks3-server[1040]: 2026/09/20 08:09:41 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6344lb # [ 137.069744] niks3-server[1040]: 2026/09/20 08:09:41 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6345lb # [ 137.075272] niks3-server[1040]: 2026/09/20 08:09:41 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6346lb # [ 137.079263] niks3-server[1040]: 2026/09/20 08:09:41 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6347lb # [ 137.081686] niks3-server[1040]: 2026/09/20 08:09:41 INFO Completed upload id=496348worker1 # [ 137.077413] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.170Z level=INFO msg="Upload complete. (287ms)"6349worker1 # [ 137.083679] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16350worker2 # [ 137.067664] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:40Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16351worker1 # [ 137.093284] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566352worker2 # [ 137.077334] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:40Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06353worker1 # [ 137.102060] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566354worker1 # [ 137.109253] nix-daemon[843]: reaped child process 1647, status = succeeded6355worker1 # [ 137.114722] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.208Z level=INFO msg="All 1 paths already cached"6356worker1 # [ 137.119072] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566357worker1 # [ 137.123131] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6358worker1 # [ 137.271273] nix-daemon[843]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)6359worker1 # [ 137.283419] nix-daemon[843]: reaped child process 1674, status = succeeded6360worker1 # [ 137.454552] nix-daemon[843]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)6361worker1 # [ 137.466546] nix-daemon[843]: reaped child process 1679, status = succeeded6362lb # [ 137.489549] niks3-server[1040]: 2026/09/20 08:09:41 INFO Received uploads request method=POST path=/api/pending_closures6363worker1 # [ 137.492915] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.586Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6364worker1 # [ 137.494305] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.586Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6365lb # [ 137.518754] niks3-server[1040]: 2026/09/20 08:09:41 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6366lb # [ 137.532269] niks3-server[1040]: 2026/09/20 08:09:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6367lb # [ 137.536451] niks3-server[1040]: 2026/09/20 08:09:41 INFO Signed narinfos id=50 count=16368worker1 # [ 137.533196] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.626Z level=INFO msg="Uploading 1 narinfos"6369lb # [ 137.542516] niks3-server[1040]: 2026/09/20 08:09:41 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6370lb # [ 137.550518] niks3-server[1040]: 2026/09/20 08:09:41 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6371lb # [ 137.554958] niks3-server[1040]: 2026/09/20 08:09:41 INFO Completed upload id=506372worker1 # [ 137.548842] nix-grpc-daemon[1396]: time=2026-09-20T08:09:41.642Z level=INFO msg="Upload complete. (419ms)"6373lb # [ 137.557185] niks3-server[1040]: 2026/09/20 08:09:41 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6374worker1 # [ 137.552528] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=6246375worker1 # [ 137.557754] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566376worker1 # [ 137.566203] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6377worker1 # [ 137.570972] nix-daemon[843]: reaped child process 1669, status = succeeded6378worker1 # [ 137.576094] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6379worker1 # [ 139.003121] nix-daemon[843]: reaped child process 1683, status = succeeded6380worker1 # [ 139.172060] nix-daemon[843]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)6381worker1 # [ 139.184411] nix-daemon[843]: reaped child process 1701, status = succeeded6382lb # [ 139.201833] niks3-server[1040]: 2026/09/20 08:09:43 INFO Received uploads request method=POST path=/api/pending_closures6383worker1 # [ 139.200948] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.294Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6384worker1 # [ 139.202814] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.296Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6385lb # [ 139.229803] niks3-server[1040]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6386lb # [ 139.235417] niks3-server[1040]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6387lb # [ 139.244677] niks3-server[1040]: 2026/09/20 08:09:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6388lb # [ 139.249652] niks3-server[1040]: 2026/09/20 08:09:43 INFO Signed narinfos id=51 count=16389worker1 # [ 139.244164] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.337Z level=INFO msg="Uploading 1 narinfos"6390lb # [ 139.252968] niks3-server[1040]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6391lb # [ 139.257986] niks3-server[1040]: 2026/09/20 08:09:43 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6392lb # [ 139.262778] niks3-server[1040]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6393lb # [ 139.266492] niks3-server[1040]: 2026/09/20 08:09:43 INFO Completed upload id=516394worker1 # [ 139.260932] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.354Z level=INFO msg="Upload complete. (276ms)"6395worker1 # [ 139.265510] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16396worker2 # [ 139.250958] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:42Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16397worker1 # [ 139.276111] nix-daemon[843]: reaped child process 1681, status = succeeded6398worker1 # [ 139.310306] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566399worker2 # [ 139.299446] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:42Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06400worker1 # [ 139.323200] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566401worker1 # [ 139.336848] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.430Z level=INFO msg="All 1 paths already cached"6402worker1 # [ 139.344427] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566403worker1 # [ 139.354173] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6404worker1 # [ 139.523652] nix-daemon[843]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)6405worker1 # [ 139.537148] nix-daemon[843]: reaped child process 1708, status = succeeded6406worker1 # [ 139.682347] nix-daemon[843]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)6407worker1 # [ 139.695722] nix-daemon[843]: reaped child process 1713, status = succeeded6408lb # [ 139.712637] niks3-server[1040]: 2026/09/20 08:09:43 INFO Received uploads request method=POST path=/api/pending_closures6409worker1 # [ 139.714654] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.806Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6410worker1 # [ 139.716075] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.806Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6411lb # [ 139.730176] niks3-server[1040]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6412lb # [ 139.733488] niks3-server[1040]: 2026/09/20 08:09:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6413lb # [ 139.735263] niks3-server[1040]: 2026/09/20 08:09:43 INFO Signed narinfos id=52 count=16414worker1 # [ 139.730883] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.824Z level=INFO msg="Uploading 1 narinfos"6415lb # [ 139.739729] niks3-server[1040]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6416lb # [ 139.743557] niks3-server[1040]: 2026/09/20 08:09:43 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6417lb # [ 139.748027] niks3-server[1040]: 2026/09/20 08:09:43 INFO Completed upload id=526418worker1 # [ 139.743494] nix-grpc-daemon[1396]: time=2026-09-20T08:09:43.836Z level=INFO msg="Upload complete. (378ms)"6419lb # [ 139.749735] niks3-server[1040]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6420worker1 # [ 139.745463] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=6246421worker1 # [ 139.748232] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566422worker1 # [ 139.755466] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6423worker1 # [ 139.757425] nix-daemon[843]: reaped child process 1703, status = succeeded6424worker1 # [ 139.762418] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6425worker1 # [ 140.576543] nix-daemon[843]: reaped child process 1717, status = succeeded6426worker1 # [ 140.722095] nix-daemon[843]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6427worker1 # [ 140.733529] nix-daemon[843]: reaped child process 1735, status = succeeded6428lb # [ 140.752207] niks3-server[1040]: 2026/09/20 08:09:44 INFO Received uploads request method=POST path=/api/pending_closures6429worker1 # [ 140.751541] nix-grpc-daemon[1396]: time=2026-09-20T08:09:44.844Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6430worker1 # [ 140.753115] nix-grpc-daemon[1396]: time=2026-09-20T08:09:44.846Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6431lb # [ 140.775221] niks3-server[1040]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6432lb # [ 140.778639] niks3-server[1040]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6433lb # [ 140.782646] niks3-server[1040]: 2026/09/20 08:09:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6434lb # [ 140.784445] niks3-server[1040]: 2026/09/20 08:09:44 INFO Signed narinfos id=53 count=16435worker1 # [ 140.778972] nix-grpc-daemon[1396]: time=2026-09-20T08:09:44.872Z level=INFO msg="Uploading 1 narinfos"6436lb # [ 140.791131] niks3-server[1040]: 2026/09/20 08:09:44 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6437lb # [ 140.794745] niks3-server[1040]: 2026/09/20 08:09:44 INFO Completed upload id=536438lb # [ 140.796416] niks3-server[1040]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6439worker1 # [ 140.790254] nix-grpc-daemon[1396]: time=2026-09-20T08:09:44.883Z level=INFO msg="Upload complete. (221ms)"6440lb # [ 140.798858] niks3-server[1040]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6441worker1 # [ 140.794069] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16442worker2 # [ 140.778589] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:44Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16443worker1 # [ 140.799953] nix-daemon[843]: reaped child process 1715, status = succeeded6444worker1 # [ 140.836935] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566445worker2 # [ 140.824306] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:44Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06446worker1 # [ 140.845730] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566447worker1 # [ 140.856596] nix-grpc-daemon[1396]: time=2026-09-20T08:09:44.949Z level=INFO msg="All 1 paths already cached"6448worker1 # [ 140.861804] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566449worker1 # [ 140.870820] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6450worker1 # [ 141.024710] nix-daemon[843]: accepted connection from pid 1739, user nix-grpc-daemon (trusted)6451worker1 # [ 141.037445] nix-daemon[843]: reaped child process 1742, status = succeeded6452worker1 # [ 141.192637] nix-daemon[843]: accepted connection from pid 1744, user nix-grpc-daemon (trusted)6453worker1 # [ 141.206973] nix-daemon[843]: reaped child process 1747, status = succeeded6454lb # [ 141.224340] niks3-server[1040]: 2026/09/20 08:09:45 INFO Received uploads request method=POST path=/api/pending_closures6455worker1 # [ 141.223487] nix-grpc-daemon[1396]: time=2026-09-20T08:09:45.316Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6456worker1 # [ 141.224872] nix-grpc-daemon[1396]: time=2026-09-20T08:09:45.316Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6457lb # [ 141.239804] niks3-server[1040]: 2026/09/20 08:09:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6458lb # [ 141.241812] niks3-server[1040]: 2026/09/20 08:09:45 INFO Signed narinfos id=54 count=16459worker1 # [ 141.237462] nix-grpc-daemon[1396]: time=2026-09-20T08:09:45.330Z level=INFO msg="Uploading 1 narinfos"6460lb # [ 141.245576] niks3-server[1040]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6461lb # [ 141.250708] niks3-server[1040]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6462lb # [ 141.252691] niks3-server[1040]: 2026/09/20 08:09:45 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6463lb # [ 141.256355] niks3-server[1040]: 2026/09/20 08:09:45 INFO Completed upload id=546464worker1 # [ 141.251779] nix-grpc-daemon[1396]: time=2026-09-20T08:09:45.345Z level=INFO msg="Upload complete. (373ms)"6465lb # [ 141.258057] niks3-server[1040]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6466worker1 # [ 141.254070] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=6246467worker1 # [ 141.256611] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566468worker1 # [ 141.264248] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6469worker1 # [ 141.266132] nix-daemon[843]: reaped child process 1737, status = succeeded6470worker1 # [ 141.271508] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6471worker1 # [ 142.284745] nix-daemon[843]: reaped child process 1751, status = succeeded6472worker1 # [ 142.433617] nix-daemon[843]: accepted connection from pid 1766, user nix-grpc-daemon (trusted)6473worker1 # [ 142.444287] nix-daemon[843]: reaped child process 1769, status = succeeded6474lb # [ 142.467357] niks3-server[1040]: 2026/09/20 08:09:46 INFO Received uploads request method=POST path=/api/pending_closures6475worker1 # [ 142.471494] nix-grpc-daemon[1396]: time=2026-09-20T08:09:46.564Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6476worker1 # [ 142.473033] nix-grpc-daemon[1396]: time=2026-09-20T08:09:46.566Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6477lb # [ 142.513152] niks3-server[1040]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6478lb # [ 142.520109] niks3-server[1040]: 2026/09/20 08:09:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6479worker1 # [ 142.522435] nix-grpc-daemon[1396]: time=2026-09-20T08:09:46.615Z level=INFO msg="Uploading 1 narinfos"6480lb # [ 142.528609] niks3-server[1040]: 2026/09/20 08:09:46 INFO Signed narinfos id=55 count=16481lb # [ 142.533486] niks3-server[1040]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6482lb # [ 142.540102] niks3-server[1040]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6483lb # [ 142.546977] niks3-server[1040]: 2026/09/20 08:09:46 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6484lb # [ 142.550281] niks3-server[1040]: 2026/09/20 08:09:46 INFO Completed upload id=556485lb # [ 142.551946] niks3-server[1040]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6486worker1 # [ 142.544727] nix-grpc-daemon[1396]: time=2026-09-20T08:09:46.638Z level=INFO msg="Upload complete. (264ms)"6487worker1 # [ 142.550662] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16488worker2 # [ 142.534848] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:45Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16489worker1 # [ 142.564470] nix-daemon[843]: reaped child process 1749, status = succeeded6490worker1 # [ 142.595249] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566491worker2 # [ 142.582715] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:45Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06492worker1 # [ 142.607735] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566493worker1 # [ 142.620377] nix-grpc-daemon[1396]: time=2026-09-20T08:09:46.713Z level=INFO msg="All 2 paths already cached"6494worker1 # [ 142.627306] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566495worker1 # [ 142.635466] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6496worker1 # [ 142.802241] nix-daemon[843]: accepted connection from pid 1773, user nix-grpc-daemon (trusted)6497worker1 # [ 142.814085] nix-daemon[843]: reaped child process 1776, status = succeeded6498worker1 # [ 142.966144] nix-daemon[843]: accepted connection from pid 1778, user nix-grpc-daemon (trusted)6499worker1 # [ 142.977555] nix-daemon[843]: reaped child process 1781, status = succeeded6500lb # [ 142.997707] niks3-server[1040]: 2026/09/20 08:09:47 INFO Received uploads request method=POST path=/api/pending_closures6501worker1 # [ 142.997399] nix-grpc-daemon[1396]: time=2026-09-20T08:09:47.090Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6502worker1 # [ 142.998828] nix-grpc-daemon[1396]: time=2026-09-20T08:09:47.092Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6503lb # [ 143.018411] niks3-server[1040]: 2026/09/20 08:09:47 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6504lb # [ 143.021115] niks3-server[1040]: 2026/09/20 08:09:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6505lb # [ 143.023300] niks3-server[1040]: 2026/09/20 08:09:47 INFO Signed narinfos id=56 count=16506worker1 # [ 143.019062] nix-grpc-daemon[1396]: time=2026-09-20T08:09:47.112Z level=INFO msg="Uploading 1 narinfos"6507lb # [ 143.027312] niks3-server[1040]: 2026/09/20 08:09:47 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6508lb # [ 143.033108] niks3-server[1040]: 2026/09/20 08:09:47 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6509lb # [ 143.035602] niks3-server[1040]: 2026/09/20 08:09:47 INFO Completed upload id=566510worker1 # [ 143.029810] nix-grpc-daemon[1396]: time=2026-09-20T08:09:47.123Z level=INFO msg="Upload complete. (380ms)"6511worker1 # [ 143.031578] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=7526512lb # [ 143.038063] niks3-server[1040]: 2026/09/20 08:09:47 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6513worker1 # [ 143.034513] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566514worker1 # [ 143.040902] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6515worker1 # [ 143.043121] nix-daemon[843]: reaped child process 1771, status = succeeded6516worker1 # [ 143.048798] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6517worker1 # [ 144.272908] nix-daemon[843]: reaped child process 1785, status = succeeded6518worker1 # [ 144.415087] nix-daemon[843]: accepted connection from pid 1800, user nix-grpc-daemon (trusted)6519worker1 # [ 144.425846] nix-daemon[843]: reaped child process 1803, status = succeeded6520lb # [ 144.443867] niks3-server[1040]: 2026/09/20 08:09:48 INFO Received uploads request method=POST path=/api/pending_closures6521worker1 # [ 144.453871] nix-grpc-daemon[1396]: time=2026-09-20T08:09:48.547Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6522worker1 # [ 144.455635] nix-grpc-daemon[1396]: time=2026-09-20T08:09:48.548Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6523lb # [ 144.484065] niks3-server[1040]: 2026/09/20 08:09:48 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6524lb # [ 144.495878] niks3-server[1040]: 2026/09/20 08:09:48 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6525lb # [ 144.505526] niks3-server[1040]: 2026/09/20 08:09:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6526lb # [ 144.509713] niks3-server[1040]: 2026/09/20 08:09:48 INFO Signed narinfos id=57 count=16527worker1 # [ 144.506426] nix-grpc-daemon[1396]: time=2026-09-20T08:09:48.599Z level=INFO msg="Uploading 1 narinfos"6528lb # [ 144.515362] niks3-server[1040]: 2026/09/20 08:09:48 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6529lb # [ 144.522648] niks3-server[1040]: 2026/09/20 08:09:48 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6530lb # [ 144.525638] niks3-server[1040]: 2026/09/20 08:09:48 INFO Completed upload id=576531lb # [ 144.528408] niks3-server[1040]: 2026/09/20 08:09:48 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6532worker1 # [ 144.519761] nix-grpc-daemon[1396]: time=2026-09-20T08:09:48.613Z level=INFO msg="Upload complete. (262ms)"6533worker2 # [ 144.508594] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:47Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16534worker1 # [ 144.526695] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16535worker1 # [ 144.533732] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566536worker1 # [ 144.544687] nix-daemon[843]: reaped child process 1783, status = succeeded6537worker1 # [ 144.576409] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566538worker1 # [ 144.589391] nix-grpc-daemon[1396]: time=2026-09-20T08:09:48.682Z level=INFO msg="All 2 paths already cached"6539worker1 # [ 144.596729] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566540worker1 # [ 144.606162] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6541worker1 # [ 144.761538] nix-daemon[843]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6542worker1 # [ 144.773510] nix-daemon[843]: reaped child process 1810, status = succeeded6543worker1 # [ 144.925089] nix-daemon[843]: accepted connection from pid 1812, user nix-grpc-daemon (trusted)6544worker1 # [ 144.936574] nix-daemon[843]: reaped child process 1815, status = succeeded6545lb # [ 144.957072] niks3-server[1040]: 2026/09/20 08:09:49 INFO Received uploads request method=POST path=/api/pending_closures6546worker1 # [ 144.958933] nix-grpc-daemon[1396]: time=2026-09-20T08:09:49.052Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6547worker1 # [ 144.960830] nix-grpc-daemon[1396]: time=2026-09-20T08:09:49.053Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6548lb # [ 144.982923] niks3-server[1040]: 2026/09/20 08:09:49 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6549lb # [ 144.993714] niks3-server[1040]: 2026/09/20 08:09:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6550lb # [ 144.998340] niks3-server[1040]: 2026/09/20 08:09:49 INFO Signed narinfos id=58 count=16551worker1 # [ 144.995328] nix-grpc-daemon[1396]: time=2026-09-20T08:09:49.088Z level=INFO msg="Uploading 1 narinfos"6552lb # [ 145.003756] niks3-server[1040]: 2026/09/20 08:09:49 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6553lb # [ 145.015659] niks3-server[1040]: 2026/09/20 08:09:49 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6554lb # [ 145.021420] niks3-server[1040]: 2026/09/20 08:09:49 INFO Completed upload id=586555worker1 # [ 145.015454] nix-grpc-daemon[1396]: time=2026-09-20T08:09:49.108Z level=INFO msg="Upload complete. (398ms)"6556lb # [ 145.024138] niks3-server[1040]: 2026/09/20 08:09:49 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6557worker1 # [ 145.020131] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=7526558worker1 # [ 145.024916] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566559worker1 # [ 145.032258] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6560worker1 # [ 145.036825] nix-daemon[843]: reaped child process 1805, status = succeeded6561worker1 # [ 145.042761] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6562worker1 # [ 146.063470] nix-daemon[843]: reaped child process 1819, status = succeeded6563worker1 # [ 146.211078] nix-daemon[843]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6564worker1 # [ 146.221872] nix-daemon[843]: reaped child process 1837, status = succeeded6565lb # [ 146.242457] niks3-server[1040]: 2026/09/20 08:09:50 INFO Received uploads request method=POST path=/api/pending_closures6566worker1 # [ 146.244935] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.338Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6567worker1 # [ 146.248065] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.339Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6568lb # [ 146.285982] niks3-server[1040]: 2026/09/20 08:09:50 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6569lb # [ 146.291992] niks3-server[1040]: 2026/09/20 08:09:50 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6570lb # [ 146.302279] niks3-server[1040]: 2026/09/20 08:09:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6571lb # [ 146.309144] niks3-server[1040]: 2026/09/20 08:09:50 INFO Signed narinfos id=59 count=16572worker1 # [ 146.306036] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.399Z level=INFO msg="Uploading 1 narinfos"6573lb # [ 146.313327] niks3-server[1040]: 2026/09/20 08:09:50 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6574lb # [ 146.323524] niks3-server[1040]: 2026/09/20 08:09:50 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6575lb # [ 146.328891] niks3-server[1040]: 2026/09/20 08:09:50 INFO Completed upload id=596576worker1 # [ 146.323301] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.416Z level=INFO msg="Upload complete. (273ms)"6577lb # [ 146.330966] niks3-server[1040]: 2026/09/20 08:09:50 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6578worker2 # [ 146.311497] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:49Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16579worker1 # [ 146.330601] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16580worker1 # [ 146.336860] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566581worker1 # [ 146.349435] nix-daemon[843]: reaped child process 1817, status = succeeded6582worker1 # [ 146.374424] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488566583worker1 # [ 146.386537] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.479Z level=INFO msg="All 2 paths already cached"6584worker1 # [ 146.393645] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488566585worker1 # [ 146.401677] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6586worker1 # [ 146.570282] nix-daemon[843]: accepted connection from pid 1841, user nix-grpc-daemon (trusted)6587worker1 # [ 146.583085] nix-daemon[843]: reaped child process 1844, status = succeeded6588worker1 # [ 146.742346] nix-daemon[843]: accepted connection from pid 1846, user nix-grpc-daemon (trusted)6589worker1 # [ 146.753878] nix-daemon[843]: reaped child process 1849, status = succeeded6590lb # [ 146.773988] niks3-server[1040]: 2026/09/20 08:09:50 INFO Received uploads request method=POST path=/api/pending_closures6591worker1 # [ 146.775675] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.869Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6592worker1 # [ 146.777394] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.870Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6593lb # [ 146.806864] niks3-server[1040]: 2026/09/20 08:09:50 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6594lb # [ 146.811204] niks3-server[1040]: 2026/09/20 08:09:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6595lb # [ 146.816569] niks3-server[1040]: 2026/09/20 08:09:50 INFO Signed narinfos id=60 count=16596worker1 # [ 146.813882] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.907Z level=INFO msg="Uploading 1 narinfos"6597lb # [ 146.826266] niks3-server[1040]: 2026/09/20 08:09:50 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6598lb # [ 146.837652] niks3-server[1040]: 2026/09/20 08:09:50 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6599lb # [ 146.844979] niks3-server[1040]: 2026/09/20 08:09:50 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6600lb # [ 146.849292] niks3-server[1040]: 2026/09/20 08:09:50 INFO Completed upload id=606601worker1 # [ 146.843682] nix-grpc-daemon[1396]: time=2026-09-20T08:09:50.936Z level=INFO msg="Upload complete. (430ms)"6602worker1 # [ 146.848334] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=0 paths=1 nar_bytes_in=7526603worker1 # [ 146.853794] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488566604worker1 # [ 146.863184] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6605worker1 # [ 146.873396] nix-daemon[843]: reaped child process 1839, status = succeeded6606worker1 # [ 146.877818] nix-daemon[843]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)6607worker1 # [ 148.291927] nix-daemon[843]: reaped child process 1853, status = succeeded6608worker1 # [ 148.438200] nix-daemon[843]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6609worker1 # [ 148.450089] nix-daemon[843]: reaped child process 1871, status = succeeded6610lb # [ 148.472613] niks3-server[1040]: 2026/09/20 08:09:52 INFO Received uploads request method=POST path=/api/pending_closures6611worker1 # [ 148.475959] nix-grpc-daemon[1396]: time=2026-09-20T08:09:52.569Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6612worker1 # [ 148.477480] nix-grpc-daemon[1396]: time=2026-09-20T08:09:52.570Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6613lb # [ 148.506238] niks3-server[1040]: 2026/09/20 08:09:52 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6614lb # [ 148.519644] niks3-server[1040]: 2026/09/20 08:09:52 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6615lb # [ 148.530893] niks3-server[1040]: 2026/09/20 08:09:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6616worker1 # [ 148.531695] nix-grpc-daemon[1396]: time=2026-09-20T08:09:52.624Z level=INFO msg="Uploading 1 narinfos"6617lb # [ 148.537444] niks3-server[1040]: 2026/09/20 08:09:52 INFO Signed narinfos id=61 count=16618lb # [ 148.545213] niks3-server[1040]: 2026/09/20 08:09:52 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6619lb # [ 148.552470] niks3-server[1040]: 2026/09/20 08:09:52 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6620lb # [ 148.557192] niks3-server[1040]: 2026/09/20 08:09:52 INFO Completed upload id=616621worker1 # [ 148.551660] nix-grpc-daemon[1396]: time=2026-09-20T08:09:52.645Z level=INFO msg="Upload complete. (266ms)"6622lb # [ 148.559306] niks3-server[1040]: 2026/09/20 08:09:52 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6623worker1 # [ 148.557256] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48856 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16624worker1 # [ 148.569167] nix-daemon[843]: reaped child process 1851, status = succeeded6625client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.05 seconds)6626worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6627worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6628client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16629worker1 # [ 148.847701] nix-grpc-daemon[1308]: ts=2026-09-20T08:09:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488566630worker2 # [ 148.842653] nix-grpc-daemon[1821]: ts=2026-09-20T08:09:52Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06631lb # [ 156.582679] envoy[901]: conn peer=[2001:db8:1::1]:35088 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26834 tx=10631 ms=178016632client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.23 seconds)6633(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 138.34 seconds)6634subtest: low disk drains a worker and builds go to the other6635worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6636worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.03 seconds)6637worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6638worker1 # [ 270.180143] nix-grpc-daemon[1308]: ts=2026-09-20T08:11:54Z level=info event=unhealthy reason=min_free6639worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6640client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26641worker1 # [ 271.205365] nix-grpc-daemon[1308]: ts=2026-09-20T08:11:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488566642client # don't know how to build these paths:6643client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6644worker2 # [ 271.205200] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:54Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06645worker2 # [ 271.209466] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:54Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16646worker2 # [ 271.246712] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369186647worker2 # [ 271.261564] nix-grpc-daemon[1821]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)6648worker2 # [ 271.269372] nix-grpc-daemon[1821]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 2/5)6649worker2 # [ 271.391365] nix-grpc-daemon[1821]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 3/5)6650worker2 # [ 271.417335] nix-grpc-daemon[1821]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 654 ms (attempt 4/5)6651worker2 # [ 272.078072] nix-grpc-daemon[1821]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6652worker2 # [ 272.100597] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369186653client # copying 1 paths to 'lb:50051'...6654client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6655worker2 # [ 272.110813] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369186656worker2 # [ 272.120767] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6657worker2 # [ 272.144688] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:55Z level=info event=niks3_push_started pid=19056658worker2 # [ 272.489813] nix-daemon[847]: accepted connection from pid 1918, user nix-grpc-daemon (trusted)6659worker2 # [ 272.505896] nix-daemon[847]: reaped child process 1921, status = succeeded6660worker2 # [ 272.655125] nix-daemon[847]: accepted connection from pid 1923, user nix-grpc-daemon (trusted)6661worker2 # [ 272.669647] nix-daemon[847]: reaped child process 1926, status = succeeded6662lb # [ 272.705622] niks3-server[1040]: 2026/09/20 08:11:56 INFO Received uploads request method=POST path=/api/pending_closures6663worker2 # [ 272.692209] nix-grpc-daemon[1905]: time=2026-09-20T08:11:55.918Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6664worker2 # [ 272.693821] nix-grpc-daemon[1905]: time=2026-09-20T08:11:55.920Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6665lb # [ 272.750283] niks3-server[1040]: 2026/09/20 08:11:56 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6666lb # [ 272.759638] niks3-server[1040]: 2026/09/20 08:11:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6667worker2 # [ 272.747316] nix-grpc-daemon[1905]: time=2026-09-20T08:11:55.973Z level=INFO msg="Uploading 1 narinfos"6668lb # [ 272.770488] niks3-server[1040]: 2026/09/20 08:11:56 INFO Signed narinfos id=62 count=16669lb # [ 272.775788] niks3-server[1040]: 2026/09/20 08:11:56 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6670lb # [ 272.787149] niks3-server[1040]: 2026/09/20 08:11:56 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6671lb # [ 272.790721] niks3-server[1040]: 2026/09/20 08:11:56 INFO Completed upload id=626672worker2 # [ 272.768302] nix-grpc-daemon[1905]: time=2026-09-20T08:11:55.994Z level=INFO msg="Upload complete. (425ms)"6673lb # [ 272.792891] niks3-server[1040]: 2026/09/20 08:11:56 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6674worker2 # [ 272.774549] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36918 duration_s=0 paths=1 nar_bytes_in=5126675worker2 # [ 272.779299] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369186676worker2 # [ 272.791061] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6677worker2 # [ 272.795440] nix-daemon[847]: reaped child process 1903, status = succeeded6678client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6679client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6680worker2 # [ 272.800720] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6681client # farm-a> LOG-farm-a-drain6682worker2 # [ 273.814772] nix-daemon[847]: reaped child process 1930, status = succeeded6683worker2 # [ 273.950761] nix-daemon[847]: accepted connection from pid 1945, user nix-grpc-daemon (trusted)6684worker2 # [ 273.965222] nix-daemon[847]: reaped child process 1948, status = succeeded6685lb # [ 274.000808] niks3-server[1040]: 2026/09/20 08:11:58 INFO Received uploads request method=POST path=/api/pending_closures6686worker2 # [ 273.990893] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.216Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6687worker2 # [ 273.994068] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.218Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6688lb # [ 274.053084] niks3-server[1040]: 2026/09/20 08:11:58 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6689lb # [ 274.056210] niks3-server[1040]: 2026/09/20 08:11:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6690lb # [ 274.059618] niks3-server[1040]: 2026/09/20 08:11:58 INFO Signed narinfos id=63 count=16691worker2 # [ 274.037358] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.262Z level=INFO msg="Uploading 1 narinfos"6692lb # [ 274.061194] niks3-server[1040]: 2026/09/20 08:11:58 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6693lb # [ 274.068309] niks3-server[1040]: 2026/09/20 08:11:58 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6694lb # [ 274.071886] niks3-server[1040]: 2026/09/20 08:11:58 INFO Completed upload id=636695worker2 # [ 274.050333] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.276Z level=INFO msg="Upload complete. (242ms)"6696lb # [ 274.073206] niks3-server[1040]: 2026/09/20 08:11:58 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6697lb # [ 274.075330] niks3-server[1040]: 2026/09/20 08:11:58 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6698worker2 # [ 274.053587] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36918 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16699worker2 # [ 274.060321] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06700worker2 # [ 274.062415] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16701worker2 # [ 274.068206] nix-daemon[847]: reaped child process 1928, status = succeeded6702worker2 # [ 274.104423] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369186703worker2 # [ 274.114564] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369186704worker2 # [ 274.125344] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.351Z level=INFO msg="All 1 paths already cached"6705client # copying 1 paths to 'lb:50051'...6706client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6707worker2 # [ 274.130761] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369186708worker2 # [ 274.137903] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6709worker2 # [ 274.279561] nix-daemon[847]: accepted connection from pid 1954, user nix-grpc-daemon (trusted)6710worker2 # [ 274.295883] nix-daemon[847]: reaped child process 1957, status = succeeded6711worker2 # [ 274.426737] nix-daemon[847]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)6712worker2 # [ 274.442061] nix-daemon[847]: reaped child process 1962, status = succeeded6713lb # [ 274.472384] niks3-server[1040]: 2026/09/20 08:11:58 INFO Received uploads request method=POST path=/api/pending_closures6714worker2 # [ 274.458855] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.684Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6715worker2 # [ 274.460241] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.684Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6716lb # [ 274.501842] niks3-server[1040]: 2026/09/20 08:11:58 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6717lb # [ 274.511806] niks3-server[1040]: 2026/09/20 08:11:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6718worker2 # [ 274.496062] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.722Z level=INFO msg="Uploading 1 narinfos"6719lb # [ 274.518695] niks3-server[1040]: 2026/09/20 08:11:58 INFO Signed narinfos id=64 count=16720lb # [ 274.523329] niks3-server[1040]: 2026/09/20 08:11:58 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6721lb # [ 274.535992] niks3-server[1040]: 2026/09/20 08:11:58 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6722lb # [ 274.542138] niks3-server[1040]: 2026/09/20 08:11:58 INFO Completed upload id=646723worker2 # [ 274.519101] nix-grpc-daemon[1905]: time=2026-09-20T08:11:57.745Z level=INFO msg="Upload complete. (371ms)"6724worker2 # [ 274.521518] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36918 duration_s=0 paths=1 nar_bytes_in=6246725lb # [ 274.545910] niks3-server[1040]: 2026/09/20 08:11:58 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6726worker2 # [ 274.529259] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369186727worker2 # [ 274.533784] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6728worker2 # [ 274.536192] nix-daemon[847]: reaped child process 1952, status = succeeded6729worker2 # [ 274.541967] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6730client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6731client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6732client # farm-b> LOG-farm-b-drain6733worker2 # [ 275.570865] nix-daemon[847]: reaped child process 1966, status = succeeded6734worker2 # [ 275.729887] nix-daemon[847]: accepted connection from pid 1981, user nix-grpc-daemon (trusted)6735worker2 # [ 275.744449] nix-daemon[847]: reaped child process 1984, status = succeeded6736lb # [ 275.783077] niks3-server[1040]: 2026/09/20 08:11:59 INFO Received uploads request method=POST path=/api/pending_closures6737worker2 # [ 275.769318] nix-grpc-daemon[1905]: time=2026-09-20T08:11:58.995Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6738worker2 # [ 275.770883] nix-grpc-daemon[1905]: time=2026-09-20T08:11:58.997Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6739lb # [ 275.821476] niks3-server[1040]: 2026/09/20 08:11:59 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6740lb # [ 275.834461] niks3-server[1040]: 2026/09/20 08:11:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6741lb # [ 275.842074] niks3-server[1040]: 2026/09/20 08:11:59 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6742lb # [ 275.848717] niks3-server[1040]: 2026/09/20 08:11:59 INFO Signed narinfos id=65 count=16743worker2 # [ 275.828681] nix-grpc-daemon[1905]: time=2026-09-20T08:11:59.054Z level=INFO msg="Uploading 1 narinfos"6744lb # [ 275.853674] niks3-server[1040]: 2026/09/20 08:11:59 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6745lb # [ 275.864333] niks3-server[1040]: 2026/09/20 08:11:59 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6746lb # [ 275.867309] niks3-server[1040]: 2026/09/20 08:11:59 INFO Completed upload id=656747worker2 # [ 275.844782] nix-grpc-daemon[1905]: time=2026-09-20T08:11:59.071Z level=INFO msg="Upload complete. (294ms)"6748lb # [ 275.869802] niks3-server[1040]: 2026/09/20 08:11:59 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6749worker2 # [ 275.854801] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36918 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16750worker2 # [ 275.862820] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06751worker2 # [ 275.867283] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16752worker2 # [ 275.877530] nix-daemon[847]: reaped child process 1964, status = succeeded6753worker2 # [ 275.907898] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369186754worker2 # [ 275.920675] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369186755worker2 # [ 275.934553] nix-grpc-daemon[1905]: time=2026-09-20T08:11:59.160Z level=INFO msg="All 2 paths already cached"6756client # copying 1 paths to 'lb:50051'...6757client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6758worker2 # [ 275.941950] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369186759worker2 # [ 275.950459] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6760worker2 # [ 276.119614] nix-daemon[847]: accepted connection from pid 1990, user nix-grpc-daemon (trusted)6761worker2 # [ 276.134791] nix-daemon[847]: reaped child process 1993, status = succeeded6762worker2 # [ 276.292191] nix-daemon[847]: accepted connection from pid 1995, user nix-grpc-daemon (trusted)6763worker2 # [ 276.306788] nix-daemon[847]: reaped child process 1998, status = succeeded6764lb # [ 276.342771] niks3-server[1040]: 2026/09/20 08:12:00 INFO Received uploads request method=POST path=/api/pending_closures6765worker2 # [ 276.325727] nix-grpc-daemon[1905]: time=2026-09-20T08:11:59.552Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6766worker2 # [ 276.327747] nix-grpc-daemon[1905]: time=2026-09-20T08:11:59.553Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6767lb # [ 276.361380] niks3-server[1040]: 2026/09/20 08:12:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6768lb # [ 276.364377] niks3-server[1040]: 2026/09/20 08:12:00 INFO Signed narinfos id=66 count=16769worker2 # [ 276.341746] nix-grpc-daemon[1905]: time=2026-09-20T08:11:59.567Z level=INFO msg="Uploading 1 narinfos"6770lb # [ 276.366562] niks3-server[1040]: 2026/09/20 08:12:00 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6771lb # [ 276.370881] niks3-server[1040]: 2026/09/20 08:12:00 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6772lb # [ 276.375303] niks3-server[1040]: 2026/09/20 08:12:00 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6773lb # [ 276.377890] niks3-server[1040]: 2026/09/20 08:12:00 INFO Completed upload id=666774worker2 # [ 276.356377] nix-grpc-daemon[1905]: time=2026-09-20T08:11:59.582Z level=INFO msg="Upload complete. (392ms)"6775lb # [ 276.380489] niks3-server[1040]: 2026/09/20 08:12:00 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6776worker2 # [ 276.358673] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36918 duration_s=0 paths=1 nar_bytes_in=7526777worker2 # [ 276.363136] nix-grpc-daemon[1821]: ts=2026-09-20T08:11:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369186778worker2 # [ 276.371192] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6779worker2 # [ 276.372568] nix-daemon[847]: reaped child process 1988, status = succeeded6780worker2 # [ 276.378313] nix-daemon[847]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6781client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6782client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6783lb # [ 276.589627] envoy[901]: conn peer=[2001:db8:1::1]:58292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=725 tx=455 ms=1200286784client # farm-top> LOG-farm-top-drain6785worker2 # [ 277.610631] nix-daemon[847]: reaped child process 2002, status = succeeded6786worker2 # [ 277.769350] nix-daemon[847]: accepted connection from pid 2017, user nix-grpc-daemon (trusted)6787worker2 # [ 277.784430] nix-daemon[847]: reaped child process 2020, status = succeeded6788lb # [ 277.821913] niks3-server[1040]: 2026/09/20 08:12:01 INFO Received uploads request method=POST path=/api/pending_closures6789worker2 # [ 277.808407] nix-grpc-daemon[1905]: time=2026-09-20T08:12:01.034Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6790worker2 # [ 277.810209] nix-grpc-daemon[1905]: time=2026-09-20T08:12:01.036Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6791lb # [ 277.863077] niks3-server[1040]: 2026/09/20 08:12:01 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6792lb # [ 277.870247] niks3-server[1040]: 2026/09/20 08:12:01 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6793lb # [ 277.880198] niks3-server[1040]: 2026/09/20 08:12:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6794lb # [ 277.885114] niks3-server[1040]: 2026/09/20 08:12:01 INFO Signed narinfos id=67 count=16795worker2 # [ 277.862760] nix-grpc-daemon[1905]: time=2026-09-20T08:12:01.088Z level=INFO msg="Uploading 1 narinfos"6796lb # [ 277.891271] niks3-server[1040]: 2026/09/20 08:12:01 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6797lb # [ 277.899978] niks3-server[1040]: 2026/09/20 08:12:01 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6798lb # [ 277.906783] niks3-server[1040]: 2026/09/20 08:12:01 INFO Completed upload id=676799worker2 # [ 277.884069] nix-grpc-daemon[1905]: time=2026-09-20T08:12:01.110Z level=INFO msg="Upload complete. (295ms)"6800lb # [ 277.908633] niks3-server[1040]: 2026/09/20 08:12:01 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6801worker2 # [ 277.893331] nix-grpc-daemon[1821]: ts=2026-09-20T08:12:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36918 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16802worker2 # [ 277.906423] nix-daemon[847]: reaped child process 2000, status = succeeded6803client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.90 seconds)6804client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6805client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.17 seconds)6806worker1: must succeed: rm /nix/.rw-store/fill6807worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6808worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6809worker1 # [ 279.185530] nix-grpc-daemon[1308]: ts=2026-09-20T08:12:03Z level=info event=healthy reason=min_free6810worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6811(finished: subtest: low disk drains a worker and builds go to the other, in 10.53 seconds)6812(finished: run the VM test script, in 280.46 seconds)6813test script finished in 280.69s6814cleanup6815kill QemuMachine (pid 49)6816client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6817kill QemuMachine (pid 50)6818lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6819kill QemuMachine (pid 52)6820worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6821kill QemuMachine (pid 51)6822worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6823(finished: cleanup, in 1.07 seconds)6824additionally exposed symbols:6825 client, lb, worker1, worker2,6826 vlan1,6827 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh