vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #287
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1: QEMU running (pid 51)14worker1 # Formatting '/build/vm-state-worker1/tmp.fMUdSVseiF', fmt=raw size=107374182415worker1 # mke2fs 1.47.4 (6-Mar-2025)16worker1 # Discarding device blocks: 0/262144 done17worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes18worker1 # Filesystem UUID: 5afac5b1-1f99-4be3-b5d6-63230f34d8ea19worker1 # Superblock backups stored on blocks:20worker1 # 32768, 98304, 163840, 22937621worker1 # 22worker1 # Allocating group tables: 0/8 done23worker1 # Writing inode tables: 0/8 done24worker1 # Creating journal (8192 blocks): done25worker2: QEMU running (pid 52)26worker2 # Disk image does not exist, creating the virtualisation disk image...27worker1 # Writing superblocks and filesystem accounting information: 0/8 done28lb # Disk image does not exist, creating the virtualisation disk image...29lb: QEMU running (pid 50)30worker2 # Formatting '/build/vm-state-worker2/tmp.h34QC0AKM6', fmt=raw size=107374182431worker1 # 32worker2 # mke2fs 1.47.4 (6-Mar-2025)33worker1 # Virtualisation disk image created.34worker2 # Discarding device blocks: 0/262144 done35lb # Formatting '/build/vm-state-lb/tmp.pheXLHPe4C', fmt=raw size=107374182436worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes37lb # mke2fs 1.47.4 (6-Mar-2025)38worker2 # Filesystem UUID: b0f8035e-8a09-480a-bc3e-2fd3a51f7f3539lb # Discarding device blocks: 0/262144 done40worker2 # Superblock backups stored on blocks:41lb # Creating filesystem with 262144 4k blocks and 65536 inodes42worker2 # 32768, 98304, 163840, 22937643lb # Filesystem UUID: 7728f80d-ed4c-46fb-9ec7-61fd98563cb244worker2 # 45lb # Superblock backups stored on blocks:46worker2 # Allocating group tables: 0/8 done47client # Disk image does not exist, creating the virtualisation disk image...48client: QEMU running (pid 49)49lb # 32768, 98304, 163840, 22937650worker2 # Writing inode tables: 0/8 done51lb # 52worker2 # Creating journal (8192 blocks): done53(finished: start all VMs, in 0.19 seconds)54client # Formatting '/build/vm-state-client/tmp.ZzLM9SU01E', fmt=raw size=107374182455lb # Allocating group tables: 0/8 done56worker2 # Writing superblocks and filesystem accounting information: 0/8 done57client: waiting for unit network-addresses-eth1.service58client # mke2fs 1.47.4 (6-Mar-2025)59lb # Writing inode tables: 0/8 done60worker2 # 61client: waiting for the VM to finish booting62client # Discarding device blocks: 0/262144 done63lb # Creating journal (8192 blocks): done64client # Creating filesystem with 262144 4k blocks and 65536 inodes65lb # Writing superblocks and filesystem accounting information: 0/8 done66client # Filesystem UUID: c924fcc4-43c6-4692-8d3b-17d04997c79367lb # 68client # Superblock backups stored on blocks:69lb # Virtualisation disk image created.70client # 32768, 98304, 163840, 22937671worker2 # Virtualisation disk image created.72client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87worker1 # 88worker1 # 89worker1 # 90worker1 # 91worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092lb # 93lb # 94lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0095worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...96worker1 # 97worker1 # 98lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99lb # 100lb # 101lb # 102lb # 103lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104client # 105client # 106worker2 # 107worker2 # 108client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00109lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...110lb # 111lb # 112worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00113client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...114client # 115client # 116client # 117client # 118worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...119worker2 # 120worker2 # 121worker2 # 122worker2 # 123client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00124worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00125client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126client # 127client # 128worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker2 # 130worker2 # 131worker1 # Booting from ROM...132lb # Booting from ROM...133client # Booting from ROM...134worker2 # Booting from ROM...135worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/91qbw423h3kdggzh5653wrgbzgayssdi-nixos-system-worker1-test/init regInfo=/nix/store/bh5pvr08kd4fj8v9yylwgb34ivqqrysj-closure-info/registration console=ttyS0,115200n8 console=tty0137worker1 # [ 0.000000] BIOS-provided physical RAM map:138worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148worker1 # [ 0.000000] NX (Execute Disable) protection: active149worker1 # [ 0.000000] APIC: Static calls initialized150worker1 # [ 0.000000] SMBIOS 2.8 present.151worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152worker1 # [ 0.000000] DMI: Memory slots populated: 1/1153worker1 # [ 0.000000] Hypervisor detected: KVM154worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000155worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00156worker1 # [ 0.000000] kvm-clock: using sched offset of 456747326 cycles157worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns158worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor159worker1 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000160worker1 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs161worker1 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT162worker1 # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f]163worker1 # [ 0.002746] Using GB pages for direct mapping164worker1 # [ 0.002896] RAMDISK: [mem 0x5e367000-0x5ffcffff]165worker1 # [ 0.002904] ACPI: Early table checksum verification disabled166client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026167worker1 # [ 0.002907] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )168lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026169worker1 # [ 0.002911] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)170worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026171worker1 # [ 0.002915] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)172worker1 # [ 0.002922] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)173client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test/init regInfo=/nix/store/2y2l7nq8r6mzsr0l5p9ykxj4vkg58blv-closure-info/registration console=ttyS0,115200n8 console=tty0174worker1 # [ 0.002924] ACPI: FACS 0x000000005FFE0000 000040175lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0176client # [ 0.000000] BIOS-provided physical RAM map:177lb # [ 0.000000] BIOS-provided physical RAM map:178worker1 # [ 0.002926] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)179client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable180lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable181worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vjmiy2swhjja3rzm8a247wvfwbk972qp-nixos-system-worker2-test/init regInfo=/nix/store/hv3hxv3v7x15bmk98vh79xmahr9ll86q-closure-info/registration console=ttyS0,115200n8 console=tty0182worker2 # [ 0.000000] BIOS-provided physical RAM map:183worker1 # [ 0.002927] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)184client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved185lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved186worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable187client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved188worker1 # [ 0.002929] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)189lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved190worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved191client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable192lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable193worker1 # [ 0.002930] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)194worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved195client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved196lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved197worker1 # [ 0.002931] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]198worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable199client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved200lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved201worker1 # [ 0.002932] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]202worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved203client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved204lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved205worker1 # [ 0.002933] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]206worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved207client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved208lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved209worker1 # [ 0.002933] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]210client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved211worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved212lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved213worker1 # [ 0.002934] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]214worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved215client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved216lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved217client # [ 0.000000] NX (Execute Disable) protection: active218worker1 # [ 0.002934] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]219lb # [ 0.000000] NX (Execute Disable) protection: active220worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved221client # [ 0.000000] APIC: Static calls initialized222lb # [ 0.000000] APIC: Static calls initialized223worker1 # [ 0.002935] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]224client # [ 0.000000] SMBIOS 2.8 present.225worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved226worker1 # [ 0.003161] No NUMA configuration found227lb # [ 0.000000] SMBIOS 2.8 present.228worker2 # [ 0.000000] NX (Execute Disable) protection: active229worker1 # [ 0.003162] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]230worker2 # [ 0.000000] APIC: Static calls initialized231client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014232lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014233worker2 # [ 0.000000] SMBIOS 2.8 present.234worker1 # [ 0.003164] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]235client # [ 0.000000] DMI: Memory slots populated: 1/1236lb # [ 0.000000] DMI: Memory slots populated: 1/1237worker1 # [ 0.005419] Zone ranges:238client # [ 0.000000] Hypervisor detected: KVM239lb # [ 0.000000] Hypervisor detected: KVM240worker1 # [ 0.005420] DMA [mem 0x0000000000001000-0x0000000000ffffff]241client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000242worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014243lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000244worker2 # [ 0.000000] DMI: Memory slots populated: 1/1245client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00246lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00247worker1 # [ 0.005421] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]248worker2 # [ 0.000000] Hypervisor detected: KVM249worker1 # [ 0.005422] Normal empty250worker1 # [ 0.005423] Device empty251client # [ 0.000000] kvm-clock: using sched offset of 487900961 cycles252lb # [ 0.000000] kvm-clock: using sched offset of 487268835 cycles253worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000254worker1 # [ 0.005424] Movable zone start for each node255worker1 # [ 0.005424] Early memory node ranges256worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00257client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns258lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns259worker1 # [ 0.005425] node 0: [mem 0x0000000000001000-0x000000000009efff]260worker2 # [ 0.000000] kvm-clock: using sched offset of 484571167 cycles261client # [ 0.000005] tsc: Detected 2400.012 MHz processor262lb # [ 0.000005] tsc: Detected 2400.012 MHz processor263worker1 # [ 0.005426] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]264client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000265lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000266worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns267worker1 # [ 0.005427] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]268worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor269client # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs270lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs271worker1 # [ 0.005447] On node 0, zone DMA: 1 pages in unavailable ranges272worker2 # [ 0.000803] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000273client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT274lb # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT275worker1 # [ 0.005714] On node 0, zone DMA: 97 pages in unavailable ranges276client # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]277lb # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]278worker2 # [ 0.000830] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs279worker1 # [ 0.032579] On node 0, zone DMA32: 40 pages in unavailable ranges280client # [ 0.002743] Using GB pages for direct mapping281lb # [ 0.002744] Using GB pages for direct mapping282worker1 # [ 0.033032] ACPI: PM-Timer IO Port: 0x608283worker2 # [ 0.000832] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT284client # [ 0.002881] RAMDISK: [mem 0x5e366000-0x5ffcffff]285lb # [ 0.002859] RAMDISK: [mem 0x5e367000-0x5ffcffff]286worker1 # [ 0.033043] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])287worker2 # [ 0.002722] found SMP MP-table at [mem 0x000f5450-0x000f545f]288client # [ 0.002889] ACPI: Early table checksum verification disabled289lb # [ 0.002868] ACPI: Early table checksum verification disabled290worker2 # [ 0.002733] Using GB pages for direct mapping291client # [ 0.002892] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )292worker1 # [ 0.033075] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23293lb # [ 0.002871] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )294worker2 # [ 0.002833] RAMDISK: [mem 0x5e367000-0x5ffcffff]295worker1 # [ 0.033077] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)296client # [ 0.002896] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)297worker2 # [ 0.002841] ACPI: Early table checksum verification disabled298lb # [ 0.002875] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)299worker1 # [ 0.033079] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)300worker2 # [ 0.002843] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )301client # [ 0.002900] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)302lb # [ 0.002878] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)303worker1 # [ 0.033080] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)304worker2 # [ 0.002847] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)305client # [ 0.002906] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)306worker1 # [ 0.033081] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)307lb # [ 0.002885] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)308client # [ 0.002908] ACPI: FACS 0x000000005FFE0000 000040309worker2 # [ 0.002850] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)310lb # [ 0.002887] ACPI: FACS 0x000000005FFE0000 000040311worker1 # [ 0.033082] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)312client # [ 0.002909] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)313worker1 # [ 0.033084] ACPI: Using ACPI (MADT) for SMP configuration information314worker2 # [ 0.002857] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)315lb # [ 0.002889] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)316worker2 # [ 0.002860] ACPI: FACS 0x000000005FFE0000 000040317worker1 # [ 0.033085] ACPI: HPET id: 0x8086a201 base: 0xfed00000318client # [ 0.002911] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)319worker1 # [ 0.033088] TSC deadline timer available320lb # [ 0.002890] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)321worker1 # [ 0.033093] CPU topo: Max. logical packages: 1322worker2 # [ 0.002861] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)323client # [ 0.002912] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)324worker1 # [ 0.033093] CPU topo: Max. logical dies: 1325lb # [ 0.002892] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)326worker2 # [ 0.002863] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)327worker1 # [ 0.033094] CPU topo: Max. dies per package: 1328client # [ 0.002914] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)329worker1 # [ 0.033099] CPU topo: Max. threads per core: 1330lb # [ 0.002893] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)331worker2 # [ 0.002864] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)332client # [ 0.002915] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]333worker1 # [ 0.033100] CPU topo: Num. cores per package: 1334lb # [ 0.002895] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]335worker1 # [ 0.033100] CPU topo: Num. threads per package: 1336worker2 # [ 0.002866] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)337client # [ 0.002916] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]338lb # [ 0.002896] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]339worker1 # [ 0.033100] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs340client # [ 0.002917] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]341worker2 # [ 0.002867] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]342lb # [ 0.002896] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]343worker1 # [ 0.033118] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()344client # [ 0.002917] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]345worker2 # [ 0.002868] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]346lb # [ 0.002897] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]347worker1 # [ 0.033148] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]348worker2 # [ 0.002869] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]349client # [ 0.002918] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]350lb # [ 0.002897] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]351worker1 # [ 0.033150] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]352client # [ 0.002918] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]353worker2 # [ 0.002869] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]354lb # [ 0.002898] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]355worker1 # [ 0.033151] [mem 0x60000000-0xafffffff] available for PCI devices356client # [ 0.002919] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]357worker2 # [ 0.002869] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]358worker1 # [ 0.033152] Booting paravirtualized kernel on KVM359lb # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]360client # [ 0.003146] No NUMA configuration found361lb # [ 0.003131] No NUMA configuration found362worker2 # [ 0.002870] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]363client # [ 0.003147] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]364lb # [ 0.003132] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]365worker1 # [ 0.033156] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns366worker2 # [ 0.002870] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]367client # [ 0.003149] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]368lb # [ 0.003134] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]369worker2 # [ 0.003096] No NUMA configuration found370worker1 # [ 0.037607] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1371client # [ 0.005413] Zone ranges:372lb # [ 0.005517] Zone ranges:373client # [ 0.005414] DMA [mem 0x0000000000001000-0x0000000000ffffff]374worker1 # [ 0.039780] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152375lb # [ 0.005518] DMA [mem 0x0000000000001000-0x0000000000ffffff]376worker2 # [ 0.003097] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]377worker2 # [ 0.003100] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]378worker1 # [ 0.039824] kvm-guest: PV spinlocks disabled, single CPU379client # [ 0.005415] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]380lb # [ 0.005520] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]381worker2 # [ 0.005370] Zone ranges:382client # [ 0.005416] Normal empty383lb # [ 0.005521] Normal empty384client # [ 0.005417] Device empty385lb # [ 0.005522] Device empty386worker2 # [ 0.005370] DMA [mem 0x0000000000001000-0x0000000000ffffff]387client # [ 0.005418] Movable zone start for each node388lb # [ 0.005522] Movable zone start for each node389client # [ 0.005418] Early memory node ranges390worker2 # [ 0.005372] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]391lb # [ 0.005523] Early memory node ranges392worker2 # [ 0.005373] Normal empty393client # [ 0.005419] node 0: [mem 0x0000000000001000-0x000000000009efff]394worker2 # [ 0.005374] Device empty395lb # [ 0.005523] node 0: [mem 0x0000000000001000-0x000000000009efff]396worker2 # [ 0.005374] Movable zone start for each node397client # [ 0.005420] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]398lb # [ 0.005524] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]399worker2 # [ 0.005375] Early memory node ranges400worker1 # [ 0.039825] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/91qbw423h3kdggzh5653wrgbzgayssdi-nixos-system-worker1-test/init regInfo=/nix/store/bh5pvr08kd4fj8v9yylwgb34ivqqrysj-closure-info/registration console=ttyS0,115200n8 console=tty0401client # [ 0.005421] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]402lb # [ 0.005525] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]403worker2 # [ 0.005375] node 0: [mem 0x0000000000001000-0x000000000009efff]404client # [ 0.005440] On node 0, zone DMA: 1 pages in unavailable ranges405lb # [ 0.005546] On node 0, zone DMA: 1 pages in unavailable ranges406worker2 # [ 0.005376] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]407client # [ 0.005713] On node 0, zone DMA: 97 pages in unavailable ranges408lb # [ 0.005823] On node 0, zone DMA: 97 pages in unavailable ranges409worker1 # [ 0.039918] Unknown kernel command line parameters "regInfo=/nix/store/bh5pvr08kd4fj8v9yylwgb34ivqqrysj-closure-info/registration", will be passed to user space.410worker2 # [ 0.005377] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]411worker1 # [ 0.039930] random: crng init done412client # [ 0.032565] On node 0, zone DMA32: 40 pages in unavailable ranges413lb # [ 0.033923] On node 0, zone DMA32: 40 pages in unavailable ranges414worker2 # [ 0.005397] On node 0, zone DMA: 1 pages in unavailable ranges415client # [ 0.033025] ACPI: PM-Timer IO Port: 0x608416worker1 # [ 0.039931] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes417lb # [ 0.034388] ACPI: PM-Timer IO Port: 0x608418worker2 # [ 0.005660] On node 0, zone DMA: 97 pages in unavailable ranges419client # [ 0.033036] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])420lb # [ 0.034399] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])421worker1 # [ 0.042073] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)422worker2 # [ 0.032664] On node 0, zone DMA32: 40 pages in unavailable ranges423client # [ 0.033063] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23424lb # [ 0.034428] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23425worker2 # [ 0.033120] ACPI: PM-Timer IO Port: 0x608426worker1 # [ 0.043146] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)427client # [ 0.033065] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)428worker1 # [ 0.043176] Fallback order for Node 0: 0429lb # [ 0.034431] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)430worker2 # [ 0.033131] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])431client # [ 0.033067] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)432worker1 # [ 0.043179] Built 1 zonelists, mobility grouping on. Total pages: 393078433lb # [ 0.034433] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)434worker2 # [ 0.033157] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23435worker1 # [ 0.043180] Policy zone: DMA32436client # [ 0.033068] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)437lb # [ 0.034434] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)438worker2 # [ 0.033160] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)439worker1 # [ 0.045944] mem auto-init: stack:all(zero), heap alloc:on, heap free:off440client # [ 0.033069] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)441lb # [ 0.034435] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)442worker2 # [ 0.033162] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)443worker1 # [ 0.049052] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1444client # [ 0.033070] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)445worker1 # [ 0.052390] allocated 3145728 bytes of page_ext446worker2 # [ 0.033163] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)447lb # [ 0.034436] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)448client # [ 0.033072] ACPI: Using ACPI (MADT) for SMP configuration information449worker1 # [ 0.062472] ftrace: allocating 48731 entries in 192 pages450lb # [ 0.034438] ACPI: Using ACPI (MADT) for SMP configuration information451worker2 # [ 0.033164] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)452worker1 # [ 0.062474] ftrace: allocated 192 pages with 2 groups453client # [ 0.033073] ACPI: HPET id: 0x8086a201 base: 0xfed00000454lb # [ 0.034439] ACPI: HPET id: 0x8086a201 base: 0xfed00000455client # [ 0.033077] TSC deadline timer available456worker2 # [ 0.033165] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)457lb # [ 0.034443] TSC deadline timer available458worker1 # [ 0.063328] Dynamic Preempt: lazy459client # [ 0.033080] CPU topo: Max. logical packages: 1460worker1 # [ 0.063474] rcu: Preemptible hierarchical RCU implementation.461lb # [ 0.034447] CPU topo: Max. logical packages: 1462worker2 # [ 0.033167] ACPI: Using ACPI (MADT) for SMP configuration information463client # [ 0.033081] CPU topo: Max. logical dies: 1464worker1 # [ 0.063474] rcu: RCU event tracing is enabled.465lb # [ 0.034448] CPU topo: Max. logical dies: 1466worker2 # [ 0.033168] ACPI: HPET id: 0x8086a201 base: 0xfed00000467client # [ 0.033082] CPU topo: Max. dies per package: 1468worker2 # [ 0.033171] TSC deadline timer available469lb # [ 0.034449] CPU topo: Max. dies per package: 1470worker1 # [ 0.063475] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.471client # [ 0.033085] CPU topo: Max. threads per core: 1472worker2 # [ 0.033175] CPU topo: Max. logical packages: 1473lb # [ 0.034452] CPU topo: Max. threads per core: 1474worker1 # [ 0.063477] Trampoline variant of Tasks RCU enabled.475client # [ 0.033086] CPU topo: Num. cores per package: 1476lb # [ 0.034453] CPU topo: Num. cores per package: 1477worker1 # [ 0.063477] Rude variant of Tasks RCU enabled.478worker2 # [ 0.033175] CPU topo: Max. logical dies: 1479client # [ 0.033086] CPU topo: Num. threads per package: 1480worker2 # [ 0.033176] CPU topo: Max. dies per package: 1481lb # [ 0.034454] CPU topo: Num. threads per package: 1482worker1 # [ 0.063477] Tracing variant of Tasks RCU enabled.483client # [ 0.033086] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs484worker2 # [ 0.033179] CPU topo: Max. threads per core: 1485lb # [ 0.034454] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs486worker1 # [ 0.063478] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.487worker2 # [ 0.033180] CPU topo: Num. cores per package: 1488client # [ 0.033103] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()489lb # [ 0.034473] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()490worker2 # [ 0.033180] CPU topo: Num. threads per package: 1491worker1 # [ 0.063479] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1492client # [ 0.033134] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]493worker2 # [ 0.033181] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs494lb # [ 0.034506] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]495worker1 # [ 0.063500] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.496worker2 # [ 0.033198] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()497client # [ 0.033135] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]498lb # [ 0.034508] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]499client # [ 0.033137] [mem 0x60000000-0xafffffff] available for PCI devices500lb # [ 0.034509] [mem 0x60000000-0xafffffff] available for PCI devices501worker2 # [ 0.033229] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]502worker1 # [ 0.063502] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.503client # [ 0.033139] Booting paravirtualized kernel on KVM504lb # [ 0.034511] Booting paravirtualized kernel on KVM505worker1 # [ 0.063503] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.506worker2 # [ 0.033230] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]507client # [ 0.033141] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns508worker1 # [ 0.067868] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16509lb # [ 0.034514] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns510worker2 # [ 0.033232] [mem 0x60000000-0xafffffff] available for PCI devices511worker2 # [ 0.033233] Booting paravirtualized kernel on KVM512client # [ 0.037592] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1513worker1 # [ 0.068142] rcu: srcu_init: Setting srcu_struct sizes based on contention.514lb # [ 0.038990] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1515client # [ 0.039767] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152516worker2 # [ 0.033236] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns517lb # [ 0.041531] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152518worker1 # [ 0.068149] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns519client # [ 0.039810] kvm-guest: PV spinlocks disabled, single CPU520lb # [ 0.041577] kvm-guest: PV spinlocks disabled, single CPU521worker2 # [ 0.037701] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1522worker1 # [ 0.068252] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)523worker1 # [ 0.071791] Console: colour VGA+ 80x25524worker2 # [ 0.040163] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152525worker1 # [ 0.071795] printk: legacy console [tty0] enabled526worker2 # [ 0.040208] kvm-guest: PV spinlocks disabled, single CPU527worker1 # [ 0.101272] printk: legacy console [ttyS0] enabled528worker1 # [ 0.196543] ACPI: Core revision 20250807529client # [ 0.039811] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test/init regInfo=/nix/store/2y2l7nq8r6mzsr0l5p9ykxj4vkg58blv-closure-info/registration console=ttyS0,115200n8 console=tty0530lb # [ 0.041578] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0531worker1 # [ 0.197406] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns532client # [ 0.039903] Unknown kernel command line parameters "regInfo=/nix/store/2y2l7nq8r6mzsr0l5p9ykxj4vkg58blv-closure-info/registration", will be passed to user space.533lb # [ 0.041673] Unknown kernel command line parameters "regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration", will be passed to user space.534worker2 # [ 0.040210] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vjmiy2swhjja3rzm8a247wvfwbk972qp-nixos-system-worker2-test/init regInfo=/nix/store/hv3hxv3v7x15bmk98vh79xmahr9ll86q-closure-info/registration console=ttyS0,115200n8 console=tty0535worker1 # [ 0.198888] APIC: Switch to symmetric I/O mode setup536client # [ 0.039916] random: crng init done537lb # [ 0.041686] random: crng init done538worker1 # [ 0.199815] x2apic enabled539client # [ 0.039917] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes540lb # [ 0.041687] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes541worker2 # [ 0.040301] Unknown kernel command line parameters "regInfo=/nix/store/hv3hxv3v7x15bmk98vh79xmahr9ll86q-closure-info/registration", will be passed to user space.542worker1 # [ 0.200547] APIC: Switched APIC routing to: physical x2apic543client # [ 0.042065] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)544lb # [ 0.043936] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)545worker2 # [ 0.040314] random: crng init done546client # [ 0.043403] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)547lb # [ 0.045053] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)548worker2 # [ 0.040315] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes549client # [ 0.043434] Fallback order for Node 0: 0550lb # [ 0.045086] Fallback order for Node 0: 0551worker1 # [ 0.202293] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1552worker2 # [ 0.042463] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)553client # [ 0.043437] Built 1 zonelists, mobility grouping on. Total pages: 393078554lb # [ 0.045088] Built 1 zonelists, mobility grouping on. Total pages: 393078555client # [ 0.043438] Policy zone: DMA32556lb # [ 0.045089] Policy zone: DMA32557worker2 # [ 0.043529] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)558client # [ 0.045937] mem auto-init: stack:all(zero), heap alloc:on, heap free:off559worker1 # [ 0.203228] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns560worker2 # [ 0.043560] Fallback order for Node 0: 0561lb # [ 0.047706] mem auto-init: stack:all(zero), heap alloc:on, heap free:off562client # [ 0.049118] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1563worker2 # [ 0.043563] Built 1 zonelists, mobility grouping on. Total pages: 393078564lb # [ 0.051012] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1565client # [ 0.052450] allocated 3145728 bytes of page_ext566worker2 # [ 0.043564] Policy zone: DMA32567worker1 # [ 0.204791] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)568lb # [ 0.054805] allocated 3145728 bytes of page_ext569client # [ 0.062464] ftrace: allocating 48731 entries in 192 pages570worker2 # [ 0.046087] mem auto-init: stack:all(zero), heap alloc:on, heap free:off571lb # [ 0.064760] ftrace: allocating 48731 entries in 192 pages572worker1 # [ 0.206874] x86/cpu: User Mode Instruction Prevention (UMIP) activated573client # [ 0.062466] ftrace: allocated 192 pages with 2 groups574lb # [ 0.064762] ftrace: allocated 192 pages with 2 groups575client # [ 0.063552] Dynamic Preempt: lazy576worker2 # [ 0.049240] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1577lb # [ 0.065636] Dynamic Preempt: lazy578worker2 # [ 0.052873] allocated 3145728 bytes of page_ext579worker1 # [ 0.207956] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127580client # [ 0.063663] rcu: Preemptible hierarchical RCU implementation.581lb # [ 0.065810] rcu: Preemptible hierarchical RCU implementation.582worker2 # [ 0.062768] ftrace: allocating 48731 entries in 192 pages583client # [ 0.063663] rcu: RCU event tracing is enabled.584lb # [ 0.065811] rcu: RCU event tracing is enabled.585worker1 # [ 0.208789] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0586worker2 # [ 0.062769] ftrace: allocated 192 pages with 2 groups587client # [ 0.063664] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.588worker2 # [ 0.063579] Dynamic Preempt: lazy589lb # [ 0.065812] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.590client # [ 0.063665] Trampoline variant of Tasks RCU enabled.591worker2 # [ 0.063668] rcu: Preemptible hierarchical RCU implementation.592lb # [ 0.065814] Trampoline variant of Tasks RCU enabled.593client # [ 0.063666] Rude variant of Tasks RCU enabled.594worker1 # [ 0.209792] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto595worker2 # [ 0.063669] rcu: RCU event tracing is enabled.596lb # [ 0.065814] Rude variant of Tasks RCU enabled.597client # [ 0.063666] Tracing variant of Tasks RCU enabled.598lb # [ 0.065814] Tracing variant of Tasks RCU enabled.599worker2 # [ 0.063670] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.600worker1 # [ 0.210789] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl601client # [ 0.063667] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.602worker2 # [ 0.063671] Trampoline variant of Tasks RCU enabled.603lb # [ 0.065815] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.604worker2 # [ 0.063672] Rude variant of Tasks RCU enabled.605client # [ 0.063668] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1606worker1 # [ 0.212788] Transient Scheduler Attacks: Vulnerable: No microcode607lb # [ 0.065816] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1608worker2 # [ 0.063672] Tracing variant of Tasks RCU enabled.609worker1 # [ 0.213788] Spectre V2 : Mitigation: Enhanced / Automatic IBRS610client # [ 0.063681] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.611lb # [ 0.065826] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612worker2 # [ 0.063673] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.613worker1 # [ 0.214788] Speculative Return Stack Overflow: Mitigation: Safe RET614client # [ 0.063682] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.615worker2 # [ 0.063673] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1616lb # [ 0.065828] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.617worker2 # [ 0.063694] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.618client # [ 0.063683] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.619lb # [ 0.065829] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.620client # [ 0.068069] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16621lb # [ 0.070290] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16622worker2 # [ 0.063696] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.623client # [ 0.068359] rcu: srcu_init: Setting srcu_struct sizes based on contention.624lb # [ 0.070564] rcu: srcu_init: Setting srcu_struct sizes based on contention.625worker2 # [ 0.063697] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.626worker1 # [ 0.215715] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization627client # [ 0.068366] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns628worker2 # [ 0.068222] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16629lb # [ 0.070572] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns630worker1 # [ 0.216796] Spectre V2 : Enabling IBPB for BPF631worker2 # [ 0.068508] rcu: srcu_init: Setting srcu_struct sizes based on contention.632client # [ 0.068468] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)633lb # [ 0.070681] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)634lb # [ 0.074257] Console: colour VGA+ 80x25635client # [ 0.072000] Console: colour VGA+ 80x25636worker1 # [ 0.217789] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier637worker2 # [ 0.068515] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns638client # [ 0.072003] printk: legacy console [tty0] enabled639lb # [ 0.074260] printk: legacy console [tty0] enabled640worker1 # [ 0.218789] active return thunk: srso_alias_return_thunk641client # [ 0.101390] printk: legacy console [ttyS0] enabled642lb # [ 0.103689] printk: legacy console [ttyS0] enabled643worker2 # [ 0.068615] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)644client # [ 0.196758] ACPI: Core revision 20250807645lb # [ 0.198871] ACPI: Core revision 20250807646worker2 # [ 0.072182] Console: colour VGA+ 80x25647worker1 # [ 0.219809] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'648worker2 # [ 0.072185] printk: legacy console [tty0] enabled649worker2 # [ 0.101670] printk: legacy console [ttyS0] enabled650worker1 # [ 0.220788] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'651client # [ 0.197631] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns652lb # [ 0.199723] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns653worker2 # [ 0.197497] ACPI: Core revision 20250807654worker1 # [ 0.222503] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'655lb # [ 0.201234] APIC: Switch to symmetric I/O mode setup656client # [ 0.199135] APIC: Switch to symmetric I/O mode setup657worker1 # [ 0.222788] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'658lb # [ 0.202196] x2apic enabled659client # [ 0.200159] x2apic enabled660worker2 # [ 0.198342] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns661worker1 # [ 0.223788] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'662lb # [ 0.202967] APIC: Switched APIC routing to: physical x2apic663client # [ 0.200925] APIC: Switched APIC routing to: physical x2apic664worker2 # [ 0.199830] APIC: Switch to symmetric I/O mode setup665worker1 # [ 0.224788] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'666worker2 # [ 0.200807] x2apic enabled667lb # [ 0.204751] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1668client # [ 0.202723] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1669worker2 # [ 0.201587] APIC: Switched APIC routing to: physical x2apic670worker1 # [ 0.225788] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'671worker1 # [ 0.226789] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256672lb # [ 0.205711] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns673client # [ 0.203687] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns674worker1 # [ 0.228487] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64675worker2 # [ 0.203418] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1676lb # [ 0.207339] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)677worker1 # [ 0.228788] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512678client # [ 0.205336] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)679worker2 # [ 0.204376] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns680worker1 # [ 0.229788] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024681lb # [ 0.208424] x86/cpu: User Mode Instruction Prevention (UMIP) activated682client # [ 0.206419] x86/cpu: User Mode Instruction Prevention (UMIP) activated683worker1 # [ 0.230788] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8684worker2 # [ 0.206007] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)685lb # [ 0.209512] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127686client # [ 0.207456] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127687worker2 # [ 0.207090] x86/cpu: User Mode Instruction Prevention (UMIP) activated688lb # [ 0.210336] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0689worker1 # [ 0.231788] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.690client # [ 0.208334] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0691worker2 # [ 0.208135] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127692client # [ 0.209337] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto693lb # [ 0.211340] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto694worker2 # [ 0.209005] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0695lb # [ 0.213336] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl696client # [ 0.211334] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl697worker2 # [ 0.210008] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto698lb # [ 0.214336] Transient Scheduler Attacks: Vulnerable: No microcode699client # [ 0.212334] Transient Scheduler Attacks: Vulnerable: No microcode700lb # [ 0.215336] Spectre V2 : Mitigation: Enhanced / Automatic IBRS701client # [ 0.213334] Spectre V2 : Mitigation: Enhanced / Automatic IBRS702worker2 # [ 0.212005] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl703client # [ 0.214334] Speculative Return Stack Overflow: Mitigation: Safe RET704lb # [ 0.216336] Speculative Return Stack Overflow: Mitigation: Safe RET705worker2 # [ 0.213005] Transient Scheduler Attacks: Vulnerable: No microcode706worker2 # [ 0.214004] Spectre V2 : Mitigation: Enhanced / Automatic IBRS707worker2 # [ 0.215004] Speculative Return Stack Overflow: Mitigation: Safe RET708client # [ 0.215334] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization709lb # [ 0.217336] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization710client # [ 0.217342] Spectre V2 : Enabling IBPB for BPF711lb # [ 0.219345] Spectre V2 : Enabling IBPB for BPF712worker2 # [ 0.216004] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization713client # [ 0.218335] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier714lb # [ 0.220337] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier715worker2 # [ 0.218012] Spectre V2 : Enabling IBPB for BPF716lb # [ 0.221337] active return thunk: srso_alias_return_thunk717client # [ 0.219335] active return thunk: srso_alias_return_thunk718worker2 # [ 0.219005] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier719lb # [ 0.222358] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'720client # [ 0.220355] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'721worker2 # [ 0.220005] active return thunk: srso_alias_return_thunk722lb # [ 0.223336] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'723client # [ 0.221334] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'724lb # [ 0.224336] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'725client # [ 0.222334] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'726worker2 # [ 0.221026] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'727worker2 # [ 0.222005] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'728client # [ 0.223334] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'729lb # [ 0.225336] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'730worker2 # [ 0.223004] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'731lb # [ 0.226336] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'732client # [ 0.224334] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'733worker2 # [ 0.224004] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'734lb # [ 0.227336] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'735client # [ 0.225334] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'736worker2 # [ 0.225004] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'737client # [ 0.226334] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'738lb # [ 0.228336] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'739worker2 # [ 0.226005] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'740client # [ 0.228244] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256741lb # [ 0.230335] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256742client # [ 0.229037] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64743worker2 # [ 0.227004] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'744lb # [ 0.231336] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64745client # [ 0.230049] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512746worker2 # [ 0.228901] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256747lb # [ 0.232261] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512748worker2 # [ 0.229707] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64749client # [ 0.231047] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024750lb # [ 0.233034] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024751worker2 # [ 0.230706] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512752client # [ 0.232031] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8753lb # [ 0.234025] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8754worker2 # [ 0.231709] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024755client # [ 0.232334] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.756lb # [ 0.235042] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.757worker2 # [ 0.232004] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758worker2 # [ 0.233005] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759worker1 # [ 0.266157] Freeing SMP alternatives memory: 44K760worker1 # [ 0.266792] pid_max: default: 32768 minimum: 301761worker1 # [ 0.267619] LSM: initializing lsm=capability,landlock,yama,bpf,ima762worker1 # [ 0.268830] landlock: Up and running.763worker1 # [ 0.269439] Yama: becoming mindful.764worker1 # [ 0.270001] LSM support for eBPF active765worker1 # [ 0.270909] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766worker1 # [ 0.271833] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker1 # [ 0.274507] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768worker1 # [ 0.275333] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769worker1 # [ 0.275793] ... version: 2770worker1 # [ 0.276482] ... bit width: 48771worker1 # [ 0.276791] ... generic counters: 6772worker1 # [ 0.277478] ... generic bitmap: 000000000000003f773worker1 # [ 0.277802] ... fixed-purpose counters: 0774worker1 # [ 0.278482] ... fixed-purpose bitmap: 0000000000000000775worker1 # [ 0.278791] ... value mask: 0000ffffffffffff776worker1 # [ 0.279652] ... max period: 00007fffffffffff777worker1 # [ 0.280450] ... global_ctrl mask: 000000000000003f778worker1 # [ 0.280914] signal: max sigframe size: 3376779worker1 # [ 0.281727] rcu: Hierarchical SRCU implementation.780worker1 # [ 0.282348] rcu: Max phase no-delay instances is 400.781worker1 # [ 0.287308] smp: Bringing up secondary CPUs ...782client # [ 0.266737] Freeing SMP alternatives memory: 44K783worker1 # [ 0.287804] smp: Brought up 1 node, 1 CPU784client # [ 0.267337] pid_max: default: 32768 minimum: 301785worker1 # [ 0.288449] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)786lb # [ 0.269967] Freeing SMP alternatives memory: 44K787worker2 # [ 0.266269] Freeing SMP alternatives memory: 44K788client # [ 0.268390] LSM: initializing lsm=capability,landlock,yama,bpf,ima789lb # [ 0.270340] pid_max: default: 32768 minimum: 301790worker2 # [ 0.267007] pid_max: default: 32768 minimum: 301791client # [ 0.269427] landlock: Up and running.792lb # [ 0.271475] LSM: initializing lsm=capability,landlock,yama,bpf,ima793client # [ 0.270018] Yama: becoming mindful.794worker1 # [ 0.288945] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)795worker2 # [ 0.267822] LSM: initializing lsm=capability,landlock,yama,bpf,ima796lb # [ 0.272451] landlock: Up and running.797client # [ 0.270546] LSM support for eBPF active798worker1 # [ 0.290015] devtmpfs: initialized799worker2 # [ 0.268806] landlock: Up and running.800lb # [ 0.273050] Yama: becoming mindful.801worker2 # [ 0.269432] Yama: becoming mindful.802worker1 # [ 0.290795] x86/mm: Memory block size: 128MB803lb # [ 0.273949] LSM support for eBPF active804client # [ 0.271469] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)805worker2 # [ 0.270224] LSM support for eBPF active806lb # [ 0.274450] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)807client # [ 0.272376] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)808worker2 # [ 0.271065] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)809worker1 # [ 0.292554] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)810lb # [ 0.275376] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)811worker2 # [ 0.272042] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)812worker1 # [ 0.293655] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).813client # [ 0.275194] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)814worker1 # [ 0.294901] pinctrl core: initialized pinctrl subsystem815lb # [ 0.278392] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)816worker1 # [ 0.295992] PM: RTC time: 10:49:08, date: 2026-09-20817worker2 # [ 0.274497] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)818client # [ 0.275852] Performance Events: Fam17h+ core perfctr, AMD PMU driver.819client # [ 0.276339] ... version: 2820lb # [ 0.279939] Performance Events: Fam17h+ core perfctr, AMD PMU driver.821client # [ 0.277054] ... bit width: 48822worker2 # [ 0.275523] Performance Events: Fam17h+ core perfctr, AMD PMU driver.823lb # [ 0.280345] ... version: 2824client # [ 0.277336] ... generic counters: 6825worker2 # [ 0.276010] ... version: 2826lb # [ 0.281027] ... bit width: 48827worker2 # [ 0.276713] ... bit width: 48828client # [ 0.278033] ... generic bitmap: 000000000000003f829lb # [ 0.281338] ... generic counters: 6830worker1 # [ 0.299435] NET: Registered PF_NETLINK/PF_ROUTE protocol family831worker2 # [ 0.277007] ... generic counters: 6832client # [ 0.278382] ... fixed-purpose counters: 0833lb # [ 0.282022] ... generic bitmap: 000000000000003f834worker2 # [ 0.277689] ... generic bitmap: 000000000000003f835client # [ 0.279097] ... fixed-purpose bitmap: 0000000000000000836lb # [ 0.282338] ... fixed-purpose counters: 0837worker1 # [ 0.300270] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations838worker2 # [ 0.278057] ... fixed-purpose counters: 0839client # [ 0.279337] ... value mask: 0000ffffffffffff840lb # [ 0.283003] ... fixed-purpose bitmap: 0000000000000000841worker2 # [ 0.278766] ... fixed-purpose bitmap: 0000000000000000842worker1 # [ 0.300814] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations843client # [ 0.280221] ... max period: 00007fffffffffff844lb # [ 0.283338] ... value mask: 0000ffffffffffff845worker2 # [ 0.279008] ... value mask: 0000ffffffffffff846client # [ 0.281004] ... global_ctrl mask: 000000000000003f847lb # [ 0.284183] ... max period: 00007fffffffffff848worker1 # [ 0.302068] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations849worker2 # [ 0.279854] ... max period: 00007fffffffffff850client # [ 0.281447] signal: max sigframe size: 3376851lb # [ 0.284973] ... global_ctrl mask: 000000000000003f852worker1 # [ 0.302801] audit: initializing netlink subsys (disabled)853worker2 # [ 0.280637] ... global_ctrl mask: 000000000000003f854client # [ 0.282189] rcu: Hierarchical SRCU implementation.855lb # [ 0.285450] signal: max sigframe size: 3376856worker2 # [ 0.281116] signal: max sigframe size: 3376857client # [ 0.282886] rcu: Max phase no-delay instances is 400.858worker1 # [ 0.303858] thermal_sys: Registered thermal governor 'fair_share'859lb # [ 0.286210] rcu: Hierarchical SRCU implementation.860worker2 # [ 0.281886] rcu: Hierarchical SRCU implementation.861worker1 # [ 0.303860] thermal_sys: Registered thermal governor 'bang_bang'862lb # [ 0.286880] rcu: Max phase no-delay instances is 400.863worker2 # [ 0.282595] rcu: Max phase no-delay instances is 400.864worker1 # [ 0.304765] thermal_sys: Registered thermal governor 'step_wise'865worker1 # [ 0.305479] thermal_sys: Registered thermal governor 'user_space'866worker1 # [ 0.305794] audit: type=2000 audit(1789901348.762:1): state=initialized audit_enabled=0 res=1867worker1 # [ 0.307790] thermal_sys: Registered thermal governor 'power_allocator'868client # [ 0.287853] smp: Bringing up secondary CPUs ...869worker1 # [ 0.307816] cpuidle: using governor menu870client # [ 0.288350] smp: Brought up 1 node, 1 CPU871lb # [ 0.291931] smp: Bringing up secondary CPUs ...872worker2 # [ 0.287447] smp: Bringing up secondary CPUs ...873lb # [ 0.292353] smp: Brought up 1 node, 1 CPU874client # [ 0.289052] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)875worker1 # [ 0.309964] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5876worker2 # [ 0.288020] smp: Brought up 1 node, 1 CPU877lb # [ 0.292998] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)878worker2 # [ 0.288685] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)879worker1 # [ 0.311016] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]880client # [ 0.289582] Memory: 1454584K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)881worker1 # [ 0.311794] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry882lb # [ 0.293566] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)883client # [ 0.290571] devtmpfs: initialized884worker2 # [ 0.289182] Memory: 1454584K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)885worker1 # [ 0.312800] PCI: Using configuration type 1 for base access886client # [ 0.291281] x86/mm: Memory block size: 128MB887lb # [ 0.294627] devtmpfs: initialized888worker2 # [ 0.290231] devtmpfs: initialized889lb # [ 0.295437] x86/mm: Memory block size: 128MB890worker1 # [ 0.313882] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.891worker2 # [ 0.291059] x86/mm: Memory block size: 128MB892client # [ 0.292914] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)893lb # [ 0.297239] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)894worker2 # [ 0.292774] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)895client # [ 0.293364] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).896lb # [ 0.298192] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).897client # [ 0.294415] pinctrl core: initialized pinctrl subsystem898worker2 # [ 0.293900] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).899lb # [ 0.299418] pinctrl core: initialized pinctrl subsystem900client # [ 0.295480] PM: RTC time: 10:49:08, date: 2026-09-20901worker2 # [ 0.295091] pinctrl core: initialized pinctrl subsystem902lb # [ 0.300543] PM: RTC time: 10:49:08, date: 2026-09-20903worker2 # [ 0.296186] PM: RTC time: 10:49:08, date: 2026-09-20904worker1 # [ 0.321062] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages905client # [ 0.299074] NET: Registered PF_NETLINK/PF_ROUTE protocol family906worker1 # [ 0.321793] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page907lb # [ 0.304569] NET: Registered PF_NETLINK/PF_ROUTE protocol family908worker2 # [ 0.300042] NET: Registered PF_NETLINK/PF_ROUTE protocol family909client # [ 0.299829] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations910client # [ 0.300358] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations911lb # [ 0.305853] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations912worker2 # [ 0.301485] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations913lb # [ 0.306363] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations914worker2 # [ 0.302028] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations915client # [ 0.301616] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations916worker1 # [ 0.326791] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages917client # [ 0.302345] audit: initializing netlink subsys (disabled)918lb # [ 0.307629] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations919worker2 # [ 0.303284] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations920worker1 # [ 0.327792] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page921lb # [ 0.308350] audit: initializing netlink subsys (disabled)922worker2 # [ 0.304017] audit: initializing netlink subsys (disabled)923client # [ 0.303338] audit: type=2000 audit(1789901348.786:1): state=initialized audit_enabled=0 res=1924lb # [ 0.309462] thermal_sys: Registered thermal governor 'fair_share'925client # [ 0.304524] thermal_sys: Registered thermal governor 'fair_share'926worker2 # [ 0.305010] audit: type=2000 audit(1789901348.789:1): state=initialized audit_enabled=0 res=1927lb # [ 0.309464] thermal_sys: Registered thermal governor 'bang_bang'928client # [ 0.304526] thermal_sys: Registered thermal governor 'bang_bang'929worker2 # [ 0.306139] thermal_sys: Registered thermal governor 'fair_share'930client # [ 0.305338] thermal_sys: Registered thermal governor 'step_wise'931lb # [ 0.310339] thermal_sys: Registered thermal governor 'step_wise'932worker2 # [ 0.306141] thermal_sys: Registered thermal governor 'bang_bang'933lb # [ 0.311274] thermal_sys: Registered thermal governor 'user_space'934client # [ 0.306260] thermal_sys: Registered thermal governor 'user_space'935worker2 # [ 0.307008] thermal_sys: Registered thermal governor 'step_wise'936client # [ 0.307033] thermal_sys: Registered thermal governor 'power_allocator'937lb # [ 0.312046] audit: type=2000 audit(1789901348.790:1): state=initialized audit_enabled=0 res=1938worker2 # [ 0.307936] thermal_sys: Registered thermal governor 'user_space'939client # [ 0.307358] cpuidle: using governor menu940lb # [ 0.313341] thermal_sys: Registered thermal governor 'power_allocator'941worker2 # [ 0.308733] thermal_sys: Registered thermal governor 'power_allocator'942lb # [ 0.313354] cpuidle: using governor menu943worker2 # [ 0.309027] cpuidle: using governor menu944client # [ 0.309560] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5945worker1 # [ 0.336473] ACPI: Added _OSI(Module Device)946lb # [ 0.315549] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5947worker1 # [ 0.336792] ACPI: Added _OSI(Processor Device)948worker2 # [ 0.311204] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5949client # [ 0.310594] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]950worker1 # [ 0.337499] ACPI: Added _OSI(Processor Aggregator Device)951client # [ 0.311340] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry952lb # [ 0.316568] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]953worker2 # [ 0.312237] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]954client # [ 0.312348] PCI: Using configuration type 1 for base access955lb # [ 0.317341] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry956worker2 # [ 0.313010] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry957lb # [ 0.318351] PCI: Using configuration type 1 for base access958worker2 # [ 0.314019] PCI: Using configuration type 1 for base access959client # [ 0.313440] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.960lb # [ 0.319407] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.961worker2 # [ 0.315095] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.962worker1 # [ 0.344324] ACPI: 1 ACPI AML tables successfully acquired and loaded963lb # [ 0.324569] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages964lb # [ 0.325340] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page965client # [ 0.321354] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages966worker1 # [ 0.347714] ACPI: Interpreter enabled967worker2 # [ 0.322024] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages968worker1 # [ 0.348237] ACPI: PM: (supports S0 S3 S4 S5)969client # [ 0.322337] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page970worker2 # [ 0.323008] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page971worker1 # [ 0.348792] ACPI: Using IOAPIC for interrupt routing972worker1 # [ 0.349617] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug973client # [ 0.325342] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages974lb # [ 0.330341] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages975client # [ 0.326336] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page976lb # [ 0.331338] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page977worker2 # [ 0.328008] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages978worker2 # [ 0.329008] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page979worker1 # [ 0.354791] PCI: Using E820 reservations for host bridge windows980worker1 # [ 0.355862] ACPI: Enabled 2 GPEs in block 00 to 3F981client # [ 0.336728] ACPI: Added _OSI(Module Device)982lb # [ 0.341688] ACPI: Added _OSI(Module Device)983client # [ 0.337338] ACPI: Added _OSI(Processor Device)984lb # [ 0.342340] ACPI: Added _OSI(Processor Device)985client # [ 0.338081] ACPI: Added _OSI(Processor Aggregator Device)986lb # [ 0.343090] ACPI: Added _OSI(Processor Aggregator Device)987worker1 # [ 0.364474] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])988worker2 # [ 0.340315] ACPI: Added _OSI(Module Device)989worker2 # [ 0.341009] ACPI: Added _OSI(Processor Device)990worker1 # [ 0.365216] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]991worker2 # [ 0.341723] ACPI: Added _OSI(Processor Aggregator Device)992worker1 # [ 0.365867] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]993worker1 # [ 0.366920] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]994worker1 # [ 0.368135] PCI host bridge to bus 0000:00995worker1 # [ 0.368796] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]996worker1 # [ 0.369791] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]997worker1 # [ 0.370791] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]998worker2 # [ 0.347408] ACPI: 1 ACPI AML tables successfully acquired and loaded999client # [ 0.346858] ACPI: 1 ACPI AML tables successfully acquired and loaded1000lb # [ 0.351903] ACPI: 1 ACPI AML tables successfully acquired and loaded1001worker1 # [ 0.371791] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1002worker1 # [ 0.372791] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1003worker1 # [ 0.373791] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1004worker2 # [ 0.351419] ACPI: Interpreter enabled1005worker1 # [ 0.374791] pci_bus 0000:00: root bus resource [bus 00-ff]1006client # [ 0.350751] ACPI: Interpreter enabled1007lb # [ 0.355743] ACPI: Interpreter enabled1008worker2 # [ 0.352022] ACPI: PM: (supports S0 S3 S4 S5)1009client # [ 0.351353] ACPI: PM: (supports S0 S3 S4 S5)1010lb # [ 0.356355] ACPI: PM: (supports S0 S3 S4 S5)1011client # [ 0.352056] ACPI: Using IOAPIC for interrupt routing1012worker1 # [ 0.375804] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1013worker2 # [ 0.352703] ACPI: Using IOAPIC for interrupt routing1014lb # [ 0.357015] ACPI: Using IOAPIC for interrupt routing1015client # [ 0.352390] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1016worker1 # [ 0.377220] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1017lb # [ 0.357395] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1018client # [ 0.353337] PCI: Using E820 reservations for host bridge windows1019lb # [ 0.358340] PCI: Using E820 reservations for host bridge windows1020worker2 # [ 0.355086] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1021worker2 # [ 0.356008] PCI: Using E820 reservations for host bridge windows1022client # [ 0.356428] ACPI: Enabled 2 GPEs in block 00 to 3F1023lb # [ 0.361428] ACPI: Enabled 2 GPEs in block 00 to 3F1024worker2 # [ 0.359101] ACPI: Enabled 2 GPEs in block 00 to 3F1025worker1 # [ 0.379854] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1026worker1 # [ 0.380803] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1027worker1 # [ 0.381736] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1028worker1 # [ 0.382745] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1029client # [ 0.364666] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1030lb # [ 0.370098] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1031worker2 # [ 0.366401] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1032client # [ 0.365343] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1033worker1 # [ 0.384486] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1034lb # [ 0.370345] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1035worker2 # [ 0.367013] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1036client # [ 0.366413] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1037worker2 # [ 0.368085] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1038lb # [ 0.371961] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1039client # [ 0.367463] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1040worker2 # [ 0.369131] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1041client # [ 0.368694] PCI host bridge to bus 0000:001042lb # [ 0.372464] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1043worker1 # [ 0.387808] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1044worker1 # [ 0.388624] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1045worker2 # [ 0.370359] PCI host bridge to bus 0000:001046client # [ 0.369341] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1047lb # [ 0.373693] PCI host bridge to bus 0000:001048worker2 # [ 0.371012] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1049worker1 # [ 0.389491] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1050client # [ 0.370336] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1051lb # [ 0.374343] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1052worker1 # [ 0.389797] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1053worker2 # [ 0.372007] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1054lb # [ 0.375339] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1055client # [ 0.371337] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1056worker2 # [ 0.373007] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1057lb # [ 0.376339] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1058client # [ 0.372337] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1059worker1 # [ 0.391413] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1060worker2 # [ 0.374007] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1061lb # [ 0.377339] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1062client # [ 0.373337] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1063worker2 # [ 0.375007] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1064lb # [ 0.378339] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1065client # [ 0.374336] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1066worker1 # [ 0.393800] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1067client # [ 0.375336] pci_bus 0000:00: root bus resource [bus 00-ff]1068worker2 # [ 0.376007] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1069lb # [ 0.379338] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1070worker1 # [ 0.394599] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1071worker2 # [ 0.377018] pci_bus 0000:00: root bus resource [bus 00-ff]1072lb # [ 0.380339] pci_bus 0000:00: root bus resource [bus 00-ff]1073client # [ 0.376312] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1074worker1 # [ 0.395486] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1075worker2 # [ 0.377975] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1076lb # [ 0.381246] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1077client # [ 0.377744] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1078worker1 # [ 0.396377] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1079worker2 # [ 0.379446] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1080lb # [ 0.382772] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1081worker1 # [ 0.398806] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1082worker1 # [ 0.399797] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1083worker1 # [ 0.400721] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1084worker1 # [ 0.402148] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1085client # [ 0.380426] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1086lb # [ 0.385406] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1087client # [ 0.381348] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1088worker2 # [ 0.382143] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1089lb # [ 0.386351] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1090worker1 # [ 0.403808] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1091worker2 # [ 0.383019] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1092client # [ 0.382289] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1093lb # [ 0.387269] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1094worker1 # [ 0.404618] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1095worker2 # [ 0.383966] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1096worker1 # [ 0.405480] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1097lb # [ 0.388466] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1098client # [ 0.383638] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1099worker2 # [ 0.385134] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1100worker1 # [ 0.406335] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1101client # [ 0.385083] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1102lb # [ 0.390245] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1103worker2 # [ 0.386791] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1104worker1 # [ 0.407799] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1105lb # [ 0.392355] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1106worker1 # [ 0.408623] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1107client # [ 0.388371] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1108worker2 # [ 0.390040] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1109lb # [ 0.393173] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1110client # [ 0.389211] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1111worker1 # [ 0.409502] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1112worker2 # [ 0.390888] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1113lb # [ 0.394049] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1114client # [ 0.390051] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1115worker2 # [ 0.391741] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1116lb # [ 0.394345] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1117worker1 # [ 0.410378] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1118client # [ 0.390343] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1119worker2 # [ 0.392013] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1120lb # [ 0.395832] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1121client # [ 0.392032] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1122worker1 # [ 0.412806] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1123worker2 # [ 0.393727] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1124worker1 # [ 0.413643] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1125lb # [ 0.398354] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1126client # [ 0.394372] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1127worker1 # [ 0.414493] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1128lb # [ 0.399186] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1129worker2 # [ 0.396040] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1130client # [ 0.395215] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1131lb # [ 0.400041] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1132worker2 # [ 0.396936] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1133client # [ 0.396121] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1134worker1 # [ 0.415386] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1135worker2 # [ 0.397744] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1136lb # [ 0.400881] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1137client # [ 0.397720] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1138worker1 # [ 0.416799] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1139worker2 # [ 0.398545] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1140worker1 # [ 0.417633] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1141worker1 # [ 0.418492] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1142worker1 # [ 0.418807] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1143client # [ 0.400372] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1144worker2 # [ 0.401015] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1145client # [ 0.401216] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1146lb # [ 0.403356] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1147worker2 # [ 0.401843] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1148worker1 # [ 0.420291] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1149client # [ 0.402064] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1150lb # [ 0.404960] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1151worker2 # [ 0.402743] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1152lb # [ 0.405360] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1153worker1 # [ 0.421778] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1154client # [ 0.402870] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1155worker2 # [ 0.403592] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1156worker1 # [ 0.422508] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1157lb # [ 0.406901] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1158client # [ 0.404344] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1159worker1 # [ 0.423323] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1160worker2 # [ 0.405894] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1161client # [ 0.405164] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1162lb # [ 0.408355] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1163worker2 # [ 0.406703] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1164lb # [ 0.409162] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1165client # [ 0.406079] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1166worker1 # [ 0.424823] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1167lb # [ 0.410030] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1168worker2 # [ 0.407029] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1169worker1 # [ 0.425645] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1170worker1 # [ 0.426505] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1171client # [ 0.406926] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1172worker2 # [ 0.408555] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1173lb # [ 0.410892] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1174worker1 # [ 0.427755] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1175client # [ 0.408344] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1176worker2 # [ 0.410041] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1177client # [ 0.409191] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1178lb # [ 0.413355] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1179worker2 # [ 0.410897] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1180worker1 # [ 0.429798] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1181client # [ 0.410095] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1182lb # [ 0.414195] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1183worker2 # [ 0.411734] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1184worker1 # [ 0.430600] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1185lb # [ 0.415028] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1186worker1 # [ 0.431492] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1187client # [ 0.410931] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1188worker2 # [ 0.412570] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1189lb # [ 0.415909] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1190worker1 # [ 0.432509] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1191worker1 # [ 0.434494] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1192client # [ 0.412712] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1193worker2 # [ 0.415991] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1194client # [ 0.413983] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1195worker1 # [ 0.434988] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1196lb # [ 0.418355] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1197worker2 # [ 0.416661] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1198client # [ 0.414359] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1199lb # [ 0.419962] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1200worker2 # [ 0.417030] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1201worker1 # [ 0.436436] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1202lb # [ 0.420361] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1203client # [ 0.415943] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1204worker2 # [ 0.418607] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1205lb # [ 0.421929] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1206client # [ 0.417372] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1207worker2 # [ 0.420014] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1208client # [ 0.418289] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1209lb # [ 0.423347] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1210worker2 # [ 0.420848] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1211client # [ 0.419088] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1212lb # [ 0.424189] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1213worker2 # [ 0.421745] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1214lb # [ 0.425074] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1215client # [ 0.419343] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1216worker2 # [ 0.422013] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1217lb # [ 0.425346] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1218client # [ 0.420882] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1219worker2 # [ 0.423556] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1220lb # [ 0.426929] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1221client # [ 0.422377] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1222worker2 # [ 0.425014] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1223lb # [ 0.428379] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1224client # [ 0.423358] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1225worker1 # [ 0.437006] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1226worker2 # [ 0.425971] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1227lb # [ 0.429322] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1228worker1 # [ 0.439465] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1229client # [ 0.424862] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1230worker2 # [ 0.427376] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1231lb # [ 0.430773] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1232worker1 # [ 0.440073] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1233worker2 # [ 0.429015] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1234client # [ 0.426355] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1235worker1 # [ 0.441375] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1236lb # [ 0.433243] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1237worker2 # [ 0.429858] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1238client # [ 0.427181] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1239worker1 # [ 0.442069] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1240worker2 # [ 0.431030] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1241client # [ 0.428359] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1242lb # [ 0.433970] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1243worker1 # [ 0.443097] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1244lb # [ 0.435066] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1245worker2 # [ 0.432541] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1246client # [ 0.429914] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1247worker1 # [ 0.444035] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1248lb # [ 0.435892] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1249worker2 # [ 0.434014] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1250client # [ 0.431344] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1251worker1 # [ 0.445802] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1252worker2 # [ 0.434865] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1253client # [ 0.432190] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1254worker1 # [ 0.446619] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1255lb # [ 0.437346] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1256worker2 # [ 0.435743] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1257client # [ 0.433071] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1258lb # [ 0.438157] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1259worker1 # [ 0.447813] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1260lb # [ 0.439069] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1261worker2 # [ 0.436562] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1262client # [ 0.433924] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1263worker1 # [ 0.449438] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1264lb # [ 0.439924] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1265worker2 # [ 0.437676] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1266client # [ 0.435758] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1267worker2 # [ 0.438212] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1268lb # [ 0.441718] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1269client # [ 0.436572] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1270worker1 # [ 0.453085] ACPI: PCI: Interrupt link LNKA configured for IRQ 101271worker2 # [ 0.439686] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1272lb # [ 0.442550] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1273client # [ 0.437977] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1274worker1 # [ 0.453897] ACPI: PCI: Interrupt link LNKB configured for IRQ 101275lb # [ 0.443983] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1276worker1 # [ 0.454891] ACPI: PCI: Interrupt link LNKC configured for IRQ 111277worker1 # [ 0.455890] ACPI: PCI: Interrupt link LNKD configured for IRQ 111278worker1 # [ 0.456887] ACPI: PCI: Interrupt link LNKE configured for IRQ 101279worker1 # [ 0.457886] ACPI: PCI: Interrupt link LNKF configured for IRQ 101280worker1 # [ 0.458892] ACPI: PCI: Interrupt link LNKG configured for IRQ 111281worker1 # [ 0.459891] ACPI: PCI: Interrupt link LNKH configured for IRQ 111282worker1 # [ 0.460831] ACPI: PCI: Interrupt link GSIA configured for IRQ 161283worker1 # [ 0.461806] ACPI: PCI: Interrupt link GSIB configured for IRQ 171284worker1 # [ 0.462730] ACPI: PCI: Interrupt link GSIC configured for IRQ 181285worker1 # [ 0.463523] ACPI: PCI: Interrupt link GSID configured for IRQ 191286worker1 # [ 0.463805] ACPI: PCI: Interrupt link GSIE configured for IRQ 201287worker2 # [ 0.440198] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1288worker1 # [ 0.464749] ACPI: PCI: Interrupt link GSIF configured for IRQ 211289client # [ 0.438564] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1290worker1 # [ 0.465541] ACPI: PCI: Interrupt link GSIG configured for IRQ 221291worker2 # [ 0.442625] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1292lb # [ 0.444553] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1293worker1 # [ 0.465809] ACPI: PCI: Interrupt link GSIH configured for IRQ 231294client # [ 0.441024] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1295worker2 # [ 0.443245] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1296lb # [ 0.447002] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1297client # [ 0.441564] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1298worker1 # [ 0.467778] iommu: Default domain type: Translated1299worker2 # [ 0.444554] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1300lb # [ 0.447582] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1301worker1 # [ 0.468398] iommu: DMA domain TLB invalidation policy: lazy mode1302client # [ 0.443301] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1303worker1 # [ 0.469041] ACPI: bus type USB registered1304worker2 # [ 0.445703] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1305lb # [ 0.448921] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1306worker1 # [ 0.469814] usbcore: registered new interface driver usbfs1307client # [ 0.444311] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1308worker1 # [ 0.470699] usbcore: registered new interface driver hub1309worker2 # [ 0.447250] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1310lb # [ 0.450290] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1311worker1 # [ 0.471446] usbcore: registered new device driver usb1312client # [ 0.445619] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1313worker2 # [ 0.448261] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1314lb # [ 0.451623] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1315worker1 # [ 0.472656] NetLabel: Initializing1316client # [ 0.446626] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1317worker1 # [ 0.473235] NetLabel: domain hash size = 1281318worker2 # [ 0.449997] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1319lb # [ 0.452596] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1320worker1 # [ 0.473791] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1321worker2 # [ 0.450620] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1322client # [ 0.448365] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1323worker1 # [ 0.474758] NetLabel: unlabeled traffic allowed by default1324lb # [ 0.454367] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1325worker1 # [ 0.475490] PCI: Using ACPI for IRQ routing1326client # [ 0.449318] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1327worker2 # [ 0.451328] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1328lb # [ 0.455207] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1329worker2 # [ 0.452613] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1330client # [ 0.450371] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1331lb # [ 0.456427] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1332client # [ 0.452045] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1333lb # [ 0.457999] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1334worker2 # [ 0.455916] ACPI: PCI: Interrupt link LNKA configured for IRQ 101335worker2 # [ 0.456824] ACPI: PCI: Interrupt link LNKB configured for IRQ 101336client # [ 0.455359] ACPI: PCI: Interrupt link LNKA configured for IRQ 101337worker2 # [ 0.457817] ACPI: PCI: Interrupt link LNKC configured for IRQ 111338lb # [ 0.461295] ACPI: PCI: Interrupt link LNKA configured for IRQ 101339client # [ 0.456439] ACPI: PCI: Interrupt link LNKB configured for IRQ 101340worker2 # [ 0.458808] ACPI: PCI: Interrupt link LNKD configured for IRQ 111341lb # [ 0.462193] ACPI: PCI: Interrupt link LNKB configured for IRQ 101342client # [ 0.457437] ACPI: PCI: Interrupt link LNKC configured for IRQ 111343worker2 # [ 0.459804] ACPI: PCI: Interrupt link LNKE configured for IRQ 101344lb # [ 0.463163] ACPI: PCI: Interrupt link LNKC configured for IRQ 111345worker2 # [ 0.460793] ACPI: PCI: Interrupt link LNKF configured for IRQ 101346client # [ 0.458432] ACPI: PCI: Interrupt link LNKD configured for IRQ 111347lb # [ 0.464185] ACPI: PCI: Interrupt link LNKD configured for IRQ 111348worker2 # [ 0.461798] ACPI: PCI: Interrupt link LNKG configured for IRQ 111349client # [ 0.459436] ACPI: PCI: Interrupt link LNKE configured for IRQ 101350lb # [ 0.465193] ACPI: PCI: Interrupt link LNKE configured for IRQ 101351worker2 # [ 0.463008] ACPI: PCI: Interrupt link LNKH configured for IRQ 111352client # [ 0.460441] ACPI: PCI: Interrupt link LNKF configured for IRQ 101353lb # [ 0.466229] ACPI: PCI: Interrupt link LNKF configured for IRQ 101354worker2 # [ 0.464030] ACPI: PCI: Interrupt link GSIA configured for IRQ 161355client # [ 0.461463] ACPI: PCI: Interrupt link LNKG configured for IRQ 111356lb # [ 0.467235] ACPI: PCI: Interrupt link LNKG configured for IRQ 111357worker2 # [ 0.464999] ACPI: PCI: Interrupt link GSIB configured for IRQ 171358client # [ 0.462434] ACPI: PCI: Interrupt link LNKH configured for IRQ 111359lb # [ 0.468158] ACPI: PCI: Interrupt link LNKH configured for IRQ 111360worker2 # [ 0.465715] ACPI: PCI: Interrupt link GSIC configured for IRQ 181361client # [ 0.463370] ACPI: PCI: Interrupt link GSIA configured for IRQ 161362worker2 # [ 0.466020] ACPI: PCI: Interrupt link GSID configured for IRQ 191363lb # [ 0.469059] ACPI: PCI: Interrupt link GSIA configured for IRQ 161364client # [ 0.464342] ACPI: PCI: Interrupt link GSIB configured for IRQ 171365worker2 # [ 0.466931] ACPI: PCI: Interrupt link GSIE configured for IRQ 201366lb # [ 0.469354] ACPI: PCI: Interrupt link GSIB configured for IRQ 171367client # [ 0.465280] ACPI: PCI: Interrupt link GSIC configured for IRQ 181368worker2 # [ 0.467708] ACPI: PCI: Interrupt link GSIF configured for IRQ 211369lb # [ 0.470297] ACPI: PCI: Interrupt link GSIC configured for IRQ 181370client # [ 0.466048] ACPI: PCI: Interrupt link GSID configured for IRQ 191371worker2 # [ 0.468019] ACPI: PCI: Interrupt link GSIG configured for IRQ 221372lb # [ 0.471092] ACPI: PCI: Interrupt link GSID configured for IRQ 191373client # [ 0.466350] ACPI: PCI: Interrupt link GSIE configured for IRQ 201374worker2 # [ 0.468955] ACPI: PCI: Interrupt link GSIH configured for IRQ 231375lb # [ 0.471351] ACPI: PCI: Interrupt link GSIE configured for IRQ 201376client # [ 0.467267] ACPI: PCI: Interrupt link GSIF configured for IRQ 211377lb # [ 0.472304] ACPI: PCI: Interrupt link GSIF configured for IRQ 211378client # [ 0.468051] ACPI: PCI: Interrupt link GSIG configured for IRQ 221379worker2 # [ 0.470734] iommu: Default domain type: Translated1380lb # [ 0.473127] ACPI: PCI: Interrupt link GSIG configured for IRQ 221381client # [ 0.468349] ACPI: PCI: Interrupt link GSIH configured for IRQ 231382worker2 # [ 0.471016] iommu: DMA domain TLB invalidation policy: lazy mode1383lb # [ 0.474082] ACPI: PCI: Interrupt link GSIH configured for IRQ 231384worker2 # [ 0.472178] ACPI: bus type USB registered1385client # [ 0.470276] iommu: Default domain type: Translated1386worker2 # [ 0.472902] usbcore: registered new interface driver usbfs1387lb # [ 0.475380] iommu: Default domain type: Translated1388client # [ 0.470925] iommu: DMA domain TLB invalidation policy: lazy mode1389worker2 # [ 0.473665] usbcore: registered new interface driver hub1390lb # [ 0.476168] iommu: DMA domain TLB invalidation policy: lazy mode1391client # [ 0.471586] ACPI: bus type USB registered1392worker2 # [ 0.474024] usbcore: registered new device driver usb1393lb # [ 0.477327] ACPI: bus type USB registered1394client # [ 0.472294] usbcore: registered new interface driver usbfs1395worker2 # [ 0.475664] NetLabel: Initializing1396client # [ 0.473053] usbcore: registered new interface driver hub1397lb # [ 0.477927] usbcore: registered new interface driver usbfs1398worker2 # [ 0.476008] NetLabel: domain hash size = 1281399client # [ 0.473347] usbcore: registered new device driver usb1400lb # [ 0.478354] usbcore: registered new interface driver hub1401worker2 # [ 0.476692] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1402lb # [ 0.479228] usbcore: registered new device driver usb1403worker2 # [ 0.477043] NetLabel: unlabeled traffic allowed by default1404client # [ 0.475085] NetLabel: Initializing1405worker2 # [ 0.477916] PCI: Using ACPI for IRQ routing1406client # [ 0.475343] NetLabel: domain hash size = 1281407lb # [ 0.480878] NetLabel: Initializing1408lb # [ 0.481339] NetLabel: domain hash size = 1281409client # [ 0.476096] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1410lb # [ 0.482100] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1411client # [ 0.477180] NetLabel: unlabeled traffic allowed by default1412client # [ 0.478121] PCI: Using ACPI for IRQ routing1413lb # [ 0.482378] NetLabel: unlabeled traffic allowed by default1414lb # [ 0.483351] PCI: Using ACPI for IRQ routing1415worker1 # [ 0.519411] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker1 # [ 0.519787] pci 0000:00:01.0: vgaarb: bridge control possible1417worker1 # [ 0.519787] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker1 # [ 0.519795] vgaarb: loaded1419worker1 # [ 0.520532] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker1 # [ 0.520792] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker1 # [ 0.524883] clocksource: Switched to clocksource kvm-clock1422worker1 # [ 0.526590] VFS: Disk quotas dquot_6.6.01423worker1 # [ 0.529121] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424worker1 # [ 0.530539] pnp: PnP ACPI init1425worker1 # [ 0.531375] ACPI: IRQ 4 override to edge(!), high(!)1426worker1 # [ 0.532426] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1427worker1 # [ 0.534032] pnp: PnP ACPI: found 6 devices1428worker1 # [ 0.541654] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1429worker1 # [ 0.543174] clocksource: Switched to clocksource acpi_pm1430worker1 # [ 0.544178] NET: Registered PF_INET protocol family1431worker1 # [ 0.545379] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1432worker2 # [ 0.521431] pci 0000:00:01.0: vgaarb: setting as boot VGA device1433worker2 # [ 0.522003] pci 0000:00:01.0: vgaarb: bridge control possible1434worker2 # [ 0.522003] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435worker2 # [ 0.522012] vgaarb: loaded1436worker2 # [ 0.522714] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01437worker2 # [ 0.523007] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1438client # [ 0.521930] pci 0000:00:01.0: vgaarb: setting as boot VGA device1439lb # [ 0.527593] pci 0000:00:01.0: vgaarb: setting as boot VGA device1440client # [ 0.522333] pci 0000:00:01.0: vgaarb: bridge control possible1441lb # [ 0.528335] pci 0000:00:01.0: vgaarb: bridge control possible1442client # [ 0.522333] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1443lb # [ 0.528335] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1444client # [ 0.522340] vgaarb: loaded1445lb # [ 0.528343] vgaarb: loaded1446client # [ 0.523107] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01447lb # [ 0.529090] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01448client # [ 0.523337] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1449lb # [ 0.529341] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1450worker2 # [ 0.528091] clocksource: Switched to clocksource kvm-clock1451client # [ 0.526418] clocksource: Switched to clocksource kvm-clock1452lb # [ 0.532426] clocksource: Switched to clocksource kvm-clock1453worker2 # [ 0.531649] VFS: Disk quotas dquot_6.6.01454worker2 # [ 0.532310] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1455worker1 # [ 0.561875] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1456worker2 # [ 0.533588] pnp: PnP ACPI init1457worker2 # [ 0.534318] ACPI: IRQ 4 override to edge(!), high(!)1458client # [ 0.529842] VFS: Disk quotas dquot_6.6.01459worker1 # [ 0.563412] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1460lb # [ 0.536020] VFS: Disk quotas dquot_6.6.01461client # [ 0.530562] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1462worker2 # [ 0.535259] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1463lb # [ 0.536724] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1464worker1 # [ 0.564727] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1465client # [ 0.531880] pnp: PnP ACPI init1466worker2 # [ 0.536733] pnp: PnP ACPI: found 6 devices1467lb # [ 0.538040] pnp: PnP ACPI init1468worker1 # [ 0.566045] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1469client # [ 0.532937] ACPI: IRQ 4 override to edge(!), high(!)1470lb # [ 0.538889] ACPI: IRQ 4 override to edge(!), high(!)1471worker1 # [ 0.567306] TCP: Hash tables configured (established 16384 bind 16384)1472client # [ 0.533891] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1473lb # [ 0.539884] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1474worker1 # [ 0.568429] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1475client # [ 0.535422] pnp: PnP ACPI: found 6 devices1476lb # [ 0.541389] pnp: PnP ACPI: found 6 devices1477worker1 # [ 0.569722] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1478worker1 # [ 0.570826] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1479worker1 # [ 0.572071] NET: Registered PF_UNIX/PF_LOCAL protocol family1480worker1 # [ 0.573095] NET: Registered PF_XDP protocol family1481worker2 # [ 0.544244] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1482worker1 # [ 0.573981] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1483worker2 # [ 0.545641] clocksource: Switched to clocksource acpi_pm1484worker1 # [ 0.575021] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1485worker2 # [ 0.546565] NET: Registered PF_INET protocol family1486worker1 # [ 0.576056] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1487worker2 # [ 0.547691] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1488client # [ 0.542983] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1489worker1 # [ 0.577196] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1490lb # [ 0.548988] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1491client # [ 0.544370] clocksource: Switched to clocksource acpi_pm1492worker1 # [ 0.578263] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1493lb # [ 0.550369] clocksource: Switched to clocksource acpi_pm1494client # [ 0.545313] NET: Registered PF_INET protocol family1495lb # [ 0.551290] NET: Registered PF_INET protocol family1496worker1 # [ 0.579357] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1497client # [ 0.546483] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1498worker1 # [ 0.581068] ACPI: \_SB_.GSIA: Enabled at IRQ 161499lb # [ 0.552524] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1500worker1 # [ 0.583293] ACPI: \_SB_.GSIB: Enabled at IRQ 171501worker1 # [ 0.585339] ACPI: \_SB_.GSIC: Enabled at IRQ 181502worker1 # [ 0.587415] ACPI: \_SB_.GSID: Enabled at IRQ 191503worker1 # [ 0.589099] PCI: CLS 0 bytes, default 641504worker1 # [ 0.590042] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1505worker1 # [ 0.591895] Trying to unpack rootfs image as initramfs...1506worker2 # [ 0.564023] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1507worker2 # [ 0.565519] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1508worker2 # [ 0.566768] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1509client # [ 0.562820] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1510worker2 # [ 0.568043] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1511lb # [ 0.569425] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1512worker2 # [ 0.569232] TCP: Hash tables configured (established 16384 bind 16384)1513client # [ 0.564394] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1514lb # [ 0.570957] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1515worker2 # [ 0.570294] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1516client # [ 0.565656] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1517worker2 # [ 0.571522] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1518lb # [ 0.572284] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1519client # [ 0.567009] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1520worker2 # [ 0.572545] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1521lb # [ 0.573611] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1522client # [ 0.568215] TCP: Hash tables configured (established 16384 bind 16384)1523worker2 # [ 0.573694] NET: Registered PF_UNIX/PF_LOCAL protocol family1524lb # [ 0.574870] TCP: Hash tables configured (established 16384 bind 16384)1525client # [ 0.569325] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1526worker2 # [ 0.574612] NET: Registered PF_XDP protocol family1527lb # [ 0.575976] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1528client # [ 0.570549] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1529worker2 # [ 0.575376] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1530lb # [ 0.577219] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1531worker2 # [ 0.576318] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1532client # [ 0.571593] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1533worker2 # [ 0.577258] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1534client # [ 0.572767] NET: Registered PF_UNIX/PF_LOCAL protocol family1535lb # [ 0.578278] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1536client # [ 0.573669] NET: Registered PF_XDP protocol family1537worker2 # [ 0.578282] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1538lb # [ 0.579489] NET: Registered PF_UNIX/PF_LOCAL protocol family1539client # [ 0.574499] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1540lb # [ 0.580424] NET: Registered PF_XDP protocol family1541worker2 # [ 0.579305] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1542client # [ 0.575481] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1543lb # [ 0.581219] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1544worker2 # [ 0.580326] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1545client # [ 0.576487] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1546lb # [ 0.582204] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1547worker2 # [ 0.581945] ACPI: \_SB_.GSIA: Enabled at IRQ 161548client # [ 0.577583] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1549lb # [ 0.583222] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1550client # [ 0.578647] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1551lb # [ 0.584343] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1552worker2 # [ 0.584083] ACPI: \_SB_.GSIB: Enabled at IRQ 171553client # [ 0.579709] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1554lb # [ 0.585435] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1555lb # [ 0.586505] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1556client # [ 0.581344] ACPI: \_SB_.GSIA: Enabled at IRQ 161557worker2 # [ 0.586381] ACPI: \_SB_.GSIC: Enabled at IRQ 181558lb # [ 0.588237] ACPI: \_SB_.GSIA: Enabled at IRQ 161559worker2 # [ 0.588332] ACPI: \_SB_.GSID: Enabled at IRQ 191560client # [ 0.583778] ACPI: \_SB_.GSIB: Enabled at IRQ 171561lb # [ 0.590536] ACPI: \_SB_.GSIB: Enabled at IRQ 171562worker2 # [ 0.589941] PCI: CLS 0 bytes, default 641563client # [ 0.585667] ACPI: \_SB_.GSIC: Enabled at IRQ 181564worker2 # [ 0.590790] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1565lb # [ 0.593044] ACPI: \_SB_.GSIC: Enabled at IRQ 181566client # [ 0.587612] ACPI: \_SB_.GSID: Enabled at IRQ 191567worker2 # [ 0.592418] Trying to unpack rootfs image as initramfs...1568client # [ 0.589270] PCI: CLS 0 bytes, default 641569lb # [ 0.595057] ACPI: \_SB_.GSID: Enabled at IRQ 191570client # [ 0.590150] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1571lb # [ 0.596863] PCI: CLS 0 bytes, default 641572client # [ 0.591916] Trying to unpack rootfs image as initramfs...1573lb # [ 0.597889] Trying to unpack rootfs image as initramfs...1574lb # [ 0.604248] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575worker1 # [ 0.637720] Initialise system trusted keyrings1576worker1 # [ 0.638685] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker1 # [ 0.661806] Key type asymmetric registered1578worker1 # [ 0.662508] Asymmetric key parser 'x509' registered1579worker1 # [ 0.663376] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1580worker2 # [ 0.634955] Initialise system trusted keyrings1581worker2 # [ 0.638573] workingset: timestamp_bits=40 max_order=19 bucket_order=01582worker1 # [ 0.668784] io scheduler mq-deadline registered1583worker1 # [ 0.669553] io scheduler kyber registered1584client # [ 0.635919] Initialise system trusted keyrings1585client # [ 0.638036] workingset: timestamp_bits=40 max_order=19 bucket_order=01586lb # [ 0.645239] Initialise system trusted keyrings1587worker1 # [ 0.673578] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1588lb # [ 0.646195] workingset: timestamp_bits=40 max_order=19 bucket_order=01589worker1 # [ 0.674891] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1590worker1 # [ 0.680443] Linux agpgart interface v0.1031591worker1 # [ 0.681237] ACPI: bus type drm_connector registered1592worker1 # [ 0.686098] usbcore: registered new interface driver usbserial_generic1593worker1 # [ 0.687229] usbserial: USB Serial support registered for generic1594worker2 # [ 0.659690] Key type asymmetric registered1595worker2 # [ 0.660366] Asymmetric key parser 'x509' registered1596worker2 # [ 0.661197] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1597worker1 # [ 0.690669] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1598worker1 # [ 0.690669] Please enable it if your BIOS has the CPPC option.1599worker1 # [ 0.692945] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1600worker2 # [ 0.664631] io scheduler mq-deadline registered1601worker2 # [ 0.665348] io scheduler kyber registered1602client # [ 0.661089] Key type asymmetric registered1603client # [ 0.661803] Asymmetric key parser 'x509' registered1604worker1 # [ 0.695811] drop_monitor: Initializing network drop monitor service1605client # [ 0.662648] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1606worker1 # [ 0.696997] NET: Registered PF_INET6 protocol family1607worker2 # [ 0.668125] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1608lb # [ 0.669875] Key type asymmetric registered1609lb # [ 0.670621] Asymmetric key parser 'x509' registered1610worker2 # [ 0.669373] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1611worker1 # [ 0.700111] Segment Routing with IPv61612lb # [ 0.671457] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1613client # [ 0.668101] io scheduler mq-deadline registered1614worker1 # [ 0.702672] In-situ OAM (IOAM) with IPv61615client # [ 0.668897] io scheduler kyber registered1616lb # [ 0.674949] io scheduler mq-deadline registered1617worker1 # [ 0.703686] IPI shorthand broadcast: enabled1618lb # [ 0.675727] io scheduler kyber registered1619worker2 # [ 0.675193] Linux agpgart interface v0.1031620worker2 # [ 0.675964] ACPI: bus type drm_connector registered1621client # [ 0.672497] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1622client # [ 0.673809] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1623lb # [ 0.679815] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1624worker2 # [ 0.678966] usbcore: registered new interface driver usbserial_generic1625worker2 # [ 0.679989] usbserial: USB Serial support registered for generic1626lb # [ 0.681045] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1627client # [ 0.677878] Linux agpgart interface v0.1031628worker1 # [ 0.711878] sched_clock: Marking stable (579015905, 132638627)->(781953470, -70298938)1629client # [ 0.678639] ACPI: bus type drm_connector registered1630worker2 # [ 0.683524] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1631worker2 # [ 0.683524] Please enable it if your BIOS has the CPPC option.1632lb # [ 0.686590] Linux agpgart interface v0.1031633worker2 # [ 0.685653] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1634client # [ 0.681412] usbcore: registered new interface driver usbserial_generic1635lb # [ 0.687352] ACPI: bus type drm_connector registered1636worker2 # [ 0.686949] drop_monitor: Initializing network drop monitor service1637client # [ 0.682464] usbserial: USB Serial support registered for generic1638worker1 # [ 0.716742] registered taskstats version 11639worker2 # [ 0.688066] NET: Registered PF_INET6 protocol family1640worker1 # [ 0.717686] Loading compiled-in X.509 certificates1641lb # [ 0.690249] usbcore: registered new interface driver usbserial_generic1642lb # [ 0.691351] usbserial: USB Serial support registered for generic1643client # [ 0.685998] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1644client # [ 0.685998] Please enable it if your BIOS has the CPPC option.1645worker2 # [ 0.692972] Segment Routing with IPv61646client # [ 0.688266] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1647lb # [ 0.694802] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1648lb # [ 0.694802] Please enable it if your BIOS has the CPPC option.1649worker2 # [ 0.695523] In-situ OAM (IOAM) with IPv61650worker2 # [ 0.696572] IPI shorthand broadcast: enabled1651lb # [ 0.697080] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1652client # [ 0.693117] drop_monitor: Initializing network drop monitor service1653client # [ 0.694329] NET: Registered PF_INET6 protocol family1654lb # [ 0.700961] drop_monitor: Initializing network drop monitor service1655lb # [ 0.702202] NET: Registered PF_INET6 protocol family1656client # [ 0.697424] Segment Routing with IPv61657lb # [ 0.705241] Segment Routing with IPv61658client # [ 0.700013] In-situ OAM (IOAM) with IPv61659worker1 # [ 0.734138] Demotion targets for Node 0: null1660worker2 # [ 0.704871] sched_clock: Marking stable (571013677, 133488973)->(777886390, -73383740)1661client # [ 0.701050] IPI shorthand broadcast: enabled1662lb # [ 0.707815] In-situ OAM (IOAM) with IPv61663worker1 # [ 0.736709] Key type .fscrypt registered1664lb # [ 0.708890] IPI shorthand broadcast: enabled1665worker1 # [ 0.737382] Key type fscrypt-provisioning registered1666worker1 # [ 0.738349] ima: No TPM chip found, activating TPM-bypass!1667worker2 # [ 0.709768] registered taskstats version 11668worker2 # [ 0.710747] Loading compiled-in X.509 certificates1669worker1 # [ 0.742676] ima: Allocated hash algorithm: sha11670worker1 # [ 0.743475] ima: No architecture policies found1671client # [ 0.709143] sched_clock: Marking stable (576013161, 132967405)->(788240438, -79259872)1672worker1 # [ 0.744408] PM: Magic number: 10:369:8311673lb # [ 0.717344] sched_clock: Marking stable (584014932, 132763146)->(792476037, -75697959)1674client # [ 0.714227] registered taskstats version 11675worker1 # [ 0.748095] RAS: Correctable Errors collector initialized.1676client # [ 0.715199] Loading compiled-in X.509 certificates1677lb # [ 0.722954] registered taskstats version 11678lb # [ 0.723960] Loading compiled-in X.509 certificates1679worker1 # [ 0.756729] clk: Disabling unused clocks1680worker2 # [ 0.727522] Demotion targets for Node 0: null1681worker1 # [ 0.757385] PM: genpd: Disabling unused power domains1682worker2 # [ 0.730561] Key type .fscrypt registered1683worker2 # [ 0.731249] Key type fscrypt-provisioning registered1684worker2 # [ 0.732225] ima: No TPM chip found, activating TPM-bypass!1685worker2 # [ 0.734520] ima: Allocated hash algorithm: sha11686worker2 # [ 0.735315] ima: No architecture policies found1687client # [ 0.731557] Demotion targets for Node 0: null1688client # [ 0.734037] Key type .fscrypt registered1689client # [ 0.734723] Key type fscrypt-provisioning registered1690worker2 # [ 0.739520] PM: Magic number: 10:369:8311691client # [ 0.735663] ima: No TPM chip found, activating TPM-bypass!1692worker2 # [ 0.741098] RAS: Correctable Errors collector initialized.1693lb # [ 0.742795] Demotion targets for Node 0: null1694lb # [ 0.743705] Key type .fscrypt registered1695lb # [ 0.744400] Key type fscrypt-provisioning registered1696client # [ 0.739997] ima: Allocated hash algorithm: sha11697client # [ 0.740802] ima: No architecture policies found1698lb # [ 0.747906] ima: No TPM chip found, activating TPM-bypass!1699client # [ 0.742997] PM: Magic number: 10:369:8311700lb # [ 0.748853] ima: Allocated hash algorithm: sha11701lb # [ 0.749627] ima: No architecture policies found1702client # [ 0.744557] RAS: Correctable Errors collector initialized.1703worker2 # [ 0.750185] clk: Disabling unused clocks1704lb # [ 0.751967] PM: Magic number: 10:369:8311705worker2 # [ 0.752520] PM: genpd: Disabling unused power domains1706lb # [ 0.753628] RAS: Correctable Errors collector initialized.1707client # [ 0.753628] clk: Disabling unused clocks1708client # [ 0.756006] PM: genpd: Disabling unused power domains1709lb # [ 0.764483] clk: Disabling unused clocks1710lb # [ 0.766792] PM: genpd: Disabling unused power domains1711worker1 # [ 0.916137] Freeing initrd memory: 29092K1712worker1 # [ 0.919288] Freeing unused decrypted memory: 2028K1713worker1 # [ 0.921992] Freeing unused kernel image (initmem) memory: 3644K1714worker1 # [ 0.923109] Write protecting the kernel read-only data: 32768k1715worker1 # [ 0.925036] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker1 # [ 0.926586] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker2 # [ 0.920075] Freeing initrd memory: 29092K1718client # [ 0.916413] Freeing initrd memory: 29096K1719worker2 # [ 0.923221] Freeing unused decrypted memory: 2028K1720client # [ 0.919542] Freeing unused decrypted memory: 2028K1721worker2 # [ 0.925825] Freeing unused kernel image (initmem) memory: 3644K1722client # [ 0.922175] Freeing unused kernel image (initmem) memory: 3644K1723worker2 # [ 0.926919] Write protecting the kernel read-only data: 32768k1724client # [ 0.923268] Write protecting the kernel read-only data: 32768k1725worker2 # [ 0.928782] Freeing unused kernel image (text/rodata gap) memory: 1208K1726client # [ 0.925176] Freeing unused kernel image (text/rodata gap) memory: 1208K1727worker2 # [ 0.930346] Freeing unused kernel image (rodata/data gap) memory: 752K1728client # [ 0.926652] Freeing unused kernel image (rodata/data gap) memory: 752K1729lb # [ 0.934850] Freeing initrd memory: 29092K1730lb # [ 0.938091] Freeing unused decrypted memory: 2028K1731lb # [ 0.940798] Freeing unused kernel image (initmem) memory: 3644K1732lb # [ 0.941921] Write protecting the kernel read-only data: 32768k1733lb # [ 0.943851] Freeing unused kernel image (text/rodata gap) memory: 1208K1734lb # [ 0.945424] Freeing unused kernel image (rodata/data gap) memory: 752K1735worker1 # [ 0.977847] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736worker1 # [ 0.978962] Run /init as init process1737worker1 # [ 0.989282] systemd[1]: Inserted module 'autofs4'1738worker1 # [ 1.005558] fuse: init (API version 7.45)1739worker2 # [ 0.981522] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740worker1 # [ 1.011469] ACPI: \_SB_.GSIG: Enabled at IRQ 221741worker2 # [ 0.982636] Run /init as init process1742client # [ 0.977802] x86/mm: Checked W+X mappings: passed, no W+X pages found.1743client # [ 0.978837] Run /init as init process1744worker1 # [ 1.013814] ACPI: \_SB_.GSIH: Enabled at IRQ 231745worker1 # [ 1.016828] ACPI: \_SB_.GSIE: Enabled at IRQ 201746worker1 # [ 1.019060] ACPI: \_SB_.GSIF: Enabled at IRQ 211747worker2 # [ 0.993047] systemd[1]: Inserted module 'autofs4'1748client # [ 0.989178] systemd[1]: Inserted module 'autofs4'1749lb # [ 0.996429] x86/mm: Checked W+X mappings: passed, no W+X pages found.1750lb # [ 0.997517] Run /init as init process1751lb # [ 1.007909] systemd[1]: Inserted module 'autofs4'1752worker2 # [ 1.009215] fuse: init (API version 7.45)1753client # [ 1.005223] fuse: init (API version 7.45)1754worker1 # [ 1.043307] systemd[1]: Successfully made /usr/ read-only.1755worker2 # [ 1.015001] ACPI: \_SB_.GSIG: Enabled at IRQ 221756client # [ 1.011080] ACPI: \_SB_.GSIG: Enabled at IRQ 221757worker2 # [ 1.017445] ACPI: \_SB_.GSIH: Enabled at IRQ 231758client # [ 1.013715] ACPI: \_SB_.GSIH: Enabled at IRQ 231759worker2 # [ 1.020586] ACPI: \_SB_.GSIE: Enabled at IRQ 201760client # [ 1.017039] ACPI: \_SB_.GSIE: Enabled at IRQ 201761worker2 # [ 1.022807] ACPI: \_SB_.GSIF: Enabled at IRQ 211762lb # [ 1.024342] fuse: init (API version 7.45)1763client # [ 1.019394] ACPI: \_SB_.GSIF: Enabled at IRQ 211764lb # [ 1.030268] ACPI: \_SB_.GSIG: Enabled at IRQ 221765lb # [ 1.032683] ACPI: \_SB_.GSIH: Enabled at IRQ 231766lb # [ 1.035816] ACPI: \_SB_.GSIE: Enabled at IRQ 201767lb # [ 1.038117] ACPI: \_SB_.GSIF: Enabled at IRQ 211768worker2 # [ 1.049323] systemd[1]: Successfully made /usr/ read-only.1769client # [ 1.046681] systemd[1]: Successfully made /usr/ read-only.1770lb # [ 1.065867] systemd[1]: Successfully made /usr/ read-only.1771worker1 # [ 1.378818] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker1 # [ 1.383914] systemd[1]: Detected virtualization kvm.1773worker1 # [ 1.384782] systemd[1]: Detected architecture x86-64.1774worker1 # [ 1.385666] systemd[1]: Running in initrd.1775worker1 # [ 1.386764] systemd[1]: Initializing machine ID from random generator.1776worker1 # [ 1.387954] systemd[1]: Hostname set to <worker1>.1777worker2 # [ 1.385773] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778client # [ 1.382947] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1779worker2 # [ 1.397834] systemd[1]: Detected virtualization kvm.1780client # [ 1.394694] systemd[1]: Detected virtualization kvm.1781worker2 # [ 1.399945] systemd[1]: Detected architecture x86-64.1782client # [ 1.396780] systemd[1]: Detected architecture x86-64.1783worker2 # [ 1.402065] systemd[1]: Running in initrd.1784client # [ 1.398904] systemd[1]: Running in initrd.1785worker2 # [ 1.404638] systemd[1]: Initializing machine ID from random generator.1786client # [ 1.401403] systemd[1]: Initializing machine ID from random generator.1787worker2 # [ 1.407450] systemd[1]: Hostname set to <worker2>.1788client # [ 1.404225] systemd[1]: Hostname set to <client>.1789lb # [ 1.402585] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790lb # [ 1.414425] systemd[1]: Detected virtualization kvm.1791lb # [ 1.416582] systemd[1]: Detected architecture x86-64.1792lb # [ 1.418722] systemd[1]: Running in initrd.1793lb # [ 1.421342] systemd[1]: Initializing machine ID from random generator.1794lb # [ 1.424290] systemd[1]: Hostname set to <lb>.1795worker1 # [ 1.593200] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker1 # [ 1.646050] systemd[1]: Queued start job for default target Initrd Default Target.1797worker1 # [ 1.649965] systemd[1]: Created slice Slice /system/modprobe.1798worker1 # [ 1.651243] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1799worker1 # [ 1.652800] systemd[1]: Expecting device /dev/disk/by-label/nixos...1800worker1 # [ 1.654039] systemd[1]: Reached target Path Units.1801worker1 # [ 1.655004] systemd[1]: Reached target Slice Units.1802worker1 # [ 1.655996] systemd[1]: Reached target Swaps.1803worker1 # [ 1.656883] systemd[1]: Reached target Timer Units.1804worker2 # [ 1.626232] systemd[1]: bpf-restrict-fs: LSM BPF program attached1805worker1 # [ 1.657948] systemd[1]: Listening on D-Bus System Message Bus Socket.1806worker1 # [ 1.659261] systemd[1]: Listening on Journal Socket (/dev/log).1807worker1 # [ 1.660535] systemd[1]: Listening on Journal Sockets.1808client # [ 1.625652] systemd[1]: bpf-restrict-fs: LSM BPF program attached1809worker1 # [ 1.661679] systemd[1]: Listening on udev Control Socket.1810worker1 # [ 1.662804] systemd[1]: Listening on udev Kernel Socket.1811worker1 # [ 1.663864] systemd[1]: Reached target Socket Units.1812worker1 # [ 1.665718] systemd[1]: Starting Create List of Static Device Nodes...1813worker1 # [ 1.669729] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1814worker1 # [ 1.681043] systemd[1]: Starting Load Kernel Module configfs...1815lb # [ 1.651749] systemd[1]: bpf-restrict-fs: LSM BPF program attached1816worker1 # [ 1.693220] systemd[1]: Starting Journal Service...1817worker1 # [ 1.702728] systemd[1]: Starting Load Kernel Modules...1818worker2 # [ 1.678813] systemd[1]: Queued start job for default target Initrd Default Target.1819worker2 # [ 1.682788] systemd[1]: Created slice Slice /system/modprobe.1820client # [ 1.678603] systemd[1]: Queued start job for default target Initrd Default Target.1821worker2 # [ 1.683908] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1822worker2 # [ 1.685237] systemd[1]: Expecting device /dev/disk/by-label/nixos...1823worker2 # [ 1.686277] systemd[1]: Reached target Path Units.1824worker2 # [ 1.687100] systemd[1]: Reached target Slice Units.1825worker2 # [ 1.687946] systemd[1]: Reached target Swaps.1826client # [ 1.683275] systemd[1]: Created slice Slice /system/modprobe.1827worker2 # [ 1.688715] systemd[1]: Reached target Timer Units.1828client # [ 1.684449] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1829worker2 # [ 1.689641] systemd[1]: Listening on D-Bus System Message Bus Socket.1830client # [ 1.685883] systemd[1]: Expecting device /dev/disk/by-label/nixos...1831worker2 # [ 1.690794] systemd[1]: Listening on Journal Socket (/dev/log).1832client # [ 1.687065] systemd[1]: Reached target Path Units.1833worker2 # [ 1.691947] systemd[1]: Listening on Journal Sockets.1834client # [ 1.687929] systemd[1]: Reached target Slice Units.1835worker2 # [ 1.692916] systemd[1]: Listening on udev Control Socket.1836client # [ 1.688829] systemd[1]: Reached target Swaps.1837worker1 # [ 1.710696] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1838worker2 # [ 1.693894] systemd[1]: Listening on udev Kernel Socket.1839client # [ 1.689632] systemd[1]: Reached target Timer Units.1840worker2 # [ 1.694807] systemd[1]: Reached target Socket Units.1841client # [ 1.690630] systemd[1]: Listening on D-Bus System Message Bus Socket.1842worker1 # [ 1.725924] netfs: FS-Cache loaded1843client # [ 1.691869] systemd[1]: Listening on Journal Socket (/dev/log).1844worker2 # [ 1.696522] systemd[1]: Starting Create List of Static Device Nodes...1845client # [ 1.692989] systemd[1]: Listening on Journal Sockets.1846client # [ 1.694030] systemd[1]: Listening on udev Control Socket.1847client # [ 1.695092] systemd[1]: Listening on udev Kernel Socket.1848worker2 # [ 1.700323] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1849client # [ 1.696069] systemd[1]: Reached target Socket Units.1850worker1 # [ 1.730490] 9pnet: Installing 9P2000 support1851client # [ 1.697804] systemd[1]: Starting Create List of Static Device Nodes...1852lb # [ 1.706402] systemd[1]: Queued start job for default target Initrd Default Target.1853client # [ 1.701772] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1854worker2 # [ 1.707747] systemd[1]: Starting Load Kernel Module configfs...1855lb # [ 1.711155] systemd[1]: Created slice Slice /system/modprobe.1856worker1 # [ 1.739863] systemd[1]: Starting Coldplug All udev Devices...1857lb # [ 1.712357] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1858lb # [ 1.713820] systemd[1]: Expecting device /dev/disk/by-label/nixos...1859lb # [ 1.714970] systemd[1]: Reached target Path Units.1860client # [ 1.709176] systemd[1]: Starting Load Kernel Module configfs...1861lb # [ 1.715883] systemd[1]: Reached target Slice Units.1862lb # [ 1.716801] systemd[1]: Reached target Swaps.1863lb # [ 1.717622] systemd[1]: Reached target Timer Units.1864lb # [ 1.718629] systemd[1]: Listening on D-Bus System Message Bus Socket.1865lb # [ 1.719904] systemd[1]: Listening on Journal Socket (/dev/log).1866lb # [ 1.721100] systemd[1]: Listening on Journal Sockets.1867lb # [ 1.722139] systemd[1]: Listening on udev Control Socket.1868lb # [ 1.723197] systemd[1]: Listening on udev Kernel Socket.1869worker2 # [ 1.723117] systemd[1]: Starting Journal Service...1870lb # [ 1.724181] systemd[1]: Reached target Socket Units.1871worker1 # [ 1.753200] systemd[1]: Finished Create List of Static Device Nodes.1872lb # [ 1.726100] systemd[1]: Starting Create List of Static Device Nodes...1873client # [ 1.722164] systemd[1]: Starting Journal Service...1874lb # [ 1.729904] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1875worker1 # [ 1.758221] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1876worker2 # [ 1.734588] systemd[1]: Starting Load Kernel Modules...1877worker1 # [ 1.766369] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1878lb # [ 1.738845] systemd[1]: Starting Load Kernel Module configfs...1879client # [ 1.736068] systemd[1]: Starting Load Kernel Modules...1880worker1 # [ 1.771083] systemd[1]: modprobe@configfs.service: Deactivated successfully.1881worker1 # [ 1.776187] systemd-journald[67]: Collecting audit messages is disabled.1882worker1 # [ 1.779011] systemd[1]: Finished Load Kernel Module configfs.1883lb # [ 1.752972] systemd[1]: Starting Journal Service...1884worker2 # [ 1.741524] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1885worker2 # [ 1.756881] netfs: FS-Cache loaded1886worker1 # [ 1.785131] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1887client # [ 1.742142] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1888worker2 # [ 1.761520] 9pnet: Installing 9P2000 support1889worker1 # [ 1.789712] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1890client # [ 1.758637] netfs: FS-Cache loaded1891lb # [ 1.766089] systemd[1]: Starting Load Kernel Modules...1892worker1 # [ 1.795730] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1893client # [ 1.763796] 9pnet: Installing 9P2000 support1894worker1 # [ 1.797109] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1895worker2 # [ 1.773616] systemd[1]: Starting Coldplug All udev Devices...1896client # [ 1.775183] systemd[1]: Starting Coldplug All udev Devices...1897lb # [ 1.771876] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1898lb # [ 1.790020] netfs: FS-Cache loaded1899worker2 # [ 1.788614] systemd[1]: Finished Create List of Static Device Nodes.1900lb # [ 1.794960] 9pnet: Installing 9P2000 support1901client # [ 1.789224] systemd-journald[67]: Collecting audit messages is disabled.1902client # [ 1.790472] systemd[1]: Finished Create List of Static Device Nodes.1903worker2 # [ 1.795233] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1904worker1 # [ 1.825220] systemd[1]: Finished Load Kernel Modules.1905client # [ 1.794562] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1906worker2 # [ 1.803960] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1907worker1 # [ 1.833726] systemd[1]: Starting Apply Kernel Variables...1908lb # [ 1.805861] systemd[1]: Starting Coldplug All udev Devices...1909worker2 # [ 1.806055] systemd-journald[67]: Collecting audit messages is disabled.1910client # [ 1.803398] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1911worker2 # [ 1.811985] systemd[1]: modprobe@configfs.service: Deactivated successfully.1912client # [ 1.808406] systemd[1]: modprobe@configfs.service: Deactivated successfully.1913worker1 # [ 1.846725] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1914worker2 # [ 1.817931] systemd[1]: Finished Load Kernel Module configfs.1915lb # [ 1.820928] systemd[1]: Finished Create List of Static Device Nodes.1916client # [ 1.816335] systemd[1]: Finished Load Kernel Module configfs.1917worker2 # [ 1.823006] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1918lb # [ 1.825519] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1919client # [ 1.819776] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1920worker1 # [ 1.854866] systemd[1]: Starting Create Static Device Nodes in /dev...1921worker2 # [ 1.827377] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1922client # [ 1.823427] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1923lb # [ 1.833273] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1924worker2 # [ 1.835766] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1925worker2 # [ 1.837313] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1926lb # [ 1.838679] systemd-journald[67]: Collecting audit messages is disabled.1927client # [ 1.833054] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1928worker1 # [ 1.868797] systemd[1]: Finished Apply Kernel Variables.1929lb # [ 1.840300] systemd[1]: modprobe@configfs.service: Deactivated successfully.1930client # [ 1.834458] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1931lb # [ 1.847161] systemd[1]: Finished Load Kernel Module configfs.1932lb # [ 1.852278] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1933lb # [ 1.856910] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1934worker1 # [ 1.887176] systemd[1]: Finished Create Static Device Nodes in /dev.1935worker1 # [ 1.756345] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.890869] systemd[1]: Started Journal Service.1936worker1 # 1937worker1 # [ 1.760302] systemd-modules-load[68]: Inserted module 'virtio_balloon'1938lb # [ 1.864868] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1939worker1 # [ 1.761328] systemd-modules-load[68]: Inserted module 'virtio_gpu'1940lb # [ 1.866237] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1941worker2 # [ 1.868110] systemd[1]: Finished Load Kernel Modules.1942client # [ 1.864515] systemd[1]: Finished Load Kernel Modules.1943worker1 # [ 1.769664] systemd[1]: Reached target Preparation for Local File Systems.1944worker1 # [ 1.771905] systemd[1]: Reached target Local File Systems.1945worker2 # [ 1.876729] systemd[1]: Starting Apply Kernel Variables...1946client # [ 1.872429] systemd[1]: Starting Apply Kernel Variables...1947worker1 # [ 1.774979] systemd[1]: Starting Create System Files and Directories...1948worker1 # [ 1.782069] systemd[1]: Starting Rule-based Manager for Device Events and Files...1949worker2 # [ 1.887740] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1950client # [ 1.885071] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1951lb # [ 1.899395] systemd[1]: Finished Load Kernel Modules.1952worker2 # [ 1.898820] systemd[1]: Starting Create Static Device Nodes in /dev...1953client # [ 1.895180] systemd[1]: Starting Create Static Device Nodes in /dev...1954lb # [ 1.907555] systemd[1]: Starting Apply Kernel Variables...1955worker1 # [ 1.805857] systemd[1]: Finished Create System Files and Directories.1956client # [ 1.906559] systemd[1]: Finished Apply Kernel Variables.1957client # [ 1.776355] systemd-modules-load[68]: Inserted module 'dm_mod'1958client # [ 1.777764] systemd-modules-load[68]: Inserted module 'virtio_balloon'1959client # [ 1.779171] systemd-modules-load[68]: Inserted module 'virtio_gpu'1960client # [ 1.913204] systemd[1]: Started Journal Service.1961lb # [ 1.919865] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1962worker2 # [ 1.921650] systemd[1]: Finished Apply Kernel Variables.1963lb # [ 1.928213] systemd[1]: Starting Create Static Device Nodes in /dev...1964worker2 # [ 1.928762] systemd[1]: Started Journal Service.1965worker1 # [ 1.825666] systemd-udevd[83]: Using default interface naming scheme 'v261'.1966worker2 # [ 1.798376] systemd-modules-load[68]: Inserted module 'dm_mod'1967worker2 # [ 1.799698] systemd-modules-load[68]: Inserted module 'virtio_balloon'1968worker2 # [ 1.803094] systemd-modules-load[68]: Inserted module 'virtio_gpu'1969client # [ 1.800112] systemd[1]: Finished Create Static Device Nodes in /dev.1970client # [ 1.801121] systemd[1]: Reached target Preparation for Local File Systems.1971client # [ 1.802082] systemd[1]: Reached target Local File Systems.1972worker2 # [ 1.808162] systemd[1]: Finished Create Static Device Nodes in /dev.1973client # [ 1.804075] systemd[1]: Starting Create System Files and Directories...1974client # [ 1.809079] systemd[1]: Starting Rule-based Manager for Device Events and Files...1975worker2 # [ 1.813718] systemd[1]: Reached target Preparation for Local File Systems.1976lb # [ 1.950368] systemd[1]: Finished Apply Kernel Variables.1977worker2 # [ 1.816887] systemd[1]: Reached target Local File Systems.1978worker2 # [ 1.818300] systemd[1]: Starting Create System Files and Directories...1979worker1 # [ 1.850220] systemd[1]: Started Rule-based Manager for Device Events and Files.1980lb # [ 1.959653] systemd[1]: Started Journal Service.1981worker2 # [ 1.825359] systemd[1]: Starting Rule-based Manager for Device Events and Files...1982lb # [ 1.829244] systemd-modules-load[68]: Inserted module 'dm_mod'1983lb # [ 1.831358] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984lb # [ 1.833846] systemd-modules-load[68]: Inserted module 'virtio_gpu'1985client # [ 1.833182] systemd[1]: Finished Create System Files and Directories.1986lb # [ 1.840166] systemd[1]: Finished Create Static Device Nodes in /dev.1987lb # [ 1.845121] systemd[1]: Reached target Preparation for Local File Systems.1988lb # [ 1.846159] systemd[1]: Reached target Local File Systems.1989lb # [ 1.850078] systemd[1]: Starting Create System Files and Directories...1990worker2 # [ 1.851302] systemd[1]: Finished Create System Files and Directories.1991lb # [ 1.855794] systemd[1]: Starting Rule-based Manager for Device Events and Files...1992client # [ 1.854407] systemd-udevd[83]: Using default interface naming scheme 'v261'.1993worker1 # [ 1.896091] systemd[1]: Finished Coldplug All udev Devices.1994worker1 # [ 1.896887] systemd[1]: Reached target System Initialization.1995worker1 # [ 1.897735] systemd[1]: Reached target Basic System.1996worker2 # [ 1.875198] systemd-udevd[83]: Using default interface naming scheme 'v261'.1997client # [ 1.878066] systemd[1]: Started Rule-based Manager for Device Events and Files.1998lb # [ 1.886175] systemd[1]: Finished Create System Files and Directories.1999worker2 # [ 1.901147] systemd[1]: Started Rule-based Manager for Device Events and Files.2000lb # [ 1.906879] systemd-udevd[83]: Using default interface naming scheme 'v261'.
loading 1,592 hidden lines…
3593lb # [ 9.356800] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized3594lb # [ 9.552137] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt3595lb # [ 9.552253] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD3596worker2 # [ 9.426330] systemd[1]: Starting User Login Management...3597worker2 # [ 9.433955] systemd[1]: Finished Import lastlog data into lastlog2 database.3598lb # [ 9.437173] nsncd[524]: Sep 20 10:49:17.780 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3599lb # [ 9.443612] systemd[1]: Started Name Service Cache Daemon (nsncd).3600worker1 # [ 9.615882] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3601client # [ 9.582701] kvm_amd: TSC scaling supported3602worker1 # [ 9.616537] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3603client # [ 9.583328] kvm_amd: Nested Virtualization enabled3604client # [ 9.583836] kvm_amd: Nested Paging enabled3605client # [ 9.584843] kvm_amd: LBR virtualization supported3606client # [ 9.585623] kvm_amd: Virtual VMLOAD VMSAVE supported3607worker1 # [ 9.619498] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23608client # [ 9.586491] kvm_amd: Virtual GIF supported3609worker1 # [ 9.620343] cfg80211: failed to load regulatory.db3610client # [ 9.587233] kvm_amd: Virtual NMI enabled3611lb # [ 9.463530] systemd[1]: Reached target Host and Network Name Lookups.3612lb # [ 9.464475] systemd[1]: Reached target User and Group Name Lookups.3613lb # [ 9.475121] systemd[1]: Starting D-Bus System Message Bus...3614worker2 # [ 9.487490] dbus-broker-launch[536]: Looking up NSS user entry for 'systemd-timesync'...3615lb # [ 9.501370] systemd[1]: Starting User Login Management...3616worker1 # [ 9.666803] 8021q: adding VLAN 0 to HW filter on device eth03617worker2 # [ 9.503869] dbus-broker-launch[536]: NSS returned no entry for 'systemd-timesync'3618client # [ 9.634063] EDAC MC: Ver: 3.0.03619worker1 # [ 9.535257] dhcpcd[694]: eth0: waiting for carrier3620worker1 # [ 9.535972] dhcpcd[694]: eth0: carrier acquired3621worker2 # [ 9.504918] dbus-broker-launch[536]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3622lb # [ 9.509585] systemd[1]: Finished Import lastlog data into lastlog2 database.3623worker1 # [ 9.544588] dhcpcd[694]: DUID 00:01:00:01:32:42:76:ae:52:54:00:12:34:563624lb # [ 9.649570] [drm] Found bochs VGA, ID 0xb0c5.3625worker1 # [ 9.545688] dhcpcd[694]: eth0: IAID 00:12:34:563626lb # [ 9.649573] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.3627worker1 # [ 9.546409] dhcpcd[694]: eth0: adding address fe80::5054:ff:fe12:34563628worker2 # [ 9.519799] systemd[1]: Stopped target Host and Network Name Lookups.3629worker2 # [ 9.522553] systemd[1]: Stopping Host and Network Name Lookups...3630worker2 # [ 9.524306] systemd[1]: Stopped target User and Group Name Lookups.3631worker2 # [ 9.525543] systemd[1]: Stopping User and Group Name Lookups...3632worker2 # [ 9.527734] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3633worker2 # [ 9.528753] systemd[1]: nscd.service: Deactivated successfully.3634lb # [ 9.663435] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic3635worker2 # [ 9.531271] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3636worker2 # [ 9.541080] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3637worker2 # [ 9.548244] systemd-logind[554]: New seat seat0.3638worker2 # [ 9.551526] systemd[1]: Started D-Bus System Message Bus.3639worker2 # [ 9.556412] systemd-logind[554]: Watching system buttons on /dev/input/event2 (Power Button)3640lb # [ 9.692824] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 03641worker2 # [ 9.558655] systemd-logind[554]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3642worker2 # [ 9.560465] systemd-logind[554]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3643worker2 # [ 9.563867] systemd[1]: Started User Login Management.3644worker2 # [ 9.566485] systemd[1]: Starting linger-users.service...3645client # [ 9.582687] systemd[1]: Finished register-nix-paths.service.3646lb # [ 9.746329] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input63647worker2 # [ 9.613393] dbus-broker-launch[536]: Ready3648lb # [ 9.750388] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input53649worker2 # [ 9.622692] nsncd[601]: Sep 20 10:49:17.851 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3650worker2 # [ 9.627182] systemd[1]: Started Name Service Cache Daemon (nsncd).3651worker2 # [ 9.627967] systemd[1]: Reached target Host and Network Name Lookups.3652worker2 # [ 9.629257] systemd[1]: Reached target User and Group Name Lookups.3653worker2 # [ 9.634977] systemd[1]: linger-users.service: Deactivated successfully.3654worker2 # [ 9.636560] systemd[1]: Finished linger-users.service.3655worker2 # [ 9.654322] systemd[1]: Finished resolvconf update.3656worker2 # [ 9.656154] systemd[1]: Reached target Preparation for Network.3657worker2 # [ 9.659838] systemd[1]: Starting DHCP Client...3658worker2 # [ 9.662142] systemd[1]: Starting Address configuration of eth1...3659worker2 # [ 9.666226] systemd[1]: Starting Extra networking commands....3660lb # [ 9.672804] dbus-broker-launch[552]: Looking up NSS user entry for 'systemd-timesync'...3661client # [ 9.666566] systemd-vconsole-setup[423]: Configuration of first virtual console was skipped, ignoring remaining ones.3662client # [ 9.670211] systemd[1]: Finished Virtual Console Setup.3663client # [ 9.671821] systemd[1]: Reached target System Initialization.3664client # [ 9.673540] systemd[1]: Started Discard unused filesystem blocks once a week.3665client # [ 9.674491] systemd[1]: Started Daily Cleanup of Temporary Directories.3666client # [ 9.676212] systemd[1]: Reached target Timer Units.3667client # [ 9.676885] systemd[1]: Listening on D-Bus System Message Bus Socket.3668client # [ 9.677711] systemd[1]: Listening on Nix Daemon Socket.3669client # [ 9.678499] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3670client # [ 9.680148] systemd[1]: Reached target Socket Units.3671client # [ 9.680864] systemd[1]: Reached target Basic System.3672client # [ 9.683978] systemd[1]: Started backdoor.service.3673client # [ 9.685756] systemd[1]: Starting Import lastlog data into lastlog2 database...3674lb # [ 9.692971] dbus-broker-launch[552]: NSS returned no entry for 'systemd-timesync'3675client # [ 9.690344] systemd[1]: Starting nftables firewall...3676lb # [ 9.695053] dbus-broker-launch[552]: Invalid user-name in /nix/store/0vgm8r903b3kyr8fcdjkv3g9zyy4h8rn-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3677client # [ 9.696056] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3678client # [ 9.703562] systemd[1]: Starting Post-Boot Actions...3679client # [ 9.714497] systemd[1]: Started Reset console on configuration changes.3680client # [ 9.728456] systemd[1]: Starting resolvconf update...3681worker2 # [ 9.760286] network-addresses-eth1-start[631]: adding address 192.168.1.4/24... done3682worker2 # [ 9.776183] network-addresses-eth1-start[631]: adding address 2001:db8:1::4/64... done3683client # [ 9.778795] systemd[1]: Starting D-Bus System Message Bus...3684client # connecting to host...3685worker2 # [ 9.796334] systemd[1]: Finished Address configuration of eth1.3686client # [ 9.794616] systemd[1]: Finished Post-Boot Actions.3687client # [ 9.800521] nsncd[431]: Sep 20 10:49:18.593 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3688client # [ 9.806539] systemd[1]: Started Name Service Cache Daemon (nsncd).3689client: Guest shell says: b'Spawning backdoor root shell...\n'3690worker2 # [ 9.824722] dhcpcd[639]: dhcpcd-10.3.2 starting3691client # [ 9.826394] systemd[1]: Reached target Host and Network Name Lookups.3692worker2 # [ 9.834259] dhcpcd[693]: dev: loaded udev3693client: connected to guest root shell3694client # [ 9.827276] systemd[1]: Reached target User and Group Name Lookups.3695client: (connecting took 10.53 seconds)3696worker2 # [ 9.841092] systemd[1]: Finished Extra networking commands..3697client: (finished: waiting for the VM to finish booting, in 10.53 seconds)3698worker2 # [ 9.842678] systemd[1]: Reached target Network.3699client # [ 9.839219] systemd[1]: Starting User Login Management...3700worker2 # [ 9.845827] systemd[1]: Starting Permit User Sessions...3701client # [ 9.843754] systemd[1]: Finished Import lastlog data into lastlog2 database.3702worker2 # [ 9.994685] 8021q: 802.1Q VLAN Support v1.83703worker2 # [ 9.995150] 8021q: adding VLAN 0 to HW filter on device eth13704worker2 # [ 9.878745] systemd[1]: Finished Permit User Sessions.3705worker2 # [ 9.882750] systemd[1]: Started Getty on tty1.3706worker2 # [ 9.884287] systemd[1]: Reached target Login Prompts.3707worker2 # [ 9.898553] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3708lb # [ 10.015660] Console: switching to colour frame buffer device 160x503709lb # [ 10.079653] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device3710lb # [ 9.723111] systemd[1]: Stopped target Host and Network Name Lookups.3711client # [ 9.944571] dbus-broker-launch[442]: Looking up NSS user entry for 'systemd-timesync'...3712lb # [ 9.951156] systemd[1]: Stopping Host and Network Name Lookups...3713lb # [ 9.952389] systemd[1]: Stopped target User and Group Name Lookups.3714worker2 # [ 10.086941] cfg80211: Loading compiled-in X.509 certificates for regulatory database3715lb # [ 9.961384] nsncd[611]: Sep 20 10:49:18.182 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3716lb # [ 9.963455] systemd[1]: Stopping User and Group Name Lookups...3717client # [ 9.964655] dbus-broker-launch[442]: NSS returned no entry for 'systemd-timesync'3718lb # [ 9.972136] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3719lb # [ 9.973180] systemd[1]: Started D-Bus System Message Bus.3720client # [ 9.966134] dbus-broker-launch[442]: Invalid user-name in /nix/store/i187syzbavbkjz7z897lklr60jwf2ymx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3721lb # [ 9.974023] systemd[1]: nscd.service: Deactivated successfully.3722lb # [ 9.974775] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3723lb # [ 9.976858] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3724worker2 # [ 10.108824] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3725worker2 # [ 10.109652] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3726lb # [ 9.979470] dbus-broker-launch[552]: Ready3727worker2 # [ 10.112132] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23728worker2 # [ 10.112969] cfg80211: failed to load regulatory.db3729lb # [ 9.984195] systemd[1]: Started Name Service Cache Daemon (nsncd).3730lb # [ 9.985223] systemd[1]: Reached target Host and Network Name Lookups.3731lb # [ 9.986873] systemd[1]: Reached target User and Group Name Lookups.3732lb # [ 9.987813] systemd[1]: Starting Virtual Console Setup...3733lb # [ 9.991131] systemd[1]: Finished resolvconf update.3734client # [ 9.985816] systemd[1]: Stopped target Host and Network Name Lookups.3735lb # [ 9.992831] systemd[1]: Reached target Preparation for Network.3736client # [ 9.987133] systemd[1]: Stopping Host and Network Name Lookups...3737client # [ 9.987910] systemd[1]: Stopped target User and Group Name Lookups.3738lb # [ 9.994517] systemd[1]: Starting DHCP Client...3739client # [ 9.990338] systemd[1]: Stopping User and Group Name Lookups...3740lb # [ 9.997187] systemd[1]: Starting Address configuration of eth1...3741client # [ 9.991978] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3742lb # [ 10.000536] systemd[1]: Starting Extra networking commands....3743client # [ 9.994936] systemd[1]: nscd.service: Deactivated successfully.3744lb # [ 10.001373] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3745lb # [ 10.002511] systemd-logind[554]: New seat seat0.3746lb # [ 10.003261] systemd-logind[554]: Watching system buttons on /dev/input/event2 (Power Button)3747client # [ 9.999033] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3748lb # [ 10.006986] systemd[1]: Stopped Virtual Console Setup.3749lb # [ 10.009248] systemd-logind[554]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3750lb # [ 10.011279] systemd[1]: Started User Login Management.3751lb # [ 10.015392] systemd[1]: Starting linger-users.service...3752worker2 # [ 10.154604] 8021q: adding VLAN 0 to HW filter on device eth03753worker2 # [ 10.022350] dhcpcd[693]: eth0: waiting for carrier3754worker2 # [ 10.023109] dhcpcd[693]: eth0: carrier acquired3755client # [ 10.019882] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3756client # [ 10.020761] systemd[1]: Started D-Bus System Message Bus.3757lb # [ 10.027676] systemd[1]: Starting Virtual Console Setup...3758client # [ 10.023312] systemd-logind[461]: New seat seat0.3759worker2 # [ 10.030862] dhcpcd[693]: DUID 00:01:00:01:32:42:76:ae:52:54:00:12:34:563760worker2 # [ 10.031864] dhcpcd[693]: eth0: IAID 00:12:34:563761worker2 # [ 10.032615] dhcpcd[693]: eth0: adding address fe80::5054:ff:fe12:34563762client # [ 10.030870] systemd-logind[461]: Watching system buttons on /dev/input/event2 (Power Button)3763client # [ 10.032179] systemd-logind[461]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3764client # [ 10.035236] systemd-logind[461]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3765client # [ 10.049771] systemd[1]: Started User Login Management.3766client # [ 10.068073] systemd[1]: Starting linger-users.service...3767client # [ 10.075985] dbus-broker-launch[442]: Ready3768lb # [ 10.092447] network-addresses-eth1-start[636]: adding address 192.168.1.2/24... done3769client # [ 10.116602] systemd[1]: Started Name Service Cache Daemon (nsncd).3770lb # [ 10.122603] network-addresses-eth1-start[636]: adding address 2001:db8:1::2/64... done3771client # [ 10.119217] systemd[1]: Reached target Host and Network Name Lookups.3772client # [ 10.120368] nsncd[517]: Sep 20 10:49:18.911 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3773client # [ 10.122195] systemd[1]: Reached target User and Group Name Lookups.3774lb # [ 10.132407] systemd[1]: linger-users.service: Deactivated successfully.3775client # [ 10.132685] systemd[1]: linger-users.service: Deactivated successfully.3776lb # [ 10.138889] systemd[1]: Finished linger-users.service.3777client # [ 10.134437] systemd[1]: Finished linger-users.service.3778client # [ 10.148286] systemd[1]: Finished resolvconf update.3779lb # [ 10.287032] ppdev: user-space parallel port driver3780client # [ 10.152922] systemd[1]: Starting DHCP Client...3781lb # [ 10.161904] systemd[1]: Finished Address configuration of eth1.3782client # [ 10.264295] dhcpcd[556]: dhcpcd-10.3.2 starting3783client # [ 10.273528] dhcpcd[564]: dev: loaded udev3784lb # [ 10.280572] systemd-logind[554]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3785lb # [ 10.288461] dhcpcd[647]: dhcpcd-10.3.2 starting3786lb # [ 10.292568] systemd[1]: Finished Extra networking commands..3787lb # [ 10.295206] systemd[1]: Reached target Network.3788client # [ 10.426606] 8021q: 802.1Q VLAN Support v1.83789lb # [ 10.305992] systemd[1]: Starting PostgreSQL Server...3790lb # [ 10.307437] dhcpcd[714]: dev: loaded udev3791lb # [ 10.311568] systemd[1]: Starting Permit User Sessions...3792client # [ 10.321272] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3793lb # [ 10.462363] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3794lb # [ 10.472953] 8021q: 802.1Q VLAN Support v1.83795lb # [ 10.473366] 8021q: adding VLAN 0 to HW filter on device eth13796lb # [ 10.376942] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3797lb # [ 10.381482] systemd[1]: Stopped Virtual Console Setup.3798client # [ 10.522510] cfg80211: Loading compiled-in X.509 certificates for regulatory database3799lb # [ 10.403355] systemd[1]: Finished Permit User Sessions.3800lb # [ 10.417312] systemd[1]: Started Getty on tty1.3801lb # [ 10.551260] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3802client # [ 10.415940] systemd[1]: Finished nftables firewall.3803lb # [ 10.422590] systemd[1]: Reached target Login Prompts.3804client # [ 10.417865] systemd[1]: Reached target Preparation for Network.3805client # [ 10.552581] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3806client # [ 10.554040] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3807client # [ 10.557050] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23808client # [ 10.557870] cfg80211: failed to load regulatory.db3809client # [ 10.423988] systemd[1]: Starting Address configuration of eth1...3810lb # [ 10.435442] systemd[1]: Starting Virtual Console Setup...3811client # [ 10.431208] systemd[1]: Starting Extra networking commands....3812worker1 # [ 10.516861] dhcpcd[694]: eth0: soliciting a DHCP lease3813client # [ 10.627782] 8021q: adding VLAN 0 to HW filter on device eth03814client # [ 10.495951] dhcpcd[564]: eth0: waiting for carrier3815client # [ 10.497234] dhcpcd[564]: eth0: carrier acquired3816client # [ 10.641062] 8021q: adding VLAN 0 to HW filter on device eth13817worker1 # [ 10.676279] NET: Registered PF_PACKET protocol family3818client # [ 10.510213] dhcpcd[564]: DUID 00:01:00:01:32:42:76:af:52:54:00:12:34:563819client # [ 10.511275] dhcpcd[564]: eth0: IAID 00:12:34:563820client # [ 10.512467] dhcpcd[564]: eth0: adding address fe80::5054:ff:fe12:34563821worker1 # [ 10.550260] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.23822worker1 # [ 10.555355] dhcpcd[694]: eth0: probing address 10.0.2.15/243823client # [ 10.526338] network-addresses-eth1-start[580]: adding address 192.168.1.1/24... done3824lb # [ 10.535408] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3825client # [ 10.538458] network-addresses-eth1-start[580]: adding address 2001:db8:1::1/64... done3826client # [ 10.555625] systemd[1]: Finished Address configuration of eth1.3827client # [ 10.578359] systemd[1]: Finished Extra networking commands..3828client # [ 10.580213] systemd[1]: Reached target Network.3829client # [ 10.583451] systemd[1]: Starting Permit User Sessions...3830client # [ 10.612280] systemd[1]: Finished Permit User Sessions.3831lb # [ 10.752153] cfg80211: Loading compiled-in X.509 certificates for regulatory database3832client # [ 10.616259] systemd[1]: Started Getty on tty1.3833client # [ 10.617448] systemd[1]: Reached target Login Prompts.3834lb # [ 10.792888] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3835lb # [ 10.793566] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3836lb # [ 10.797382] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23837lb # [ 10.798337] cfg80211: failed to load regulatory.db3838lb # [ 10.838086] kvm_amd: TSC scaling supported3839lb # [ 10.838603] kvm_amd: Nested Virtualization enabled3840lb # [ 10.840043] kvm_amd: Nested Paging enabled3841lb # [ 10.840553] kvm_amd: LBR virtualization supported3842lb # [ 10.841810] kvm_amd: Virtual VMLOAD VMSAVE supported3843lb # [ 10.842338] kvm_amd: Virtual GIF supported3844lb # [ 10.843188] kvm_amd: Virtual NMI enabled3845lb # [ 10.749198] postgresql-pre-start[730]: The files belonging to this database system will be owned by user "postgres".3846lb # [ 10.750639] postgresql-pre-start[730]: This user must also own the server process.3847lb # [ 10.893456] 8021q: adding VLAN 0 to HW filter on device eth03848lb # [ 10.762382] dhcpcd[714]: eth0: waiting for carrier3849lb # [ 10.764123] dhcpcd[714]: eth0: carrier acquired3850lb # [ 10.768396] postgresql-pre-start[730]: The database cluster will be initialized with locale "en_US.UTF-8".3851lb # [ 10.769613] postgresql-pre-start[730]: The default database encoding has accordingly been set to "UTF8".3852lb # [ 10.770738] postgresql-pre-start[730]: The default text search configuration will be set to "english".3853lb # [ 10.771867] postgresql-pre-start[730]: Data page checksums are enabled.3854lb # [ 10.772687] postgresql-pre-start[730]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3855lb # [ 10.773925] postgresql-pre-start[730]: creating subdirectories ... ok3856lb # [ 10.775673] postgresql-pre-start[730]: selecting dynamic shared memory implementation ... posix3857lb # [ 10.790110] dhcpcd[714]: DUID 00:01:00:01:32:42:76:af:52:54:00:12:34:563858lb # [ 10.791163] dhcpcd[714]: eth0: IAID 00:12:34:563859lb # [ 10.793924] dhcpcd[714]: eth0: adding address fe80::5054:ff:fe12:34563860lb # [ 10.947478] EDAC MC: Ver: 3.0.03861worker1 # [ 10.877197] dhcpcd[694]: eth0: soliciting an IPv6 router3862worker1 # [ 10.880414] dhcpcd[694]: eth0: Router Advertisement from fe80::23863worker1 # [ 10.882449] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/643864worker1 # [ 10.884663] dhcpcd[694]: eth0: adding route to fec0::/643865worker1 # [ 10.886587] dhcpcd[694]: eth0: adding default route via fe80::23866lb # [ 10.899508] postgresql-pre-start[730]: selecting default "max_connections" ... 1003867lb # [ 10.964477] systemd-vconsole-setup[727]: Configuration of first virtual console was skipped, ignoring remaining ones.3868lb # [ 10.970499] systemd[1]: Finished Virtual Console Setup.3869lb # [ 10.995505] postgresql-pre-start[730]: selecting default "shared_buffers" ... 128MB3870worker2 # [ 11.010129] dhcpcd[693]: eth0: soliciting a DHCP lease3871worker2 # [ 11.168528] NET: Registered PF_PACKET protocol family3872worker2 # [ 11.042828] dhcpcd[693]: eth0: offered 10.0.2.15 from 10.0.2.23873worker2 # [ 11.045556] dhcpcd[693]: eth0: probing address 10.0.2.15/243874client # [ 11.126981] dhcpcd[564]: eth0: soliciting a DHCP lease3875client: (finished: waiting for unit network-addresses-eth1.service, in 11.81 seconds)3876client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3877client # [ 11.281305] NET: Registered PF_PACKET protocol family3878client # [ 11.153345] dhcpcd[564]: eth0: offered 10.0.2.15 from 10.0.2.23879client # [ 11.156196] dhcpcd[564]: eth0: probing address 10.0.2.15/243880client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3881lb: waiting for unit network-addresses-eth1.service3882lb: waiting for the VM to finish booting3883lb: Guest shell says: b'Spawning backdoor root shell...\n'3884lb: connected to guest root shell3885lb: (connecting took 0.00 seconds)3886lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3887lb: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds)3888lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3889lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.02 seconds)3890worker1: waiting for unit network-addresses-eth1.service3891worker1: waiting for the VM to finish booting3892worker1: Guest shell says: b'Spawning backdoor root shell...\n'3893worker1: connected to guest root shell3894worker1: (connecting took 0.00 seconds)3895worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3896worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3897worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3898worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3899worker2: waiting for unit network-addresses-eth1.service3900worker2: waiting for the VM to finish booting3901worker2: Guest shell says: b'Spawning backdoor root shell...\n'3902worker2: connected to guest root shell3903worker2: (connecting took 0.00 seconds)3904worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3905worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3906worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3907worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3908lb: waiting for unit niks3.service3909lb # [ 12.299223] dhcpcd[714]: eth0: soliciting a DHCP lease3910lb # [ 12.448517] NET: Registered PF_PACKET protocol family3911lb # [ 12.321772] dhcpcd[714]: eth0: offered 10.0.2.15 from 10.0.2.23912lb # [ 12.324162] dhcpcd[714]: eth0: probing address 10.0.2.15/243913lb # [ 12.491239] postgresql-pre-start[730]: selecting default time zone ... UTC3914lb # [ 12.495132] postgresql-pre-start[730]: creating configuration files ... ok3915lb # [ 12.729587] postgresql-pre-start[730]: running bootstrap script ... ok3916worker2 # [ 12.831125] dhcpcd[693]: eth0: soliciting an IPv6 router3917worker2 # [ 12.833274] dhcpcd[693]: eth0: Router Advertisement from fe80::23918worker2 # [ 12.835311] dhcpcd[693]: eth0: adding address fec0::5054:ff:fe12:3456/643919worker2 # [ 12.837669] dhcpcd[693]: eth0: adding route to fec0::/643920worker2 # [ 12.839594] dhcpcd[693]: eth0: adding default route via fe80::23921lb # [ 13.170226] dhcpcd[714]: eth0: soliciting an IPv6 router3922lb # [ 13.171463] dhcpcd[714]: eth0: Router Advertisement from fe80::23923lb # [ 13.172285] dhcpcd[714]: eth0: adding address fec0::5054:ff:fe12:3456/643924lb # [ 13.174141] dhcpcd[714]: eth0: adding route to fec0::/643925lb # [ 13.174919] dhcpcd[714]: eth0: adding default route via fe80::23926lb # [ 13.232977] postgresql-pre-start[730]: performing post-bootstrap initialization ... ok3927client # [ 13.269807] dhcpcd[564]: eth0: soliciting an IPv6 router3928client # [ 13.272711] dhcpcd[564]: eth0: Router Advertisement from fe80::23929client # [ 13.274875] dhcpcd[564]: eth0: adding address fec0::5054:ff:fe12:3456/643930client # [ 13.277131] dhcpcd[564]: eth0: adding route to fec0::/643931client # [ 13.278990] dhcpcd[564]: eth0: adding default route via fe80::23932lb # [ 13.356114] postgresql-pre-start[730]: syncing data to disk ... ok3933lb # [ 13.357920] postgresql-pre-start[730]: initdb: warning: enabling "trust" authentication for local connections3934lb # [ 13.359188] postgresql-pre-start[730]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3935lb # [ 13.361050] postgresql-pre-start[730]: Success. You can now start the database server using:3936lb # [ 13.362078] postgresql-pre-start[730]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3937lb # [ 13.479426] postgres[792]: [792] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3938lb # [ 13.484198] postgres[792]: [792] LOG: listening on IPv6 address "::1", port 54323939lb # [ 13.485237] postgres[792]: [792] LOG: listening on IPv4 address "127.0.0.1", port 54323940lb # [ 13.489113] postgres[792]: [792] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3941lb # [ 13.501349] postgres[801]: [801] LOG: database system was shut down at 2026-09-20 10:49:21 GMT3942lb # [ 13.507747] postgres[792]: [792] LOG: database system is ready to accept connections3943lb # [ 13.512535] systemd[1]: Started PostgreSQL Server.3944lb # [ 13.519368] systemd[1]: Starting PostgreSQL Setup Scripts...3945lb # [ 13.741324] postgresql-setup-start[812]: CREATE DATABASE3946lb # [ 13.786883] postgresql-setup-start[826]: CREATE ROLE3947lb # [ 13.806988] postgresql-setup-start[828]: ALTER DATABASE3948lb # [ 13.812478] systemd[1]: Finished PostgreSQL Setup Scripts.3949lb # [ 13.814281] systemd[1]: Reached target PostgreSQL.3950worker1 # [ 14.899663] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds3951worker1 # [ 14.900820] dhcpcd[694]: eth0: adding route to 10.0.2.0/243952worker1 # [ 14.901617] dhcpcd[694]: eth0: adding default route via 10.0.2.23953worker1 # [ 14.987473] systemd[1]: Started DHCP Client.3954worker1 # [ 14.989586] systemd[1]: Reached target Multi-User System.3955worker1 # [ 14.990465] systemd[1]: Startup finished in 849ms (kernel) + 3.862s (initrd) + 10.277s (userspace) = 14.989s.3956worker2 # [ 15.933656] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds3957worker2 # [ 15.936975] dhcpcd[693]: eth0: adding route to 10.0.2.0/243958worker2 # [ 15.939274] dhcpcd[693]: eth0: adding default route via 10.0.2.23959worker2 # [ 16.053643] systemd[1]: Started DHCP Client.3960worker2 # [ 16.055625] systemd[1]: Reached target Multi-User System.3961worker2 # [ 16.056645] systemd[1]: Startup finished in 852ms (kernel) + 3.969s (initrd) + 11.234s (userspace) = 16.056s.3962client # [ 16.447624] dhcpcd[564]: eth0: leased 10.0.2.15 for 86400 seconds3963client # [ 16.449734] dhcpcd[564]: eth0: adding route to 10.0.2.0/243964client # [ 16.452351] dhcpcd[564]: eth0: adding default route via 10.0.2.23965client # [ 16.556744] systemd[1]: Started DHCP Client.3966client # [ 16.558935] systemd[1]: Reached target Multi-User System.3967client # [ 16.559979] systemd[1]: Startup finished in 849ms (kernel) + 4.890s (initrd) + 10.820s (userspace) = 16.559s.3968lb # [ 16.939735] dhcpcd[714]: eth0: leased 10.0.2.15 for 86400 seconds3969lb # [ 16.941853] dhcpcd[714]: eth0: adding route to 10.0.2.0/243970lb # [ 16.945396] dhcpcd[714]: eth0: adding default route via 10.0.2.23971lb # [ 17.078735] systemd[1]: Started DHCP Client.3972lb # [ 17.083197] systemd[1]: Reached target Network is Online.3973lb # [ 17.087095] systemd[1]: Started Envoy reverse proxy.3974lb # [ 17.090882] systemd[1]: Started mock-oidc.service.3975lb # [ 17.179829] mock-oidc-server[919]: Mock OIDC Server running3976lb # [ 17.180922] mock-oidc-server[919]: OIDC Address: 192.168.1.2:80803977lb # [ 17.182164] mock-oidc-server[919]: Issue Address: 0.0.0.0:80813978lb # [ 17.183503] mock-oidc-server[919]: Issuer: http://192.168.1.2:8080/oidc3979lb # [ 17.184651] mock-oidc-server[919]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3980lb # [ 17.186198] mock-oidc-server[919]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3981lb # [ 17.187766] mock-oidc-server[919]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3982lb # [ 17.592371] envoy[918]: [2026-09-20 10:49:25.936][918][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3983lb # [ 17.594398] envoy[918]: [2026-09-20 10:49:25.936][918][info][main] [source/server/server.cc:469] statically linked extensions:3984lb # [ 17.595940] envoy[918]: [2026-09-20 10:49:25.936][918][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3985lb # [ 17.598562] envoy[918]: [2026-09-20 10:49:25.936][918][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13986lb # [ 17.601083] envoy[918]: [2026-09-20 10:49:25.936][918][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3987lb # [ 17.614700] envoy[918]: [2026-09-20 10:49:25.936][918][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3988lb # [ 17.616618] envoy[918]: [2026-09-20 10:49:25.936][918][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3989lb # [ 17.619173] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3990lb # [ 17.623318] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3991lb # [ 17.627854] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3992lb # [ 17.629636] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3993lb # [ 17.631691] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3994lb # [ 17.634099] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3995lb # [ 17.635923] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3996lb # [ 17.638284] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3997lb # [ 17.641187] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3998lb # [ 17.643810] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3999lb # [ 17.647462] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4000lb # [ 17.650096] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4001lb # [ 17.652404] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4002lb # [ 17.654279] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4003lb # [ 17.655941] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4004lb # [ 17.660204] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4005lb # [ 17.664155] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4006lb # [ 17.666422] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4007lb # [ 17.670762] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4008lb # [ 17.672639] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4009lb # [ 17.676523] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4010lb # [ 17.680113] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4011lb # [ 17.682304] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4012lb # [ 17.683862] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4013lb # [ 17.685502] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4014lb # [ 17.690292] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4015lb # [ 17.692661] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4016lb # [ 17.696935] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4017lb # [ 17.699084] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4018lb # [ 17.700839] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4019lb # [ 17.703184] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4020lb # [ 17.708402] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4021lb # [ 17.709851] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4022lb # [ 17.712434] envoy[918]: [2026-09-20 10:49:25.943][918][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4023lb # [ 17.714959] envoy[918]: [2026-09-20 10:49:25.945][918][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4024lb # [ 17.717407] envoy[918]: [2026-09-20 10:49:25.945][918][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4025lb # [ 17.742097] envoy[918]: [2026-09-20 10:49:25.945][918][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4026lb # [ 17.743646] envoy[918]: [2026-09-20 10:49:25.945][918][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4027lb # [ 17.745519] envoy[918]: [2026-09-20 10:49:25.945][918][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4028lb # [ 17.747851] envoy[918]: [2026-09-20 10:49:25.945][918][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4029lb # [ 17.758313] envoy[918]: [2026-09-20 10:49:25.945][918][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4030lb # [ 17.760097] envoy[918]: [2026-09-20 10:49:25.952][918][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4031lb # [ 17.762826] envoy[918]: [2026-09-20 10:49:25.952][918][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4032lb # [ 17.766570] envoy[918]: [2026-09-20 10:49:25.952][918][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4033lb # [ 17.768917] envoy[918]: [2026-09-20 10:49:25.952][918][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24034lb # [ 17.771027] envoy[918]: [2026-09-20 10:49:25.952][918][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4035lb # [ 17.772736] envoy[918]: [2026-09-20 10:49:25.952][918][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4036lb # [ 17.774294] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4037lb # [ 17.776798] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4038lb # [ 17.778700] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4039lb # [ 17.780957] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4040lb # [ 17.782311] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4041lb # [ 17.784953] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4042lb # [ 17.786734] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24043lb # [ 17.788413] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4044lb # [ 17.790145] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4045lb # [ 17.792134] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4046lb # [ 17.794462] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24047lb # [ 17.796052] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4048lb # [ 17.798238] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84049lb # [ 17.799944] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4050lb # [ 17.802731] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4051lb # [ 17.805080] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4052lb # [ 17.810863] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4053lb # [ 17.812526] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4054lb # [ 17.814150] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4055lb # [ 17.816531] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4056lb # [ 17.822369] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4057lb # [ 17.824529] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4058lb # [ 17.826287] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4059lb # [ 17.828496] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4060lb # [ 17.830262] envoy[918]: [2026-09-20 10:49:25.953][918][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4061lb # [ 17.835340] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4062lb # [ 17.841178] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4063lb # [ 17.842830] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4064lb # [ 17.845079] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4065lb # [ 17.847103] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4066lb # [ 17.848862] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4067lb # [ 17.851597] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4068lb # [ 17.860463] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4069lb # [ 17.862621] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4070lb # [ 17.864409] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4071lb # [ 17.865898] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4072lb # [ 17.867952] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4073lb # [ 17.870125] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4074lb # [ 17.872553] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4075lb # [ 17.876870] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4076lb # [ 17.878407] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4077lb # [ 17.880272] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4078lb # [ 17.882936] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4079lb # [ 17.889649] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4080lb # [ 17.892399] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4081lb # [ 17.894035] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4082lb # [ 17.896258] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4083lb # [ 17.899036] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4084lb # [ 17.900741] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4085lb # [ 17.903121] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4086lb # [ 17.904755] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4087lb # [ 17.906493] envoy[918]: [2026-09-20 10:49:25.954][918][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4088lb # [ 17.908270] envoy[918]: [2026-09-20 10:49:26.136][918][info][main] [source/server/server.cc:531] HTTP header map info:4089lb # [ 17.909587] envoy[918]: [2026-09-20 10:49:26.174][918][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4090lb # [ 17.922046] envoy[918]: [2026-09-20 10:49:26.175][918][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4091lb # [ 17.923479] envoy[918]: [2026-09-20 10:49:26.175][918][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4092lb # [ 17.930693] envoy[918]: [2026-09-20 10:49:26.175][918][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4093lb # [ 17.961764] envoy[918]: [2026-09-20 10:49:26.306][918][info][main] [source/server/server.cc:968] runtime: {}4094lb # [ 17.967050] envoy[918]: [2026-09-20 10:49:26.311][918][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4095lb # [ 17.969050] envoy[918]: [2026-09-20 10:49:26.313][918][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014096lb # [ 17.971406] envoy[918]: [2026-09-20 10:49:26.316][918][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014097lb # [ 17.973884] envoy[918]: [2026-09-20 10:49:26.318][918][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4098lb # [ 17.975469] envoy[918]: [2026-09-20 10:49:26.320][918][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4099lb # [ 17.976988] envoy[918]: [2026-09-20 10:49:26.320][918][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4100lb # [ 18.013264] envoy[918]: [2026-09-20 10:49:26.358][918][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4101worker1 # [ 18.047371] systemd[1]: Starting Nix worker-protocol over gRPC...4102worker2 # [ 18.020260] systemd[1]: Starting Nix worker-protocol over gRPC...4103lb # [ 18.030985] envoy[918]: [2026-09-20 10:49:26.375][918][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4104lb # [ 18.033211] envoy[918]: [2026-09-20 10:49:26.378][918][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4105lb # [ 18.035939] envoy[918]: [2026-09-20 10:49:26.380][918][info][main] [source/server/server.cc:1077] starting main dispatch loop4106worker1 # [ 18.230376] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4107worker1 # [ 18.240515] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14108worker2 # [ 18.221570] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4109worker2 # [ 18.228966] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14110worker1 # [ 18.274665] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4111worker1 # [ 18.277900] systemd[1]: Started Nix worker-protocol over gRPC.4112worker2 # [ 18.256684] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4113worker2 # [ 18.260538] systemd[1]: Started Nix worker-protocol over gRPC.4114worker1 # [ 18.306183] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4115worker2 # [ 18.280324] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4116lb # [ 18.296084] envoy[918]: [2026-09-20 10:49:26.640][918][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4117lb # [ 18.299917] envoy[918]: [2026-09-20 10:49:26.640][918][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4118lb # [ 18.304366] envoy[918]: [2026-09-20 10:49:26.640][918][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4119lb # [ 18.309213] envoy[918]: [2026-09-20 10:49:26.648][918][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4120worker1 # [ 18.507411] nix-grpc-daemon[785]: ts=2026-09-20T10:49:27Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4121worker2 # [ 18.481222] nix-grpc-daemon[785]: ts=2026-09-20T10:49:26Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4122worker1 # [ 18.907751] nix-grpc-daemon[785]: ts=2026-09-20T10:49:27Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4123worker2 # [ 18.881626] nix-grpc-daemon[785]: ts=2026-09-20T10:49:27Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4124worker1 # [ 19.711845] nix-grpc-daemon[785]: ts=2026-09-20T10:49:28Z level=info event=scheduler_connected addr=lb:500514125worker2 # [ 19.685684] nix-grpc-daemon[785]: ts=2026-09-20T10:49:27Z level=info event=scheduler_connected addr=lb:500514126worker1 # [ 19.730148] nix-grpc-daemon[785]: ts=2026-09-20T10:49:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04127worker1 # [ 19.736150] nix-grpc-daemon[785]: ts=2026-09-20T10:49:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04128lb # [ 27.233308] rustfs-bucket-start[1019]: mb s3://farm4129lb # [ 27.238760] systemd[1]: Finished rustfs-bucket.service.4130lb # [ 27.245250] systemd[1]: Starting niks3 server...4131lb # [ 27.492815] postgres[1033]: [1033] ERROR: relation "goose_db_version" does not exist at character 364132lb # [ 27.494045] postgres[1033]: [1033] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4133lb # [ 27.537236] niks3-server[1027]: 2026/09/20 10:49:35 OK 20241026095416_initial_model.sql (23.2ms)4134lb # [ 27.541028] niks3-server[1027]: 2026/09/20 10:49:35 OK 20251210153512_drop_unused_gin_index.sql (3.92ms)4135lb # [ 27.546395] niks3-server[1027]: 2026/09/20 10:49:35 OK 20251218171726_add_pins.sql (3.54ms)4136lb # [ 27.551549] niks3-server[1027]: 2026/09/20 10:49:35 OK 20260628120000_add_object_size_and_stats.sql (5.53ms)4137lb # [ 27.555976] niks3-server[1027]: 2026/09/20 10:49:35 OK 20260905000000_add_claims.sql (4.35ms)4138lb # [ 27.557072] niks3-server[1027]: 2026/09/20 10:49:35 goose: successfully migrated database to version: 202609050000004139lb # [ 27.563837] niks3-server[1027]: 2026/09/20 10:49:35 OK 1_commit_pending_closure.sql (7.91ms)4140lb # [ 27.566530] niks3-server[1027]: 2026/09/20 10:49:35 OK 2_object_stats_trigger.sql (1.47ms)4141lb # [ 27.567699] niks3-server[1027]: 2026/09/20 10:49:35 goose: up to current file version: 24142lb # [ 27.575221] niks3-server[1027]: 2026/09/20 10:49:35 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4143lb # [ 27.665705] niks3-server[1027]: 2026/09/20 10:49:36 INFO Read proxy enabled — serving cache objects from S34144lb # [ 27.667524] niks3-server[1027]: 2026/09/20 10:49:36 INFO Using socket-activated listener address=0.0.0.0:57514145lb # [ 27.672917] systemd[1]: Started niks3 server.4146lb # [ 27.673608] systemd[1]: Reached target Multi-User System.4147lb # [ 27.674825] systemd[1]: Startup finished in 868ms (kernel) + 4.894s (initrd) + 21.912s (userspace) = 27.674s.4148lb # [ 27.676689] niks3-server[1027]: 2026/09/20 10:49:36 INFO systemd watchdog enabled interval=15s4149lb # [ 27.678574] niks3-server[1027]: 2026/09/20 10:49:36 INFO Starting HTTP server address=0.0.0.0:57514150lb: (finished: waiting for unit niks3.service, in 16.37 seconds)4151lb: waiting for TCP port 5751 on localhost4152lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4153lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4154lb: waiting for unit envoy.service4155lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4156lb: waiting for TCP port 50051 on localhost4157lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4158lb # [ 27.987855] envoy[918]: conn peer=[::1]:51044 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34159lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4160lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4161??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4162 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284163lb: must succeed: curl -sf localhost:9901/clusters4164lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4165lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)4166lb: waiting until exactly no endpoints of sched are unhealthy4167lb: must succeed: curl -sf localhost:9901/clusters4168lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4169lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.03 seconds)4170subtest: both builders hold a WorkerSession on the scheduler4171worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4172worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4173(finished: subtest: both builders hold a WorkerSession on the scheduler, in 0.08 seconds)4174subtest: balancer auth: client cert, bearer token, nothing, unknown CN4175worker2 # [ 28.520068] nix-grpc-daemon[785]: ts=2026-09-20T10:49:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:513604176worker2 # [ 28.525966] systemd[1]: Started Nix Daemon.4177worker2 # [ 28.711763] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4178worker2 # [ 28.764540] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)4179worker2 # [ 28.768879] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 2/5)4180worker2 # [ 28.839425] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 398 ms (attempt 3/5)4181worker2 # [ 29.237582] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 542 ms (attempt 4/5)4182worker2 # [ 29.786479] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4183worker2 # [ 29.810115] nix-grpc-daemon[785]: ts=2026-09-20T10:49:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513604184worker2 # [ 29.819327] nix-grpc-daemon[785]: ts=2026-09-20T10:49:38Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4185worker1 # [ 29.861802] nix-grpc-daemon[785]: ts=2026-09-20T10:49:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:518184186worker1 # [ 29.874631] systemd[1]: Started Nix Daemon.4187worker1 # [ 30.096248] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4188worker1 # [ 30.124256] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)4189worker1 # [ 30.178747] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 2/5)4190worker1 # [ 30.272246] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 238 ms (attempt 3/5)4191worker1 # [ 30.512834] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 4/5)4192worker1 # [ 30.615161] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4193worker1 # [ 30.629088] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4194client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4195client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)4196client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4197client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4198worker2 # [ 30.974945] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=info event=oidc_jwks provider=mock keys=14199worker2 # [ 30.978809] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:513604200worker1 # [ 31.036881] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=info event=oidc_jwks provider=mock keys=14201worker1 # [ 31.040890] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:518184202worker1 # [ 31.050098] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4203worker1 # [ 31.059439] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:518184204worker1 # [ 31.068483] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4205client: must succeed: rm -r /var/lib/nix-grpc-store4206client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4207worker1 # [ 31.338624] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=info event=denied method=QueryMissing cn=- role=none4208worker1 # [ 31.563939] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=info event=denied method=QueryMissing cn=stranger role=none4209(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.28 seconds)4210subtest: DAG build is scheduled across workers and lands in the cache4211client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24212worker2 # [ 31.770556] nix-grpc-daemon[785]: ts=2026-09-20T10:49:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:513604213client # don't know how to build these paths:4214client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4215worker2 # [ 31.784417] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513604216worker1 # [ 31.872937] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04217worker1 # [ 31.878820] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14218worker1 # [ 31.924118] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184219worker1 # [ 31.943601] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184220client # copying 1 paths to 'lb:50051'...4221worker1 # [ 31.953343] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184222client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4223worker1 # [ 31.976905] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4224worker1 # [ 31.995257] nix-grpc-daemon[785]: ts=2026-09-20T10:49:40Z level=info event=niks3_push_started pid=8554225worker1 # [ 32.458370] nix-daemon[843]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4226worker1 # [ 32.475175] nix-daemon[843]: reaped child process 870, status = succeeded4227worker1 # [ 32.624438] nix-daemon[843]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4228worker1 # [ 32.636946] nix-daemon[843]: reaped child process 875, status = succeeded4229lb # [ 32.624325] niks3-server[1027]: 2026/09/20 10:49:40 INFO Received uploads request method=POST path=/api/pending_closures4230worker1 # [ 32.669944] nix-grpc-daemon[855]: time=2026-09-20T10:49:41.230Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4231worker1 # [ 32.673150] nix-grpc-daemon[855]: time=2026-09-20T10:49:41.233Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4232lb # [ 32.675348] niks3-server[1027]: 2026/09/20 10:49:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4233lb # [ 32.679170] niks3-server[1027]: 2026/09/20 10:49:41 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4234lb # [ 32.698960] niks3-server[1027]: 2026/09/20 10:49:41 INFO Signed narinfos id=1 count=14235worker1 # [ 32.730235] nix-grpc-daemon[855]: time=2026-09-20T10:49:41.291Z level=INFO msg="Uploading 1 narinfos"4236lb # [ 32.705314] niks3-server[1027]: 2026/09/20 10:49:41 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4237lb # [ 32.712370] niks3-server[1027]: 2026/09/20 10:49:41 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4238lb # [ 32.721214] niks3-server[1027]: 2026/09/20 10:49:41 INFO Completed upload id=14239worker1 # [ 32.749850] nix-grpc-daemon[855]: time=2026-09-20T10:49:41.311Z level=INFO msg="Upload complete. (471ms)"4240worker1 # [ 32.752638] nix-grpc-daemon[785]: ts=2026-09-20T10:49:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=5044241lb # [ 32.729381] niks3-server[1027]: 2026/09/20 10:49:41 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4242worker1 # [ 32.761094] nix-daemon[843]: reaped child process 853, status = succeeded4243worker1 # [ 32.762589] nix-grpc-daemon[785]: ts=2026-09-20T10:49:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184244worker1 # [ 32.767972] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4245worker1 # [ 32.774430] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4246client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4247client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4248client # farm-a> LOG-farm-a-t14249worker1 # [ 33.988314] nix-daemon[843]: reaped child process 879, status = succeeded4250worker1 # [ 34.142679] nix-daemon[843]: accepted connection from pid 895, user nix-grpc-daemon (trusted)4251worker1 # [ 34.153697] nix-daemon[843]: reaped child process 898, status = succeeded4252lb # [ 34.142368] niks3-server[1027]: 2026/09/20 10:49:42 INFO Received uploads request method=POST path=/api/pending_closures4253worker1 # [ 34.183843] nix-grpc-daemon[855]: time=2026-09-20T10:49:42.745Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4254worker1 # [ 34.185458] nix-grpc-daemon[855]: time=2026-09-20T10:49:42.746Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4255lb # [ 34.189582] niks3-server[1027]: 2026/09/20 10:49:42 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4256lb # [ 34.200778] niks3-server[1027]: 2026/09/20 10:49:42 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4257lb # [ 34.211556] niks3-server[1027]: 2026/09/20 10:49:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4258lb # [ 34.215824] niks3-server[1027]: 2026/09/20 10:49:42 INFO Signed narinfos id=2 count=14259worker1 # [ 34.244937] nix-grpc-daemon[855]: time=2026-09-20T10:49:42.805Z level=INFO msg="Uploading 1 narinfos"4260lb # [ 34.221135] niks3-server[1027]: 2026/09/20 10:49:42 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4261lb # [ 34.229444] niks3-server[1027]: 2026/09/20 10:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4262lb # [ 34.237179] niks3-server[1027]: 2026/09/20 10:49:42 INFO Completed upload id=24263lb # [ 34.238896] niks3-server[1027]: 2026/09/20 10:49:42 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4264worker1 # [ 34.265975] nix-grpc-daemon[855]: time=2026-09-20T10:49:42.827Z level=INFO msg="Upload complete. (280ms)"4265worker1 # [ 34.274677] nix-grpc-daemon[785]: ts=2026-09-20T10:49:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14266worker1 # [ 34.285510] nix-daemon[843]: reaped child process 877, status = succeeded4267worker1 # [ 34.290798] nix-grpc-daemon[785]: ts=2026-09-20T10:49:42Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04268worker1 # [ 34.292912] nix-grpc-daemon[785]: ts=2026-09-20T10:49:42Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14269worker1 # [ 34.334598] nix-grpc-daemon[785]: ts=2026-09-20T10:49:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184270worker1 # [ 34.342463] nix-grpc-daemon[785]: ts=2026-09-20T10:49:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184271worker1 # [ 34.356202] nix-grpc-daemon[855]: time=2026-09-20T10:49:42.917Z level=INFO msg="All 1 paths already cached"4272client # copying 1 paths to 'lb:50051'...4273client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4274worker1 # [ 34.366308] nix-grpc-daemon[785]: ts=2026-09-20T10:49:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184275worker1 # [ 34.381239] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4276worker1 # [ 34.545259] nix-daemon[843]: accepted connection from pid 904, user nix-grpc-daemon (trusted)4277worker1 # [ 34.558137] nix-daemon[843]: reaped child process 907, status = succeeded4278worker1 # [ 34.709293] nix-daemon[843]: accepted connection from pid 909, user nix-grpc-daemon (trusted)4279worker1 # [ 34.720735] nix-daemon[843]: reaped child process 912, status = succeeded4280lb # [ 34.708178] niks3-server[1027]: 2026/09/20 10:49:43 INFO Received uploads request method=POST path=/api/pending_closures4281worker1 # [ 34.748701] nix-grpc-daemon[855]: time=2026-09-20T10:49:43.310Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4282worker1 # [ 34.750391] nix-grpc-daemon[855]: time=2026-09-20T10:49:43.311Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4283lb # [ 34.742897] niks3-server[1027]: 2026/09/20 10:49:43 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4284lb # [ 34.755113] niks3-server[1027]: 2026/09/20 10:49:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4285worker1 # [ 34.790464] nix-grpc-daemon[855]: time=2026-09-20T10:49:43.351Z level=INFO msg="Uploading 1 narinfos"4286lb # [ 34.761956] niks3-server[1027]: 2026/09/20 10:49:43 INFO Signed narinfos id=3 count=14287lb # [ 34.766398] niks3-server[1027]: 2026/09/20 10:49:43 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4288lb # [ 34.778123] niks3-server[1027]: 2026/09/20 10:49:43 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4289lb # [ 34.784979] niks3-server[1027]: 2026/09/20 10:49:43 INFO Completed upload id=34290lb # [ 34.787876] niks3-server[1027]: 2026/09/20 10:49:43 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4291worker1 # [ 34.816114] nix-grpc-daemon[855]: time=2026-09-20T10:49:43.377Z level=INFO msg="Upload complete. (422ms)"4292worker1 # [ 34.821147] nix-grpc-daemon[785]: ts=2026-09-20T10:49:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=6244293worker1 # [ 34.825495] nix-grpc-daemon[785]: ts=2026-09-20T10:49:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184294worker1 # [ 34.836990] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4295worker1 # [ 34.840473] nix-daemon[843]: reaped child process 902, status = succeeded4296client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4297worker1 # [ 34.846465] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4298client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4299client # farm-b> LOG-farm-b-t14300worker1 # [ 35.471942] nix-daemon[843]: reaped child process 916, status = succeeded4301worker1 # [ 35.619302] nix-daemon[843]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4302worker1 # [ 35.631207] nix-daemon[843]: reaped child process 935, status = succeeded4303lb # [ 35.617985] niks3-server[1027]: 2026/09/20 10:49:43 INFO Received uploads request method=POST path=/api/pending_closures4304worker1 # [ 35.652376] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.213Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4305worker1 # [ 35.654164] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.215Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4306lb # [ 35.637981] niks3-server[1027]: 2026/09/20 10:49:43 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4307lb # [ 35.644070] niks3-server[1027]: 2026/09/20 10:49:43 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4308lb # [ 35.648159] niks3-server[1027]: 2026/09/20 10:49:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4309lb # [ 35.649993] niks3-server[1027]: 2026/09/20 10:49:43 INFO Signed narinfos id=4 count=14310worker1 # [ 35.679966] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.241Z level=INFO msg="Uploading 1 narinfos"4311lb # [ 35.653343] niks3-server[1027]: 2026/09/20 10:49:43 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4312lb # [ 35.658060] niks3-server[1027]: 2026/09/20 10:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4313lb # [ 35.662291] niks3-server[1027]: 2026/09/20 10:49:44 INFO Completed upload id=44314worker1 # [ 35.690510] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.252Z level=INFO msg="Upload complete. (238ms)"4315lb # [ 35.664161] niks3-server[1027]: 2026/09/20 10:49:44 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4316worker1 # [ 35.693354] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14317worker1 # [ 35.700799] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04318worker1 # [ 35.702856] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14319worker1 # [ 35.707107] nix-daemon[843]: reaped child process 914, status = succeeded4320worker1 # [ 35.745540] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184321worker1 # [ 35.756481] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184322worker1 # [ 35.767682] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.329Z level=INFO msg="All 2 paths already cached"4323client # copying 1 paths to 'lb:50051'...4324client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4325worker1 # [ 35.775240] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184326worker1 # [ 35.782372] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4327worker1 # [ 35.944409] nix-daemon[843]: accepted connection from pid 941, user nix-grpc-daemon (trusted)4328worker1 # [ 35.957090] nix-daemon[843]: reaped child process 944, status = succeeded4329worker1 # [ 36.109874] nix-daemon[843]: accepted connection from pid 946, user nix-grpc-daemon (trusted)4330worker1 # [ 36.122030] nix-daemon[843]: reaped child process 949, status = succeeded4331lb # [ 36.102995] niks3-server[1027]: 2026/09/20 10:49:44 INFO Received uploads request method=POST path=/api/pending_closures4332worker1 # [ 36.136606] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.698Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4333worker1 # [ 36.138262] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.699Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4334lb # [ 36.121994] niks3-server[1027]: 2026/09/20 10:49:44 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4335lb # [ 36.124984] niks3-server[1027]: 2026/09/20 10:49:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4336lb # [ 36.127342] niks3-server[1027]: 2026/09/20 10:49:44 INFO Signed narinfos id=5 count=14337worker1 # [ 36.157323] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.718Z level=INFO msg="Uploading 1 narinfos"4338lb # [ 36.132468] niks3-server[1027]: 2026/09/20 10:49:44 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4339lb # [ 36.136889] niks3-server[1027]: 2026/09/20 10:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4340lb # [ 36.141451] niks3-server[1027]: 2026/09/20 10:49:44 INFO Completed upload id=54341worker1 # [ 36.170116] nix-grpc-daemon[855]: time=2026-09-20T10:49:44.731Z level=INFO msg="Upload complete. (376ms)"4342lb # [ 36.142771] niks3-server[1027]: 2026/09/20 10:49:44 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4343worker1 # [ 36.172495] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=7524344worker1 # [ 36.175408] nix-grpc-daemon[785]: ts=2026-09-20T10:49:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184345worker1 # [ 36.180421] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4346worker1 # [ 36.184419] nix-daemon[843]: reaped child process 939, status = succeeded4347client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4348worker1 # [ 36.189226] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4349client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4350client # farm-top> LOG-farm-top-t14351worker1 # [ 37.015477] nix-daemon[843]: reaped child process 953, status = succeeded4352worker1 # [ 37.168933] nix-daemon[843]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4353worker1 # [ 37.180902] nix-daemon[843]: reaped child process 971, status = succeeded4354lb # [ 37.169296] niks3-server[1027]: 2026/09/20 10:49:45 INFO Received uploads request method=POST path=/api/pending_closures4355worker1 # [ 37.206587] nix-grpc-daemon[855]: time=2026-09-20T10:49:45.767Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4356worker1 # [ 37.208041] nix-grpc-daemon[855]: time=2026-09-20T10:49:45.769Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4357lb # [ 37.202273] niks3-server[1027]: 2026/09/20 10:49:45 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4358lb # [ 37.213689] niks3-server[1027]: 2026/09/20 10:49:45 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4359lb # [ 37.226301] niks3-server[1027]: 2026/09/20 10:49:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4360worker1 # [ 37.260022] nix-grpc-daemon[855]: time=2026-09-20T10:49:45.821Z level=INFO msg="Uploading 1 narinfos"4361lb # [ 37.231971] niks3-server[1027]: 2026/09/20 10:49:45 INFO Signed narinfos id=6 count=14362lb # [ 37.237291] niks3-server[1027]: 2026/09/20 10:49:45 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4363lb # [ 37.245497] niks3-server[1027]: 2026/09/20 10:49:45 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4364lb # [ 37.252330] niks3-server[1027]: 2026/09/20 10:49:45 INFO Completed upload id=64365lb # [ 37.254627] niks3-server[1027]: 2026/09/20 10:49:45 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4366worker1 # [ 37.282465] nix-grpc-daemon[855]: time=2026-09-20T10:49:45.843Z level=INFO msg="Upload complete. (284ms)"4367worker1 # [ 37.290296] nix-grpc-daemon[785]: ts=2026-09-20T10:49:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14368worker1 # [ 37.303383] nix-daemon[843]: reaped child process 951, status = succeeded4369client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 5.73 seconds)4370client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4371client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds)4372client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4373client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4374client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4375client # copying 3 paths...4376client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4377client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4378client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4379client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4380(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.29 seconds)4381subtest: repeat is answered Cached by the scheduler without building4382worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4383lb # [ 38.020547] envoy[918]: conn peer=[2001:db8:1::1]:33942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=21314384lb # [ 38.024957] envoy[918]: conn peer=[2001:db8:1::1]:33950 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=387 ms=944385lb # [ 38.028539] envoy[918]: conn peer=[2001:db8:1::1]:33954 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=144386lb # [ 38.031840] envoy[918]: conn peer=[2001:db8:1::1]:33960 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84387lb # [ 38.035887] envoy[918]: conn peer=[2001:db8:1::1]:33964 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9520 tx=3813 ms=55364388worker1 # finding garbage collector roots...4389worker1 # deleting specified paths...4390worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4391worker1 # deleting unused links...4392worker1 # note: hard linking is currently saving 0.0 KiB4393worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4394worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4395worker2 # finding garbage collector roots...4396worker2 # deleting specified paths...4397worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4398worker2 # deleting unused links...4399worker2 # note: hard linking is currently saving 0.0 KiB4400worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4401client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24402worker1 # [ 38.593936] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:518184403client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4404client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4405worker2 # [ 38.585476] nix-grpc-daemon[785]: ts=2026-09-20T10:49:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513604406worker1 # [ 38.648323] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14407client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.29 seconds)4408client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4409client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4410worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4411worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4412(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.12 seconds)4413subtest: inputs already in the cache are not sent to the scheduler4414worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4415worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds)4416client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24417worker1 # [ 39.229432] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:518184418client # don't know how to build these paths:4419client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4420worker2 # [ 39.207967] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513604421worker1 # [ 39.254951] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04422worker1 # [ 39.259938] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14423worker1 # [ 39.299115] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184424worker1 # [ 39.311572] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184425worker1 # [ 39.325589] nix-grpc-daemon[855]: time=2026-09-20T10:49:47.886Z level=INFO msg="All 2 paths already cached"4426client # copying 1 paths to 'lb:50051'...4427client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4428worker1 # [ 39.333188] nix-grpc-daemon[785]: ts=2026-09-20T10:49:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184429worker1 # [ 39.342991] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4430worker1 # [ 39.510424] nix-daemon[843]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)4431worker1 # [ 39.523995] nix-daemon[843]: reaped child process 1004, status = succeeded4432worker1 # [ 39.670298] nix-daemon[843]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4433worker1 # [ 39.681849] nix-daemon[843]: reaped child process 1009, status = succeeded4434lb # [ 39.667183] niks3-server[1027]: 2026/09/20 10:49:48 INFO Received uploads request method=POST path=/api/pending_closures4435worker1 # [ 39.707166] nix-grpc-daemon[855]: time=2026-09-20T10:49:48.268Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4436worker1 # [ 39.708489] nix-grpc-daemon[855]: time=2026-09-20T10:49:48.268Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4437lb # [ 39.700843] niks3-server[1027]: 2026/09/20 10:49:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4438lb # [ 39.707682] niks3-server[1027]: 2026/09/20 10:49:48 INFO Signed narinfos id=7 count=14439worker1 # [ 39.739933] nix-grpc-daemon[855]: time=2026-09-20T10:49:48.301Z level=INFO msg="Uploading 1 narinfos"4440lb # [ 39.713196] niks3-server[1027]: 2026/09/20 10:49:48 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4441lb # [ 39.720147] niks3-server[1027]: 2026/09/20 10:49:48 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4442lb # [ 39.729482] niks3-server[1027]: 2026/09/20 10:49:48 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4443lb # [ 39.733813] niks3-server[1027]: 2026/09/20 10:49:48 INFO Completed upload id=74444worker1 # [ 39.763595] nix-grpc-daemon[855]: time=2026-09-20T10:49:48.325Z level=INFO msg="Upload complete. (403ms)"4445lb # [ 39.735673] niks3-server[1027]: 2026/09/20 10:49:48 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4446worker1 # [ 39.766793] nix-grpc-daemon[785]: ts=2026-09-20T10:49:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=7524447worker1 # [ 39.772263] nix-grpc-daemon[785]: ts=2026-09-20T10:49:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184448worker1 # [ 39.779061] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4449worker1 # [ 39.784607] nix-daemon[843]: reaped child process 999, status = succeeded4450worker1 # [ 39.788965] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4451client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4452client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4453client # farm-top> LOG-farm-top-t1b4454worker1 # [ 41.416212] nix-daemon[843]: reaped child process 1013, status = succeeded4455worker1 # [ 41.576087] nix-daemon[843]: accepted connection from pid 1028, user nix-grpc-daemon (trusted)4456worker1 # [ 41.586573] nix-daemon[843]: reaped child process 1032, status = succeeded4457lb # [ 41.572905] niks3-server[1027]: 2026/09/20 10:49:49 INFO Received uploads request method=POST path=/api/pending_closures4458worker1 # [ 41.611718] nix-grpc-daemon[855]: time=2026-09-20T10:49:50.173Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4459worker1 # [ 41.613294] nix-grpc-daemon[855]: time=2026-09-20T10:49:50.174Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4460lb # [ 41.609693] niks3-server[1027]: 2026/09/20 10:49:49 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4461lb # [ 41.621245] niks3-server[1027]: 2026/09/20 10:49:49 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4462lb # [ 41.629997] niks3-server[1027]: 2026/09/20 10:49:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4463worker1 # [ 41.663372] nix-grpc-daemon[855]: time=2026-09-20T10:49:50.224Z level=INFO msg="Uploading 1 narinfos"4464lb # [ 41.634961] niks3-server[1027]: 2026/09/20 10:49:49 INFO Signed narinfos id=8 count=14465lb # [ 41.639995] niks3-server[1027]: 2026/09/20 10:49:49 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4466lb # [ 41.649329] niks3-server[1027]: 2026/09/20 10:49:49 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4467lb # [ 41.654596] niks3-server[1027]: 2026/09/20 10:49:49 INFO Completed upload id=84468worker1 # [ 41.683334] nix-grpc-daemon[855]: time=2026-09-20T10:49:50.244Z level=INFO msg="Upload complete. (285ms)"4469lb # [ 41.658426] niks3-server[1027]: 2026/09/20 10:49:50 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4470worker1 # [ 41.689577] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14471worker1 # [ 41.703482] nix-daemon[843]: reaped child process 1011, status = succeeded4472client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.75 seconds)4473client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4474client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.20 seconds)4475worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4476worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4477(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.03 seconds)4478subtest: two clients wanting the same drv build it once4479client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4480client # [ 42.028849] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4481client # Running as unit: dedup1.service; invocation ID: d148f7f821344af6a551d5f88d9cbabc4482client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4483client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4484client # [ 42.228648] nix[882]: don't know how to build these paths:4485client # [ 42.230027] nix[882]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4486worker2 # [ 42.232660] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:513604487worker1 # [ 42.272360] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04488worker1 # [ 42.277260] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14489worker2 # [ 42.249622] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513604490worker2 # [ 42.264496] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513604491client # [ 42.270779] nix[882]: copying 1 paths to 'lb:50051'...4492client # [ 42.271560] nix[882]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4493worker2 # [ 42.275398] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:513604494worker2 # [ 42.281281] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4495worker2 # [ 42.292607] nix-grpc-daemon[785]: ts=2026-09-20T10:49:50Z level=info event=niks3_push_started pid=8344496worker2 # [ 42.680059] nix-daemon[807]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4497worker2 # [ 42.695586] nix-daemon[807]: reaped child process 849, status = succeeded4498worker2 # [ 42.855649] nix-daemon[807]: accepted connection from pid 852, user nix-grpc-daemon (trusted)4499worker2 # [ 42.866426] nix-daemon[807]: reaped child process 855, status = succeeded4500lb # [ 42.885117] niks3-server[1027]: 2026/09/20 10:49:51 INFO Received uploads request method=POST path=/api/pending_closures4501worker2 # [ 42.893190] nix-grpc-daemon[834]: time=2026-09-20T10:49:51.121Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4502worker2 # [ 42.896165] nix-grpc-daemon[834]: time=2026-09-20T10:49:51.124Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4503lb # [ 42.921919] niks3-server[1027]: 2026/09/20 10:49:51 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4504lb # [ 42.932857] niks3-server[1027]: 2026/09/20 10:49:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4505lb # [ 42.938362] niks3-server[1027]: 2026/09/20 10:49:51 INFO Signed narinfos id=9 count=14506worker2 # [ 42.940199] nix-grpc-daemon[834]: time=2026-09-20T10:49:51.169Z level=INFO msg="Uploading 1 narinfos"4507lb # [ 42.951437] niks3-server[1027]: 2026/09/20 10:49:51 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4508lb # [ 42.957908] niks3-server[1027]: 2026/09/20 10:49:51 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4509lb # [ 42.965428] niks3-server[1027]: 2026/09/20 10:49:51 INFO Completed upload id=94510worker2 # [ 42.963969] nix-grpc-daemon[834]: time=2026-09-20T10:49:51.193Z level=INFO msg="Upload complete. (443ms)"4511lb # [ 42.966776] niks3-server[1027]: 2026/09/20 10:49:51 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4512worker2 # [ 42.965833] nix-grpc-daemon[785]: ts=2026-09-20T10:49:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=0 paths=1 nar_bytes_in=4324513worker2 # [ 42.970691] nix-grpc-daemon[785]: ts=2026-09-20T10:49:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513604514worker2 # [ 42.976186] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4515worker2 # [ 42.978407] nix-daemon[807]: reaped child process 832, status = succeeded4516worker2 # [ 42.983704] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4517client # [ 42.978778] nix[882]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4518client # [ 43.098514] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4519client # Running as unit: dedup2.service; invocation ID: 9ecc7cdf18554d1d8fd3cb449825bceb4520client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4521client # [ 43.338512] nix[898]: don't know how to build these paths:4522client # [ 43.339368] nix[898]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4523worker1 # [ 43.370987] nix-grpc-daemon[785]: ts=2026-09-20T10:49:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:518184524worker1 # [ 43.379935] nix-grpc-daemon[785]: ts=2026-09-20T10:49:51Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04525worker2 # [ 43.352875] nix-grpc-daemon[785]: ts=2026-09-20T10:49:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513604526client # [ 43.351413] nix[898]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4527client: must succeed: sleep 24528client: (finished: must succeed: sleep 2, in 2.05 seconds)4529??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4530 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394531client: waiting for success: ! systemctl is-active dedup1 dedup24532??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4533 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394534worker2 # [ 46.598939] nix-daemon[807]: reaped child process 859, status = succeeded4535worker2 # [ 46.746267] nix-daemon[807]: accepted connection from pid 888, user nix-grpc-daemon (trusted)4536worker2 # [ 46.757897] nix-daemon[807]: reaped child process 891, status = succeeded4537lb # [ 46.777464] niks3-server[1027]: 2026/09/20 10:49:55 INFO Received uploads request method=POST path=/api/pending_closures4538worker2 # [ 46.788160] nix-grpc-daemon[834]: time=2026-09-20T10:49:55.017Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4539worker2 # [ 46.789711] nix-grpc-daemon[834]: time=2026-09-20T10:49:55.018Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4540lb # [ 46.827702] niks3-server[1027]: 2026/09/20 10:49:55 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4541lb # [ 46.835298] niks3-server[1027]: 2026/09/20 10:49:55 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4542lb # [ 46.842318] niks3-server[1027]: 2026/09/20 10:49:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4543lb # [ 46.847794] niks3-server[1027]: 2026/09/20 10:49:55 INFO Signed narinfos id=10 count=14544worker2 # [ 46.847128] nix-grpc-daemon[834]: time=2026-09-20T10:49:55.075Z level=INFO msg="Uploading 1 narinfos"4545lb # [ 46.853319] niks3-server[1027]: 2026/09/20 10:49:55 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4546lb # [ 46.861813] niks3-server[1027]: 2026/09/20 10:49:55 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4547lb # [ 46.865287] niks3-server[1027]: 2026/09/20 10:49:55 INFO Completed upload id=104548worker2 # [ 46.863759] nix-grpc-daemon[834]: time=2026-09-20T10:49:55.092Z level=INFO msg="Upload complete. (267ms)"4549lb # [ 46.867091] niks3-server[1027]: 2026/09/20 10:49:55 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4550worker2 # [ 46.869818] nix-grpc-daemon[785]: ts=2026-09-20T10:49:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14551worker2 # [ 46.876233] nix-grpc-daemon[785]: ts=2026-09-20T10:49:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14552worker2 # [ 46.885546] nix-daemon[807]: reaped child process 857, status = succeeded4553client # [ 46.904752] systemd[1]: dedup1.service: Deactivated successfully.4554client # [ 46.910194] systemd[1]: dedup1.service: Consumed 98ms CPU time over 4.879s wall clock time, 39.3M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.4555client # [ 46.947035] systemd[1]: dedup2.service: Deactivated successfully.4556client # [ 46.948645] systemd[1]: dedup2.service: Consumed 127ms CPU time over 3.850s wall clock time, 31.2M memory peak, 7.6K incoming IP traffic, 6.4K outgoing IP traffic.4557client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds)4558client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4559client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds)4560worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4561worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4562worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4563worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4564worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4565worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4566worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4567worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4568(finished: subtest: two clients wanting the same drv build it once, in 5.76 seconds)4569subtest: build hook: nix-daemon with builders = grpc://lb4570client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4571client # [ 47.886041] systemd[1]: Started Nix Daemon.4572lb # [ 48.020638] envoy[918]: conn peer=[2001:db8:1::1]:60224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=694573lb # [ 48.023661] envoy[918]: conn peer=[2001:db8:1::1]:60238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1700 ms=25164574lb # [ 48.026623] envoy[918]: conn peer=[2001:db8:1::1]:60244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2968 tx=1331 ms=46514575client # [ 48.024279] nix-daemon[939]: accepted connection from pid 936, user root (trusted)4576lb # [ 48.029703] envoy[918]: conn peer=[2001:db8:1::1]:56976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=35894577worker1 # [ 48.237747] nix-grpc-daemon[785]: ts=2026-09-20T10:49:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:518184578worker1 # [ 48.244448] nix-grpc-daemon[785]: ts=2026-09-20T10:49:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184579worker1 # [ 48.260240] nix-grpc-daemon[785]: ts=2026-09-20T10:49:56Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04580worker1 # [ 48.264582] nix-grpc-daemon[785]: ts=2026-09-20T10:49:56Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14581worker1 # [ 48.308530] nix-grpc-daemon[785]: ts=2026-09-20T10:49:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184582worker1 # [ 48.321253] nix-grpc-daemon[785]: ts=2026-09-20T10:49:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184583worker1 # [ 48.332116] nix-grpc-daemon[785]: ts=2026-09-20T10:49:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184584worker1 # [ 48.343111] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4585worker1 # [ 48.528642] nix-daemon[843]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4586worker1 # [ 48.541234] nix-daemon[843]: reaped child process 1071, status = succeeded4587worker1 # [ 48.700957] nix-daemon[843]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)4588worker1 # [ 48.712960] nix-daemon[843]: reaped child process 1076, status = succeeded4589lb # [ 48.702260] niks3-server[1027]: 2026/09/20 10:49:57 INFO Received uploads request method=POST path=/api/pending_closures4590worker1 # [ 48.739441] nix-grpc-daemon[855]: time=2026-09-20T10:49:57.300Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4591worker1 # [ 48.740799] nix-grpc-daemon[855]: time=2026-09-20T10:49:57.300Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4592lb # [ 48.728826] niks3-server[1027]: 2026/09/20 10:49:57 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4593lb # [ 48.740807] niks3-server[1027]: 2026/09/20 10:49:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4594lb # [ 48.746632] niks3-server[1027]: 2026/09/20 10:49:57 INFO Signed narinfos id=11 count=14595worker1 # [ 48.778553] nix-grpc-daemon[855]: time=2026-09-20T10:49:57.339Z level=INFO msg="Uploading 1 narinfos"4596lb # [ 48.752100] niks3-server[1027]: 2026/09/20 10:49:57 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4597lb # [ 48.763083] niks3-server[1027]: 2026/09/20 10:49:57 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4598lb # [ 48.769304] niks3-server[1027]: 2026/09/20 10:49:57 INFO Completed upload id=114599worker1 # [ 48.797986] nix-grpc-daemon[855]: time=2026-09-20T10:49:57.359Z level=INFO msg="Upload complete. (443ms)"4600lb # [ 48.773518] niks3-server[1027]: 2026/09/20 10:49:57 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4601worker1 # [ 48.802157] nix-grpc-daemon[785]: ts=2026-09-20T10:49:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=5124602worker1 # [ 48.806675] nix-grpc-daemon[785]: ts=2026-09-20T10:49:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184603worker1 # [ 48.816844] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4604worker1 # [ 48.820320] nix-daemon[843]: reaped child process 1066, status = succeeded4605worker1 # [ 48.825034] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4606worker1 # [ 49.638245] nix-daemon[843]: reaped child process 1080, status = succeeded4607worker1 # [ 49.765637] nix-daemon[843]: accepted connection from pid 1095, user nix-grpc-daemon (trusted)4608worker1 # [ 49.777780] nix-daemon[843]: reaped child process 1098, status = succeeded4609lb # [ 49.763153] niks3-server[1027]: 2026/09/20 10:49:58 INFO Received uploads request method=POST path=/api/pending_closures4610worker1 # [ 49.796153] nix-grpc-daemon[855]: time=2026-09-20T10:49:58.357Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4611worker1 # [ 49.797700] nix-grpc-daemon[855]: time=2026-09-20T10:49:58.359Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4612lb # [ 49.786728] niks3-server[1027]: 2026/09/20 10:49:58 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4613lb # [ 49.791099] niks3-server[1027]: 2026/09/20 10:49:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4614lb # [ 49.793800] niks3-server[1027]: 2026/09/20 10:49:58 INFO Signed narinfos id=12 count=14615worker1 # [ 49.822391] nix-grpc-daemon[855]: time=2026-09-20T10:49:58.383Z level=INFO msg="Uploading 1 narinfos"4616lb # [ 49.795487] niks3-server[1027]: 2026/09/20 10:49:58 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4617lb # [ 49.800841] niks3-server[1027]: 2026/09/20 10:49:58 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4618lb # [ 49.803799] niks3-server[1027]: 2026/09/20 10:49:58 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4619lb # [ 49.809481] niks3-server[1027]: 2026/09/20 10:49:58 INFO Completed upload id=124620worker1 # [ 49.837948] nix-grpc-daemon[855]: time=2026-09-20T10:49:58.399Z level=INFO msg="Upload complete. (207ms)"4621lb # [ 49.810893] niks3-server[1027]: 2026/09/20 10:49:58 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4622worker1 # [ 49.841305] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14623worker1 # [ 49.846206] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:518184624worker1 # [ 49.849524] nix-daemon[843]: reaped child process 1078, status = succeeded4625worker1 # [ 49.858656] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:518184626worker1 # [ 49.861200] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_out=1284627worker2 # [ 50.067522] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:513604628worker1 # [ 50.099536] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184629worker1 # [ 50.105837] nix-grpc-daemon[855]: time=2026-09-20T10:49:58.667Z level=INFO msg="All 1 paths already cached"4630worker1 # [ 50.115851] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04631worker1 # [ 50.118587] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14632worker1 # [ 50.123972] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184633worker1 # [ 50.135561] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184634worker1 # [ 50.147827] nix-grpc-daemon[855]: time=2026-09-20T10:49:58.709Z level=INFO msg="All 1 paths already cached"4635worker1 # [ 50.154546] nix-grpc-daemon[785]: ts=2026-09-20T10:49:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184636worker1 # [ 50.164336] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4637worker1 # [ 50.305981] nix-daemon[843]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4638worker1 # [ 50.319656] nix-daemon[843]: reaped child process 1107, status = succeeded4639worker1 # [ 50.465772] nix-daemon[843]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4640worker1 # [ 50.478532] nix-daemon[843]: reaped child process 1112, status = succeeded4641lb # [ 50.457722] niks3-server[1027]: 2026/09/20 10:49:58 INFO Received uploads request method=POST path=/api/pending_closures4642worker1 # [ 50.490735] nix-grpc-daemon[855]: time=2026-09-20T10:49:59.052Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4643worker1 # [ 50.492248] nix-grpc-daemon[855]: time=2026-09-20T10:49:59.053Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4644lb # [ 50.474126] niks3-server[1027]: 2026/09/20 10:49:58 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4645lb # [ 50.478425] niks3-server[1027]: 2026/09/20 10:49:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4646lb # [ 50.480561] niks3-server[1027]: 2026/09/20 10:49:58 INFO Signed narinfos id=13 count=14647worker1 # [ 50.510263] nix-grpc-daemon[855]: time=2026-09-20T10:49:59.071Z level=INFO msg="Uploading 1 narinfos"4648lb # [ 50.482964] niks3-server[1027]: 2026/09/20 10:49:58 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4649lb # [ 50.488386] niks3-server[1027]: 2026/09/20 10:49:58 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4650lb # [ 50.492811] niks3-server[1027]: 2026/09/20 10:49:58 INFO Completed upload id=134651worker1 # [ 50.521264] nix-grpc-daemon[855]: time=2026-09-20T10:49:59.082Z level=INFO msg="Upload complete. (347ms)"4652lb # [ 50.494413] niks3-server[1027]: 2026/09/20 10:49:58 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4653worker1 # [ 50.523168] nix-grpc-daemon[785]: ts=2026-09-20T10:49:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=6244654worker1 # [ 50.526735] nix-grpc-daemon[785]: ts=2026-09-20T10:49:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184655worker1 # [ 50.532530] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4656worker1 # [ 50.534733] nix-daemon[843]: reaped child process 1102, status = succeeded4657worker1 # [ 50.539939] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4658worker1 # [ 51.365354] nix-daemon[843]: reaped child process 1116, status = succeeded4659worker1 # [ 51.506599] nix-daemon[843]: accepted connection from pid 1131, user nix-grpc-daemon (trusted)4660worker1 # [ 51.519200] nix-daemon[843]: reaped child process 1134, status = succeeded4661lb # [ 51.506119] niks3-server[1027]: 2026/09/20 10:49:59 INFO Received uploads request method=POST path=/api/pending_closures4662worker1 # [ 51.539665] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.100Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4663worker1 # [ 51.541172] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.102Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4664lb # [ 51.532586] niks3-server[1027]: 2026/09/20 10:49:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4665lb # [ 51.534209] niks3-server[1027]: 2026/09/20 10:49:59 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4666lb # [ 51.536370] niks3-server[1027]: 2026/09/20 10:49:59 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4667lb # [ 51.537982] niks3-server[1027]: 2026/09/20 10:49:59 INFO Signed narinfos id=14 count=14668worker1 # [ 51.567895] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.129Z level=INFO msg="Uploading 1 narinfos"4669lb # [ 51.543931] niks3-server[1027]: 2026/09/20 10:49:59 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4670lb # [ 51.546141] niks3-server[1027]: 2026/09/20 10:49:59 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4671lb # [ 51.549706] niks3-server[1027]: 2026/09/20 10:49:59 INFO Completed upload id=144672worker1 # [ 51.578078] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.139Z level=INFO msg="Upload complete. (231ms)"4673lb # [ 51.551368] niks3-server[1027]: 2026/09/20 10:49:59 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4674worker1 # [ 51.580442] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14675worker1 # [ 51.585712] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:518184676worker1 # [ 51.589987] nix-daemon[843]: reaped child process 1114, status = succeeded4677worker2 # [ 51.564791] nix-grpc-daemon[785]: ts=2026-09-20T10:49:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:513604678worker2 # [ 51.574679] nix-grpc-daemon[785]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4679worker2 # [ 51.585437] nix-grpc-daemon[785]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4680worker2 # [ 51.593973] nix-grpc-daemon[785]: ts=2026-09-20T10:49:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=0 paths=1 nar_bytes_out=1764681worker1 # [ 51.852640] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:518184682worker2 # [ 51.825940] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513604683worker2 # [ 51.832169] nix-grpc-daemon[834]: time=2026-09-20T10:50:00.061Z level=INFO msg="All 2 paths already cached"4684worker1 # [ 51.872808] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04685worker1 # [ 51.875518] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14686worker1 # [ 51.878228] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184687worker1 # [ 51.884576] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184688worker1 # [ 51.891402] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.452Z level=INFO msg="All 2 paths already cached"4689worker1 # [ 51.895197] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184690worker1 # [ 51.900451] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4691worker1 # [ 52.059196] nix-daemon[843]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)4692worker1 # [ 52.073597] nix-daemon[843]: reaped child process 1143, status = succeeded4693worker1 # [ 52.219948] nix-daemon[843]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4694worker1 # [ 52.234873] nix-daemon[843]: reaped child process 1148, status = succeeded4695lb # [ 52.215066] niks3-server[1027]: 2026/09/20 10:50:00 INFO Received uploads request method=POST path=/api/pending_closures4696worker1 # [ 52.248433] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.809Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4697worker1 # [ 52.249889] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.811Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4698lb # [ 52.232202] niks3-server[1027]: 2026/09/20 10:50:00 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4699lb # [ 52.237076] niks3-server[1027]: 2026/09/20 10:50:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4700lb # [ 52.239370] niks3-server[1027]: 2026/09/20 10:50:00 INFO Signed narinfos id=15 count=14701worker1 # [ 52.269305] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.830Z level=INFO msg="Uploading 1 narinfos"4702lb # [ 52.245079] niks3-server[1027]: 2026/09/20 10:50:00 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4703lb # [ 52.250599] niks3-server[1027]: 2026/09/20 10:50:00 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4704lb # [ 52.254107] niks3-server[1027]: 2026/09/20 10:50:00 INFO Completed upload id=154705worker1 # [ 52.283863] nix-grpc-daemon[855]: time=2026-09-20T10:50:00.845Z level=INFO msg="Upload complete. (378ms)"4706lb # [ 52.256186] niks3-server[1027]: 2026/09/20 10:50:00 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4707worker1 # [ 52.285616] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=7524708worker1 # [ 52.291203] nix-grpc-daemon[785]: ts=2026-09-20T10:50:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184709worker1 # [ 52.296547] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4710worker1 # [ 52.298906] nix-daemon[843]: reaped child process 1138, status = succeeded4711worker1 # [ 52.304401] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4712worker1 # [ 53.518515] nix-daemon[843]: reaped child process 1152, status = succeeded4713worker1 # [ 53.654278] nix-daemon[843]: accepted connection from pid 1167, user nix-grpc-daemon (trusted)4714worker1 # [ 53.667095] nix-daemon[843]: reaped child process 1170, status = succeeded4715lb # [ 53.656275] niks3-server[1027]: 2026/09/20 10:50:01 INFO Received uploads request method=POST path=/api/pending_closures4716worker1 # [ 53.693297] nix-grpc-daemon[855]: time=2026-09-20T10:50:02.254Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4717worker1 # [ 53.694945] nix-grpc-daemon[855]: time=2026-09-20T10:50:02.256Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4718lb # [ 53.695447] niks3-server[1027]: 2026/09/20 10:50:02 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4719lb # [ 53.703879] niks3-server[1027]: 2026/09/20 10:50:02 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4720lb # [ 53.714167] niks3-server[1027]: 2026/09/20 10:50:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4721worker1 # [ 53.746845] nix-grpc-daemon[855]: time=2026-09-20T10:50:02.308Z level=INFO msg="Uploading 1 narinfos"4722lb # [ 53.718725] niks3-server[1027]: 2026/09/20 10:50:02 INFO Signed narinfos id=16 count=14723lb # [ 53.723350] niks3-server[1027]: 2026/09/20 10:50:02 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4724lb # [ 53.732936] niks3-server[1027]: 2026/09/20 10:50:02 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4725lb # [ 53.738987] niks3-server[1027]: 2026/09/20 10:50:02 INFO Completed upload id=164726worker1 # [ 53.767526] nix-grpc-daemon[855]: time=2026-09-20T10:50:02.329Z level=INFO msg="Upload complete. (256ms)"4727lb # [ 53.741615] niks3-server[1027]: 2026/09/20 10:50:02 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4728worker1 # [ 53.770399] nix-grpc-daemon[785]: ts=2026-09-20T10:50:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14729worker1 # [ 53.774917] nix-grpc-daemon[785]: ts=2026-09-20T10:50:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:518184730worker1 # [ 53.778784] nix-daemon[843]: reaped child process 1150, status = succeeded4731worker1 # [ 53.791085] nix-grpc-daemon[785]: ts=2026-09-20T10:50:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:518184732worker1 # [ 53.794473] nix-grpc-daemon[785]: ts=2026-09-20T10:50:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_out=2324733client # [ 53.854677] nix-daemon[939]: reaped child process 941, status = succeeded4734client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.11 seconds)4735client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4736client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4737client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4738client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4739client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4740client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4741(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.20 seconds)4742subtest: an input only one worker has still reaches the builder4743client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4744client # this derivation will be built:4745client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4746client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4747client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.42 seconds)4748client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4749client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.18 seconds)4750worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4751worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4752worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4753worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.01 seconds)4754client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24755client # [ 54.922237] nix-daemon[939]: accepted connection from pid 1019, user root (trusted)4756client # this derivation will be built:4757client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4758worker2 # [ 55.071047] nix-grpc-daemon[785]: ts=2026-09-20T10:50:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:513604759worker1 # [ 55.103497] nix-grpc-daemon[785]: ts=2026-09-20T10:50:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184760client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4761worker1 # [ 55.265465] nix-daemon[843]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)4762worker1 # [ 55.278534] nix-daemon[843]: reaped child process 1180, status = succeeded4763lb # [ 55.259085] niks3-server[1027]: 2026/09/20 10:50:03 INFO Received uploads request method=POST path=/api/pending_closures4764worker1 # [ 55.292257] nix-grpc-daemon[855]: time=2026-09-20T10:50:03.853Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4765worker1 # [ 55.293941] nix-grpc-daemon[855]: time=2026-09-20T10:50:03.855Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4766lb # [ 55.274224] niks3-server[1027]: 2026/09/20 10:50:03 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4767lb # [ 55.278441] niks3-server[1027]: 2026/09/20 10:50:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4768lb # [ 55.280239] niks3-server[1027]: 2026/09/20 10:50:03 INFO Signed narinfos id=17 count=14769worker1 # [ 55.308942] nix-grpc-daemon[855]: time=2026-09-20T10:50:03.870Z level=INFO msg="Uploading 1 narinfos"4770lb # [ 55.284220] niks3-server[1027]: 2026/09/20 10:50:03 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4771lb # [ 55.289829] niks3-server[1027]: 2026/09/20 10:50:03 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4772lb # [ 55.293443] niks3-server[1027]: 2026/09/20 10:50:03 INFO Completed upload id=174773worker1 # [ 55.322044] nix-grpc-daemon[855]: time=2026-09-20T10:50:03.883Z level=INFO msg="Upload complete. (217ms)"4774lb # [ 55.296071] niks3-server[1027]: 2026/09/20 10:50:03 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4775worker1 # [ 55.334980] nix-grpc-daemon[785]: ts=2026-09-20T10:50:03Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04776worker1 # [ 55.336864] nix-grpc-daemon[785]: ts=2026-09-20T10:50:03Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14777worker2 # [ 55.348676] nix-grpc-daemon[785]: ts=2026-09-20T10:50:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513604778worker2 # [ 55.357163] nix-grpc-daemon[785]: ts=2026-09-20T10:50:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513604779client # copying 2 paths to 'lb:50051'...4780worker2 # [ 55.370219] nix-grpc-daemon[785]: ts=2026-09-20T10:50:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:513604781client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4782client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4783worker2 # [ 55.386419] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4784worker2 # [ 55.548402] nix-daemon[807]: accepted connection from pid 909, user nix-grpc-daemon (trusted)4785worker2 # [ 55.563123] nix-daemon[807]: reaped child process 912, status = succeeded4786worker2 # [ 55.710621] nix-daemon[807]: accepted connection from pid 914, user nix-grpc-daemon (trusted)4787worker2 # [ 55.722786] nix-daemon[807]: reaped child process 917, status = succeeded4788lb # [ 55.741375] niks3-server[1027]: 2026/09/20 10:50:04 INFO Received uploads request method=POST path=/api/pending_closures4789lb # [ 55.748763] niks3-server[1027]: 2026/09/20 10:50:04 INFO Received uploads request method=POST path=/api/pending_closures4790worker2 # [ 55.753316] nix-grpc-daemon[834]: time=2026-09-20T10:50:03.982Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4791worker2 # [ 55.754891] nix-grpc-daemon[834]: time=2026-09-20T10:50:03.984Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4792worker2 # [ 55.756730] nix-grpc-daemon[834]: time=2026-09-20T10:50:03.985Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4793lb # [ 55.790264] niks3-server[1027]: 2026/09/20 10:50:04 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4794lb # [ 55.796189] niks3-server[1027]: 2026/09/20 10:50:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4795lb # [ 55.799518] niks3-server[1027]: 2026/09/20 10:50:04 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4796lb # [ 55.803696] niks3-server[1027]: 2026/09/20 10:50:04 INFO Signed narinfos id=18 count=14797lb # [ 55.807201] niks3-server[1027]: 2026/09/20 10:50:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4798lb # [ 55.809991] niks3-server[1027]: 2026/09/20 10:50:04 INFO Signed narinfos id=19 count=24799worker2 # [ 55.808943] nix-grpc-daemon[834]: time=2026-09-20T10:50:04.037Z level=INFO msg="Uploading 3 narinfos"4800lb # [ 55.811827] niks3-server[1027]: 2026/09/20 10:50:04 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4801lb # [ 55.813663] niks3-server[1027]: 2026/09/20 10:50:04 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4802lb # [ 55.828594] niks3-server[1027]: 2026/09/20 10:50:04 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4803lb # [ 55.832242] niks3-server[1027]: 2026/09/20 10:50:04 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4804lb # [ 55.833715] niks3-server[1027]: 2026/09/20 10:50:04 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4805lb # [ 55.835499] niks3-server[1027]: 2026/09/20 10:50:04 INFO Completed upload id=184806lb # [ 55.837253] niks3-server[1027]: 2026/09/20 10:50:04 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4807lb # [ 55.839709] niks3-server[1027]: 2026/09/20 10:50:04 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4808lb # [ 55.842132] niks3-server[1027]: 2026/09/20 10:50:04 INFO Completed upload id=194809worker2 # [ 55.840577] nix-grpc-daemon[834]: time=2026-09-20T10:50:04.069Z level=INFO msg="Upload complete. (447ms)"4810worker2 # [ 55.842847] nix-grpc-daemon[785]: ts=2026-09-20T10:50:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=0 paths=2 nar_bytes_in=9764811worker2 # [ 55.845831] nix-grpc-daemon[785]: ts=2026-09-20T10:50:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513604812worker2 # [ 55.852638] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4813worker2 # [ 55.854934] nix-daemon[807]: reaped child process 907, status = succeeded4814worker2 # [ 55.861324] nix-grpc-daemon[785]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4815client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4816worker2 # [ 55.868167] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4817client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4818worker2 # [ 56.891319] nix-daemon[807]: reaped child process 922, status = succeeded4819worker2 # [ 57.049195] nix-daemon[807]: accepted connection from pid 937, user nix-grpc-daemon (trusted)4820worker2 # [ 57.060765] nix-daemon[807]: reaped child process 940, status = succeeded4821lb # [ 57.081695] niks3-server[1027]: 2026/09/20 10:50:05 INFO Received uploads request method=POST path=/api/pending_closures4822worker2 # [ 57.089473] nix-grpc-daemon[834]: time=2026-09-20T10:50:05.318Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4823lb # [ 57.113246] niks3-server[1027]: 2026/09/20 10:50:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4824lb # [ 57.119501] niks3-server[1027]: 2026/09/20 10:50:05 INFO Signed narinfos id=20 count=14825worker2 # [ 57.120909] nix-grpc-daemon[834]: time=2026-09-20T10:50:05.350Z level=INFO msg="Uploading 1 narinfos"4826lb # [ 57.129218] niks3-server[1027]: 2026/09/20 10:50:05 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4827lb # [ 57.136196] niks3-server[1027]: 2026/09/20 10:50:05 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4828lb # [ 57.146425] niks3-server[1027]: 2026/09/20 10:50:05 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4829lb # [ 57.151216] niks3-server[1027]: 2026/09/20 10:50:05 INFO Completed upload id=204830worker2 # [ 57.149972] nix-grpc-daemon[834]: time=2026-09-20T10:50:05.379Z level=INFO msg="Upload complete. (273ms)"4831lb # [ 57.156106] niks3-server[1027]: 2026/09/20 10:50:05 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4832worker2 # [ 57.154911] nix-grpc-daemon[785]: ts=2026-09-20T10:50:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14833worker2 # [ 57.165842] nix-daemon[807]: reaped child process 919, status = succeeded4834client # copying 1 paths...4835worker2 # [ 57.200486] nix-grpc-daemon[785]: ts=2026-09-20T10:50:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513604836client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4837worker1 # [ 57.252985] nix-grpc-daemon[785]: ts=2026-09-20T10:50:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:518184838worker1 # [ 57.268349] nix-grpc-daemon[785]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4839worker1 # [ 57.286524] nix-grpc-daemon[785]: ts=2026-09-20T10:50:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_out=1204840client # [ 57.358434] nix-daemon[939]: reaped child process 1022, status = succeeded4841client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.59 seconds)4842client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24843client # [ 57.550288] nix-daemon[939]: accepted connection from pid 1040, user root (trusted)4844client # this derivation will be built:4845client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4846worker2 # [ 57.742832] nix-grpc-daemon[785]: ts=2026-09-20T10:50:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:513604847client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4848worker1 # [ 57.779088] nix-grpc-daemon[785]: ts=2026-09-20T10:50:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184849worker1 # [ 57.784602] nix-grpc-daemon[855]: time=2026-09-20T10:50:06.345Z level=INFO msg="All 1 paths already cached"4850worker1 # [ 57.792934] nix-grpc-daemon[785]: ts=2026-09-20T10:50:06Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04851worker1 # [ 57.795485] nix-grpc-daemon[785]: ts=2026-09-20T10:50:06Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14852worker1 # [ 57.798202] nix-grpc-daemon[785]: ts=2026-09-20T10:50:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184853worker1 # [ 57.804153] nix-grpc-daemon[785]: ts=2026-09-20T10:50:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184854client # copying 1 paths to 'lb:50051'...4855client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4856worker1 # [ 57.812217] nix-grpc-daemon[785]: ts=2026-09-20T10:50:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:518184857worker1 # [ 57.816508] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4858worker1 # [ 57.826037] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5)4859worker1 # [ 57.919751] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 2/5)4860worker1 # [ 57.948512] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 147 ms (attempt 3/5)4861lb # [ 58.021206] envoy[918]: conn peer=[2001:db8:1::1]:56980 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3368 tx=1619 ms=16744862lb # [ 58.022733] envoy[918]: conn peer=[2001:db8:1::1]:56984 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=514863lb # [ 58.024408] envoy[918]: conn peer=[2001:db8:1::1]:56988 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1853 ms=15744864lb # [ 58.025908] envoy[918]: conn peer=[2001:db8:1::1]:56994 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=774865lb # [ 58.027246] envoy[918]: conn peer=[2001:db8:1::1]:57004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2106 ms=19924866lb # [ 58.028607] envoy[918]: conn peer=[2001:db8:1::1]:48226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=524867lb # [ 58.029965] envoy[918]: conn peer=[2001:db8:1::1]:48236 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1739 ms=22354868lb # [ 58.031341] envoy[918]: conn peer=[2001:db8:1::1]:48242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=874869worker1 # [ 58.098102] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 4/5)4870worker1 # [ 58.284763] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4871worker1 # [ 58.287588] nix-grpc-daemon[785]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4872worker1 # [ 58.449091] nix-daemon[843]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)4873worker1 # [ 58.462078] nix-daemon[843]: reaped child process 1196, status = succeeded4874worker1 # [ 58.603986] nix-daemon[843]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4875worker1 # [ 58.616055] nix-daemon[843]: reaped child process 1201, status = succeeded4876lb # [ 58.601979] niks3-server[1027]: 2026/09/20 10:50:06 INFO Received uploads request method=POST path=/api/pending_closures4877worker1 # [ 58.638531] nix-grpc-daemon[855]: time=2026-09-20T10:50:07.200Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4878worker1 # [ 58.639959] nix-grpc-daemon[855]: time=2026-09-20T10:50:07.201Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4879lb # [ 58.629460] niks3-server[1027]: 2026/09/20 10:50:06 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4880lb # [ 58.641951] niks3-server[1027]: 2026/09/20 10:50:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4881worker1 # [ 58.675192] nix-grpc-daemon[855]: time=2026-09-20T10:50:07.236Z level=INFO msg="Uploading 1 narinfos"4882lb # [ 58.648081] niks3-server[1027]: 2026/09/20 10:50:06 INFO Signed narinfos id=21 count=14883lb # [ 58.653204] niks3-server[1027]: 2026/09/20 10:50:06 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4884lb # [ 58.664414] niks3-server[1027]: 2026/09/20 10:50:07 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4885lb # [ 58.669956] niks3-server[1027]: 2026/09/20 10:50:07 INFO Completed upload id=214886worker1 # [ 58.698173] nix-grpc-daemon[855]: time=2026-09-20T10:50:07.259Z level=INFO msg="Upload complete. (400ms)"4887lb # [ 58.673697] niks3-server[1027]: 2026/09/20 10:50:07 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4888worker1 # [ 58.701864] nix-grpc-daemon[785]: ts=2026-09-20T10:50:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_in=5604889worker1 # [ 58.706722] nix-grpc-daemon[785]: ts=2026-09-20T10:50:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:518184890worker1 # [ 58.716198] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4891worker1 # [ 58.722605] nix-daemon[843]: reaped child process 1187, status = succeeded4892worker1 # [ 58.725587] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4893client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4894client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4895worker1 # [ 59.950926] nix-daemon[843]: reaped child process 1205, status = succeeded4896worker1 # [ 60.086730] nix-daemon[843]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)4897worker1 # [ 60.097260] nix-daemon[843]: reaped child process 1223, status = succeeded4898lb # [ 60.080772] niks3-server[1027]: 2026/09/20 10:50:08 INFO Received uploads request method=POST path=/api/pending_closures4899worker1 # [ 60.117554] nix-grpc-daemon[855]: time=2026-09-20T10:50:08.678Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4900lb # [ 60.112400] niks3-server[1027]: 2026/09/20 10:50:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4901worker1 # [ 60.149759] nix-grpc-daemon[855]: time=2026-09-20T10:50:08.711Z level=INFO msg="Uploading 1 narinfos"4902lb # [ 60.122389] niks3-server[1027]: 2026/09/20 10:50:08 INFO Signed narinfos id=22 count=14903lb # [ 60.124956] niks3-server[1027]: 2026/09/20 10:50:08 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4904lb # [ 60.132385] niks3-server[1027]: 2026/09/20 10:50:08 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4905lb # [ 60.143697] niks3-server[1027]: 2026/09/20 10:50:08 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4906lb # [ 60.148442] niks3-server[1027]: 2026/09/20 10:50:08 INFO Completed upload id=224907worker1 # [ 60.177004] nix-grpc-daemon[855]: time=2026-09-20T10:50:08.738Z level=INFO msg="Upload complete. (243ms)"4908lb # [ 60.153114] niks3-server[1027]: 2026/09/20 10:50:08 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4909worker1 # [ 60.181562] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=14910worker1 # [ 60.192962] nix-daemon[843]: reaped child process 1203, status = succeeded4911client # copying 1 paths...4912worker2 # [ 60.199256] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513604913worker2 # [ 60.211147] nix-grpc-daemon[785]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...4914client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4915worker1 # [ 60.275325] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:518184916worker1 # [ 60.280390] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51818 duration_s=0 paths=1 nar_bytes_out=1204917client # [ 60.307356] nix-daemon[939]: reaped child process 1043, status = succeeded4918client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.94 seconds)4919client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24920client # [ 60.489915] nix-daemon[939]: accepted connection from pid 1061, user root (trusted)4921client # this derivation will be built:4922client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4923worker2 # [ 60.655174] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:513604924client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4925worker1 # [ 60.691935] nix-grpc-daemon[785]: ts=2026-09-20T10:50:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:518184926worker1 # [ 60.700963] nix-grpc-daemon[855]: time=2026-09-20T10:50:09.262Z level=INFO msg="All 1 paths already cached"4927worker1 # [ 60.712861] nix-grpc-daemon[785]: ts=2026-09-20T10:50:09Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=04928worker1 # [ 60.715288] nix-grpc-daemon[785]: ts=2026-09-20T10:50:09Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14929worker2 # [ 60.726937] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513604930worker2 # [ 60.739458] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513604931worker2 # [ 60.752488] nix-grpc-daemon[834]: time=2026-09-20T10:50:08.981Z level=INFO msg="All 1 paths already cached"4932client # copying 1 paths to 'lb:50051'...4933client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...4934worker2 # [ 60.759337] nix-grpc-daemon[785]: ts=2026-09-20T10:50:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:513604935worker2 # [ 60.771540] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4936worker2 # [ 60.947583] nix-daemon[807]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4937worker2 # [ 60.959490] nix-daemon[807]: reaped child process 948, status = succeeded4938worker2 # [ 61.096129] nix-daemon[807]: accepted connection from pid 950, user nix-grpc-daemon (trusted)4939worker2 # [ 61.107660] nix-daemon[807]: reaped child process 953, status = succeeded4940lb # [ 61.127567] niks3-server[1027]: 2026/09/20 10:50:09 INFO Received uploads request method=POST path=/api/pending_closures4941worker2 # [ 61.133272] nix-grpc-daemon[834]: time=2026-09-20T10:50:09.362Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4942worker2 # [ 61.134717] nix-grpc-daemon[834]: time=2026-09-20T10:50:09.363Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"4943lb # [ 61.159161] niks3-server[1027]: 2026/09/20 10:50:09 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst4944lb # [ 61.167085] niks3-server[1027]: 2026/09/20 10:50:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4945worker2 # [ 61.171370] nix-grpc-daemon[834]: time=2026-09-20T10:50:09.400Z level=INFO msg="Uploading 1 narinfos"4946lb # [ 61.172832] niks3-server[1027]: 2026/09/20 10:50:09 INFO Signed narinfos id=23 count=14947lb # [ 61.180456] niks3-server[1027]: 2026/09/20 10:50:09 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls4948lb # [ 61.190438] niks3-server[1027]: 2026/09/20 10:50:09 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4949worker2 # [ 61.194799] nix-grpc-daemon[834]: time=2026-09-20T10:50:09.423Z level=INFO msg="Upload complete. (411ms)"4950lb # [ 61.196414] niks3-server[1027]: 2026/09/20 10:50:09 INFO Completed upload id=234951worker2 # [ 61.196940] nix-grpc-daemon[785]: ts=2026-09-20T10:50:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=0 paths=1 nar_bytes_in=5604952lb # [ 61.199690] niks3-server[1027]: 2026/09/20 10:50:09 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo4953worker2 # [ 61.202992] nix-grpc-daemon[785]: ts=2026-09-20T10:50:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513604954worker2 # [ 61.213288] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4955worker2 # [ 61.215713] nix-daemon[807]: reaped child process 943, status = succeeded4956worker2 # [ 61.221727] nix-daemon[807]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4957client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...4958client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4959worker2 # [ 62.835306] nix-daemon[807]: reaped child process 957, status = succeeded4960worker2 # [ 62.953357] nix-daemon[807]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4961worker2 # [ 62.965471] nix-daemon[807]: reaped child process 975, status = succeeded4962lb # [ 62.982383] niks3-server[1027]: 2026/09/20 10:50:11 INFO Received uploads request method=POST path=/api/pending_closures4963worker2 # [ 62.989215] nix-grpc-daemon[834]: time=2026-09-20T10:50:11.217Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4964lb # [ 63.004952] niks3-server[1027]: 2026/09/20 10:50:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4965lb # [ 63.006576] niks3-server[1027]: 2026/09/20 10:50:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls4966lb # [ 63.009262] niks3-server[1027]: 2026/09/20 10:50:11 INFO Signed narinfos id=24 count=14967worker2 # [ 63.009268] nix-grpc-daemon[834]: time=2026-09-20T10:50:11.238Z level=INFO msg="Uploading 1 narinfos"4968lb # [ 63.016117] niks3-server[1027]: 2026/09/20 10:50:11 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4969lb # [ 63.019575] niks3-server[1027]: 2026/09/20 10:50:11 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4970lb # [ 63.022040] niks3-server[1027]: 2026/09/20 10:50:11 INFO Completed upload id=244971worker2 # [ 63.020205] nix-grpc-daemon[834]: time=2026-09-20T10:50:11.249Z level=INFO msg="Upload complete. (192ms)"4972lb # [ 63.023673] niks3-server[1027]: 2026/09/20 10:50:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo4973worker2 # [ 63.022669] nix-grpc-daemon[785]: ts=2026-09-20T10:50:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=14974client # copying 1 paths...4975worker2 # [ 63.030130] nix-grpc-daemon[785]: ts=2026-09-20T10:50:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513604976worker2 # [ 63.032098] nix-daemon[807]: reaped child process 955, status = succeeded4977client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...4978worker2 # [ 63.044645] nix-grpc-daemon[785]: ts=2026-09-20T10:50:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:513604979worker2 # [ 63.046801] nix-grpc-daemon[785]: ts=2026-09-20T10:50:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51360 duration_s=0 paths=1 nar_bytes_out=1204980client # [ 63.147578] nix-daemon[939]: reaped child process 1064, status = succeeded4981client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.84 seconds)4982(finished: subtest: an input only one worker has still reaches the builder, in 9.20 seconds)4983subtest: upload whose reference the worker lacks is completed from the cache4984client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache4985client # this derivation will be built:4986client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv4987client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...4988client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.33 seconds)4989client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache4990client # this derivation will be built:4991client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv4992client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...4993client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.33 seconds)4994client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure4995client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)4996worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4997worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)4998worker2 # [ 64.242314] systemd[1]: Stopping Nix worker-protocol over gRPC...4999worker2 # [ 64.276254] nix-grpc-daemon[785]: ts=2026-09-20T10:50:12Z level=info event=signal_exit5000worker1 # [ 64.316524] nix-grpc-daemon[785]: ts=2026-09-20T10:50:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479125001worker1 # [ 64.320572] nix-grpc-daemon[785]: ts=2026-09-20T10:50:12Z level=info event=worker_gone addr=192.168.1.4:500515002worker2 # [ 64.291218] nix-grpc-daemon[785]: ts=2026-09-20T10:50:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5003worker2 # [ 64.309385] nix-daemon[807]: reaped child process 809, status = succeeded5004worker2 # [ 64.397652] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5005worker2 # [ 64.401097] nix-grpc-daemon[785]: E0000 00:00:1789901412.626240 796 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5006worker2 # [ 65.804442] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5007worker2 # [ 65.807586] systemd[1]: Stopped Nix worker-protocol over gRPC.5008worker2 # [ 65.811434] systemd[1]: nix-grpc-daemon.service: Consumed 1.075s CPU time over 47.784s wall clock time, 44.2M memory peak, 37.8K incoming IP traffic, 64.4K outgoing IP traffic.5009worker2 # [ 65.823092] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5010worker2 # [ 65.827350] systemd[1]: Closed Nix worker-protocol over gRPC.5011worker2 # [ 65.830483] systemd[1]: nix-grpc-daemon.socket: Consumed 293us CPU time over 56.548s wall clock time, 256K memory peak, 35.5K incoming IP traffic, 29.4K outgoing IP traffic.5012lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5013lb: must succeed: curl -sf localhost:9901/clusters5014lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5015lb: must succeed: curl -sf localhost:9901/clusters5016lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5017lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5018client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25019worker1 # [ 67.218962] nix-grpc-daemon[785]: ts=2026-09-20T10:50:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:518185020client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5021worker1 # [ 67.224260] nix-grpc-daemon[785]: ts=2026-09-20T10:50:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:518185022client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5023worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5024worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5025worker2 # [ 67.271410] systemd[1]: Listening on Nix worker-protocol over gRPC.5026worker1 # [ 67.360071] systemd[1]: Stopping Nix worker-protocol over gRPC...5027worker2 # [ 67.794346] systemd[1]: Starting Nix worker-protocol over gRPC...5028worker2 # [ 67.940877] nix-grpc-daemon[996]: ts=2026-09-20T10:50:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5029worker2 # [ 67.942808] nix-grpc-daemon[996]: ts=2026-09-20T10:50:16Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15030worker2 # [ 67.949192] nix-grpc-daemon[996]: ts=2026-09-20T10:50:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5031worker2 # [ 67.952227] systemd[1]: Started Nix worker-protocol over gRPC.5032worker2 # [ 67.964587] nix-grpc-daemon[996]: ts=2026-09-20T10:50:16Z level=info event=scheduler_connected addr=lb:500515033worker1 # [ 67.997071] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05034lb # [ 68.022340] envoy[918]: conn peer=[2001:db8:1::1]:48248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1912 ms=25185035lb # [ 68.026345] envoy[918]: conn peer=[2001:db8:1::1]:48256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=473 tx=328 ms=185036lb # [ 68.029759] envoy[918]: conn peer=[2001:db8:1::1]:57848 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=515037lb # [ 68.033245] envoy[918]: conn peer=[2001:db8:1::1]:48264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3699 tx=1800 ms=24445038lb # [ 68.036677] envoy[918]: conn peer=192.168.1.4:44536 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1149 tx=433 ms=451855039lb # [ 68.040839] envoy[918]: conn peer=[2001:db8:1::1]:57856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=175040worker1 # [ 68.296403] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=signal_exit5041worker2 # [ 68.267409] nix-grpc-daemon[996]: ts=2026-09-20T10:50:16Z level=info event=scheduler_restarting addr=lb:500515042worker1 # [ 68.305792] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=scheduler_restarting5043worker1 # [ 68.309263] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479125044worker1 # [ 68.313232] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=worker_gone addr=192.168.1.4:500515045worker1 # [ 68.316372] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=scheduler_restarting addr=lb:500515046worker1 # [ 68.319471] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479125047worker1 # [ 68.323089] nix-grpc-daemon[785]: ts=2026-09-20T10:50:16Z level=info event=worker_gone addr=192.168.1.3:500515048worker1 # [ 68.341331] nix-daemon[843]: reaped child process 845, status = succeeded5049worker1 # [ 68.409388] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5050worker1 # [ 68.412784] nix-grpc-daemon[785]: E0000 00:00:1789901416.969809 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5051worker1 # [ 68.417466] nix-grpc-daemon[785]: E0000 00:00:1789901416.970845 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5052worker2 # [ 68.468501] nix-grpc-daemon[996]: ts=2026-09-20T10:50:16Z level=info event=scheduler_connected addr=lb:500515053worker1 # [ 68.500977] nix-grpc-daemon[785]: E0000 00:00:1789901417.062338 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5054worker1 # [ 68.518899] nix-grpc-daemon[785]: ts=2026-09-20T10:50:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5055worker2 # [ 69.755783] nix-grpc-daemon[996]: ts=2026-09-20T10:50:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5056worker1 # [ 69.798454] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5057worker1 # [ 69.799711] systemd[1]: Stopped Nix worker-protocol over gRPC.5058worker1 # [ 69.801608] systemd[1]: nix-grpc-daemon.service: Consumed 2.486s CPU time over 51.752s wall clock time, 61.8M memory peak, 83.4K incoming IP traffic, 159.5K outgoing IP traffic.5059worker1 # [ 69.805914] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5060worker1 # [ 69.807644] systemd[1]: Closed Nix worker-protocol over gRPC.5061worker1 # [ 69.808938] systemd[1]: nix-grpc-daemon.socket: Consumed 293us CPU time over 1min 1.006s wall clock time, 256K memory peak, 90.7K incoming IP traffic, 70.9K outgoing IP traffic.5062lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5063lb: must succeed: curl -sf localhost:9901/clusters5064lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5065worker2 # [ 69.955843] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_connected addr=lb:500515066worker2 # [ 69.959758] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5067worker2 # [ 70.160213] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_connected addr=lb:500515068worker2 # [ 70.162968] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5069worker2 # [ 70.364085] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_connected addr=lb:500515070worker2 # [ 70.367961] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5071worker2 # [ 70.568609] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_connected addr=lb:500515072worker2 # [ 70.570654] nix-grpc-daemon[996]: ts=2026-09-20T10:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5073worker2 # [ 70.771821] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_connected addr=lb:500515074worker2 # [ 70.773470] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5075lb: must succeed: curl -sf localhost:9901/clusters5076lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5077lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 1.11 seconds)5078client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25079worker2 # [ 70.973788] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_connected addr=lb:500515080worker2 # [ 70.975988] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5081worker2 # [ 71.066067] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411505082worker2 # [ 71.071103] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5083worker2 # [ 71.078446] nix-grpc-daemon[996]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)5084worker2 # [ 71.122808] nix-grpc-daemon[996]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 2/5)5085worker2 # [ 71.177089] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_connected addr=lb:500515086worker2 # [ 71.180813] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5087worker2 # [ 71.253764] nix-grpc-daemon[996]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 228 ms (attempt 3/5)5088worker2 # [ 71.381675] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_connected addr=lb:500515089worker2 # [ 71.385515] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5090worker2 # [ 71.481968] nix-grpc-daemon[996]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 391 ms (attempt 4/5)5091worker2 # [ 71.586368] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_connected addr=lb:500515092worker2 # [ 71.590263] nix-grpc-daemon[996]: ts=2026-09-20T10:50:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5093worker2 # [ 71.791847] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_connected addr=lb:500515094worker2 # [ 71.795701] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5095worker2 # [ 71.879382] nix-grpc-daemon[996]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5096client # copying 2 paths...5097client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5098client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5099worker2 # [ 71.898160] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411505100worker2 # [ 71.908174] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5101worker2 # [ 71.927748] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=niks3_push_started pid=10175102worker2 # [ 71.996494] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_connected addr=lb:500515103worker2 # [ 71.999152] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5104worker2 # [ 72.199692] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_connected addr=lb:500515105worker2 # [ 72.202582] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5106worker2 # [ 72.270780] nix-daemon[807]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5107worker2 # [ 72.282585] nix-daemon[807]: reaped child process 1033, status = succeeded5108lb # [ 72.301429] niks3-server[1027]: 2026/09/20 10:50:20 INFO Received uploads request method=POST path=/api/pending_closures5109lb # [ 72.311666] niks3-server[1027]: 2026/09/20 10:50:20 INFO Received uploads request method=POST path=/api/pending_closures5110worker2 # [ 72.317649] nix-grpc-daemon[1017]: time=2026-09-20T10:50:20.546Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5111worker2 # [ 72.321745] nix-grpc-daemon[1017]: time=2026-09-20T10:50:20.548Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5112worker2 # [ 72.323683] nix-grpc-daemon[1017]: time=2026-09-20T10:50:20.548Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5113lb # [ 72.364117] niks3-server[1027]: 2026/09/20 10:50:20 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5114lb # [ 72.368634] niks3-server[1027]: 2026/09/20 10:50:20 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5115lb # [ 72.380596] niks3-server[1027]: 2026/09/20 10:50:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5116lb # [ 72.384875] niks3-server[1027]: 2026/09/20 10:50:20 INFO Signed narinfos id=26 count=25117lb # [ 72.387880] niks3-server[1027]: 2026/09/20 10:50:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5118lb # [ 72.391429] niks3-server[1027]: 2026/09/20 10:50:20 INFO Signed narinfos id=25 count=15119worker2 # [ 72.390737] nix-grpc-daemon[1017]: time=2026-09-20T10:50:20.619Z level=INFO msg="Uploading 3 narinfos"5120lb # [ 72.393872] niks3-server[1027]: 2026/09/20 10:50:20 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5121worker2 # [ 72.403084] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_connected addr=lb:500515122lb # [ 72.407479] niks3-server[1027]: 2026/09/20 10:50:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5123lb # [ 72.409614] niks3-server[1027]: 2026/09/20 10:50:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5124worker2 # [ 72.407842] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5125lb # [ 72.413920] niks3-server[1027]: 2026/09/20 10:50:20 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5126lb # [ 72.418072] niks3-server[1027]: 2026/09/20 10:50:20 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5127lb # [ 72.421607] niks3-server[1027]: 2026/09/20 10:50:20 INFO Completed upload id=255128lb # [ 72.423226] niks3-server[1027]: 2026/09/20 10:50:20 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5129lb # [ 72.425230] niks3-server[1027]: 2026/09/20 10:50:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5130lb # [ 72.428335] niks3-server[1027]: 2026/09/20 10:50:20 INFO Completed upload id=265131worker2 # [ 72.427925] nix-grpc-daemon[1017]: time=2026-09-20T10:50:20.657Z level=INFO msg="Upload complete. (312ms)"5132worker2 # [ 72.429842] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=0 paths=2 nar_bytes_in=3125133worker2 # [ 72.435911] nix-daemon[807]: reaped child process 1015, status = succeeded5134client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.57 seconds)5135worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5136worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.01 seconds)5137worker1 # [ 72.565596] systemd[1]: Listening on Nix worker-protocol over gRPC.5138worker1 # [ 72.572217] systemd[1]: Starting Nix worker-protocol over gRPC...5139worker2 # [ 72.608535] nix-grpc-daemon[996]: ts=2026-09-20T10:50:20Z level=info event=scheduler_connected addr=lb:500515140worker1 # [ 72.725694] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5141worker1 # [ 72.729044] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15142worker1 # [ 72.735055] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5143worker1 # [ 72.739694] systemd[1]: Started Nix worker-protocol over gRPC.5144worker1 # [ 72.746052] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05145lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5146lb: must succeed: curl -sf localhost:9901/clusters5147worker1 # [ 72.756964] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:21Z level=info event=scheduler_connected addr=lb:500515148worker1 # [ 72.758568] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05149lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5150lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5151(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.63 seconds)5152subtest: scheduler down: builds wait, then resume when it is back5153worker1 # [ 72.859246] systemd[1]: Stopping Nix worker-protocol over gRPC...5154worker1 # [ 73.741659] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:22Z level=info event=signal_exit5155worker1 # [ 73.746864] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:22Z level=info event=scheduler_restarting5156worker2 # [ 73.718649] nix-grpc-daemon[996]: ts=2026-09-20T10:50:21Z level=info event=scheduler_restarting addr=lb:500515157worker1 # [ 73.751278] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:22Z level=info event=scheduler_restarting addr=lb:500515158worker1 # [ 73.754427] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:594665159worker1 # [ 73.757883] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:22Z level=info event=worker_gone addr=192.168.1.3:500515160worker1 # [ 73.761092] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:594665161worker1 # [ 73.764476] nix-grpc-daemon[1248]: ts=2026-09-20T10:50:22Z level=info event=worker_gone addr=192.168.1.4:500515162worker1 # [ 73.789552] nix-grpc-daemon[1248]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5163worker1 # [ 73.791103] nix-grpc-daemon[1248]: E0000 00:00:1789901422.351040 1291 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 13, started true, shutdown true5164worker1 # [ 73.793219] nix-grpc-daemon[1248]: E0000 00:00:1789901422.354684 1291 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5165worker2 # [ 73.918560] nix-grpc-daemon[996]: ts=2026-09-20T10:50:22Z level=info event=scheduler_connected addr=lb:500515166worker1 # [ 73.949793] nix-grpc-daemon[1248]: E0000 00:00:1789901422.511217 1291 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5167worker2 # [ 74.706466] nix-grpc-daemon[996]: ts=2026-09-20T10:50:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5168worker1 # [ 74.751611] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5169worker1 # [ 74.753581] systemd[1]: Stopped Nix worker-protocol over gRPC.5170worker1 # [ 74.754706] systemd[1]: nix-grpc-daemon.service: Consumed 92ms CPU time over 2.180s wall clock time, 9.6M memory peak, 6K incoming IP traffic, 5K outgoing IP traffic.5171worker1 # [ 74.758808] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5172worker1 # [ 74.760605] systemd[1]: Closed Nix worker-protocol over gRPC.5173worker1 # [ 74.761825] systemd[1]: nix-grpc-daemon.socket: Consumed 513us CPU time over 2.203s wall clock time, 256K memory peak, 13.1K incoming IP traffic, 9.6K outgoing IP traffic.5174lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy5175lb: must succeed: curl -sf localhost:9901/clusters5176lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5177worker2 # [ 74.907477] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_connected addr=lb:500515178worker2 # [ 74.909252] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5179worker2 # [ 75.109902] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_connected addr=lb:500515180worker2 # [ 75.112206] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5181worker2 # [ 75.312821] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_connected addr=lb:500515182worker2 # [ 75.315066] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5183worker2 # [ 75.515704] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_connected addr=lb:500515184worker2 # [ 75.518493] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5185worker2 # [ 75.719198] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_connected addr=lb:500515186worker2 # [ 75.721251] nix-grpc-daemon[996]: ts=2026-09-20T10:50:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5187lb: must succeed: curl -sf localhost:9901/clusters5188lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5189lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 1.11 seconds)5190client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback5191client # [ 75.873659] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback.5192client # Running as unit: waits.service; invocation ID: c72e33f2f1d44a6387731e7f57223e915193client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback, in 0.04 seconds)5194??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5195 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735196client: must succeed: sleep 3.05197worker2 # [ 75.922240] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_connected addr=lb:500515198worker2 # [ 75.924989] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5199client # [ 76.068084] nix[1141]: don't know how to build these paths:5200worker2 # [ 76.070087] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411505201client # [ 76.069366] nix[1141]: /nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5202worker2 # [ 76.075063] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411505203client # [ 76.085915] nix[1141]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5204worker2 # [ 76.125787] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_connected addr=lb:500515205worker2 # [ 76.128810] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5206worker2 # [ 76.329256] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_connected addr=lb:500515207worker2 # [ 76.331065] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5208worker2 # [ 76.532175] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_connected addr=lb:500515209worker2 # [ 76.536209] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5210client # [ 76.588865] nix[1141]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5211worker2 # [ 76.736552] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_connected addr=lb:500515212worker2 # [ 76.738430] nix-grpc-daemon[996]: ts=2026-09-20T10:50:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5213worker2 # [ 76.940255] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_connected addr=lb:500515214worker2 # [ 76.944370] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5215worker2 # [ 77.145434] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_connected addr=lb:500515216worker2 # [ 77.149320] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5217worker2 # [ 77.349703] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_connected addr=lb:500515218worker2 # [ 77.352083] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5219worker2 # [ 77.553151] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_connected addr=lb:500515220worker2 # [ 77.557173] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5221client # [ 77.592601] nix[1141]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5222worker2 # [ 77.757939] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_connected addr=lb:500515223worker2 # [ 77.761879] nix-grpc-daemon[996]: ts=2026-09-20T10:50:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5224worker2 # [ 77.963462] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_connected addr=lb:500515225worker2 # [ 77.967281] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5226lb # [ 78.021854] envoy[918]: conn peer=192.168.1.3:46798 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2176 tx=1013 ms=491545227lb # [ 78.023980] envoy[918]: conn peer=[2001:db8:1::1]:57862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1002 tx=305 ms=13745228lb # [ 78.026136] envoy[918]: conn peer=[2001:db8:1::3]:54438 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=552 tx=177 ms=11975229worker2 # [ 78.168099] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_connected addr=lb:500515230worker2 # [ 78.172109] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5231worker2 # [ 78.372430] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_connected addr=lb:500515232worker2 # [ 78.375379] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5233worker2 # [ 78.576311] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_connected addr=lb:500515234worker2 # [ 78.579504] nix-grpc-daemon[996]: ts=2026-09-20T10:50:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5235worker2 # [ 78.780561] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=info event=scheduler_connected addr=lb:500515236worker2 # [ 78.784491] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5237client: (finished: must succeed: sleep 3.0, in 3.03 seconds)5238client: must succeed: systemctl is-active waits5239client: (finished: must succeed: systemctl is-active waits, in 0.04 seconds)5240worker2 # [ 78.985668] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=info event=scheduler_connected addr=lb:500515241worker2 # [ 78.989474] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5242worker1 # [ 79.057792] systemd[1]: Listening on Nix worker-protocol over gRPC.5243worker1 # [ 79.064528] systemd[1]: Starting Nix worker-protocol over gRPC...5244worker2 # [ 79.189821] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=info event=scheduler_connected addr=lb:500515245worker1 # [ 79.220255] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5246worker1 # [ 79.224287] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15247worker1 # [ 79.230625] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5248worker1 # [ 79.235138] systemd[1]: Started Nix worker-protocol over gRPC.5249worker1 # [ 79.239781] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05250lb: waiting until exactly no endpoints of sched are unhealthy5251lb: must succeed: curl -sf localhost:9901/clusters5252worker1 # [ 79.251302] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:27Z level=info event=scheduler_connected addr=lb:500515253worker1 # [ 79.252911] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05254lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5255worker1 # [ 79.635497] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:28Z level=debug event=want client=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv cached=05256worker1 # [ 79.637516] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:28Z level=debug event=assigned drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv worker=192.168.1.4:50051 clients=15257worker2 # [ 79.651889] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505258worker2 # [ 79.666888] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411505259client # [ 79.674761] nix[1141]: copying 1 paths to 'lb:50051'...5260worker2 # [ 79.678962] nix-grpc-daemon[996]: ts=2026-09-20T10:50:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411505261client # [ 79.676829] nix[1141]: copying path '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' to 'lb:50051'...5262worker2 # [ 79.692169] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5263worker2 # [ 79.860419] nix-daemon[807]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)5264worker2 # [ 79.872830] nix-daemon[807]: reaped child process 1043, status = succeeded5265worker2 # [ 80.013534] nix-daemon[807]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5266worker2 # [ 80.025629] nix-daemon[807]: reaped child process 1048, status = succeeded5267lb # [ 80.038477] niks3-server[1027]: 2026/09/20 10:50:28 INFO Received uploads request method=POST path=/api/pending_closures5268worker2 # [ 80.046044] nix-grpc-daemon[1017]: time=2026-09-20T10:50:28.274Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5269worker2 # [ 80.047411] nix-grpc-daemon[1017]: time=2026-09-20T10:50:28.274Z level=INFO msg="Uploading 78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv (520B)"5270lb # [ 80.071503] niks3-server[1027]: 2026/09/20 10:50:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5271worker2 # [ 80.074617] nix-grpc-daemon[1017]: time=2026-09-20T10:50:28.303Z level=INFO msg="Uploading 1 narinfos"5272lb # [ 80.076566] niks3-server[1027]: 2026/09/20 10:50:28 INFO Signed narinfos id=27 count=15273lb # [ 80.085943] niks3-server[1027]: 2026/09/20 10:50:28 INFO Registered completed upload object_key=nar/06bjks304hxld0mwhch6kvcfiix46iimcpysvzrdsfv41vfc14ny.nar.zst5274lb # [ 80.097915] niks3-server[1027]: 2026/09/20 10:50:28 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.ls5275lb # [ 80.103521] niks3-server[1027]: 2026/09/20 10:50:28 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5276lb # [ 80.108085] niks3-server[1027]: 2026/09/20 10:50:28 INFO Completed upload id=275277worker2 # [ 80.108754] nix-grpc-daemon[1017]: time=2026-09-20T10:50:28.337Z level=INFO msg="Upload complete. (405ms)"5278lb # [ 80.114566] niks3-server[1027]: 2026/09/20 10:50:28 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.narinfo5279worker2 # [ 80.113609] nix-grpc-daemon[996]: ts=2026-09-20T10:50:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=0 paths=1 nar_bytes_in=5205280worker2 # [ 80.119271] nix-grpc-daemon[996]: ts=2026-09-20T10:50:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505281worker2 # [ 80.126200] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5282worker2 # [ 80.131260] nix-daemon[807]: reaped child process 1038, status = succeeded5283worker2 # [ 80.136319] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5284client # [ 80.131784] nix[1141]: building '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' on lb:50051...5285lb: must succeed: curl -sf localhost:9901/clusters5286lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5287lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.15 seconds)5288client: waiting for success: ! systemctl is-active waits5289worker2 # [ 81.158251] nix-daemon[807]: reaped child process 1052, status = succeeded5290worker2 # [ 81.310839] nix-daemon[807]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)5291worker2 # [ 81.322660] nix-daemon[807]: reaped child process 1070, status = succeeded5292lb # [ 81.337355] niks3-server[1027]: 2026/09/20 10:50:29 INFO Received uploads request method=POST path=/api/pending_closures5293worker2 # [ 81.345369] nix-grpc-daemon[1017]: time=2026-09-20T10:50:29.574Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5294worker2 # [ 81.347994] nix-grpc-daemon[1017]: time=2026-09-20T10:50:29.576Z level=INFO msg="Uploading wxl98jgbbzfq9nz6nhndwvzybqml1mdg-farm-a (136B)"5295lb # [ 81.376362] niks3-server[1027]: 2026/09/20 10:50:29 INFO Registered completed upload object_key=log/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv5296lb # [ 81.384151] niks3-server[1027]: 2026/09/20 10:50:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5297lb # [ 81.389916] niks3-server[1027]: 2026/09/20 10:50:29 INFO Signed narinfos id=28 count=15298worker2 # [ 81.391351] nix-grpc-daemon[1017]: time=2026-09-20T10:50:29.620Z level=INFO msg="Uploading 1 narinfos"5299lb # [ 81.398344] niks3-server[1027]: 2026/09/20 10:50:29 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst5300lb # [ 81.406864] niks3-server[1027]: 2026/09/20 10:50:29 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.ls5301lb # [ 81.417083] niks3-server[1027]: 2026/09/20 10:50:29 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5302lb # [ 81.419511] niks3-server[1027]: 2026/09/20 10:50:29 INFO Completed upload id=285303lb # [ 81.421608] niks3-server[1027]: 2026/09/20 10:50:29 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.narinfo5304worker2 # [ 81.419418] nix-grpc-daemon[1017]: time=2026-09-20T10:50:29.648Z level=INFO msg="Upload complete. (274ms)"5305worker2 # [ 81.424761] nix-grpc-daemon[996]: ts=2026-09-20T10:50:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv assign_id=1 outputs=15306worker2 # [ 81.434414] nix-daemon[807]: reaped child process 1050, status = succeeded5307worker1 # [ 81.462943] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:30Z level=debug event=want client=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv cached=05308worker1 # [ 81.467134] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:30Z level=debug event=assigned drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv worker=192.168.1.4:50051 clients=15309worker2 # [ 81.475737] nix-grpc-daemon[996]: ts=2026-09-20T10:50:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505310worker2 # [ 81.483806] nix-grpc-daemon[996]: ts=2026-09-20T10:50:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411505311worker2 # [ 81.493096] nix-grpc-daemon[1017]: time=2026-09-20T10:50:29.722Z level=INFO msg="All 1 paths already cached"5312client # [ 81.492389] nix[1141]: copying 1 paths to 'lb:50051'...5313client # [ 81.493167] nix[1141]: copying path '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' to 'lb:50051'...5314worker2 # [ 81.496967] nix-grpc-daemon[996]: ts=2026-09-20T10:50:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411505315worker2 # [ 81.502747] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5316worker2 # [ 81.660794] nix-daemon[807]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)5317worker2 # [ 81.672820] nix-daemon[807]: reaped child process 1077, status = succeeded5318worker2 # [ 81.828621] nix-daemon[807]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)5319worker2 # [ 81.840519] nix-daemon[807]: reaped child process 1082, status = succeeded5320lb # [ 81.854618] niks3-server[1027]: 2026/09/20 10:50:30 INFO Received uploads request method=POST path=/api/pending_closures5321worker2 # [ 81.861706] nix-grpc-daemon[1017]: time=2026-09-20T10:50:30.090Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5322worker2 # [ 81.863130] nix-grpc-daemon[1017]: time=2026-09-20T10:50:30.090Z level=INFO msg="Uploading jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv (632B)"5323lb # [ 81.879059] niks3-server[1027]: 2026/09/20 10:50:30 INFO Registered completed upload object_key=nar/06r703613wasx30c56zihv19sk7v1y1xsivlzw3jax3csnwjf02v.nar.zst5324lb # [ 81.891644] niks3-server[1027]: 2026/09/20 10:50:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5325lb # [ 81.898291] niks3-server[1027]: 2026/09/20 10:50:30 INFO Signed narinfos id=29 count=15326worker2 # [ 81.900069] nix-grpc-daemon[1017]: time=2026-09-20T10:50:30.128Z level=INFO msg="Uploading 1 narinfos"5327lb # [ 81.901661] niks3-server[1027]: 2026/09/20 10:50:30 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.ls5328lb # [ 81.914290] niks3-server[1027]: 2026/09/20 10:50:30 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5329worker2 # [ 81.919152] nix-grpc-daemon[1017]: time=2026-09-20T10:50:30.148Z level=INFO msg="Upload complete. (411ms)"5330lb # [ 81.920674] niks3-server[1027]: 2026/09/20 10:50:30 INFO Completed upload id=295331worker2 # [ 81.921137] nix-grpc-daemon[996]: ts=2026-09-20T10:50:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=0 paths=1 nar_bytes_in=6325332lb # [ 81.923241] niks3-server[1027]: 2026/09/20 10:50:30 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.narinfo5333worker2 # [ 81.927214] nix-daemon[807]: reaped child process 1072, status = succeeded5334worker2 # [ 81.928572] nix-grpc-daemon[996]: ts=2026-09-20T10:50:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505335worker2 # [ 81.932485] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5336worker2 # [ 81.939087] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5337client # [ 81.934491] nix[1141]: building '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' on lb:50051...5338worker2 # [ 82.958301] nix-daemon[807]: reaped child process 1086, status = succeeded5339worker2 # [ 83.109846] nix-daemon[807]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)5340worker2 # [ 83.120888] nix-daemon[807]: reaped child process 1104, status = succeeded5341lb # [ 83.140731] niks3-server[1027]: 2026/09/20 10:50:31 INFO Received uploads request method=POST path=/api/pending_closures5342worker2 # [ 83.147990] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.376Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5343worker2 # [ 83.149531] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.378Z level=INFO msg="Uploading ahy8cs7r52ad4fklig5k1khmrwzp7bkc-farm-b (184B)"5344lb # [ 83.184150] niks3-server[1027]: 2026/09/20 10:50:31 INFO Registered completed upload object_key=nar/1bxjgkmwyii071c3ahwryw7md5gl9qidg8bm2rb2v2idzf8bvmpb.nar.zst5345lb # [ 83.188461] niks3-server[1027]: 2026/09/20 10:50:31 INFO Registered completed upload object_key=log/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv5346lb # [ 83.193934] niks3-server[1027]: 2026/09/20 10:50:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5347lb # [ 83.199901] niks3-server[1027]: 2026/09/20 10:50:31 INFO Signed narinfos id=30 count=15348worker2 # [ 83.201446] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.430Z level=INFO msg="Uploading 1 narinfos"5349lb # [ 83.207194] niks3-server[1027]: 2026/09/20 10:50:31 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.ls5350lb # [ 83.218132] niks3-server[1027]: 2026/09/20 10:50:31 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5351lb # [ 83.222584] niks3-server[1027]: 2026/09/20 10:50:31 INFO Completed upload id=305352worker2 # [ 83.221246] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.450Z level=INFO msg="Upload complete. (273ms)"5353lb # [ 83.225270] niks3-server[1027]: 2026/09/20 10:50:31 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.narinfo5354worker2 # [ 83.226962] nix-grpc-daemon[996]: ts=2026-09-20T10:50:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv assign_id=2 outputs=15355worker1 # [ 83.263473] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:31Z level=debug event=want client=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv cached=05356worker1 # [ 83.267496] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:31Z level=debug event=assigned drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv worker=192.168.1.4:50051 clients=15357worker2 # [ 83.241364] nix-daemon[807]: reaped child process 1084, status = succeeded5358worker2 # [ 83.278591] nix-grpc-daemon[996]: ts=2026-09-20T10:50:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505359worker2 # [ 83.290995] nix-grpc-daemon[996]: ts=2026-09-20T10:50:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411505360worker2 # [ 83.303590] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.532Z level=INFO msg="All 2 paths already cached"5361client # [ 83.305584] nix[1141]: copying 1 paths to 'lb:50051'...5362client # [ 83.307066] nix[1141]: copying path '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' to 'lb:50051'...5363worker2 # [ 83.310477] nix-grpc-daemon[996]: ts=2026-09-20T10:50:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411505364worker2 # [ 83.318670] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5365worker2 # [ 83.506274] nix-daemon[807]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)5366worker2 # [ 83.518448] nix-daemon[807]: reaped child process 1111, status = succeeded5367worker2 # [ 83.683313] nix-daemon[807]: accepted connection from pid 1113, user nix-grpc-daemon (trusted)5368worker2 # [ 83.695428] nix-daemon[807]: reaped child process 1116, status = succeeded5369lb # [ 83.714265] niks3-server[1027]: 2026/09/20 10:50:32 INFO Received uploads request method=POST path=/api/pending_closures5370worker2 # [ 83.719556] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.948Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5371worker2 # [ 83.721346] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.950Z level=INFO msg="Uploading 4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv (760B)"5372lb # [ 83.738677] niks3-server[1027]: 2026/09/20 10:50:32 INFO Registered completed upload object_key=nar/1dx1l3qanf0yqmk397nzvl6w8vm5z1klsskxak9mqzzqlm7rj9id.nar.zst5373lb # [ 83.751142] niks3-server[1027]: 2026/09/20 10:50:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5374lb # [ 83.758087] niks3-server[1027]: 2026/09/20 10:50:32 INFO Signed narinfos id=31 count=15375worker2 # [ 83.759711] nix-grpc-daemon[1017]: time=2026-09-20T10:50:31.988Z level=INFO msg="Uploading 1 narinfos"5376lb # [ 83.762861] niks3-server[1027]: 2026/09/20 10:50:32 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.ls5377lb # [ 83.774181] niks3-server[1027]: 2026/09/20 10:50:32 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5378lb # [ 83.779879] niks3-server[1027]: 2026/09/20 10:50:32 INFO Completed upload id=315379worker2 # [ 83.779654] nix-grpc-daemon[1017]: time=2026-09-20T10:50:32.008Z level=INFO msg="Upload complete. (447ms)"5380lb # [ 83.781878] niks3-server[1027]: 2026/09/20 10:50:32 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.narinfo5381worker2 # [ 83.782757] nix-grpc-daemon[996]: ts=2026-09-20T10:50:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=0 paths=1 nar_bytes_in=7605382worker2 # [ 83.787488] nix-grpc-daemon[996]: ts=2026-09-20T10:50:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505383worker2 # [ 83.795855] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5384worker2 # [ 83.801350] nix-daemon[807]: reaped child process 1106, status = succeeded5385worker2 # [ 83.806398] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5386client # [ 83.802072] nix[1141]: building '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' on lb:50051...5387worker2 # [ 84.831336] nix-daemon[807]: reaped child process 1120, status = succeeded5388worker2 # [ 85.000809] nix-daemon[807]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)5389worker2 # [ 85.014910] nix-daemon[807]: reaped child process 1138, status = succeeded5390lb # [ 85.026604] niks3-server[1027]: 2026/09/20 10:50:33 INFO Received uploads request method=POST path=/api/pending_closures5391worker2 # [ 85.034204] nix-grpc-daemon[1017]: time=2026-09-20T10:50:33.263Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5392worker2 # [ 85.037144] nix-grpc-daemon[1017]: time=2026-09-20T10:50:33.264Z level=INFO msg="Uploading 2kzynzc2x7d9fjl737krjzzjbsp5p77k-farm-top (240B)"5393lb # [ 85.055180] niks3-server[1027]: 2026/09/20 10:50:33 INFO Registered completed upload object_key=log/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5394lb # [ 85.058217] niks3-server[1027]: 2026/09/20 10:50:33 INFO Registered completed upload object_key=nar/1x5xsygwz4a6bpv0g402i3p0nk63j2j9qkxs1rdnp6s20644kc3j.nar.zst5395lb # [ 85.062667] niks3-server[1027]: 2026/09/20 10:50:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5396lb # [ 85.064454] niks3-server[1027]: 2026/09/20 10:50:33 INFO Signed narinfos id=32 count=15397worker2 # [ 85.064221] nix-grpc-daemon[1017]: time=2026-09-20T10:50:33.293Z level=INFO msg="Uploading 1 narinfos"5398lb # [ 85.068573] niks3-server[1027]: 2026/09/20 10:50:33 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.ls5399lb # [ 85.072715] niks3-server[1027]: 2026/09/20 10:50:33 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5400lb # [ 85.075327] niks3-server[1027]: 2026/09/20 10:50:33 INFO Completed upload id=325401worker2 # [ 85.075103] nix-grpc-daemon[1017]: time=2026-09-20T10:50:33.304Z level=INFO msg="Upload complete. (261ms)"5402lb # [ 85.077615] niks3-server[1027]: 2026/09/20 10:50:33 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.narinfo5403worker2 # [ 85.077627] nix-grpc-daemon[996]: ts=2026-09-20T10:50:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv assign_id=3 outputs=15404worker2 # [ 85.084623] nix-daemon[807]: reaped child process 1118, status = succeeded5405client # [ 85.105624] systemd[1]: waits.service: Deactivated successfully.5406client # [ 85.108132] systemd[1]: waits.service: Consumed 134ms CPU time over 9.233s wall clock time, 47.5M memory peak, 14.3K incoming IP traffic, 19.8K outgoing IP traffic.5407client: (finished: waiting for success: ! systemctl is-active waits, in 5.28 seconds)5408client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }5409client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.03 seconds)5410worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5411worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5412(finished: subtest: scheduler down: builds wait, then resume when it is back, in 12.95 seconds)5413subtest: clean scheduler restart: peers are told, reconnect without error or backoff5414client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5415client # [ 85.786887] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5416client # Running as unit: rs.service; invocation ID: 4f6751c984a3476baee318379e93ccf05417client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.06 seconds)5418worker2 # [ 85.983069] nix-grpc-daemon[996]: ts=2026-09-20T10:50:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411505419client # [ 85.984503] nix[1201]: don't know how to build these paths:5420client # [ 85.986054] nix[1201]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5421worker1 # [ 86.028756] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:34Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05422worker1 # [ 86.034283] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:34Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15423worker1 # [ 86.075165] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410725424worker1 # [ 86.086363] nix-daemon[843]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5425worker1 # [ 86.102574] nix-grpc-daemon[1309]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5)5426worker1 # [ 86.140348] nix-grpc-daemon[1309]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5)5427worker1 # [ 86.294148] nix-grpc-daemon[1309]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 3/5)5428worker1 # [ 86.340874] nix-grpc-daemon[1309]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 666 ms (attempt 4/5)5429worker1 # [ 87.012575] nix-grpc-daemon[1309]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5430worker1 # [ 87.022986] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410725431client # [ 86.995799] nix[1201]: copying 1 paths to 'lb:50051'...5432worker1 # [ 87.030117] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410725433client # [ 86.999171] nix[1201]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5434worker1 # [ 87.040400] nix-daemon[843]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5435worker1 # [ 87.049541] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:35Z level=info event=niks3_push_started pid=13815436worker1 # [ 87.317479] nix-daemon[843]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5437worker1 # [ 87.329112] nix-daemon[843]: reaped child process 1397, status = succeeded5438worker1 # [ 87.471901] nix-daemon[843]: accepted connection from pid 1399, user nix-grpc-daemon (trusted)5439worker1 # [ 87.483308] nix-daemon[843]: reaped child process 1402, status = succeeded5440lb # [ 87.465685] niks3-server[1027]: 2026/09/20 10:50:35 INFO Received uploads request method=POST path=/api/pending_closures5441worker1 # [ 87.499663] nix-grpc-daemon[1381]: time=2026-09-20T10:50:36.060Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5442worker1 # [ 87.501926] nix-grpc-daemon[1381]: time=2026-09-20T10:50:36.062Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5443lb # [ 87.491140] niks3-server[1027]: 2026/09/20 10:50:35 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5444lb # [ 87.505133] niks3-server[1027]: 2026/09/20 10:50:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5445lb # [ 87.510600] niks3-server[1027]: 2026/09/20 10:50:35 INFO Signed narinfos id=33 count=15446worker1 # [ 87.542454] nix-grpc-daemon[1381]: time=2026-09-20T10:50:36.103Z level=INFO msg="Uploading 1 narinfos"5447lb # [ 87.524716] niks3-server[1027]: 2026/09/20 10:50:35 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5448lb # [ 87.530232] niks3-server[1027]: 2026/09/20 10:50:35 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5449lb # [ 87.535873] niks3-server[1027]: 2026/09/20 10:50:35 INFO Completed upload id=335450worker1 # [ 87.564412] nix-grpc-daemon[1381]: time=2026-09-20T10:50:36.125Z level=INFO msg="Upload complete. (374ms)"5451worker1 # [ 87.566422] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41072 duration_s=0 paths=1 nar_bytes_in=4165452lb # [ 87.539082] niks3-server[1027]: 2026/09/20 10:50:35 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5453worker1 # [ 87.570383] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410725454worker1 # [ 87.576819] nix-daemon[843]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5455worker1 # [ 87.579045] nix-daemon[843]: reaped child process 1379, status = succeeded5456worker1 # [ 87.584066] nix-daemon[843]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5457client # [ 87.549575] nix[1201]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5458lb # [ 88.023504] envoy[918]: conn peer=[2001:db8:1::1]:34950 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=10116 tx=4019 ms=90225459worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5460worker2 # [ 89.390548] systemd-journald[288]: Received client request to rotate journal, rotating.5461worker2 # [ 89.400958] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/2fd9d273793c4178886255dd4f7df36c.5462worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5463worker1: must succeed: systemctl restart nix-grpc-daemon.service5464worker1 # [ 89.386807] systemd[1]: Stopping Nix worker-protocol over gRPC...5465worker1 # [ 89.398164] nix-daemon[843]: reaped child process 1406, status = succeeded5466worker1 # [ 89.545351] nix-daemon[843]: accepted connection from pid 1438, user nix-grpc-daemon (trusted)5467worker1 # [ 89.555533] nix-daemon[843]: reaped child process 1441, status = succeeded5468lb # [ 89.543843] niks3-server[1027]: 2026/09/20 10:50:37 INFO Received uploads request method=POST path=/api/pending_closures5469worker1 # [ 89.576588] nix-grpc-daemon[1381]: time=2026-09-20T10:50:38.137Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5470worker1 # [ 89.577993] nix-grpc-daemon[1381]: time=2026-09-20T10:50:38.139Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5471lb # [ 89.561546] niks3-server[1027]: 2026/09/20 10:50:37 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5472lb # [ 89.567139] niks3-server[1027]: 2026/09/20 10:50:37 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5473lb # [ 89.571056] niks3-server[1027]: 2026/09/20 10:50:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5474lb # [ 89.573969] niks3-server[1027]: 2026/09/20 10:50:37 INFO Signed narinfos id=34 count=15475worker1 # [ 89.603088] nix-grpc-daemon[1381]: time=2026-09-20T10:50:38.164Z level=INFO msg="Uploading 1 narinfos"5476lb # [ 89.577384] niks3-server[1027]: 2026/09/20 10:50:37 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5477lb # [ 89.581146] niks3-server[1027]: 2026/09/20 10:50:37 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5478lb # [ 89.584865] niks3-server[1027]: 2026/09/20 10:50:37 INFO Completed upload id=345479worker1 # [ 89.613362] nix-grpc-daemon[1381]: time=2026-09-20T10:50:38.174Z level=INFO msg="Upload complete. (221ms)"5480lb # [ 89.586580] niks3-server[1027]: 2026/09/20 10:50:37 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5481worker1 # [ 89.615803] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41072 duration_s=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15482worker1 # [ 89.622705] nix-daemon[843]: reaped child process 1404, status = succeeded5483client # [ 89.618576] systemd[1]: rs.service: Deactivated successfully.5484client # [ 89.622396] systemd[1]: rs.service: Consumed 108ms CPU time over 3.833s wall clock time, 39.2M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.5485worker1 # [ 90.235662] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=signal_exit5486worker2 # [ 90.208339] nix-grpc-daemon[996]: ts=2026-09-20T10:50:38Z level=info event=scheduler_restarting addr=lb:500515487worker1 # [ 90.242754] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=scheduler_restarting5488worker1 # [ 90.246984] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=scheduler_restarting addr=lb:500515489worker1 # [ 90.251219] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:478745490worker1 # [ 90.254691] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=worker_gone addr=192.168.1.3:500515491worker1 # [ 90.257832] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:478745492worker1 # [ 90.261534] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:38Z level=info event=worker_gone addr=192.168.1.4:500515493worker1 # [ 90.273647] nix-daemon[843]: reaped child process 1370, status = succeeded5494worker2 # [ 90.408194] nix-grpc-daemon[996]: ts=2026-09-20T10:50:38Z level=info event=scheduler_connected addr=lb:500515495worker1 # [ 90.440459] nix-grpc-daemon[1309]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5496worker1 # [ 90.449441] nix-grpc-daemon[1309]: E0000 00:00:1789901439.001816 1352 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5497worker1 # [ 90.458270] nix-grpc-daemon[1309]: ts=2026-09-20T10:50:39Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5498worker1 # [ 90.780782] nix-grpc-daemon[1309]: E0000 00:00:1789901439.341136 1352 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5499worker1 # [ 90.785877] nix-grpc-daemon[1309]: E0000 00:00:1789901439.347131 1352 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5500worker2 # [ 91.768538] nix-grpc-daemon[996]: ts=2026-09-20T10:50:39Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5501worker1 # [ 91.819585] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5502worker1 # [ 91.823270] systemd[1]: Stopped Nix worker-protocol over gRPC.5503worker1 # [ 91.826543] systemd[1]: nix-grpc-daemon.service: Consumed 456ms CPU time over 12.755s wall clock time, 31.1M memory peak, 17.2K incoming IP traffic, 23.1K outgoing IP traffic.5504worker1 # [ 91.844450] systemd[1]: Starting Nix worker-protocol over gRPC...5505worker1 # [ 91.994605] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5506worker1 # [ 91.997804] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15507worker2 # [ 91.968794] nix-grpc-daemon[996]: ts=2026-09-20T10:50:40Z level=info event=scheduler_connected addr=lb:500515508worker1 # [ 92.004058] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5509worker1 # [ 92.008371] systemd[1]: Started Nix worker-protocol over gRPC.5510worker1 # [ 92.014855] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:40Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05511worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.66 seconds)5512worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5513worker1 # [ 92.022397] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:40Z level=info event=scheduler_connected addr=lb:500515514worker1 # [ 92.024057] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05515worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.05 seconds)5516worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5517worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5518client: waiting for success: ! systemctl is-active rs5519client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5520client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5521client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5522client: must fail: journalctl -u rs | grep -q 'reconnecting'5523client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5524(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.55 seconds)5525subtest: scheduler restart mid-build: build finishes, no double build5526client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5527client # [ 92.320636] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5528client # Running as unit: mid.service; invocation ID: 00d201f00c294d0c8d41d0ccb68e694a5529client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5530worker1 # [ 92.558708] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411265531worker1 # [ 92.570683] nix-daemon[843]: accepted connection from pid 1448, user nix-grpc-daemon (trusted)5532client # [ 92.548537] nix[1233]: don't know how to build these paths:5533client # [ 92.549542] nix[1233]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5534worker1 # [ 92.594099] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:41Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05535worker1 # [ 92.598965] nix-grpc-daemon[1448]: ts=2026-09-20T10:50:41Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15536worker2 # [ 92.612982] nix-grpc-daemon[996]: ts=2026-09-20T10:50:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505537worker2 # [ 92.621882] nix-grpc-daemon[996]: ts=2026-09-20T10:50:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411505538client # [ 92.624541] nix[1233]: copying 1 paths to 'lb:50051'...5539worker2 # [ 92.629162] nix-grpc-daemon[996]: ts=2026-09-20T10:50:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411505540client # [ 92.625481] nix[1233]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5541worker2 # [ 92.634610] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5542worker2 # [ 92.810466] nix-daemon[807]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5543worker2 # [ 92.826143] nix-daemon[807]: reaped child process 1180, status = succeeded5544worker2 # [ 93.007233] nix-daemon[807]: accepted connection from pid 1182, user nix-grpc-daemon (trusted)5545worker2 # [ 93.021455] nix-daemon[807]: reaped child process 1185, status = succeeded5546lb # [ 93.041328] niks3-server[1027]: 2026/09/20 10:50:41 INFO Received uploads request method=POST path=/api/pending_closures5547worker2 # [ 93.048759] nix-grpc-daemon[1017]: time=2026-09-20T10:50:41.277Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5548worker2 # [ 93.051060] nix-grpc-daemon[1017]: time=2026-09-20T10:50:41.280Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5549lb # [ 93.073146] niks3-server[1027]: 2026/09/20 10:50:41 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5550lb # [ 93.084920] niks3-server[1027]: 2026/09/20 10:50:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5551worker2 # [ 93.089136] nix-grpc-daemon[1017]: time=2026-09-20T10:50:41.318Z level=INFO msg="Uploading 1 narinfos"5552lb # [ 93.090744] niks3-server[1027]: 2026/09/20 10:50:41 INFO Signed narinfos id=35 count=15553lb # [ 93.096871] niks3-server[1027]: 2026/09/20 10:50:41 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5554lb # [ 93.106343] niks3-server[1027]: 2026/09/20 10:50:41 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5555lb # [ 93.111227] niks3-server[1027]: 2026/09/20 10:50:41 INFO Completed upload id=355556worker2 # [ 93.109455] nix-grpc-daemon[1017]: time=2026-09-20T10:50:41.338Z level=WARN msg="Failed to register uploaded object" key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo error="server returned 404: object is not pending upload\n"5557worker2 # [ 93.116248] nix-grpc-daemon[1017]: time=2026-09-20T10:50:41.343Z level=INFO msg="Upload complete. (472ms)"5558worker2 # [ 93.120067] nix-grpc-daemon[996]: ts=2026-09-20T10:50:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=0 paths=1 nar_bytes_in=4245559worker2 # [ 93.124855] nix-grpc-daemon[996]: ts=2026-09-20T10:50:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505560worker2 # [ 93.133612] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5561worker2 # [ 93.137252] nix-daemon[807]: reaped child process 1175, status = succeeded5562client # [ 93.137216] nix[1233]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5563worker2 # [ 93.142067] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5564worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5565worker1 # [ 94.861305] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1448 (nix-grpc-daemon) on client request.5566worker1 # [ 94.866936] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5567worker2 # [ 94.838120] nix-grpc-daemon[996]: ts=2026-09-20T10:50:43Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5568client # [ 94.835284] nix[1233]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5569worker1 # [ 94.877824] nix-daemon[843]: reaped child process 1505, status = succeeded5570worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.05 seconds)5571client: must succeed: sleep 5.05572worker1 # [ 94.888251] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5573worker1 # [ 94.889705] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5574worker1 # [ 94.890989] systemd[1]: nix-grpc-daemon.service: Consumed 107ms CPU time over 3.043s wall clock time, 10.7M memory peak, 6.5K incoming IP traffic, 7.1K outgoing IP traffic.5575worker2 # [ 95.038252] nix-grpc-daemon[996]: ts=2026-09-20T10:50:43Z level=info event=scheduler_connected addr=lb:500515576worker1 # [ 95.071856] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5577worker1 # [ 95.081280] systemd[1]: Starting Nix worker-protocol over gRPC...5578worker1 # [ 95.233612] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5579worker1 # [ 95.236151] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15580worker1 # [ 95.242320] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5581worker1 # [ 95.246056] systemd[1]: Started Nix worker-protocol over gRPC.5582worker1 # [ 95.250531] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15583worker1 # [ 95.258725] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:43Z level=info event=scheduler_connected addr=lb:500515584worker1 # [ 95.260294] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05585lb # [ 98.023716] envoy[918]: conn peer=[2001:db8:1::1]:59778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2934 tx=1371 ms=36165586lb # [ 98.027730] envoy[918]: conn peer=[2001:db8:1::3]:56096 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=744 tx=260 ms=111995587lb # [ 98.031671] envoy[918]: conn peer=[2001:db8:1::3]:35488 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=496 tx=55 ms=28515588client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5589client: waiting for success: ! systemctl is-active mid5590worker2 # [ 100.161271] nix-daemon[807]: reaped child process 1189, status = succeeded5591worker2 # [ 100.305715] nix-daemon[807]: accepted connection from pid 1225, user nix-grpc-daemon (trusted)5592worker2 # [ 100.318808] nix-daemon[807]: reaped child process 1228, status = succeeded5593lb # [ 100.337592] niks3-server[1027]: 2026/09/20 10:50:48 INFO Received uploads request method=POST path=/api/pending_closures5594worker2 # [ 100.346307] nix-grpc-daemon[1017]: time=2026-09-20T10:50:48.575Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5595worker2 # [ 100.348059] nix-grpc-daemon[1017]: time=2026-09-20T10:50:48.577Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5596lb # [ 100.366040] niks3-server[1027]: 2026/09/20 10:50:48 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5597lb # [ 100.369882] niks3-server[1027]: 2026/09/20 10:50:48 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5598lb # [ 100.373607] niks3-server[1027]: 2026/09/20 10:50:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5599lb # [ 100.376945] niks3-server[1027]: 2026/09/20 10:50:48 INFO Signed narinfos id=36 count=15600worker2 # [ 100.375596] nix-grpc-daemon[1017]: time=2026-09-20T10:50:48.604Z level=INFO msg="Uploading 1 narinfos"5601lb # [ 100.381959] niks3-server[1027]: 2026/09/20 10:50:48 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5602lb # [ 100.463707] niks3-server[1027]: 2026/09/20 10:50:48 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5603worker2 # [ 100.471565] nix-grpc-daemon[1017]: time=2026-09-20T10:50:48.700Z level=INFO msg="Upload complete. (317ms)"5604lb # [ 100.473559] niks3-server[1027]: 2026/09/20 10:50:48 INFO Completed upload id=365605worker2 # [ 100.475393] nix-grpc-daemon[996]: ts=2026-09-20T10:50:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15606lb # [ 100.479889] niks3-server[1027]: 2026/09/20 10:50:48 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5607worker2 # [ 100.482447] nix-daemon[807]: reaped child process 1187, status = succeeded5608client # [ 100.507620] systemd[1]: mid.service: Deactivated successfully.5609client # [ 100.509232] systemd[1]: mid.service: Consumed 107ms CPU time over 8.188s wall clock time, 37.1M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.5610client: (finished: waiting for success: ! systemctl is-active mid, in 1.10 seconds)5611client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5612client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5613(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 8.97 seconds)5614subtest: interrupting the client stops the build on the worker5615client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5616client # [ 101.289476] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5617client # Running as unit: intr.service; invocation ID: 88e610a24d924c8e9e26522d19b457505618client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5619client # [ 101.482238] nix[1268]: don't know how to build these paths:5620worker2 # [ 101.485506] nix-grpc-daemon[996]: ts=2026-09-20T10:50:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411505621client # [ 101.483133] nix[1268]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5622worker1 # [ 101.528634] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:50Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05623worker1 # [ 101.534176] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:50Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15624worker1 # [ 101.575696] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345625worker1 # [ 101.586882] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5626worker1 # [ 101.603288] nix-grpc-daemon[1529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5627worker1 # [ 101.613913] nix-grpc-daemon[1529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 172 ms (attempt 2/5)5628worker1 # [ 101.791843] nix-grpc-daemon[1529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 275 ms (attempt 3/5)5629worker1 # [ 102.072703] nix-grpc-daemon[1529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 190 ms (attempt 4/5)5630worker1 # [ 102.262969] nix-grpc-daemon[1529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5631worker1 # [ 102.276281] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565345632client # [ 102.249298] nix[1268]: copying 1 paths to 'lb:50051'...5633worker1 # [ 102.284099] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565345634client # [ 102.252150] nix[1268]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5635worker1 # [ 102.294071] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5636worker1 # [ 102.302477] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:50Z level=info event=niks3_push_started pid=15965637worker1 # [ 102.625286] nix-daemon[843]: accepted connection from pid 1613, user nix-grpc-daemon (trusted)5638worker1 # [ 102.635801] nix-daemon[843]: reaped child process 1616, status = succeeded5639worker1 # [ 102.793935] nix-daemon[843]: accepted connection from pid 1618, user nix-grpc-daemon (trusted)5640worker1 # [ 102.805565] nix-daemon[843]: reaped child process 1621, status = succeeded5641lb # [ 102.792573] niks3-server[1027]: 2026/09/20 10:50:51 INFO Received uploads request method=POST path=/api/pending_closures5642worker1 # [ 102.831660] nix-grpc-daemon[1596]: time=2026-09-20T10:50:51.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5643worker1 # [ 102.834735] nix-grpc-daemon[1596]: time=2026-09-20T10:50:51.394Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5644lb # [ 102.826234] niks3-server[1027]: 2026/09/20 10:50:51 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5645lb # [ 102.835764] niks3-server[1027]: 2026/09/20 10:50:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5646lb # [ 102.840534] niks3-server[1027]: 2026/09/20 10:50:51 INFO Signed narinfos id=37 count=15647worker1 # [ 102.872164] nix-grpc-daemon[1596]: time=2026-09-20T10:50:51.433Z level=INFO msg="Uploading 1 narinfos"5648lb # [ 102.850827] niks3-server[1027]: 2026/09/20 10:50:51 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5649lb # [ 102.859809] niks3-server[1027]: 2026/09/20 10:50:51 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5650lb # [ 102.867367] niks3-server[1027]: 2026/09/20 10:50:51 INFO Completed upload id=375651worker1 # [ 102.895966] nix-grpc-daemon[1596]: time=2026-09-20T10:50:51.457Z level=INFO msg="Upload complete. (419ms)"5652lb # [ 102.870053] niks3-server[1027]: 2026/09/20 10:50:51 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5653worker1 # [ 102.899321] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=4245654worker1 # [ 102.905490] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345655worker1 # [ 102.913040] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5656worker1 # [ 102.917348] nix-daemon[843]: reaped child process 1594, status = succeeded5657client # [ 102.887651] nix[1268]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5658worker1 # [ 102.922295] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5659client: must succeed: systemctl kill -s INT intr5660client # [ 103.677147] systemd[1]: intr.service: Sent signal SIGINT to main process 1268 (nix) on client request.5661client # [ 103.680997] nix[1268]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5662client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5663client # [ 103.688784] nix[1268]: error: interrupted by the user5664worker1 # [ 103.743696] nix-daemon[843]: reaped child process 1623, status = succeeded5665worker1 # [ 103.749282] nix-daemon[1625]: unexpected Nix daemon error: error: interrupted by the user5666client # [ 103.715881] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5667client # [ 103.718121] systemd[1]: intr.service: Failed with result 'exit-code'.5668worker1 # [ 103.753218] nix-daemon[843]: reaped child process 1625, status = failed with exit code 15669client # [ 103.719558] systemd[1]: intr.service: Consumed 100ms CPU time over 2.428s wall clock time, 37.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5670(finished: subtest: interrupting the client stops the build on the worker, in 2.51 seconds)5671subtest: a deploy mid-build drains: the build finishes, the new generation takes over5672client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5673client # [ 103.811146] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5674client # Running as unit: sw.service; invocation ID: d5c3eee53b114263ae88affc82a7a6e15675client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5676worker2 # [ 104.004508] nix-grpc-daemon[996]: ts=2026-09-20T10:50:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411505677client # [ 104.001919] nix[1287]: don't know how to build these paths:5678client # [ 104.002867] nix[1287]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5679worker1 # [ 104.044770] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:52Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05680worker1 # [ 104.048649] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:52Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15681worker2 # [ 104.059149] nix-grpc-daemon[996]: ts=2026-09-20T10:50:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505682worker2 # [ 104.067306] nix-grpc-daemon[996]: ts=2026-09-20T10:50:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411505683client # [ 104.070162] nix[1287]: copying 1 paths to 'lb:50051'...5684worker2 # [ 104.074478] nix-grpc-daemon[996]: ts=2026-09-20T10:50:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411505685client # [ 104.071990] nix[1287]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5686worker2 # [ 104.082807] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5687worker2 # [ 104.252741] nix-daemon[807]: accepted connection from pid 1252, user nix-grpc-daemon (trusted)5688worker2 # [ 104.265811] nix-daemon[807]: reaped child process 1255, status = succeeded5689worker2 # [ 104.430430] nix-daemon[807]: accepted connection from pid 1257, user nix-grpc-daemon (trusted)5690worker2 # [ 104.442398] nix-daemon[807]: reaped child process 1260, status = succeeded5691lb # [ 104.460538] niks3-server[1027]: 2026/09/20 10:50:52 INFO Received uploads request method=POST path=/api/pending_closures5692worker2 # [ 104.466932] nix-grpc-daemon[1017]: time=2026-09-20T10:50:52.695Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5693worker2 # [ 104.468723] nix-grpc-daemon[1017]: time=2026-09-20T10:50:52.697Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5694lb # [ 104.490568] niks3-server[1027]: 2026/09/20 10:50:52 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5695lb # [ 104.504134] niks3-server[1027]: 2026/09/20 10:50:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5696worker2 # [ 104.507590] nix-grpc-daemon[1017]: time=2026-09-20T10:50:52.736Z level=INFO msg="Uploading 1 narinfos"5697lb # [ 104.509634] niks3-server[1027]: 2026/09/20 10:50:52 INFO Signed narinfos id=38 count=15698lb # [ 104.514378] niks3-server[1027]: 2026/09/20 10:50:52 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5699lb # [ 104.526740] niks3-server[1027]: 2026/09/20 10:50:52 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5700lb # [ 104.533135] niks3-server[1027]: 2026/09/20 10:50:52 INFO Completed upload id=385701worker2 # [ 104.531533] nix-grpc-daemon[1017]: time=2026-09-20T10:50:52.760Z level=INFO msg="Upload complete. (442ms)"5702lb # [ 104.535974] niks3-server[1027]: 2026/09/20 10:50:52 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5703worker2 # [ 104.536188] nix-grpc-daemon[996]: ts=2026-09-20T10:50:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=0 paths=1 nar_bytes_in=4165704worker2 # [ 104.541927] nix-grpc-daemon[996]: ts=2026-09-20T10:50:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411505705worker2 # [ 104.550881] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5706worker2 # [ 104.561134] nix-daemon[807]: reaped child process 1250, status = succeeded5707worker2 # [ 104.565765] nix-daemon[807]: accepted connection from pid 996, user nix-grpc-daemon (trusted)5708client # [ 104.560426] nix[1287]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5709worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25710worker2 # Checking switch inhibitors... done5711worker2 # [ 106.900452] nixos[1295]: switching to system configuration /nix/store/2wlzjflm4j959cdjv3m4x4f4rmngdqvs-nixos-system-worker2-test5712worker2 # activating the configuration...5713worker2 # [ 106.905146] systemd[1]: Stopped target Remote File Systems.5714worker2 # [ 106.905968] systemd[1]: Stopped target Local File Systems.5715worker2 # setting up /etc...5716worker2 # [ 107.549046] systemd[1]: Reload requested from client PID 1295 ('.switch-to-conf') (unit backdoor.service)...5717worker2 # [ 107.550609] systemd[1]: Reloading...5718lb # [ 108.024396] envoy[918]: conn peer=[2001:db8:1::1]:59794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=1379 ms=79745719lb # [ 108.028538] envoy[918]: conn peer=[2001:db8:1::1]:35482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=728 ms=22185720worker2 # [ 108.182912] systemd[1]: Reloading finished in 629 ms.5721worker2 # restarting sysinit-reactivation.target5722worker2 # [ 108.236197] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5723worker2 # [ 108.366287] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5724worker2 # [ 108.370971] systemd[1]: Reached target Reactivate sysinit units.5725worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5726worker2 # [ 108.374674] systemd[1]: Reloading D-Bus System Message Bus...5727worker2 # [ 108.376552] dbus-broker-launch[536]: Caught SIGHUP, trigger reload.5728worker2 # [ 108.380342] systemd[1]: Reloading Nix worker-protocol over gRPC...5729worker2 # [ 108.408547] dbus-broker-launch[536]: Looking up NSS user entry for 'systemd-timesync'...5730worker2 # [ 108.412358] dbus-broker-launch[536]: NSS returned no entry for 'systemd-timesync'5731worker2 # [ 108.413792] dbus-broker-launch[536]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5732worker2 # [ 108.424245] systemd[1]: Reloaded Nix worker-protocol over gRPC.5733worker2 # [ 108.443286] systemd[1]: Reloaded D-Bus System Message Bus.5734worker2 # [ 108.449200] systemd[1]: Reached target Remote File Systems.5735worker2 # [ 108.452574] systemd[1]: Starting linger-users.service...5736worker2 # [ 108.456676] systemd[1]: Reached target Local File Systems.5737worker2 # [ 108.458817] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5738worker2 # [ 108.466064] systemd[1]: Starting Create SUID/SGID Wrappers...5739worker2 # [ 108.466842] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5740worker2 # [ 108.470446] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675741worker2 # [ 108.472429] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5742worker2 # [ 108.473806] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5743worker2 # [ 108.474973] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5744worker2 # [ 108.487187] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5745worker2 # [ 108.488415] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5746worker2 # [ 108.523502] systemd[1]: linger-users.service: Deactivated successfully.5747worker2 # [ 108.526754] systemd[1]: Finished linger-users.service.5748worker2 # [ 108.886706] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5749worker2 # [ 108.888278] systemd[1]: Finished Create SUID/SGID Wrappers.5750worker2 # [ 108.966257] nix-grpc-daemon[996]: ts=2026-09-20T10:50:57Z level=info event=draining5751worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5752worker2 # [ 109.143514] nixos[1295]: finished switching to system configuration /nix/store/2wlzjflm4j959cdjv3m4x4f4rmngdqvs-nixos-system-worker2-test5753worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.93 seconds)5754worker2: must succeed: pgrep -f 'read -t [9]0 x'5755worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5756client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25757client # don't know how to build these paths:5758client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5759worker1 # [ 109.446977] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:565345760worker1 # [ 109.453966] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565345761worker1 # [ 109.472737] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05762worker1 # [ 109.478400] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15763worker1 # [ 109.520816] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345764worker1 # [ 109.532539] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565345765client # copying 1 paths to 'lb:50051'...5766worker1 # [ 109.544614] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565345767client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5768worker1 # [ 109.565620] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5769worker1 # [ 109.765639] nix-daemon[843]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)5770worker1 # [ 109.781324] nix-daemon[843]: reaped child process 1674, status = succeeded5771worker1 # [ 109.957528] nix-daemon[843]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)5772worker1 # [ 109.973870] nix-daemon[843]: reaped child process 1679, status = succeeded5773lb # [ 109.959664] niks3-server[1027]: 2026/09/20 10:50:58 INFO Received uploads request method=POST path=/api/pending_closures5774worker1 # [ 109.997291] nix-grpc-daemon[1596]: time=2026-09-20T10:50:58.558Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5775worker1 # [ 109.999403] nix-grpc-daemon[1596]: time=2026-09-20T10:50:58.560Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5776lb # [ 109.990165] niks3-server[1027]: 2026/09/20 10:50:58 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5777lb # [ 109.997262] niks3-server[1027]: 2026/09/20 10:50:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5778worker1 # [ 110.033677] nix-grpc-daemon[1596]: time=2026-09-20T10:50:58.594Z level=INFO msg="Uploading 1 narinfos"5779lb # [ 110.004603] niks3-server[1027]: 2026/09/20 10:50:58 INFO Signed narinfos id=39 count=15780lb # [ 110.011452] niks3-server[1027]: 2026/09/20 10:50:58 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5781lb # [ 110.021569] niks3-server[1027]: 2026/09/20 10:50:58 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5782lb # [ 110.026880] niks3-server[1027]: 2026/09/20 10:50:58 INFO Completed upload id=395783worker1 # [ 110.057573] nix-grpc-daemon[1596]: time=2026-09-20T10:50:58.619Z level=INFO msg="Upload complete. (479ms)"5784lb # [ 110.031330] niks3-server[1027]: 2026/09/20 10:50:58 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5785worker1 # [ 110.060738] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=5285786worker1 # [ 110.066530] nix-grpc-daemon[1529]: ts=2026-09-20T10:50:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345787worker1 # [ 110.077326] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5788worker1 # [ 110.081064] nix-daemon[843]: reaped child process 1669, status = succeeded5789worker1 # [ 110.086590] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5790client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5791client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5792worker1 # [ 111.301319] nix-daemon[843]: reaped child process 1683, status = succeeded5793client # farm-a> LOG-farm-a-during-drain5794worker1 # [ 111.449111] nix-daemon[843]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)5795worker1 # [ 111.460139] nix-daemon[843]: reaped child process 1701, status = succeeded5796lb # [ 111.448407] niks3-server[1027]: 2026/09/20 10:50:59 INFO Received uploads request method=POST path=/api/pending_closures5797worker1 # [ 111.484804] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.046Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5798worker1 # [ 111.486918] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.047Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5799lb # [ 111.492262] niks3-server[1027]: 2026/09/20 10:50:59 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5800lb # [ 111.498823] niks3-server[1027]: 2026/09/20 10:50:59 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5801lb # [ 111.509370] niks3-server[1027]: 2026/09/20 10:50:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5802lb # [ 111.515702] niks3-server[1027]: 2026/09/20 10:50:59 INFO Signed narinfos id=40 count=15803worker1 # [ 111.544657] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.105Z level=INFO msg="Uploading 1 narinfos"5804lb # [ 111.520976] niks3-server[1027]: 2026/09/20 10:50:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5805lb # [ 111.531362] niks3-server[1027]: 2026/09/20 10:50:59 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5806lb # [ 111.534735] niks3-server[1027]: 2026/09/20 10:50:59 INFO Completed upload id=405807lb # [ 111.536244] niks3-server[1027]: 2026/09/20 10:50:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5808worker1 # [ 111.563605] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.124Z level=INFO msg="Upload complete. (269ms)"5809worker1 # [ 111.572782] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=15810worker1 # [ 111.581872] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05811worker1 # [ 111.585984] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15812worker1 # [ 111.595202] nix-daemon[843]: reaped child process 1681, status = succeeded5813worker1 # [ 111.631475] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345814worker1 # [ 111.644390] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565345815worker1 # [ 111.658349] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.219Z level=INFO msg="All 1 paths already cached"5816client # copying 1 paths to 'lb:50051'...5817worker1 # [ 111.666266] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565345818client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5819worker1 # [ 111.685231] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5820worker1 # [ 111.860624] nix-daemon[843]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)5821worker1 # [ 111.873662] nix-daemon[843]: reaped child process 1710, status = succeeded5822worker1 # [ 112.012785] nix-daemon[843]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5823worker1 # [ 112.025750] nix-daemon[843]: reaped child process 1715, status = succeeded5824lb # [ 112.010100] niks3-server[1027]: 2026/09/20 10:51:00 INFO Received uploads request method=POST path=/api/pending_closures5825worker1 # [ 112.043265] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.604Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5826worker1 # [ 112.045155] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.606Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5827lb # [ 112.026643] niks3-server[1027]: 2026/09/20 10:51:00 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5828lb # [ 112.036545] niks3-server[1027]: 2026/09/20 10:51:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5829lb # [ 112.041628] niks3-server[1027]: 2026/09/20 10:51:00 INFO Signed narinfos id=41 count=15830worker1 # [ 112.073694] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.635Z level=INFO msg="Uploading 1 narinfos"5831lb # [ 112.045479] niks3-server[1027]: 2026/09/20 10:51:00 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5832lb # [ 112.051568] niks3-server[1027]: 2026/09/20 10:51:00 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5833lb # [ 112.055771] niks3-server[1027]: 2026/09/20 10:51:00 INFO Completed upload id=415834worker1 # [ 112.084190] nix-grpc-daemon[1596]: time=2026-09-20T10:51:00.645Z level=INFO msg="Upload complete. (387ms)"5835lb # [ 112.057561] niks3-server[1027]: 2026/09/20 10:51:00 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5836worker1 # [ 112.086383] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=6405837worker1 # [ 112.092188] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345838worker1 # [ 112.096158] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5839worker1 # [ 112.098465] nix-daemon[843]: reaped child process 1705, status = succeeded5840worker1 # [ 112.103706] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5841client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5842client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5843client # farm-b> LOG-farm-b-during-drain5844worker1 # [ 112.928731] nix-daemon[843]: reaped child process 1719, status = succeeded5845worker1 # [ 113.088858] nix-daemon[843]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)5846worker1 # [ 113.101324] nix-daemon[843]: reaped child process 1737, status = succeeded5847lb # [ 113.089192] niks3-server[1027]: 2026/09/20 10:51:01 INFO Received uploads request method=POST path=/api/pending_closures5848worker1 # [ 113.125500] nix-grpc-daemon[1596]: time=2026-09-20T10:51:01.686Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5849worker1 # [ 113.126990] nix-grpc-daemon[1596]: time=2026-09-20T10:51:01.688Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5850lb # [ 113.120148] niks3-server[1027]: 2026/09/20 10:51:01 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5851lb # [ 113.131797] niks3-server[1027]: 2026/09/20 10:51:01 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5852lb # [ 113.144619] niks3-server[1027]: 2026/09/20 10:51:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5853lb # [ 113.151107] niks3-server[1027]: 2026/09/20 10:51:01 INFO Signed narinfos id=42 count=15854worker1 # [ 113.182412] nix-grpc-daemon[1596]: time=2026-09-20T10:51:01.743Z level=INFO msg="Uploading 1 narinfos"5855lb # [ 113.153776] niks3-server[1027]: 2026/09/20 10:51:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5856lb # [ 113.165236] niks3-server[1027]: 2026/09/20 10:51:01 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5857lb # [ 113.170808] niks3-server[1027]: 2026/09/20 10:51:01 INFO Completed upload id=425858worker1 # [ 113.199525] nix-grpc-daemon[1596]: time=2026-09-20T10:51:01.760Z level=INFO msg="Upload complete. (289ms)"5859lb # [ 113.173157] niks3-server[1027]: 2026/09/20 10:51:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5860worker1 # [ 113.212813] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=15861worker1 # [ 113.217624] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:01Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05862worker1 # [ 113.220790] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:01Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15863worker1 # [ 113.229644] nix-daemon[843]: reaped child process 1717, status = succeeded5864worker1 # [ 113.255939] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345865worker1 # [ 113.271858] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565345866worker1 # [ 113.284401] nix-grpc-daemon[1596]: time=2026-09-20T10:51:01.845Z level=INFO msg="All 2 paths already cached"5867client # copying 1 paths to 'lb:50051'...5868client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5869worker1 # [ 113.291778] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565345870worker1 # [ 113.303172] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5871worker1 # [ 113.473369] nix-daemon[843]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)5872worker1 # [ 113.485536] nix-daemon[843]: reaped child process 1746, status = succeeded5873worker1 # [ 113.660275] nix-daemon[843]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)5874worker1 # [ 113.672680] nix-daemon[843]: reaped child process 1751, status = succeeded5875lb # [ 113.661240] niks3-server[1027]: 2026/09/20 10:51:02 INFO Received uploads request method=POST path=/api/pending_closures5876worker1 # [ 113.699567] nix-grpc-daemon[1596]: time=2026-09-20T10:51:02.260Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5877worker1 # [ 113.700987] nix-grpc-daemon[1596]: time=2026-09-20T10:51:02.260Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5878lb # [ 113.690247] niks3-server[1027]: 2026/09/20 10:51:02 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5879lb # [ 113.694951] niks3-server[1027]: 2026/09/20 10:51:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5880lb # [ 113.698425] niks3-server[1027]: 2026/09/20 10:51:02 INFO Signed narinfos id=43 count=15881worker1 # [ 113.728822] nix-grpc-daemon[1596]: time=2026-09-20T10:51:02.290Z level=INFO msg="Uploading 1 narinfos"5882lb # [ 113.705325] niks3-server[1027]: 2026/09/20 10:51:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5883lb # [ 113.709733] niks3-server[1027]: 2026/09/20 10:51:02 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5884lb # [ 113.712145] niks3-server[1027]: 2026/09/20 10:51:02 INFO Completed upload id=435885worker1 # [ 113.740554] nix-grpc-daemon[1596]: time=2026-09-20T10:51:02.302Z level=INFO msg="Upload complete. (426ms)"5886worker1 # [ 113.742429] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=7685887lb # [ 113.714413] niks3-server[1027]: 2026/09/20 10:51:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5888worker1 # [ 113.745207] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345889worker1 # [ 113.752117] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5890worker1 # [ 113.754417] nix-daemon[843]: reaped child process 1741, status = succeeded5891client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5892client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5893worker1 # [ 113.759600] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5894client # farm-top> LOG-farm-top-during-drain5895worker1 # [ 115.384274] nix-daemon[843]: reaped child process 1755, status = succeeded5896worker1 # [ 115.534335] nix-daemon[843]: accepted connection from pid 1770, user nix-grpc-daemon (trusted)5897worker1 # [ 115.545114] nix-daemon[843]: reaped child process 1773, status = succeeded5898lb # [ 115.534892] niks3-server[1027]: 2026/09/20 10:51:03 INFO Received uploads request method=POST path=/api/pending_closures5899worker1 # [ 115.568861] nix-grpc-daemon[1596]: time=2026-09-20T10:51:04.130Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5900worker1 # [ 115.570524] nix-grpc-daemon[1596]: time=2026-09-20T10:51:04.131Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5901lb # [ 115.568237] niks3-server[1027]: 2026/09/20 10:51:03 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5902lb # [ 115.579216] niks3-server[1027]: 2026/09/20 10:51:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5903lb # [ 115.587229] niks3-server[1027]: 2026/09/20 10:51:03 INFO Signed narinfos id=44 count=15904worker1 # [ 115.618562] nix-grpc-daemon[1596]: time=2026-09-20T10:51:04.179Z level=INFO msg="Uploading 1 narinfos"5905lb # [ 115.605402] niks3-server[1027]: 2026/09/20 10:51:03 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5906lb # [ 115.608491] niks3-server[1027]: 2026/09/20 10:51:03 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5907lb # [ 115.610273] niks3-server[1027]: 2026/09/20 10:51:03 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5908lb # [ 115.612275] niks3-server[1027]: 2026/09/20 10:51:03 INFO Completed upload id=445909worker1 # [ 115.642465] nix-grpc-daemon[1596]: time=2026-09-20T10:51:04.203Z level=INFO msg="Upload complete. (272ms)"5910worker1 # [ 115.647944] nix-grpc-daemon[1596]: time=2026-09-20T10:51:04.203Z level=WARN msg="Failed to register uploaded object" key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo error="server returned 404: object is not pending upload\n"5911worker1 # [ 115.654788] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=15912worker1 # [ 115.665789] nix-daemon[843]: reaped child process 1753, status = succeeded5913client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.47 seconds)5914client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath5915client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.20 seconds)5916worker2: must succeed: pkill -f 'read -t [9]0 x'5917worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds)5918client: waiting for success: ! systemctl is-active sw5919worker2 # [ 115.990964] nix-daemon[807]: reaped child process 1264, status = succeeded5920worker2 # [ 116.125936] nix-daemon[807]: accepted connection from pid 1435, user nix-grpc-daemon (trusted)5921worker2 # [ 116.138332] nix-daemon[807]: reaped child process 1438, status = succeeded5922lb # [ 116.153507] niks3-server[1027]: 2026/09/20 10:51:04 INFO Received uploads request method=POST path=/api/pending_closures5923worker2 # [ 116.156286] nix-grpc-daemon[1017]: time=2026-09-20T10:51:04.385Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5924worker2 # [ 116.157730] nix-grpc-daemon[1017]: time=2026-09-20T10:51:04.386Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"5925lb # [ 116.173743] niks3-server[1027]: 2026/09/20 10:51:04 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5926lb # [ 116.181166] niks3-server[1027]: 2026/09/20 10:51:04 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5927lb # [ 116.184060] niks3-server[1027]: 2026/09/20 10:51:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5928lb # [ 116.186959] niks3-server[1027]: 2026/09/20 10:51:04 INFO Signed narinfos id=45 count=15929worker2 # [ 116.185551] nix-grpc-daemon[1017]: time=2026-09-20T10:51:04.414Z level=INFO msg="Uploading 1 narinfos"5930lb # [ 116.188390] niks3-server[1027]: 2026/09/20 10:51:04 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls5931lb # [ 116.194523] niks3-server[1027]: 2026/09/20 10:51:04 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5932lb # [ 116.197554] niks3-server[1027]: 2026/09/20 10:51:04 INFO Completed upload id=455933worker2 # [ 116.197233] nix-grpc-daemon[1017]: time=2026-09-20T10:51:04.426Z level=INFO msg="Upload complete. (213ms)"5934lb # [ 116.199039] niks3-server[1027]: 2026/09/20 10:51:04 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo5935worker2 # [ 116.201144] nix-grpc-daemon[996]: ts=2026-09-20T10:51:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41150 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=15936worker2 # [ 116.206532] nix-daemon[807]: reaped child process 1262, status = succeeded5937client # [ 116.234527] systemd[1]: sw.service: Deactivated successfully.5938client # [ 116.238214] systemd[1]: sw.service: Consumed 112ms CPU time over 12.422s wall clock time, 39.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.5939worker2 # [ 116.966942] nix-grpc-daemon[996]: ts=2026-09-20T10:51:05Z level=info event=signal_exit5940worker1 # [ 117.004625] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:565005941worker1 # [ 117.008473] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:05Z level=info event=worker_gone addr=192.168.1.4:500515942worker2 # [ 116.979616] nix-grpc-daemon[996]: ts=2026-09-20T10:51:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5943client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)5944client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5945worker2 # [ 117.000740] nix-daemon[807]: reaped child process 1010, status = succeeded5946client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)5947worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5948worker2 # [ 117.048475] nix-grpc-daemon[996]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5949worker2 # [ 117.051875] nix-grpc-daemon[996]: E0000 00:00:1789901465.277525 1007 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5950worker2 # [ 118.006336] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5951worker2 # [ 118.008304] systemd[1]: nix-grpc-daemon.service: Consumed 1.570s CPU time over 50.211s wall clock time, 32.6M memory peak, 65.5K incoming IP traffic, 106.4K outgoing IP traffic.5952worker2 # [ 118.015121] systemd[1]: Starting Nix worker-protocol over gRPC...5953lb # [ 118.024905] envoy[918]: conn peer=[2001:db8:1::1]:38708 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9572 tx=3799 ms=62255954lb # [ 118.029354] envoy[918]: conn peer=[2001:db8:1::1]:38694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1333 ms=122075955lb # [ 118.033388] envoy[918]: conn peer=[2001:db8:1::4]:40126 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9582 tx=2180 ms=490155956worker2 # [ 118.162345] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5957worker2 # [ 118.164301] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:06Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15958worker2 # [ 118.170484] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5959worker2 # [ 118.172294] systemd[1]: Started Nix worker-protocol over gRPC.5960worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.16 seconds)5961lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5962lb: must succeed: curl -sf localhost:9901/clusters5963worker2 # [ 118.191107] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500515964worker1 # [ 118.225409] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05965lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5966lb: must succeed: curl -sf localhost:9901/clusters5967lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5968lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5969worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5970worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5971(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.59 seconds)5972subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5973client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15974worker1 # [ 119.625684] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:565345975worker2 # [ 119.608375] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591665976worker2 # [ 119.619119] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)5977worker2 # [ 119.635488] nix-grpc-daemon[1452]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)5978worker2 # [ 119.664354] nix-grpc-daemon[1452]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 2/5)5979worker2 # [ 119.856946] nix-grpc-daemon[1452]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 297 ms (attempt 3/5)5980worker2 # [ 120.157023] nix-grpc-daemon[1452]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 314 ms (attempt 4/5)5981worker2 # [ 120.476484] nix-grpc-daemon[1452]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5982worker1 # [ 120.549620] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=05983worker1 # [ 120.552139] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=15984worker1 # [ 120.553984] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=05985worker1 # [ 120.555593] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=05986worker1 # [ 120.593627] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565345987worker1 # [ 120.601555] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565345988worker1 # [ 120.608601] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565345989worker1 # [ 120.613882] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5990worker1 # [ 120.761144] nix-daemon[843]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)5991worker1 # [ 120.773110] nix-daemon[843]: reaped child process 1785, status = succeeded5992worker1 # [ 120.936936] nix-daemon[843]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)5993worker1 # [ 120.949069] nix-daemon[843]: reaped child process 1790, status = succeeded5994lb # [ 120.935412] niks3-server[1027]: 2026/09/20 10:51:09 INFO Received uploads request method=POST path=/api/pending_closures5995worker1 # [ 120.972551] nix-grpc-daemon[1596]: time=2026-09-20T10:51:09.533Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5996worker1 # [ 120.973956] nix-grpc-daemon[1596]: time=2026-09-20T10:51:09.533Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"5997lb # [ 120.968102] niks3-server[1027]: 2026/09/20 10:51:09 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst5998lb # [ 120.973293] niks3-server[1027]: 2026/09/20 10:51:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5999lb # [ 120.978551] niks3-server[1027]: 2026/09/20 10:51:09 INFO Signed narinfos id=46 count=16000worker1 # [ 121.010617] nix-grpc-daemon[1596]: time=2026-09-20T10:51:09.572Z level=INFO msg="Uploading 1 narinfos"6001lb # [ 120.991594] niks3-server[1027]: 2026/09/20 10:51:09 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6002lb # [ 120.999408] niks3-server[1027]: 2026/09/20 10:51:09 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6003worker1 # [ 121.039397] nix-grpc-daemon[1596]: time=2026-09-20T10:51:09.600Z level=INFO msg="Upload complete. (420ms)"6004lb # [ 121.011311] niks3-server[1027]: 2026/09/20 10:51:09 INFO Completed upload id=466005worker1 # [ 121.042325] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=5046006lb # [ 121.014740] niks3-server[1027]: 2026/09/20 10:51:09 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6007worker1 # [ 121.047465] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346008worker1 # [ 121.052264] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6009worker1 # [ 121.054697] nix-daemon[843]: reaped child process 1780, status = succeeded6010worker1 # [ 121.060077] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6011worker1 # [ 122.074441] nix-daemon[843]: reaped child process 1794, status = succeeded6012worker1 # [ 122.235358] nix-daemon[843]: accepted connection from pid 1809, user nix-grpc-daemon (trusted)6013worker1 # [ 122.246453] nix-daemon[843]: reaped child process 1812, status = succeeded6014lb # [ 122.236495] niks3-server[1027]: 2026/09/20 10:51:10 INFO Received uploads request method=POST path=/api/pending_closures6015worker1 # [ 122.272938] nix-grpc-daemon[1596]: time=2026-09-20T10:51:10.834Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6016worker1 # [ 122.274559] nix-grpc-daemon[1596]: time=2026-09-20T10:51:10.835Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6017lb # [ 122.274686] niks3-server[1027]: 2026/09/20 10:51:10 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6018lb # [ 122.281871] niks3-server[1027]: 2026/09/20 10:51:10 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6019lb # [ 122.293995] niks3-server[1027]: 2026/09/20 10:51:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6020worker1 # [ 122.327315] nix-grpc-daemon[1596]: time=2026-09-20T10:51:10.888Z level=INFO msg="Uploading 1 narinfos"6021lb # [ 122.298577] niks3-server[1027]: 2026/09/20 10:51:10 INFO Signed narinfos id=47 count=16022lb # [ 122.308374] niks3-server[1027]: 2026/09/20 10:51:10 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6023lb # [ 122.314378] niks3-server[1027]: 2026/09/20 10:51:10 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6024lb # [ 122.317987] niks3-server[1027]: 2026/09/20 10:51:10 INFO Completed upload id=476025worker1 # [ 122.348529] nix-grpc-daemon[1596]: time=2026-09-20T10:51:10.910Z level=INFO msg="Upload complete. (281ms)"6026worker1 # [ 122.351582] nix-grpc-daemon[1596]: time=2026-09-20T10:51:10.911Z level=WARN msg="Failed to register uploaded object" key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo error="server returned 404: object is not pending upload\n"6027worker1 # [ 122.356299] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=16028worker1 # [ 122.359233] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:10Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16029worker1 # [ 122.361567] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346030worker1 # [ 122.364133] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:10Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06031worker1 # [ 122.369431] nix-daemon[843]: reaped child process 1792, status = succeeded6032worker1 # [ 122.370720] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346033worker1 # [ 122.377499] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346034worker1 # [ 122.382388] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6035worker1 # [ 122.546546] nix-daemon[843]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6036worker1 # [ 122.558694] nix-daemon[843]: reaped child process 1821, status = succeeded6037worker1 # [ 122.730228] nix-daemon[843]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)6038worker1 # [ 122.742655] nix-daemon[843]: reaped child process 1826, status = succeeded6039lb # [ 122.730728] niks3-server[1027]: 2026/09/20 10:51:11 INFO Received uploads request method=POST path=/api/pending_closures6040worker1 # [ 122.768317] nix-grpc-daemon[1596]: time=2026-09-20T10:51:11.329Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6041worker1 # [ 122.769792] nix-grpc-daemon[1596]: time=2026-09-20T10:51:11.329Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6042lb # [ 122.759234] niks3-server[1027]: 2026/09/20 10:51:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6043lb # [ 122.764505] niks3-server[1027]: 2026/09/20 10:51:11 INFO Signed narinfos id=48 count=16044worker1 # [ 122.796404] nix-grpc-daemon[1596]: time=2026-09-20T10:51:11.357Z level=INFO msg="Uploading 1 narinfos"6045lb # [ 122.776146] niks3-server[1027]: 2026/09/20 10:51:11 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6046lb # [ 122.788373] niks3-server[1027]: 2026/09/20 10:51:11 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6047lb # [ 122.796475] niks3-server[1027]: 2026/09/20 10:51:11 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6048lb # [ 122.804803] niks3-server[1027]: 2026/09/20 10:51:11 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6049lb # [ 122.810564] niks3-server[1027]: 2026/09/20 10:51:11 INFO Completed upload id=486050worker1 # [ 122.839229] nix-grpc-daemon[1596]: time=2026-09-20T10:51:11.400Z level=INFO msg="Upload complete. (451ms)"6051worker1 # [ 122.843354] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=5046052worker1 # [ 122.849383] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346053worker1 # [ 122.860106] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6054worker1 # [ 122.871963] nix-daemon[843]: reaped child process 1816, status = succeeded6055worker1 # [ 122.874975] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6056worker1 # [ 124.500779] nix-daemon[843]: reaped child process 1830, status = succeeded6057worker1 # [ 124.664713] nix-daemon[843]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)6058worker1 # [ 124.675239] nix-daemon[843]: reaped child process 1848, status = succeeded6059lb # [ 124.663476] niks3-server[1027]: 2026/09/20 10:51:13 INFO Received uploads request method=POST path=/api/pending_closures6060worker1 # [ 124.699772] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.261Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6061worker1 # [ 124.701317] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.262Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6062lb # [ 124.704350] niks3-server[1027]: 2026/09/20 10:51:13 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6063lb # [ 124.712559] niks3-server[1027]: 2026/09/20 10:51:13 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6064lb # [ 124.719981] niks3-server[1027]: 2026/09/20 10:51:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6065lb # [ 124.726705] niks3-server[1027]: 2026/09/20 10:51:13 INFO Signed narinfos id=49 count=16066worker1 # [ 124.755431] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.316Z level=INFO msg="Uploading 1 narinfos"6067lb # [ 124.736824] niks3-server[1027]: 2026/09/20 10:51:13 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6068lb # [ 124.744364] niks3-server[1027]: 2026/09/20 10:51:13 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6069lb # [ 124.749386] niks3-server[1027]: 2026/09/20 10:51:13 INFO Completed upload id=496070worker1 # [ 124.778097] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.339Z level=INFO msg="Upload complete. (294ms)"6071lb # [ 124.751207] niks3-server[1027]: 2026/09/20 10:51:13 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6072worker1 # [ 124.788568] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16073worker1 # [ 124.793218] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16074worker1 # [ 124.797936] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346075worker1 # [ 124.801330] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06076worker1 # [ 124.809079] nix-daemon[843]: reaped child process 1828, status = succeeded6077worker1 # [ 124.810899] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346078worker1 # [ 124.817698] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346079worker1 # [ 124.822366] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6080worker1 # [ 124.977433] nix-daemon[843]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6081worker1 # [ 124.989504] nix-daemon[843]: reaped child process 1857, status = succeeded6082worker1 # [ 125.145069] nix-daemon[843]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6083worker1 # [ 125.157478] nix-daemon[843]: reaped child process 1862, status = succeeded6084lb # [ 125.144515] niks3-server[1027]: 2026/09/20 10:51:13 INFO Received uploads request method=POST path=/api/pending_closures6085worker1 # [ 125.177724] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.739Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6086worker1 # [ 125.179238] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.740Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6087lb # [ 125.162092] niks3-server[1027]: 2026/09/20 10:51:13 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6088lb # [ 125.166262] niks3-server[1027]: 2026/09/20 10:51:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6089lb # [ 125.168525] niks3-server[1027]: 2026/09/20 10:51:13 INFO Signed narinfos id=50 count=16090worker1 # [ 125.198472] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.760Z level=INFO msg="Uploading 1 narinfos"6091lb # [ 125.172836] niks3-server[1027]: 2026/09/20 10:51:13 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6092lb # [ 125.179712] niks3-server[1027]: 2026/09/20 10:51:13 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6093worker1 # [ 125.211261] nix-grpc-daemon[1596]: time=2026-09-20T10:51:13.772Z level=INFO msg="Upload complete. (384ms)"6094lb # [ 125.182964] niks3-server[1027]: 2026/09/20 10:51:13 INFO Completed upload id=506095worker1 # [ 125.212663] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=5046096lb # [ 125.184889] niks3-server[1027]: 2026/09/20 10:51:13 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6097worker1 # [ 125.217573] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346098worker1 # [ 125.223160] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6099worker1 # [ 125.225479] nix-daemon[843]: reaped child process 1852, status = succeeded6100worker1 # [ 125.230791] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6101worker1 # [ 126.444184] nix-daemon[843]: reaped child process 1866, status = succeeded6102worker1 # [ 126.584556] nix-daemon[843]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6103worker1 # [ 126.596474] nix-daemon[843]: reaped child process 1884, status = succeeded6104lb # [ 126.582969] niks3-server[1027]: 2026/09/20 10:51:14 INFO Received uploads request method=POST path=/api/pending_closures6105worker1 # [ 126.617077] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.177Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6106worker1 # [ 126.618465] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.177Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6107lb # [ 126.603657] niks3-server[1027]: 2026/09/20 10:51:14 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6108lb # [ 126.606910] niks3-server[1027]: 2026/09/20 10:51:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6109lb # [ 126.609189] niks3-server[1027]: 2026/09/20 10:51:14 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6110lb # [ 126.611930] niks3-server[1027]: 2026/09/20 10:51:14 INFO Signed narinfos id=51 count=16111worker1 # [ 126.642049] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.203Z level=INFO msg="Uploading 1 narinfos"6112lb # [ 126.616335] niks3-server[1027]: 2026/09/20 10:51:14 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6113lb # [ 126.622204] niks3-server[1027]: 2026/09/20 10:51:14 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6114lb # [ 126.625535] niks3-server[1027]: 2026/09/20 10:51:14 INFO Completed upload id=516115worker1 # [ 126.654087] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.215Z level=INFO msg="Upload complete. (216ms)"6116lb # [ 126.628487] niks3-server[1027]: 2026/09/20 10:51:14 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6117worker1 # [ 126.658323] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16118worker1 # [ 126.661610] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16119worker1 # [ 126.664145] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346120worker1 # [ 126.669325] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06121worker1 # [ 126.672302] nix-daemon[843]: reaped child process 1864, status = succeeded6122worker1 # [ 126.703982] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346123worker1 # [ 126.710268] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.271Z level=INFO msg="All 1 paths already cached"6124worker1 # [ 126.713940] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346125worker1 # [ 126.718843] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6126worker1 # [ 126.869298] nix-daemon[843]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)6127worker1 # [ 126.882421] nix-daemon[843]: reaped child process 1893, status = succeeded6128worker1 # [ 127.035789] nix-daemon[843]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6129worker1 # [ 127.047531] nix-daemon[843]: reaped child process 1898, status = succeeded6130lb # [ 127.034178] niks3-server[1027]: 2026/09/20 10:51:15 INFO Received uploads request method=POST path=/api/pending_closures6131worker1 # [ 127.067804] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.629Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6132worker1 # [ 127.069206] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.629Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6133lb # [ 127.049714] niks3-server[1027]: 2026/09/20 10:51:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6134lb # [ 127.053160] niks3-server[1027]: 2026/09/20 10:51:15 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6135lb # [ 127.056730] niks3-server[1027]: 2026/09/20 10:51:15 INFO Signed narinfos id=52 count=16136worker1 # [ 127.085402] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.646Z level=INFO msg="Uploading 1 narinfos"6137lb # [ 127.060300] niks3-server[1027]: 2026/09/20 10:51:15 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6138lb # [ 127.066265] niks3-server[1027]: 2026/09/20 10:51:15 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6139lb # [ 127.070261] niks3-server[1027]: 2026/09/20 10:51:15 INFO Completed upload id=526140worker1 # [ 127.098763] nix-grpc-daemon[1596]: time=2026-09-20T10:51:15.660Z level=INFO msg="Upload complete. (375ms)"6141worker1 # [ 127.100652] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=6246142lb # [ 127.072688] niks3-server[1027]: 2026/09/20 10:51:15 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6143worker1 # [ 127.105185] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346144worker1 # [ 127.110278] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6145worker1 # [ 127.112593] nix-daemon[843]: reaped child process 1888, status = succeeded6146worker1 # [ 127.117760] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6147worker1 # [ 128.131184] nix-daemon[843]: reaped child process 1902, status = succeeded6148worker1 # [ 128.264473] nix-daemon[843]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)6149worker1 # [ 128.276750] nix-daemon[843]: reaped child process 1920, status = succeeded6150lb # [ 128.264869] niks3-server[1027]: 2026/09/20 10:51:16 INFO Received uploads request method=POST path=/api/pending_closures6151worker1 # [ 128.301240] nix-grpc-daemon[1596]: time=2026-09-20T10:51:16.862Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6152worker1 # [ 128.302711] nix-grpc-daemon[1596]: time=2026-09-20T10:51:16.864Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6153lb # [ 128.302573] niks3-server[1027]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6154lb # [ 128.312863] niks3-server[1027]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6155lb # [ 128.324166] niks3-server[1027]: 2026/09/20 10:51:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6156lb # [ 128.327813] niks3-server[1027]: 2026/09/20 10:51:16 INFO Signed narinfos id=53 count=16157worker1 # [ 128.356796] nix-grpc-daemon[1596]: time=2026-09-20T10:51:16.918Z level=INFO msg="Uploading 1 narinfos"6158lb # [ 128.330152] niks3-server[1027]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6159lb # [ 128.338263] niks3-server[1027]: 2026/09/20 10:51:16 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6160lb # [ 128.341585] niks3-server[1027]: 2026/09/20 10:51:16 INFO Completed upload id=536161worker1 # [ 128.370248] nix-grpc-daemon[1596]: time=2026-09-20T10:51:16.931Z level=INFO msg="Upload complete. (245ms)"6162lb # [ 128.343246] niks3-server[1027]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6163worker1 # [ 128.376527] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16164worker1 # [ 128.383511] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:16Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16165worker1 # [ 128.389622] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346166worker1 # [ 128.392953] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:16Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06167worker1 # [ 128.399962] nix-daemon[843]: reaped child process 1900, status = succeeded6168worker1 # [ 128.401845] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346169worker1 # [ 128.407907] nix-grpc-daemon[1596]: time=2026-09-20T10:51:16.969Z level=INFO msg="All 1 paths already cached"6170worker1 # [ 128.411752] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346171worker1 # [ 128.416432] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6172worker1 # [ 128.552047] nix-daemon[843]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)6173worker1 # [ 128.564253] nix-daemon[843]: reaped child process 1929, status = succeeded6174worker1 # [ 128.721935] nix-daemon[843]: accepted connection from pid 1931, user nix-grpc-daemon (trusted)6175worker1 # [ 128.733218] nix-daemon[843]: reaped child process 1934, status = succeeded6176lb # [ 128.719233] niks3-server[1027]: 2026/09/20 10:51:17 INFO Received uploads request method=POST path=/api/pending_closures6177worker1 # [ 128.752366] nix-grpc-daemon[1596]: time=2026-09-20T10:51:17.313Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6178worker1 # [ 128.753837] nix-grpc-daemon[1596]: time=2026-09-20T10:51:17.315Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6179lb # [ 128.747204] niks3-server[1027]: 2026/09/20 10:51:17 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6180lb # [ 128.757060] niks3-server[1027]: 2026/09/20 10:51:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6181lb # [ 128.762064] niks3-server[1027]: 2026/09/20 10:51:17 INFO Signed narinfos id=54 count=16182worker1 # [ 128.793625] nix-grpc-daemon[1596]: time=2026-09-20T10:51:17.355Z level=INFO msg="Uploading 1 narinfos"6183lb # [ 128.768248] niks3-server[1027]: 2026/09/20 10:51:17 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6184lb # [ 128.777516] niks3-server[1027]: 2026/09/20 10:51:17 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6185lb # [ 128.784257] niks3-server[1027]: 2026/09/20 10:51:17 INFO Completed upload id=546186worker1 # [ 128.812988] nix-grpc-daemon[1596]: time=2026-09-20T10:51:17.374Z level=INFO msg="Upload complete. (392ms)"6187worker1 # [ 128.816071] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=6246188lb # [ 128.788971] niks3-server[1027]: 2026/09/20 10:51:17 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6189worker1 # [ 128.821284] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346190worker1 # [ 128.828136] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6191worker1 # [ 128.830376] nix-daemon[843]: reaped child process 1924, status = succeeded6192worker1 # [ 128.835527] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6193worker1 # [ 129.860396] nix-daemon[843]: reaped child process 1938, status = succeeded6194worker1 # [ 130.022762] nix-daemon[843]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6195worker1 # [ 130.033974] nix-daemon[843]: reaped child process 1956, status = succeeded6196lb # [ 130.021807] niks3-server[1027]: 2026/09/20 10:51:18 INFO Received uploads request method=POST path=/api/pending_closures6197worker1 # [ 130.058873] nix-grpc-daemon[1596]: time=2026-09-20T10:51:18.620Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6198worker1 # [ 130.060546] nix-grpc-daemon[1596]: time=2026-09-20T10:51:18.621Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6199lb # [ 130.063224] niks3-server[1027]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6200lb # [ 130.067907] niks3-server[1027]: 2026/09/20 10:51:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6201lb # [ 130.073085] niks3-server[1027]: 2026/09/20 10:51:18 INFO Signed narinfos id=55 count=16202worker1 # [ 130.105079] nix-grpc-daemon[1596]: time=2026-09-20T10:51:18.666Z level=INFO msg="Uploading 1 narinfos"6203lb # [ 130.080394] niks3-server[1027]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6204lb # [ 130.091683] niks3-server[1027]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6205lb # [ 130.098542] niks3-server[1027]: 2026/09/20 10:51:18 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6206lb # [ 130.104979] niks3-server[1027]: 2026/09/20 10:51:18 INFO Completed upload id=556207worker1 # [ 130.133711] nix-grpc-daemon[1596]: time=2026-09-20T10:51:18.695Z level=INFO msg="Upload complete. (290ms)"6208lb # [ 130.106697] niks3-server[1027]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6209worker1 # [ 130.145074] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:18Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16210worker1 # [ 130.149806] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16211worker1 # [ 130.155280] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346212worker1 # [ 130.158404] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:18Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06213worker1 # [ 130.167340] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346214worker1 # [ 130.169953] nix-daemon[843]: reaped child process 1936, status = succeeded6215worker1 # [ 130.174790] nix-grpc-daemon[1596]: time=2026-09-20T10:51:18.736Z level=INFO msg="All 1 paths already cached"6216worker1 # [ 130.179283] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346217worker1 # [ 130.183950] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6218worker1 # [ 130.345216] nix-daemon[843]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)6219worker1 # [ 130.357448] nix-daemon[843]: reaped child process 1965, status = succeeded6220worker1 # [ 130.514460] nix-daemon[843]: accepted connection from pid 1967, user nix-grpc-daemon (trusted)6221worker1 # [ 130.526291] nix-daemon[843]: reaped child process 1970, status = succeeded6222lb # [ 130.512723] niks3-server[1027]: 2026/09/20 10:51:18 INFO Received uploads request method=POST path=/api/pending_closures6223worker1 # [ 130.549217] nix-grpc-daemon[1596]: time=2026-09-20T10:51:19.110Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6224worker1 # [ 130.550551] nix-grpc-daemon[1596]: time=2026-09-20T10:51:19.110Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6225lb # [ 130.538187] niks3-server[1027]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6226lb # [ 130.549865] niks3-server[1027]: 2026/09/20 10:51:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6227worker1 # [ 130.583448] nix-grpc-daemon[1596]: time=2026-09-20T10:51:19.144Z level=INFO msg="Uploading 1 narinfos"6228lb # [ 130.555125] niks3-server[1027]: 2026/09/20 10:51:18 INFO Signed narinfos id=56 count=16229lb # [ 130.561352] niks3-server[1027]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6230lb # [ 130.573963] niks3-server[1027]: 2026/09/20 10:51:18 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6231lb # [ 130.586578] niks3-server[1027]: 2026/09/20 10:51:18 INFO Completed upload id=566232worker1 # [ 130.615241] nix-grpc-daemon[1596]: time=2026-09-20T10:51:19.176Z level=INFO msg="Upload complete. (426ms)"6233lb # [ 130.589310] niks3-server[1027]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6234worker1 # [ 130.618975] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=6246235worker1 # [ 130.624526] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346236worker1 # [ 130.634111] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6237worker1 # [ 130.641537] nix-daemon[843]: reaped child process 1960, status = succeeded6238worker1 # [ 130.646410] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6239worker1 # [ 131.466975] nix-daemon[843]: reaped child process 1974, status = succeeded6240worker1 # [ 131.604538] nix-daemon[843]: accepted connection from pid 1989, user nix-grpc-daemon (trusted)6241worker1 # [ 131.616546] nix-daemon[843]: reaped child process 1992, status = succeeded6242lb # [ 131.603311] niks3-server[1027]: 2026/09/20 10:51:19 INFO Received uploads request method=POST path=/api/pending_closures6243worker1 # [ 131.635816] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.197Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6244worker1 # [ 131.637392] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.198Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6245lb # [ 131.621725] niks3-server[1027]: 2026/09/20 10:51:19 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6246lb # [ 131.630326] niks3-server[1027]: 2026/09/20 10:51:19 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6247lb # [ 131.633772] niks3-server[1027]: 2026/09/20 10:51:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6248lb # [ 131.638764] niks3-server[1027]: 2026/09/20 10:51:19 INFO Signed narinfos id=57 count=16249worker1 # [ 131.669611] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.231Z level=INFO msg="Uploading 1 narinfos"6250lb # [ 131.643455] niks3-server[1027]: 2026/09/20 10:51:19 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6251lb # [ 131.649051] niks3-server[1027]: 2026/09/20 10:51:19 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6252lb # [ 131.652142] niks3-server[1027]: 2026/09/20 10:51:19 INFO Completed upload id=576253worker1 # [ 131.681829] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.243Z level=INFO msg="Upload complete. (228ms)"6254lb # [ 131.653659] niks3-server[1027]: 2026/09/20 10:51:19 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6255worker1 # [ 131.685818] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16256worker1 # [ 131.689424] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16257worker1 # [ 131.691854] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346258worker1 # [ 131.698304] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06259worker1 # [ 131.700895] nix-daemon[843]: reaped child process 1972, status = succeeded6260worker1 # [ 131.702653] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346261worker1 # [ 131.708939] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.270Z level=INFO msg="All 2 paths already cached"6262worker1 # [ 131.712396] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346263worker1 # [ 131.716068] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6264worker1 # [ 131.876655] nix-daemon[843]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)6265worker1 # [ 131.890649] nix-daemon[843]: reaped child process 2001, status = succeeded6266worker1 # [ 132.054591] nix-daemon[843]: accepted connection from pid 2003, user nix-grpc-daemon (trusted)6267worker1 # [ 132.066669] nix-daemon[843]: reaped child process 2006, status = succeeded6268lb # [ 132.054309] niks3-server[1027]: 2026/09/20 10:51:20 INFO Received uploads request method=POST path=/api/pending_closures6269worker1 # [ 132.090706] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.651Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6270worker1 # [ 132.092128] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.651Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6271lb # [ 132.078654] niks3-server[1027]: 2026/09/20 10:51:20 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6272lb # [ 132.089967] niks3-server[1027]: 2026/09/20 10:51:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6273worker1 # [ 132.123112] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.684Z level=INFO msg="Uploading 1 narinfos"6274lb # [ 132.094987] niks3-server[1027]: 2026/09/20 10:51:20 INFO Signed narinfos id=58 count=16275lb # [ 132.101357] niks3-server[1027]: 2026/09/20 10:51:20 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6276lb # [ 132.111749] niks3-server[1027]: 2026/09/20 10:51:20 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6277lb # [ 132.117734] niks3-server[1027]: 2026/09/20 10:51:20 INFO Completed upload id=586278worker1 # [ 132.146303] nix-grpc-daemon[1596]: time=2026-09-20T10:51:20.707Z level=INFO msg="Upload complete. (423ms)"6279lb # [ 132.120766] niks3-server[1027]: 2026/09/20 10:51:20 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6280worker1 # [ 132.150106] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=7526281worker1 # [ 132.154625] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346282worker1 # [ 132.160235] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6283worker1 # [ 132.162514] nix-daemon[843]: reaped child process 1996, status = succeeded6284worker1 # [ 132.167711] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6285worker1 # [ 133.181264] nix-daemon[843]: reaped child process 2010, status = succeeded6286worker1 # [ 133.323882] nix-daemon[843]: accepted connection from pid 2025, user nix-grpc-daemon (trusted)6287worker1 # [ 133.336271] nix-daemon[843]: reaped child process 2028, status = succeeded6288lb # [ 133.325760] niks3-server[1027]: 2026/09/20 10:51:21 INFO Received uploads request method=POST path=/api/pending_closures6289worker1 # [ 133.364607] nix-grpc-daemon[1596]: time=2026-09-20T10:51:21.925Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6290worker1 # [ 133.366152] nix-grpc-daemon[1596]: time=2026-09-20T10:51:21.925Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6291lb # [ 133.367428] niks3-server[1027]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6292lb # [ 133.373846] niks3-server[1027]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6293lb # [ 133.385128] niks3-server[1027]: 2026/09/20 10:51:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6294worker1 # [ 133.417837] nix-grpc-daemon[1596]: time=2026-09-20T10:51:21.979Z level=INFO msg="Uploading 1 narinfos"6295lb # [ 133.389520] niks3-server[1027]: 2026/09/20 10:51:21 INFO Signed narinfos id=59 count=16296lb # [ 133.395275] niks3-server[1027]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6297lb # [ 133.400375] niks3-server[1027]: 2026/09/20 10:51:21 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6298lb # [ 133.403087] niks3-server[1027]: 2026/09/20 10:51:21 INFO Completed upload id=596299worker1 # [ 133.431573] nix-grpc-daemon[1596]: time=2026-09-20T10:51:21.993Z level=INFO msg="Upload complete. (257ms)"6300lb # [ 133.404708] niks3-server[1027]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6301worker1 # [ 133.434919] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16302worker1 # [ 133.439733] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:21Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16303worker1 # [ 133.445840] nix-daemon[843]: reaped child process 2008, status = succeeded6304worker1 # [ 133.481989] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346305worker1 # [ 133.491835] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346306worker1 # [ 133.502608] nix-grpc-daemon[1596]: time=2026-09-20T10:51:22.064Z level=INFO msg="All 2 paths already cached"6307worker1 # [ 133.508695] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346308worker1 # [ 133.518106] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6309worker1 # [ 133.684041] nix-daemon[843]: accepted connection from pid 2032, user nix-grpc-daemon (trusted)6310worker1 # [ 133.696617] nix-daemon[843]: reaped child process 2035, status = succeeded6311worker1 # [ 133.852390] nix-daemon[843]: accepted connection from pid 2037, user nix-grpc-daemon (trusted)6312worker1 # [ 133.864171] nix-daemon[843]: reaped child process 2040, status = succeeded6313lb # [ 133.849232] niks3-server[1027]: 2026/09/20 10:51:22 INFO Received uploads request method=POST path=/api/pending_closures6314worker1 # [ 133.882299] nix-grpc-daemon[1596]: time=2026-09-20T10:51:22.443Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6315worker1 # [ 133.883761] nix-grpc-daemon[1596]: time=2026-09-20T10:51:22.445Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6316lb # [ 133.866434] niks3-server[1027]: 2026/09/20 10:51:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6317lb # [ 133.869359] niks3-server[1027]: 2026/09/20 10:51:22 INFO Signed narinfos id=60 count=16318worker1 # [ 133.897695] nix-grpc-daemon[1596]: time=2026-09-20T10:51:22.459Z level=INFO msg="Uploading 1 narinfos"6319lb # [ 133.871653] niks3-server[1027]: 2026/09/20 10:51:22 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6320lb # [ 133.875485] niks3-server[1027]: 2026/09/20 10:51:22 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6321lb # [ 133.879666] niks3-server[1027]: 2026/09/20 10:51:22 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6322lb # [ 133.882591] niks3-server[1027]: 2026/09/20 10:51:22 INFO Completed upload id=606323worker1 # [ 133.912139] nix-grpc-daemon[1596]: time=2026-09-20T10:51:22.473Z level=INFO msg="Upload complete. (384ms)"6324lb # [ 133.884399] niks3-server[1027]: 2026/09/20 10:51:22 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6325worker1 # [ 133.914140] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=7526326worker1 # [ 133.917079] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346327worker1 # [ 133.921253] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6328worker1 # [ 133.926579] nix-daemon[843]: reaped child process 2030, status = succeeded6329worker1 # [ 133.931669] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6330worker1 # [ 135.156766] nix-daemon[843]: reaped child process 2044, status = succeeded6331worker1 # [ 135.294268] nix-daemon[843]: accepted connection from pid 2059, user nix-grpc-daemon (trusted)6332worker1 # [ 135.306201] nix-daemon[843]: reaped child process 2062, status = succeeded6333lb # [ 135.291340] niks3-server[1027]: 2026/09/20 10:51:23 INFO Received uploads request method=POST path=/api/pending_closures6334worker1 # [ 135.329661] nix-grpc-daemon[1596]: time=2026-09-20T10:51:23.890Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6335worker1 # [ 135.331138] nix-grpc-daemon[1596]: time=2026-09-20T10:51:23.892Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6336lb # [ 135.329547] niks3-server[1027]: 2026/09/20 10:51:23 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6337lb # [ 135.339174] niks3-server[1027]: 2026/09/20 10:51:23 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6338lb # [ 135.348207] niks3-server[1027]: 2026/09/20 10:51:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6339worker1 # [ 135.381880] nix-grpc-daemon[1596]: time=2026-09-20T10:51:23.943Z level=INFO msg="Uploading 1 narinfos"6340lb # [ 135.353123] niks3-server[1027]: 2026/09/20 10:51:23 INFO Signed narinfos id=61 count=16341lb # [ 135.358889] niks3-server[1027]: 2026/09/20 10:51:23 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6342lb # [ 135.369375] niks3-server[1027]: 2026/09/20 10:51:23 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6343lb # [ 135.373908] niks3-server[1027]: 2026/09/20 10:51:23 INFO Completed upload id=616344lb # [ 135.376479] niks3-server[1027]: 2026/09/20 10:51:23 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6345worker1 # [ 135.404713] nix-grpc-daemon[1596]: time=2026-09-20T10:51:23.966Z level=INFO msg="Upload complete. (266ms)"6346worker1 # [ 135.412616] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16347worker1 # [ 135.418318] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:23Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16348worker1 # [ 135.429248] nix-daemon[843]: reaped child process 2042, status = succeeded6349worker1 # [ 135.453768] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346350worker1 # [ 135.465605] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346351worker1 # [ 135.477622] nix-grpc-daemon[1596]: time=2026-09-20T10:51:24.039Z level=INFO msg="All 2 paths already cached"6352worker1 # [ 135.484631] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:565346353worker1 # [ 135.492438] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6354worker1 # [ 135.647718] nix-daemon[843]: accepted connection from pid 2066, user nix-grpc-daemon (trusted)6355worker1 # [ 135.659619] nix-daemon[843]: reaped child process 2069, status = succeeded6356worker1 # [ 135.815821] nix-daemon[843]: accepted connection from pid 2071, user nix-grpc-daemon (trusted)6357worker1 # [ 135.826425] nix-daemon[843]: reaped child process 2074, status = succeeded6358lb # [ 135.812271] niks3-server[1027]: 2026/09/20 10:51:24 INFO Received uploads request method=POST path=/api/pending_closures6359worker1 # [ 135.849949] nix-grpc-daemon[1596]: time=2026-09-20T10:51:24.411Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6360worker1 # [ 135.851529] nix-grpc-daemon[1596]: time=2026-09-20T10:51:24.413Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6361lb # [ 135.843267] niks3-server[1027]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6362lb # [ 135.854207] niks3-server[1027]: 2026/09/20 10:51:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6363worker1 # [ 135.886985] nix-grpc-daemon[1596]: time=2026-09-20T10:51:24.448Z level=INFO msg="Uploading 1 narinfos"6364lb # [ 135.859151] niks3-server[1027]: 2026/09/20 10:51:24 INFO Signed narinfos id=62 count=16365lb # [ 135.866574] niks3-server[1027]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6366lb # [ 135.877759] niks3-server[1027]: 2026/09/20 10:51:24 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6367lb # [ 135.883527] niks3-server[1027]: 2026/09/20 10:51:24 INFO Completed upload id=626368worker1 # [ 135.911985] nix-grpc-daemon[1596]: time=2026-09-20T10:51:24.473Z level=INFO msg="Upload complete. (407ms)"6369lb # [ 135.885807] niks3-server[1027]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6370worker1 # [ 135.915562] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 paths=1 nar_bytes_in=7526371worker1 # [ 135.920759] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:565346372worker1 # [ 135.929133] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6373worker1 # [ 135.938172] nix-daemon[843]: reaped child process 2064, status = succeeded6374worker1 # [ 135.941202] nix-daemon[843]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6375worker1 # [ 136.564445] nix-daemon[843]: reaped child process 2078, status = succeeded6376worker1 # [ 136.718359] nix-daemon[843]: accepted connection from pid 2093, user nix-grpc-daemon (trusted)6377worker1 # [ 136.729975] nix-daemon[843]: reaped child process 2096, status = succeeded6378lb # [ 136.717775] niks3-server[1027]: 2026/09/20 10:51:25 INFO Received uploads request method=POST path=/api/pending_closures6379worker1 # [ 136.754489] nix-grpc-daemon[1596]: time=2026-09-20T10:51:25.315Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6380worker1 # [ 136.757479] nix-grpc-daemon[1596]: time=2026-09-20T10:51:25.317Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6381lb # [ 136.753390] niks3-server[1027]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6382lb # [ 136.758991] niks3-server[1027]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6383lb # [ 136.769344] niks3-server[1027]: 2026/09/20 10:51:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6384lb # [ 136.775431] niks3-server[1027]: 2026/09/20 10:51:25 INFO Signed narinfos id=63 count=16385worker1 # [ 136.808085] nix-grpc-daemon[1596]: time=2026-09-20T10:51:25.369Z level=INFO msg="Uploading 1 narinfos"6386lb # [ 136.782765] niks3-server[1027]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6387lb # [ 136.792372] niks3-server[1027]: 2026/09/20 10:51:25 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6388worker1 # [ 136.826768] nix-grpc-daemon[1596]: time=2026-09-20T10:51:25.388Z level=INFO msg="Upload complete. (277ms)"6389lb # [ 136.798421] niks3-server[1027]: 2026/09/20 10:51:25 INFO Completed upload id=636390lb # [ 136.801944] niks3-server[1027]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6391worker1 # [ 136.831177] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56534 duration_s=0 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16392worker1 # [ 136.838803] nix-daemon[843]: reaped child process 2076, status = succeeded6393client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.48 seconds)6394worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6395worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6396client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16397worker1 # [ 137.143134] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:565346398worker2 # [ 137.118523] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591666399worker1 # [ 137.163038] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:25Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06400client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.25 seconds)6401(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 17.78 seconds)6402subtest: low disk drains a worker and builds go to the other6403worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6404lb # [ 138.026620] envoy[918]: conn peer=[2001:db8:1::1]:51692 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27068 tx=10610 ms=172236405lb # [ 138.030527] envoy[918]: conn peer=[2001:db8:1::1]:52302 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=504 ms=336406worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.90 seconds)6407worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6408worker1 # [ 138.258108] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:26Z level=info event=unhealthy reason=min_free6409worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.10 seconds)6410client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26411worker2 # [ 139.373300] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:591666412client # don't know how to build these paths:6413client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6414worker1 # [ 139.413326] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:565346415worker1 # [ 139.436169] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:27Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06416worker1 # [ 139.440252] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:27Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16417worker2 # [ 139.450327] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591666418worker2 # [ 139.462762] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591666419client # copying 1 paths to 'lb:50051'...6420client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6421worker2 # [ 139.475104] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591666422worker2 # [ 139.486894] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6423worker2 # [ 139.504442] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:27Z level=info event=niks3_push_started pid=14736424worker2 # [ 139.809678] nix-daemon[807]: accepted connection from pid 1486, user nix-grpc-daemon (trusted)6425worker2 # [ 139.821183] nix-daemon[807]: reaped child process 1489, status = succeeded6426worker2 # [ 139.963518] nix-daemon[807]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6427worker2 # [ 139.975582] nix-daemon[807]: reaped child process 1494, status = succeeded6428lb # [ 139.991351] niks3-server[1027]: 2026/09/20 10:51:28 INFO Received uploads request method=POST path=/api/pending_closures6429worker2 # [ 139.993978] nix-grpc-daemon[1473]: time=2026-09-20T10:51:28.222Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6430worker2 # [ 139.997162] nix-grpc-daemon[1473]: time=2026-09-20T10:51:28.224Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6431lb # [ 140.010968] niks3-server[1027]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6432lb # [ 140.015696] niks3-server[1027]: 2026/09/20 10:51:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6433lb # [ 140.017547] niks3-server[1027]: 2026/09/20 10:51:28 INFO Signed narinfos id=64 count=16434worker2 # [ 140.016334] nix-grpc-daemon[1473]: time=2026-09-20T10:51:28.245Z level=INFO msg="Uploading 1 narinfos"6435lb # [ 140.022527] niks3-server[1027]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6436lb # [ 140.026497] niks3-server[1027]: 2026/09/20 10:51:28 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6437lb # [ 140.029468] niks3-server[1027]: 2026/09/20 10:51:28 INFO Completed upload id=646438worker2 # [ 140.027592] nix-grpc-daemon[1473]: time=2026-09-20T10:51:28.256Z level=INFO msg="Upload complete. (354ms)"6439lb # [ 140.031195] niks3-server[1027]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6440worker2 # [ 140.029800] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59166 duration_s=0 paths=1 nar_bytes_in=5126441worker2 # [ 140.034027] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591666442worker2 # [ 140.039629] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6443worker2 # [ 140.042037] nix-daemon[807]: reaped child process 1471, status = succeeded6444worker2 # [ 140.047583] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6445client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6446client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6447client # farm-a> LOG-farm-a-drain6448worker2 # [ 141.065187] nix-daemon[807]: reaped child process 1498, status = succeeded6449worker2 # [ 141.207094] nix-daemon[807]: accepted connection from pid 1513, user nix-grpc-daemon (trusted)6450worker2 # [ 141.218124] nix-daemon[807]: reaped child process 1516, status = succeeded6451lb # [ 141.234986] niks3-server[1027]: 2026/09/20 10:51:29 INFO Received uploads request method=POST path=/api/pending_closures6452worker2 # [ 141.237940] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.466Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6453worker2 # [ 141.239589] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.468Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6454lb # [ 141.253758] niks3-server[1027]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6455lb # [ 141.258278] niks3-server[1027]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6456lb # [ 141.262522] niks3-server[1027]: 2026/09/20 10:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6457lb # [ 141.265096] niks3-server[1027]: 2026/09/20 10:51:29 INFO Signed narinfos id=65 count=16458worker2 # [ 141.265270] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.493Z level=INFO msg="Uploading 1 narinfos"6459lb # [ 141.268247] niks3-server[1027]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6460lb # [ 141.272835] niks3-server[1027]: 2026/09/20 10:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6461lb # [ 141.275500] niks3-server[1027]: 2026/09/20 10:51:29 INFO Completed upload id=656462worker2 # [ 141.273976] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.503Z level=INFO msg="Upload complete. (219ms)"6463lb # [ 141.278273] niks3-server[1027]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6464worker2 # [ 141.276397] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59166 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16465worker2 # [ 141.282939] nix-daemon[807]: reaped child process 1496, status = succeeded6466worker1 # [ 141.313972] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:29Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06467worker1 # [ 141.318485] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:29Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16468worker2 # [ 141.326168] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591666469worker2 # [ 141.332886] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591666470worker2 # [ 141.339806] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.568Z level=INFO msg="All 1 paths already cached"6471client # copying 1 paths to 'lb:50051'...6472worker2 # [ 141.344797] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591666473client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6474worker2 # [ 141.350172] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6475worker2 # [ 141.503576] nix-daemon[807]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6476worker2 # [ 141.516144] nix-daemon[807]: reaped child process 1523, status = succeeded6477worker2 # [ 141.659136] nix-daemon[807]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6478worker2 # [ 141.671709] nix-daemon[807]: reaped child process 1528, status = succeeded6479lb # [ 141.687588] niks3-server[1027]: 2026/09/20 10:51:30 INFO Received uploads request method=POST path=/api/pending_closures6480worker2 # [ 141.694983] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.923Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6481worker2 # [ 141.696371] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.923Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6482lb # [ 141.719290] niks3-server[1027]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6483lb # [ 141.731331] niks3-server[1027]: 2026/09/20 10:51:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6484worker2 # [ 141.735280] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.964Z level=INFO msg="Uploading 1 narinfos"6485lb # [ 141.737421] niks3-server[1027]: 2026/09/20 10:51:30 INFO Signed narinfos id=66 count=16486lb # [ 141.741867] niks3-server[1027]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6487lb # [ 141.752534] niks3-server[1027]: 2026/09/20 10:51:30 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6488lb # [ 141.758361] niks3-server[1027]: 2026/09/20 10:51:30 INFO Completed upload id=666489worker2 # [ 141.756734] nix-grpc-daemon[1473]: time=2026-09-20T10:51:29.985Z level=INFO msg="Upload complete. (400ms)"6490lb # [ 141.760663] niks3-server[1027]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6491worker2 # [ 141.760301] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59166 duration_s=0 paths=1 nar_bytes_in=6246492worker2 # [ 141.765218] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591666493worker2 # [ 141.772482] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6494worker2 # [ 141.782664] nix-daemon[807]: reaped child process 1518, status = succeeded6495worker2 # [ 141.785726] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6496client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6497client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6498client # farm-b> LOG-farm-b-drain6499worker2 # [ 142.612860] nix-daemon[807]: reaped child process 1532, status = succeeded6500worker2 # [ 142.744477] nix-daemon[807]: accepted connection from pid 1547, user nix-grpc-daemon (trusted)6501worker2 # [ 142.759169] nix-daemon[807]: reaped child process 1550, status = succeeded6502lb # [ 142.775745] niks3-server[1027]: 2026/09/20 10:51:31 INFO Received uploads request method=POST path=/api/pending_closures6503worker2 # [ 142.783364] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.012Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6504worker2 # [ 142.785244] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.014Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6505lb # [ 142.817186] niks3-server[1027]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6506lb # [ 142.822558] niks3-server[1027]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6507lb # [ 142.837210] niks3-server[1027]: 2026/09/20 10:51:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6508worker2 # [ 142.840472] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.069Z level=INFO msg="Uploading 1 narinfos"6509lb # [ 142.843057] niks3-server[1027]: 2026/09/20 10:51:31 INFO Signed narinfos id=67 count=16510lb # [ 142.847934] niks3-server[1027]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6511lb # [ 142.857991] niks3-server[1027]: 2026/09/20 10:51:31 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6512lb # [ 142.861296] niks3-server[1027]: 2026/09/20 10:51:31 INFO Completed upload id=676513worker2 # [ 142.859974] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.089Z level=INFO msg="Upload complete. (267ms)"6514lb # [ 142.863182] niks3-server[1027]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6515worker2 # [ 142.864817] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59166 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16516worker1 # [ 142.899873] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:31Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06517worker1 # [ 142.901985] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:31Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16518worker2 # [ 142.877494] nix-daemon[807]: reaped child process 1530, status = succeeded6519worker2 # [ 142.914926] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591666520worker2 # [ 142.927289] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591666521worker2 # [ 142.939503] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.168Z level=INFO msg="All 2 paths already cached"6522client # copying 1 paths to 'lb:50051'...6523client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6524worker2 # [ 142.947693] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591666525worker2 # [ 142.955909] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6526worker2 # [ 143.121040] nix-daemon[807]: accepted connection from pid 1554, user nix-grpc-daemon (trusted)6527worker2 # [ 143.134407] nix-daemon[807]: reaped child process 1557, status = succeeded6528worker2 # [ 143.276107] nix-daemon[807]: accepted connection from pid 1559, user nix-grpc-daemon (trusted)6529worker2 # [ 143.288173] nix-daemon[807]: reaped child process 1562, status = succeeded6530lb # [ 143.303189] niks3-server[1027]: 2026/09/20 10:51:31 INFO Received uploads request method=POST path=/api/pending_closures6531worker2 # [ 143.309788] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.538Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6532worker2 # [ 143.311649] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.540Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6533lb # [ 143.331079] niks3-server[1027]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6534lb # [ 143.344453] niks3-server[1027]: 2026/09/20 10:51:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6535lb # [ 143.351950] niks3-server[1027]: 2026/09/20 10:51:31 INFO Signed narinfos id=68 count=16536worker2 # [ 143.353610] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.582Z level=INFO msg="Uploading 1 narinfos"6537lb # [ 143.355302] niks3-server[1027]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6538lb # [ 143.368488] niks3-server[1027]: 2026/09/20 10:51:31 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6539worker2 # [ 143.372068] nix-grpc-daemon[1473]: time=2026-09-20T10:51:31.601Z level=INFO msg="Upload complete. (402ms)"6540lb # [ 143.373645] niks3-server[1027]: 2026/09/20 10:51:31 INFO Completed upload id=686541worker2 # [ 143.374138] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59166 duration_s=0 paths=1 nar_bytes_in=7526542worker2 # [ 143.377582] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591666543lb # [ 143.379127] niks3-server[1027]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6544worker2 # [ 143.382113] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6545worker2 # [ 143.386603] nix-daemon[807]: reaped child process 1552, status = succeeded6546worker2 # [ 143.391759] nix-daemon[807]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6547client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6548client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6549client # farm-top> LOG-farm-top-drain6550worker2 # [ 144.607902] nix-daemon[807]: reaped child process 1566, status = succeeded6551worker2 # [ 144.740817] nix-daemon[807]: accepted connection from pid 1581, user nix-grpc-daemon (trusted)6552worker2 # [ 144.753231] nix-daemon[807]: reaped child process 1584, status = succeeded6553lb # [ 144.767616] niks3-server[1027]: 2026/09/20 10:51:33 INFO Received uploads request method=POST path=/api/pending_closures6554worker2 # [ 144.774386] nix-grpc-daemon[1473]: time=2026-09-20T10:51:33.003Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6555worker2 # [ 144.775871] nix-grpc-daemon[1473]: time=2026-09-20T10:51:33.005Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6556lb # [ 144.805612] niks3-server[1027]: 2026/09/20 10:51:33 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6557lb # [ 144.820172] niks3-server[1027]: 2026/09/20 10:51:33 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6558lb # [ 144.825273] niks3-server[1027]: 2026/09/20 10:51:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6559worker2 # [ 144.832658] nix-grpc-daemon[1473]: time=2026-09-20T10:51:33.061Z level=INFO msg="Uploading 1 narinfos"6560lb # [ 144.833725] niks3-server[1027]: 2026/09/20 10:51:33 INFO Signed narinfos id=69 count=16561lb # [ 144.838726] niks3-server[1027]: 2026/09/20 10:51:33 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6562lb # [ 144.848033] niks3-server[1027]: 2026/09/20 10:51:33 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6563lb # [ 144.850613] niks3-server[1027]: 2026/09/20 10:51:33 INFO Completed upload id=696564worker2 # [ 144.849259] nix-grpc-daemon[1473]: time=2026-09-20T10:51:33.078Z level=INFO msg="Upload complete. (249ms)"6565lb # [ 144.852862] niks3-server[1027]: 2026/09/20 10:51:33 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6566worker2 # [ 144.854616] nix-grpc-daemon[1452]: ts=2026-09-20T10:51:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59166 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16567worker2 # [ 144.866849] nix-daemon[807]: reaped child process 1564, status = succeeded6568client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 5.72 seconds)6569client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6570client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.18 seconds)6571worker1: must succeed: rm /nix/.rw-store/fill6572worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6573worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6574worker1 # [ 146.266511] nix-grpc-daemon[1529]: ts=2026-09-20T10:51:34Z level=info event=healthy reason=min_free6575worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6576(finished: subtest: low disk drains a worker and builds go to the other, in 9.22 seconds)6577(finished: run the VM test script, in 147.25 seconds)6578test script finished in 147.50s6579cleanup6580kill QemuMachine (pid 49)6581client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6582kill QemuMachine (pid 50)6583lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6584kill QemuMachine (pid 51)6585worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6586kill QemuMachine (pid 52)6587worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6588(finished: cleanup, in 1.00 seconds)6589additionally exposed symbols:6590 client, lb, worker1, worker2,6591 vlan1,6592 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh