nixbot

builds

succeeded vm-test-run-nix-grpc-farm checks.x86_64-linux.farm · build #285 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client # Formatting '/build/vm-state-client/tmp.7nUkmhalgZ', fmt=raw size=107374182414client # mke2fs 1.47.4 (6-Mar-2025)15client: QEMU running (pid 49)16worker1 # Disk image does not exist, creating the virtualisation disk image...17client # Discarding device blocks: 0/262144 done18worker1 # Formatting '/build/vm-state-worker1/tmp.94zQvlBOyy', fmt=raw size=107374182419lb # Disk image does not exist, creating the virtualisation disk image...20lb: QEMU running (pid 50)21worker1 # mke2fs 1.47.4 (6-Mar-2025)22worker2: QEMU running (pid 52)23worker1: QEMU running (pid 51)24client # Creating filesystem with 262144 4k blocks and 65536 inodes25lb # Formatting '/build/vm-state-lb/tmp.HrOjLerKTP', fmt=raw size=107374182426worker1 # Discarding device blocks: 0/262144 done27worker2 # Disk image does not exist, creating the virtualisation disk image...28(finished: start all VMs, in 0.20 seconds)29worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes30worker2 # Formatting '/build/vm-state-worker2/tmp.mBOTOUXozM', fmt=raw size=107374182431client: waiting for unit network-addresses-eth1.service32worker1 # Filesystem UUID: d661d349-6df5-4415-a0e3-c1cb00462b7d33worker2 # mke2fs 1.47.4 (6-Mar-2025)34client: waiting for the VM to finish booting35worker1 # Superblock backups stored on blocks:36worker2 # Discarding device blocks: 0/262144 done37lb # mke2fs 1.47.4 (6-Mar-2025)38client # Filesystem UUID: 7d9f9389-0255-4799-b91f-21db2e61827139worker1 # 32768, 98304, 163840, 22937640worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes41lb # Discarding device blocks: 0/262144 done42client # Superblock backups stored on blocks:43worker1 # 44worker2 # Filesystem UUID: ff28795b-65a1-497a-b9ba-6c91b1795f6945lb # Creating filesystem with 262144 4k blocks and 65536 inodes46client # 32768, 98304, 163840, 22937647worker1 # Allocating group tables: 0/8 done48worker2 # Superblock backups stored on blocks:49lb # Filesystem UUID: 8517c65f-2884-4445-9ad3-3a7e85d05bd150client # 51worker1 # Writing inode tables: 0/8 done52worker2 # 32768, 98304, 163840, 22937653lb # Superblock backups stored on blocks:54client # Allocating group tables: 0/8 done55worker1 # Creating journal (8192 blocks): done56worker2 # 57lb # 32768, 98304, 163840, 22937658client # Writing inode tables: 0/8 done59worker1 # Writing superblocks and filesystem accounting information: 0/8 done60worker2 # Allocating group tables: 0/8 done61lb # 62client # Creating journal (8192 blocks): done63worker1 # 64worker2 # Writing inode tables: 0/8 done65lb # Allocating group tables: 0/8 done66client # Writing superblocks and filesystem accounting information: 0/8 done67worker1 # Virtualisation disk image created.68worker2 # Creating journal (8192 blocks): done69lb # Writing inode tables: 0/8 done70worker2 # Writing superblocks and filesystem accounting information: 0/8 done71lb # Creating journal (8192 blocks): done72worker2 # 73lb # Writing superblocks and filesystem accounting information: 0/8 done74worker2 # Virtualisation disk image created.75lb # 76client # 77lb # Virtualisation disk image created.78client # Virtualisation disk image created.79client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83client # 84client # 85client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87client # 88client # 89client # 90client # 91client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...93client # 94client # 95worker1 # 96worker1 # 97worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0098lb # 99lb # 100worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...101worker1 # 102worker1 # 103worker1 # 104worker1 # 105lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00106worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00107lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108lb # 109lb # 110lb # 111lb # 112worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...113worker1 # 114worker1 # 115lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116worker2 # 117worker2 # 118lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...119lb # 120lb # 121worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122client # Booting from ROM...123worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...124worker2 # 125worker2 # 126worker2 # 127worker2 # 128worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00129worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...130worker2 # 131worker2 # 132worker1 # Booting from ROM...133lb # Booting from ROM...134worker2 # Booting from ROM...135client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test/init regInfo=/nix/store/2y2l7nq8r6mzsr0l5p9ykxj4vkg58blv-closure-info/registration console=ttyS0,115200n8 console=tty0137client # [ 0.000000] BIOS-provided physical RAM map:138client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148client # [ 0.000000] NX (Execute Disable) protection: active149client # [ 0.000000] APIC: Static calls initialized150client # [ 0.000000] SMBIOS 2.8 present.151client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152client # [ 0.000000] DMI: Memory slots populated: 1/1153client # [ 0.000000] Hypervisor detected: KVM154client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000155client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00156worker1 # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026157client # [ 0.000000] kvm-clock: using sched offset of 458502148 cycles158client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns159client # [ 0.000005] tsc: Detected 2400.012 MHz processor160client # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000161worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/91qbw423h3kdggzh5653wrgbzgayssdi-nixos-system-worker1-test/init regInfo=/nix/store/bh5pvr08kd4fj8v9yylwgb34ivqqrysj-closure-info/registration console=ttyS0,115200n8 console=tty0162client # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs163worker1 # [ 0.000000] BIOS-provided physical RAM map:164client # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT165worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable166client # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f]167lb # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026168worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved169client # [ 0.002736] Using GB pages for direct mapping170client # [ 0.002854] RAMDISK: [mem 0x5e366000-0x5ffcffff]171worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved172client # [ 0.002862] ACPI: Early table checksum verification disabled173worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable174client # [ 0.002865] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )175worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved176client # [ 0.002869] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)177lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0178worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved179lb # [ 0.000000] BIOS-provided physical RAM map:180worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved181client # [ 0.002874] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)182lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable183worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved184client # [ 0.002881] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)185lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved186client # [ 0.002883] ACPI: FACS 0x000000005FFE0000 000040187worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved188lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved189worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved190client # [ 0.002884] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)191lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable192worker1 # [ 0.000000] NX (Execute Disable) protection: active193worker1 # [ 0.000000] APIC: Static calls initialized194client # [ 0.002886] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)195lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved196worker1 # [ 0.000000] SMBIOS 2.8 present.197lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved198client # [ 0.002887] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)199worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014200lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved201worker1 # [ 0.000000] DMI: Memory slots populated: 1/1202client # [ 0.002889] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)203worker1 # [ 0.000000] Hypervisor detected: KVM204lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved205client # [ 0.002890] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]206worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000207lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved208worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00209client # [ 0.002891] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]210lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved211worker1 # [ 0.000000] kvm-clock: using sched offset of 473582353 cycles212client # [ 0.002892] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]213lb # [ 0.000000] NX (Execute Disable) protection: active214lb # [ 0.000000] APIC: Static calls initialized215client # [ 0.002892] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]216lb # [ 0.000000] SMBIOS 2.8 present.217worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns218worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor219client # [ 0.002893] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]220lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014221worker1 # [ 0.000808] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000222client # [ 0.002893] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]223lb # [ 0.000000] DMI: Memory slots populated: 1/1224worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026225lb # [ 0.000000] Hypervisor detected: KVM226worker1 # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs227client # [ 0.002894] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]228client # [ 0.003115] No NUMA configuration found229lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000230worker1 # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT231lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00232client # [ 0.003116] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]233worker1 # [ 0.002729] found SMP MP-table at [mem 0x000f5450-0x000f545f]234lb # [ 0.000000] kvm-clock: using sched offset of 489299715 cycles235worker1 # [ 0.002738] Using GB pages for direct mapping236client # [ 0.003118] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]237client # [ 0.005233] Zone ranges:238worker1 # [ 0.002843] RAMDISK: [mem 0x5e367000-0x5ffcffff]239client # [ 0.005234] DMA [mem 0x0000000000001000-0x0000000000ffffff]240lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns241worker1 # [ 0.002850] ACPI: Early table checksum verification disabled242worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vjmiy2swhjja3rzm8a247wvfwbk972qp-nixos-system-worker2-test/init regInfo=/nix/store/hv3hxv3v7x15bmk98vh79xmahr9ll86q-closure-info/registration console=ttyS0,115200n8 console=tty0243lb # [ 0.000005] tsc: Detected 2400.012 MHz processor244client # [ 0.005235] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]245worker2 # [ 0.000000] BIOS-provided physical RAM map:246worker1 # [ 0.002853] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )247client # [ 0.005237] Normal empty248lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000249client # [ 0.005237] Device empty250worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable251worker1 # [ 0.002856] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)252client # [ 0.005238] Movable zone start for each node253lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs254client # [ 0.005239] Early memory node ranges255worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved256worker1 # [ 0.002860] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)257lb # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT258client # [ 0.005239] node 0: [mem 0x0000000000001000-0x000000000009efff]259worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved260lb # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f]261worker1 # [ 0.002867] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)262client # [ 0.005240] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]263worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable264lb # [ 0.002748] Using GB pages for direct mapping265worker1 # [ 0.002869] ACPI: FACS 0x000000005FFE0000 000040266client # [ 0.005241] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]267lb # [ 0.002862] RAMDISK: [mem 0x5e367000-0x5ffcffff]268worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved269worker1 # [ 0.002870] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)270client # [ 0.005260] On node 0, zone DMA: 1 pages in unavailable ranges271lb # [ 0.002870] ACPI: Early table checksum verification disabled272worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved273client # [ 0.005511] On node 0, zone DMA: 97 pages in unavailable ranges274lb # [ 0.002873] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )275worker1 # [ 0.002872] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)276worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved277client # [ 0.030686] On node 0, zone DMA32: 40 pages in unavailable ranges278lb # [ 0.002877] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)279client # [ 0.031150] ACPI: PM-Timer IO Port: 0x608280worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved281worker1 # [ 0.002873] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)282client # [ 0.031163] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])283lb # [ 0.002880] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)284worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved285worker1 # [ 0.002875] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)286client # [ 0.031189] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23287worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved288lb # [ 0.002887] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)289worker1 # [ 0.002876] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]290client # [ 0.031192] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)291worker2 # [ 0.000000] NX (Execute Disable) protection: active292lb # [ 0.002889] ACPI: FACS 0x000000005FFE0000 000040293worker1 # [ 0.002877] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]294worker2 # [ 0.000000] APIC: Static calls initialized295client # [ 0.031194] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)296worker2 # [ 0.000000] SMBIOS 2.8 present.297lb # [ 0.002890] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)298worker1 # [ 0.002878] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]299client # [ 0.031195] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)300lb # [ 0.002892] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)301worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014302worker1 # [ 0.002878] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]303client # [ 0.031196] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)304worker2 # [ 0.000000] DMI: Memory slots populated: 1/1305worker1 # [ 0.002879] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]306client # [ 0.031197] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)307lb # [ 0.002893] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)308worker2 # [ 0.000000] Hypervisor detected: KVM309worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000310worker1 # [ 0.002879] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]311client # [ 0.031200] ACPI: Using ACPI (MADT) for SMP configuration information312lb # [ 0.002895] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)313worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00314client # [ 0.031201] ACPI: HPET id: 0x8086a201 base: 0xfed00000315worker1 # [ 0.002880] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]316lb # [ 0.002896] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]317client # [ 0.031205] TSC deadline timer available318worker2 # [ 0.000000] kvm-clock: using sched offset of 479463993 cycles319worker1 # [ 0.003100] No NUMA configuration found320client # [ 0.031209] CPU topo: Max. logical packages: 1321lb # [ 0.002897] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]322worker1 # [ 0.003101] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]323client # [ 0.031210] CPU topo: Max. logical dies: 1324worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns325client # [ 0.031210] CPU topo: Max. dies per package: 1326lb # [ 0.002898] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]327worker1 # [ 0.003104] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]328worker2 # [ 0.000004] tsc: Detected 2400.012 MHz processor329worker1 # [ 0.005224] Zone ranges:330client # [ 0.031214] CPU topo: Max. threads per core: 1331lb # [ 0.002898] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]332worker2 # [ 0.000809] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000333worker1 # [ 0.005225] DMA [mem 0x0000000000001000-0x0000000000ffffff]334client # [ 0.031215] CPU topo: Num. cores per package: 1335client # [ 0.031215] CPU topo: Num. threads per package: 1336lb # [ 0.002899] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]337worker1 # [ 0.005226] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]338worker2 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs339worker1 # [ 0.005227] Normal empty340client # [ 0.031215] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs341worker1 # [ 0.005228] Device empty342lb # [ 0.002899] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]343worker2 # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT344worker1 # [ 0.005229] Movable zone start for each node345client # [ 0.031238] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()346lb # [ 0.002900] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]347worker2 # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f]348worker1 # [ 0.005230] Early memory node ranges349lb # [ 0.003117] No NUMA configuration found350worker2 # [ 0.002746] Using GB pages for direct mapping351client # [ 0.031271] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]352worker1 # [ 0.005230] node 0: [mem 0x0000000000001000-0x000000000009efff]353worker2 # [ 0.002841] RAMDISK: [mem 0x5e367000-0x5ffcffff]354lb # [ 0.003118] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]355worker1 # [ 0.005231] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]356worker2 # [ 0.002849] ACPI: Early table checksum verification disabled357lb # [ 0.003120] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]358lb # [ 0.005235] Zone ranges:359client # [ 0.031273] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]360worker1 # [ 0.005232] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]361client # [ 0.031274] [mem 0x60000000-0xafffffff] available for PCI devices362worker2 # [ 0.002852] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )363client # [ 0.031276] Booting paravirtualized kernel on KVM364lb # [ 0.005236] DMA [mem 0x0000000000001000-0x0000000000ffffff]365worker1 # [ 0.005251] On node 0, zone DMA: 1 pages in unavailable ranges366worker2 # [ 0.002857] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)367lb # [ 0.005237] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]368worker1 # [ 0.005508] On node 0, zone DMA: 97 pages in unavailable ranges369lb # [ 0.005238] Normal empty370client # [ 0.031279] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns371lb # [ 0.005239] Device empty372worker2 # [ 0.002861] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)373worker1 # [ 0.030643] On node 0, zone DMA32: 40 pages in unavailable ranges374lb # [ 0.005239] Movable zone start for each node375client # [ 0.035732] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1376worker1 # [ 0.031092] ACPI: PM-Timer IO Port: 0x608377lb # [ 0.005240] Early memory node ranges378worker2 # [ 0.002868] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)379worker1 # [ 0.031104] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])380client # [ 0.037806] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152381worker2 # [ 0.002870] ACPI: FACS 0x000000005FFE0000 000040382lb # [ 0.005240] node 0: [mem 0x0000000000001000-0x000000000009efff]383client # [ 0.037850] kvm-guest: PV spinlocks disabled, single CPU384worker1 # [ 0.031130] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23385lb # [ 0.005241] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]386worker2 # [ 0.002871] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)387worker1 # [ 0.031132] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)388lb # [ 0.005243] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]389worker2 # [ 0.002873] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)390worker1 # [ 0.031134] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)391lb # [ 0.005261] On node 0, zone DMA: 1 pages in unavailable ranges392worker1 # [ 0.031135] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)393lb # [ 0.005511] On node 0, zone DMA: 97 pages in unavailable ranges394worker2 # [ 0.002874] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)395worker1 # [ 0.031136] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)396lb # [ 0.030556] On node 0, zone DMA32: 40 pages in unavailable ranges397worker2 # [ 0.002876] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)398client # [ 0.037852] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test/init regInfo=/nix/store/2y2l7nq8r6mzsr0l5p9ykxj4vkg58blv-closure-info/registration console=ttyS0,115200n8 console=tty0399lb # [ 0.031011] ACPI: PM-Timer IO Port: 0x608400worker1 # [ 0.031137] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)401worker2 # [ 0.002877] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]402lb # [ 0.031022] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])403worker1 # [ 0.031139] ACPI: Using ACPI (MADT) for SMP configuration information404worker2 # [ 0.002878] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]405lb # [ 0.031047] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23406worker1 # [ 0.031140] ACPI: HPET id: 0x8086a201 base: 0xfed00000407client # [ 0.037950] Unknown kernel command line parameters "regInfo=/nix/store/2y2l7nq8r6mzsr0l5p9ykxj4vkg58blv-closure-info/registration", will be passed to user space.408client # [ 0.037963] random: crng init done409worker1 # [ 0.031143] TSC deadline timer available410lb # [ 0.031050] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)411worker2 # [ 0.002879] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]412worker1 # [ 0.031147] CPU topo: Max. logical packages: 1413client # [ 0.037964] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes414lb # [ 0.031051] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)415worker2 # [ 0.002879] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]416worker1 # [ 0.031148] CPU topo: Max. logical dies: 1417worker1 # [ 0.031149] CPU topo: Max. dies per package: 1418lb # [ 0.031052] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)419client # [ 0.040009] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)420worker2 # [ 0.002880] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]421worker1 # [ 0.031152] CPU topo: Max. threads per core: 1422lb # [ 0.031053] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)423worker2 # [ 0.002880] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]424client # [ 0.041166] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)425worker1 # [ 0.031153] CPU topo: Num. cores per package: 1426client # [ 0.041197] Fallback order for Node 0: 0427lb # [ 0.031054] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)428worker1 # [ 0.031153] CPU topo: Num. threads per package: 1429worker2 # [ 0.002881] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]430client # [ 0.041200] Built 1 zonelists, mobility grouping on. Total pages: 393078431worker2 # [ 0.003101] No NUMA configuration found432worker1 # [ 0.031154] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs433lb # [ 0.031056] ACPI: Using ACPI (MADT) for SMP configuration information434client # [ 0.041201] Policy zone: DMA32435lb # [ 0.031057] ACPI: HPET id: 0x8086a201 base: 0xfed00000436worker2 # [ 0.003101] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]437worker1 # [ 0.031170] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()438client # [ 0.043597] mem auto-init: stack:all(zero), heap alloc:on, heap free:off439lb # [ 0.031061] TSC deadline timer available440worker2 # [ 0.003104] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]441lb # [ 0.031065] CPU topo: Max. logical packages: 1442worker2 # [ 0.005229] Zone ranges:443worker1 # [ 0.031203] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]444client # [ 0.046633] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1445lb # [ 0.031066] CPU topo: Max. logical dies: 1446worker2 # [ 0.005231] DMA [mem 0x0000000000001000-0x0000000000ffffff]447client # [ 0.049783] allocated 3145728 bytes of page_ext448worker1 # [ 0.031204] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]449lb # [ 0.031066] CPU topo: Max. dies per package: 1450client # [ 0.059481] ftrace: allocating 48731 entries in 192 pages451worker2 # [ 0.005232] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]452lb # [ 0.031069] CPU topo: Max. threads per core: 1453worker1 # [ 0.031205] [mem 0x60000000-0xafffffff] available for PCI devices454worker2 # [ 0.005234] Normal empty455client # [ 0.059483] ftrace: allocated 192 pages with 2 groups456worker2 # [ 0.005234] Device empty457lb # [ 0.031070] CPU topo: Num. cores per package: 1458worker1 # [ 0.031207] Booting paravirtualized kernel on KVM459client # [ 0.060287] Dynamic Preempt: lazy460worker2 # [ 0.005235] Movable zone start for each node461lb # [ 0.031070] CPU topo: Num. threads per package: 1462worker2 # [ 0.005236] Early memory node ranges463client # [ 0.060422] rcu: Preemptible hierarchical RCU implementation.464worker1 # [ 0.031209] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns465lb # [ 0.031071] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs466client # [ 0.060423] rcu: RCU event tracing is enabled.467worker2 # [ 0.005236] node 0: [mem 0x0000000000001000-0x000000000009efff]468lb # [ 0.031087] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()469worker1 # [ 0.035642] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1470client # [ 0.060424] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.471worker2 # [ 0.005237] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]472client # [ 0.060425] Trampoline variant of Tasks RCU enabled.473worker1 # [ 0.037694] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152474lb # [ 0.031119] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]475worker2 # [ 0.005238] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]476client # [ 0.060425] Rude variant of Tasks RCU enabled.477worker1 # [ 0.037737] kvm-guest: PV spinlocks disabled, single CPU478worker2 # [ 0.005258] On node 0, zone DMA: 1 pages in unavailable ranges479lb # [ 0.031121] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]480client # [ 0.060426] Tracing variant of Tasks RCU enabled.481worker2 # [ 0.005511] On node 0, zone DMA: 97 pages in unavailable ranges482lb # [ 0.031122] [mem 0x60000000-0xafffffff] available for PCI devices483client # [ 0.060426] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.484lb # [ 0.031123] Booting paravirtualized kernel on KVM485worker2 # [ 0.030520] On node 0, zone DMA32: 40 pages in unavailable ranges486client # [ 0.060427] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1487worker2 # [ 0.030972] ACPI: PM-Timer IO Port: 0x608488lb # [ 0.031125] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns489worker2 # [ 0.030984] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])490client # [ 0.060441] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.491lb # [ 0.035547] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1492worker1 # [ 0.037739] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/91qbw423h3kdggzh5653wrgbzgayssdi-nixos-system-worker1-test/init regInfo=/nix/store/bh5pvr08kd4fj8v9yylwgb34ivqqrysj-closure-info/registration console=ttyS0,115200n8 console=tty0493worker2 # [ 0.031010] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23494client # [ 0.060443] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.495worker2 # [ 0.031012] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)496lb # [ 0.037584] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152497lb # [ 0.037625] kvm-guest: PV spinlocks disabled, single CPU498worker2 # [ 0.031014] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)499client # [ 0.060444] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.500worker1 # [ 0.037829] Unknown kernel command line parameters "regInfo=/nix/store/bh5pvr08kd4fj8v9yylwgb34ivqqrysj-closure-info/registration", will be passed to user space.501worker1 # [ 0.037842] random: crng init done502worker2 # [ 0.031015] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)503client # [ 0.064877] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16504worker1 # [ 0.037843] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes505worker2 # [ 0.031016] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)506client # [ 0.065189] rcu: srcu_init: Setting srcu_struct sizes based on contention.507worker2 # [ 0.031016] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)508worker1 # [ 0.039885] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)509client # [ 0.065196] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns510worker2 # [ 0.031019] ACPI: Using ACPI (MADT) for SMP configuration information511lb # [ 0.037627] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0512worker1 # [ 0.040898] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)513worker2 # [ 0.031020] ACPI: HPET id: 0x8086a201 base: 0xfed00000514client # [ 0.065295] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)515worker2 # [ 0.031023] TSC deadline timer available516worker1 # [ 0.040928] Fallback order for Node 0: 0517client # [ 0.068797] Console: colour VGA+ 80x25518worker2 # [ 0.031027] CPU topo: Max. logical packages: 1519client # [ 0.068801] printk: legacy console [tty0] enabled520worker1 # [ 0.040931] Built 1 zonelists, mobility grouping on. Total pages: 393078521worker2 # [ 0.031028] CPU topo: Max. logical dies: 1522lb # [ 0.037723] Unknown kernel command line parameters "regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration", will be passed to user space.523client # [ 0.098281] printk: legacy console [ttyS0] enabled524worker1 # [ 0.040932] Policy zone: DMA32525lb # [ 0.037736] random: crng init done526worker2 # [ 0.031028] CPU topo: Max. dies per package: 1527client # [ 0.196952] ACPI: Core revision 20250807528worker2 # [ 0.031032] CPU topo: Max. threads per core: 1529worker1 # [ 0.043433] mem auto-init: stack:all(zero), heap alloc:on, heap free:off530lb # [ 0.037737] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes531worker2 # [ 0.031032] CPU topo: Num. cores per package: 1532worker1 # [ 0.046308] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1533worker2 # [ 0.031033] CPU topo: Num. threads per package: 1534lb # [ 0.039767] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)535worker1 # [ 0.049474] allocated 3145728 bytes of page_ext536client # [ 0.197811] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns537worker2 # [ 0.031033] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs538worker1 # [ 0.059094] ftrace: allocating 48731 entries in 192 pages539lb # [ 0.040911] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)540lb # [ 0.040941] Fallback order for Node 0: 0541client # [ 0.199357] APIC: Switch to symmetric I/O mode setup542worker1 # [ 0.059097] ftrace: allocated 192 pages with 2 groups543worker2 # [ 0.031051] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()544worker1 # [ 0.059907] Dynamic Preempt: lazy545client # [ 0.200333] x2apic enabled546lb # [ 0.040943] Built 1 zonelists, mobility grouping on. Total pages: 393078547worker2 # [ 0.031082] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]548worker1 # [ 0.060058] rcu: Preemptible hierarchical RCU implementation.549lb # [ 0.040944] Policy zone: DMA32550worker1 # [ 0.060059] rcu: RCU event tracing is enabled.551client # [ 0.201109] APIC: Switched APIC routing to: physical x2apic552lb # [ 0.043296] mem auto-init: stack:all(zero), heap alloc:on, heap free:off553worker2 # [ 0.031084] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]554worker1 # [ 0.060060] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.555lb # [ 0.046188] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1556worker2 # [ 0.031085] [mem 0x60000000-0xafffffff] available for PCI devices557worker1 # [ 0.060061] Trampoline variant of Tasks RCU enabled.558lb # [ 0.049321] allocated 3145728 bytes of page_ext559worker2 # [ 0.031087] Booting paravirtualized kernel on KVM560worker1 # [ 0.060062] Rude variant of Tasks RCU enabled.561client # [ 0.202897] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1562lb # [ 0.058864] ftrace: allocating 48731 entries in 192 pages563worker1 # [ 0.060062] Tracing variant of Tasks RCU enabled.564lb # [ 0.058866] ftrace: allocated 192 pages with 2 groups565worker2 # [ 0.031090] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns566lb # [ 0.059676] Dynamic Preempt: lazy567worker1 # [ 0.060062] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.568worker2 # [ 0.035534] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1569client # [ 0.203863] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns570lb # [ 0.059844] rcu: Preemptible hierarchical RCU implementation.571worker1 # [ 0.060063] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1572lb # [ 0.059844] rcu: RCU event tracing is enabled.573worker2 # [ 0.037576] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152574client # [ 0.205539] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)575worker2 # [ 0.037616] kvm-guest: PV spinlocks disabled, single CPU576lb # [ 0.059845] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.577worker1 # [ 0.060083] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.578lb # [ 0.059846] Trampoline variant of Tasks RCU enabled.579client # [ 0.206629] x86/cpu: User Mode Instruction Prevention (UMIP) activated580lb # [ 0.059847] Rude variant of Tasks RCU enabled.581worker1 # [ 0.060085] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.582lb # [ 0.059847] Tracing variant of Tasks RCU enabled.583client # [ 0.207665] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127584worker1 # [ 0.060085] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.585lb # [ 0.059848] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.586worker1 # [ 0.064412] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16587client # [ 0.208537] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0588lb # [ 0.059849] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1589worker1 # [ 0.064695] rcu: srcu_init: Setting srcu_struct sizes based on contention.590worker2 # [ 0.037618] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vjmiy2swhjja3rzm8a247wvfwbk972qp-nixos-system-worker2-test/init regInfo=/nix/store/hv3hxv3v7x15bmk98vh79xmahr9ll86q-closure-info/registration console=ttyS0,115200n8 console=tty0591lb # [ 0.059872] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.592client # [ 0.209541] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto593worker1 # [ 0.064702] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns594worker2 # [ 0.037709] Unknown kernel command line parameters "regInfo=/nix/store/hv3hxv3v7x15bmk98vh79xmahr9ll86q-closure-info/registration", will be passed to user space.595lb # [ 0.059873] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.596worker2 # [ 0.037722] random: crng init done597worker1 # [ 0.064800] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)598client # [ 0.211537] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl599lb # [ 0.059874] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.600worker1 # [ 0.068468] Console: colour VGA+ 80x25601worker2 # [ 0.037723] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes602worker1 # [ 0.068471] printk: legacy console [tty0] enabled603client # [ 0.212537] Transient Scheduler Attacks: Vulnerable: No microcode604lb # [ 0.064255] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16605worker2 # [ 0.039741] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)606worker1 # [ 0.097861] printk: legacy console [ttyS0] enabled607lb # [ 0.064520] rcu: srcu_init: Setting srcu_struct sizes based on contention.608client # [ 0.213536] Spectre V2 : Mitigation: Enhanced / Automatic IBRS609worker1 # [ 0.194974] ACPI: Core revision 20250807610worker2 # [ 0.040896] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)611worker2 # [ 0.040929] Fallback order for Node 0: 0612client # [ 0.214536] Speculative Return Stack Overflow: Mitigation: Safe RET613lb # [ 0.064526] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns614worker2 # [ 0.040932] Built 1 zonelists, mobility grouping on. Total pages: 393078615worker1 # [ 0.195870] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns616worker2 # [ 0.040933] Policy zone: DMA32617lb # [ 0.064625] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)618lb # [ 0.068130] Console: colour VGA+ 80x25619worker1 # [ 0.197369] APIC: Switch to symmetric I/O mode setup620worker2 # [ 0.043290] mem auto-init: stack:all(zero), heap alloc:on, heap free:off621lb # [ 0.068133] printk: legacy console [tty0] enabled622worker1 # [ 0.198312] x2apic enabled623worker2 # [ 0.046188] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1624lb # [ 0.097460] printk: legacy console [ttyS0] enabled625worker2 # [ 0.049314] allocated 3145728 bytes of page_ext626lb # [ 0.193425] ACPI: Core revision 20250807627worker1 # [ 0.199060] APIC: Switched APIC routing to: physical x2apic628worker2 # [ 0.058933] ftrace: allocating 48731 entries in 192 pages629client # [ 0.215536] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization630worker2 # [ 0.058935] ftrace: allocated 192 pages with 2 groups631client # [ 0.217544] Spectre V2 : Enabling IBPB for BPF632worker2 # [ 0.059740] Dynamic Preempt: lazy633lb # [ 0.194306] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns634worker1 # [ 0.200836] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1635worker2 # [ 0.060040] rcu: Preemptible hierarchical RCU implementation.636lb # [ 0.195788] APIC: Switch to symmetric I/O mode setup637worker2 # [ 0.060041] rcu: RCU event tracing is enabled.638client # [ 0.218538] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier639lb # [ 0.196757] x2apic enabled640worker2 # [ 0.060041] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.641client # [ 0.219538] active return thunk: srso_alias_return_thunk642worker1 # [ 0.201790] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns643worker2 # [ 0.060043] Trampoline variant of Tasks RCU enabled.644lb # [ 0.197518] APIC: Switched APIC routing to: physical x2apic645worker2 # [ 0.060043] Rude variant of Tasks RCU enabled.646client # [ 0.220558] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'647worker1 # [ 0.203388] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)648worker2 # [ 0.060044] Tracing variant of Tasks RCU enabled.649client # [ 0.221536] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'650worker2 # [ 0.060044] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.651worker1 # [ 0.204470] x86/cpu: User Mode Instruction Prevention (UMIP) activated652lb # [ 0.199317] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1653client # [ 0.222536] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'654worker2 # [ 0.060045] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1655worker1 # [ 0.205524] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127656client # [ 0.223536] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'657worker2 # [ 0.060066] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.658lb # [ 0.200270] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns659worker1 # [ 0.206386] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0660client # [ 0.224536] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'661worker2 # [ 0.060068] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.662lb # [ 0.201896] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)663client # [ 0.225536] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'664worker1 # [ 0.207389] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto665worker2 # [ 0.060069] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.666lb # [ 0.202979] x86/cpu: User Mode Instruction Prevention (UMIP) activated667worker2 # [ 0.064348] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16668client # [ 0.226537] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'669worker1 # [ 0.208386] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl670lb # [ 0.204008] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127671worker2 # [ 0.064615] rcu: srcu_init: Setting srcu_struct sizes based on contention.672client # [ 0.227537] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256673worker1 # [ 0.209386] Transient Scheduler Attacks: Vulnerable: No microcode674lb # [ 0.204894] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0675worker2 # [ 0.064621] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns676worker1 # [ 0.210385] Spectre V2 : Mitigation: Enhanced / Automatic IBRS677client # [ 0.229262] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64678client # [ 0.230255] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512679worker2 # [ 0.064722] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)680worker1 # [ 0.211385] Speculative Return Stack Overflow: Mitigation: Safe RET681lb # [ 0.205898] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto682worker2 # [ 0.068225] Console: colour VGA+ 80x25683client # [ 0.230536] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024684worker2 # [ 0.068228] printk: legacy console [tty0] enabled685lb # [ 0.206894] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl686worker2 # [ 0.097565] printk: legacy console [ttyS0] enabled687client # [ 0.231536] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8688worker2 # [ 0.194052] ACPI: Core revision 20250807689lb # [ 0.207894] Transient Scheduler Attacks: Vulnerable: No microcode690lb # [ 0.208894] Spectre V2 : Mitigation: Enhanced / Automatic IBRS691client # [ 0.232536] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.692worker1 # [ 0.212386] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization693worker2 # [ 0.194930] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns694lb # [ 0.209894] Speculative Return Stack Overflow: Mitigation: Safe RET695worker1 # [ 0.214392] Spectre V2 : Enabling IBPB for BPF696worker2 # [ 0.196436] APIC: Switch to symmetric I/O mode setup697worker2 # [ 0.197415] x2apic enabled698worker1 # [ 0.215112] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier699worker2 # [ 0.198197] APIC: Switched APIC routing to: physical x2apic700worker1 # [ 0.216386] active return thunk: srso_alias_return_thunk701worker1 # [ 0.217280] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'702lb # [ 0.210894] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization703worker2 # [ 0.199988] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1704worker1 # [ 0.218385] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'705worker1 # [ 0.219386] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'706worker2 # [ 0.200968] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns707lb # [ 0.212903] Spectre V2 : Enabling IBPB for BPF708worker1 # [ 0.220386] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'709worker2 # [ 0.202672] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)710lb # [ 0.214896] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier711worker1 # [ 0.221385] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'712worker2 # [ 0.203754] x86/cpu: User Mode Instruction Prevention (UMIP) activated713lb # [ 0.215894] active return thunk: srso_alias_return_thunk714worker1 # [ 0.222385] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'715worker2 # [ 0.204841] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127716lb # [ 0.217522] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'717worker1 # [ 0.223385] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'718worker2 # [ 0.206354] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0719lb # [ 0.218894] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'720worker1 # [ 0.224386] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256721lb # [ 0.219894] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'722worker2 # [ 0.207430] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto723worker1 # [ 0.225386] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64724lb # [ 0.220894] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'725worker1 # [ 0.226386] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512726worker2 # [ 0.208670] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl727lb # [ 0.221854] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'728worker1 # [ 0.227385] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024729worker2 # [ 0.209670] Transient Scheduler Attacks: Vulnerable: No microcode730lb # [ 0.222645] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'731worker1 # [ 0.228385] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8732worker2 # [ 0.211385] Spectre V2 : Mitigation: Enhanced / Automatic IBRS733lb # [ 0.223894] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'734worker2 # [ 0.212359] Speculative Return Stack Overflow: Mitigation: Safe RET735worker1 # [ 0.229385] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.736lb # [ 0.224893] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256737lb # [ 0.225894] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64738lb # [ 0.226894] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512739lb # [ 0.227894] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024740worker2 # [ 0.212669] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization741lb # [ 0.228894] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8742worker2 # [ 0.214676] Spectre V2 : Enabling IBPB for BPF743lb # [ 0.229894] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.744worker2 # [ 0.215670] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745worker2 # [ 0.216670] active return thunk: srso_alias_return_thunk746worker2 # [ 0.218334] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747worker2 # [ 0.219582] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748worker2 # [ 0.220432] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749worker2 # [ 0.221669] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750worker2 # [ 0.222669] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker2 # [ 0.223669] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752worker2 # [ 0.224668] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753worker2 # [ 0.225669] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754client # [ 0.267039] Freeing SMP alternatives memory: 44K755client # [ 0.267539] pid_max: default: 32768 minimum: 301756worker2 # [ 0.226669] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64757worker2 # [ 0.227669] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512758client # [ 0.268621] LSM: initializing lsm=capability,landlock,yama,bpf,ima759client # [ 0.269637] landlock: Up and running.760worker2 # [ 0.228669] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024761client # [ 0.270272] Yama: becoming mindful.762worker2 # [ 0.229669] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8763client # [ 0.271187] LSM support for eBPF active764worker2 # [ 0.230669] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.765client # [ 0.271635] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766client # [ 0.272572] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767client # [ 0.275583] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768client # [ 0.277068] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769client # [ 0.277545] ... version: 2770client # [ 0.278263] ... bit width: 48771client # [ 0.278539] ... generic counters: 6772client # [ 0.279271] ... generic bitmap: 000000000000003f773client # [ 0.279539] ... fixed-purpose counters: 0774client # [ 0.280253] ... fixed-purpose bitmap: 0000000000000000775client # [ 0.280538] ... value mask: 0000ffffffffffff776client # [ 0.281436] ... max period: 00007fffffffffff777client # [ 0.282231] ... global_ctrl mask: 000000000000003f778worker1 # [ 0.265351] Freeing SMP alternatives memory: 44K779client # [ 0.282645] signal: max sigframe size: 3376780worker1 # [ 0.265933] pid_max: default: 32768 minimum: 301781client # [ 0.283437] rcu: Hierarchical SRCU implementation.782client # [ 0.284141] rcu: Max phase no-delay instances is 400.783worker1 # [ 0.266470] LSM: initializing lsm=capability,landlock,yama,bpf,ima784worker1 # [ 0.267496] landlock: Up and running.785worker1 # [ 0.268386] Yama: becoming mindful.786worker1 # [ 0.269599] LSM support for eBPF active787lb # [ 0.263936] Freeing SMP alternatives memory: 44K788lb # [ 0.264704] pid_max: default: 32768 minimum: 301789worker1 # [ 0.270326] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)790lb # [ 0.265508] LSM: initializing lsm=capability,landlock,yama,bpf,ima791worker1 # [ 0.271430] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)792lb # [ 0.265992] landlock: Up and running.793client # [ 0.288941] smp: Bringing up secondary CPUs ...794lb # [ 0.267311] Yama: becoming mindful.795client # [ 0.289553] smp: Brought up 1 node, 1 CPU796lb # [ 0.268108] LSM support for eBPF active797client # [ 0.290245] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)798worker1 # [ 0.273878] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)799lb # [ 0.268947] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)800worker1 # [ 0.274952] Performance Events: Fam17h+ core perfctr, AMD PMU driver.801lb # [ 0.269919] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)802client # [ 0.290724] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)803worker1 # [ 0.275390] ... version: 2804client # [ 0.291773] devtmpfs: initialized805worker1 # [ 0.276126] ... bit width: 48806client # [ 0.292545] x86/mm: Memory block size: 128MB807worker1 # [ 0.276388] ... generic counters: 6808lb # [ 0.272378] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)809worker1 # [ 0.277066] ... generic bitmap: 000000000000003f810worker1 # [ 0.277395] ... fixed-purpose counters: 0811lb # [ 0.273427] Performance Events: Fam17h+ core perfctr, AMD PMU driver.812client # [ 0.294334] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)813worker1 # [ 0.278126] ... fixed-purpose bitmap: 0000000000000000814lb # [ 0.273899] ... version: 2815lb # [ 0.274663] ... bit width: 48816client # [ 0.295439] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).817worker1 # [ 0.278389] ... value mask: 0000ffffffffffff818lb # [ 0.274896] ... generic counters: 6819client # [ 0.296609] pinctrl core: initialized pinctrl subsystem820worker1 # [ 0.279365] ... max period: 00007fffffffffff821lb # [ 0.275578] ... generic bitmap: 000000000000003f822client # [ 0.297726] PM: RTC time: 09:49:59, date: 2026-09-20823worker1 # [ 0.280139] ... global_ctrl mask: 000000000000003f824lb # [ 0.275943] ... fixed-purpose counters: 0825worker1 # [ 0.280513] signal: max sigframe size: 3376826worker2 # [ 0.265012] Freeing SMP alternatives memory: 44K827lb # [ 0.276696] ... fixed-purpose bitmap: 0000000000000000828worker2 # [ 0.265672] pid_max: default: 32768 minimum: 301829worker1 # [ 0.281429] rcu: Hierarchical SRCU implementation.830lb # [ 0.277612] ... value mask: 0000ffffffffffff831worker2 # [ 0.266484] LSM: initializing lsm=capability,landlock,yama,bpf,ima832worker1 # [ 0.282333] rcu: Max phase no-delay instances is 400.833lb # [ 0.277896] ... max period: 00007fffffffffff834worker2 # [ 0.267718] landlock: Up and running.835client # [ 0.301150] NET: Registered PF_NETLINK/PF_ROUTE protocol family836lb # [ 0.278792] ... global_ctrl mask: 000000000000003f837worker2 # [ 0.268323] Yama: becoming mindful.838lb # [ 0.279692] signal: max sigframe size: 3376839worker2 # [ 0.268883] LSM support for eBPF active840client # [ 0.302044] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations841lb # [ 0.279978] rcu: Hierarchical SRCU implementation.842worker2 # [ 0.269764] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)843lb # [ 0.280769] rcu: Max phase no-delay instances is 400.844client # [ 0.302557] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations845worker2 # [ 0.270708] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)846client # [ 0.303806] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations847worker1 # [ 0.287932] smp: Bringing up secondary CPUs ...848client # [ 0.304549] audit: initializing netlink subsys (disabled)849worker1 # [ 0.288403] smp: Brought up 1 node, 1 CPU850worker2 # [ 0.273328] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)851client # [ 0.305710] thermal_sys: Registered thermal governor 'fair_share'852worker1 # [ 0.289133] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)853client # [ 0.305712] thermal_sys: Registered thermal governor 'bang_bang'854worker2 # [ 0.274182] Performance Events: Fam17h+ core perfctr, AMD PMU driver.855lb # [ 0.285936] smp: Bringing up secondary CPUs ...856client # [ 0.306540] thermal_sys: Registered thermal governor 'step_wise'857worker2 # [ 0.274674] ... version: 2858lb # [ 0.286665] smp: Brought up 1 node, 1 CPU859client # [ 0.307499] thermal_sys: Registered thermal governor 'user_space'860worker1 # [ 0.289617] Memory: 1454536K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)861worker2 # [ 0.275409] ... bit width: 48862lb # [ 0.286904] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)863worker2 # [ 0.275672] ... generic counters: 6864worker1 # [ 0.290634] devtmpfs: initialized865client # [ 0.308232] audit: type=2000 audit(1789897799.976:1): state=initialized audit_enabled=0 res=1866worker2 # [ 0.276339] ... generic bitmap: 000000000000003f867worker1 # [ 0.291525] x86/mm: Memory block size: 128MB868worker2 # [ 0.276682] ... fixed-purpose counters: 0869client # [ 0.309541] thermal_sys: Registered thermal governor 'power_allocator'870lb # [ 0.288078] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)871client # [ 0.309563] cpuidle: using governor menu872worker2 # [ 0.277382] ... fixed-purpose bitmap: 0000000000000000873lb # [ 0.289129] devtmpfs: initialized874worker2 # [ 0.277672] ... value mask: 0000ffffffffffff875lb # [ 0.289943] x86/mm: Memory block size: 128MB876worker1 # [ 0.293467] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)877client # [ 0.311746] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5878worker2 # [ 0.278544] ... max period: 00007fffffffffff879worker2 # [ 0.279336] ... global_ctrl mask: 000000000000003f880worker1 # [ 0.294419] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).881client # [ 0.312784] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]882worker2 # [ 0.279780] signal: max sigframe size: 3376883lb # [ 0.291662] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)884worker1 # [ 0.295481] pinctrl core: initialized pinctrl subsystem885client # [ 0.313542] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry886worker2 # [ 0.280544] rcu: Hierarchical SRCU implementation.887lb # [ 0.292801] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).888worker1 # [ 0.296685] PM: RTC time: 09:49:59, date: 2026-09-20889client # [ 0.314550] PCI: Using configuration type 1 for base access890worker2 # [ 0.281250] rcu: Max phase no-delay instances is 400.891lb # [ 0.293964] pinctrl core: initialized pinctrl subsystem892client # [ 0.315611] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.893lb # [ 0.295061] PM: RTC time: 09:49:59, date: 2026-09-20894worker1 # [ 0.300308] NET: Registered PF_NETLINK/PF_ROUTE protocol family895worker2 # [ 0.286150] smp: Bringing up secondary CPUs ...896lb # [ 0.298554] NET: Registered PF_NETLINK/PF_ROUTE protocol family897worker1 # [ 0.301813] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations898worker2 # [ 0.286686] smp: Brought up 1 node, 1 CPU899client # [ 0.320763] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages900lb # [ 0.299379] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations901worker2 # [ 0.287388] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)902worker1 # [ 0.302413] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations903client # [ 0.321540] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page904lb # [ 0.299916] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations905worker1 # [ 0.303712] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations906worker2 # [ 0.287831] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)907lb # [ 0.301157] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations908worker1 # [ 0.304399] audit: initializing netlink subsys (disabled)909worker2 # [ 0.288880] devtmpfs: initialized910lb # [ 0.301906] audit: initializing netlink subsys (disabled)911worker2 # [ 0.289699] x86/mm: Memory block size: 128MB912worker1 # [ 0.305590] thermal_sys: Registered thermal governor 'fair_share'913lb # [ 0.303094] thermal_sys: Registered thermal governor 'fair_share'914worker1 # [ 0.305593] thermal_sys: Registered thermal governor 'bang_bang'915client # [ 0.326540] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages916lb # [ 0.303097] thermal_sys: Registered thermal governor 'bang_bang'917worker1 # [ 0.306389] thermal_sys: Registered thermal governor 'step_wise'918worker2 # [ 0.291469] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)919client # [ 0.327538] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page920worker1 # [ 0.307378] thermal_sys: Registered thermal governor 'user_space'921lb # [ 0.303899] audit: type=2000 audit(1789897800.002:1): state=initialized audit_enabled=0 res=1922worker2 # [ 0.292542] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).923lb # [ 0.305897] thermal_sys: Registered thermal governor 'step_wise'924worker1 # [ 0.308092] audit: type=2000 audit(1789897799.998:1): state=initialized audit_enabled=0 res=1925worker2 # [ 0.293765] pinctrl core: initialized pinctrl subsystem926lb # [ 0.305899] thermal_sys: Registered thermal governor 'user_space'927worker1 # [ 0.309391] thermal_sys: Registered thermal governor 'power_allocator'928worker2 # [ 0.294832] PM: RTC time: 09:49:59, date: 2026-09-20929worker1 # [ 0.309406] cpuidle: using governor menu930lb # [ 0.306855] thermal_sys: Registered thermal governor 'power_allocator'931lb # [ 0.307689] cpuidle: using governor menu932worker1 # [ 0.311676] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5933lb # [ 0.309980] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5934worker2 # [ 0.298172] NET: Registered PF_NETLINK/PF_ROUTE protocol family935worker1 # [ 0.312604] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]936lb # [ 0.311120] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]937worker1 # [ 0.313391] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry938worker2 # [ 0.299168] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations939lb # [ 0.311899] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry940worker1 # [ 0.314401] PCI: Using configuration type 1 for base access941worker2 # [ 0.299690] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations942lb # [ 0.312908] PCI: Using configuration type 1 for base access943client # [ 0.337908] ACPI: Added _OSI(Module Device)944worker1 # [ 0.315492] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.945worker2 # [ 0.300935] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations946client # [ 0.338541] ACPI: Added _OSI(Processor Device)947lb # [ 0.314027] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.948worker2 # [ 0.301681] audit: initializing netlink subsys (disabled)949client # [ 0.339256] ACPI: Added _OSI(Processor Aggregator Device)950worker2 # [ 0.302781] thermal_sys: Registered thermal governor 'fair_share'951worker2 # [ 0.302783] thermal_sys: Registered thermal governor 'bang_bang'952worker2 # [ 0.303673] thermal_sys: Registered thermal governor 'step_wise'953worker2 # [ 0.304607] thermal_sys: Registered thermal governor 'user_space'954worker1 # [ 0.320623] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages955lb # [ 0.319163] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages956worker1 # [ 0.321390] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page957worker2 # [ 0.305405] audit: type=2000 audit(1789897800.016:1): state=initialized audit_enabled=0 res=1958lb # [ 0.319898] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page959worker2 # [ 0.306675] thermal_sys: Registered thermal governor 'power_allocator'960worker2 # [ 0.306690] cpuidle: using governor menu961worker2 # [ 0.308885] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5962client # [ 0.348029] ACPI: 1 ACPI AML tables successfully acquired and loaded963worker1 # [ 0.326389] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages964worker2 # [ 0.309901] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]965lb # [ 0.324898] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages966worker2 # [ 0.310674] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry967worker1 # [ 0.327388] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page968client # [ 0.349437] ACPI: Interpreter enabled969client # [ 0.349985] ACPI: PM: (supports S0 S3 S4 S5)970lb # [ 0.325896] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page971worker2 # [ 0.311685] PCI: Using configuration type 1 for base access972worker2 # [ 0.312736] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.973client # [ 0.352540] ACPI: Using IOAPIC for interrupt routing974client # [ 0.353450] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug975client # [ 0.356540] PCI: Using E820 reservations for host bridge windows976client # [ 0.357655] ACPI: Enabled 2 GPEs in block 00 to 3F977worker2 # [ 0.319915] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages978worker1 # [ 0.337776] ACPI: Added _OSI(Module Device)979worker2 # [ 0.320673] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page980lb # [ 0.336238] ACPI: Added _OSI(Module Device)981worker1 # [ 0.338390] ACPI: Added _OSI(Processor Device)982lb # [ 0.336898] ACPI: Added _OSI(Processor Device)983worker1 # [ 0.339135] ACPI: Added _OSI(Processor Aggregator Device)984lb # [ 0.337656] ACPI: Added _OSI(Processor Aggregator Device)985worker2 # [ 0.325673] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages986worker2 # [ 0.326673] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page987client # [ 0.366212] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])988client # [ 0.367151] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]989lb # [ 0.345408] ACPI: 1 ACPI AML tables successfully acquired and loaded990client # [ 0.367618] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]991worker1 # [ 0.347942] ACPI: 1 ACPI AML tables successfully acquired and loaded992client # [ 0.368661] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]993client # [ 0.369870] PCI host bridge to bus 0000:00994client # [ 0.370544] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]995lb # [ 0.349299] ACPI: Interpreter enabled996worker1 # [ 0.351795] ACPI: Interpreter enabled997client # [ 0.371539] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]998lb # [ 0.349912] ACPI: PM: (supports S0 S3 S4 S5)999worker1 # [ 0.352403] ACPI: PM: (supports S0 S3 S4 S5)1000lb # [ 0.350603] ACPI: Using IOAPIC for interrupt routing1001worker2 # [ 0.336676] ACPI: Added _OSI(Module Device)1002client # [ 0.372539] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1003worker1 # [ 0.353129] ACPI: Using IOAPIC for interrupt routing1004worker2 # [ 0.337344] ACPI: Added _OSI(Processor Device)1005client # [ 0.373539] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1006worker2 # [ 0.337672] ACPI: Added _OSI(Processor Aggregator Device)1007worker1 # [ 0.353433] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1008client # [ 0.374539] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1009worker1 # [ 0.354389] PCI: Using E820 reservations for host bridge windows1010lb # [ 0.352942] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1011client # [ 0.375539] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1012lb # [ 0.353897] PCI: Using E820 reservations for host bridge windows1013client # [ 0.376540] pci_bus 0000:00: root bus resource [bus 00-ff]1014worker1 # [ 0.357520] ACPI: Enabled 2 GPEs in block 00 to 3F1015client # [ 0.377546] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1016lb # [ 0.357005] ACPI: Enabled 2 GPEs in block 00 to 3F1017client # [ 0.379047] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1018worker2 # [ 0.345062] ACPI: 1 ACPI AML tables successfully acquired and loaded1019worker2 # [ 0.349078] ACPI: Interpreter enabled1020worker2 # [ 0.349686] ACPI: PM: (supports S0 S3 S4 S5)1021worker1 # [ 0.366097] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1022worker2 # [ 0.350450] ACPI: Using IOAPIC for interrupt routing1023client # [ 0.381596] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1024lb # [ 0.365099] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1025client # [ 0.382551] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1026worker1 # [ 0.366394] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1027worker2 # [ 0.350706] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1028client # [ 0.383479] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1029worker2 # [ 0.351672] PCI: Using E820 reservations for host bridge windows1030lb # [ 0.365903] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1031worker1 # [ 0.367916] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1032lb # [ 0.366984] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1033client # [ 0.384501] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1034worker1 # [ 0.368510] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1035lb # [ 0.368020] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1036worker1 # [ 0.369772] PCI host bridge to bus 0000:001037worker2 # [ 0.354750] ACPI: Enabled 2 GPEs in block 00 to 3F1038client # [ 0.386284] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1039lb # [ 0.369235] PCI host bridge to bus 0000:001040worker1 # [ 0.370392] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1041lb # [ 0.369901] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1042worker1 # [ 0.371388] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1043lb # [ 0.370897] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1044worker1 # [ 0.372388] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1045client # [ 0.389564] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1046lb # [ 0.371897] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1047worker1 # [ 0.373388] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1048client # [ 0.390409] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1049lb # [ 0.372896] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1050worker1 # [ 0.374388] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1051client # [ 0.391290] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1052lb # [ 0.373897] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1053client # [ 0.391545] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1054worker1 # [ 0.375392] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1055lb # [ 0.374896] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1056worker1 # [ 0.376411] pci_bus 0000:00: root bus resource [bus 00-ff]1057lb # [ 0.375910] pci_bus 0000:00: root bus resource [bus 00-ff]1058worker2 # [ 0.363348] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1059client # [ 0.393074] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1060worker1 # [ 0.377378] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1061worker2 # [ 0.363678] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1062lb # [ 0.376899] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1063worker1 # [ 0.378789] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1064worker2 # [ 0.365261] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1065lb # [ 0.378349] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1066client # [ 0.395663] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1067worker2 # [ 0.365794] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1068client # [ 0.396546] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1069worker2 # [ 0.367029] PCI host bridge to bus 0000:001070client # [ 0.397519] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1071worker2 # [ 0.367676] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1072worker2 # [ 0.368672] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1073client # [ 0.398974] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1074worker2 # [ 0.369672] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1075worker1 # [ 0.381440] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1076worker2 # [ 0.370672] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1077lb # [ 0.380948] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1078worker1 # [ 0.382400] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1079client # [ 0.400557] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1080worker2 # [ 0.371672] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1081lb # [ 0.381997] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1082worker1 # [ 0.383350] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1083client # [ 0.401384] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1084worker2 # [ 0.372671] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1085lb # [ 0.382912] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1086client # [ 0.402248] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1087worker2 # [ 0.373672] pci_bus 0000:00: root bus resource [bus 00-ff]1088worker1 # [ 0.384375] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1089lb # [ 0.384192] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1090worker2 # [ 0.374608] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1091client # [ 0.403562] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1092worker1 # [ 0.386089] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1093lb # [ 0.385588] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1094worker2 # [ 0.376101] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1095client # [ 0.405549] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1096worker1 # [ 0.388418] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1097client # [ 0.406417] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1098lb # [ 0.387927] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1099worker1 # [ 0.389302] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1100client # [ 0.407279] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1101lb # [ 0.388786] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1102worker1 # [ 0.390144] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1103lb # [ 0.389661] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1104worker1 # [ 0.390394] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1105client # [ 0.408084] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1106lb # [ 0.389903] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1107worker2 # [ 0.378731] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1108worker1 # [ 0.391966] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1109lb # [ 0.391457] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1110worker2 # [ 0.379684] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1111client # [ 0.409555] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1112worker2 # [ 0.380603] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1113worker1 # [ 0.393395] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1114client # [ 0.410546] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1115worker2 # [ 0.381612] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1116worker1 # [ 0.394236] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1117lb # [ 0.393904] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1118client # [ 0.411506] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1119lb # [ 0.394741] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1120worker1 # [ 0.395124] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1121client # [ 0.412918] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1122lb # [ 0.395671] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1123worker2 # [ 0.383717] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1124worker1 # [ 0.395955] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1125lb # [ 0.397259] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1126client # [ 0.414547] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1127worker2 # [ 0.386703] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1128client # [ 0.415413] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1129worker2 # [ 0.387559] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1130worker1 # [ 0.398420] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1131client # [ 0.416306] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1132lb # [ 0.398928] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1133worker2 # [ 0.388410] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1134lb # [ 0.399755] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1135worker1 # [ 0.399258] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1136worker2 # [ 0.388678] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1137lb # [ 0.400705] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1138worker1 # [ 0.400410] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1139client # [ 0.417117] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1140worker2 # [ 0.390381] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1141worker1 # [ 0.401948] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1142lb # [ 0.402716] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143client # [ 0.418547] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1144client # [ 0.419409] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1145lb # [ 0.404904] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1146worker1 # [ 0.403395] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1147worker2 # [ 0.393679] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1148client # [ 0.420309] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1149worker1 # [ 0.404224] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1150lb # [ 0.405750] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1151worker2 # [ 0.394496] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1152client # [ 0.420545] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1153worker1 # [ 0.405109] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1154lb # [ 0.406623] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1155worker2 # [ 0.395357] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1156client # [ 0.422028] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1157worker1 # [ 0.405956] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1158lb # [ 0.407465] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1159worker2 # [ 0.396242] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1160client # [ 0.423552] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1161worker1 # [ 0.408306] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1162client # [ 0.424544] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1163worker2 # [ 0.398708] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1164lb # [ 0.408928] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1165worker1 # [ 0.409058] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1166lb # [ 0.409911] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1167worker1 # [ 0.409409] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1168client # [ 0.426071] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1169worker2 # [ 0.399543] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1170lb # [ 0.410878] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1171worker2 # [ 0.400695] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1172worker1 # [ 0.410961] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1173client # [ 0.427546] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1174lb # [ 0.412294] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1175worker2 # [ 0.402240] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1176client # [ 0.428397] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1177worker1 # [ 0.412421] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1178client # [ 0.429297] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1179lb # [ 0.413931] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1180worker1 # [ 0.413267] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1181lb # [ 0.414795] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1182worker2 # [ 0.403702] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1183worker1 # [ 0.414131] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1184client # [ 0.430109] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1185lb # [ 0.415648] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1186worker2 # [ 0.404575] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1187worker2 # [ 0.405405] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1188worker1 # [ 0.415547] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1189lb # [ 0.416477] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1190client # [ 0.431547] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1191client # [ 0.433190] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1192worker2 # [ 0.406287] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1193worker1 # [ 0.417395] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1194lb # [ 0.417904] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1195worker1 # [ 0.418257] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1196client # [ 0.433561] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1197lb # [ 0.418731] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1198worker1 # [ 0.419129] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1199worker2 # [ 0.407704] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1200lb # [ 0.419656] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1201client # [ 0.435113] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1202worker1 # [ 0.419394] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1203worker2 # [ 0.408574] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1204lb # [ 0.420717] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1205client # [ 0.436219] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1206worker2 # [ 0.409406] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1207worker1 # [ 0.420877] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1208lb # [ 0.422190] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1209client # [ 0.436734] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1210worker2 # [ 0.410231] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1211client # [ 0.438175] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1212worker1 # [ 0.422298] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1213lb # [ 0.423886] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1214worker1 # [ 0.423410] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1215worker2 # [ 0.411703] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1216lb # [ 0.424651] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1217worker1 # [ 0.424942] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1218worker2 # [ 0.412577] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1219lb # [ 0.425421] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1220worker2 # [ 0.413694] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1221worker1 # [ 0.426396] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1222lb # [ 0.426942] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1223worker1 # [ 0.427280] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1224worker2 # [ 0.415266] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1225lb # [ 0.427847] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1226worker1 # [ 0.428124] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1227lb # [ 0.428655] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1228worker2 # [ 0.416700] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1229worker1 # [ 0.428968] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1230worker2 # [ 0.417562] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1231lb # [ 0.429461] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1232worker2 # [ 0.418422] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1233worker2 # [ 0.418678] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1234worker1 # [ 0.430874] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1235worker1 # [ 0.431395] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1236lb # [ 0.431570] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1237client # [ 0.438740] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1238lb # [ 0.431903] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1239worker1 # [ 0.432363] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1240worker2 # [ 0.420198] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1241lb # [ 0.432883] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1242worker1 # [ 0.433828] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1243worker2 # [ 0.421685] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1244lb # [ 0.434360] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1245worker1 # [ 0.434946] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1246worker2 # [ 0.422632] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1247client # [ 0.442173] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1248lb # [ 0.435421] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1249worker1 # [ 0.435592] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1250client # [ 0.442777] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1251worker2 # [ 0.424019] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1252lb # [ 0.436100] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1253worker1 # [ 0.436901] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1254client # [ 0.444460] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1255lb # [ 0.437406] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1256worker2 # [ 0.426370] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1257client # [ 0.445494] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1258worker2 # [ 0.426679] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1259client # [ 0.446784] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1260worker2 # [ 0.427641] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1261client # [ 0.447780] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1262worker2 # [ 0.429683] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1263client # [ 0.450471] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1264worker2 # [ 0.431679] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1265client # [ 0.451184] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1266worker2 # [ 0.432576] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1267worker2 # [ 0.433403] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1268client # [ 0.451859] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1269client # [ 0.453237] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1270worker2 # [ 0.434223] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1271worker1 # [ 0.437610] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1272worker2 # [ 0.435277] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1273lb # [ 0.438084] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1274worker2 # [ 0.435866] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1275client # [ 0.456462] ACPI: PCI: Interrupt link LNKA configured for IRQ 101276worker1 # [ 0.441041] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1277client # [ 0.457369] ACPI: PCI: Interrupt link LNKB configured for IRQ 101278worker2 # [ 0.437386] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1279lb # [ 0.441419] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1280worker1 # [ 0.441628] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1281client # [ 0.458663] ACPI: PCI: Interrupt link LNKC configured for IRQ 111282lb # [ 0.442129] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1283client # [ 0.459650] ACPI: PCI: Interrupt link LNKD configured for IRQ 111284worker1 # [ 0.443395] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1285client # [ 0.460650] ACPI: PCI: Interrupt link LNKE configured for IRQ 101286lb # [ 0.443819] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1287worker1 # [ 0.444614] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1288client # [ 0.461640] ACPI: PCI: Interrupt link LNKF configured for IRQ 101289lb # [ 0.444857] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1290client # [ 0.462639] ACPI: PCI: Interrupt link LNKG configured for IRQ 111291worker1 # [ 0.445674] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1292client # [ 0.463637] ACPI: PCI: Interrupt link LNKH configured for IRQ 111293lb # [ 0.446177] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1294worker1 # [ 0.446645] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1295client # [ 0.464575] ACPI: PCI: Interrupt link GSIA configured for IRQ 161296client # [ 0.465555] ACPI: PCI: Interrupt link GSIB configured for IRQ 171297lb # [ 0.447161] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1298client # [ 0.466507] ACPI: PCI: Interrupt link GSIC configured for IRQ 181299worker1 # [ 0.448900] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1300client # [ 0.467275] ACPI: PCI: Interrupt link GSID configured for IRQ 191301worker1 # [ 0.449395] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1302lb # [ 0.449514] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1303client # [ 0.467555] ACPI: PCI: Interrupt link GSIE configured for IRQ 201304lb # [ 0.449904] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1305worker1 # [ 0.450668] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1306client # [ 0.468552] ACPI: PCI: Interrupt link GSIF configured for IRQ 211307worker2 # [ 0.437886] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1308client # [ 0.469490] ACPI: PCI: Interrupt link GSIG configured for IRQ 221309lb # [ 0.451163] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1310worker1 # [ 0.452182] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1311worker2 # [ 0.440286] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1312client # [ 0.470273] ACPI: PCI: Interrupt link GSIH configured for IRQ 231313lb # [ 0.452671] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1314worker2 # [ 0.440896] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1315client # [ 0.471664] iommu: Default domain type: Translated1316client # [ 0.472435] iommu: DMA domain TLB invalidation policy: lazy mode1317worker2 # [ 0.442242] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1318worker1 # [ 0.455986] ACPI: PCI: Interrupt link LNKA configured for IRQ 101319client # [ 0.473491] ACPI: bus type USB registered1320client # [ 0.474082] usbcore: registered new interface driver usbfs1321worker2 # [ 0.442924] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1322lb # [ 0.455815] ACPI: PCI: Interrupt link LNKA configured for IRQ 101323worker1 # [ 0.456495] ACPI: PCI: Interrupt link LNKB configured for IRQ 101324client # [ 0.474555] usbcore: registered new interface driver hub1325worker1 # [ 0.457491] ACPI: PCI: Interrupt link LNKC configured for IRQ 111326lb # [ 0.456748] ACPI: PCI: Interrupt link LNKB configured for IRQ 101327client # [ 0.475405] usbcore: registered new device driver usb1328worker2 # [ 0.443959] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1329worker1 # [ 0.458485] ACPI: PCI: Interrupt link LNKD configured for IRQ 111330lb # [ 0.457995] ACPI: PCI: Interrupt link LNKC configured for IRQ 111331client # [ 0.476995] NetLabel: Initializing1332worker2 # [ 0.444934] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1333worker1 # [ 0.459502] ACPI: PCI: Interrupt link LNKE configured for IRQ 101334client # [ 0.477540] NetLabel: domain hash size = 1281335lb # [ 0.459009] ACPI: PCI: Interrupt link LNKD configured for IRQ 111336client # [ 0.478241] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1337worker1 # [ 0.460533] ACPI: PCI: Interrupt link LNKF configured for IRQ 101338worker2 # [ 0.446661] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1339lb # [ 0.460006] ACPI: PCI: Interrupt link LNKE configured for IRQ 101340client # [ 0.478586] NetLabel: unlabeled traffic allowed by default1341worker1 # [ 0.461506] ACPI: PCI: Interrupt link LNKG configured for IRQ 111342worker2 # [ 0.447301] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1343lb # [ 0.460999] ACPI: PCI: Interrupt link LNKF configured for IRQ 101344client # [ 0.479464] PCI: Using ACPI for IRQ routing1345worker1 # [ 0.462486] ACPI: PCI: Interrupt link LNKH configured for IRQ 111346lb # [ 0.461996] ACPI: PCI: Interrupt link LNKG configured for IRQ 111347worker2 # [ 0.447988] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1348worker1 # [ 0.463432] ACPI: PCI: Interrupt link GSIA configured for IRQ 161349lb # [ 0.462994] ACPI: PCI: Interrupt link LNKH configured for IRQ 111350worker1 # [ 0.464402] ACPI: PCI: Interrupt link GSIB configured for IRQ 171351worker2 # [ 0.449296] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1352lb # [ 0.463934] ACPI: PCI: Interrupt link GSIA configured for IRQ 161353worker1 # [ 0.465379] ACPI: PCI: Interrupt link GSIC configured for IRQ 181354lb # [ 0.464908] ACPI: PCI: Interrupt link GSIB configured for IRQ 171355worker1 # [ 0.466283] ACPI: PCI: Interrupt link GSID configured for IRQ 191356lb # [ 0.465911] ACPI: PCI: Interrupt link GSIC configured for IRQ 181357worker1 # [ 0.467199] ACPI: PCI: Interrupt link GSIE configured for IRQ 201358lb # [ 0.466912] ACPI: PCI: Interrupt link GSID configured for IRQ 191359worker1 # [ 0.468196] ACPI: PCI: Interrupt link GSIF configured for IRQ 211360worker2 # [ 0.452872] ACPI: PCI: Interrupt link LNKA configured for IRQ 101361lb # [ 0.467908] ACPI: PCI: Interrupt link GSIE configured for IRQ 201362worker1 # [ 0.469178] ACPI: PCI: Interrupt link GSIG configured for IRQ 221363worker2 # [ 0.453778] ACPI: PCI: Interrupt link LNKB configured for IRQ 101364lb # [ 0.468909] ACPI: PCI: Interrupt link GSIF configured for IRQ 211365worker1 # [ 0.470182] ACPI: PCI: Interrupt link GSIH configured for IRQ 231366worker2 # [ 0.454769] ACPI: PCI: Interrupt link LNKC configured for IRQ 111367lb # [ 0.469892] ACPI: PCI: Interrupt link GSIG configured for IRQ 221368worker2 # [ 0.455768] ACPI: PCI: Interrupt link LNKD configured for IRQ 111369lb # [ 0.470905] ACPI: PCI: Interrupt link GSIH configured for IRQ 231370worker1 # [ 0.472318] iommu: Default domain type: Translated1371worker2 # [ 0.456771] ACPI: PCI: Interrupt link LNKE configured for IRQ 101372worker1 # [ 0.473040] iommu: DMA domain TLB invalidation policy: lazy mode1373lb # [ 0.472908] iommu: Default domain type: Translated1374worker2 # [ 0.457771] ACPI: PCI: Interrupt link LNKF configured for IRQ 101375worker1 # [ 0.473631] ACPI: bus type USB registered1376lb # [ 0.473714] iommu: DMA domain TLB invalidation policy: lazy mode1377worker2 # [ 0.458771] ACPI: PCI: Interrupt link LNKG configured for IRQ 111378worker1 # [ 0.474407] usbcore: registered new interface driver usbfs1379lb # [ 0.474915] ACPI: bus type USB registered1380worker2 # [ 0.459770] ACPI: PCI: Interrupt link LNKH configured for IRQ 111381worker1 # [ 0.475360] usbcore: registered new interface driver hub1382lb # [ 0.475694] usbcore: registered new interface driver usbfs1383worker2 # [ 0.460719] ACPI: PCI: Interrupt link GSIA configured for IRQ 161384worker1 # [ 0.476098] usbcore: registered new device driver usb1385lb # [ 0.476627] usbcore: registered new interface driver hub1386worker2 # [ 0.461686] ACPI: PCI: Interrupt link GSIB configured for IRQ 171387lb # [ 0.476906] usbcore: registered new device driver usb1388worker1 # [ 0.477249] NetLabel: Initializing1389worker2 # [ 0.462648] ACPI: PCI: Interrupt link GSIC configured for IRQ 181390worker1 # [ 0.477827] NetLabel: domain hash size = 1281391lb # [ 0.478543] NetLabel: Initializing1392worker2 # [ 0.463410] ACPI: PCI: Interrupt link GSID configured for IRQ 191393worker1 # [ 0.478388] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1394lb # [ 0.478902] NetLabel: domain hash size = 1281395worker2 # [ 0.463688] ACPI: PCI: Interrupt link GSIE configured for IRQ 201396worker1 # [ 0.479373] NetLabel: unlabeled traffic allowed by default1397lb # [ 0.479653] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1398worker2 # [ 0.464609] ACPI: PCI: Interrupt link GSIF configured for IRQ 211399worker1 # [ 0.480126] PCI: Using ACPI for IRQ routing1400lb # [ 0.479932] NetLabel: unlabeled traffic allowed by default1401worker2 # [ 0.465375] ACPI: PCI: Interrupt link GSIG configured for IRQ 221402lb # [ 0.480859] PCI: Using ACPI for IRQ routing1403worker2 # [ 0.465686] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404worker2 # [ 0.467700] iommu: Default domain type: Translated1405worker2 # [ 0.468492] iommu: DMA domain TLB invalidation policy: lazy mode1406worker2 # [ 0.469654] ACPI: bus type USB registered1407worker2 # [ 0.470228] usbcore: registered new interface driver usbfs1408worker2 # [ 0.470685] usbcore: registered new interface driver hub1409worker2 # [ 0.471546] usbcore: registered new device driver usb1410worker2 # [ 0.473201] NetLabel: Initializing1411worker2 # [ 0.473673] NetLabel: domain hash size = 1281412worker2 # [ 0.474397] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker2 # [ 0.474711] NetLabel: unlabeled traffic allowed by default1414worker2 # [ 0.475601] PCI: Using ACPI for IRQ routing1415client # [ 0.523368] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416client # [ 0.523535] pci 0000:00:01.0: vgaarb: bridge control possible1417client # [ 0.523535] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418client # [ 0.523544] vgaarb: loaded1419client # [ 0.524262] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420client # [ 0.524540] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.528619] clocksource: Switched to clocksource kvm-clock1422client # [ 0.530247] VFS: Disk quotas dquot_6.6.01423client # [ 0.532653] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424client # [ 0.533965] pnp: PnP ACPI init1425client # [ 0.534762] ACPI: IRQ 4 override to edge(!), high(!)1426client # [ 0.535736] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1427client # [ 0.537229] pnp: PnP ACPI: found 6 devices1428worker1 # [ 0.523648] pci 0000:00:01.0: vgaarb: setting as boot VGA device1429lb # [ 0.524939] pci 0000:00:01.0: vgaarb: setting as boot VGA device1430worker1 # [ 0.524384] pci 0000:00:01.0: vgaarb: bridge control possible1431lb # [ 0.525893] pci 0000:00:01.0: vgaarb: bridge control possible1432worker1 # [ 0.524384] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1433worker1 # [ 0.524393] vgaarb: loaded1434lb # [ 0.525893] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435lb # [ 0.525900] vgaarb: loaded1436worker1 # [ 0.525136] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01437lb # [ 0.526625] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01438worker1 # [ 0.525389] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1439lb # [ 0.526897] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1440client # [ 0.544704] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1441client # [ 0.546110] clocksource: Switched to clocksource acpi_pm1442client # [ 0.547029] NET: Registered PF_INET protocol family1443worker1 # [ 0.528470] clocksource: Switched to clocksource kvm-clock1444client # [ 0.548140] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1445lb # [ 0.529990] clocksource: Switched to clocksource kvm-clock1446worker2 # [ 0.519042] pci 0000:00:01.0: vgaarb: setting as boot VGA device1447worker1 # [ 0.532021] VFS: Disk quotas dquot_6.6.01448lb # [ 0.533382] VFS: Disk quotas dquot_6.6.01449worker2 # [ 0.519668] pci 0000:00:01.0: vgaarb: bridge control possible1450worker1 # [ 0.532734] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1451lb # [ 0.534091] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1452worker2 # [ 0.519668] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1453worker1 # [ 0.534051] pnp: PnP ACPI init1454lb # [ 0.535419] pnp: PnP ACPI init1455worker2 # [ 0.519676] vgaarb: loaded1456worker1 # [ 0.534843] ACPI: IRQ 4 override to edge(!), high(!)1457lb # [ 0.536179] ACPI: IRQ 4 override to edge(!), high(!)1458worker2 # [ 0.520374] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01459worker2 # [ 0.520673] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1460worker1 # [ 0.535847] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1461lb # [ 0.537163] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1462worker1 # [ 0.537397] pnp: PnP ACPI: found 6 devices1463lb # [ 0.538680] pnp: PnP ACPI: found 6 devices1464worker2 # [ 0.523753] clocksource: Switched to clocksource kvm-clock1465worker2 # [ 0.527110] VFS: Disk quotas dquot_6.6.01466worker2 # [ 0.527813] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1467client # [ 0.564017] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1468worker2 # [ 0.529154] pnp: PnP ACPI init1469worker1 # [ 0.545042] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1470lb # [ 0.546210] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1471client # [ 0.565522] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1472worker2 # [ 0.529925] ACPI: IRQ 4 override to edge(!), high(!)1473worker1 # [ 0.546482] clocksource: Switched to clocksource acpi_pm1474lb # [ 0.547643] clocksource: Switched to clocksource acpi_pm1475client # [ 0.566794] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1476worker1 # [ 0.547442] NET: Registered PF_INET protocol family1477lb # [ 0.548617] NET: Registered PF_INET protocol family1478worker2 # [ 0.530911] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1479client # [ 0.568074] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1480worker2 # [ 0.532389] pnp: PnP ACPI: found 6 devices1481worker1 # [ 0.548602] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1482lb # [ 0.549748] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1483client # [ 0.569290] TCP: Hash tables configured (established 16384 bind 16384)1484client # [ 0.570396] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1485client # [ 0.571619] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1486client # [ 0.572671] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1487client # [ 0.573851] NET: Registered PF_UNIX/PF_LOCAL protocol family1488client # [ 0.574778] NET: Registered PF_XDP protocol family1489client # [ 0.575598] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1490client # [ 0.576585] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1491worker2 # [ 0.539915] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1492worker2 # [ 0.541336] clocksource: Switched to clocksource acpi_pm1493client # [ 0.577561] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1494client # [ 0.578631] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1495worker2 # [ 0.542291] NET: Registered PF_INET protocol family1496client # [ 0.579735] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1497client # [ 0.580802] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1498worker2 # [ 0.544450] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1499client # [ 0.582432] ACPI: \_SB_.GSIA: Enabled at IRQ 161500client # [ 0.584539] ACPI: \_SB_.GSIB: Enabled at IRQ 171501worker1 # [ 0.564635] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1502lb # [ 0.565885] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1503worker1 # [ 0.566205] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1504client # [ 0.586691] ACPI: \_SB_.GSIC: Enabled at IRQ 181505lb # [ 0.567429] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1506worker1 # [ 0.567545] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1507lb # [ 0.568728] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1508client # [ 0.588701] ACPI: \_SB_.GSID: Enabled at IRQ 191509worker1 # [ 0.568924] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1510lb # [ 0.570055] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1511client # [ 0.590370] PCI: CLS 0 bytes, default 641512worker1 # [ 0.570185] TCP: Hash tables configured (established 16384 bind 16384)1513lb # [ 0.571294] TCP: Hash tables configured (established 16384 bind 16384)1514worker1 # [ 0.571336] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1515lb # [ 0.572422] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1516client # [ 0.591258] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1517worker1 # [ 0.572593] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1518lb # [ 0.573646] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1519client # [ 0.592933] Trying to unpack rootfs image as initramfs...1520worker1 # [ 0.573669] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1521lb # [ 0.574697] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1522worker1 # [ 0.574926] NET: Registered PF_UNIX/PF_LOCAL protocol family1523lb # [ 0.575916] NET: Registered PF_UNIX/PF_LOCAL protocol family1524lb # [ 0.576898] NET: Registered PF_XDP protocol family1525worker1 # [ 0.575921] NET: Registered PF_XDP protocol family1526lb # [ 0.577740] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1527worker1 # [ 0.576776] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1528lb # [ 0.578751] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1529worker1 # [ 0.577781] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1530worker2 # [ 0.561895] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1531lb # [ 0.579752] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1532worker1 # [ 0.578797] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1533lb # [ 0.580828] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1534worker1 # [ 0.579909] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1535worker2 # [ 0.563544] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1536lb # [ 0.581867] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1537worker1 # [ 0.581014] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1538worker2 # [ 0.564852] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1539lb # [ 0.582936] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1540worker1 # [ 0.582136] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1541worker2 # [ 0.566224] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1542lb # [ 0.584624] ACPI: \_SB_.GSIA: Enabled at IRQ 161543worker1 # [ 0.583844] ACPI: \_SB_.GSIA: Enabled at IRQ 161544worker2 # [ 0.567502] TCP: Hash tables configured (established 16384 bind 16384)1545worker2 # [ 0.568663] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1546lb # [ 0.586776] ACPI: \_SB_.GSIB: Enabled at IRQ 171547worker1 # [ 0.586255] ACPI: \_SB_.GSIB: Enabled at IRQ 171548worker2 # [ 0.569955] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1549lb # [ 0.588703] ACPI: \_SB_.GSIC: Enabled at IRQ 181550worker2 # [ 0.571083] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1551worker1 # [ 0.588255] ACPI: \_SB_.GSIC: Enabled at IRQ 181552worker2 # [ 0.572338] NET: Registered PF_UNIX/PF_LOCAL protocol family1553lb # [ 0.590671] ACPI: \_SB_.GSID: Enabled at IRQ 191554worker2 # [ 0.573361] NET: Registered PF_XDP protocol family1555worker1 # [ 0.590211] ACPI: \_SB_.GSID: Enabled at IRQ 191556worker2 # [ 0.574253] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1557lb # [ 0.592479] PCI: CLS 0 bytes, default 641558worker1 # [ 0.591882] PCI: CLS 0 bytes, default 641559worker2 # [ 0.575277] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1560worker1 # [ 0.592814] Trying to unpack rootfs image as initramfs...1561worker2 # [ 0.576305] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1562lb # [ 0.593346] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1563worker2 # [ 0.577419] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1564lb # [ 0.595098] Trying to unpack rootfs image as initramfs...1565worker2 # [ 0.578548] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1566worker2 # [ 0.579699] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1567worker1 # [ 0.596985] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1568worker2 # [ 0.581565] ACPI: \_SB_.GSIA: Enabled at IRQ 161569worker2 # [ 0.584767] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker2 # [ 0.586921] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker2 # [ 0.589157] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker2 # [ 0.591102] PCI: CLS 0 bytes, default 641573worker2 # [ 0.592015] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574worker2 # [ 0.593923] Trying to unpack rootfs image as initramfs...1575client # [ 0.638748] Initialise system trusted keyrings1576client # [ 0.639687] workingset: timestamp_bits=40 max_order=19 bucket_order=01577lb # [ 0.639794] Initialise system trusted keyrings1578worker1 # [ 0.639492] Initialise system trusted keyrings1579lb # [ 0.640795] workingset: timestamp_bits=40 max_order=19 bucket_order=01580client # [ 0.663580] Key type asymmetric registered1581worker1 # [ 0.643751] workingset: timestamp_bits=40 max_order=19 bucket_order=01582client # [ 0.664300] Asymmetric key parser 'x509' registered1583client # [ 0.665134] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584client # [ 0.668460] io scheduler mq-deadline registered1585client # [ 0.669213] io scheduler kyber registered1586client # [ 0.672932] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1587client # [ 0.674187] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1588worker2 # [ 0.639029] Initialise system trusted keyrings1589worker2 # [ 0.642128] workingset: timestamp_bits=40 max_order=19 bucket_order=01590client # [ 0.679423] Linux agpgart interface v0.1031591client # [ 0.680140] ACPI: bus type drm_connector registered1592client # [ 0.682502] usbcore: registered new interface driver usbserial_generic1593worker1 # [ 0.663003] Key type asymmetric registered1594lb # [ 0.664488] Key type asymmetric registered1595client # [ 0.683553] usbserial: USB Serial support registered for generic1596lb # [ 0.665206] Asymmetric key parser 'x509' registered1597lb # [ 0.666059] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1598worker1 # [ 0.665740] Asymmetric key parser 'x509' registered1599worker1 # [ 0.666590] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1600client # [ 0.686373] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1601client # [ 0.686373] Please enable it if your BIOS has the CPPC option.1602client # [ 0.688539] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1603worker1 # [ 0.669829] io scheduler mq-deadline registered1604lb # [ 0.671506] io scheduler mq-deadline registered1605worker1 # [ 0.670616] io scheduler kyber registered1606lb # [ 0.672269] io scheduler kyber registered1607client # [ 0.692534] drop_monitor: Initializing network drop monitor service1608client # [ 0.693758] NET: Registered PF_INET6 protocol family1609worker1 # [ 0.674276] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1610lb # [ 0.675921] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1611worker1 # [ 0.675571] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1612lb # [ 0.677134] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1613client # [ 0.698466] Segment Routing with IPv61614client # [ 0.699151] In-situ OAM (IOAM) with IPv61615worker1 # [ 0.679450] Linux agpgart interface v0.1031616lb # [ 0.681156] Linux agpgart interface v0.1031617worker1 # [ 0.680257] ACPI: bus type drm_connector registered1618lb # [ 0.681903] ACPI: bus type drm_connector registered1619worker2 # [ 0.665083] Key type asymmetric registered1620worker2 # [ 0.665832] Asymmetric key parser 'x509' registered1621client # [ 0.702512] IPI shorthand broadcast: enabled1622worker1 # [ 0.683126] usbcore: registered new interface driver usbserial_generic1623worker2 # [ 0.666767] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1624lb # [ 0.684896] usbcore: registered new interface driver usbserial_generic1625worker1 # [ 0.684205] usbserial: USB Serial support registered for generic1626lb # [ 0.685911] usbserial: USB Serial support registered for generic1627worker2 # [ 0.670199] io scheduler mq-deadline registered1628worker2 # [ 0.670967] io scheduler kyber registered1629worker1 # [ 0.686714] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1630worker1 # [ 0.686714] Please enable it if your BIOS has the CPPC option.1631lb # [ 0.689400] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1632client # [ 0.708702] sched_clock: Marking stable (572015345, 136339768)->(784517007, -76161894)1633worker1 # [ 0.688991] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1634lb # [ 0.689400] Please enable it if your BIOS has the CPPC option.1635worker2 # [ 0.673686] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1636lb # [ 0.691557] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1637worker2 # [ 0.675001] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1638worker1 # [ 0.692861] drop_monitor: Initializing network drop monitor service1639client # [ 0.713444] registered taskstats version 11640lb # [ 0.694548] drop_monitor: Initializing network drop monitor service1641worker1 # [ 0.694076] NET: Registered PF_INET6 protocol family1642client # [ 0.714381] Loading compiled-in X.509 certificates1643lb # [ 0.695723] NET: Registered PF_INET6 protocol family1644worker2 # [ 0.680767] Linux agpgart interface v0.1031645lb # [ 0.698828] Segment Routing with IPv61646worker2 # [ 0.681576] ACPI: bus type drm_connector registered1647worker1 # [ 0.699164] Segment Routing with IPv61648worker1 # [ 0.699862] In-situ OAM (IOAM) with IPv61649worker2 # [ 0.683622] usbcore: registered new interface driver usbserial_generic1650lb # [ 0.701410] In-situ OAM (IOAM) with IPv61651worker2 # [ 0.684699] usbserial: USB Serial support registered for generic1652lb # [ 0.702436] IPI shorthand broadcast: enabled1653worker1 # [ 0.702981] IPI shorthand broadcast: enabled1654worker2 # [ 0.689082] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1655worker2 # [ 0.689082] Please enable it if your BIOS has the CPPC option.1656worker2 # [ 0.691398] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1657worker1 # [ 0.709209] sched_clock: Marking stable (574013624, 134682906)->(785192194, -76495664)1658lb # [ 0.710585] sched_clock: Marking stable (577013664, 133367264)->(780163669, -69782741)1659worker2 # [ 0.694223] drop_monitor: Initializing network drop monitor service1660client # [ 0.730747] Demotion targets for Node 0: null1661worker2 # [ 0.695408] NET: Registered PF_INET6 protocol family1662client # [ 0.733410] Key type .fscrypt registered1663client # [ 0.734112] Key type fscrypt-provisioning registered1664lb # [ 0.715618] registered taskstats version 11665client # [ 0.735063] ima: No TPM chip found, activating TPM-bypass!1666lb # [ 0.716571] Loading compiled-in X.509 certificates1667worker1 # [ 0.715894] registered taskstats version 11668worker2 # [ 0.700179] Segment Routing with IPv61669worker1 # [ 0.716802] Loading compiled-in X.509 certificates1670worker2 # [ 0.700885] In-situ OAM (IOAM) with IPv61671client # [ 0.739379] ima: Allocated hash algorithm: sha11672client # [ 0.740181] ima: No architecture policies found1673worker2 # [ 0.704379] IPI shorthand broadcast: enabled1674client # [ 0.742369] PM: Magic number: 10:263:8291675client # [ 0.743968] RAS: Correctable Errors collector initialized.1676worker2 # [ 0.710814] sched_clock: Marking stable (576017722, 134047680)->(781840011, -71774609)1677worker2 # [ 0.714275] registered taskstats version 11678worker2 # [ 0.715301] Loading compiled-in X.509 certificates1679lb # [ 0.732904] Demotion targets for Node 0: null1680client # [ 0.752039] clk: Disabling unused clocks1681worker1 # [ 0.733093] Demotion targets for Node 0: null1682lb # [ 0.736442] Key type .fscrypt registered1683worker1 # [ 0.735747] Key type .fscrypt registered1684lb # [ 0.737115] Key type fscrypt-provisioning registered1685worker1 # [ 0.736429] Key type fscrypt-provisioning registered1686client # [ 0.756366] PM: genpd: Disabling unused power domains1687lb # [ 0.738015] ima: No TPM chip found, activating TPM-bypass!1688worker1 # [ 0.737396] ima: No TPM chip found, activating TPM-bypass!1689lb # [ 0.740399] ima: Allocated hash algorithm: sha11690lb # [ 0.741169] ima: No architecture policies found1691worker1 # [ 0.741711] ima: Allocated hash algorithm: sha11692lb # [ 0.743400] PM: Magic number: 10:263:8291693worker1 # [ 0.742506] ima: No architecture policies found1694worker1 # [ 0.743468] PM: Magic number: 10:263:8291695lb # [ 0.744949] RAS: Correctable Errors collector initialized.1696worker1 # [ 0.747118] RAS: Correctable Errors collector initialized.1697worker2 # [ 0.734149] Demotion targets for Node 0: null1698lb # [ 0.754072] clk: Disabling unused clocks1699worker2 # [ 0.737133] Key type .fscrypt registered1700worker2 # [ 0.737820] Key type fscrypt-provisioning registered1701worker2 # [ 0.738826] ima: No TPM chip found, activating TPM-bypass!1702lb # [ 0.756406] PM: genpd: Disabling unused power domains1703worker1 # [ 0.755846] clk: Disabling unused clocks1704worker1 # [ 0.756557] PM: genpd: Disabling unused power domains1705worker2 # [ 0.743091] ima: Allocated hash algorithm: sha11706worker2 # [ 0.743906] ima: No architecture policies found1707worker2 # [ 0.746078] PM: Magic number: 10:263:8291708worker2 # [ 0.747846] RAS: Correctable Errors collector initialized.1709worker2 # [ 0.757808] clk: Disabling unused clocks1710worker2 # [ 0.760078] PM: genpd: Disabling unused power domains1711client # [ 0.910403] Freeing initrd memory: 29096K1712client # [ 0.913474] Freeing unused decrypted memory: 2028K1713client # [ 0.916025] Freeing unused kernel image (initmem) memory: 3644K1714client # [ 0.917129] Write protecting the kernel read-only data: 32768k1715client # [ 0.918977] Freeing unused kernel image (text/rodata gap) memory: 1208K1716client # [ 0.920528] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker1 # [ 0.915791] Freeing initrd memory: 29092K1718lb # [ 0.919330] Freeing initrd memory: 29092K1719worker1 # [ 0.918866] Freeing unused decrypted memory: 2028K1720worker1 # [ 0.921369] Freeing unused kernel image (initmem) memory: 3644K1721lb # [ 0.922511] Freeing unused decrypted memory: 2028K1722worker1 # [ 0.922478] Write protecting the kernel read-only data: 32768k1723lb # [ 0.925056] Freeing unused kernel image (initmem) memory: 3644K1724worker1 # [ 0.924369] Freeing unused kernel image (text/rodata gap) memory: 1208K1725lb # [ 0.926138] Write protecting the kernel read-only data: 32768k1726worker1 # [ 0.925931] Freeing unused kernel image (rodata/data gap) memory: 752K1727lb # [ 0.927992] Freeing unused kernel image (text/rodata gap) memory: 1208K1728lb # [ 0.929571] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker2 # [ 0.934503] Freeing initrd memory: 29092K1730client # [ 0.971783] x86/mm: Checked W+X mappings: passed, no W+X pages found.1731client # [ 0.972917] Run /init as init process1732worker2 # [ 0.937857] Freeing unused decrypted memory: 2028K1733worker2 # [ 0.940706] Freeing unused kernel image (initmem) memory: 3644K1734worker2 # [ 0.941881] Write protecting the kernel read-only data: 32768k1735worker2 # [ 0.943861] Freeing unused kernel image (text/rodata gap) memory: 1208K1736worker2 # [ 0.945521] Freeing unused kernel image (rodata/data gap) memory: 752K1737client # [ 0.982916] systemd[1]: Inserted module 'autofs4'1738worker1 # [ 0.977156] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739worker1 # [ 0.978271] Run /init as init process1740client # [ 0.999186] fuse: init (API version 7.45)1741lb # [ 0.980538] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742lb # [ 0.981645] Run /init as init process1743client # [ 1.004946] ACPI: \_SB_.GSIG: Enabled at IRQ 221744client # [ 1.007303] ACPI: \_SB_.GSIH: Enabled at IRQ 231745worker1 # [ 0.988288] systemd[1]: Inserted module 'autofs4'1746client # [ 1.010164] ACPI: \_SB_.GSIE: Enabled at IRQ 201747lb # [ 0.991572] systemd[1]: Inserted module 'autofs4'1748client # [ 1.012293] ACPI: \_SB_.GSIF: Enabled at IRQ 211749worker1 # [ 1.004632] fuse: init (API version 7.45)1750lb # [ 1.007839] fuse: init (API version 7.45)1751worker1 # [ 1.010486] ACPI: \_SB_.GSIG: Enabled at IRQ 221752lb # [ 1.013540] ACPI: \_SB_.GSIG: Enabled at IRQ 221753worker1 # [ 1.012834] ACPI: \_SB_.GSIH: Enabled at IRQ 231754worker2 # [ 0.996588] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755worker2 # [ 0.997668] Run /init as init process1756lb # [ 1.015778] ACPI: \_SB_.GSIH: Enabled at IRQ 231757worker1 # [ 1.016033] ACPI: \_SB_.GSIE: Enabled at IRQ 201758lb # [ 1.018773] ACPI: \_SB_.GSIE: Enabled at IRQ 201759worker1 # [ 1.018238] ACPI: \_SB_.GSIF: Enabled at IRQ 211760client # [ 1.039070] systemd[1]: Successfully made /usr/ read-only.1761lb # [ 1.020988] ACPI: \_SB_.GSIF: Enabled at IRQ 211762worker2 # [ 1.008419] systemd[1]: Inserted module 'autofs4'1763worker2 # [ 1.025169] fuse: init (API version 7.45)1764worker1 # [ 1.044487] systemd[1]: Successfully made /usr/ read-only.1765lb # [ 1.046091] systemd[1]: Successfully made /usr/ read-only.1766worker2 # [ 1.031217] ACPI: \_SB_.GSIG: Enabled at IRQ 221767worker2 # [ 1.033894] ACPI: \_SB_.GSIH: Enabled at IRQ 231768worker2 # [ 1.037210] ACPI: \_SB_.GSIE: Enabled at IRQ 201769worker2 # [ 1.039636] ACPI: \_SB_.GSIF: Enabled at IRQ 211770worker2 # [ 1.067147] systemd[1]: Successfully made /usr/ read-only.1771client # [ 1.375569] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772client # [ 1.387552] systemd[1]: Detected virtualization kvm.1773client # [ 1.389622] systemd[1]: Detected architecture x86-64.1774client # [ 1.391806] systemd[1]: Running in initrd.1775client # [ 1.394400] systemd[1]: Initializing machine ID from random generator.1776client # [ 1.397174] systemd[1]: Hostname set to <client>.1777worker1 # [ 1.380996] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778lb # [ 1.382253] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1779worker1 # [ 1.392923] systemd[1]: Detected virtualization kvm.1780lb # [ 1.394163] systemd[1]: Detected virtualization kvm.1781worker1 # [ 1.395005] systemd[1]: Detected architecture x86-64.1782lb # [ 1.396313] systemd[1]: Detected architecture x86-64.1783worker1 # [ 1.397114] systemd[1]: Running in initrd.1784lb # [ 1.398475] systemd[1]: Running in initrd.1785worker1 # [ 1.399509] systemd[1]: Initializing machine ID from random generator.1786lb # [ 1.400959] systemd[1]: Initializing machine ID from random generator.1787worker1 # [ 1.402363] systemd[1]: Hostname set to <worker1>.1788lb # [ 1.403808] systemd[1]: Hostname set to <lb>.1789worker2 # [ 1.403737] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker2 # [ 1.415618] systemd[1]: Detected virtualization kvm.1791worker2 # [ 1.417775] systemd[1]: Detected architecture x86-64.1792worker2 # [ 1.419909] systemd[1]: Running in initrd.1793worker2 # [ 1.422459] systemd[1]: Initializing machine ID from random generator.1794worker2 # [ 1.425377] systemd[1]: Hostname set to <worker2>.1795client # [ 1.621400] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796lb # [ 1.622529] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker1 # [ 1.624628] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798client # [ 1.674499] systemd[1]: Queued start job for default target Initrd Default Target.1799client # [ 1.677645] systemd[1]: Created slice Slice /system/modprobe.1800client # [ 1.678834] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801client # [ 1.680324] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802client # [ 1.681473] systemd[1]: Reached target Path Units.1803client # [ 1.682354] systemd[1]: Reached target Slice Units.1804client # [ 1.683232] systemd[1]: Reached target Swaps.1805client # [ 1.684037] systemd[1]: Reached target Timer Units.1806worker2 # [ 1.646771] systemd[1]: bpf-restrict-fs: LSM BPF program attached1807client # [ 1.685044] systemd[1]: Listening on D-Bus System Message Bus Socket.1808client # [ 1.686251] systemd[1]: Listening on Journal Socket (/dev/log).1809client # [ 1.687481] systemd[1]: Listening on Journal Sockets.1810client # [ 1.688556] systemd[1]: Listening on udev Control Socket.1811client # [ 1.689616] systemd[1]: Listening on udev Kernel Socket.1812client # [ 1.690691] systemd[1]: Reached target Socket Units.1813client # [ 1.692543] systemd[1]: Starting Create List of Static Device Nodes...1814client # [ 1.696432] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1815lb # [ 1.677434] systemd[1]: Queued start job for default target Initrd Default Target.1816lb # [ 1.680655] systemd[1]: Created slice Slice /system/modprobe.1817worker1 # [ 1.679629] systemd[1]: Queued start job for default target Initrd Default Target.1818lb # [ 1.681858] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1819lb # [ 1.683285] systemd[1]: Expecting device /dev/disk/by-label/nixos...1820lb # [ 1.684449] systemd[1]: Reached target Path Units.1821worker1 # [ 1.684020] systemd[1]: Created slice Slice /system/modprobe.1822lb # [ 1.685324] systemd[1]: Reached target Slice Units.1823client # [ 1.704459] systemd[1]: Starting Load Kernel Module configfs...1824lb # [ 1.686226] systemd[1]: Reached target Swaps.1825worker1 # [ 1.685244] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1826lb # [ 1.687047] systemd[1]: Reached target Timer Units.1827worker1 # [ 1.686707] systemd[1]: Expecting device /dev/disk/by-label/nixos...1828lb # [ 1.688065] systemd[1]: Listening on D-Bus System Message Bus Socket.1829worker1 # [ 1.687847] systemd[1]: Reached target Path Units.1830lb # [ 1.689306] systemd[1]: Listening on Journal Socket (/dev/log).1831worker1 # [ 1.688750] systemd[1]: Reached target Slice Units.1832worker1 # [ 1.689605] systemd[1]: Reached target Swaps.1833lb # [ 1.690524] systemd[1]: Listening on Journal Sockets.1834worker1 # [ 1.690463] systemd[1]: Reached target Timer Units.1835lb # [ 1.691550] systemd[1]: Listening on udev Control Socket.1836lb # [ 1.692613] systemd[1]: Listening on udev Kernel Socket.1837worker1 # [ 1.691473] systemd[1]: Listening on D-Bus System Message Bus Socket.1838lb # [ 1.693599] systemd[1]: Reached target Socket Units.1839worker1 # [ 1.692756] systemd[1]: Listening on Journal Socket (/dev/log).1840worker1 # [ 1.693915] systemd[1]: Listening on Journal Sockets.1841lb # [ 1.695413] systemd[1]: Starting Create List of Static Device Nodes...1842worker1 # [ 1.694921] systemd[1]: Listening on udev Control Socket.1843worker1 # [ 1.695977] systemd[1]: Listening on udev Kernel Socket.1844worker1 # [ 1.696953] systemd[1]: Reached target Socket Units.1845client # [ 1.717536] systemd[1]: Starting Journal Service...1846lb # [ 1.699250] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1847worker1 # [ 1.698769] systemd[1]: Starting Create List of Static Device Nodes...1848worker1 # [ 1.702585] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1849lb # [ 1.706097] systemd[1]: Starting Load Kernel Module configfs...1850worker1 # [ 1.709407] systemd[1]: Starting Load Kernel Module configfs...1851client # [ 1.731440] systemd[1]: Starting Load Kernel Modules...1852worker2 # [ 1.701398] systemd[1]: Queued start job for default target Initrd Default Target.1853lb # [ 1.722033] systemd[1]: Starting Journal Service...1854worker2 # [ 1.705370] systemd[1]: Created slice Slice /system/modprobe.1855worker2 # [ 1.706535] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1856worker2 # [ 1.707882] systemd[1]: Expecting device /dev/disk/by-label/nixos...1857worker2 # [ 1.708952] systemd[1]: Reached target Path Units.1858worker1 # [ 1.725355] systemd[1]: Starting Journal Service...1859worker2 # [ 1.709850] systemd[1]: Reached target Slice Units.1860worker2 # [ 1.710687] systemd[1]: Reached target Swaps.1861worker2 # [ 1.711442] systemd[1]: Reached target Timer Units.1862worker2 # [ 1.712392] systemd[1]: Listening on D-Bus System Message Bus Socket.1863worker2 # [ 1.713574] systemd[1]: Listening on Journal Socket (/dev/log).1864client # [ 1.738468] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1865worker2 # [ 1.714669] systemd[1]: Listening on Journal Sockets.1866worker2 # [ 1.715615] systemd[1]: Listening on udev Control Socket.1867worker2 # [ 1.716610] systemd[1]: Listening on udev Kernel Socket.1868worker2 # [ 1.717537] systemd[1]: Reached target Socket Units.1869client # [ 1.754931] netfs: FS-Cache loaded1870lb # [ 1.736450] systemd[1]: Starting Load Kernel Modules...1871worker2 # [ 1.720139] systemd[1]: Starting Create List of Static Device Nodes...1872worker1 # [ 1.738771] systemd[1]: Starting Load Kernel Modules...1873worker2 # [ 1.722874] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1874client # [ 1.760011] 9pnet: Installing 9P2000 support1875worker2 # [ 1.734147] systemd[1]: Starting Load Kernel Module configfs...1876lb # [ 1.741472] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1877client # [ 1.773506] systemd[1]: Starting Coldplug All udev Devices...1878lb # [ 1.757612] netfs: FS-Cache loaded1879worker1 # [ 1.745763] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1880worker2 # [ 1.744141] systemd[1]: Starting Journal Service...1881worker1 # [ 1.761320] netfs: FS-Cache loaded1882lb # [ 1.763883] 9pnet: Installing 9P2000 support1883client # [ 1.785512] systemd[1]: Finished Create List of Static Device Nodes.1884worker1 # [ 1.766142] 9pnet: Installing 9P2000 support1885client # [ 1.790992] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1886worker2 # [ 1.756259] systemd[1]: Starting Load Kernel Modules...1887worker1 # [ 1.774794] systemd[1]: Starting Coldplug All udev Devices...1888lb # [ 1.778716] systemd[1]: Starting Coldplug All udev Devices...1889client # [ 1.798886] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1890lb # [ 1.786286] systemd-journald[67]: Collecting audit messages is disabled.1891client # [ 1.805816] systemd[1]: modprobe@configfs.service: Deactivated successfully.1892client # [ 1.807286] systemd-journald[67]: Collecting audit messages is disabled.1893worker1 # [ 1.788803] systemd[1]: Finished Create List of Static Device Nodes.1894worker2 # [ 1.761148] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1895lb # [ 1.792548] systemd[1]: Finished Create List of Static Device Nodes.1896client # [ 1.813734] systemd[1]: Finished Load Kernel Module configfs.1897worker1 # [ 1.794324] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1898worker2 # [ 1.779122] netfs: FS-Cache loaded1899lb # [ 1.799006] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1900client # [ 1.817842] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1901worker2 # [ 1.783770] 9pnet: Installing 9P2000 support1902worker1 # [ 1.802781] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1903client # [ 1.822872] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1904lb # [ 1.807795] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1905worker1 # [ 1.809143] systemd[1]: modprobe@configfs.service: Deactivated successfully.1906client # [ 1.830379] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1907worker2 # [ 1.795133] systemd[1]: Starting Coldplug All udev Devices...1908client # [ 1.832082] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1909lb # [ 1.813790] systemd[1]: modprobe@configfs.service: Deactivated successfully.1910worker1 # [ 1.813209] systemd-journald[67]: Collecting audit messages is disabled.1911worker1 # [ 1.816069] systemd[1]: Finished Load Kernel Module configfs.1912lb # [ 1.820734] systemd[1]: Finished Load Kernel Module configfs.1913worker2 # [ 1.807541] systemd[1]: Finished Create List of Static Device Nodes.1914worker1 # [ 1.823178] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1915lb # [ 1.824799] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1916lb # [ 1.827286] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1917worker1 # [ 1.827867] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1918worker2 # [ 1.813652] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1919worker1 # [ 1.833763] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1920worker1 # [ 1.835135] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1921lb # [ 1.836587] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1922lb # [ 1.837978] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1923worker2 # [ 1.821468] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1924client # [ 1.861961] systemd[1]: Finished Load Kernel Modules.1925worker2 # [ 1.828472] systemd[1]: modprobe@configfs.service: Deactivated successfully.1926worker2 # [ 1.829794] systemd-journald[67]: Collecting audit messages is disabled.1927client # [ 1.869574] systemd[1]: Starting Apply Kernel Variables...1928worker2 # [ 1.834147] systemd[1]: Finished Load Kernel Module configfs.1929worker2 # [ 1.840523] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1930worker2 # [ 1.844539] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1931client # [ 1.883433] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1932worker1 # [ 1.866214] systemd[1]: Finished Load Kernel Modules.1933lb # [ 1.867443] systemd[1]: Finished Load Kernel Modules.1934worker2 # [ 1.852138] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1935worker2 # [ 1.853515] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1936client # [ 1.891559] systemd[1]: Starting Create Static Device Nodes in /dev...1937lb # [ 1.874583] systemd[1]: Starting Apply Kernel Variables...1938worker1 # [ 1.873922] systemd[1]: Starting Apply Kernel Variables...1939worker1 # [ 1.882857] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1940lb # [ 1.884584] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1941client # [ 1.911952] systemd[1]: Finished Apply Kernel Variables.1942lb # [ 1.895476] systemd[1]: Starting Create Static Device Nodes in /dev...1943worker1 # [ 1.896789] systemd[1]: Starting Create Static Device Nodes in /dev...1944worker2 # [ 1.884190] systemd[1]: Finished Load Kernel Modules.1945client # [ 1.924356] systemd[1]: Started Journal Service.1946client # [ 1.790207] systemd-modules-load[68]: Inserted module 'dm_mod'1947worker2 # [ 1.891245] systemd[1]: Starting Apply Kernel Variables...1948lb # [ 1.909953] systemd[1]: Started Journal Service.1949client # [ 1.792723] systemd-modules-load[68]: Inserted module 'virtio_balloon'1950lb # [ 1.774686] systemd-modules-load[68]: Inserted module 'dm_mod'1951lb # [ 1.779057] systemd-modules-load[68]: Inserted module 'virtio_balloon'1952client # [ 1.796286] systemd-modules-load[68]: Inserted module 'virtio_gpu'1953client # [ 1.797305] systemd[1]: Finished Create Static Device Nodes in /dev.1954lb # [ 1.781454] systemd-modules-load[68]: Inserted module 'virtio_gpu'1955client # [ 1.798436] systemd[1]: Reached target Preparation for Local File Systems.1956client # [ 1.799782] systemd[1]: Reached target Local File Systems.1957worker1 # [ 1.917301] systemd[1]: Finished Apply Kernel Variables.1958client # [ 1.803124] systemd[1]: Starting Create System Files and Directories...1959worker2 # [ 1.903036] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1960lb # [ 1.788152] systemd[1]: Finished Apply Kernel Variables.1961client # [ 1.809079] systemd[1]: Starting Rule-based Manager for Device Events and Files...1962worker1 # [ 1.794312] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.930028] systemd[1]: Started Journal Service.1963worker1 # 1964worker1 # [ 1.797261] systemd-modules-load[68]: Inserted module 'virtio_balloon'1965worker2 # [ 1.915259] systemd[1]: Starting Create Static Device Nodes in /dev...1966worker1 # [ 1.799297] systemd-modules-load[68]: Inserted module 'virtio_gpu'1967worker1 # [ 1.802260] systemd[1]: Finished Create Static Device Nodes in /dev.1968worker1 # [ 1.803316] systemd[1]: Reached target Preparation for Local File Systems.1969worker1 # [ 1.804444] systemd[1]: Reached target Local File Systems.1970lb # [ 1.807094] systemd[1]: Finished Create Static Device Nodes in /dev.1971lb # [ 1.808133] systemd[1]: Reached target Preparation for Local File Systems.1972lb # [ 1.809647] systemd[1]: Reached target Local File Systems.1973worker1 # [ 1.809906] systemd[1]: Starting Create System Files and Directories...1974worker2 # [ 1.929181] systemd[1]: Finished Apply Kernel Variables.1975lb # [ 1.815133] systemd[1]: Starting Create System Files and Directories...1976worker1 # [ 1.813134] systemd[1]: Starting Rule-based Manager for Device Events and Files...1977lb # [ 1.819886] systemd[1]: Starting Rule-based Manager for Device Events and Files...1978client # [ 1.841465] systemd[1]: Finished Create System Files and Directories.1979worker2 # [ 1.942774] systemd[1]: Started Journal Service.1980worker2 # [ 1.809773] systemd-modules-load[68]: Inserted module 'dm_mod'1981worker2 # [ 1.813459] systemd-modules-load[68]: Inserted module 'virtio_balloon'1982worker2 # [ 1.814617] systemd-modules-load[68]: Inserted module 'virtio_gpu'1983worker2 # [ 1.816262] systemd[1]: Finished Create Static Device Nodes in /dev.1984worker2 # [ 1.822064] systemd[1]: Reached target Preparation for Local File Systems.1985worker2 # [ 1.823030] systemd[1]: Reached target Local File Systems.1986worker1 # [ 1.839264] systemd[1]: Finished Create System Files and Directories.1987worker2 # [ 1.823775] systemd[1]: Starting Create System Files and Directories...1988client # [ 1.863411] systemd-udevd[77]: Using default interface naming scheme 'v261'.1989worker2 # [ 1.829793] systemd[1]: Starting Rule-based Manager for Device Events and Files...1990lb # [ 1.850317] systemd[1]: Finished Create System Files and Directories.1991worker1 # [ 1.866290] systemd-udevd[77]: Using default interface naming scheme 'v261'.1992client # [ 1.888836] systemd[1]: Started Rule-based Manager for Device Events and Files.1993lb # [ 1.875363] systemd-udevd[83]: Using default interface naming scheme 'v261'.1994worker2 # [ 1.858173] systemd[1]: Finished Create System Files and Directories.1995worker1 # [ 1.892074] systemd[1]: Started Rule-based Manager for Device Events and Files.1996worker2 # [ 1.882509] systemd-udevd[77]: Using default interface naming scheme 'v261'.1997lb # [ 1.901375] systemd[1]: Started Rule-based Manager for Device Events and Files.1998client # [ 1.936311] systemd[1]: Finished Coldplug All udev Devices.1999client # [ 1.938591] systemd[1]: Reached target System Initialization.2000client # [ 1.939467] systemd[1]: Reached target Basic System.3600worker2 # [ 9.692745] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync'3601worker2 # [ 9.694233] dbus-broker-launch[535]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3602worker2 # [ 9.705717] systemd[1]: Stopped target Host and Network Name Lookups.3603lb # [ 9.857963] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3604worker2 # [ 9.707090] systemd[1]: Stopping Host and Network Name Lookups...3605lb # [ 9.860205] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3606worker1 # [ 9.725211] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3607worker2 # [ 9.709979] systemd[1]: Stopped target User and Group Name Lookups.3608worker2 # [ 9.710921] systemd[1]: Stopping User and Group Name Lookups...3609worker1 # [ 9.727475] systemd[1]: Stopped Virtual Console Setup.3610worker2 # [ 9.712760] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3611lb # [ 9.864289] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23612lb # [ 9.865156] cfg80211: failed to load regulatory.db3613worker2 # [ 9.715038] systemd[1]: nscd.service: Deactivated successfully.3614worker2 # [ 9.716429] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3615worker1 # [ 9.733317] systemd[1]: Starting Virtual Console Setup...3616client # [ 9.756610] systemd-vconsole-setup[423]: Configuration of first virtual console was skipped, ignoring remaining ones.3617worker2 # [ 9.725343] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3618client # [ 9.760217] systemd[1]: Finished Virtual Console Setup.3619client # [ 9.762192] systemd[1]: Reached target System Initialization.3620client # [ 9.763173] systemd[1]: Started Discard unused filesystem blocks once a week.3621client # [ 9.764216] systemd[1]: Started Daily Cleanup of Temporary Directories.3622lb # [ 9.882067] kvm_amd: TSC scaling supported3623lb # [ 9.882740] kvm_amd: Nested Virtualization enabled3624client # [ 9.765458] systemd[1]: Reached target Timer Units.3625lb # [ 9.883672] kvm_amd: Nested Paging enabled3626lb # [ 9.884197] kvm_amd: LBR virtualization supported3627client # [ 9.767136] systemd[1]: Listening on D-Bus System Message Bus Socket.3628lb # [ 9.885044] kvm_amd: Virtual VMLOAD VMSAVE supported3629client # [ 9.767993] systemd[1]: Listening on Nix Daemon Socket.3630lb # [ 9.886106] kvm_amd: Virtual GIF supported3631client # [ 9.768732] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3632lb # [ 9.886935] kvm_amd: Virtual NMI enabled3633client # [ 9.769854] systemd[1]: Reached target Socket Units.3634client # [ 9.770576] systemd[1]: Reached target Basic System.3635client # [ 9.773272] systemd[1]: Started backdoor.service.3636client # [ 9.776132] systemd[1]: Starting Import lastlog data into lastlog2 database...3637worker2 # [ 9.744622] systemd[1]: Started D-Bus System Message Bus.3638client # [ 9.780975] systemd[1]: Starting nftables firewall...3639worker2 # [ 9.747428] systemd-logind[557]: New seat seat0.3640client # [ 9.783812] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3641worker2 # [ 9.755420] systemd-logind[557]: Watching system buttons on /dev/input/event2 (Power Button)3642client # [ 9.793228] systemd[1]: Starting Post-Boot Actions...3643worker2 # [ 9.758979] systemd-logind[557]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3644worker2 # [ 9.760207] systemd-logind[557]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3645worker2 # [ 9.761409] systemd[1]: Started User Login Management.3646client # [ 9.799265] systemd[1]: Started Reset console on configuration changes.3647worker2 # [ 9.765994] systemd[1]: Starting linger-users.service...3648client # [ 9.816159] systemd[1]: Starting resolvconf update...3649lb # [ 9.960580] EDAC MC: Ver: 3.0.03650worker2 # [ 9.809289] dbus-broker-launch[535]: Ready3651worker1 # [ 9.963396] kvm_amd: TSC scaling supported3652worker1 # [ 9.964006] kvm_amd: Nested Virtualization enabled3653worker1 # [ 9.964533] kvm_amd: Nested Paging enabled3654worker1 # [ 9.965372] kvm_amd: LBR virtualization supported3655worker2 # [ 9.814209] nsncd[601]: Sep 20 09:50:09.819 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3656worker1 # [ 9.966122] kvm_amd: Virtual VMLOAD VMSAVE supported3657lb # [ 9.967078] 8021q: adding VLAN 0 to HW filter on device eth03658worker1 # [ 9.966607] kvm_amd: Virtual GIF supported3659lb # [ 9.834818] dhcpcd[708]: eth0: waiting for carrier3660worker1 # [ 9.967386] kvm_amd: Virtual NMI enabled3661worker2 # [ 9.817494] systemd[1]: Started Name Service Cache Daemon (nsncd).3662lb # [ 9.836121] dhcpcd[708]: eth0: carrier acquired3663worker2 # [ 9.818780] systemd[1]: Reached target Host and Network Name Lookups.3664worker2 # [ 9.819846] systemd[1]: Reached target User and Group Name Lookups.3665lb # [ 9.850924] dhcpcd[708]: DUID 00:01:00:01:32:42:68:d1:52:54:00:12:34:563666client # [ 9.867099] systemd[1]: Starting D-Bus System Message Bus...3667lb # [ 9.852230] dhcpcd[708]: eth0: IAID 00:12:34:563668worker2 # [ 9.835243] systemd[1]: linger-users.service: Deactivated successfully.3669lb # [ 9.853439] dhcpcd[708]: eth0: adding address fe80::5054:ff:fe12:34563670worker2 # [ 9.836275] systemd[1]: Finished linger-users.service.3671client # connecting to host...3672worker2 # [ 9.840493] systemd[1]: Finished resolvconf update.3673worker2 # [ 9.842350] systemd[1]: Reached target Preparation for Network.3674lb # [ 9.862928] postgresql-pre-start[730]: The files belonging to this database system will be owned by user "postgres".3675lb # [ 9.864577] postgresql-pre-start[730]: This user must also own the server process.3676worker2 # [ 9.847106] systemd[1]: Starting DHCP Client...3677worker2 # [ 9.849512] systemd[1]: Starting Address configuration of eth1...3678client # [ 9.885693] systemd[1]: Finished Post-Boot Actions.3679worker2 # [ 9.853402] systemd[1]: Starting Extra networking commands....3680lb # [ 9.873459] postgresql-pre-start[730]: The database cluster will be initialized with locale "en_US.UTF-8".3681lb # [ 9.875472] postgresql-pre-start[730]: The default database encoding has accordingly been set to "UTF8".3682lb # [ 9.876718] postgresql-pre-start[730]: The default text search configuration will be set to "english".3683lb # [ 9.877872] postgresql-pre-start[730]: Data page checksums are enabled.3684client # [ 9.894371] systemd[1]: Started Name Service Cache Daemon (nsncd).3685lb # [ 9.878788] postgresql-pre-start[730]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3686lb # [ 9.879952] postgresql-pre-start[730]: creating subdirectories ... ok3687lb # [ 9.881466] postgresql-pre-start[730]: selecting dynamic shared memory implementation ... posix3688client # [ 9.897223] nsncd[431]: Sep 20 09:50:09.627 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3689worker1 # [ 10.016491] EDAC MC: Ver: 3.0.03690client: Guest shell says: b'Spawning backdoor root shell...\n'3691client # [ 9.923611] systemd[1]: Finished Import lastlog data into lastlog2 database.3692client # [ 9.926574] systemd[1]: Reached target Host and Network Name Lookups.3693client # [ 9.928946] systemd[1]: Reached target User and Group Name Lookups.3694client # [ 9.939077] systemd[1]: Starting User Login Management...3695worker1 # [ 9.939897] systemd[1]: Finished register-nix-paths.service.3696client: connected to guest root shell3697client: (connecting took 10.63 seconds)3698client: (finished: waiting for the VM to finish booting, in 10.63 seconds)3699worker2 # [ 9.960763] network-addresses-eth1-start[631]: adding address 192.168.1.4/24... done3700lb # [ 9.989425] postgresql-pre-start[730]: selecting default "max_connections" ... 1003701worker2 # [ 9.979776] network-addresses-eth1-start[631]: adding address 2001:db8:1::4/64... done3702client # [ 10.017929] dbus-broker-launch[442]: Looking up NSS user entry for 'systemd-timesync'...3703worker2 # [ 10.001551] systemd[1]: Finished Address configuration of eth1.3704client # [ 10.038820] dbus-broker-launch[442]: NSS returned no entry for 'systemd-timesync'3705client # [ 10.040886] dbus-broker-launch[442]: Invalid user-name in /nix/store/i187syzbavbkjz7z897lklr60jwf2ymx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3706worker2 # [ 10.022667] dhcpcd[638]: dhcpcd-10.3.2 starting3707client # [ 10.063467] systemd[1]: Stopped target Host and Network Name Lookups.3708client # [ 10.064748] systemd[1]: Stopping Host and Network Name Lookups...3709worker2 # [ 10.032243] dhcpcd[692]: dev: loaded udev3710client # [ 10.067250] systemd[1]: Stopped target User and Group Name Lookups.3711client # [ 10.069141] systemd[1]: Stopping User and Group Name Lookups...3712client # [ 10.069938] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3713worker2 # [ 10.043060] systemd[1]: Finished Extra networking commands..3714worker2 # [ 10.045084] systemd[1]: Reached target Network.3715worker2 # [ 10.048885] systemd[1]: Starting Permit User Sessions...3716client # [ 10.083528] systemd-logind[463]: New seat seat0.3717lb # [ 10.073514] systemd-vconsole-setup[721]: Configuration of first virtual console was skipped, ignoring remaining ones.3718worker2 # [ 10.192526] 8021q: 802.1Q VLAN Support v1.83719worker2 # [ 10.192989] 8021q: adding VLAN 0 to HW filter on device eth13720client # [ 10.093051] systemd-logind[463]: Watching system buttons on /dev/input/event2 (Power Button)3721lb # [ 10.078448] systemd[1]: Finished Virtual Console Setup.3722client # [ 10.094993] systemd-logind[463]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3723client # [ 10.097299] systemd-logind[463]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3724lb # [ 10.087927] postgresql-pre-start[730]: selecting default "shared_buffers" ... 128MB3725client # [ 10.104623] systemd[1]: Started D-Bus System Message Bus.3726client # [ 10.105458] systemd[1]: Started User Login Management.3727client # [ 10.106186] systemd[1]: nscd.service: Deactivated successfully.3728worker2 # [ 10.081447] systemd[1]: Finished Permit User Sessions.3729client # [ 10.115385] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3730worker2 # [ 10.086934] systemd[1]: Started Getty on tty1.3731worker2 # [ 10.088406] systemd[1]: Reached target Login Prompts.3732client # [ 10.135214] dbus-broker-launch[442]: Ready3733worker2 # [ 10.101215] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3734client # [ 10.138080] systemd[1]: Starting linger-users.service...3735client # [ 10.144604] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3736worker1 # [ 10.141222] systemd-vconsole-setup[521]: Configuration of first virtual console was skipped, ignoring remaining ones.3737worker1 # [ 10.144615] systemd[1]: Finished Virtual Console Setup.3738worker1 # [ 10.145465] systemd[1]: Reached target System Initialization.3739worker1 # [ 10.146640] systemd[1]: Started Discard unused filesystem blocks once a week.3740worker1 # [ 10.148219] systemd[1]: Started Daily Cleanup of Temporary Directories.3741worker1 # [ 10.149185] systemd[1]: Reached target Timer Units.3742worker1 # [ 10.150144] systemd[1]: Listening on D-Bus System Message Bus Socket.3743worker1 # [ 10.151132] systemd[1]: Listening on Nix Daemon Socket.3744worker1 # [ 10.153461] systemd[1]: Listening on Nix worker-protocol over gRPC.3745worker1 # [ 10.154726] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3746worker1 # [ 10.155913] systemd[1]: Reached target Socket Units.3747worker1 # [ 10.157124] systemd[1]: Reached target Basic System.3748worker1 # [ 10.160575] systemd[1]: Started backdoor.service.3749worker1 # [ 10.163179] systemd[1]: Starting Import lastlog data into lastlog2 database...3750worker1 # [ 10.168086] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3751worker2 # [ 10.290066] cfg80211: Loading compiled-in X.509 certificates for regulatory database3752worker1 # [ 10.172222] systemd[1]: Starting Post-Boot Actions...3753worker1 # [ 10.176189] systemd[1]: Started Reset console on configuration changes.3754worker1 # [ 10.184741] systemd[1]: Starting resolvconf update...3755client # [ 10.206176] systemd[1]: Finished resolvconf update.3756worker1 # [ 10.190128] systemd[1]: Starting D-Bus System Message Bus...3757client # [ 10.215344] systemd[1]: Starting DHCP Client...3758worker2 # [ 10.317801] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3759worker2 # [ 10.318599] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3760client # [ 10.220797] systemd[1]: linger-users.service: Deactivated successfully.3761worker2 # [ 10.321766] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23762worker2 # [ 10.322585] cfg80211: failed to load regulatory.db3763client # [ 10.224539] nsncd[524]: Sep 20 09:50:09.960 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3764client # [ 10.227335] systemd[1]: Finished linger-users.service.3765client # [ 10.228947] systemd[1]: Started Name Service Cache Daemon (nsncd).3766client # [ 10.231222] systemd[1]: Reached target Host and Network Name Lookups.3767client # [ 10.232547] systemd[1]: Reached target User and Group Name Lookups.3768worker1 # [ 10.253472] systemd[1]: Finished Post-Boot Actions.3769worker2 # [ 10.375223] 8021q: adding VLAN 0 to HW filter on device eth03770worker2 # [ 10.242688] dhcpcd[692]: eth0: waiting for carrier3771worker2 # [ 10.243521] dhcpcd[692]: eth0: carrier acquired3772worker2 # [ 10.253033] dhcpcd[692]: DUID 00:01:00:01:32:42:68:d2:52:54:00:12:34:563773worker2 # [ 10.253943] dhcpcd[692]: eth0: IAID 00:12:34:563774worker2 # [ 10.254605] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:34563775worker1 # connecting to host...3776worker1 # [ 10.288085] systemd[1]: Started Name Service Cache Daemon (nsncd).3777worker1 # [ 10.289520] systemd[1]: Reached target Host and Network Name Lookups.3778worker1 # [ 10.294945] nsncd[529]: Sep 20 09:50:09.541 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3779worker1 # [ 10.297428] systemd[1]: Reached target User and Group Name Lookups.3780worker1 # [ 10.300069] systemd[1]: Starting User Login Management...3781worker1 # [ 10.301547] systemd[1]: Finished Import lastlog data into lastlog2 database.3782client # [ 10.342275] dhcpcd[556]: dhcpcd-10.3.2 starting3783client # [ 10.350505] dhcpcd[563]: dev: loaded udev3784client # [ 10.506727] 8021q: 802.1Q VLAN Support v1.83785worker1 # [ 10.355872] dbus-broker-launch[533]: Looking up NSS user entry for 'systemd-timesync'...3786worker1 # [ 10.372451] dbus-broker-launch[533]: NSS returned no entry for 'systemd-timesync'3787worker1 # [ 10.373559] dbus-broker-launch[533]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3788client # [ 10.397530] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3789worker1 # [ 10.385259] systemd[1]: Stopped target Host and Network Name Lookups.3790worker1 # [ 10.387170] systemd[1]: Stopping Host and Network Name Lookups...3791worker1 # [ 10.388483] systemd[1]: Stopped target User and Group Name Lookups.3792worker1 # [ 10.391429] systemd[1]: Stopping User and Group Name Lookups...3793worker1 # [ 10.393130] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3794worker1 # [ 10.395104] systemd[1]: nscd.service: Deactivated successfully.3795worker1 # [ 10.398896] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3796worker1 # [ 10.407173] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3797worker1 # [ 10.416651] systemd-logind[555]: New seat seat0.3798worker1 # [ 10.423301] systemd[1]: Started D-Bus System Message Bus.3799worker1 # [ 10.425866] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button)3800worker1 # [ 10.427475] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3801worker1 # [ 10.429638] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3802worker1 # [ 10.431762] systemd[1]: Started User Login Management.3803worker1 # [ 10.435908] systemd[1]: Starting linger-users.service...3804client # [ 10.596267] cfg80211: Loading compiled-in X.509 certificates for regulatory database3805client # [ 10.624760] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3806client # [ 10.625850] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3807client # [ 10.628247] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23808client # [ 10.629134] cfg80211: failed to load regulatory.db3809worker1 # [ 10.481899] dbus-broker-launch[533]: Ready3810client # [ 10.505715] systemd[1]: Finished nftables firewall.3811worker1 # [ 10.487950] systemd[1]: Started Name Service Cache Daemon (nsncd).3812client # [ 10.507730] systemd[1]: Reached target Preparation for Network.3813worker1 # [ 10.489841] nsncd[600]: Sep 20 09:50:09.743 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3814worker1 # [ 10.492304] systemd[1]: Reached target Host and Network Name Lookups.3815client # [ 10.511301] systemd[1]: Starting Address configuration of eth1...3816worker1 # [ 10.494445] systemd[1]: Reached target User and Group Name Lookups.3817client # [ 10.515323] systemd[1]: Starting Extra networking commands....3818worker1 # [ 10.501471] systemd[1]: linger-users.service: Deactivated successfully.3819worker1 # [ 10.502961] systemd[1]: Finished linger-users.service.3820worker1 # [ 10.514272] systemd[1]: Finished resolvconf update.3821worker1 # [ 10.514939] systemd[1]: Reached target Preparation for Network.3822worker1 # [ 10.518790] systemd[1]: Starting DHCP Client...3823worker1 # [ 10.521177] systemd[1]: Starting Address configuration of eth1...3824worker1 # [ 10.525230] systemd[1]: Starting Extra networking commands....3825client # [ 10.695053] 8021q: adding VLAN 0 to HW filter on device eth03826client # [ 10.561090] dhcpcd[563]: eth0: waiting for carrier3827client # [ 10.562304] dhcpcd[563]: eth0: carrier acquired3828client # [ 10.573898] dhcpcd[563]: DUID 00:01:00:01:32:42:68:d2:52:54:00:12:34:563829client # [ 10.574996] dhcpcd[563]: eth0: IAID 00:12:34:563830client # [ 10.575912] dhcpcd[563]: eth0: adding address fe80::5054:ff:fe12:34563831client # [ 10.722615] 8021q: adding VLAN 0 to HW filter on device eth13832client # [ 10.601291] network-addresses-eth1-start[582]: adding address 192.168.1.1/24... done3833client # [ 10.612534] network-addresses-eth1-start[582]: adding address 2001:db8:1::1/64... done3834client # [ 10.627636] systemd[1]: Finished Address configuration of eth1.3835worker1 # [ 10.622439] network-addresses-eth1-start[629]: adding address 192.168.1.3/24... done3836client # [ 10.652468] systemd[1]: Finished Extra networking commands..3837client # [ 10.654086] systemd[1]: Reached target Network.3838client # [ 10.657181] systemd[1]: Starting Permit User Sessions...3839worker1 # [ 10.640430] network-addresses-eth1-start[629]: adding address 2001:db8:1::3/64... done3840worker1 # [ 10.661513] systemd[1]: Finished Address configuration of eth1.3841client # [ 10.682787] systemd[1]: Finished Permit User Sessions.3842client # [ 10.685236] systemd[1]: Started Getty on tty1.3843client # [ 10.686418] systemd[1]: Reached target Login Prompts.3844worker1 # [ 10.686886] dhcpcd[637]: dhcpcd-10.3.2 starting3845worker1 # [ 10.696992] dhcpcd[692]: dev: loaded udev3846worker1 # [ 10.701355] systemd[1]: Finished Extra networking commands..3847worker1 # [ 10.703288] systemd[1]: Reached target Network.3848worker1 # [ 10.706578] systemd[1]: Starting Permit User Sessions...3849worker1 # [ 10.859496] 8021q: 802.1Q VLAN Support v1.83850worker1 # [ 10.860065] 8021q: adding VLAN 0 to HW filter on device eth13851worker1 # [ 10.736978] systemd[1]: Finished Permit User Sessions.3852worker1 # [ 10.740901] systemd[1]: Started Getty on tty1.3853worker1 # [ 10.742108] systemd[1]: Reached target Login Prompts.3854worker1 # [ 10.757746] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3855worker1 # [ 10.948162] cfg80211: Loading compiled-in X.509 certificates for regulatory database3856worker1 # [ 10.977526] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3857worker1 # [ 10.978304] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3858worker1 # [ 10.981554] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23859worker1 # [ 10.982444] cfg80211: failed to load regulatory.db3860worker1 # [ 11.036428] 8021q: adding VLAN 0 to HW filter on device eth03861worker1 # [ 10.902823] dhcpcd[692]: eth0: waiting for carrier3862worker1 # [ 10.903755] dhcpcd[692]: eth0: carrier acquired3863worker1 # [ 10.914150] dhcpcd[692]: DUID 00:01:00:01:32:42:68:d2:52:54:00:12:34:563864worker1 # [ 10.915076] dhcpcd[692]: eth0: IAID 00:12:34:563865worker1 # [ 10.915801] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:34563866client # [ 11.213355] dhcpcd[563]: eth0: soliciting a DHCP lease3867client # [ 11.379571] NET: Registered PF_PACKET protocol family3868client # [ 11.250150] dhcpcd[563]: eth0: offered 10.0.2.15 from 10.0.2.23869client # [ 11.255359] dhcpcd[563]: eth0: probing address 10.0.2.15/243870client: (finished: waiting for unit network-addresses-eth1.service, in 11.93 seconds)3871client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3872client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3873lb: waiting for unit network-addresses-eth1.service3874lb: waiting for the VM to finish booting3875lb: Guest shell says: b'Spawning backdoor root shell...\n'3876lb: connected to guest root shell3877lb: (connecting took 0.00 seconds)3878lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3879lb: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3880lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3881lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3882worker1: waiting for unit network-addresses-eth1.service3883worker1: waiting for the VM to finish booting3884worker1: Guest shell says: b'Spawning backdoor root shell...\n'3885worker1: connected to guest root shell3886worker1: (connecting took 0.00 seconds)3887worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3888lb # [ 11.452306] dhcpcd[708]: eth0: soliciting a DHCP lease3889lb # [ 11.603139] NET: Registered PF_PACKET protocol family3890lb # [ 11.473499] dhcpcd[708]: eth0: offered 10.0.2.15 from 10.0.2.23891lb # [ 11.476157] dhcpcd[708]: eth0: probing address 10.0.2.15/243892worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3893worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3894worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3895worker2: waiting for unit network-addresses-eth1.service3896worker2: waiting for the VM to finish booting3897worker2: Guest shell says: b'Spawning backdoor root shell...\n'3898worker2: connected to guest root shell3899worker2: (connecting took 0.00 seconds)3900worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3901worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3902worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3903worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3904lb: waiting for unit niks3.service3905worker2 # [ 11.674805] dhcpcd[692]: eth0: soliciting a DHCP lease3906worker2 # [ 11.823235] NET: Registered PF_PACKET protocol family3907worker2 # [ 11.693481] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.23908worker2 # [ 11.697156] dhcpcd[692]: eth0: probing address 10.0.2.15/243909lb # [ 12.151888] postgresql-pre-start[730]: selecting default time zone ... UTC3910lb # [ 12.156922] postgresql-pre-start[730]: creating configuration files ... ok3911lb # [ 12.175944] dhcpcd[708]: eth0: soliciting an IPv6 router3912lb # [ 12.177123] dhcpcd[708]: eth0: Router Advertisement from fe80::23913lb # [ 12.177969] dhcpcd[708]: eth0: adding address fec0::5054:ff:fe12:3456/643914lb # [ 12.179294] dhcpcd[708]: eth0: adding route to fec0::/643915lb # [ 12.180087] dhcpcd[708]: eth0: adding default route via fe80::23916worker2 # [ 12.330176] dhcpcd[692]: eth0: soliciting an IPv6 router3917worker2 # [ 12.331558] dhcpcd[692]: eth0: Router Advertisement from fe80::23918worker2 # [ 12.332664] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643919worker2 # [ 12.333722] dhcpcd[692]: eth0: adding route to fec0::/643920worker2 # [ 12.334635] dhcpcd[692]: eth0: adding default route via fe80::23921lb # [ 12.392085] postgresql-pre-start[730]: running bootstrap script ... ok3922client # [ 12.431217] dhcpcd[563]: eth0: soliciting an IPv6 router3923client # [ 12.434332] dhcpcd[563]: eth0: Router Advertisement from fe80::23924client # [ 12.436694] dhcpcd[563]: eth0: adding address fec0::5054:ff:fe12:3456/643925client # [ 12.439233] dhcpcd[563]: eth0: adding route to fec0::/643926client # [ 12.441199] dhcpcd[563]: eth0: adding default route via fe80::23927worker1 # [ 12.555296] dhcpcd[692]: eth0: soliciting a DHCP lease3928worker1 # [ 12.707849] NET: Registered PF_PACKET protocol family3929worker1 # [ 12.577653] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.23930worker1 # [ 12.581162] dhcpcd[692]: eth0: probing address 10.0.2.15/243931worker1 # [ 12.937722] dhcpcd[692]: eth0: soliciting an IPv6 router3932worker1 # [ 12.940269] dhcpcd[692]: eth0: Router Advertisement from fe80::23933worker1 # [ 12.942735] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643934worker1 # [ 12.944898] dhcpcd[692]: eth0: adding route to fec0::/643935worker1 # [ 12.946811] dhcpcd[692]: eth0: adding default route via fe80::23936lb # [ 12.969082] postgresql-pre-start[730]: performing post-bootstrap initialization ... ok3937lb # [ 13.095830] postgresql-pre-start[730]: syncing data to disk ... ok3938lb # [ 13.096883] postgresql-pre-start[730]: initdb: warning: enabling "trust" authentication for local connections3939lb # [ 13.098842] postgresql-pre-start[730]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3940lb # [ 13.100736] postgresql-pre-start[730]: Success. You can now start the database server using:3941lb # [ 13.101789] postgresql-pre-start[730]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3942lb # [ 13.222881] postgres[792]: [792] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3943lb # [ 13.228157] postgres[792]: [792] LOG: listening on IPv6 address "::1", port 54323944lb # [ 13.229770] postgres[792]: [792] LOG: listening on IPv4 address "127.0.0.1", port 54323945lb # [ 13.233355] postgres[792]: [792] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3946lb # [ 13.245829] postgres[801]: [801] LOG: database system was shut down at 2026-09-20 09:50:12 GMT3947lb # [ 13.252182] postgres[792]: [792] LOG: database system is ready to accept connections3948lb # [ 13.257097] systemd[1]: Started PostgreSQL Server.3949lb # [ 13.263769] systemd[1]: Starting PostgreSQL Setup Scripts...3950lb # [ 13.456104] postgresql-setup-start[812]: CREATE DATABASE3951lb # [ 13.503757] postgresql-setup-start[817]: CREATE ROLE3952lb # [ 13.526052] postgresql-setup-start[819]: ALTER DATABASE3953lb # [ 13.532110] systemd[1]: Finished PostgreSQL Setup Scripts.3954lb # [ 13.533804] systemd[1]: Reached target PostgreSQL.3955client # [ 16.523295] dhcpcd[563]: eth0: leased 10.0.2.15 for 86400 seconds3956client # [ 16.525495] dhcpcd[563]: eth0: adding route to 10.0.2.0/243957client # [ 16.528144] dhcpcd[563]: eth0: adding default route via 10.0.2.23958client # [ 16.646561] systemd[1]: Started DHCP Client.3959client # [ 16.648388] systemd[1]: Reached target Multi-User System.3960client # [ 16.649267] systemd[1]: Startup finished in 839ms (kernel) + 4.963s (initrd) + 10.845s (userspace) = 16.649s.3961worker1 # [ 16.837698] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3962worker1 # [ 16.838847] dhcpcd[692]: eth0: adding route to 10.0.2.0/243963worker1 # [ 16.839656] dhcpcd[692]: eth0: adding default route via 10.0.2.23964worker1 # [ 16.932598] systemd[1]: Started DHCP Client.3965worker1 # [ 16.934665] systemd[1]: Reached target Multi-User System.3966worker1 # [ 16.935548] systemd[1]: Startup finished in 846ms (kernel) + 5.057s (initrd) + 11.030s (userspace) = 16.934s.3967worker2 # [ 17.064737] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3968worker2 # [ 17.067731] dhcpcd[692]: eth0: adding route to 10.0.2.0/243969worker2 # [ 17.069879] dhcpcd[692]: eth0: adding default route via 10.0.2.23970lb # [ 17.136940] dhcpcd[708]: eth0: leased 10.0.2.15 for 86400 seconds3971lb # [ 17.139458] dhcpcd[708]: eth0: adding route to 10.0.2.0/243972lb # [ 17.141468] dhcpcd[708]: eth0: adding default route via 10.0.2.23973worker2 # [ 17.184749] systemd[1]: Started DHCP Client.3974worker2 # [ 17.185601] systemd[1]: Reached target Multi-User System.3975worker2 # [ 17.186394] systemd[1]: Startup finished in 867ms (kernel) + 4.108s (initrd) + 12.208s (userspace) = 17.184s.3976lb # [ 17.250529] systemd[1]: Started DHCP Client.3977lb # [ 17.252581] systemd[1]: Reached target Network is Online.3978lb # [ 17.256670] systemd[1]: Started Envoy reverse proxy.3979lb # [ 17.259813] systemd[1]: Started mock-oidc.service.3980lb # [ 17.348098] mock-oidc-server[920]: Mock OIDC Server running3981lb # [ 17.349184] mock-oidc-server[920]: OIDC Address: 192.168.1.2:80803982lb # [ 17.350577] mock-oidc-server[920]: Issue Address: 0.0.0.0:80813983lb # [ 17.351621] mock-oidc-server[920]: Issuer: http://192.168.1.2:8080/oidc3984lb # [ 17.352650] mock-oidc-server[920]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3985lb # [ 17.354102] mock-oidc-server[920]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3986lb # [ 17.355668] mock-oidc-server[920]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3987lb # [ 17.795284] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3988lb # [ 17.797061] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:469] statically linked extensions:3989lb # [ 17.798399] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3990lb # [ 17.801251] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3991lb # [ 17.815907] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3992lb # [ 17.821698] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3993lb # [ 17.826863] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3994lb # [ 17.829123] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3995lb # [ 17.831104] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3996lb # [ 17.833351] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3997lb # [ 17.835552] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3998lb # [ 17.837971] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3999lb # [ 17.840227] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4000lb # [ 17.842851] envoy[919]: [2026-09-20 09:50:17.014][919][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4001lb # [ 17.847272] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4002lb # [ 17.850952] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4003lb # [ 17.852499] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14004lb # [ 17.854416] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4005lb # [ 17.856410] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4006lb # [ 17.858724] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4007lb # [ 17.869863] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4008lb # [ 17.871753] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4009lb # [ 17.873820] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4010lb # [ 17.875450] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4011lb # [ 17.877262] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4012lb # [ 17.880083] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4013lb # [ 17.881861] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4014lb # [ 17.883327] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4015lb # [ 17.885655] envoy[919]: [2026-09-20 09:50:17.020][919][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4016lb # [ 17.887462] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4017lb # [ 17.893353] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4018lb # [ 17.895705] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24019lb # [ 17.897713] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4020lb # [ 17.899974] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4021lb # [ 17.902569] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4022lb # [ 17.905070] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4023lb # [ 17.911237] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4024lb # [ 17.913038] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4025lb # [ 17.914504] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4026lb # [ 17.916227] envoy[919]: [2026-09-20 09:50:17.027][919][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4027lb # [ 17.917865] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4028lb # [ 17.919413] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4029lb # [ 17.921762] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24030lb # [ 17.923240] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4031lb # [ 17.925130] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4032lb # [ 17.926779] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4033lb # [ 17.928234] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4034lb # [ 17.929875] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4035lb # [ 17.934095] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4036lb # [ 17.936199] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4037lb # [ 17.938137] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4038lb # [ 17.940143] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4039lb # [ 17.941976] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4040lb # [ 17.945092] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4041lb # [ 17.946755] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4042lb # [ 17.952215] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24043lb # [ 17.953804] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4044lb # [ 17.955512] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4045lb # [ 17.957252] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4046lb # [ 17.960205] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4047lb # [ 17.961883] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4048lb # [ 17.986816] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4049lb # [ 17.988525] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4050lb # [ 17.990649] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84051lb # [ 17.992332] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4052lb # [ 17.994756] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4053lb # [ 17.996839] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4054lb # [ 18.002824] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4055lb # [ 18.004564] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4056lb # [ 18.007052] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4057lb # [ 18.009331] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4058lb # [ 18.011780] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4059lb # [ 18.016049] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4060lb # [ 18.020140] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4061lb # [ 18.021911] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4062lb # [ 18.025698] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4063lb # [ 18.027696] envoy[919]: [2026-09-20 09:50:17.028][919][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4064lb # [ 18.029765] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4065lb # [ 18.032682] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4066lb # [ 18.035375] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4067lb # [ 18.044307] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4068lb # [ 18.046641] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4069lb # [ 18.051306] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4070lb # [ 18.053284] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4071lb # [ 18.056445] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4072lb # [ 18.058775] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4073lb # [ 18.062780] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4074lb # [ 18.065717] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4075lb # [ 18.068045] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4076lb # [ 18.070737] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4077lb # [ 18.072472] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4078lb # [ 18.074258] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4079lb # [ 18.076050] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4080lb # [ 18.078131] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4081lb # [ 18.080531] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4082lb # [ 18.082408] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4083lb # [ 18.085394] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4084lb # [ 18.088121] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4085lb # [ 18.090640] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4086lb # [ 18.093050] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4087lb # [ 18.094933] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4088lb # [ 18.096552] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4089lb # [ 18.099669] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4090lb # [ 18.101318] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4091lb # [ 18.105161] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4092lb # [ 18.106573] envoy[919]: [2026-09-20 09:50:17.029][919][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4093lb # [ 18.108884] envoy[919]: [2026-09-20 09:50:17.164][919][info][main] [source/server/server.cc:531] HTTP header map info:4094lb # [ 18.110116] envoy[919]: [2026-09-20 09:50:17.226][919][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4095lb # [ 18.122550] envoy[919]: [2026-09-20 09:50:17.226][919][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4096lb # [ 18.124236] envoy[919]: [2026-09-20 09:50:17.226][919][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4097lb # [ 18.131665] envoy[919]: [2026-09-20 09:50:17.226][919][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4098lb # [ 18.164269] envoy[919]: [2026-09-20 09:50:17.383][919][info][main] [source/server/server.cc:968] runtime: {}4099lb # [ 18.170116] envoy[919]: [2026-09-20 09:50:17.389][919][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4100lb # [ 18.172121] envoy[919]: [2026-09-20 09:50:17.391][919][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014101lb # [ 18.174623] envoy[919]: [2026-09-20 09:50:17.394][919][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014102lb # [ 18.177327] envoy[919]: [2026-09-20 09:50:17.396][919][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4103lb # [ 18.178900] envoy[919]: [2026-09-20 09:50:17.398][919][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4104lb # [ 18.180414] envoy[919]: [2026-09-20 09:50:17.398][919][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4105lb # [ 18.236537] envoy[919]: [2026-09-20 09:50:17.456][919][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4106worker1 # [ 18.236309] systemd[1]: Starting Nix worker-protocol over gRPC...4107worker2 # [ 18.227889] systemd[1]: Starting Nix worker-protocol over gRPC...4108lb # [ 18.265766] envoy[919]: [2026-09-20 09:50:17.485][919][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4109lb # [ 18.269098] envoy[919]: [2026-09-20 09:50:17.488][919][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4110lb # [ 18.271948] envoy[919]: [2026-09-20 09:50:17.488][919][info][main] [source/server/server.cc:1077] starting main dispatch loop4111worker1 # [ 18.456765] nix-grpc-daemon[783]: ts=2026-09-20T09:50:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4112worker1 # [ 18.467142] nix-grpc-daemon[783]: ts=2026-09-20T09:50:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14113worker2 # [ 18.455830] nix-grpc-daemon[785]: ts=2026-09-20T09:50:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4114worker2 # [ 18.465531] nix-grpc-daemon[785]: ts=2026-09-20T09:50:18Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14115worker1 # [ 18.505519] nix-grpc-daemon[783]: ts=2026-09-20T09:50:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4116worker1 # [ 18.509442] systemd[1]: Started Nix worker-protocol over gRPC.4117worker2 # [ 18.504516] nix-grpc-daemon[785]: ts=2026-09-20T09:50:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4118worker2 # [ 18.509171] systemd[1]: Started Nix worker-protocol over gRPC.4119lb # [ 18.553127] envoy[919]: [2026-09-20 09:50:17.772][919][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4120worker2 # [ 18.534502] nix-grpc-daemon[785]: ts=2026-09-20T09:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4121worker1 # [ 18.550550] nix-grpc-daemon[783]: ts=2026-09-20T09:50:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4122lb # [ 18.554956] envoy[919]: [2026-09-20 09:50:17.774][919][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4123lb # [ 18.556802] envoy[919]: [2026-09-20 09:50:17.774][919][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4124lb # [ 18.558445] envoy[919]: [2026-09-20 09:50:17.776][919][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4125worker1 # [ 18.751375] nix-grpc-daemon[783]: ts=2026-09-20T09:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4126worker2 # [ 18.735782] nix-grpc-daemon[785]: ts=2026-09-20T09:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4127worker1 # [ 19.151780] nix-grpc-daemon[783]: ts=2026-09-20T09:50:18Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4128worker2 # [ 19.136418] nix-grpc-daemon[785]: ts=2026-09-20T09:50:19Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4129worker1 # [ 19.955814] nix-grpc-daemon[783]: ts=2026-09-20T09:50:19Z level=info event=scheduler_connected addr=lb:500514130worker2 # [ 19.940903] nix-grpc-daemon[785]: ts=2026-09-20T09:50:19Z level=info event=scheduler_connected addr=lb:500514131worker1 # [ 19.978456] nix-grpc-daemon[783]: ts=2026-09-20T09:50:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04132worker1 # [ 19.984119] nix-grpc-daemon[783]: ts=2026-09-20T09:50:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04133lb # [ 29.264747] rustfs-bucket-start[1038]: mb s3://farm4134lb # [ 29.270210] systemd[1]: Finished rustfs-bucket.service.4135lb # [ 29.276347] systemd[1]: Starting niks3 server...4136lb # [ 29.492750] postgres[1053]: [1053] ERROR: relation "goose_db_version" does not exist at character 364137lb # [ 29.493963] postgres[1053]: [1053] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4138lb # [ 29.531863] niks3-server[1047]: 2026/09/20 09:50:28 OK 20241026095416_initial_model.sql (20.16ms)4139lb # [ 29.535410] niks3-server[1047]: 2026/09/20 09:50:28 OK 20251210153512_drop_unused_gin_index.sql (3.63ms)4140lb # [ 29.540193] niks3-server[1047]: 2026/09/20 09:50:28 OK 20251218171726_add_pins.sql (4.76ms)4141lb # [ 29.544959] niks3-server[1047]: 2026/09/20 09:50:28 OK 20260628120000_add_object_size_and_stats.sql (4.82ms)4142lb # [ 29.549377] niks3-server[1047]: 2026/09/20 09:50:28 OK 20260905000000_add_claims.sql (2.94ms)4143lb # [ 29.550479] niks3-server[1047]: 2026/09/20 09:50:28 goose: successfully migrated database to version: 202609050000004144lb # [ 29.556259] niks3-server[1047]: 2026/09/20 09:50:28 OK 1_commit_pending_closure.sql (6.85ms)4145lb # [ 29.558737] niks3-server[1047]: 2026/09/20 09:50:28 OK 2_object_stats_trigger.sql (2.53ms)4146lb # [ 29.559927] niks3-server[1047]: 2026/09/20 09:50:28 goose: up to current file version: 24147lb # [ 29.566170] niks3-server[1047]: 2026/09/20 09:50:28 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4148lb # [ 29.638365] niks3-server[1047]: 2026/09/20 09:50:28 INFO Read proxy enabled — serving cache objects from S34149lb # [ 29.640424] niks3-server[1047]: 2026/09/20 09:50:28 INFO Using socket-activated listener address=0.0.0.0:57514150lb # [ 29.646174] systemd[1]: Started niks3 server.4151lb # [ 29.646888] niks3-server[1047]: 2026/09/20 09:50:28 INFO systemd watchdog enabled interval=15s4152lb # [ 29.648464] systemd[1]: Reached target Multi-User System.4153lb # [ 29.649881] systemd[1]: Startup finished in 851ms (kernel) + 4.061s (initrd) + 24.736s (userspace) = 29.649s.4154lb # [ 29.651820] niks3-server[1047]: 2026/09/20 09:50:28 INFO Starting HTTP server address=0.0.0.0:57514155lb: (finished: waiting for unit niks3.service, in 18.50 seconds)4156lb: waiting for TCP port 5751 on localhost4157lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4158lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4159lb: waiting for unit envoy.service4160lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4161lb: waiting for TCP port 50051 on localhost4162lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4163lb # [ 30.299420] envoy[919]: conn peer=[::1]:41748 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24164lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4165lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4166??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4167 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284168lb: must succeed: curl -sf localhost:9901/clusters4169lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4170lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)4171lb: waiting until exactly no endpoints of sched are unhealthy4172lb: must succeed: curl -sf localhost:9901/clusters4173lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4174lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.04 seconds)4175subtest: both builders hold a WorkerSession on the scheduler4176worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4177worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4178(finished: subtest: both builders hold a WorkerSession on the scheduler, in 0.08 seconds)4179subtest: balancer auth: client cert, bearer token, nothing, unknown CN4180worker1 # [ 30.936618] nix-grpc-daemon[783]: ts=2026-09-20T09:50:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337804181worker1 # [ 30.947747] systemd[1]: Started Nix Daemon.4182worker1 # [ 31.149551] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4183worker1 # [ 31.200208] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5)4184worker1 # [ 31.230695] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 2/5)4185worker1 # [ 31.247357] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 3/5)4186worker1 # [ 31.295515] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 769 ms (attempt 4/5)4187worker1 # [ 32.074849] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4188worker1 # [ 32.099383] nix-grpc-daemon[783]: ts=2026-09-20T09:50:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:337804189worker1 # [ 32.116703] nix-grpc-daemon[783]: ts=2026-09-20T09:50:31Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4190worker2 # [ 32.115871] nix-grpc-daemon[785]: ts=2026-09-20T09:50:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347404191worker2 # [ 32.130496] systemd[1]: Started Nix Daemon.4192worker2 # [ 32.332393] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4193worker2 # [ 32.369380] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)4194worker2 # [ 32.389733] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 2/5)4195worker2 # [ 32.470257] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 388 ms (attempt 3/5)4196worker2 # [ 32.858969] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 4/5)4197worker2 # [ 33.011189] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4198worker2 # [ 33.025498] nix-grpc-daemon[785]: ts=2026-09-20T09:50:33Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4199client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4200client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)4201client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4202client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4203worker1 # [ 33.440798] nix-grpc-daemon[783]: ts=2026-09-20T09:50:32Z level=info event=oidc_jwks provider=mock keys=14204worker1 # [ 33.444642] nix-grpc-daemon[783]: ts=2026-09-20T09:50:32Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:337804205worker1 # [ 33.456345] nix-grpc-daemon[783]: ts=2026-09-20T09:50:32Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:337804206worker1 # [ 33.465113] nix-grpc-daemon[783]: ts=2026-09-20T09:50:32Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4207worker2 # [ 33.462500] nix-grpc-daemon[785]: ts=2026-09-20T09:50:33Z level=info event=oidc_jwks provider=mock keys=14208worker2 # [ 33.464682] nix-grpc-daemon[785]: ts=2026-09-20T09:50:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:347404209worker2 # [ 33.469861] nix-grpc-daemon[785]: ts=2026-09-20T09:50:33Z level=debug event=path_info_miss path=p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test error="error: path '/nix/store/p9sd1i74w6yh86l94pim59ldq7caqhbx-nixos-system-client-test' is required, but there is no substituter that can build it"4210client: must succeed: rm -r /var/lib/nix-grpc-store4211client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4212worker2 # [ 33.717501] nix-grpc-daemon[785]: ts=2026-09-20T09:50:33Z level=info event=denied method=QueryMissing cn=- role=none4213worker2 # [ 33.938295] nix-grpc-daemon[785]: ts=2026-09-20T09:50:33Z level=info event=denied method=QueryMissing cn=stranger role=none4214(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.37 seconds)4215subtest: DAG build is scheduled across workers and lands in the cache4216client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24217worker1 # [ 34.196291] nix-grpc-daemon[783]: ts=2026-09-20T09:50:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337804218client # don't know how to build these paths:4219client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4220worker2 # [ 34.191367] nix-grpc-daemon[785]: ts=2026-09-20T09:50:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404221worker1 # [ 34.237863] nix-grpc-daemon[783]: ts=2026-09-20T09:50:33Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04222worker1 # [ 34.242477] nix-grpc-daemon[783]: ts=2026-09-20T09:50:33Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14223worker2 # [ 34.278337] nix-grpc-daemon[785]: ts=2026-09-20T09:50:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404224worker2 # [ 34.298122] nix-grpc-daemon[785]: ts=2026-09-20T09:50:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404225client # copying 1 paths to 'lb:50051'...4226worker2 # [ 34.309291] nix-grpc-daemon[785]: ts=2026-09-20T09:50:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404227client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4228worker2 # [ 34.336776] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4229worker2 # [ 34.363542] nix-grpc-daemon[785]: ts=2026-09-20T09:50:34Z level=info event=niks3_push_started pid=8184230worker2 # [ 34.852490] nix-daemon[808]: accepted connection from pid 829, user nix-grpc-daemon (trusted)4231worker2 # [ 34.870555] nix-daemon[808]: reaped child process 833, status = succeeded4232worker2 # [ 35.053161] nix-daemon[808]: accepted connection from pid 836, user nix-grpc-daemon (trusted)4233worker2 # [ 35.065425] nix-daemon[808]: reaped child process 839, status = succeeded4234lb # [ 35.103438] niks3-server[1047]: 2026/09/20 09:50:34 INFO Received uploads request method=POST path=/api/pending_closures4235worker2 # [ 35.114062] nix-grpc-daemon[818]: time=2026-09-20T09:50:35.118Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4236worker2 # [ 35.116174] nix-grpc-daemon[818]: time=2026-09-20T09:50:35.120Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4237lb # [ 35.171207] niks3-server[1047]: 2026/09/20 09:50:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4238lb # [ 35.190064] niks3-server[1047]: 2026/09/20 09:50:34 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4239lb # [ 35.199644] niks3-server[1047]: 2026/09/20 09:50:34 INFO Signed narinfos id=1 count=14240worker2 # [ 35.183901] nix-grpc-daemon[818]: time=2026-09-20T09:50:35.189Z level=INFO msg="Uploading 1 narinfos"4241lb # [ 35.210761] niks3-server[1047]: 2026/09/20 09:50:34 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4242lb # [ 35.213723] niks3-server[1047]: 2026/09/20 09:50:34 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4243lb # [ 35.222233] niks3-server[1047]: 2026/09/20 09:50:34 INFO Completed upload id=14244worker2 # [ 35.204685] nix-grpc-daemon[818]: time=2026-09-20T09:50:35.210Z level=INFO msg="Upload complete. (542ms)"4245lb # [ 35.227272] niks3-server[1047]: 2026/09/20 09:50:34 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4246worker2 # [ 35.210532] nix-grpc-daemon[785]: ts=2026-09-20T09:50:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_in=5044247worker2 # [ 35.217685] nix-grpc-daemon[785]: ts=2026-09-20T09:50:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404248worker2 # [ 35.229130] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4249worker2 # [ 35.238742] nix-daemon[808]: reaped child process 816, status = succeeded4250client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4251client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4252worker2 # [ 35.242275] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4253client # farm-a> LOG-farm-a-t14254worker2 # [ 36.068882] nix-daemon[808]: reaped child process 843, status = succeeded4255worker2 # [ 36.239070] nix-daemon[808]: accepted connection from pid 859, user nix-grpc-daemon (trusted)4256worker2 # [ 36.252745] nix-daemon[808]: reaped child process 862, status = succeeded4257lb # [ 36.288246] niks3-server[1047]: 2026/09/20 09:50:35 INFO Received uploads request method=POST path=/api/pending_closures4258worker2 # [ 36.281991] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.287Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4259worker2 # [ 36.283676] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.289Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4260lb # [ 36.329634] niks3-server[1047]: 2026/09/20 09:50:35 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4261lb # [ 36.344161] niks3-server[1047]: 2026/09/20 09:50:35 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4262lb # [ 36.360362] niks3-server[1047]: 2026/09/20 09:50:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4263lb # [ 36.364235] niks3-server[1047]: 2026/09/20 09:50:35 INFO Signed narinfos id=2 count=14264worker2 # [ 36.349788] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.355Z level=INFO msg="Uploading 1 narinfos"4265lb # [ 36.369187] niks3-server[1047]: 2026/09/20 09:50:35 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4266lb # [ 36.377727] niks3-server[1047]: 2026/09/20 09:50:35 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4267lb # [ 36.383270] niks3-server[1047]: 2026/09/20 09:50:35 INFO Completed upload id=24268lb # [ 36.384864] niks3-server[1047]: 2026/09/20 09:50:35 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4269worker2 # [ 36.366822] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.372Z level=INFO msg="Upload complete. (314ms)"4270worker2 # [ 36.374155] nix-grpc-daemon[785]: ts=2026-09-20T09:50:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14271worker1 # [ 36.399079] nix-grpc-daemon[783]: ts=2026-09-20T09:50:35Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04272worker1 # [ 36.400914] nix-grpc-daemon[783]: ts=2026-09-20T09:50:35Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14273worker2 # [ 36.387203] nix-daemon[808]: reaped child process 841, status = succeeded4274worker2 # [ 36.428597] nix-grpc-daemon[785]: ts=2026-09-20T09:50:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404275worker2 # [ 36.440710] nix-grpc-daemon[785]: ts=2026-09-20T09:50:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404276worker2 # [ 36.453480] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.459Z level=INFO msg="All 1 paths already cached"4277client # copying 1 paths to 'lb:50051'...4278worker2 # [ 36.461348] nix-grpc-daemon[785]: ts=2026-09-20T09:50:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404279client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4280worker2 # [ 36.483164] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4281worker2 # [ 36.681654] nix-daemon[808]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4282worker2 # [ 36.694868] nix-daemon[808]: reaped child process 869, status = succeeded4283worker2 # [ 36.868131] nix-daemon[808]: accepted connection from pid 871, user nix-grpc-daemon (trusted)4284worker2 # [ 36.880845] nix-daemon[808]: reaped child process 874, status = succeeded4285lb # [ 36.915594] niks3-server[1047]: 2026/09/20 09:50:36 INFO Received uploads request method=POST path=/api/pending_closures4286worker2 # [ 36.908584] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.914Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4287worker2 # [ 36.910579] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.916Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4288lb # [ 36.946155] niks3-server[1047]: 2026/09/20 09:50:36 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4289lb # [ 36.956596] niks3-server[1047]: 2026/09/20 09:50:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4290lb # [ 36.962235] niks3-server[1047]: 2026/09/20 09:50:36 INFO Signed narinfos id=3 count=14291worker2 # [ 36.947232] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.953Z level=INFO msg="Uploading 1 narinfos"4292lb # [ 36.968042] niks3-server[1047]: 2026/09/20 09:50:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4293lb # [ 36.977573] niks3-server[1047]: 2026/09/20 09:50:36 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4294lb # [ 36.982668] niks3-server[1047]: 2026/09/20 09:50:36 INFO Completed upload id=34295worker2 # [ 36.966906] nix-grpc-daemon[818]: time=2026-09-20T09:50:36.973Z level=INFO msg="Upload complete. (469ms)"4296lb # [ 36.987520] niks3-server[1047]: 2026/09/20 09:50:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4297worker2 # [ 36.970069] nix-grpc-daemon[785]: ts=2026-09-20T09:50:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_in=6244298worker2 # [ 36.975583] nix-grpc-daemon[785]: ts=2026-09-20T09:50:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404299worker2 # [ 36.986736] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4300worker2 # [ 36.988982] nix-daemon[808]: reaped child process 864, status = succeeded4301worker2 # [ 36.993944] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4302client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4303client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4304client # farm-b> LOG-farm-b-t14305worker2 # [ 38.220177] nix-daemon[808]: reaped child process 878, status = succeeded4306lb # [ 38.247263] envoy[919]: conn peer=[2001:db8:1::1]:42560 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=21664307lb # [ 38.250900] envoy[919]: conn peer=[2001:db8:1::1]:47064 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=774308lb # [ 38.254300] envoy[919]: conn peer=[2001:db8:1::1]:47078 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=144309lb # [ 38.257583] envoy[919]: conn peer=[2001:db8:1::1]:47086 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=94310worker2 # [ 38.384544] nix-daemon[808]: accepted connection from pid 893, user nix-grpc-daemon (trusted)4311worker2 # [ 38.395835] nix-daemon[808]: reaped child process 896, status = succeeded4312lb # [ 38.432196] niks3-server[1047]: 2026/09/20 09:50:37 INFO Received uploads request method=POST path=/api/pending_closures4313worker2 # [ 38.427811] nix-grpc-daemon[818]: time=2026-09-20T09:50:38.433Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4314worker2 # [ 38.429702] nix-grpc-daemon[818]: time=2026-09-20T09:50:38.435Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4315lb # [ 38.479446] niks3-server[1047]: 2026/09/20 09:50:37 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4316lb # [ 38.486961] niks3-server[1047]: 2026/09/20 09:50:37 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4317lb # [ 38.495759] niks3-server[1047]: 2026/09/20 09:50:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4318lb # [ 38.501089] niks3-server[1047]: 2026/09/20 09:50:37 INFO Signed narinfos id=4 count=14319worker2 # [ 38.483173] nix-grpc-daemon[818]: time=2026-09-20T09:50:38.488Z level=INFO msg="Uploading 1 narinfos"4320lb # [ 38.506233] niks3-server[1047]: 2026/09/20 09:50:37 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4321lb # [ 38.515058] niks3-server[1047]: 2026/09/20 09:50:37 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4322lb # [ 38.518895] niks3-server[1047]: 2026/09/20 09:50:37 INFO Completed upload id=44323worker2 # [ 38.501186] nix-grpc-daemon[818]: time=2026-09-20T09:50:38.507Z level=INFO msg="Upload complete. (299ms)"4324lb # [ 38.521459] niks3-server[1047]: 2026/09/20 09:50:37 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4325worker2 # [ 38.506878] nix-grpc-daemon[785]: ts=2026-09-20T09:50:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14326worker1 # [ 38.529722] nix-grpc-daemon[783]: ts=2026-09-20T09:50:37Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04327worker1 # [ 38.533647] nix-grpc-daemon[783]: ts=2026-09-20T09:50:37Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14328worker2 # [ 38.521573] nix-daemon[808]: reaped child process 876, status = succeeded4329worker2 # [ 38.556682] nix-grpc-daemon[785]: ts=2026-09-20T09:50:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404330worker2 # [ 38.567238] nix-grpc-daemon[785]: ts=2026-09-20T09:50:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404331worker2 # [ 38.577506] nix-grpc-daemon[818]: time=2026-09-20T09:50:38.583Z level=INFO msg="All 2 paths already cached"4332client # copying 1 paths to 'lb:50051'...4333client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4334worker2 # [ 38.585131] nix-grpc-daemon[785]: ts=2026-09-20T09:50:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404335worker2 # [ 38.597225] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4336worker2 # [ 38.758878] nix-daemon[808]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4337worker2 # [ 38.771886] nix-daemon[808]: reaped child process 903, status = succeeded4338worker2 # [ 38.925640] nix-daemon[808]: accepted connection from pid 905, user nix-grpc-daemon (trusted)4339worker2 # [ 38.938390] nix-daemon[808]: reaped child process 908, status = succeeded4340lb # [ 38.970465] niks3-server[1047]: 2026/09/20 09:50:38 INFO Received uploads request method=POST path=/api/pending_closures4341worker2 # [ 38.961271] nix-grpc-daemon[818]: time=2026-09-20T09:50:38.967Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4342worker2 # [ 38.963592] nix-grpc-daemon[818]: time=2026-09-20T09:50:38.969Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4343lb # [ 38.997344] niks3-server[1047]: 2026/09/20 09:50:38 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4344lb # [ 39.009405] niks3-server[1047]: 2026/09/20 09:50:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4345lb # [ 39.016115] niks3-server[1047]: 2026/09/20 09:50:38 INFO Signed narinfos id=5 count=14346worker2 # [ 39.001420] nix-grpc-daemon[818]: time=2026-09-20T09:50:39.007Z level=INFO msg="Uploading 1 narinfos"4347lb # [ 39.020961] niks3-server[1047]: 2026/09/20 09:50:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4348lb # [ 39.031144] niks3-server[1047]: 2026/09/20 09:50:38 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4349lb # [ 39.037626] niks3-server[1047]: 2026/09/20 09:50:38 INFO Completed upload id=54350worker2 # [ 39.020753] nix-grpc-daemon[818]: time=2026-09-20T09:50:39.026Z level=INFO msg="Upload complete. (409ms)"4351worker2 # [ 39.021974] nix-grpc-daemon[785]: ts=2026-09-20T09:50:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_in=7524352lb # [ 39.042369] niks3-server[1047]: 2026/09/20 09:50:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4353worker2 # [ 39.028396] nix-grpc-daemon[785]: ts=2026-09-20T09:50:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404354worker2 # [ 39.032508] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4355worker2 # [ 39.034726] nix-daemon[808]: reaped child process 898, status = succeeded4356client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4357worker2 # [ 39.040704] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4358client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4359client # farm-top> LOG-farm-top-t14360worker2 # [ 39.864807] nix-daemon[808]: reaped child process 913, status = succeeded4361worker2 # [ 40.032901] nix-daemon[808]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4362worker2 # [ 40.045774] nix-daemon[808]: reaped child process 931, status = succeeded4363lb # [ 40.081279] niks3-server[1047]: 2026/09/20 09:50:39 INFO Received uploads request method=POST path=/api/pending_closures4364worker2 # [ 40.070098] nix-grpc-daemon[818]: time=2026-09-20T09:50:40.076Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4365worker2 # [ 40.071727] nix-grpc-daemon[818]: time=2026-09-20T09:50:40.077Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4366lb # [ 40.109462] niks3-server[1047]: 2026/09/20 09:50:39 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4367lb # [ 40.113279] niks3-server[1047]: 2026/09/20 09:50:39 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4368lb # [ 40.116687] niks3-server[1047]: 2026/09/20 09:50:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4369lb # [ 40.119429] niks3-server[1047]: 2026/09/20 09:50:39 INFO Signed narinfos id=6 count=14370worker2 # [ 40.101748] nix-grpc-daemon[818]: time=2026-09-20T09:50:40.107Z level=INFO msg="Uploading 1 narinfos"4371lb # [ 40.122398] niks3-server[1047]: 2026/09/20 09:50:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4372lb # [ 40.127148] niks3-server[1047]: 2026/09/20 09:50:39 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4373lb # [ 40.129924] niks3-server[1047]: 2026/09/20 09:50:39 INFO Completed upload id=64374worker2 # [ 40.112065] nix-grpc-daemon[818]: time=2026-09-20T09:50:40.118Z level=INFO msg="Upload complete. (266ms)"4375lb # [ 40.132828] niks3-server[1047]: 2026/09/20 09:50:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4376worker2 # [ 40.115945] nix-grpc-daemon[785]: ts=2026-09-20T09:50:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14377worker2 # [ 40.121537] nix-daemon[808]: reaped child process 911, status = succeeded4378client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.19 seconds)4379client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4380client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.21 seconds)4381client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4382client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.03 seconds)4383client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4384client # copying 3 paths...4385client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4386client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4387client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4388client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.30 seconds)4389(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.81 seconds)4390subtest: repeat is answered Cached by the scheduler without building4391worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4392worker1 # finding garbage collector roots...4393worker1 # deleting specified paths...4394worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4395worker1 # deleting unused links...4396worker1 # note: hard linking is currently saving 0.0 KiB4397worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4398worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4399worker2 # finding garbage collector roots...4400worker2 # deleting specified paths...4401worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4402worker2 # deleting unused links...4403worker2 # note: hard linking is currently saving 0.0 KiB4404worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4405client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24406client # don't know how to build these paths:4407client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4408worker1 # [ 41.501941] nix-grpc-daemon[783]: ts=2026-09-20T09:50:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337804409worker2 # [ 41.489157] nix-grpc-daemon[785]: ts=2026-09-20T09:50:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404410worker2 # [ 41.494224] nix-grpc-daemon[818]: time=2026-09-20T09:50:41.500Z level=INFO msg="All 2 paths already cached"4411worker1 # [ 41.520138] nix-grpc-daemon[783]: ts=2026-09-20T09:50:40Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14412client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.26 seconds)4413client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4414client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds)4415worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}'4416worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}', in 0.04 seconds)4417(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.05 seconds)4418subtest: inputs already in the cache are not sent to the scheduler4419worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4420worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4421client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24422client # don't know how to build these paths:4423client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4424worker1 # [ 42.057576] nix-grpc-daemon[783]: ts=2026-09-20T09:50:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337804425worker1 # [ 42.062769] nix-grpc-daemon[783]: ts=2026-09-20T09:50:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:337804426worker1 # [ 42.087537] nix-grpc-daemon[783]: ts=2026-09-20T09:50:41Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04427worker2 # [ 42.074559] nix-grpc-daemon[785]: ts=2026-09-20T09:50:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404428worker1 # [ 42.091890] nix-grpc-daemon[783]: ts=2026-09-20T09:50:41Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14429worker2 # [ 42.086639] nix-grpc-daemon[785]: ts=2026-09-20T09:50:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404430worker2 # [ 42.099677] nix-grpc-daemon[818]: time=2026-09-20T09:50:42.105Z level=INFO msg="All 2 paths already cached"4431client # copying 1 paths to 'lb:50051'...4432client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4433worker2 # [ 42.106317] nix-grpc-daemon[785]: ts=2026-09-20T09:50:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404434worker2 # [ 42.117979] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4435worker2 # [ 42.311333] nix-daemon[808]: accepted connection from pid 948, user nix-grpc-daemon (trusted)4436worker2 # [ 42.324522] nix-daemon[808]: reaped child process 952, status = succeeded4437worker2 # [ 42.492675] nix-daemon[808]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4438worker2 # [ 42.505407] nix-daemon[808]: reaped child process 957, status = succeeded4439lb # [ 42.538914] niks3-server[1047]: 2026/09/20 09:50:41 INFO Received uploads request method=POST path=/api/pending_closures4440worker2 # [ 42.525420] nix-grpc-daemon[818]: time=2026-09-20T09:50:42.531Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4441worker2 # [ 42.526874] nix-grpc-daemon[818]: time=2026-09-20T09:50:42.531Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4442lb # [ 42.551271] niks3-server[1047]: 2026/09/20 09:50:41 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4443lb # [ 42.554435] niks3-server[1047]: 2026/09/20 09:50:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4444lb # [ 42.556082] niks3-server[1047]: 2026/09/20 09:50:41 INFO Signed narinfos id=7 count=14445worker2 # [ 42.538651] nix-grpc-daemon[818]: time=2026-09-20T09:50:42.544Z level=INFO msg="Uploading 1 narinfos"4446lb # [ 42.561993] niks3-server[1047]: 2026/09/20 09:50:41 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4447lb # [ 42.565411] niks3-server[1047]: 2026/09/20 09:50:41 INFO Completed upload id=74448worker2 # [ 42.547511] nix-grpc-daemon[818]: time=2026-09-20T09:50:42.553Z level=WARN msg="Failed to register uploaded object" key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo error="server returned 404: object is not pending upload\n"4449lb # [ 42.566814] niks3-server[1047]: 2026/09/20 09:50:41 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4450worker2 # [ 42.550792] nix-grpc-daemon[818]: time=2026-09-20T09:50:42.556Z level=INFO msg="Upload complete. (419ms)"4451worker2 # [ 42.553388] nix-grpc-daemon[785]: ts=2026-09-20T09:50:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_in=7524452worker2 # [ 42.555301] nix-grpc-daemon[785]: ts=2026-09-20T09:50:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404453worker2 # [ 42.562475] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4454worker2 # [ 42.564468] nix-daemon[808]: reaped child process 946, status = succeeded4455client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4456client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4457worker2 # [ 42.569693] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4458client # farm-top> LOG-farm-top-t1b4459worker2 # [ 43.996884] nix-daemon[808]: reaped child process 961, status = succeeded4460worker2 # [ 44.138645] nix-daemon[808]: accepted connection from pid 976, user nix-grpc-daemon (trusted)4461worker2 # [ 44.151232] nix-daemon[808]: reaped child process 979, status = succeeded4462lb # [ 44.180893] niks3-server[1047]: 2026/09/20 09:50:43 INFO Received uploads request method=POST path=/api/pending_closures4463worker2 # [ 44.174573] nix-grpc-daemon[818]: time=2026-09-20T09:50:44.180Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4464worker2 # [ 44.176902] nix-grpc-daemon[818]: time=2026-09-20T09:50:44.182Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4465lb # [ 44.209250] niks3-server[1047]: 2026/09/20 09:50:43 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4466lb # [ 44.213783] niks3-server[1047]: 2026/09/20 09:50:43 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4467lb # [ 44.216687] niks3-server[1047]: 2026/09/20 09:50:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4468lb # [ 44.219334] niks3-server[1047]: 2026/09/20 09:50:43 INFO Signed narinfos id=8 count=14469worker2 # [ 44.202907] nix-grpc-daemon[818]: time=2026-09-20T09:50:44.208Z level=INFO msg="Uploading 1 narinfos"4470lb # [ 44.220759] niks3-server[1047]: 2026/09/20 09:50:43 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4471lb # [ 44.226360] niks3-server[1047]: 2026/09/20 09:50:43 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4472lb # [ 44.229547] niks3-server[1047]: 2026/09/20 09:50:43 INFO Completed upload id=84473worker2 # [ 44.211560] nix-grpc-daemon[818]: time=2026-09-20T09:50:44.217Z level=INFO msg="Upload complete. (233ms)"4474lb # [ 44.231070] niks3-server[1047]: 2026/09/20 09:50:43 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4475worker2 # [ 44.213926] nix-grpc-daemon[785]: ts=2026-09-20T09:50:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14476worker2 # [ 44.220665] nix-daemon[808]: reaped child process 959, status = succeeded4477client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.40 seconds)4478client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4479client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.17 seconds)4480worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4481worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds)4482(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.64 seconds)4483subtest: two clients wanting the same drv build it once4484client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4485client # [ 44.529157] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4486client # Running as unit: dedup1.service; invocation ID: 6842fb5275a44081865db679e74c6ac04487client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4488client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4489worker1 # [ 44.692644] nix-grpc-daemon[783]: ts=2026-09-20T09:50:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337804490client # [ 44.716782] nix[888]: don't know how to build these paths:4491client # [ 44.717678] nix[888]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4492worker1 # [ 44.704833] nix-grpc-daemon[783]: ts=2026-09-20T09:50:43Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04493worker1 # [ 44.710460] nix-grpc-daemon[783]: ts=2026-09-20T09:50:43Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14494worker1 # [ 44.715645] nix-grpc-daemon[783]: ts=2026-09-20T09:50:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337804495worker1 # [ 44.729956] nix-grpc-daemon[783]: ts=2026-09-20T09:50:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:337804496client # [ 44.757545] nix[888]: copying 1 paths to 'lb:50051'...4497client # [ 44.758355] nix[888]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4498worker1 # [ 44.740323] nix-grpc-daemon[783]: ts=2026-09-20T09:50:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:337804499worker1 # [ 44.751326] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4500worker1 # [ 44.769368] nix-grpc-daemon[783]: ts=2026-09-20T09:50:44Z level=info event=niks3_push_started pid=8964501worker1 # [ 45.190314] nix-daemon[843]: accepted connection from pid 907, user nix-grpc-daemon (trusted)4502worker1 # [ 45.205880] nix-daemon[843]: reaped child process 911, status = succeeded4503worker1 # [ 45.350299] nix-daemon[843]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4504worker1 # [ 45.361706] nix-daemon[843]: reaped child process 916, status = succeeded4505lb # [ 45.379550] niks3-server[1047]: 2026/09/20 09:50:44 INFO Received uploads request method=POST path=/api/pending_closures4506worker1 # [ 45.384236] nix-grpc-daemon[896]: time=2026-09-20T09:50:44.638Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4507worker1 # [ 45.386545] nix-grpc-daemon[896]: time=2026-09-20T09:50:44.641Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4508lb # [ 45.405368] niks3-server[1047]: 2026/09/20 09:50:44 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4509lb # [ 45.407990] niks3-server[1047]: 2026/09/20 09:50:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4510lb # [ 45.410138] niks3-server[1047]: 2026/09/20 09:50:44 INFO Signed narinfos id=9 count=14511worker1 # [ 45.409236] nix-grpc-daemon[896]: time=2026-09-20T09:50:44.665Z level=INFO msg="Uploading 1 narinfos"4512lb # [ 45.413990] niks3-server[1047]: 2026/09/20 09:50:44 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4513lb # [ 45.418814] niks3-server[1047]: 2026/09/20 09:50:44 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4514lb # [ 45.421724] niks3-server[1047]: 2026/09/20 09:50:44 INFO Completed upload id=94515worker1 # [ 45.419659] nix-grpc-daemon[896]: time=2026-09-20T09:50:44.675Z level=INFO msg="Upload complete. (385ms)"4516lb # [ 45.424260] niks3-server[1047]: 2026/09/20 09:50:44 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4517worker1 # [ 45.421495] nix-grpc-daemon[783]: ts=2026-09-20T09:50:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=0 paths=1 nar_bytes_in=4324518worker1 # [ 45.427955] nix-grpc-daemon[783]: ts=2026-09-20T09:50:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337804519worker1 # [ 45.429861] nix-daemon[843]: reaped child process 894, status = succeeded4520worker1 # [ 45.432940] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4521worker1 # [ 45.439550] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4522client # [ 45.456989] nix[888]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4523client # [ 45.594907] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4524client # Running as unit: dedup2.service; invocation ID: 301607d97e564473859250e8a17e47f24525client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4526worker2 # [ 45.803870] nix-grpc-daemon[785]: ts=2026-09-20T09:50:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:347404527client # [ 45.843114] nix[903]: don't know how to build these paths:4528client # [ 45.846055] nix[903]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4529worker1 # [ 45.838836] nix-grpc-daemon[783]: ts=2026-09-20T09:50:45Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04530client # [ 45.862820] nix[903]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4531worker1 # [ 45.844809] nix-grpc-daemon[783]: ts=2026-09-20T09:50:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337804532client: must succeed: sleep 24533lb # [ 48.247982] envoy[919]: conn peer=[2001:db8:1::1]:47090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=3799 ms=59744534lb # [ 48.251789] envoy[919]: conn peer=[2001:db8:1::1]:47102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=324535lb # [ 48.255323] envoy[919]: conn peer=[2001:db8:1::1]:47104 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4152 tx=1713 ms=21864536client: (finished: must succeed: sleep 2, in 2.05 seconds)4537??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4538 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394539client: waiting for success: ! systemctl is-active dedup1 dedup24540??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4541 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394542worker1 # [ 49.054750] nix-daemon[843]: reaped child process 920, status = succeeded4543worker1 # [ 49.201087] nix-daemon[843]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4544worker1 # [ 49.211506] nix-daemon[843]: reaped child process 954, status = succeeded4545lb # [ 49.230924] niks3-server[1047]: 2026/09/20 09:50:48 INFO Received uploads request method=POST path=/api/pending_closures4546worker1 # [ 49.234491] nix-grpc-daemon[896]: time=2026-09-20T09:50:48.490Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4547worker1 # [ 49.236158] nix-grpc-daemon[896]: time=2026-09-20T09:50:48.492Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4548lb # [ 49.257174] niks3-server[1047]: 2026/09/20 09:50:48 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4549lb # [ 49.260200] niks3-server[1047]: 2026/09/20 09:50:48 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4550lb # [ 49.264075] niks3-server[1047]: 2026/09/20 09:50:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4551lb # [ 49.265711] niks3-server[1047]: 2026/09/20 09:50:48 INFO Signed narinfos id=10 count=14552worker1 # [ 49.264318] nix-grpc-daemon[896]: time=2026-09-20T09:50:48.519Z level=INFO msg="Uploading 1 narinfos"4553lb # [ 49.269731] niks3-server[1047]: 2026/09/20 09:50:48 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4554lb # [ 49.275132] niks3-server[1047]: 2026/09/20 09:50:48 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4555lb # [ 49.277906] niks3-server[1047]: 2026/09/20 09:50:48 INFO Completed upload id=104556worker1 # [ 49.275786] nix-grpc-daemon[896]: time=2026-09-20T09:50:48.531Z level=INFO msg="Upload complete. (225ms)"4557lb # [ 49.279547] niks3-server[1047]: 2026/09/20 09:50:48 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4558worker1 # [ 49.278747] nix-grpc-daemon[783]: ts=2026-09-20T09:50:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14559worker1 # [ 49.282132] nix-grpc-daemon[783]: ts=2026-09-20T09:50:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14560worker1 # [ 49.288304] nix-daemon[843]: reaped child process 918, status = succeeded4561client # [ 49.328882] systemd[1]: dedup2.service: Deactivated successfully.4562client # [ 49.330662] systemd[1]: dedup2.service: Consumed 121ms CPU time over 3.736s wall clock time, 31.2M memory peak, 7.4K incoming IP traffic, 6.3K outgoing IP traffic.4563client # [ 49.369251] systemd[1]: dedup1.service: Deactivated successfully.4564client # [ 49.370646] systemd[1]: dedup1.service: Consumed 93ms CPU time over 4.841s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.4565client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4566client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4567client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4568worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4569worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4570worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4571worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4572worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4573worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4574worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4575worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4576(finished: subtest: two clients wanting the same drv build it once, in 5.88 seconds)4577subtest: build hook: nix-daemon with builders = grpc://lb4578client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4579client # [ 50.568804] systemd[1]: Started Nix Daemon.4580client # [ 50.723291] nix-daemon[944]: accepted connection from pid 941, user root (trusted)4581worker1 # [ 50.883174] nix-grpc-daemon[783]: ts=2026-09-20T09:50:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:337804582worker2 # [ 50.872811] nix-grpc-daemon[785]: ts=2026-09-20T09:50:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404583worker1 # [ 50.901837] nix-grpc-daemon[783]: ts=2026-09-20T09:50:50Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04584worker1 # [ 50.905232] nix-grpc-daemon[783]: ts=2026-09-20T09:50:50Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14585worker2 # [ 50.928986] nix-grpc-daemon[785]: ts=2026-09-20T09:50:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404586worker2 # [ 50.939635] nix-grpc-daemon[785]: ts=2026-09-20T09:50:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404587worker2 # [ 50.949084] nix-grpc-daemon[785]: ts=2026-09-20T09:50:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404588worker2 # [ 50.960288] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4589worker2 # [ 51.149596] nix-daemon[808]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4590worker2 # [ 51.164163] nix-daemon[808]: reaped child process 1009, status = succeeded4591worker2 # [ 51.334506] nix-daemon[808]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4592worker2 # [ 51.347719] nix-daemon[808]: reaped child process 1014, status = succeeded4593lb # [ 51.381862] niks3-server[1047]: 2026/09/20 09:50:50 INFO Received uploads request method=POST path=/api/pending_closures4594worker2 # [ 51.372037] nix-grpc-daemon[818]: time=2026-09-20T09:50:51.377Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4595worker2 # [ 51.373446] nix-grpc-daemon[818]: time=2026-09-20T09:50:51.377Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4596lb # [ 51.404616] niks3-server[1047]: 2026/09/20 09:50:50 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4597lb # [ 51.416778] niks3-server[1047]: 2026/09/20 09:50:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4598worker2 # [ 51.403716] nix-grpc-daemon[818]: time=2026-09-20T09:50:51.409Z level=INFO msg="Uploading 1 narinfos"4599lb # [ 51.423101] niks3-server[1047]: 2026/09/20 09:50:50 INFO Signed narinfos id=11 count=14600lb # [ 51.427571] niks3-server[1047]: 2026/09/20 09:50:50 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4601lb # [ 51.437861] niks3-server[1047]: 2026/09/20 09:50:50 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4602lb # [ 51.443981] niks3-server[1047]: 2026/09/20 09:50:50 INFO Completed upload id=114603worker2 # [ 51.426806] nix-grpc-daemon[818]: time=2026-09-20T09:50:51.432Z level=INFO msg="Upload complete. (454ms)"4604worker2 # [ 51.428478] nix-grpc-daemon[785]: ts=2026-09-20T09:50:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_in=5124605lb # [ 51.448504] niks3-server[1047]: 2026/09/20 09:50:50 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4606worker2 # [ 51.435488] nix-grpc-daemon[785]: ts=2026-09-20T09:50:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404607worker2 # [ 51.440147] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4608worker2 # [ 51.442477] nix-daemon[808]: reaped child process 1004, status = succeeded4609worker2 # [ 51.447790] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4610worker2 # [ 52.878718] nix-daemon[808]: reaped child process 1018, status = succeeded4611worker2 # [ 53.028345] nix-daemon[808]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4612worker2 # [ 53.041231] nix-daemon[808]: reaped child process 1036, status = succeeded4613lb # [ 53.076314] niks3-server[1047]: 2026/09/20 09:50:52 INFO Received uploads request method=POST path=/api/pending_closures4614worker2 # [ 53.064987] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.071Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4615worker2 # [ 53.066460] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.072Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4616lb # [ 53.115565] niks3-server[1047]: 2026/09/20 09:50:52 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4617lb # [ 53.122216] niks3-server[1047]: 2026/09/20 09:50:52 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4618lb # [ 53.131980] niks3-server[1047]: 2026/09/20 09:50:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4619lb # [ 53.138995] niks3-server[1047]: 2026/09/20 09:50:52 INFO Signed narinfos id=12 count=14620worker2 # [ 53.123649] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.129Z level=INFO msg="Uploading 1 narinfos"4621lb # [ 53.141997] niks3-server[1047]: 2026/09/20 09:50:52 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4622lb # [ 53.151981] niks3-server[1047]: 2026/09/20 09:50:52 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4623lb # [ 53.158410] niks3-server[1047]: 2026/09/20 09:50:52 INFO Completed upload id=124624lb # [ 53.159995] niks3-server[1047]: 2026/09/20 09:50:52 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4625worker2 # [ 53.142377] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.148Z level=INFO msg="Upload complete. (283ms)"4626worker2 # [ 53.148612] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14627worker1 # [ 53.167751] nix-grpc-daemon[783]: ts=2026-09-20T09:50:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:337804628worker2 # [ 53.161199] nix-daemon[808]: reaped child process 1016, status = succeeded4629worker1 # [ 53.181581] nix-grpc-daemon[783]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4630worker1 # [ 53.213456] nix-grpc-daemon[783]: ts=2026-09-20T09:50:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:337804631worker1 # [ 53.219081] nix-grpc-daemon[783]: ts=2026-09-20T09:50:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=0 paths=1 nar_bytes_out=1284632worker2 # [ 53.450159] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:347404633worker2 # [ 53.456793] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404634worker2 # [ 53.461656] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.467Z level=INFO msg="All 1 paths already cached"4635worker1 # [ 53.487235] nix-grpc-daemon[783]: ts=2026-09-20T09:50:52Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04636worker1 # [ 53.491697] nix-grpc-daemon[783]: ts=2026-09-20T09:50:52Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14637worker2 # [ 53.477994] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404638worker2 # [ 53.489529] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404639worker2 # [ 53.501750] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.507Z level=INFO msg="All 1 paths already cached"4640worker2 # [ 53.508365] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404641worker2 # [ 53.518168] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4642worker2 # [ 53.695707] nix-daemon[808]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4643worker2 # [ 53.710382] nix-daemon[808]: reaped child process 1043, status = succeeded4644worker2 # [ 53.869296] nix-daemon[808]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)4645worker2 # [ 53.882551] nix-daemon[808]: reaped child process 1048, status = succeeded4646lb # [ 53.914838] niks3-server[1047]: 2026/09/20 09:50:53 INFO Received uploads request method=POST path=/api/pending_closures4647worker2 # [ 53.904881] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.910Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4648worker2 # [ 53.906221] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.910Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4649lb # [ 53.941588] niks3-server[1047]: 2026/09/20 09:50:53 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4650lb # [ 53.950585] niks3-server[1047]: 2026/09/20 09:50:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4651worker2 # [ 53.938355] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.944Z level=INFO msg="Uploading 1 narinfos"4652lb # [ 53.955967] niks3-server[1047]: 2026/09/20 09:50:53 INFO Signed narinfos id=13 count=14653lb # [ 53.962257] niks3-server[1047]: 2026/09/20 09:50:53 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4654lb # [ 53.974436] niks3-server[1047]: 2026/09/20 09:50:53 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4655worker2 # [ 53.961317] nix-grpc-daemon[818]: time=2026-09-20T09:50:53.967Z level=INFO msg="Upload complete. (430ms)"4656lb # [ 53.979254] niks3-server[1047]: 2026/09/20 09:50:53 INFO Completed upload id=134657worker2 # [ 53.964080] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_in=6244658lb # [ 53.982301] niks3-server[1047]: 2026/09/20 09:50:53 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4659worker2 # [ 53.968120] nix-grpc-daemon[785]: ts=2026-09-20T09:50:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404660worker2 # [ 53.974135] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4661worker2 # [ 53.976395] nix-daemon[808]: reaped child process 1038, status = succeeded4662worker2 # [ 53.983052] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4663worker2 # [ 55.609918] nix-daemon[808]: reaped child process 1052, status = succeeded4664worker2 # [ 55.758274] nix-daemon[808]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4665worker2 # [ 55.771062] nix-daemon[808]: reaped child process 1070, status = succeeded4666lb # [ 55.804576] niks3-server[1047]: 2026/09/20 09:50:55 INFO Received uploads request method=POST path=/api/pending_closures4667worker2 # [ 55.795340] nix-grpc-daemon[818]: time=2026-09-20T09:50:55.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4668worker2 # [ 55.796928] nix-grpc-daemon[818]: time=2026-09-20T09:50:55.803Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4669lb # [ 55.844273] niks3-server[1047]: 2026/09/20 09:50:55 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4670lb # [ 55.851821] niks3-server[1047]: 2026/09/20 09:50:55 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4671lb # [ 55.863660] niks3-server[1047]: 2026/09/20 09:50:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4672worker2 # [ 55.853264] nix-grpc-daemon[818]: time=2026-09-20T09:50:55.859Z level=INFO msg="Uploading 1 narinfos"4673lb # [ 55.869972] niks3-server[1047]: 2026/09/20 09:50:55 INFO Signed narinfos id=14 count=14674lb # [ 55.874681] niks3-server[1047]: 2026/09/20 09:50:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4675lb # [ 55.883969] niks3-server[1047]: 2026/09/20 09:50:55 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4676lb # [ 55.889619] niks3-server[1047]: 2026/09/20 09:50:55 INFO Completed upload id=144677lb # [ 55.892509] niks3-server[1047]: 2026/09/20 09:50:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4678worker2 # [ 55.872278] nix-grpc-daemon[818]: time=2026-09-20T09:50:55.878Z level=INFO msg="Upload complete. (279ms)"4679worker2 # [ 55.878536] nix-grpc-daemon[785]: ts=2026-09-20T09:50:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14680worker1 # [ 55.898124] nix-grpc-daemon[783]: ts=2026-09-20T09:50:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:337804681worker2 # [ 55.892503] nix-daemon[808]: reaped child process 1050, status = succeeded4682worker1 # [ 55.907353] nix-grpc-daemon[783]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4683worker1 # [ 55.931519] nix-grpc-daemon[783]: ts=2026-09-20T09:50:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:337804684worker1 # [ 55.936346] nix-grpc-daemon[783]: ts=2026-09-20T09:50:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=0 paths=1 nar_bytes_out=1764685worker1 # [ 56.196814] nix-grpc-daemon[783]: ts=2026-09-20T09:50:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:337804686worker2 # [ 56.185117] nix-grpc-daemon[785]: ts=2026-09-20T09:50:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404687worker2 # [ 56.195089] nix-grpc-daemon[818]: time=2026-09-20T09:50:56.201Z level=INFO msg="All 2 paths already cached"4688worker1 # [ 56.226635] nix-grpc-daemon[783]: ts=2026-09-20T09:50:55Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04689worker1 # [ 56.231093] nix-grpc-daemon[783]: ts=2026-09-20T09:50:55Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14690worker2 # [ 56.217496] nix-grpc-daemon[785]: ts=2026-09-20T09:50:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404691worker2 # [ 56.229474] nix-grpc-daemon[785]: ts=2026-09-20T09:50:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404692worker2 # [ 56.241434] nix-grpc-daemon[818]: time=2026-09-20T09:50:56.247Z level=INFO msg="All 2 paths already cached"4693worker2 # [ 56.247965] nix-grpc-daemon[785]: ts=2026-09-20T09:50:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404694worker2 # [ 56.256357] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4695worker2 # [ 56.403299] nix-daemon[808]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4696worker2 # [ 56.417212] nix-daemon[808]: reaped child process 1077, status = succeeded4697worker2 # [ 56.556915] nix-daemon[808]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4698worker2 # [ 56.569813] nix-daemon[808]: reaped child process 1082, status = succeeded4699lb # [ 56.599352] niks3-server[1047]: 2026/09/20 09:50:55 INFO Received uploads request method=POST path=/api/pending_closures4700worker2 # [ 56.589235] nix-grpc-daemon[818]: time=2026-09-20T09:50:56.595Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4701worker2 # [ 56.590795] nix-grpc-daemon[818]: time=2026-09-20T09:50:56.597Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4702lb # [ 56.628540] niks3-server[1047]: 2026/09/20 09:50:55 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4703lb # [ 56.637133] niks3-server[1047]: 2026/09/20 09:50:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4704lb # [ 56.642103] niks3-server[1047]: 2026/09/20 09:50:55 INFO Signed narinfos id=15 count=14705worker2 # [ 56.627047] nix-grpc-daemon[818]: time=2026-09-20T09:50:56.633Z level=INFO msg="Uploading 1 narinfos"4706lb # [ 56.650975] niks3-server[1047]: 2026/09/20 09:50:55 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4707lb # [ 56.661572] niks3-server[1047]: 2026/09/20 09:50:55 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4708lb # [ 56.666668] niks3-server[1047]: 2026/09/20 09:50:55 INFO Completed upload id=154709worker2 # [ 56.648895] nix-grpc-daemon[818]: time=2026-09-20T09:50:56.655Z level=INFO msg="Upload complete. (378ms)"4710worker2 # [ 56.651726] nix-grpc-daemon[785]: ts=2026-09-20T09:50:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_in=7524711lb # [ 56.671474] niks3-server[1047]: 2026/09/20 09:50:55 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4712worker2 # [ 56.657826] nix-grpc-daemon[785]: ts=2026-09-20T09:50:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404713worker2 # [ 56.666620] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4714worker2 # [ 56.670095] nix-daemon[808]: reaped child process 1072, status = succeeded4715worker2 # [ 56.675254] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4716worker2 # [ 58.101953] nix-daemon[808]: reaped child process 1086, status = succeeded4717lb # [ 58.248350] envoy[919]: conn peer=[2001:db8:1::1]:38338 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=34814718lb # [ 58.252158] envoy[919]: conn peer=[2001:db8:1::1]:38326 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1353 ms=46454719lb # [ 58.255600] envoy[919]: conn peer=[2001:db8:1::1]:38354 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3421 tx=1750 ms=23894720lb # [ 58.259241] envoy[919]: conn peer=[2001:db8:1::1]:49988 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=584721lb # [ 58.262607] envoy[919]: conn peer=[2001:db8:1::1]:50006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=554722lb # [ 58.265988] envoy[919]: conn peer=[2001:db8:1::1]:50000 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1992 ms=25234723worker2 # [ 58.265829] nix-daemon[808]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4724worker2 # [ 58.278834] nix-daemon[808]: reaped child process 1104, status = succeeded4725lb # [ 58.313206] niks3-server[1047]: 2026/09/20 09:50:57 INFO Received uploads request method=POST path=/api/pending_closures4726worker2 # [ 58.303062] nix-grpc-daemon[818]: time=2026-09-20T09:50:58.309Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4727worker2 # [ 58.305053] nix-grpc-daemon[818]: time=2026-09-20T09:50:58.310Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4728lb # [ 58.353934] niks3-server[1047]: 2026/09/20 09:50:57 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4729lb # [ 58.360754] niks3-server[1047]: 2026/09/20 09:50:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4730lb # [ 58.369354] niks3-server[1047]: 2026/09/20 09:50:57 INFO Signed narinfos id=16 count=14731worker2 # [ 58.354658] nix-grpc-daemon[818]: time=2026-09-20T09:50:58.360Z level=INFO msg="Uploading 1 narinfos"4732lb # [ 58.375178] niks3-server[1047]: 2026/09/20 09:50:57 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4733lb # [ 58.380138] niks3-server[1047]: 2026/09/20 09:50:57 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4734lb # [ 58.389645] niks3-server[1047]: 2026/09/20 09:50:57 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4735lb # [ 58.392734] niks3-server[1047]: 2026/09/20 09:50:57 INFO Completed upload id=164736lb # [ 58.394695] niks3-server[1047]: 2026/09/20 09:50:57 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4737worker2 # [ 58.376153] nix-grpc-daemon[818]: time=2026-09-20T09:50:58.382Z level=INFO msg="Upload complete. (293ms)"4738worker2 # [ 58.380892] nix-grpc-daemon[785]: ts=2026-09-20T09:50:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14739worker2 # [ 58.387525] nix-grpc-daemon[785]: ts=2026-09-20T09:50:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347404740worker2 # [ 58.396415] nix-daemon[808]: reaped child process 1084, status = succeeded4741worker2 # [ 58.400117] nix-grpc-daemon[785]: ts=2026-09-20T09:50:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:347404742worker2 # [ 58.402666] nix-grpc-daemon[785]: ts=2026-09-20T09:50:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_out=2324743client # [ 58.546362] nix-daemon[944]: reaped child process 946, status = succeeded4744client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.18 seconds)4745client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4746client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4747client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4748client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4749client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4750client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4751(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.27 seconds)4752subtest: an input only one worker has still reaches the builder4753client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4754client # this derivation will be built:4755client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4756client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4757client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.39 seconds)4758client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4759client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.15 seconds)4760worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4761worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4762worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4763worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4764client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24765client # [ 59.609259] nix-daemon[944]: accepted connection from pid 1024, user root (trusted)4766client # this derivation will be built:4767client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4768client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4769worker1 # [ 59.761808] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:337804770worker1 # [ 59.768062] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:337804771worker1 # [ 59.953243] nix-daemon[843]: accepted connection from pid 981, user nix-grpc-daemon (trusted)4772worker1 # [ 59.963989] nix-daemon[843]: reaped child process 984, status = succeeded4773lb # [ 59.983302] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received uploads request method=POST path=/api/pending_closures4774worker1 # [ 59.985486] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.241Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4775worker1 # [ 59.986825] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.241Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4776lb # [ 59.995707] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4777lb # [ 59.998570] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4778lb # [ 60.000360] niks3-server[1047]: 2026/09/20 09:50:59 INFO Signed narinfos id=17 count=14779worker1 # [ 59.999603] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.255Z level=INFO msg="Uploading 1 narinfos"4780lb # [ 60.003391] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4781lb # [ 60.007991] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4782lb # [ 60.011537] niks3-server[1047]: 2026/09/20 09:50:59 INFO Completed upload id=174783worker1 # [ 60.009513] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.265Z level=INFO msg="Upload complete. (242ms)"4784lb # [ 60.012668] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4785worker1 # [ 60.023031] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04786worker1 # [ 60.025472] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14787worker1 # [ 60.066930] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337804788worker1 # [ 60.076614] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:337804789client # copying 2 paths to 'lb:50051'...4790client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4791worker1 # [ 60.089268] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:337804792client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4793worker1 # [ 60.098136] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4794worker1 # [ 60.260150] nix-daemon[843]: accepted connection from pid 990, user nix-grpc-daemon (trusted)4795worker1 # [ 60.272932] nix-daemon[843]: reaped child process 993, status = succeeded4796worker1 # [ 60.411801] nix-daemon[843]: accepted connection from pid 995, user nix-grpc-daemon (trusted)4797worker1 # [ 60.423471] nix-daemon[843]: reaped child process 998, status = succeeded4798lb # [ 60.436300] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received uploads request method=POST path=/api/pending_closures4799lb # [ 60.440735] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received uploads request method=POST path=/api/pending_closures4800worker1 # [ 60.442673] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.698Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4801worker1 # [ 60.444113] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.698Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4802worker1 # [ 60.445762] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.698Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4803lb # [ 60.455440] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4804lb # [ 60.459444] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4805lb # [ 60.464742] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4806lb # [ 60.466848] niks3-server[1047]: 2026/09/20 09:50:59 INFO Signed narinfos id=19 count=24807lb # [ 60.469892] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4808lb # [ 60.472233] niks3-server[1047]: 2026/09/20 09:50:59 INFO Signed narinfos id=18 count=14809worker1 # [ 60.470479] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.726Z level=INFO msg="Uploading 3 narinfos"4810lb # [ 60.473862] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4811lb # [ 60.476141] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4812lb # [ 60.487654] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4813lb # [ 60.491613] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4814lb # [ 60.495397] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4815lb # [ 60.497075] niks3-server[1047]: 2026/09/20 09:50:59 INFO Completed upload id=184816lb # [ 60.498723] niks3-server[1047]: 2026/09/20 09:50:59 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4817lb # [ 60.501699] niks3-server[1047]: 2026/09/20 09:50:59 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4818lb # [ 60.504696] niks3-server[1047]: 2026/09/20 09:50:59 INFO Completed upload id=194819worker1 # [ 60.502655] nix-grpc-daemon[896]: time=2026-09-20T09:50:59.758Z level=INFO msg="Upload complete. (392ms)"4820worker1 # [ 60.505066] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=0 paths=2 nar_bytes_in=9764821worker1 # [ 60.507480] nix-grpc-daemon[783]: ts=2026-09-20T09:50:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337804822worker1 # [ 60.514129] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4823worker1 # [ 60.516442] nix-daemon[843]: reaped child process 988, status = succeeded4824worker1 # [ 60.521847] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4825client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4826client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4827worker1 # [ 61.544870] nix-daemon[843]: reaped child process 1002, status = succeeded4828worker1 # [ 61.713281] nix-daemon[843]: accepted connection from pid 1017, user nix-grpc-daemon (trusted)4829worker1 # [ 61.723778] nix-daemon[843]: reaped child process 1020, status = succeeded4830lb # [ 61.741560] niks3-server[1047]: 2026/09/20 09:51:00 INFO Received uploads request method=POST path=/api/pending_closures4831worker1 # [ 61.748093] nix-grpc-daemon[896]: time=2026-09-20T09:51:01.003Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4832lb # [ 61.769377] niks3-server[1047]: 2026/09/20 09:51:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4833worker1 # [ 61.776548] nix-grpc-daemon[896]: time=2026-09-20T09:51:01.032Z level=INFO msg="Uploading 1 narinfos"4834lb # [ 61.779110] niks3-server[1047]: 2026/09/20 09:51:00 INFO Signed narinfos id=20 count=14835lb # [ 61.789987] niks3-server[1047]: 2026/09/20 09:51:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4836lb # [ 61.793594] niks3-server[1047]: 2026/09/20 09:51:01 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4837lb # [ 61.804388] niks3-server[1047]: 2026/09/20 09:51:01 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4838worker1 # [ 61.808652] nix-grpc-daemon[896]: time=2026-09-20T09:51:01.064Z level=INFO msg="Upload complete. (277ms)"4839lb # [ 61.810977] niks3-server[1047]: 2026/09/20 09:51:01 INFO Completed upload id=204840lb # [ 61.814909] niks3-server[1047]: 2026/09/20 09:51:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4841worker1 # [ 61.812349] nix-grpc-daemon[783]: ts=2026-09-20T09:51:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14842client # copying 1 paths...4843worker1 # [ 61.819545] nix-grpc-daemon[783]: ts=2026-09-20T09:51:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:337804844worker1 # [ 61.822167] nix-daemon[843]: reaped child process 1000, status = succeeded4845client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4846worker2 # [ 61.820873] nix-grpc-daemon[785]: ts=2026-09-20T09:51:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:347404847worker2 # [ 61.834318] nix-grpc-daemon[785]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4848worker2 # [ 61.850968] nix-grpc-daemon[785]: ts=2026-09-20T09:51:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_out=1204849client # [ 61.979128] nix-daemon[944]: reaped child process 1027, status = succeeded4850client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.56 seconds)4851client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24852client # [ 62.131078] nix-daemon[944]: accepted connection from pid 1045, user root (trusted)4853client # this derivation will be built:4854client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4855worker2 # [ 62.272217] nix-grpc-daemon[785]: ts=2026-09-20T09:51:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:347404856client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4857worker2 # [ 62.277848] nix-grpc-daemon[785]: ts=2026-09-20T09:51:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404858worker1 # [ 62.315306] nix-grpc-daemon[783]: ts=2026-09-20T09:51:01Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04859worker1 # [ 62.317777] nix-grpc-daemon[783]: ts=2026-09-20T09:51:01Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14860worker2 # [ 62.304147] nix-grpc-daemon[785]: ts=2026-09-20T09:51:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404861worker2 # [ 62.314792] nix-grpc-daemon[785]: ts=2026-09-20T09:51:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404862client # copying 1 paths to 'lb:50051'...4863client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4864worker2 # [ 62.330350] nix-grpc-daemon[785]: ts=2026-09-20T09:51:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347404865worker2 # [ 62.341225] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4866worker2 # [ 62.357561] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)4867worker2 # [ 62.441619] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 2/5)4868worker2 # [ 62.481889] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 239 ms (attempt 3/5)4869worker2 # [ 62.726750] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 245 ms (attempt 4/5)4870worker2 # [ 62.978928] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4871worker2 # [ 62.985241] nix-grpc-daemon[785]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4872worker2 # [ 63.164558] nix-daemon[808]: accepted connection from pid 1117, user nix-grpc-daemon (trusted)4873worker2 # [ 63.178686] nix-daemon[808]: reaped child process 1120, status = succeeded4874worker2 # [ 63.313606] nix-daemon[808]: accepted connection from pid 1122, user nix-grpc-daemon (trusted)4875worker2 # [ 63.326692] nix-daemon[808]: reaped child process 1125, status = succeeded4876lb # [ 63.355367] niks3-server[1047]: 2026/09/20 09:51:02 INFO Received uploads request method=POST path=/api/pending_closures4877worker2 # [ 63.345467] nix-grpc-daemon[818]: time=2026-09-20T09:51:03.351Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4878worker2 # [ 63.347335] nix-grpc-daemon[818]: time=2026-09-20T09:51:03.353Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4879lb # [ 63.380811] niks3-server[1047]: 2026/09/20 09:51:02 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4880lb # [ 63.392814] niks3-server[1047]: 2026/09/20 09:51:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4881lb # [ 63.398112] niks3-server[1047]: 2026/09/20 09:51:02 INFO Signed narinfos id=21 count=14882worker2 # [ 63.383371] nix-grpc-daemon[818]: time=2026-09-20T09:51:03.389Z level=INFO msg="Uploading 1 narinfos"4883lb # [ 63.404699] niks3-server[1047]: 2026/09/20 09:51:02 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4884lb # [ 63.415585] niks3-server[1047]: 2026/09/20 09:51:02 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4885lb # [ 63.421517] niks3-server[1047]: 2026/09/20 09:51:02 INFO Completed upload id=214886worker2 # [ 63.403555] nix-grpc-daemon[818]: time=2026-09-20T09:51:03.409Z level=INFO msg="Upload complete. (399ms)"4887lb # [ 63.424164] niks3-server[1047]: 2026/09/20 09:51:02 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4888worker2 # [ 63.407078] nix-grpc-daemon[785]: ts=2026-09-20T09:51:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=1 paths=1 nar_bytes_in=5604889worker2 # [ 63.412769] nix-grpc-daemon[785]: ts=2026-09-20T09:51:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347404890worker2 # [ 63.420805] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4891worker2 # [ 63.424097] nix-daemon[808]: reaped child process 1111, status = succeeded4892worker2 # [ 63.427053] nix-grpc-daemon[785]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4893worker2 # [ 63.436239] nix-daemon[808]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4894client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4895client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4896worker2 # [ 65.264808] nix-daemon[808]: reaped child process 1130, status = succeeded4897worker2 # [ 65.424580] nix-daemon[808]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4898worker2 # [ 65.437266] nix-daemon[808]: reaped child process 1148, status = succeeded4899lb # [ 65.470810] niks3-server[1047]: 2026/09/20 09:51:04 INFO Received uploads request method=POST path=/api/pending_closures4900worker2 # [ 65.461264] nix-grpc-daemon[818]: time=2026-09-20T09:51:05.467Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4901lb # [ 65.500901] niks3-server[1047]: 2026/09/20 09:51:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4902lb # [ 65.506848] niks3-server[1047]: 2026/09/20 09:51:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4903lb # [ 65.511355] niks3-server[1047]: 2026/09/20 09:51:04 INFO Signed narinfos id=22 count=14904worker2 # [ 65.496378] nix-grpc-daemon[818]: time=2026-09-20T09:51:05.502Z level=INFO msg="Uploading 1 narinfos"4905lb # [ 65.519232] niks3-server[1047]: 2026/09/20 09:51:04 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4906lb # [ 65.530773] niks3-server[1047]: 2026/09/20 09:51:04 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4907lb # [ 65.535838] niks3-server[1047]: 2026/09/20 09:51:04 INFO Completed upload id=224908worker2 # [ 65.518165] nix-grpc-daemon[818]: time=2026-09-20T09:51:05.524Z level=INFO msg="Upload complete. (270ms)"4909lb # [ 65.539990] niks3-server[1047]: 2026/09/20 09:51:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4910worker2 # [ 65.522777] nix-grpc-daemon[785]: ts=2026-09-20T09:51:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=2 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=14911worker2 # [ 65.534676] nix-daemon[808]: reaped child process 1127, status = succeeded4912client # copying 1 paths...4913worker1 # [ 65.574403] nix-grpc-daemon[783]: ts=2026-09-20T09:51:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:337804914worker1 # [ 65.585931] nix-grpc-daemon[783]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...4915client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4916worker1 # [ 65.615988] nix-grpc-daemon[783]: ts=2026-09-20T09:51:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:337804917worker1 # [ 65.620969] nix-grpc-daemon[783]: ts=2026-09-20T09:51:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=0 paths=1 nar_bytes_out=1204918client # [ 65.746059] nix-daemon[944]: reaped child process 1048, status = succeeded4919client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.77 seconds)4920client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24921client # [ 65.925023] nix-daemon[944]: accepted connection from pid 1066, user root (trusted)4922client # this derivation will be built:4923client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4924worker2 # [ 66.057668] nix-grpc-daemon[785]: ts=2026-09-20T09:51:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:347404925client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4926worker2 # [ 66.063485] nix-grpc-daemon[785]: ts=2026-09-20T09:51:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347404927worker2 # [ 66.068931] nix-grpc-daemon[818]: time=2026-09-20T09:51:06.075Z level=INFO msg="All 1 paths already cached"4928worker1 # [ 66.098230] nix-grpc-daemon[783]: ts=2026-09-20T09:51:05Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=04929worker1 # [ 66.103815] nix-grpc-daemon[783]: ts=2026-09-20T09:51:05Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14930worker1 # [ 66.109627] nix-grpc-daemon[783]: ts=2026-09-20T09:51:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337804931worker1 # [ 66.119979] nix-grpc-daemon[783]: ts=2026-09-20T09:51:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:337804932worker1 # [ 66.132096] nix-grpc-daemon[896]: time=2026-09-20T09:51:05.387Z level=INFO msg="All 1 paths already cached"4933client # copying 1 paths to 'lb:50051'...4934client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...4935worker1 # [ 66.139582] nix-grpc-daemon[783]: ts=2026-09-20T09:51:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:337804936worker1 # [ 66.150357] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4937worker1 # [ 66.288430] nix-daemon[843]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4938worker1 # [ 66.300877] nix-daemon[843]: reaped child process 1032, status = succeeded4939worker1 # [ 66.436479] nix-daemon[843]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4940worker1 # [ 66.447726] nix-daemon[843]: reaped child process 1037, status = succeeded4941lb # [ 66.463843] niks3-server[1047]: 2026/09/20 09:51:05 INFO Received uploads request method=POST path=/api/pending_closures4942worker1 # [ 66.468973] nix-grpc-daemon[896]: time=2026-09-20T09:51:05.725Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4943worker1 # [ 66.470445] nix-grpc-daemon[896]: time=2026-09-20T09:51:05.726Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"4944lb # [ 66.490679] niks3-server[1047]: 2026/09/20 09:51:05 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst4945lb # [ 66.502684] niks3-server[1047]: 2026/09/20 09:51:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4946worker1 # [ 66.504949] nix-grpc-daemon[896]: time=2026-09-20T09:51:05.761Z level=INFO msg="Uploading 1 narinfos"4947lb # [ 66.507675] niks3-server[1047]: 2026/09/20 09:51:05 INFO Signed narinfos id=23 count=14948lb # [ 66.514402] niks3-server[1047]: 2026/09/20 09:51:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls4949lb # [ 66.524099] niks3-server[1047]: 2026/09/20 09:51:05 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4950worker1 # [ 66.527522] nix-grpc-daemon[896]: time=2026-09-20T09:51:05.783Z level=INFO msg="Upload complete. (366ms)"4951lb # [ 66.529805] niks3-server[1047]: 2026/09/20 09:51:05 INFO Completed upload id=234952worker1 # [ 66.529424] nix-grpc-daemon[783]: ts=2026-09-20T09:51:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=0 paths=1 nar_bytes_in=5604953lb # [ 66.534431] niks3-server[1047]: 2026/09/20 09:51:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo4954worker1 # [ 66.536539] nix-grpc-daemon[783]: ts=2026-09-20T09:51:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337804955worker1 # [ 66.543230] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4956worker1 # [ 66.545403] nix-daemon[843]: reaped child process 1027, status = succeeded4957worker1 # [ 66.550479] nix-daemon[843]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4958client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...4959client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4960worker1 # [ 67.764385] nix-daemon[843]: reaped child process 1041, status = succeeded4961worker1 # [ 67.907400] nix-daemon[843]: accepted connection from pid 1056, user nix-grpc-daemon (trusted)4962worker1 # [ 67.918740] nix-daemon[843]: reaped child process 1059, status = succeeded4963lb # [ 67.936513] niks3-server[1047]: 2026/09/20 09:51:07 INFO Received uploads request method=POST path=/api/pending_closures4964worker1 # [ 67.943086] nix-grpc-daemon[896]: time=2026-09-20T09:51:07.197Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4965lb # [ 67.967041] niks3-server[1047]: 2026/09/20 09:51:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls4966lb # [ 67.976178] niks3-server[1047]: 2026/09/20 09:51:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4967worker1 # [ 67.979089] nix-grpc-daemon[896]: time=2026-09-20T09:51:07.235Z level=INFO msg="Uploading 1 narinfos"4968lb # [ 67.981100] niks3-server[1047]: 2026/09/20 09:51:07 INFO Signed narinfos id=24 count=14969lb # [ 67.991308] niks3-server[1047]: 2026/09/20 09:51:07 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4970lb # [ 67.995675] niks3-server[1047]: 2026/09/20 09:51:07 INFO Completed upload id=244971worker1 # [ 67.993613] nix-grpc-daemon[896]: time=2026-09-20T09:51:07.249Z level=INFO msg="Upload complete. (236ms)"4972lb # [ 67.997437] niks3-server[1047]: 2026/09/20 09:51:07 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4973lb # [ 68.000050] niks3-server[1047]: 2026/09/20 09:51:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo4974worker1 # [ 67.998149] nix-grpc-daemon[783]: ts=2026-09-20T09:51:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33780 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=14975worker1 # [ 68.004294] nix-daemon[843]: reaped child process 1039, status = succeeded4976client # copying 1 paths...4977worker2 # [ 68.029697] nix-grpc-daemon[785]: ts=2026-09-20T09:51:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347404978worker2 # [ 68.042280] nix-grpc-daemon[785]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...4979client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...4980worker2 # [ 68.073745] nix-grpc-daemon[785]: ts=2026-09-20T09:51:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:347404981worker2 # [ 68.078718] nix-grpc-daemon[785]: ts=2026-09-20T09:51:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34740 duration_s=0 paths=1 nar_bytes_out=1204982client # [ 68.217690] nix-daemon[944]: reaped child process 1069, status = succeeded4983client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.47 seconds)4984(finished: subtest: an input only one worker has still reaches the builder, in 9.58 seconds)4985subtest: upload whose reference the worker lacks is completed from the cache4986client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache4987lb # [ 68.248936] envoy[919]: conn peer=[2001:db8:1::1]:50010 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4314 tx=2087 ms=22774988lb # [ 68.253389] envoy[919]: conn peer=[2001:db8:1::1]:50022 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=544989lb # [ 68.257211] envoy[919]: conn peer=[2001:db8:1::1]:50028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3821 tx=1741 ms=21584990lb # [ 68.260706] envoy[919]: conn peer=[2001:db8:1::1]:50044 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=834991lb # [ 68.264446] envoy[919]: conn peer=[2001:db8:1::1]:42052 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=574992lb # [ 68.267893] envoy[919]: conn peer=[2001:db8:1::1]:50048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3685 tx=1918 ms=33884993lb # [ 68.271352] envoy[919]: conn peer=[2001:db8:1::1]:42066 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=574994lb # [ 68.275229] envoy[919]: conn peer=[2001:db8:1::1]:42058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1887 ms=20734995client # this derivation will be built:4996client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv4997client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...4998client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.40 seconds)4999client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5000client # this derivation will be built:5001client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5002client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5003client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.42 seconds)5004client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5005client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.19 seconds)5006worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5007worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.22 seconds)5008worker2 # [ 69.458236] systemd[1]: Stopping Nix worker-protocol over gRPC...5009worker2 # [ 69.530544] nix-grpc-daemon[785]: ts=2026-09-20T09:51:09Z level=info event=signal_exit5010worker1 # [ 69.552443] nix-grpc-daemon[783]: ts=2026-09-20T09:51:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:499165011worker1 # [ 69.554106] nix-grpc-daemon[783]: ts=2026-09-20T09:51:08Z level=info event=worker_gone addr=192.168.1.4:500515012worker2 # [ 69.538839] nix-grpc-daemon[785]: ts=2026-09-20T09:51:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5013worker2 # [ 69.552371] nix-daemon[808]: reaped child process 810, status = succeeded5014worker2 # [ 69.641919] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5015worker2 # [ 69.645424] nix-grpc-daemon[785]: E0000 00:00:1789897869.647371 796 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5016worker2 # [ 70.398092] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5017worker2 # [ 70.402480] systemd[1]: Stopped Nix worker-protocol over gRPC.5018worker2 # [ 70.406630] systemd[1]: nix-grpc-daemon.service: Consumed 2.468s CPU time over 52.170s wall clock time, 55.1M memory peak, 73.1K incoming IP traffic, 131.1K outgoing IP traffic.5019worker2 # [ 70.416830] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5020worker2 # [ 70.421253] systemd[1]: Closed Nix worker-protocol over gRPC.5021worker2 # [ 70.425235] systemd[1]: nix-grpc-daemon.socket: Consumed 320us CPU time over 1min 961ms wall clock time, 256K memory peak, 55.1K incoming IP traffic, 42.6K outgoing IP traffic.5022lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5023lb: must succeed: curl -sf localhost:9901/clusters5024lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5025lb: must succeed: curl -sf localhost:9901/clusters5026lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5027lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 1.15 seconds)5028client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25029worker1 # [ 71.820955] nix-grpc-daemon[783]: ts=2026-09-20T09:51:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337805030client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5031worker1 # [ 71.826347] nix-grpc-daemon[783]: ts=2026-09-20T09:51:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:337805032client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.26 seconds)5033worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5034worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5035worker2 # [ 71.890027] systemd[1]: Listening on Nix worker-protocol over gRPC.5036worker1 # [ 71.963645] systemd[1]: Stopping Nix worker-protocol over gRPC...5037worker2 # [ 72.386560] systemd[1]: Starting Nix worker-protocol over gRPC...5038worker1 # [ 72.528121] nix-grpc-daemon[783]: ts=2026-09-20T09:51:11Z level=info event=signal_exit5039worker1 # [ 72.534844] nix-grpc-daemon[783]: ts=2026-09-20T09:51:11Z level=info event=scheduler_restarting5040worker1 # [ 72.540746] nix-grpc-daemon[783]: ts=2026-09-20T09:51:11Z level=info event=scheduler_restarting addr=lb:500515041worker1 # [ 72.544836] nix-grpc-daemon[783]: ts=2026-09-20T09:51:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:499165042worker1 # [ 72.548396] nix-grpc-daemon[783]: ts=2026-09-20T09:51:11Z level=info event=worker_gone addr=192.168.1.3:500515043worker1 # [ 72.567204] nix-daemon[843]: reaped child process 845, status = succeeded5044worker2 # [ 72.583242] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5045worker2 # [ 72.585363] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:12Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15046worker2 # [ 72.592054] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5047worker2 # [ 72.596376] systemd[1]: Started Nix worker-protocol over gRPC.5048worker2 # [ 72.608822] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:12Z level=info event=scheduler_connected addr=lb:500515049worker1 # [ 72.627492] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5050worker1 # [ 72.630937] nix-grpc-daemon[783]: E0000 00:00:1789897871.882610 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5051worker1 # [ 72.637834] nix-grpc-daemon[783]: E0000 00:00:1789897871.893750 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5052worker1 # [ 72.642397] nix-grpc-daemon[783]: E0000 00:00:1789897871.893893 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5053worker1 # [ 72.746694] nix-grpc-daemon[783]: ts=2026-09-20T09:51:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5054worker2 # [ 74.322859] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5055worker1 # [ 74.350332] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5056worker1 # [ 74.352458] systemd[1]: Stopped Nix worker-protocol over gRPC.5057worker1 # [ 74.353398] systemd[1]: nix-grpc-daemon.service: Consumed 1.326s CPU time over 56.115s wall clock time, 49.7M memory peak, 47.8K incoming IP traffic, 82.2K outgoing IP traffic.5058worker1 # [ 74.357721] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5059worker1 # [ 74.359431] systemd[1]: Closed Nix worker-protocol over gRPC.5060worker1 # [ 74.360630] systemd[1]: nix-grpc-daemon.socket: Consumed 292us CPU time over 1min 4.211s wall clock time, 256K memory peak, 74.9K incoming IP traffic, 62.9K outgoing IP traffic.5061lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5062lb: must succeed: curl -sf localhost:9901/clusters5063lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5064worker2 # [ 74.523419] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:14Z level=info event=scheduler_connected addr=lb:500515065worker2 # [ 74.527561] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5066worker2 # [ 74.728418] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:14Z level=info event=scheduler_connected addr=lb:500515067worker2 # [ 74.732566] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5068worker2 # [ 74.933476] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:14Z level=info event=scheduler_connected addr=lb:500515069worker2 # [ 74.937558] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5070worker2 # [ 75.138634] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_connected addr=lb:500515071worker2 # [ 75.142669] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5072worker2 # [ 75.344531] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_connected addr=lb:500515073worker2 # [ 75.348337] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5074lb: must succeed: curl -sf localhost:9901/clusters5075lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5076lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5077client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25078worker2 # [ 75.549226] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_connected addr=lb:500515079worker2 # [ 75.553250] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5080worker2 # [ 75.707172] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607345081worker2 # [ 75.718493] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5082worker2 # [ 75.734724] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5083worker2 # [ 75.753835] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_connected addr=lb:500515084worker2 # [ 75.757683] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5085worker2 # [ 75.779497] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 2/5)5086worker2 # [ 75.793264] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5)5087worker2 # [ 75.958781] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_connected addr=lb:500515088worker2 # [ 75.962881] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5089worker2 # [ 76.135853] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 764 ms (attempt 4/5)5090worker2 # [ 76.163731] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_connected addr=lb:500515091worker2 # [ 76.167537] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5092worker2 # [ 76.369554] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_connected addr=lb:500515093worker2 # [ 76.373312] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5094worker2 # [ 76.574150] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_connected addr=lb:500515095worker2 # [ 76.577976] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5096worker2 # [ 76.778587] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_connected addr=lb:500515097worker2 # [ 76.780614] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5098worker2 # [ 76.906146] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5099client # copying 2 paths...5100client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5101worker2 # [ 76.920993] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607345102client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5103worker2 # [ 76.934307] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5104worker2 # [ 76.954482] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=niks3_push_started pid=11915105worker2 # [ 76.981712] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_connected addr=lb:500515106worker2 # [ 76.985280] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5107worker2 # [ 77.185708] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:17Z level=info event=scheduler_connected addr=lb:500515108worker2 # [ 77.187731] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5109worker2 # [ 77.334611] nix-daemon[808]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5110worker2 # [ 77.347954] nix-daemon[808]: reaped child process 1207, status = succeeded5111lb # [ 77.383329] niks3-server[1047]: 2026/09/20 09:51:16 INFO Received uploads request method=POST path=/api/pending_closures5112lb # [ 77.390211] niks3-server[1047]: 2026/09/20 09:51:16 INFO Received uploads request method=POST path=/api/pending_closures5113worker2 # [ 77.376245] nix-grpc-daemon[1191]: time=2026-09-20T09:51:17.382Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5114worker2 # [ 77.378719] nix-grpc-daemon[1191]: time=2026-09-20T09:51:17.384Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5115worker2 # [ 77.381877] nix-grpc-daemon[1191]: time=2026-09-20T09:51:17.384Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5116worker2 # [ 77.388159] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:17Z level=info event=scheduler_connected addr=lb:500515117worker2 # [ 77.390050] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5118lb # [ 77.419461] niks3-server[1047]: 2026/09/20 09:51:16 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5119lb # [ 77.426617] niks3-server[1047]: 2026/09/20 09:51:16 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5120lb # [ 77.429292] niks3-server[1047]: 2026/09/20 09:51:16 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5121lb # [ 77.433381] niks3-server[1047]: 2026/09/20 09:51:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5122lb # [ 77.435705] niks3-server[1047]: 2026/09/20 09:51:16 INFO Signed narinfos id=25 count=15123lb # [ 77.437019] niks3-server[1047]: 2026/09/20 09:51:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5124lb # [ 77.439224] niks3-server[1047]: 2026/09/20 09:51:16 INFO Signed narinfos id=26 count=25125worker2 # [ 77.423071] nix-grpc-daemon[1191]: time=2026-09-20T09:51:17.428Z level=INFO msg="Uploading 3 narinfos"5126lb # [ 77.441807] niks3-server[1047]: 2026/09/20 09:51:16 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5127lb # [ 77.456456] niks3-server[1047]: 2026/09/20 09:51:16 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5128lb # [ 77.459468] niks3-server[1047]: 2026/09/20 09:51:16 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5129lb # [ 77.461504] niks3-server[1047]: 2026/09/20 09:51:16 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5130lb # [ 77.464913] niks3-server[1047]: 2026/09/20 09:51:16 INFO Completed upload id=255131lb # [ 77.466337] niks3-server[1047]: 2026/09/20 09:51:16 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5132lb # [ 77.468319] niks3-server[1047]: 2026/09/20 09:51:16 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5133lb # [ 77.471065] niks3-server[1047]: 2026/09/20 09:51:16 INFO Completed upload id=265134worker2 # [ 77.454420] nix-grpc-daemon[1191]: time=2026-09-20T09:51:17.460Z level=INFO msg="Upload complete. (291ms)"5135worker2 # [ 77.457061] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=0 paths=2 nar_bytes_in=3125136worker2 # [ 77.463887] nix-daemon[808]: reaped child process 1189, status = succeeded5137client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.99 seconds)5138worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5139worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5140worker1 # [ 77.559767] systemd[1]: Listening on Nix worker-protocol over gRPC.5141worker1 # [ 77.564374] systemd[1]: Starting Nix worker-protocol over gRPC...5142worker2 # [ 77.591261] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:17Z level=info event=scheduler_connected addr=lb:500515143worker1 # [ 77.751891] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5144worker1 # [ 77.755187] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15145worker1 # [ 77.761486] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5146worker1 # [ 77.763087] systemd[1]: Started Nix worker-protocol over gRPC.5147worker1 # [ 77.771970] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05148lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5149lb: must succeed: curl -sf localhost:9901/clusters5150worker1 # [ 77.782812] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:17Z level=info event=scheduler_connected addr=lb:500515151worker1 # [ 77.784504] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05152lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5153lb # [ 78.249808] envoy[919]: conn peer=192.168.1.4:53878 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1912 tx=816 ms=500575154lb # [ 78.253566] envoy[919]: conn peer=[2001:db8:1::1]:42076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=155155lb # [ 78.256945] envoy[919]: conn peer=[2001:db8:1::3]:52152 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1223 tx=468 ms=531055156lb # [ 78.260597] envoy[919]: conn peer=[2001:db8:1::1]:33766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=282 ms=17635157lb: must succeed: curl -sf localhost:9901/clusters5158lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5159lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5160(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.70 seconds)5161subtest: scheduler down: builds wait, then resume when it is back5162worker1 # [ 78.947511] systemd[1]: Stopping Nix worker-protocol over gRPC...5163worker1 # [ 79.768529] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:19Z level=info event=signal_exit5164worker1 # [ 79.771130] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:19Z level=info event=scheduler_restarting5165worker1 # [ 79.772425] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:19Z level=info event=scheduler_restarting addr=lb:500515166worker1 # [ 79.774224] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:602625167worker1 # [ 79.775555] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:19Z level=info event=worker_gone addr=192.168.1.3:500515168worker2 # [ 79.758231] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:19Z level=info event=scheduler_restarting addr=lb:500515169worker1 # [ 79.776748] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:602625170worker1 # [ 79.778057] nix-grpc-daemon[1082]: ts=2026-09-20T09:51:19Z level=info event=worker_gone addr=192.168.1.4:500515171worker2 # [ 79.958374] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:19Z level=info event=scheduler_connected addr=lb:500515172worker1 # [ 79.975452] nix-grpc-daemon[1082]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5173worker1 # [ 79.979776] nix-grpc-daemon[1082]: E0000 00:00:1789897879.231389 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 13, started true, shutdown true5174worker1 # [ 80.345124] nix-grpc-daemon[1082]: E0000 00:00:1789897879.600995 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5175worker1 # [ 80.353401] nix-grpc-daemon[1082]: E0000 00:00:1789897879.609420 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5176worker2 # [ 81.753414] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5177worker1 # [ 81.785474] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5178worker1 # [ 81.788629] systemd[1]: Stopped Nix worker-protocol over gRPC.5179worker1 # [ 81.791785] systemd[1]: nix-grpc-daemon.service: Consumed 109ms CPU time over 4.220s wall clock time, 9.8M memory peak, 6K incoming IP traffic, 5K outgoing IP traffic.5180worker1 # [ 81.802652] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5181worker1 # [ 81.806738] systemd[1]: Closed Nix worker-protocol over gRPC.5182worker1 # [ 81.810922] systemd[1]: nix-grpc-daemon.socket: Consumed 297us CPU time over 4.250s wall clock time, 256K memory peak, 13.8K incoming IP traffic, 10.2K outgoing IP traffic.5183lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy5184lb: must succeed: curl -sf localhost:9901/clusters5185lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5186worker2 # [ 81.954221] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:21Z level=info event=scheduler_connected addr=lb:500515187worker2 # [ 81.958715] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5188worker2 # [ 82.159923] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_connected addr=lb:500515189worker2 # [ 82.164272] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5190worker2 # [ 82.364944] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_connected addr=lb:500515191worker2 # [ 82.369363] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5192worker2 # [ 82.570361] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_connected addr=lb:500515193worker2 # [ 82.574344] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5194worker2 # [ 82.776628] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_connected addr=lb:500515195worker2 # [ 82.779637] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5196lb: must succeed: curl -sf localhost:9901/clusters5197lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5198lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 1.13 seconds)5199client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback5200worker2 # [ 82.977711] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_connected addr=lb:500515201client # [ 83.010767] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback.5202worker2 # [ 82.981648] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5203client # Running as unit: waits.service; invocation ID: 7a0f02bf3af94953ac26ad3d089592b75204client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback, in 0.06 seconds)5205??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5206 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735207client: must succeed: sleep 3.05208client # [ 83.187213] nix[1146]: don't know how to build these paths:5209client # [ 83.188065] nix[1146]: /nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5210worker2 # [ 83.151949] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:607345211worker2 # [ 83.156927] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607345212client # [ 83.209593] nix[1146]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5213worker2 # [ 83.182169] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_connected addr=lb:500515214worker2 # [ 83.186118] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5215worker2 # [ 83.387186] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_connected addr=lb:500515216worker2 # [ 83.391141] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5217worker2 # [ 83.592331] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_connected addr=lb:500515218worker2 # [ 83.596777] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5219client # [ 83.712958] nix[1146]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5220worker2 # [ 83.798598] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_connected addr=lb:500515221worker2 # [ 83.802388] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5222worker2 # [ 84.003316] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_connected addr=lb:500515223worker2 # [ 84.007164] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5224worker2 # [ 84.207904] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_connected addr=lb:500515225worker2 # [ 84.211758] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5226worker2 # [ 84.412629] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_connected addr=lb:500515227worker2 # [ 84.416514] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5228worker2 # [ 84.617719] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_connected addr=lb:500515229worker2 # [ 84.622367] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5230client # [ 84.715294] nix[1146]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5231worker2 # [ 84.824204] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_connected addr=lb:500515232worker2 # [ 84.827981] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5233worker2 # [ 85.028924] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_connected addr=lb:500515234worker2 # [ 85.032974] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5235worker2 # [ 85.233920] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_connected addr=lb:500515236worker2 # [ 85.238062] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5237worker2 # [ 85.438757] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_connected addr=lb:500515238worker2 # [ 85.442721] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5239worker2 # [ 85.643503] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_connected addr=lb:500515240worker2 # [ 85.647457] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5241worker2 # [ 85.849299] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_connected addr=lb:500515242worker2 # [ 85.853345] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5243client: (finished: must succeed: sleep 3.0, in 3.03 seconds)5244client: must succeed: systemctl is-active waits5245worker2 # [ 86.054405] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:26Z level=info event=scheduler_connected addr=lb:500515246client: (finished: must succeed: systemctl is-active waits, in 0.04 seconds)5247worker2 # [ 86.058560] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5248worker1 # [ 86.137434] systemd[1]: Listening on Nix worker-protocol over gRPC.5249worker1 # [ 86.143267] systemd[1]: Starting Nix worker-protocol over gRPC...5250worker2 # [ 86.259410] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:26Z level=info event=scheduler_connected addr=lb:500515251worker1 # [ 86.325265] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5252worker1 # [ 86.328752] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15253worker1 # [ 86.334061] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5254worker1 # [ 86.337515] systemd[1]: Started Nix worker-protocol over gRPC.5255worker1 # [ 86.341358] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05256lb: waiting until exactly no endpoints of sched are unhealthy5257lb: must succeed: curl -sf localhost:9901/clusters5258worker1 # [ 86.357713] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=info event=scheduler_connected addr=lb:500515259worker1 # [ 86.359251] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05260lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5261worker1 # [ 86.706970] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=debug event=want client=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv cached=05262worker1 # [ 86.711271] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:25Z level=debug event=assigned drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv worker=192.168.1.4:50051 clients=15263worker2 # [ 86.736450] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345264worker2 # [ 86.745121] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607345265worker2 # [ 86.752583] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607345266client # [ 86.786821] nix[1146]: copying 1 paths to 'lb:50051'...5267client # [ 86.788747] nix[1146]: copying path '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' to 'lb:50051'...5268worker2 # [ 86.761453] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5269worker2 # [ 86.938231] nix-daemon[808]: accepted connection from pid 1214, user nix-grpc-daemon (trusted)5270worker2 # [ 86.951657] nix-daemon[808]: reaped child process 1217, status = succeeded5271worker2 # [ 87.121332] nix-daemon[808]: accepted connection from pid 1219, user nix-grpc-daemon (trusted)5272worker2 # [ 87.134354] nix-daemon[808]: reaped child process 1222, status = succeeded5273lb # [ 87.164761] niks3-server[1047]: 2026/09/20 09:51:26 INFO Received uploads request method=POST path=/api/pending_closures5274worker2 # [ 87.155774] nix-grpc-daemon[1191]: time=2026-09-20T09:51:27.161Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5275worker2 # [ 87.157194] nix-grpc-daemon[1191]: time=2026-09-20T09:51:27.161Z level=INFO msg="Uploading 78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv (520B)"5276lb # [ 87.189514] niks3-server[1047]: 2026/09/20 09:51:26 INFO Registered completed upload object_key=nar/06bjks304hxld0mwhch6kvcfiix46iimcpysvzrdsfv41vfc14ny.nar.zst5277lb # [ 87.200199] niks3-server[1047]: 2026/09/20 09:51:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5278worker2 # [ 87.188779] nix-grpc-daemon[1191]: time=2026-09-20T09:51:27.194Z level=INFO msg="Uploading 1 narinfos"5279lb # [ 87.206374] niks3-server[1047]: 2026/09/20 09:51:26 INFO Signed narinfos id=27 count=15280lb # [ 87.219748] niks3-server[1047]: 2026/09/20 09:51:26 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5281lb # [ 87.226573] niks3-server[1047]: 2026/09/20 09:51:26 INFO Completed upload id=275282worker2 # [ 87.208321] nix-grpc-daemon[1191]: time=2026-09-20T09:51:27.214Z level=WARN msg="Failed to register uploaded object" key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.narinfo error="server returned 404: object is not pending upload\n"5283lb # [ 87.229721] niks3-server[1047]: 2026/09/20 09:51:26 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.ls5284worker2 # [ 87.214294] nix-grpc-daemon[1191]: time=2026-09-20T09:51:27.219Z level=INFO msg="Upload complete. (444ms)"5285worker2 # [ 87.217379] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=0 paths=1 nar_bytes_in=5205286worker2 # [ 87.219736] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345287worker2 # [ 87.224279] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5288worker2 # [ 87.229490] nix-daemon[808]: reaped child process 1212, status = succeeded5289worker2 # [ 87.235090] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5290client # [ 87.267862] nix[1146]: building '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' on lb:50051...5291lb: must succeed: curl -sf localhost:9901/clusters5292lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5293lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.14 seconds)5294client: waiting for success: ! systemctl is-active waits5295worker2 # [ 88.049627] nix-daemon[808]: reaped child process 1226, status = succeeded5296worker2 # [ 88.178735] nix-daemon[808]: accepted connection from pid 1241, user nix-grpc-daemon (trusted)5297worker2 # [ 88.191592] nix-daemon[808]: reaped child process 1244, status = succeeded5298lb # [ 88.221089] niks3-server[1047]: 2026/09/20 09:51:27 INFO Received uploads request method=POST path=/api/pending_closures5299worker2 # [ 88.207468] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.213Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5300worker2 # [ 88.208931] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.215Z level=INFO msg="Uploading wxl98jgbbzfq9nz6nhndwvzybqml1mdg-farm-a (136B)"5301lb # [ 88.237680] niks3-server[1047]: 2026/09/20 09:51:27 INFO Registered completed upload object_key=log/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv5302lb # [ 88.243247] niks3-server[1047]: 2026/09/20 09:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5303lb # [ 88.246052] niks3-server[1047]: 2026/09/20 09:51:27 INFO Signed narinfos id=28 count=15304worker2 # [ 88.229633] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.235Z level=INFO msg="Uploading 1 narinfos"5305lb # [ 88.249748] niks3-server[1047]: 2026/09/20 09:51:27 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst5306lb # [ 88.251751] envoy[919]: conn peer=[2001:db8:1::3]:55736 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=552 tx=177 ms=21955307lb # [ 88.253869] niks3-server[1047]: 2026/09/20 09:51:27 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.ls5308lb # [ 88.258958] niks3-server[1047]: 2026/09/20 09:51:27 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5309lb # [ 88.262403] niks3-server[1047]: 2026/09/20 09:51:27 INFO Completed upload id=285310worker2 # [ 88.244598] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.250Z level=INFO msg="Upload complete. (203ms)"5311lb # [ 88.264767] niks3-server[1047]: 2026/09/20 09:51:27 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.narinfo5312worker2 # [ 88.248146] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv assign_id=1 outputs=15313worker2 # [ 88.253942] nix-daemon[808]: reaped child process 1224, status = succeeded5314worker1 # [ 88.270846] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:27Z level=debug event=want client=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv cached=05315worker1 # [ 88.275190] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:27Z level=debug event=assigned drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv worker=192.168.1.4:50051 clients=15316worker2 # [ 88.298178] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345317worker2 # [ 88.307633] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607345318worker2 # [ 88.315985] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.322Z level=INFO msg="All 1 paths already cached"5319client # [ 88.355729] nix[1146]: copying 1 paths to 'lb:50051'...5320worker2 # [ 88.321431] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607345321client # [ 88.357907] nix[1146]: copying path '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' to 'lb:50051'...5322worker2 # [ 88.333134] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5323worker2 # [ 88.507907] nix-daemon[808]: accepted connection from pid 1248, user nix-grpc-daemon (trusted)5324worker2 # [ 88.520941] nix-daemon[808]: reaped child process 1251, status = succeeded5325worker2 # [ 88.692680] nix-daemon[808]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5326worker2 # [ 88.705319] nix-daemon[808]: reaped child process 1256, status = succeeded5327lb # [ 88.740410] niks3-server[1047]: 2026/09/20 09:51:27 INFO Received uploads request method=POST path=/api/pending_closures5328worker2 # [ 88.730302] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.736Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5329worker2 # [ 88.731831] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.738Z level=INFO msg="Uploading jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv (632B)"5330lb # [ 88.770148] niks3-server[1047]: 2026/09/20 09:51:27 INFO Registered completed upload object_key=nar/06r703613wasx30c56zihv19sk7v1y1xsivlzw3jax3csnwjf02v.nar.zst5331lb # [ 88.778513] niks3-server[1047]: 2026/09/20 09:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5332lb # [ 88.784547] niks3-server[1047]: 2026/09/20 09:51:28 INFO Signed narinfos id=29 count=15333worker2 # [ 88.772397] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.778Z level=INFO msg="Uploading 1 narinfos"5334lb # [ 88.795201] niks3-server[1047]: 2026/09/20 09:51:28 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.ls5335lb # [ 88.805451] niks3-server[1047]: 2026/09/20 09:51:28 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5336worker2 # [ 88.791909] nix-grpc-daemon[1191]: time=2026-09-20T09:51:28.798Z level=INFO msg="Upload complete. (449ms)"5337lb # [ 88.810062] niks3-server[1047]: 2026/09/20 09:51:28 INFO Completed upload id=295338lb # [ 88.813684] niks3-server[1047]: 2026/09/20 09:51:28 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.narinfo5339worker2 # [ 88.794276] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=0 paths=1 nar_bytes_in=6325340worker2 # [ 88.799465] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345341worker2 # [ 88.809105] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5342worker2 # [ 88.815307] nix-daemon[808]: reaped child process 1246, status = succeeded5343worker2 # [ 88.819625] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5344client # [ 88.853192] nix[1146]: building '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' on lb:50051...5345worker2 # [ 90.034892] nix-daemon[808]: reaped child process 1260, status = succeeded5346worker2 # [ 90.182993] nix-daemon[808]: accepted connection from pid 1275, user nix-grpc-daemon (trusted)5347worker2 # [ 90.195942] nix-daemon[808]: reaped child process 1278, status = succeeded5348lb # [ 90.231178] niks3-server[1047]: 2026/09/20 09:51:29 INFO Received uploads request method=POST path=/api/pending_closures5349worker2 # [ 90.217757] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.223Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5350worker2 # [ 90.219232] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.225Z level=INFO msg="Uploading ahy8cs7r52ad4fklig5k1khmrwzp7bkc-farm-b (184B)"5351lb # [ 90.251400] niks3-server[1047]: 2026/09/20 09:51:29 INFO Registered completed upload object_key=log/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv5352lb # [ 90.255645] niks3-server[1047]: 2026/09/20 09:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5353lb # [ 90.257607] niks3-server[1047]: 2026/09/20 09:51:29 INFO Registered completed upload object_key=nar/1bxjgkmwyii071c3ahwryw7md5gl9qidg8bm2rb2v2idzf8bvmpb.nar.zst5354lb # [ 90.260403] niks3-server[1047]: 2026/09/20 09:51:29 INFO Signed narinfos id=30 count=15355worker2 # [ 90.243780] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.250Z level=INFO msg="Uploading 1 narinfos"5356lb # [ 90.264233] niks3-server[1047]: 2026/09/20 09:51:29 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.ls5357lb # [ 90.269218] niks3-server[1047]: 2026/09/20 09:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5358lb # [ 90.272451] niks3-server[1047]: 2026/09/20 09:51:29 INFO Completed upload id=305359worker2 # [ 90.254499] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.260Z level=INFO msg="Upload complete. (227ms)"5360lb # [ 90.274989] niks3-server[1047]: 2026/09/20 09:51:29 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.narinfo5361worker2 # [ 90.258134] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv assign_id=2 outputs=15362worker2 # [ 90.263992] nix-daemon[808]: reaped child process 1258, status = succeeded5363worker1 # [ 90.281806] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:29Z level=debug event=want client=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv cached=05364worker1 # [ 90.286672] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:29Z level=debug event=assigned drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv worker=192.168.1.4:50051 clients=15365worker2 # [ 90.308757] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345366worker2 # [ 90.318262] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607345367worker2 # [ 90.327752] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.333Z level=INFO msg="All 2 paths already cached"5368client # [ 90.366373] nix[1146]: copying 1 paths to 'lb:50051'...5369client # [ 90.367142] nix[1146]: copying path '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' to 'lb:50051'...5370worker2 # [ 90.332778] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607345371worker2 # [ 90.339934] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5372worker2 # [ 90.512101] nix-daemon[808]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5373worker2 # [ 90.525293] nix-daemon[808]: reaped child process 1285, status = succeeded5374worker2 # [ 90.700843] nix-daemon[808]: accepted connection from pid 1287, user nix-grpc-daemon (trusted)5375worker2 # [ 90.713525] nix-daemon[808]: reaped child process 1290, status = succeeded5376lb # [ 90.747876] niks3-server[1047]: 2026/09/20 09:51:29 INFO Received uploads request method=POST path=/api/pending_closures5377worker2 # [ 90.735476] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.741Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5378worker2 # [ 90.737030] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.743Z level=INFO msg="Uploading 4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv (760B)"5379lb # [ 90.765544] niks3-server[1047]: 2026/09/20 09:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5380lb # [ 90.768734] niks3-server[1047]: 2026/09/20 09:51:29 INFO Signed narinfos id=31 count=15381worker2 # [ 90.751046] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.757Z level=INFO msg="Uploading 1 narinfos"5382lb # [ 90.770772] niks3-server[1047]: 2026/09/20 09:51:29 INFO Registered completed upload object_key=nar/1dx1l3qanf0yqmk397nzvl6w8vm5z1klsskxak9mqzzqlm7rj9id.nar.zst5383lb # [ 90.775703] niks3-server[1047]: 2026/09/20 09:51:29 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.ls5384lb # [ 90.779164] niks3-server[1047]: 2026/09/20 09:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5385lb # [ 90.781755] niks3-server[1047]: 2026/09/20 09:51:30 INFO Completed upload id=315386worker2 # [ 90.763721] nix-grpc-daemon[1191]: time=2026-09-20T09:51:30.769Z level=INFO msg="Upload complete. (412ms)"5387worker2 # [ 90.765713] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=0 paths=1 nar_bytes_in=7605388lb # [ 90.784251] niks3-server[1047]: 2026/09/20 09:51:30 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.narinfo5389worker2 # [ 90.768731] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345390worker2 # [ 90.775254] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5391worker2 # [ 90.778392] nix-daemon[808]: reaped child process 1280, status = succeeded5392client # [ 90.816797] nix[1146]: building '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' on lb:50051...5393worker2 # [ 90.783514] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5394worker2 # [ 91.597959] nix-daemon[808]: reaped child process 1294, status = succeeded5395worker2 # [ 91.749275] nix-daemon[808]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5396worker2 # [ 91.762320] nix-daemon[808]: reaped child process 1312, status = succeeded5397lb # [ 91.798627] niks3-server[1047]: 2026/09/20 09:51:31 INFO Received uploads request method=POST path=/api/pending_closures5398worker2 # [ 91.788768] nix-grpc-daemon[1191]: time=2026-09-20T09:51:31.794Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5399worker2 # [ 91.790257] nix-grpc-daemon[1191]: time=2026-09-20T09:51:31.796Z level=INFO msg="Uploading 2kzynzc2x7d9fjl737krjzzjbsp5p77k-farm-top (240B)"5400lb # [ 91.834449] niks3-server[1047]: 2026/09/20 09:51:31 INFO Registered completed upload object_key=nar/1x5xsygwz4a6bpv0g402i3p0nk63j2j9qkxs1rdnp6s20644kc3j.nar.zst5401lb # [ 91.844649] niks3-server[1047]: 2026/09/20 09:51:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5402lb # [ 91.853233] niks3-server[1047]: 2026/09/20 09:51:31 INFO Signed narinfos id=32 count=15403worker2 # [ 91.838655] nix-grpc-daemon[1191]: time=2026-09-20T09:51:31.844Z level=INFO msg="Uploading 1 narinfos"5404lb # [ 91.859825] niks3-server[1047]: 2026/09/20 09:51:31 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.ls5405lb # [ 91.863085] niks3-server[1047]: 2026/09/20 09:51:31 INFO Registered completed upload object_key=log/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5406lb # [ 91.872921] niks3-server[1047]: 2026/09/20 09:51:31 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5407lb # [ 91.878063] niks3-server[1047]: 2026/09/20 09:51:31 INFO Completed upload id=325408worker2 # [ 91.860431] nix-grpc-daemon[1191]: time=2026-09-20T09:51:31.866Z level=INFO msg="Upload complete. (270ms)"5409lb # [ 91.880532] niks3-server[1047]: 2026/09/20 09:51:31 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.narinfo5410worker2 # [ 91.866570] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv assign_id=3 outputs=15411worker2 # [ 91.878091] nix-daemon[808]: reaped child process 1292, status = succeeded5412client # [ 91.929182] systemd[1]: waits.service: Deactivated successfully.5413client # [ 91.933327] systemd[1]: waits.service: Consumed 126ms CPU time over 8.921s wall clock time, 45.5M memory peak, 14.5K incoming IP traffic, 19.9K outgoing IP traffic.5414client: (finished: waiting for success: ! systemctl is-active waits, in 5.23 seconds)5415client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }5416client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.03 seconds)5417worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5418worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5419(finished: subtest: scheduler down: builds wait, then resume when it is back, in 13.90 seconds)5420subtest: clean scheduler restart: peers are told, reconnect without error or backoff5421client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5422client # [ 92.873778] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5423client # Running as unit: rs.service; invocation ID: 46aad9b9dd7a499ba6baccc09ca048d85424client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.06 seconds)5425worker1 # [ 93.042697] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:571805426worker1 # [ 93.054333] nix-daemon[843]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5427client # [ 93.084470] nix[1206]: don't know how to build these paths:5428client # [ 93.085812] nix[1206]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5429worker1 # [ 93.075096] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:32Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05430worker1 # [ 93.080916] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:32Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15431worker1 # [ 93.125279] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:571805432worker1 # [ 93.137488] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 1/5)5433worker1 # [ 93.171100] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 107 ms (attempt 2/5)5434worker1 # [ 93.284713] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 3/5)5435worker1 # [ 93.342476] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 381 ms (attempt 4/5)5436worker1 # [ 93.730515] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5437worker1 # [ 93.747787] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:571805438client # [ 93.775985] nix[1206]: copying 1 paths to 'lb:50051'...5439client # [ 93.779067] nix[1206]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5440worker1 # [ 93.761810] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:571805441worker1 # [ 93.769914] nix-daemon[843]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5442worker1 # [ 93.790860] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:33Z level=info event=niks3_push_started pid=12135443worker1 # [ 94.142516] nix-daemon[843]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5444worker1 # [ 94.154078] nix-daemon[843]: reaped child process 1233, status = succeeded5445worker1 # [ 94.324062] nix-daemon[843]: accepted connection from pid 1235, user nix-grpc-daemon (trusted)5446worker1 # [ 94.335630] nix-daemon[843]: reaped child process 1238, status = succeeded5447lb # [ 94.355225] niks3-server[1047]: 2026/09/20 09:51:33 INFO Received uploads request method=POST path=/api/pending_closures5448worker1 # [ 94.362404] nix-grpc-daemon[1213]: time=2026-09-20T09:51:33.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5449worker1 # [ 94.365470] nix-grpc-daemon[1213]: time=2026-09-20T09:51:33.620Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5450lb # [ 94.389735] niks3-server[1047]: 2026/09/20 09:51:33 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5451lb # [ 94.400842] niks3-server[1047]: 2026/09/20 09:51:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5452lb # [ 94.407824] niks3-server[1047]: 2026/09/20 09:51:33 INFO Signed narinfos id=33 count=15453worker1 # [ 94.408989] nix-grpc-daemon[1213]: time=2026-09-20T09:51:33.664Z level=INFO msg="Uploading 1 narinfos"5454lb # [ 94.420662] niks3-server[1047]: 2026/09/20 09:51:33 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5455lb # [ 94.428445] niks3-server[1047]: 2026/09/20 09:51:33 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5456lb # [ 94.436208] niks3-server[1047]: 2026/09/20 09:51:33 INFO Completed upload id=335457worker1 # [ 94.434060] nix-grpc-daemon[1213]: time=2026-09-20T09:51:33.690Z level=INFO msg="Upload complete. (446ms)"5458lb # [ 94.439454] niks3-server[1047]: 2026/09/20 09:51:33 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5459worker1 # [ 94.438602] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57180 duration_s=0 paths=1 nar_bytes_in=4165460worker1 # [ 94.444447] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:571805461worker1 # [ 94.453334] nix-daemon[843]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5462worker1 # [ 94.461099] nix-daemon[843]: reaped child process 1211, status = succeeded5463client # [ 94.482519] nix[1206]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5464worker1 # [ 94.464605] nix-daemon[843]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5465worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5466worker2 # [ 96.505168] systemd-journald[289]: Received client request to rotate journal, rotating.5467worker2 # [ 96.516816] systemd-journald[289]: Vacuuming done, freed 0B of archived journals from /var/log/journal/903e32a88d6a4f0a8d8e41c89ef3f5c5.5468worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5469worker1: must succeed: systemctl restart nix-grpc-daemon.service5470worker1 # [ 96.483118] nix-daemon[843]: reaped child process 1242, status = succeeded5471worker1 # [ 96.496776] systemd[1]: Stopping Nix worker-protocol over gRPC...5472worker1 # [ 96.625396] nix-daemon[843]: accepted connection from pid 1273, user nix-grpc-daemon (trusted)5473worker1 # [ 96.637271] nix-daemon[843]: reaped child process 1277, status = succeeded5474lb # [ 96.655294] niks3-server[1047]: 2026/09/20 09:51:35 INFO Received uploads request method=POST path=/api/pending_closures5475worker1 # [ 96.663669] nix-grpc-daemon[1213]: time=2026-09-20T09:51:35.919Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5476worker1 # [ 96.665351] nix-grpc-daemon[1213]: time=2026-09-20T09:51:35.921Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5477lb # [ 96.690702] niks3-server[1047]: 2026/09/20 09:51:35 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5478lb # [ 96.700745] niks3-server[1047]: 2026/09/20 09:51:35 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5479lb # [ 96.712687] niks3-server[1047]: 2026/09/20 09:51:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5480lb # [ 96.716823] niks3-server[1047]: 2026/09/20 09:51:35 INFO Signed narinfos id=34 count=15481worker1 # [ 96.719736] nix-grpc-daemon[1213]: time=2026-09-20T09:51:35.975Z level=INFO msg="Uploading 1 narinfos"5482lb # [ 96.721902] niks3-server[1047]: 2026/09/20 09:51:35 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5483lb # [ 96.732771] niks3-server[1047]: 2026/09/20 09:51:35 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5484lb # [ 96.739762] niks3-server[1047]: 2026/09/20 09:51:35 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5485lb # [ 96.741870] niks3-server[1047]: 2026/09/20 09:51:35 INFO Completed upload id=345486worker1 # [ 96.740106] nix-grpc-daemon[1213]: time=2026-09-20T09:51:35.995Z level=INFO msg="Upload complete. (268ms)"5487worker1 # [ 96.748429] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57180 duration_s=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15488worker1 # [ 96.760909] nix-daemon[843]: reaped child process 1240, status = succeeded5489client # [ 96.799906] systemd[1]: rs.service: Deactivated successfully.5490client # [ 96.803619] systemd[1]: rs.service: Consumed 103ms CPU time over 3.928s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9K outgoing IP traffic.5491worker1 # [ 97.338376] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=signal_exit5492worker2 # [ 97.330245] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:37Z level=info event=scheduler_restarting addr=lb:500515493worker1 # [ 97.347254] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=scheduler_restarting5494worker1 # [ 97.351620] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:490685495worker1 # [ 97.356791] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=worker_gone addr=192.168.1.4:500515496worker1 # [ 97.360603] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=scheduler_restarting addr=lb:500515497worker1 # [ 97.364721] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:490685498worker1 # [ 97.368753] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=worker_gone addr=192.168.1.3:500515499worker1 # [ 97.383891] nix-daemon[843]: reaped child process 1204, status = succeeded5500worker2 # [ 97.529426] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:37Z level=info event=scheduler_connected addr=lb:500515501worker1 # [ 97.546660] nix-grpc-daemon[1143]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5502worker1 # [ 97.551275] nix-grpc-daemon[1143]: E0000 00:00:1789897896.802554 1186 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5503worker1 # [ 97.565656] nix-grpc-daemon[1143]: ts=2026-09-20T09:51:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5504worker1 # [ 97.803240] nix-grpc-daemon[1143]: E0000 00:00:1789897897.058036 1186 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5505worker1 # [ 97.808737] nix-grpc-daemon[1143]: E0000 00:00:1789897897.058227 1186 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5506lb # [ 98.250205] envoy[919]: conn peer=[2001:db8:1::1]:39742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=10116 tx=4053 ms=87255507lb # [ 98.251762] envoy[919]: conn peer=[2001:db8:1::1]:55248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1351 ms=37175508lb # [ 98.253230] envoy[919]: conn peer=[2001:db8:1::3]:60474 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=744 tx=260 ms=112085509worker2 # [ 98.813728] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:38Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5510worker1 # [ 98.849517] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5511worker1 # [ 98.853887] systemd[1]: Stopped Nix worker-protocol over gRPC.5512worker1 # [ 98.856378] systemd[1]: nix-grpc-daemon.service: Consumed 485ms CPU time over 12.705s wall clock time, 31.1M memory peak, 17K incoming IP traffic, 23.1K outgoing IP traffic.5513worker1 # [ 98.872920] systemd[1]: Starting Nix worker-protocol over gRPC...5514worker1 # [ 99.024210] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5515worker1 # [ 99.027732] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15516worker2 # [ 99.013948] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:39Z level=info event=scheduler_connected addr=lb:500515517worker1 # [ 99.034386] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5518worker1 # [ 99.036203] systemd[1]: Started Nix worker-protocol over gRPC.5519worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.58 seconds)5520worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5521worker1 # [ 99.048387] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05522worker1 # [ 99.051867] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=info event=scheduler_connected addr=lb:500515523worker1 # [ 99.053541] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05524worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.06 seconds)5525worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5526worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5527client: waiting for success: ! systemctl is-active rs5528client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5529client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5530client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5531client: must fail: journalctl -u rs | grep -q 'reconnecting'5532client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5533(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.55 seconds)5534subtest: scheduler restart mid-build: build finishes, no double build5535client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5536client # [ 99.398458] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5537client # Running as unit: mid.service; invocation ID: ab1cf4f8812244668d8f6c176843a71b5538client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.03 seconds)5539worker1 # [ 99.548738] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:572225540worker1 # [ 99.559811] nix-daemon[843]: accepted connection from pid 1284, user nix-grpc-daemon (trusted)5541client # [ 99.589717] nix[1238]: don't know how to build these paths:5542client # [ 99.590660] nix[1238]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5543worker1 # [ 99.580128] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05544worker1 # [ 99.584821] nix-grpc-daemon[1284]: ts=2026-09-20T09:51:38Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15545worker2 # [ 99.613542] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345546worker2 # [ 99.626278] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607345547client # [ 99.670420] nix[1238]: copying 1 paths to 'lb:50051'...5548worker2 # [ 99.637352] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607345549client # [ 99.672664] nix[1238]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5550worker2 # [ 99.651205] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5551worker2 # [ 99.817223] nix-daemon[808]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5552worker2 # [ 99.829921] nix-daemon[808]: reaped child process 1354, status = succeeded5553worker2 # [ 99.981068] nix-daemon[808]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5554worker2 # [ 99.993497] nix-daemon[808]: reaped child process 1359, status = succeeded5555lb # [ 100.026659] niks3-server[1047]: 2026/09/20 09:51:39 INFO Received uploads request method=POST path=/api/pending_closures5556worker2 # [ 100.014859] nix-grpc-daemon[1191]: time=2026-09-20T09:51:40.020Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5557worker2 # [ 100.016689] nix-grpc-daemon[1191]: time=2026-09-20T09:51:40.022Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5558lb # [ 100.051142] niks3-server[1047]: 2026/09/20 09:51:39 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5559lb # [ 100.061780] niks3-server[1047]: 2026/09/20 09:51:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5560worker2 # [ 100.049024] nix-grpc-daemon[1191]: time=2026-09-20T09:51:40.055Z level=INFO msg="Uploading 1 narinfos"5561lb # [ 100.068391] niks3-server[1047]: 2026/09/20 09:51:39 INFO Signed narinfos id=35 count=15562lb # [ 100.073315] niks3-server[1047]: 2026/09/20 09:51:39 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5563lb # [ 100.084228] niks3-server[1047]: 2026/09/20 09:51:39 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5564worker2 # [ 100.072046] nix-grpc-daemon[1191]: time=2026-09-20T09:51:40.078Z level=INFO msg="Upload complete. (409ms)"5565lb # [ 100.090181] niks3-server[1047]: 2026/09/20 09:51:39 INFO Completed upload id=355566lb # [ 100.093808] niks3-server[1047]: 2026/09/20 09:51:39 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5567worker2 # [ 100.077138] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=0 paths=1 nar_bytes_in=4245568worker2 # [ 100.081557] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345569worker2 # [ 100.089305] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5570worker2 # [ 100.094360] nix-daemon[808]: reaped child process 1349, status = succeeded5571worker2 # [ 100.099149] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5572client # [ 100.132819] nix[1238]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5573worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5574worker1 # [ 101.893406] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1284 (nix-grpc-daemon) on client request.5575worker1 # [ 101.899079] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5576worker2 # [ 101.883809] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5577client # [ 101.918745] nix[1238]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5578worker1 # [ 101.908949] nix-daemon[843]: reaped child process 1343, status = succeeded5579worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.05 seconds)5580client: must succeed: sleep 5.05581worker1 # [ 101.919647] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5582worker1 # [ 101.922180] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5583worker1 # [ 101.923516] systemd[1]: nix-grpc-daemon.service: Consumed 104ms CPU time over 3.046s wall clock time, 10.3M memory peak, 6.4K incoming IP traffic, 7.1K outgoing IP traffic.5584worker2 # [ 102.084090] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:42Z level=info event=scheduler_connected addr=lb:500515585worker1 # [ 102.103430] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5586worker1 # [ 102.112516] systemd[1]: Starting Nix worker-protocol over gRPC...5587worker1 # [ 102.310172] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:41Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5588worker1 # [ 102.313389] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:41Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15589worker1 # [ 102.319055] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:41Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5590worker1 # [ 102.323105] systemd[1]: Started Nix worker-protocol over gRPC.5591worker1 # [ 102.327938] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15592worker1 # [ 102.336964] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:41Z level=info event=scheduler_connected addr=lb:500515593worker1 # [ 102.338641] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05594client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5595client: waiting for success: ! systemctl is-active mid5596worker2 # [ 107.330621] nix-daemon[808]: reaped child process 1363, status = succeeded5597worker2 # [ 107.496973] nix-daemon[808]: accepted connection from pid 1399, user nix-grpc-daemon (trusted)5598worker2 # [ 107.508587] nix-daemon[808]: reaped child process 1402, status = succeeded5599lb # [ 107.543386] niks3-server[1047]: 2026/09/20 09:51:46 INFO Received uploads request method=POST path=/api/pending_closures5600worker2 # [ 107.530659] nix-grpc-daemon[1191]: time=2026-09-20T09:51:47.536Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5601worker2 # [ 107.532233] nix-grpc-daemon[1191]: time=2026-09-20T09:51:47.538Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5602lb # [ 107.567964] niks3-server[1047]: 2026/09/20 09:51:46 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5603lb # [ 107.573826] niks3-server[1047]: 2026/09/20 09:51:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5604lb # [ 107.576273] niks3-server[1047]: 2026/09/20 09:51:46 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5605lb # [ 107.579878] niks3-server[1047]: 2026/09/20 09:51:46 INFO Signed narinfos id=36 count=15606worker2 # [ 107.562109] nix-grpc-daemon[1191]: time=2026-09-20T09:51:47.568Z level=INFO msg="Uploading 1 narinfos"5607lb # [ 107.582919] niks3-server[1047]: 2026/09/20 09:51:46 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5608lb # [ 107.588071] niks3-server[1047]: 2026/09/20 09:51:46 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5609lb # [ 107.591053] niks3-server[1047]: 2026/09/20 09:51:46 INFO Completed upload id=365610worker2 # [ 107.573055] nix-grpc-daemon[1191]: time=2026-09-20T09:51:47.579Z level=INFO msg="Upload complete. (260ms)"5611lb # [ 107.593762] niks3-server[1047]: 2026/09/20 09:51:46 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5612worker2 # [ 107.575503] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15613worker2 # [ 107.582340] nix-daemon[808]: reaped child process 1361, status = succeeded5614client # [ 107.649438] systemd[1]: mid.service: Deactivated successfully.5615client # [ 107.653449] systemd[1]: mid.service: Consumed 105ms CPU time over 8.253s wall clock time, 37.1M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.5616lb # [ 108.250877] envoy[919]: conn peer=[2001:db8:1::3]:33532 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=496 tx=55 ms=28535617lb # [ 108.255164] envoy[919]: conn peer=[2001:db8:1::1]:55260 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3014 tx=1382 ms=80615618client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)5619client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5620client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5621(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.00 seconds)5622subtest: interrupting the client stops the build on the worker5623client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5624client # [ 108.407445] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5625client # Running as unit: intr.service; invocation ID: 3958465e97b641d4ad1d31cea1c8b8cc5626client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5627worker1 # [ 108.595229] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:551285628worker1 # [ 108.607134] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5629client # [ 108.632395] nix[1273]: don't know how to build these paths:5630client # [ 108.633329] nix[1273]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5631worker1 # [ 108.619876] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:47Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05632worker1 # [ 108.621872] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:47Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15633worker1 # [ 108.666049] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285634worker1 # [ 108.671857] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5)5635worker1 # [ 108.686404] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)5636worker1 # [ 108.792869] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 349 ms (attempt 3/5)5637worker1 # [ 109.144644] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 634 ms (attempt 4/5)5638worker1 # [ 109.785546] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5639worker1 # [ 109.803304] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551285640client # [ 109.831557] nix[1273]: copying 1 paths to 'lb:50051'...5641client # [ 109.834785] nix[1273]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5642worker1 # [ 109.817131] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551285643worker1 # [ 109.828169] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5644worker1 # [ 109.846319] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:49Z level=info event=niks3_push_started pid=14385645worker1 # [ 110.185054] nix-daemon[843]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5646worker1 # [ 110.196884] nix-daemon[843]: reaped child process 1454, status = succeeded5647worker1 # [ 110.354497] nix-daemon[843]: accepted connection from pid 1456, user nix-grpc-daemon (trusted)5648worker1 # [ 110.366228] nix-daemon[843]: reaped child process 1459, status = succeeded5649lb # [ 110.379099] niks3-server[1047]: 2026/09/20 09:51:49 INFO Received uploads request method=POST path=/api/pending_closures5650worker1 # [ 110.381884] nix-grpc-daemon[1438]: time=2026-09-20T09:51:49.637Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5651worker1 # [ 110.383376] nix-grpc-daemon[1438]: time=2026-09-20T09:51:49.639Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5652lb # [ 110.399807] niks3-server[1047]: 2026/09/20 09:51:49 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5653lb # [ 110.402933] niks3-server[1047]: 2026/09/20 09:51:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5654lb # [ 110.405139] niks3-server[1047]: 2026/09/20 09:51:49 INFO Signed narinfos id=37 count=15655worker1 # [ 110.404659] nix-grpc-daemon[1438]: time=2026-09-20T09:51:49.660Z level=INFO msg="Uploading 1 narinfos"5656lb # [ 110.411881] niks3-server[1047]: 2026/09/20 09:51:49 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5657lb # [ 110.414371] niks3-server[1047]: 2026/09/20 09:51:49 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5658lb # [ 110.419174] niks3-server[1047]: 2026/09/20 09:51:49 INFO Completed upload id=375659worker1 # [ 110.417069] nix-grpc-daemon[1438]: time=2026-09-20T09:51:49.673Z level=INFO msg="Upload complete. (385ms)"5660lb # [ 110.420578] niks3-server[1047]: 2026/09/20 09:51:49 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5661worker1 # [ 110.419142] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=4245662worker1 # [ 110.423182] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285663worker1 # [ 110.428768] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5664worker1 # [ 110.430988] nix-daemon[843]: reaped child process 1436, status = succeeded5665worker1 # [ 110.436054] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5666client # [ 110.453816] nix[1273]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5667client: must succeed: systemctl kill -s INT intr5668client # [ 111.917954] systemd[1]: intr.service: Sent signal SIGINT to main process 1273 (nix) on client request.5669client # [ 111.924834] nix[1273]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5670client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5671client # [ 111.932767] nix[1273]: error: interrupted by the user5672client # [ 111.966523] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5673client # [ 111.967936] systemd[1]: intr.service: Failed with result 'exit-code'.5674client # [ 111.969838] systemd[1]: intr.service: Consumed 105ms CPU time over 3.561s wall clock time, 37.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5675worker1 # [ 112.053732] nix-daemon[843]: reaped child process 1461, status = succeeded5676worker1 # [ 112.057443] nix-daemon[1463]: unexpected Nix daemon error: error: interrupted by the user5677worker1 # [ 112.061650] nix-daemon[843]: reaped child process 1463, status = failed with exit code 15678(finished: subtest: interrupting the client stops the build on the worker, in 4.77 seconds)5679subtest: a deploy mid-build drains: the build finishes, the new generation takes over5680client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5681client # [ 113.199547] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5682client # Running as unit: sw.service; invocation ID: 79cb67c3b0f143dcbca249d7e3764de05683client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5684worker1 # [ 113.399095] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:551285685client # [ 113.423969] nix[1293]: don't know how to build these paths:5686client # [ 113.424881] nix[1293]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5687worker1 # [ 113.413650] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:52Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05688worker1 # [ 113.417657] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:52Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15689worker2 # [ 113.441952] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345690worker2 # [ 113.449189] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607345691client # [ 113.489245] nix[1293]: copying 1 paths to 'lb:50051'...5692worker2 # [ 113.455942] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607345693client # [ 113.492145] nix[1293]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5694worker2 # [ 113.465698] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5695worker2 # [ 113.629446] nix-daemon[808]: accepted connection from pid 1434, user nix-grpc-daemon (trusted)5696worker2 # [ 113.642289] nix-daemon[808]: reaped child process 1437, status = succeeded5697worker2 # [ 113.807908] nix-daemon[808]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5698worker2 # [ 113.820390] nix-daemon[808]: reaped child process 1442, status = succeeded5699lb # [ 113.854743] niks3-server[1047]: 2026/09/20 09:51:53 INFO Received uploads request method=POST path=/api/pending_closures5700worker2 # [ 113.845926] nix-grpc-daemon[1191]: time=2026-09-20T09:51:53.851Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5701worker2 # [ 113.847405] nix-grpc-daemon[1191]: time=2026-09-20T09:51:53.853Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5702lb # [ 113.885700] niks3-server[1047]: 2026/09/20 09:51:53 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5703lb # [ 113.895658] niks3-server[1047]: 2026/09/20 09:51:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5704worker2 # [ 113.885049] nix-grpc-daemon[1191]: time=2026-09-20T09:51:53.891Z level=INFO msg="Uploading 1 narinfos"5705lb # [ 113.902660] niks3-server[1047]: 2026/09/20 09:51:53 INFO Signed narinfos id=38 count=15706lb # [ 113.908256] niks3-server[1047]: 2026/09/20 09:51:53 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5707lb # [ 113.917929] niks3-server[1047]: 2026/09/20 09:51:53 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5708lb # [ 113.921195] niks3-server[1047]: 2026/09/20 09:51:53 INFO Completed upload id=385709lb # [ 113.922513] niks3-server[1047]: 2026/09/20 09:51:53 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5710worker2 # [ 113.903598] nix-grpc-daemon[1191]: time=2026-09-20T09:51:53.909Z level=INFO msg="Upload complete. (432ms)"5711worker2 # [ 113.907577] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=0 paths=1 nar_bytes_in=4165712worker2 # [ 113.913258] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607345713worker2 # [ 113.921077] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5714worker2 # [ 113.928090] nix-daemon[808]: reaped child process 1432, status = succeeded5715worker2 # [ 113.933960] nix-daemon[808]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5716client # [ 113.966662] nix[1293]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5717worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25718worker2 # Checking switch inhibitors... done5719worker2 # [ 116.223940] nixos[1477]: switching to system configuration /nix/store/2wlzjflm4j959cdjv3m4x4f4rmngdqvs-nixos-system-worker2-test5720worker2 # [ 116.225698] systemd[1]: Stopped target Remote File Systems.5721worker2 # activating the configuration...5722worker2 # [ 116.229075] systemd[1]: Stopped target Local File Systems.5723worker2 # setting up /etc...5724worker2 # [ 116.869721] systemd[1]: Reload requested from client PID 1477 ('.switch-to-conf') (unit backdoor.service)...5725worker2 # [ 116.872395] systemd[1]: Reloading...5726worker2 # [ 117.536316] systemd[1]: Reloading finished in 662 ms.5727worker2 # restarting sysinit-reactivation.target5728worker2 # [ 117.593408] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5729worker2 # [ 117.734312] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5730worker2 # [ 117.737667] systemd[1]: Reached target Reactivate sysinit units.5731worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5732worker2 # [ 117.742267] dbus-broker-launch[535]: Caught SIGHUP, trigger reload.5733worker2 # [ 117.743970] systemd[1]: Reloading D-Bus System Message Bus...5734worker2 # [ 117.747500] systemd[1]: Reloading Nix worker-protocol over gRPC...5735worker2 # [ 117.776070] dbus-broker-launch[535]: Looking up NSS user entry for 'systemd-timesync'...5736worker2 # [ 117.780140] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync'5737worker2 # [ 117.781227] dbus-broker-launch[535]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5738worker2 # [ 117.793648] systemd[1]: Reloaded Nix worker-protocol over gRPC.5739worker2 # [ 117.811752] systemd[1]: Reloaded D-Bus System Message Bus.5740worker2 # [ 117.815567] systemd[1]: Reached target Local File Systems.5741worker2 # [ 117.819300] systemd[1]: Reached target Remote File Systems.5742worker2 # [ 117.823594] systemd[1]: Starting linger-users.service...5743worker2 # [ 117.826933] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5744worker2 # [ 117.832297] systemd[1]: Starting Create SUID/SGID Wrappers...5745worker2 # [ 117.835139] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5746worker2 # [ 117.836386] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675747worker2 # [ 117.838466] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5748worker2 # [ 117.839881] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5749worker2 # [ 117.845462] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5750worker2 # [ 117.846644] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5751worker2 # [ 117.847844] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5752worker2 # [ 117.899074] systemd[1]: linger-users.service: Deactivated successfully.5753worker2 # [ 117.900568] systemd[1]: Finished linger-users.service.5754lb # [ 118.250930] envoy[919]: conn peer=[2001:db8:1::1]:43836 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=755 ms=33365755worker2 # [ 118.242740] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5756worker2 # [ 118.244555] systemd[1]: Finished Create SUID/SGID Wrappers.5757worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5758worker2 # [ 118.500735] nixos[1477]: finished switching to system configuration /nix/store/2wlzjflm4j959cdjv3m4x4f4rmngdqvs-nixos-system-worker2-test5759worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.92 seconds)5760worker2: must succeed: pgrep -f 'read -t [9]0 x'5761worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5762client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25763worker2 # [ 118.615588] nix-grpc-daemon[1170]: ts=2026-09-20T09:51:58Z level=info event=draining5764worker1 # [ 118.783501] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:551285765client # don't know how to build these paths:5766client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5767worker1 # [ 118.793692] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551285768worker1 # [ 118.811405] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05769worker1 # [ 118.815465] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15770worker1 # [ 118.853828] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285771worker1 # [ 118.869794] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551285772client # copying 1 paths to 'lb:50051'...5773worker1 # [ 118.881862] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551285774client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5775worker1 # [ 118.907417] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5776worker1 # [ 119.075047] nix-daemon[843]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5777worker1 # [ 119.086769] nix-daemon[843]: reaped child process 1520, status = succeeded5778worker1 # [ 119.238054] nix-daemon[843]: accepted connection from pid 1522, user nix-grpc-daemon (trusted)5779worker1 # [ 119.249309] nix-daemon[843]: reaped child process 1525, status = succeeded5780lb # [ 119.267653] niks3-server[1047]: 2026/09/20 09:51:58 INFO Received uploads request method=POST path=/api/pending_closures5781worker1 # [ 119.272486] nix-grpc-daemon[1438]: time=2026-09-20T09:51:58.528Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5782worker1 # [ 119.273917] nix-grpc-daemon[1438]: time=2026-09-20T09:51:58.528Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5783lb # [ 119.283252] niks3-server[1047]: 2026/09/20 09:51:58 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5784lb # [ 119.286078] niks3-server[1047]: 2026/09/20 09:51:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5785lb # [ 119.288606] niks3-server[1047]: 2026/09/20 09:51:58 INFO Signed narinfos id=39 count=15786worker1 # [ 119.286720] nix-grpc-daemon[1438]: time=2026-09-20T09:51:58.542Z level=INFO msg="Uploading 1 narinfos"5787lb # [ 119.291798] niks3-server[1047]: 2026/09/20 09:51:58 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5788lb # [ 119.296566] niks3-server[1047]: 2026/09/20 09:51:58 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5789lb # [ 119.299045] niks3-server[1047]: 2026/09/20 09:51:58 INFO Completed upload id=395790worker1 # [ 119.296885] nix-grpc-daemon[1438]: time=2026-09-20T09:51:58.552Z level=INFO msg="Upload complete. (377ms)"5791lb # [ 119.301594] niks3-server[1047]: 2026/09/20 09:51:58 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5792worker1 # [ 119.298880] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=5285793worker1 # [ 119.301623] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285794worker1 # [ 119.307810] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5795worker1 # [ 119.311859] nix-daemon[843]: reaped child process 1515, status = succeeded5796worker1 # [ 119.315881] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5797client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5798client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5799client # farm-a> LOG-farm-a-during-drain5800worker1 # [ 120.340877] nix-daemon[843]: reaped child process 1529, status = succeeded5801worker1 # [ 120.503852] nix-daemon[843]: accepted connection from pid 1544, user nix-grpc-daemon (trusted)5802worker1 # [ 120.516586] nix-daemon[843]: reaped child process 1547, status = succeeded5803lb # [ 120.534727] niks3-server[1047]: 2026/09/20 09:51:59 INFO Received uploads request method=POST path=/api/pending_closures5804worker1 # [ 120.541282] nix-grpc-daemon[1438]: time=2026-09-20T09:51:59.796Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5805worker1 # [ 120.542696] nix-grpc-daemon[1438]: time=2026-09-20T09:51:59.796Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5806lb # [ 120.571189] niks3-server[1047]: 2026/09/20 09:51:59 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5807lb # [ 120.576858] niks3-server[1047]: 2026/09/20 09:51:59 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5808lb # [ 120.588346] niks3-server[1047]: 2026/09/20 09:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5809lb # [ 120.593847] niks3-server[1047]: 2026/09/20 09:51:59 INFO Signed narinfos id=40 count=15810worker1 # [ 120.595154] nix-grpc-daemon[1438]: time=2026-09-20T09:51:59.850Z level=INFO msg="Uploading 1 narinfos"5811lb # [ 120.599690] niks3-server[1047]: 2026/09/20 09:51:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5812lb # [ 120.608962] niks3-server[1047]: 2026/09/20 09:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5813lb # [ 120.613966] niks3-server[1047]: 2026/09/20 09:51:59 INFO Completed upload id=405814worker1 # [ 120.611490] nix-grpc-daemon[1438]: time=2026-09-20T09:51:59.867Z level=INFO msg="Upload complete. (288ms)"5815lb # [ 120.617803] niks3-server[1047]: 2026/09/20 09:51:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5816worker1 # [ 120.616484] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=15817worker1 # [ 120.626426] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:59Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05818worker1 # [ 120.629995] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:59Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15819worker1 # [ 120.637633] nix-daemon[843]: reaped child process 1527, status = succeeded5820worker1 # [ 120.670764] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285821worker1 # [ 120.682495] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551285822worker1 # [ 120.695256] nix-grpc-daemon[1438]: time=2026-09-20T09:51:59.951Z level=INFO msg="All 1 paths already cached"5823client # copying 1 paths to 'lb:50051'...5824client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5825worker1 # [ 120.703150] nix-grpc-daemon[1367]: ts=2026-09-20T09:51:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551285826worker1 # [ 120.717163] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5827worker1 # [ 120.868553] nix-daemon[843]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5828worker1 # [ 120.881110] nix-daemon[843]: reaped child process 1556, status = succeeded5829worker1 # [ 121.044057] nix-daemon[843]: accepted connection from pid 1558, user nix-grpc-daemon (trusted)5830worker1 # [ 121.056105] nix-daemon[843]: reaped child process 1561, status = succeeded5831lb # [ 121.072625] niks3-server[1047]: 2026/09/20 09:52:00 INFO Received uploads request method=POST path=/api/pending_closures5832worker1 # [ 121.078230] nix-grpc-daemon[1438]: time=2026-09-20T09:52:00.334Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5833worker1 # [ 121.080143] nix-grpc-daemon[1438]: time=2026-09-20T09:52:00.335Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5834lb # [ 121.100347] niks3-server[1047]: 2026/09/20 09:52:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5835lb # [ 121.105148] niks3-server[1047]: 2026/09/20 09:52:00 INFO Signed narinfos id=41 count=15836worker1 # [ 121.105745] nix-grpc-daemon[1438]: time=2026-09-20T09:52:00.361Z level=INFO msg="Uploading 1 narinfos"5837lb # [ 121.114895] niks3-server[1047]: 2026/09/20 09:52:00 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5838lb # [ 121.125136] niks3-server[1047]: 2026/09/20 09:52:00 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5839lb # [ 121.130332] niks3-server[1047]: 2026/09/20 09:52:00 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5840worker1 # [ 121.134314] nix-grpc-daemon[1438]: time=2026-09-20T09:52:00.390Z level=INFO msg="Upload complete. (406ms)"5841lb # [ 121.136783] niks3-server[1047]: 2026/09/20 09:52:00 INFO Completed upload id=415842worker1 # [ 121.137072] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=6405843lb # [ 121.140583] niks3-server[1047]: 2026/09/20 09:52:00 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5844worker1 # [ 121.142435] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285845worker1 # [ 121.146262] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5846worker1 # [ 121.148425] nix-daemon[843]: reaped child process 1551, status = succeeded5847worker1 # [ 121.153781] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5848client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5849client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5850client # farm-b> LOG-farm-b-during-drain5851worker1 # [ 122.366906] nix-daemon[843]: reaped child process 1565, status = succeeded5852worker1 # [ 122.508650] nix-daemon[843]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)5853worker1 # [ 122.520937] nix-daemon[843]: reaped child process 1583, status = succeeded5854lb # [ 122.538721] niks3-server[1047]: 2026/09/20 09:52:01 INFO Received uploads request method=POST path=/api/pending_closures5855worker1 # [ 122.544935] nix-grpc-daemon[1438]: time=2026-09-20T09:52:01.800Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5856worker1 # [ 122.546323] nix-grpc-daemon[1438]: time=2026-09-20T09:52:01.800Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5857lb # [ 122.566399] niks3-server[1047]: 2026/09/20 09:52:01 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5858lb # [ 122.580504] niks3-server[1047]: 2026/09/20 09:52:01 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5859lb # [ 122.588256] niks3-server[1047]: 2026/09/20 09:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5860worker1 # [ 122.591033] nix-grpc-daemon[1438]: time=2026-09-20T09:52:01.846Z level=INFO msg="Uploading 1 narinfos"5861lb # [ 122.593141] niks3-server[1047]: 2026/09/20 09:52:01 INFO Signed narinfos id=42 count=15862lb # [ 122.599107] niks3-server[1047]: 2026/09/20 09:52:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5863lb # [ 122.608156] niks3-server[1047]: 2026/09/20 09:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5864worker1 # [ 122.612580] nix-grpc-daemon[1438]: time=2026-09-20T09:52:01.868Z level=INFO msg="Upload complete. (252ms)"5865lb # [ 122.614834] niks3-server[1047]: 2026/09/20 09:52:01 INFO Completed upload id=425866lb # [ 122.616573] niks3-server[1047]: 2026/09/20 09:52:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5867worker1 # [ 122.616275] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=15868worker1 # [ 122.621940] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:01Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05869worker1 # [ 122.623750] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:01Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15870worker1 # [ 122.627664] nix-daemon[843]: reaped child process 1563, status = succeeded5871worker1 # [ 122.665970] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285872worker1 # [ 122.672099] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551285873worker1 # [ 122.678160] nix-grpc-daemon[1438]: time=2026-09-20T09:52:01.934Z level=INFO msg="All 2 paths already cached"5874client # copying 1 paths to 'lb:50051'...5875worker1 # [ 122.682823] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551285876client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5877worker1 # [ 122.694233] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5878worker1 # [ 122.822592] nix-daemon[843]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)5879worker1 # [ 122.834317] nix-daemon[843]: reaped child process 1592, status = succeeded5880worker1 # [ 122.970506] nix-daemon[843]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5881worker1 # [ 122.981936] nix-daemon[843]: reaped child process 1597, status = succeeded5882lb # [ 122.999981] niks3-server[1047]: 2026/09/20 09:52:02 INFO Received uploads request method=POST path=/api/pending_closures5883worker1 # [ 123.005425] nix-grpc-daemon[1438]: time=2026-09-20T09:52:02.261Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5884worker1 # [ 123.006987] nix-grpc-daemon[1438]: time=2026-09-20T09:52:02.263Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5885lb # [ 123.027681] niks3-server[1047]: 2026/09/20 09:52:02 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5886lb # [ 123.039090] niks3-server[1047]: 2026/09/20 09:52:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5887lb # [ 123.044256] niks3-server[1047]: 2026/09/20 09:52:02 INFO Signed narinfos id=43 count=15888worker1 # [ 123.045591] nix-grpc-daemon[1438]: time=2026-09-20T09:52:02.301Z level=INFO msg="Uploading 1 narinfos"5889lb # [ 123.048730] niks3-server[1047]: 2026/09/20 09:52:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5890lb # [ 123.059590] niks3-server[1047]: 2026/09/20 09:52:02 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5891worker1 # [ 123.063937] nix-grpc-daemon[1438]: time=2026-09-20T09:52:02.320Z level=INFO msg="Upload complete. (364ms)"5892lb # [ 123.066341] niks3-server[1047]: 2026/09/20 09:52:02 INFO Completed upload id=435893worker1 # [ 123.065944] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=7685894lb # [ 123.069344] niks3-server[1047]: 2026/09/20 09:52:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5895worker1 # [ 123.070779] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285896worker1 # [ 123.075894] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5897worker1 # [ 123.078190] nix-daemon[843]: reaped child process 1587, status = succeeded5898worker1 # [ 123.083426] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5899client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5900client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5901client # farm-top> LOG-farm-top-during-drain5902worker1 # [ 124.496361] nix-daemon[843]: reaped child process 1601, status = succeeded5903worker1 # [ 124.618588] nix-daemon[843]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5904worker1 # [ 124.629305] nix-daemon[843]: reaped child process 1619, status = succeeded5905lb # [ 124.643772] niks3-server[1047]: 2026/09/20 09:52:03 INFO Received uploads request method=POST path=/api/pending_closures5906worker1 # [ 124.651102] nix-grpc-daemon[1438]: time=2026-09-20T09:52:03.906Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5907worker1 # [ 124.652963] nix-grpc-daemon[1438]: time=2026-09-20T09:52:03.908Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5908lb # [ 124.683403] niks3-server[1047]: 2026/09/20 09:52:03 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5909lb # [ 124.688214] niks3-server[1047]: 2026/09/20 09:52:03 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5910lb # [ 124.690667] niks3-server[1047]: 2026/09/20 09:52:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5911lb # [ 124.693903] niks3-server[1047]: 2026/09/20 09:52:03 INFO Signed narinfos id=44 count=15912worker1 # [ 124.691758] nix-grpc-daemon[1438]: time=2026-09-20T09:52:03.947Z level=INFO msg="Uploading 1 narinfos"5913lb # [ 124.696855] niks3-server[1047]: 2026/09/20 09:52:03 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5914lb # [ 124.701355] niks3-server[1047]: 2026/09/20 09:52:03 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5915lb # [ 124.704179] niks3-server[1047]: 2026/09/20 09:52:03 INFO Completed upload id=445916worker1 # [ 124.701796] nix-grpc-daemon[1438]: time=2026-09-20T09:52:03.957Z level=INFO msg="Upload complete. (211ms)"5917lb # [ 124.706587] niks3-server[1047]: 2026/09/20 09:52:03 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo5918worker1 # [ 124.704685] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=15919worker1 # [ 124.711845] nix-daemon[843]: reaped child process 1599, status = succeeded5920client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.17 seconds)5921client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath5922client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.21 seconds)5923worker2: must succeed: pkill -f 'read -t [9]0 x'5924worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)5925client: waiting for success: ! systemctl is-active sw5926worker2 # [ 125.172406] nix-daemon[808]: reaped child process 1446, status = succeeded5927worker2 # [ 125.338956] nix-daemon[808]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)5928worker2 # [ 125.350590] nix-daemon[808]: reaped child process 1620, status = succeeded5929lb # [ 125.385267] niks3-server[1047]: 2026/09/20 09:52:04 INFO Received uploads request method=POST path=/api/pending_closures5930worker2 # [ 125.375182] nix-grpc-daemon[1191]: time=2026-09-20T09:52:05.381Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5931worker2 # [ 125.376859] nix-grpc-daemon[1191]: time=2026-09-20T09:52:05.382Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"5932lb # [ 125.419677] niks3-server[1047]: 2026/09/20 09:52:04 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5933lb # [ 125.435949] niks3-server[1047]: 2026/09/20 09:52:04 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls5934lb # [ 125.439666] niks3-server[1047]: 2026/09/20 09:52:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5935lb # [ 125.444363] niks3-server[1047]: 2026/09/20 09:52:04 INFO Signed narinfos id=45 count=15936worker2 # [ 125.429723] nix-grpc-daemon[1191]: time=2026-09-20T09:52:05.435Z level=INFO msg="Uploading 1 narinfos"5937lb # [ 125.456050] niks3-server[1047]: 2026/09/20 09:52:04 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5938lb # [ 125.462798] niks3-server[1047]: 2026/09/20 09:52:04 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5939lb # [ 125.468334] niks3-server[1047]: 2026/09/20 09:52:04 INFO Completed upload id=455940worker2 # [ 125.450511] nix-grpc-daemon[1191]: time=2026-09-20T09:52:05.456Z level=INFO msg="Upload complete. (297ms)"5941lb # [ 125.473171] niks3-server[1047]: 2026/09/20 09:52:04 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo5942worker2 # [ 125.456688] nix-grpc-daemon[1170]: ts=2026-09-20T09:52:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60734 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=15943worker2 # [ 125.469739] nix-daemon[808]: reaped child process 1444, status = succeeded5944client # [ 125.528548] systemd[1]: sw.service: Deactivated successfully.5945client # [ 125.531731] systemd[1]: sw.service: Consumed 113ms CPU time over 12.328s wall clock time, 39.2M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.5946worker2 # [ 125.617846] nix-grpc-daemon[1170]: ts=2026-09-20T09:52:05Z level=info event=signal_exit5947worker1 # [ 125.642366] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:572405948worker1 # [ 125.646093] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:04Z level=info event=worker_gone addr=192.168.1.4:500515949worker2 # [ 125.636429] nix-grpc-daemon[1170]: ts=2026-09-20T09:52:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5950worker2 # [ 125.657951] nix-daemon[808]: reaped child process 1184, status = succeeded5951worker2 # [ 125.682125] nix-grpc-daemon[1170]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5952worker2 # [ 125.685726] nix-grpc-daemon[1170]: E0000 00:00:1789897925.688147 1181 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5953client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)5954client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5955client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)5956worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5957worker2 # [ 126.663619] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5958worker2 # [ 126.668631] systemd[1]: nix-grpc-daemon.service: Consumed 1.692s CPU time over 54.280s wall clock time, 32.7M memory peak, 65.6K incoming IP traffic, 107.7K outgoing IP traffic.5959worker2 # [ 126.687222] systemd[1]: Starting Nix worker-protocol over gRPC...5960worker2 # [ 126.869242] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5961worker2 # [ 126.871295] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:06Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15962worker2 # [ 126.878399] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5963worker2 # [ 126.880327] systemd[1]: Started Nix worker-protocol over gRPC.5964worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.76 seconds)5965lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5966lb: must succeed: curl -sf localhost:9901/clusters5967worker2 # [ 126.899454] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:06Z level=info event=scheduler_connected addr=lb:500515968worker1 # [ 126.918450] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05969lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5970lb: must succeed: curl -sf localhost:9901/clusters5971lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5972lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5973worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5974worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5975(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.95 seconds)5976subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5977client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15978lb # [ 128.250983] envoy[919]: conn peer=[2001:db8:1::1]:45286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9585 tx=3865 ms=59415979lb # [ 128.252924] envoy[919]: conn peer=[2001:db8:1::1]:45278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1350 ms=120915980lb # [ 128.254690] envoy[919]: conn peer=[2001:db8:1::4]:35446 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9733 tx=2141 ms=530235981worker1 # [ 128.284353] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:551285982worker2 # [ 128.277853] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483225983worker2 # [ 128.288776] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)5984worker2 # [ 128.305381] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)5985worker2 # [ 128.313122] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 2/5)5986worker2 # [ 128.381074] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 279 ms (attempt 3/5)5987worker2 # [ 128.666228] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 547 ms (attempt 4/5)5988worker2 # [ 129.219683] nix-grpc-daemon[1634]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5989worker1 # [ 129.278254] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:08Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=05990worker1 # [ 129.284919] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:08Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=15991worker1 # [ 129.289225] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:08Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=05992worker1 # [ 129.293073] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:08Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=05993worker1 # [ 129.326755] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551285994worker1 # [ 129.339734] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551285995worker1 # [ 129.351151] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551285996worker1 # [ 129.359990] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5997worker1 # [ 129.521156] nix-daemon[843]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)5998worker1 # [ 129.533149] nix-daemon[843]: reaped child process 1633, status = succeeded5999worker1 # [ 129.689040] nix-daemon[843]: accepted connection from pid 1635, user nix-grpc-daemon (trusted)6000worker1 # [ 129.700789] nix-daemon[843]: reaped child process 1638, status = succeeded6001lb # [ 129.716995] niks3-server[1047]: 2026/09/20 09:52:08 INFO Received uploads request method=POST path=/api/pending_closures6002worker1 # [ 129.722532] nix-grpc-daemon[1438]: time=2026-09-20T09:52:08.978Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6003worker1 # [ 129.724096] nix-grpc-daemon[1438]: time=2026-09-20T09:52:08.980Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6004lb # [ 129.744134] niks3-server[1047]: 2026/09/20 09:52:08 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6005lb # [ 129.755415] niks3-server[1047]: 2026/09/20 09:52:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6006lb # [ 129.762390] niks3-server[1047]: 2026/09/20 09:52:08 INFO Signed narinfos id=46 count=16007worker1 # [ 129.763393] nix-grpc-daemon[1438]: time=2026-09-20T09:52:09.019Z level=INFO msg="Uploading 1 narinfos"6008lb # [ 129.765884] niks3-server[1047]: 2026/09/20 09:52:08 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6009lb # [ 129.780241] niks3-server[1047]: 2026/09/20 09:52:08 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6010lb # [ 129.784681] niks3-server[1047]: 2026/09/20 09:52:09 INFO Completed upload id=466011worker1 # [ 129.784805] nix-grpc-daemon[1438]: time=2026-09-20T09:52:09.040Z level=INFO msg="Upload complete. (411ms)"6012lb # [ 129.787295] niks3-server[1047]: 2026/09/20 09:52:09 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6013worker1 # [ 129.786888] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=5046014worker1 # [ 129.792273] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286015worker1 # [ 129.802501] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6016worker1 # [ 129.805507] nix-daemon[843]: reaped child process 1628, status = succeeded6017worker1 # [ 129.810512] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6018worker1 # [ 130.422852] nix-daemon[843]: reaped child process 1642, status = succeeded6019worker1 # [ 130.554838] nix-daemon[843]: accepted connection from pid 1657, user nix-grpc-daemon (trusted)6020worker1 # [ 130.566497] nix-daemon[843]: reaped child process 1660, status = succeeded6021lb # [ 130.582362] niks3-server[1047]: 2026/09/20 09:52:09 INFO Received uploads request method=POST path=/api/pending_closures6022worker1 # [ 130.588027] nix-grpc-daemon[1438]: time=2026-09-20T09:52:09.844Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6023worker1 # [ 130.589505] nix-grpc-daemon[1438]: time=2026-09-20T09:52:09.845Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6024lb # [ 130.616663] niks3-server[1047]: 2026/09/20 09:52:09 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6025lb # [ 130.631088] niks3-server[1047]: 2026/09/20 09:52:09 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6026lb # [ 130.639819] niks3-server[1047]: 2026/09/20 09:52:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6027lb # [ 130.645692] niks3-server[1047]: 2026/09/20 09:52:09 INFO Signed narinfos id=47 count=16028worker1 # [ 130.645884] nix-grpc-daemon[1438]: time=2026-09-20T09:52:09.901Z level=INFO msg="Uploading 1 narinfos"6029lb # [ 130.651079] niks3-server[1047]: 2026/09/20 09:52:09 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6030lb # [ 130.660349] niks3-server[1047]: 2026/09/20 09:52:09 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6031lb # [ 130.664697] niks3-server[1047]: 2026/09/20 09:52:09 INFO Completed upload id=476032worker1 # [ 130.664167] nix-grpc-daemon[1438]: time=2026-09-20T09:52:09.920Z level=INFO msg="Upload complete. (247ms)"6033worker1 # [ 130.670365] nix-grpc-daemon[1438]: time=2026-09-20T09:52:09.920Z level=WARN msg="Failed to register uploaded object" key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo error="server returned 404: object is not pending upload\n"6034worker1 # [ 130.680795] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=16035worker1 # [ 130.686223] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16036worker1 # [ 130.689965] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286037worker1 # [ 130.693271] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06038worker1 # [ 130.701189] nix-daemon[843]: reaped child process 1640, status = succeeded6039worker1 # [ 130.719063] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286040worker1 # [ 130.729457] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286041worker1 # [ 130.735731] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6042worker1 # [ 130.886315] nix-daemon[843]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)6043worker1 # [ 130.899708] nix-daemon[843]: reaped child process 1669, status = succeeded6044worker1 # [ 131.044360] nix-daemon[843]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)6045worker1 # [ 131.056125] nix-daemon[843]: reaped child process 1674, status = succeeded6046lb # [ 131.069933] niks3-server[1047]: 2026/09/20 09:52:10 INFO Received uploads request method=POST path=/api/pending_closures6047worker1 # [ 131.075890] nix-grpc-daemon[1438]: time=2026-09-20T09:52:10.331Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6048worker1 # [ 131.077241] nix-grpc-daemon[1438]: time=2026-09-20T09:52:10.331Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6049lb # [ 131.095388] niks3-server[1047]: 2026/09/20 09:52:10 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6050lb # [ 131.105923] niks3-server[1047]: 2026/09/20 09:52:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6051lb # [ 131.112096] niks3-server[1047]: 2026/09/20 09:52:10 INFO Signed narinfos id=48 count=16052worker1 # [ 131.113179] nix-grpc-daemon[1438]: time=2026-09-20T09:52:10.369Z level=INFO msg="Uploading 1 narinfos"6053lb # [ 131.117390] niks3-server[1047]: 2026/09/20 09:52:10 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6054lb # [ 131.129811] niks3-server[1047]: 2026/09/20 09:52:10 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6055lb # [ 131.136285] niks3-server[1047]: 2026/09/20 09:52:10 INFO Completed upload id=486056worker1 # [ 131.134345] nix-grpc-daemon[1438]: time=2026-09-20T09:52:10.390Z level=INFO msg="Upload complete. (390ms)"6057lb # [ 131.138700] niks3-server[1047]: 2026/09/20 09:52:10 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6058worker1 # [ 131.138145] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=5046059worker1 # [ 131.143624] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286060worker1 # [ 131.149110] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6061worker1 # [ 131.151242] nix-daemon[843]: reaped child process 1664, status = succeeded6062worker1 # [ 131.156511] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6063worker1 # [ 131.969562] nix-daemon[843]: reaped child process 1678, status = succeeded6064worker1 # [ 132.092169] nix-daemon[843]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)6065worker1 # [ 132.103597] nix-daemon[843]: reaped child process 1696, status = succeeded6066lb # [ 132.120243] niks3-server[1047]: 2026/09/20 09:52:11 INFO Received uploads request method=POST path=/api/pending_closures6067worker1 # [ 132.126089] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.381Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6068worker1 # [ 132.127587] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.383Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6069lb # [ 132.160145] niks3-server[1047]: 2026/09/20 09:52:11 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6070lb # [ 132.167737] niks3-server[1047]: 2026/09/20 09:52:11 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6071lb # [ 132.178367] niks3-server[1047]: 2026/09/20 09:52:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6072lb # [ 132.183106] niks3-server[1047]: 2026/09/20 09:52:11 INFO Signed narinfos id=49 count=16073worker1 # [ 132.183436] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.439Z level=INFO msg="Uploading 1 narinfos"6074lb # [ 132.194337] niks3-server[1047]: 2026/09/20 09:52:11 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6075lb # [ 132.199463] niks3-server[1047]: 2026/09/20 09:52:11 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6076lb # [ 132.204202] niks3-server[1047]: 2026/09/20 09:52:11 INFO Completed upload id=496077worker1 # [ 132.201671] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.457Z level=INFO msg="Upload complete. (239ms)"6078lb # [ 132.206962] niks3-server[1047]: 2026/09/20 09:52:11 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6079worker1 # [ 132.206606] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16080worker1 # [ 132.215307] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16081worker1 # [ 132.220723] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06082worker1 # [ 132.227414] nix-daemon[843]: reaped child process 1676, status = succeeded6083worker1 # [ 132.255174] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286084worker1 # [ 132.266573] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286085worker1 # [ 132.277589] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286086worker1 # [ 132.285541] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6087worker1 # [ 132.439896] nix-daemon[843]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)6088worker1 # [ 132.452716] nix-daemon[843]: reaped child process 1705, status = succeeded6089worker1 # [ 132.595753] nix-daemon[843]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)6090worker1 # [ 132.607435] nix-daemon[843]: reaped child process 1710, status = succeeded6091lb # [ 132.622454] niks3-server[1047]: 2026/09/20 09:52:11 INFO Received uploads request method=POST path=/api/pending_closures6092worker1 # [ 132.624689] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.880Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6093worker1 # [ 132.626078] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.880Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6094lb # [ 132.634406] niks3-server[1047]: 2026/09/20 09:52:11 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6095lb # [ 132.639288] niks3-server[1047]: 2026/09/20 09:52:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6096lb # [ 132.641235] niks3-server[1047]: 2026/09/20 09:52:11 INFO Signed narinfos id=50 count=16097worker1 # [ 132.639341] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.895Z level=INFO msg="Uploading 1 narinfos"6098lb # [ 132.646643] niks3-server[1047]: 2026/09/20 09:52:11 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6099lb # [ 132.649427] niks3-server[1047]: 2026/09/20 09:52:11 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6100lb # [ 132.652615] niks3-server[1047]: 2026/09/20 09:52:11 INFO Completed upload id=506101worker1 # [ 132.650392] nix-grpc-daemon[1438]: time=2026-09-20T09:52:11.906Z level=INFO msg="Upload complete. (354ms)"6102worker1 # [ 132.652246] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=5046103lb # [ 132.655545] niks3-server[1047]: 2026/09/20 09:52:11 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6104worker1 # [ 132.655788] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286105worker1 # [ 132.661571] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6106worker1 # [ 132.663742] nix-daemon[843]: reaped child process 1700, status = succeeded6107worker1 # [ 132.668530] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6108worker1 # [ 133.887974] nix-daemon[843]: reaped child process 1714, status = succeeded6109worker1 # [ 134.036980] nix-daemon[843]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)6110worker1 # [ 134.048825] nix-daemon[843]: reaped child process 1732, status = succeeded6111lb # [ 134.061786] niks3-server[1047]: 2026/09/20 09:52:13 INFO Received uploads request method=POST path=/api/pending_closures6112worker1 # [ 134.068411] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.324Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6113worker1 # [ 134.069905] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.325Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6114lb # [ 134.097546] niks3-server[1047]: 2026/09/20 09:52:13 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6115lb # [ 134.106375] niks3-server[1047]: 2026/09/20 09:52:13 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6116lb # [ 134.116577] niks3-server[1047]: 2026/09/20 09:52:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6117worker1 # [ 134.118977] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.374Z level=INFO msg="Uploading 1 narinfos"6118lb # [ 134.121528] niks3-server[1047]: 2026/09/20 09:52:13 INFO Signed narinfos id=51 count=16119lb # [ 134.127077] niks3-server[1047]: 2026/09/20 09:52:13 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6120lb # [ 134.135357] niks3-server[1047]: 2026/09/20 09:52:13 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6121lb # [ 134.140682] niks3-server[1047]: 2026/09/20 09:52:13 INFO Completed upload id=516122lb # [ 134.143808] niks3-server[1047]: 2026/09/20 09:52:13 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6123worker1 # [ 134.140473] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.396Z level=INFO msg="Upload complete. (265ms)"6124worker1 # [ 134.152617] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16125worker1 # [ 134.157248] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16126worker1 # [ 134.160878] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286127worker1 # [ 134.164247] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06128worker1 # [ 134.173293] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286129worker1 # [ 134.176356] nix-daemon[843]: reaped child process 1712, status = succeeded6130worker1 # [ 134.181059] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.437Z level=INFO msg="All 1 paths already cached"6131worker1 # [ 134.184960] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286132worker1 # [ 134.188874] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6133worker1 # [ 134.331074] nix-daemon[843]: accepted connection from pid 1738, user nix-grpc-daemon (trusted)6134worker1 # [ 134.344208] nix-daemon[843]: reaped child process 1741, status = succeeded6135worker1 # [ 134.488827] nix-daemon[843]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)6136worker1 # [ 134.500391] nix-daemon[843]: reaped child process 1746, status = succeeded6137lb # [ 134.517780] niks3-server[1047]: 2026/09/20 09:52:13 INFO Received uploads request method=POST path=/api/pending_closures6138worker1 # [ 134.522884] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.778Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6139worker1 # [ 134.524344] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.780Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6140lb # [ 134.542626] niks3-server[1047]: 2026/09/20 09:52:13 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6141lb # [ 134.555555] niks3-server[1047]: 2026/09/20 09:52:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6142worker1 # [ 134.558305] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.814Z level=INFO msg="Uploading 1 narinfos"6143lb # [ 134.561121] niks3-server[1047]: 2026/09/20 09:52:13 INFO Signed narinfos id=52 count=16144lb # [ 134.565925] niks3-server[1047]: 2026/09/20 09:52:13 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6145lb # [ 134.577159] niks3-server[1047]: 2026/09/20 09:52:13 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6146lb # [ 134.583083] niks3-server[1047]: 2026/09/20 09:52:13 INFO Completed upload id=526147worker1 # [ 134.580792] nix-grpc-daemon[1438]: time=2026-09-20T09:52:13.836Z level=INFO msg="Upload complete. (386ms)"6148lb # [ 134.585652] niks3-server[1047]: 2026/09/20 09:52:13 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6149worker1 # [ 134.584310] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=6246150worker1 # [ 134.589800] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286151worker1 # [ 134.599060] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6152worker1 # [ 134.602073] nix-daemon[843]: reaped child process 1736, status = succeeded6153worker1 # [ 134.607043] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6154worker1 # [ 135.830632] nix-daemon[843]: reaped child process 1750, status = succeeded6155worker1 # [ 135.971490] nix-daemon[843]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6156worker1 # [ 135.981948] nix-daemon[843]: reaped child process 1768, status = succeeded6157lb # [ 136.000260] niks3-server[1047]: 2026/09/20 09:52:15 INFO Received uploads request method=POST path=/api/pending_closures6158worker1 # [ 136.008338] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.264Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6159worker1 # [ 136.009846] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.265Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6160lb # [ 136.042930] niks3-server[1047]: 2026/09/20 09:52:15 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6161lb # [ 136.048090] niks3-server[1047]: 2026/09/20 09:52:15 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6162lb # [ 136.061968] niks3-server[1047]: 2026/09/20 09:52:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6163lb # [ 136.067621] niks3-server[1047]: 2026/09/20 09:52:15 INFO Signed narinfos id=53 count=16164worker1 # [ 136.068300] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.324Z level=INFO msg="Uploading 1 narinfos"6165lb # [ 136.070426] niks3-server[1047]: 2026/09/20 09:52:15 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6166lb # [ 136.081925] niks3-server[1047]: 2026/09/20 09:52:15 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6167lb # [ 136.087159] niks3-server[1047]: 2026/09/20 09:52:15 INFO Completed upload id=536168worker1 # [ 136.085277] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.341Z level=INFO msg="Upload complete. (269ms)"6169lb # [ 136.089721] niks3-server[1047]: 2026/09/20 09:52:15 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6170worker1 # [ 136.095495] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16171worker1 # [ 136.100579] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16172worker1 # [ 136.105234] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06173worker1 # [ 136.113503] nix-daemon[843]: reaped child process 1748, status = succeeded6174worker1 # [ 136.134119] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286175worker1 # [ 136.145580] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286176worker1 # [ 136.156784] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.412Z level=INFO msg="All 1 paths already cached"6177worker1 # [ 136.163588] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286178worker1 # [ 136.171418] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6179worker1 # [ 136.327128] nix-daemon[843]: accepted connection from pid 1774, user nix-grpc-daemon (trusted)6180worker1 # [ 136.339981] nix-daemon[843]: reaped child process 1777, status = succeeded6181worker1 # [ 136.467643] nix-daemon[843]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)6182worker1 # [ 136.479516] nix-daemon[843]: reaped child process 1782, status = succeeded6183lb # [ 136.491092] niks3-server[1047]: 2026/09/20 09:52:15 INFO Received uploads request method=POST path=/api/pending_closures6184worker1 # [ 136.495904] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.751Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6185worker1 # [ 136.497645] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.753Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6186lb # [ 136.520055] niks3-server[1047]: 2026/09/20 09:52:15 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6187lb # [ 136.527322] niks3-server[1047]: 2026/09/20 09:52:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6188worker1 # [ 136.531288] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.787Z level=INFO msg="Uploading 1 narinfos"6189lb # [ 136.533272] niks3-server[1047]: 2026/09/20 09:52:15 INFO Signed narinfos id=54 count=16190lb # [ 136.540223] niks3-server[1047]: 2026/09/20 09:52:15 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6191lb # [ 136.550720] niks3-server[1047]: 2026/09/20 09:52:15 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6192worker1 # [ 136.553843] nix-grpc-daemon[1438]: time=2026-09-20T09:52:15.809Z level=INFO msg="Upload complete. (371ms)"6193lb # [ 136.555914] niks3-server[1047]: 2026/09/20 09:52:15 INFO Completed upload id=546194worker1 # [ 136.555805] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=6246195lb # [ 136.560944] niks3-server[1047]: 2026/09/20 09:52:15 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6196worker1 # [ 136.560262] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286197worker1 # [ 136.568058] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6198worker1 # [ 136.572693] nix-daemon[843]: reaped child process 1772, status = succeeded6199worker1 # [ 136.576976] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6200worker1 # [ 137.789545] nix-daemon[843]: reaped child process 1786, status = succeeded6201worker1 # [ 137.907813] nix-daemon[843]: accepted connection from pid 1802, user nix-grpc-daemon (trusted)6202worker1 # [ 137.919393] nix-daemon[843]: reaped child process 1805, status = succeeded6203lb # [ 137.932958] niks3-server[1047]: 2026/09/20 09:52:17 INFO Received uploads request method=POST path=/api/pending_closures6204worker1 # [ 137.938867] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.194Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6205worker1 # [ 137.940314] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.196Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6206lb # [ 137.969684] niks3-server[1047]: 2026/09/20 09:52:17 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6207lb # [ 137.976700] niks3-server[1047]: 2026/09/20 09:52:17 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6208lb # [ 137.986212] niks3-server[1047]: 2026/09/20 09:52:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6209worker1 # [ 137.988796] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.244Z level=INFO msg="Uploading 1 narinfos"6210lb # [ 137.991198] niks3-server[1047]: 2026/09/20 09:52:17 INFO Signed narinfos id=55 count=16211lb # [ 137.997257] niks3-server[1047]: 2026/09/20 09:52:17 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6212lb # [ 138.005804] niks3-server[1047]: 2026/09/20 09:52:17 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6213lb # [ 138.010827] niks3-server[1047]: 2026/09/20 09:52:17 INFO Completed upload id=556214worker1 # [ 138.008357] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.264Z level=INFO msg="Upload complete. (224ms)"6215lb # [ 138.013328] niks3-server[1047]: 2026/09/20 09:52:17 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6216worker1 # [ 138.018058] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16217worker1 # [ 138.024123] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16218worker1 # [ 138.028597] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286219worker1 # [ 138.032217] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06220worker1 # [ 138.040572] nix-daemon[843]: reaped child process 1784, status = succeeded6221worker1 # [ 138.042188] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286222worker1 # [ 138.048803] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.304Z level=INFO msg="All 1 paths already cached"6223worker1 # [ 138.053226] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286224worker1 # [ 138.058062] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6225worker1 # [ 138.208693] nix-daemon[843]: accepted connection from pid 1811, user nix-grpc-daemon (trusted)6226worker1 # [ 138.220432] nix-daemon[843]: reaped child process 1814, status = succeeded6227worker1 # [ 138.372063] nix-daemon[843]: accepted connection from pid 1816, user nix-grpc-daemon (trusted)6228worker1 # [ 138.383486] nix-daemon[843]: reaped child process 1819, status = succeeded6229lb # [ 138.400766] niks3-server[1047]: 2026/09/20 09:52:17 INFO Received uploads request method=POST path=/api/pending_closures6230worker1 # [ 138.402810] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.658Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6231worker1 # [ 138.404170] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.658Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6232lb # [ 138.412399] niks3-server[1047]: 2026/09/20 09:52:17 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6233lb # [ 138.415751] niks3-server[1047]: 2026/09/20 09:52:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6234lb # [ 138.417604] niks3-server[1047]: 2026/09/20 09:52:17 INFO Signed narinfos id=56 count=16235worker1 # [ 138.415678] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.671Z level=INFO msg="Uploading 1 narinfos"6236lb # [ 138.421766] niks3-server[1047]: 2026/09/20 09:52:17 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6237lb # [ 138.425326] niks3-server[1047]: 2026/09/20 09:52:17 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6238lb # [ 138.428068] niks3-server[1047]: 2026/09/20 09:52:17 INFO Completed upload id=566239worker1 # [ 138.425874] nix-grpc-daemon[1438]: time=2026-09-20T09:52:17.681Z level=INFO msg="Upload complete. (363ms)"6240lb # [ 138.430356] niks3-server[1047]: 2026/09/20 09:52:17 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6241worker1 # [ 138.427763] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=6246242worker1 # [ 138.430512] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286243worker1 # [ 138.436509] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6244worker1 # [ 138.439279] nix-daemon[843]: reaped child process 1809, status = succeeded6245worker1 # [ 138.444321] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6246worker1 # [ 140.058627] nix-daemon[843]: reaped child process 1823, status = succeeded6247worker1 # [ 140.191227] nix-daemon[843]: accepted connection from pid 1838, user nix-grpc-daemon (trusted)6248worker1 # [ 140.202866] nix-daemon[843]: reaped child process 1841, status = succeeded6249lb # [ 140.220459] niks3-server[1047]: 2026/09/20 09:52:19 INFO Received uploads request method=POST path=/api/pending_closures6250worker1 # [ 140.229292] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.483Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6251worker1 # [ 140.230700] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.483Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6252lb # [ 140.252146] niks3-server[1047]: 2026/09/20 09:52:19 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6253lb # [ 140.263160] niks3-server[1047]: 2026/09/20 09:52:19 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6254lb # [ 140.273860] niks3-server[1047]: 2026/09/20 09:52:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6255lb # [ 140.278957] niks3-server[1047]: 2026/09/20 09:52:19 INFO Signed narinfos id=57 count=16256worker1 # [ 140.279570] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.535Z level=INFO msg="Uploading 1 narinfos"6257lb # [ 140.284096] niks3-server[1047]: 2026/09/20 09:52:19 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6258lb # [ 140.294162] niks3-server[1047]: 2026/09/20 09:52:19 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6259lb # [ 140.299138] niks3-server[1047]: 2026/09/20 09:52:19 INFO Completed upload id=576260worker1 # [ 140.297063] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.553Z level=INFO msg="Upload complete. (245ms)"6261lb # [ 140.300835] niks3-server[1047]: 2026/09/20 09:52:19 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6262worker1 # [ 140.308146] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16263worker1 # [ 140.313570] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:19Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16264worker1 # [ 140.317551] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286265worker1 # [ 140.320909] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:19Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06266worker1 # [ 140.329573] nix-daemon[843]: reaped child process 1821, status = succeeded6267worker1 # [ 140.348788] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286268worker1 # [ 140.359484] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.615Z level=INFO msg="All 2 paths already cached"6269worker1 # [ 140.365611] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286270worker1 # [ 140.373983] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6271worker1 # [ 140.523305] nix-daemon[843]: accepted connection from pid 1847, user nix-grpc-daemon (trusted)6272worker1 # [ 140.535182] nix-daemon[843]: reaped child process 1850, status = succeeded6273worker1 # [ 140.688441] nix-daemon[843]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6274worker1 # [ 140.699840] nix-daemon[843]: reaped child process 1855, status = succeeded6275lb # [ 140.717220] niks3-server[1047]: 2026/09/20 09:52:19 INFO Received uploads request method=POST path=/api/pending_closures6276worker1 # [ 140.719290] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.975Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6277worker1 # [ 140.720673] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.975Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6278lb # [ 140.729403] niks3-server[1047]: 2026/09/20 09:52:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6279lb # [ 140.731662] niks3-server[1047]: 2026/09/20 09:52:19 INFO Signed narinfos id=58 count=16280worker1 # [ 140.730749] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.986Z level=INFO msg="Uploading 1 narinfos"6281lb # [ 140.735389] niks3-server[1047]: 2026/09/20 09:52:19 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6282lb # [ 140.739898] niks3-server[1047]: 2026/09/20 09:52:19 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6283lb # [ 140.741798] niks3-server[1047]: 2026/09/20 09:52:19 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6284lb # [ 140.744761] niks3-server[1047]: 2026/09/20 09:52:19 INFO Completed upload id=586285worker1 # [ 140.743802] nix-grpc-daemon[1438]: time=2026-09-20T09:52:19.999Z level=INFO msg="Upload complete. (361ms)"6286lb # [ 140.746420] niks3-server[1047]: 2026/09/20 09:52:19 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6287worker1 # [ 140.745666] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=7526288worker1 # [ 140.749154] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286289worker1 # [ 140.755127] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6290worker1 # [ 140.757667] nix-daemon[843]: reaped child process 1845, status = succeeded6291worker1 # [ 140.762620] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6292worker1 # [ 142.176743] nix-daemon[843]: reaped child process 1859, status = succeeded6293worker1 # [ 142.311099] nix-daemon[843]: accepted connection from pid 1874, user nix-grpc-daemon (trusted)6294worker1 # [ 142.322921] nix-daemon[843]: reaped child process 1877, status = succeeded6295lb # [ 142.341811] niks3-server[1047]: 2026/09/20 09:52:21 INFO Received uploads request method=POST path=/api/pending_closures6296worker1 # [ 142.352353] nix-grpc-daemon[1438]: time=2026-09-20T09:52:21.607Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6297worker1 # [ 142.353699] nix-grpc-daemon[1438]: time=2026-09-20T09:52:21.607Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6298lb # [ 142.382761] niks3-server[1047]: 2026/09/20 09:52:21 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6299lb # [ 142.387373] niks3-server[1047]: 2026/09/20 09:52:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6300lb # [ 142.391422] niks3-server[1047]: 2026/09/20 09:52:21 INFO Signed narinfos id=59 count=16301worker1 # [ 142.392771] nix-grpc-daemon[1438]: time=2026-09-20T09:52:21.648Z level=INFO msg="Uploading 1 narinfos"6302lb # [ 142.399674] niks3-server[1047]: 2026/09/20 09:52:21 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6303lb # [ 142.407670] niks3-server[1047]: 2026/09/20 09:52:21 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6304lb # [ 142.413871] niks3-server[1047]: 2026/09/20 09:52:21 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6305lb # [ 142.419094] niks3-server[1047]: 2026/09/20 09:52:21 INFO Completed upload id=596306worker1 # [ 142.418111] nix-grpc-daemon[1438]: time=2026-09-20T09:52:21.673Z level=INFO msg="Upload complete. (247ms)"6307lb # [ 142.422397] niks3-server[1047]: 2026/09/20 09:52:21 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6308worker1 # [ 142.424927] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16309worker1 # [ 142.429876] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:21Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16310worker1 # [ 142.434312] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286311worker1 # [ 142.443249] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286312worker1 # [ 142.445361] nix-daemon[843]: reaped child process 1857, status = succeeded6313worker1 # [ 142.450545] nix-grpc-daemon[1438]: time=2026-09-20T09:52:21.706Z level=INFO msg="All 2 paths already cached"6314worker1 # [ 142.454218] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286315worker1 # [ 142.459537] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6316worker1 # [ 142.606060] nix-daemon[843]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6317worker1 # [ 142.617875] nix-daemon[843]: reaped child process 1884, status = succeeded6318worker1 # [ 142.761788] nix-daemon[843]: accepted connection from pid 1886, user nix-grpc-daemon (trusted)6319worker1 # [ 142.773361] nix-daemon[843]: reaped child process 1889, status = succeeded6320lb # [ 142.786398] niks3-server[1047]: 2026/09/20 09:52:22 INFO Received uploads request method=POST path=/api/pending_closures6321worker1 # [ 142.791380] nix-grpc-daemon[1438]: time=2026-09-20T09:52:22.047Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6322worker1 # [ 142.792845] nix-grpc-daemon[1438]: time=2026-09-20T09:52:22.048Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6323lb # [ 142.812220] niks3-server[1047]: 2026/09/20 09:52:22 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6324lb # [ 142.825095] niks3-server[1047]: 2026/09/20 09:52:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6325lb # [ 142.828074] niks3-server[1047]: 2026/09/20 09:52:22 INFO Signed narinfos id=60 count=16326worker1 # [ 142.827151] nix-grpc-daemon[1438]: time=2026-09-20T09:52:22.083Z level=INFO msg="Uploading 1 narinfos"6327lb # [ 142.829683] niks3-server[1047]: 2026/09/20 09:52:22 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6328lb # [ 142.834629] niks3-server[1047]: 2026/09/20 09:52:22 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6329lb # [ 142.837732] niks3-server[1047]: 2026/09/20 09:52:22 INFO Completed upload id=606330worker1 # [ 142.835673] nix-grpc-daemon[1438]: time=2026-09-20T09:52:22.091Z level=INFO msg="Upload complete. (371ms)"6331lb # [ 142.839405] niks3-server[1047]: 2026/09/20 09:52:22 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6332worker1 # [ 142.837698] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=7526333worker1 # [ 142.841330] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286334worker1 # [ 142.848384] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6335worker1 # [ 142.849679] nix-daemon[843]: reaped child process 1879, status = succeeded6336worker1 # [ 142.854874] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6337worker1 # [ 143.881501] nix-daemon[843]: reaped child process 1893, status = succeeded6338worker1 # [ 144.000792] nix-daemon[843]: accepted connection from pid 1908, user nix-grpc-daemon (trusted)6339worker1 # [ 144.012973] nix-daemon[843]: reaped child process 1911, status = succeeded6340lb # [ 144.025241] niks3-server[1047]: 2026/09/20 09:52:23 INFO Received uploads request method=POST path=/api/pending_closures6341worker1 # [ 144.031592] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.287Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6342worker1 # [ 144.034055] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.289Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6343lb # [ 144.058608] niks3-server[1047]: 2026/09/20 09:52:23 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6344lb # [ 144.068371] niks3-server[1047]: 2026/09/20 09:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6345lb # [ 144.074803] niks3-server[1047]: 2026/09/20 09:52:23 INFO Signed narinfos id=61 count=16346worker1 # [ 144.075742] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.331Z level=INFO msg="Uploading 1 narinfos"6347lb # [ 144.081873] niks3-server[1047]: 2026/09/20 09:52:23 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6348lb # [ 144.084941] niks3-server[1047]: 2026/09/20 09:52:23 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6349lb # [ 144.089179] niks3-server[1047]: 2026/09/20 09:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6350lb # [ 144.091898] niks3-server[1047]: 2026/09/20 09:52:23 INFO Completed upload id=616351worker1 # [ 144.089793] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.345Z level=INFO msg="Upload complete. (227ms)"6352lb # [ 144.094267] niks3-server[1047]: 2026/09/20 09:52:23 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6353worker1 # [ 144.095801] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16354worker1 # [ 144.101305] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:23Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16355worker1 # [ 144.106851] nix-daemon[843]: reaped child process 1891, status = succeeded6356worker1 # [ 144.137308] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286357worker1 # [ 144.148676] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286358worker1 # [ 144.160453] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.416Z level=INFO msg="All 2 paths already cached"6359worker1 # [ 144.167299] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:551286360worker1 # [ 144.174933] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6361worker1 # [ 144.330500] nix-daemon[843]: accepted connection from pid 1915, user nix-grpc-daemon (trusted)6362worker1 # [ 144.342298] nix-daemon[843]: reaped child process 1918, status = succeeded6363worker1 # [ 144.469474] nix-daemon[843]: accepted connection from pid 1920, user nix-grpc-daemon (trusted)6364worker1 # [ 144.480870] nix-daemon[843]: reaped child process 1923, status = succeeded6365lb # [ 144.493668] niks3-server[1047]: 2026/09/20 09:52:23 INFO Received uploads request method=POST path=/api/pending_closures6366worker1 # [ 144.499191] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.755Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6367worker1 # [ 144.500666] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.756Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6368lb # [ 144.522421] niks3-server[1047]: 2026/09/20 09:52:23 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6369lb # [ 144.532191] niks3-server[1047]: 2026/09/20 09:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6370lb # [ 144.537370] niks3-server[1047]: 2026/09/20 09:52:23 INFO Signed narinfos id=62 count=16371worker1 # [ 144.538632] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.794Z level=INFO msg="Uploading 1 narinfos"6372lb # [ 144.543882] niks3-server[1047]: 2026/09/20 09:52:23 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6373lb # [ 144.555946] niks3-server[1047]: 2026/09/20 09:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6374worker1 # [ 144.558760] nix-grpc-daemon[1438]: time=2026-09-20T09:52:23.814Z level=INFO msg="Upload complete. (372ms)"6375lb # [ 144.560977] niks3-server[1047]: 2026/09/20 09:52:23 INFO Completed upload id=626376lb # [ 144.562731] niks3-server[1047]: 2026/09/20 09:52:23 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6377worker1 # [ 144.560972] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=0 paths=1 nar_bytes_in=7526378worker1 # [ 144.565677] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:551286379worker1 # [ 144.575206] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6380worker1 # [ 144.578958] nix-daemon[843]: reaped child process 1913, status = succeeded6381worker1 # [ 144.583961] nix-daemon[843]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)6382worker1 # [ 145.607139] nix-daemon[843]: reaped child process 1927, status = succeeded6383worker1 # [ 145.761682] nix-daemon[843]: accepted connection from pid 1942, user nix-grpc-daemon (trusted)6384worker1 # [ 145.772184] nix-daemon[843]: reaped child process 1945, status = succeeded6385lb # [ 145.790439] niks3-server[1047]: 2026/09/20 09:52:25 INFO Received uploads request method=POST path=/api/pending_closures6386worker1 # [ 145.796131] nix-grpc-daemon[1438]: time=2026-09-20T09:52:25.051Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6387worker1 # [ 145.797711] nix-grpc-daemon[1438]: time=2026-09-20T09:52:25.053Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6388lb # [ 145.828167] niks3-server[1047]: 2026/09/20 09:52:25 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6389lb # [ 145.838089] niks3-server[1047]: 2026/09/20 09:52:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6390lb # [ 145.845210] niks3-server[1047]: 2026/09/20 09:52:25 INFO Signed narinfos id=63 count=16391worker1 # [ 145.846071] nix-grpc-daemon[1438]: time=2026-09-20T09:52:25.101Z level=INFO msg="Uploading 1 narinfos"6392lb # [ 145.849114] niks3-server[1047]: 2026/09/20 09:52:25 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6393lb # [ 145.856681] niks3-server[1047]: 2026/09/20 09:52:25 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6394lb # [ 145.865511] niks3-server[1047]: 2026/09/20 09:52:25 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6395lb # [ 145.871840] niks3-server[1047]: 2026/09/20 09:52:25 INFO Completed upload id=636396worker1 # [ 145.869343] nix-grpc-daemon[1438]: time=2026-09-20T09:52:25.125Z level=INFO msg="Upload complete. (276ms)"6397lb # [ 145.874354] niks3-server[1047]: 2026/09/20 09:52:25 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6398worker1 # [ 145.876340] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55128 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16399worker1 # [ 145.885950] nix-daemon[843]: reaped child process 1925, status = succeeded6400client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.90 seconds)6401worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6402worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6403client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16404worker1 # [ 146.229282] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:551286405worker2 # [ 146.217077] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483226406worker1 # [ 146.249191] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:25Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06407client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.24 seconds)6408(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 18.20 seconds)6409subtest: low disk drains a worker and builds go to the other6410worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6411worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds)6412worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6413worker1 # [ 147.336954] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:26Z level=info event=unhealthy reason=min_free6414lb # [ 148.252410] envoy[919]: conn peer=[2001:db8:1::1]:57340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27128 tx=10644 ms=176496415lb # [ 148.256415] envoy[919]: conn peer=[2001:db8:1::1]:57666 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=481 ms=316416worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.10 seconds)6417client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26418worker2 # [ 148.559247] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483226419client # don't know how to build these paths:6420client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6421worker1 # [ 148.584797] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:551286422worker1 # [ 148.603937] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:27Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06423worker1 # [ 148.605799] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:27Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16424worker2 # [ 148.633207] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483226425worker2 # [ 148.645952] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483226426client # copying 1 paths to 'lb:50051'...6427client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6428worker2 # [ 148.658622] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483226429worker2 # [ 148.670114] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6430worker2 # [ 148.690505] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:28Z level=info event=niks3_push_started pid=16556431worker2 # [ 149.092212] nix-daemon[808]: accepted connection from pid 1668, user nix-grpc-daemon (trusted)6432worker2 # [ 149.105189] nix-daemon[808]: reaped child process 1671, status = succeeded6433worker2 # [ 149.283249] nix-daemon[808]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6434worker2 # [ 149.295924] nix-daemon[808]: reaped child process 1676, status = succeeded6435lb # [ 149.332468] niks3-server[1047]: 2026/09/20 09:52:28 INFO Received uploads request method=POST path=/api/pending_closures6436worker2 # [ 149.323853] nix-grpc-daemon[1655]: time=2026-09-20T09:52:29.329Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6437worker2 # [ 149.327146] nix-grpc-daemon[1655]: time=2026-09-20T09:52:29.331Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6438lb # [ 149.366079] niks3-server[1047]: 2026/09/20 09:52:28 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6439lb # [ 149.375159] niks3-server[1047]: 2026/09/20 09:52:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6440lb # [ 149.380580] niks3-server[1047]: 2026/09/20 09:52:28 INFO Signed narinfos id=64 count=16441worker2 # [ 149.366066] nix-grpc-daemon[1655]: time=2026-09-20T09:52:29.371Z level=INFO msg="Uploading 1 narinfos"6442lb # [ 149.390735] niks3-server[1047]: 2026/09/20 09:52:28 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6443lb # [ 149.401219] niks3-server[1047]: 2026/09/20 09:52:28 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6444lb # [ 149.407583] niks3-server[1047]: 2026/09/20 09:52:28 INFO Completed upload id=646445worker2 # [ 149.389785] nix-grpc-daemon[1655]: time=2026-09-20T09:52:29.395Z level=INFO msg="Upload complete. (472ms)"6446lb # [ 149.410415] niks3-server[1047]: 2026/09/20 09:52:28 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6447worker2 # [ 149.393305] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48322 duration_s=0 paths=1 nar_bytes_in=5126448worker2 # [ 149.398817] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483226449worker2 # [ 149.406061] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6450worker2 # [ 149.414403] nix-daemon[808]: reaped child process 1653, status = succeeded6451worker2 # [ 149.417455] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6452client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6453client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6454client # farm-a> LOG-farm-a-drain6455worker2 # [ 150.432970] nix-daemon[808]: reaped child process 1680, status = succeeded6456worker2 # [ 150.588700] nix-daemon[808]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6457worker2 # [ 150.600452] nix-daemon[808]: reaped child process 1698, status = succeeded6458lb # [ 150.633943] niks3-server[1047]: 2026/09/20 09:52:29 INFO Received uploads request method=POST path=/api/pending_closures6459worker2 # [ 150.621239] nix-grpc-daemon[1655]: time=2026-09-20T09:52:30.627Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6460worker2 # [ 150.622786] nix-grpc-daemon[1655]: time=2026-09-20T09:52:30.629Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6461lb # [ 150.656120] niks3-server[1047]: 2026/09/20 09:52:29 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6462lb # [ 150.660795] niks3-server[1047]: 2026/09/20 09:52:29 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6463lb # [ 150.662520] niks3-server[1047]: 2026/09/20 09:52:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6464lb # [ 150.664558] niks3-server[1047]: 2026/09/20 09:52:29 INFO Signed narinfos id=65 count=16465worker2 # [ 150.648161] nix-grpc-daemon[1655]: time=2026-09-20T09:52:30.654Z level=INFO msg="Uploading 1 narinfos"6466lb # [ 150.668047] niks3-server[1047]: 2026/09/20 09:52:29 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6467lb # [ 150.674411] niks3-server[1047]: 2026/09/20 09:52:29 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6468lb # [ 150.677516] niks3-server[1047]: 2026/09/20 09:52:29 INFO Completed upload id=656469worker2 # [ 150.659660] nix-grpc-daemon[1655]: time=2026-09-20T09:52:30.665Z level=INFO msg="Upload complete. (234ms)"6470lb # [ 150.679082] niks3-server[1047]: 2026/09/20 09:52:29 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6471worker2 # [ 150.662204] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48322 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16472worker2 # [ 150.669614] nix-daemon[808]: reaped child process 1678, status = succeeded6473worker1 # [ 150.687470] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:29Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06474worker1 # [ 150.691859] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:29Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16475worker2 # [ 150.714337] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483226476worker2 # [ 150.722971] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483226477worker2 # [ 150.734374] nix-grpc-daemon[1655]: time=2026-09-20T09:52:30.740Z level=INFO msg="All 1 paths already cached"6478client # copying 1 paths to 'lb:50051'...6479client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6480worker2 # [ 150.742299] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483226481worker2 # [ 150.749543] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6482worker2 # [ 150.920881] nix-daemon[808]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)6483worker2 # [ 150.934136] nix-daemon[808]: reaped child process 1705, status = succeeded6484worker2 # [ 151.106154] nix-daemon[808]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)6485worker2 # [ 151.119144] nix-daemon[808]: reaped child process 1710, status = succeeded6486lb # [ 151.153943] niks3-server[1047]: 2026/09/20 09:52:30 INFO Received uploads request method=POST path=/api/pending_closures6487worker2 # [ 151.139989] nix-grpc-daemon[1655]: time=2026-09-20T09:52:31.146Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6488worker2 # [ 151.142303] nix-grpc-daemon[1655]: time=2026-09-20T09:52:31.147Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6489lb # [ 151.167425] niks3-server[1047]: 2026/09/20 09:52:30 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6490lb # [ 151.176107] niks3-server[1047]: 2026/09/20 09:52:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6491worker2 # [ 151.163829] nix-grpc-daemon[1655]: time=2026-09-20T09:52:31.169Z level=INFO msg="Uploading 1 narinfos"6492lb # [ 151.181854] niks3-server[1047]: 2026/09/20 09:52:30 INFO Signed narinfos id=66 count=16493lb # [ 151.187458] niks3-server[1047]: 2026/09/20 09:52:30 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6494lb # [ 151.198881] niks3-server[1047]: 2026/09/20 09:52:30 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6495worker2 # [ 151.187337] nix-grpc-daemon[1655]: time=2026-09-20T09:52:31.193Z level=INFO msg="Upload complete. (426ms)"6496lb # [ 151.205312] niks3-server[1047]: 2026/09/20 09:52:30 INFO Completed upload id=666497worker2 # [ 151.189706] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48322 duration_s=0 paths=1 nar_bytes_in=6246498lb # [ 151.208530] niks3-server[1047]: 2026/09/20 09:52:30 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6499worker2 # [ 151.194580] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483226500worker2 # [ 151.201169] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6501worker2 # [ 151.203792] nix-daemon[808]: reaped child process 1700, status = succeeded6502client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6503worker2 # [ 151.209374] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6504client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6505client # farm-b> LOG-farm-b-drain6506worker2 # [ 152.024965] nix-daemon[808]: reaped child process 1714, status = succeeded6507worker2 # [ 152.165085] nix-daemon[808]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)6508worker2 # [ 152.178756] nix-daemon[808]: reaped child process 1732, status = succeeded6509lb # [ 152.212819] niks3-server[1047]: 2026/09/20 09:52:31 INFO Received uploads request method=POST path=/api/pending_closures6510worker2 # [ 152.200419] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.205Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6511worker2 # [ 152.201855] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.205Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6512lb # [ 152.228831] niks3-server[1047]: 2026/09/20 09:52:31 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6513lb # [ 152.231593] niks3-server[1047]: 2026/09/20 09:52:31 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6514lb # [ 152.239268] niks3-server[1047]: 2026/09/20 09:52:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6515lb # [ 152.242723] niks3-server[1047]: 2026/09/20 09:52:31 INFO Signed narinfos id=67 count=16516worker2 # [ 152.227273] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.233Z level=INFO msg="Uploading 1 narinfos"6517lb # [ 152.250200] niks3-server[1047]: 2026/09/20 09:52:31 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6518lb # [ 152.255297] niks3-server[1047]: 2026/09/20 09:52:31 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6519lb # [ 152.257571] niks3-server[1047]: 2026/09/20 09:52:31 INFO Completed upload id=676520worker2 # [ 152.240789] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.247Z level=INFO msg="Upload complete. (224ms)"6521lb # [ 152.259550] niks3-server[1047]: 2026/09/20 09:52:31 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6522worker2 # [ 152.243731] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48322 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16523worker2 # [ 152.251299] nix-daemon[808]: reaped child process 1712, status = succeeded6524worker1 # [ 152.266725] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:31Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06525worker1 # [ 152.270759] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:31Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16526worker2 # [ 152.294593] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483226527worker2 # [ 152.306360] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483226528worker2 # [ 152.319386] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.325Z level=INFO msg="All 2 paths already cached"6529client # copying 1 paths to 'lb:50051'...6530client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6531worker2 # [ 152.326394] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483226532worker2 # [ 152.334866] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6533worker2 # [ 152.521490] nix-daemon[808]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6534worker2 # [ 152.534694] nix-daemon[808]: reaped child process 1739, status = succeeded6535worker2 # [ 152.691632] nix-daemon[808]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)6536worker2 # [ 152.705100] nix-daemon[808]: reaped child process 1744, status = succeeded6537lb # [ 152.741367] niks3-server[1047]: 2026/09/20 09:52:31 INFO Received uploads request method=POST path=/api/pending_closures6538worker2 # [ 152.731346] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.737Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6539worker2 # [ 152.733233] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.739Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6540lb # [ 152.770350] niks3-server[1047]: 2026/09/20 09:52:31 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6541lb # [ 152.780687] niks3-server[1047]: 2026/09/20 09:52:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6542worker2 # [ 152.767919] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.773Z level=INFO msg="Uploading 1 narinfos"6543lb # [ 152.786363] niks3-server[1047]: 2026/09/20 09:52:32 INFO Signed narinfos id=68 count=16544lb # [ 152.791342] niks3-server[1047]: 2026/09/20 09:52:32 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6545lb # [ 152.804905] niks3-server[1047]: 2026/09/20 09:52:32 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6546lb # [ 152.809401] niks3-server[1047]: 2026/09/20 09:52:32 INFO Completed upload id=686547worker2 # [ 152.793846] nix-grpc-daemon[1655]: time=2026-09-20T09:52:32.800Z level=INFO msg="Upload complete. (446ms)"6548lb # [ 152.812878] niks3-server[1047]: 2026/09/20 09:52:32 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6549worker2 # [ 152.797530] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48322 duration_s=0 paths=1 nar_bytes_in=7526550worker2 # [ 152.803297] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483226551worker2 # [ 152.811081] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6552worker2 # [ 152.819222] nix-daemon[808]: reaped child process 1734, status = succeeded6553client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6554worker2 # [ 152.825463] nix-daemon[808]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6555client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6556client # farm-top> LOG-farm-top-drain6557worker2 # [ 153.438823] nix-daemon[808]: reaped child process 1748, status = succeeded6558worker2 # [ 153.585639] nix-daemon[808]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)6559worker2 # [ 153.598606] nix-daemon[808]: reaped child process 1766, status = succeeded6560lb # [ 153.633680] niks3-server[1047]: 2026/09/20 09:52:32 INFO Received uploads request method=POST path=/api/pending_closures6561worker2 # [ 153.620578] nix-grpc-daemon[1655]: time=2026-09-20T09:52:33.626Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6562worker2 # [ 153.622143] nix-grpc-daemon[1655]: time=2026-09-20T09:52:33.628Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6563lb # [ 153.651313] niks3-server[1047]: 2026/09/20 09:52:32 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6564lb # [ 153.657438] niks3-server[1047]: 2026/09/20 09:52:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6565lb # [ 153.659804] niks3-server[1047]: 2026/09/20 09:52:32 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6566lb # [ 153.662614] niks3-server[1047]: 2026/09/20 09:52:32 INFO Signed narinfos id=69 count=16567worker2 # [ 153.645045] nix-grpc-daemon[1655]: time=2026-09-20T09:52:33.651Z level=INFO msg="Uploading 1 narinfos"6568lb # [ 153.666022] niks3-server[1047]: 2026/09/20 09:52:32 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6569lb # [ 153.670146] niks3-server[1047]: 2026/09/20 09:52:32 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6570lb # [ 153.674131] niks3-server[1047]: 2026/09/20 09:52:32 INFO Completed upload id=696571worker2 # [ 153.656297] nix-grpc-daemon[1655]: time=2026-09-20T09:52:33.662Z level=INFO msg="Upload complete. (226ms)"6572lb # [ 153.675802] niks3-server[1047]: 2026/09/20 09:52:32 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6573worker2 # [ 153.658819] nix-grpc-daemon[1634]: ts=2026-09-20T09:52:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48322 duration_s=0 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16574worker2 # [ 153.666123] nix-daemon[808]: reaped child process 1746, status = succeeded6575client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 5.35 seconds)6576client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6577client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.21 seconds)6578worker1: must succeed: rm /nix/.rw-store/fill6579worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6580worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6581worker1 # [ 154.342756] nix-grpc-daemon[1367]: ts=2026-09-20T09:52:33Z level=info event=healthy reason=min_free6582worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)6583(finished: subtest: low disk drains a worker and builds go to the other, in 8.94 seconds)6584(finished: run the VM test script, in 156.08 seconds)6585test script finished in 156.31s6586cleanup6587kill QemuMachine (pid 49)6588client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6589kill QemuMachine (pid 50)6590lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6591kill QemuMachine (pid 51)6592worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6593kill QemuMachine (pid 52)6594worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6595(finished: cleanup, in 0.98 seconds)6596additionally exposed symbols:6597 client, lb, worker1, worker2,6598 vlan1,6599 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh