vm-test-run-nix-grpc-farm log

succeeded `vm-test-run-nix-grpc-farm` `checks.x86_64-linux.farm` · build #253 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1: QEMU running (pid 51)13worker1 # Disk image does not exist, creating the virtualisation disk image...14worker1 # Formatting '/build/vm-state-worker1/tmp.WwdPeF3HOd', fmt=raw size=107374182415lb: QEMU running (pid 50)16worker1 # mke2fs 1.47.4 (6-Mar-2025)17lb # Disk image does not exist, creating the virtualisation disk image...18worker1 # Discarding device blocks: 0/262144 done19worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes20lb # Formatting '/build/vm-state-lb/tmp.aCJ1UEW52X', fmt=raw size=107374182421worker1 # Filesystem UUID: 68f3f23a-a04f-4216-89ac-3c484c2a945222lb # mke2fs 1.47.4 (6-Mar-2025)23worker1 # Superblock backups stored on blocks:24client: QEMU running (pid 49)25client # Disk image does not exist, creating the virtualisation disk image...26lb # Discarding device blocks: 0/262144 done27client # Formatting '/build/vm-state-client/tmp.138jp3SbqK', fmt=raw size=107374182428lb # Creating filesystem with 262144 4k blocks and 65536 inodes29client # mke2fs 1.47.4 (6-Mar-2025)30lb # Filesystem UUID: e8300fe0-6a0d-4c60-a802-bf4a862b6cb231client # Discarding device blocks: 0/262144 done32client # Creating filesystem with 262144 4k blocks and 65536 inodes33lb # Superblock backups stored on blocks:34worker1 # 32768, 98304, 163840, 22937635lb # 32768, 98304, 163840, 22937636worker1 # 37lb # 38worker1 # Allocating group tables: 0/8 done39lb # Allocating group tables: 0/8 done40worker1 # Writing inode tables: 0/8 done41lb # Writing inode tables: 0/8 done42worker1 # Creating journal (8192 blocks): done43lb # Creating journal (8192 blocks): done44worker1 # Writing superblocks and filesystem accounting information: 0/8 done45lb # Writing superblocks and filesystem accounting information: 0/8 done46worker1 # 47lb # 48worker1 # Virtualisation disk image created.49lb # Virtualisation disk image created.50worker2: QEMU running (pid 52)51client # Filesystem UUID: ca98be26-cd72-4db0-92be-1c174741d14f52worker2 # Disk image does not exist, creating the virtualisation disk image...53client # Superblock backups stored on blocks:54(finished: start all VMs, in 0.19 seconds)55client # 32768, 98304, 163840, 22937656client: waiting for unit network-addresses-eth1.service57client # 58client: waiting for the VM to finish booting59client # Allocating group tables: 0/8 done60client # Writing inode tables: 0/8 done61client # Creating journal (8192 blocks): done62client # Writing superblocks and filesystem accounting information: 0/8 done63client # 64worker2 # Formatting '/build/vm-state-worker2/tmp.W0Emg4lngs', fmt=raw size=107374182465client # Virtualisation disk image created.66worker2 # mke2fs 1.47.4 (6-Mar-2025)67worker2 # Discarding device blocks: 0/262144 done68worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes69worker2 # Filesystem UUID: 6b3d1b13-4b76-4981-9302-bdf42082c54e70worker2 # Superblock backups stored on blocks:71worker2 # 32768, 98304, 163840, 22937672worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83client # 84client # 85client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87client # 88client # 89client # 90client # 91client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092worker1 # 93worker1 # 94worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0095client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...96client # 97client # 98worker2 # 99worker2 # 100worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...101worker1 # 102worker1 # 103worker1 # 104worker1 # 105worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00106worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00107worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108worker2 # 109worker2 # 110worker2 # 111worker2 # 112worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00113worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114worker1 # 115worker1 # 116lb # 117lb # 118lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00119worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...120worker2 # 121worker2 # 122lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123lb # 124lb # 125lb # 126lb # 127lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129lb # 130lb # 131client # Booting from ROM...132worker1 # Booting from ROM...133worker2 # Booting from ROM...134lb # Booting from ROM...135client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test/init regInfo=/nix/store/9p1idx4s91wv7zwkal5pb5lr899hddrn-closure-info/registration console=ttyS0,115200n8 console=tty0137client # [ 0.000000] BIOS-provided physical RAM map:138client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148client # [ 0.000000] NX (Execute Disable) protection: active149client # [ 0.000000] APIC: Static calls initialized150client # [ 0.000000] SMBIOS 2.8 present.151client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026153client # [ 0.000000] DMI: Memory slots populated: 1/1154client # [ 0.000000] Hypervisor detected: KVM155client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000156client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00157client # [ 0.000000] kvm-clock: using sched offset of 445465703 cycles158worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hvv0rrwgpqzhm46a4280mwzmbapcmqq9-nixos-system-worker1-test/init regInfo=/nix/store/vhr1b62dfjs04ywz0rz399x3gf2shwsl-closure-info/registration console=ttyS0,115200n8 console=tty0159client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns160worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026161worker1 # [ 0.000000] BIOS-provided physical RAM map:162client # [ 0.000005] tsc: Detected 2400.012 MHz processor163client # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000164worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable165worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved166client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs167worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved168client # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT169client # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]170worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable171worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x5qgax5h37ybfdjp7r7k01yx9abl6wij-nixos-system-worker2-test/init regInfo=/nix/store/dq71v172s5jppb7nnfi3vkq85w35rkbj-closure-info/registration console=ttyS0,115200n8 console=tty0172client # [ 0.002743] Using GB pages for direct mapping173worker2 # [ 0.000000] BIOS-provided physical RAM map:174worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved175client # [ 0.002830] RAMDISK: [mem 0x5e366000-0x5ffcffff]176worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable177worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved178client # [ 0.002839] ACPI: Early table checksum verification disabled179worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved180client # [ 0.002842] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )181worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved182worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved183worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved184client # [ 0.002847] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)185worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable186worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved187client # [ 0.002851] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)188worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved189worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved190client # [ 0.002857] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)191worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved192worker1 # [ 0.000000] NX (Execute Disable) protection: active193client # [ 0.002859] ACPI: FACS 0x000000005FFE0000 000040194worker1 # [ 0.000000] APIC: Static calls initialized195worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved196worker1 # [ 0.000000] SMBIOS 2.8 present.197client # [ 0.002861] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)198worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved199worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014200worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved201client # [ 0.002862] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)202worker1 # [ 0.000000] DMI: Memory slots populated: 1/1203worker1 # [ 0.000000] Hypervisor detected: KVM204worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved205client # [ 0.002864] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)206worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000207worker2 # [ 0.000000] NX (Execute Disable) protection: active208worker2 # [ 0.000000] APIC: Static calls initialized209worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00210client # [ 0.002865] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)211worker2 # [ 0.000000] SMBIOS 2.8 present.212worker1 # [ 0.000000] kvm-clock: using sched offset of 483231785 cycles213client # [ 0.002866] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]214worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014215client # [ 0.002867] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]216worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns217worker2 # [ 0.000000] DMI: Memory slots populated: 1/1218lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026219worker2 # [ 0.000000] Hypervisor detected: KVM220worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor221client # [ 0.002868] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]222worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000223worker1 # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000224client # [ 0.002868] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]225worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00226worker1 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs227worker2 # [ 0.000001] kvm-clock: using sched offset of 472595398 cycles228client # [ 0.002869] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]229worker1 # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT230client # [ 0.002869] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]231worker2 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns232lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0233worker1 # [ 0.002753] found SMP MP-table at [mem 0x000f5450-0x000f545f]234client # [ 0.002870] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]235lb # [ 0.000000] BIOS-provided physical RAM map:236worker1 # [ 0.002764] Using GB pages for direct mapping237worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor238worker1 # [ 0.002836] RAMDISK: [mem 0x5e367000-0x5ffcffff]239worker2 # [ 0.000818] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000240lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable241client # [ 0.003102] No NUMA configuration found242client # [ 0.003103] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]243worker1 # [ 0.002845] ACPI: Early table checksum verification disabled244worker2 # [ 0.000846] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs245lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved246client # [ 0.003105] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]247worker1 # [ 0.002848] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )248client # [ 0.005510] Zone ranges:249lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved250worker2 # [ 0.000850] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT251client # [ 0.005511] DMA [mem 0x0000000000001000-0x0000000000ffffff]252worker1 # [ 0.002853] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)253worker2 # [ 0.002747] found SMP MP-table at [mem 0x000f5450-0x000f545f]254lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable255client # [ 0.005512] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]256worker2 # [ 0.002762] Using GB pages for direct mapping257worker1 # [ 0.002857] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)258client # [ 0.005513] Normal empty259worker2 # [ 0.002910] RAMDISK: [mem 0x5e367000-0x5ffcffff]260lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved261client # [ 0.005514] Device empty262worker2 # [ 0.002919] ACPI: Early table checksum verification disabled263client # [ 0.005515] Movable zone start for each node264lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved265worker1 # [ 0.002865] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)266client # [ 0.005515] Early memory node ranges267worker2 # [ 0.002923] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )268worker1 # [ 0.002867] ACPI: FACS 0x000000005FFE0000 000040269lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved270client # [ 0.005515] node 0: [mem 0x0000000000001000-0x000000000009efff]271worker2 # [ 0.002927] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)272worker1 # [ 0.002868] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)273lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved274client # [ 0.005516] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]275lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved276worker2 # [ 0.002932] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)277worker1 # [ 0.002870] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)278client # [ 0.005517] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]279lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved280client # [ 0.005538] On node 0, zone DMA: 1 pages in unavailable ranges281worker2 # [ 0.002940] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)282worker1 # [ 0.002871] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)283lb # [ 0.000000] NX (Execute Disable) protection: active284client # [ 0.005795] On node 0, zone DMA: 97 pages in unavailable ranges285worker2 # [ 0.002942] ACPI: FACS 0x000000005FFE0000 000040286lb # [ 0.000000] APIC: Static calls initialized287worker1 # [ 0.002873] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)288lb # [ 0.000000] SMBIOS 2.8 present.289client # [ 0.030905] On node 0, zone DMA32: 40 pages in unavailable ranges290worker2 # [ 0.002944] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)291client # [ 0.031365] ACPI: PM-Timer IO Port: 0x608292worker1 # [ 0.002874] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]293lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014294client # [ 0.031375] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])295worker2 # [ 0.002945] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)296lb # [ 0.000000] DMI: Memory slots populated: 1/1297worker1 # [ 0.002875] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]298client # [ 0.031404] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23299lb # [ 0.000000] Hypervisor detected: KVM300worker2 # [ 0.002947] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)301worker1 # [ 0.002876] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]302lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000303client # [ 0.031406] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)304worker1 # [ 0.002876] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]305worker2 # [ 0.002949] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)306lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00307client # [ 0.031408] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)308lb # [ 0.000001] kvm-clock: using sched offset of 498392118 cycles309worker1 # [ 0.002877] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]310worker2 # [ 0.002950] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]311client # [ 0.031409] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)312worker1 # [ 0.002877] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]313worker2 # [ 0.002951] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]314client # [ 0.031410] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)315lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns316lb # [ 0.000005] tsc: Detected 2400.012 MHz processor317worker2 # [ 0.002951] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]318worker1 # [ 0.002878] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]319client # [ 0.031410] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)320worker1 # [ 0.003111] No NUMA configuration found321lb # [ 0.000809] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000322worker2 # [ 0.002952] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]323client # [ 0.031413] ACPI: Using ACPI (MADT) for SMP configuration information324worker1 # [ 0.003112] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]325client # [ 0.031413] ACPI: HPET id: 0x8086a201 base: 0xfed00000326worker2 # [ 0.002952] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]327lb # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs328worker1 # [ 0.003114] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]329client # [ 0.031417] TSC deadline timer available330worker1 # [ 0.005267] Zone ranges:331lb # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT332worker2 # [ 0.002953] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]333client # [ 0.031421] CPU topo: Max. logical packages: 1334worker1 # [ 0.005268] DMA [mem 0x0000000000001000-0x0000000000ffffff]335client # [ 0.031421] CPU topo: Max. logical dies: 1336lb # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f]337worker2 # [ 0.002953] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]338lb # [ 0.002734] Using GB pages for direct mapping339client # [ 0.031422] CPU topo: Max. dies per package: 1340worker2 # [ 0.003196] No NUMA configuration found341worker1 # [ 0.005270] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]342worker1 # [ 0.005271] Normal empty343lb # [ 0.002829] RAMDISK: [mem 0x5e367000-0x5ffcffff]344client # [ 0.031425] CPU topo: Max. threads per core: 1345worker1 # [ 0.005271] Device empty346worker2 # [ 0.003197] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]347client # [ 0.031425] CPU topo: Num. cores per package: 1348worker1 # [ 0.005272] Movable zone start for each node349lb # [ 0.002838] ACPI: Early table checksum verification disabled350worker2 # [ 0.003200] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]351worker1 # [ 0.005273] Early memory node ranges352client # [ 0.031426] CPU topo: Num. threads per package: 1353lb # [ 0.002841] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )354worker2 # [ 0.005360] Zone ranges:355worker1 # [ 0.005273] node 0: [mem 0x0000000000001000-0x000000000009efff]356client # [ 0.031426] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs357worker2 # [ 0.005361] DMA [mem 0x0000000000001000-0x0000000000ffffff]358lb # [ 0.002845] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)359worker1 # [ 0.005274] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]360client # [ 0.031442] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()361worker2 # [ 0.005363] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]362worker2 # [ 0.005364] Normal empty363worker1 # [ 0.005276] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]364worker2 # [ 0.005365] Device empty365lb # [ 0.002850] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)366client # [ 0.031471] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]367worker2 # [ 0.005366] Movable zone start for each node368worker1 # [ 0.005297] On node 0, zone DMA: 1 pages in unavailable ranges369lb # [ 0.002858] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)370worker2 # [ 0.005366] Early memory node ranges371client # [ 0.031473] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]372worker1 # [ 0.005546] On node 0, zone DMA: 97 pages in unavailable ranges373lb # [ 0.002860] ACPI: FACS 0x000000005FFE0000 000040374worker2 # [ 0.005367] node 0: [mem 0x0000000000001000-0x000000000009efff]375client # [ 0.031474] [mem 0x60000000-0xafffffff] available for PCI devices376worker1 # [ 0.030780] On node 0, zone DMA32: 40 pages in unavailable ranges377client # [ 0.031475] Booting paravirtualized kernel on KVM378worker2 # [ 0.005368] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]379lb # [ 0.002861] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)380worker1 # [ 0.031256] ACPI: PM-Timer IO Port: 0x608381worker2 # [ 0.005369] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]382worker1 # [ 0.031272] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])383lb # [ 0.002863] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)384client # [ 0.031477] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns385worker2 # [ 0.005389] On node 0, zone DMA: 1 pages in unavailable ranges386worker1 # [ 0.031306] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23387worker2 # [ 0.005641] On node 0, zone DMA: 97 pages in unavailable ranges388client # [ 0.035923] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1389lb # [ 0.002864] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)390worker1 # [ 0.031309] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)391worker2 # [ 0.030729] On node 0, zone DMA32: 40 pages in unavailable ranges392client # [ 0.037986] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152393worker1 # [ 0.031310] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)394lb # [ 0.002866] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)395worker2 # [ 0.031198] ACPI: PM-Timer IO Port: 0x608396client # [ 0.038030] kvm-guest: PV spinlocks disabled, single CPU397worker2 # [ 0.031212] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])398lb # [ 0.002867] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]399worker1 # [ 0.031312] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)400worker2 # [ 0.031240] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23401lb # [ 0.002868] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]402worker1 # [ 0.031313] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)403worker1 # [ 0.031313] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)404worker2 # [ 0.031243] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)405lb # [ 0.002869] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]406worker2 # [ 0.031244] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)407worker1 # [ 0.031316] ACPI: Using ACPI (MADT) for SMP configuration information408lb # [ 0.002869] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]409worker2 # [ 0.031245] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)410worker1 # [ 0.031317] ACPI: HPET id: 0x8086a201 base: 0xfed00000411client # [ 0.038031] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test/init regInfo=/nix/store/9p1idx4s91wv7zwkal5pb5lr899hddrn-closure-info/registration console=ttyS0,115200n8 console=tty0412lb # [ 0.002870] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]413worker1 # [ 0.031321] TSC deadline timer available414worker2 # [ 0.031246] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)415worker1 # [ 0.031326] CPU topo: Max. logical packages: 1416lb # [ 0.002870] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]417worker1 # [ 0.031327] CPU topo: Max. logical dies: 1418worker2 # [ 0.031247] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)419client # [ 0.038120] Unknown kernel command line parameters "regInfo=/nix/store/9p1idx4s91wv7zwkal5pb5lr899hddrn-closure-info/registration", will be passed to user space.420lb # [ 0.002871] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]421worker1 # [ 0.031327] CPU topo: Max. dies per package: 1422lb # [ 0.003100] No NUMA configuration found423client # [ 0.038132] random: crng init done424worker2 # [ 0.031250] ACPI: Using ACPI (MADT) for SMP configuration information425worker1 # [ 0.031330] CPU topo: Max. threads per core: 1426worker2 # [ 0.031251] ACPI: HPET id: 0x8086a201 base: 0xfed00000427lb # [ 0.003101] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]428worker1 # [ 0.031331] CPU topo: Num. cores per package: 1429client # [ 0.038132] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes430worker2 # [ 0.031255] TSC deadline timer available431worker1 # [ 0.031331] CPU topo: Num. threads per package: 1432lb # [ 0.003104] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]433worker2 # [ 0.031259] CPU topo: Max. logical packages: 1434client # [ 0.040176] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)435lb # [ 0.005250] Zone ranges:436worker1 # [ 0.031332] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs437worker2 # [ 0.031260] CPU topo: Max. logical dies: 1438lb # [ 0.005252] DMA [mem 0x0000000000001000-0x0000000000ffffff]439client # [ 0.041203] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)440worker2 # [ 0.031260] CPU topo: Max. dies per package: 1441worker1 # [ 0.031353] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()442client # [ 0.041232] Fallback order for Node 0: 0443worker2 # [ 0.031263] CPU topo: Max. threads per core: 1444lb # [ 0.005253] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]445lb # [ 0.005254] Normal empty446worker1 # [ 0.031388] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]447worker2 # [ 0.031264] CPU topo: Num. cores per package: 1448client # [ 0.041234] Built 1 zonelists, mobility grouping on. Total pages: 393078449lb # [ 0.005255] Device empty450client # [ 0.041235] Policy zone: DMA32451worker2 # [ 0.031264] CPU topo: Num. threads per package: 1452lb # [ 0.005255] Movable zone start for each node453worker1 # [ 0.031390] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]454lb # [ 0.005256] Early memory node ranges455worker2 # [ 0.031265] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs456client # [ 0.043812] mem auto-init: stack:all(zero), heap alloc:on, heap free:off457worker1 # [ 0.031391] [mem 0x60000000-0xafffffff] available for PCI devices458lb # [ 0.005257] node 0: [mem 0x0000000000001000-0x000000000009efff]459client # [ 0.046825] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1460worker1 # [ 0.031393] Booting paravirtualized kernel on KVM461worker2 # [ 0.031287] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()462lb # [ 0.005258] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]463client # [ 0.049980] allocated 3145728 bytes of page_ext464worker2 # [ 0.031327] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]465client # [ 0.059746] ftrace: allocating 48731 entries in 192 pages466lb # [ 0.005259] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]467worker1 # [ 0.031397] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns468worker2 # [ 0.031328] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]469client # [ 0.059748] ftrace: allocated 192 pages with 2 groups470lb # [ 0.005278] On node 0, zone DMA: 1 pages in unavailable ranges471client # [ 0.060548] Dynamic Preempt: lazy472worker1 # [ 0.035839] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1473worker2 # [ 0.031330] [mem 0x60000000-0xafffffff] available for PCI devices474lb # [ 0.005526] On node 0, zone DMA: 97 pages in unavailable ranges475client # [ 0.060678] rcu: Preemptible hierarchical RCU implementation.476worker2 # [ 0.031331] Booting paravirtualized kernel on KVM477worker1 # [ 0.037900] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152478lb # [ 0.030591] On node 0, zone DMA32: 40 pages in unavailable ranges479client # [ 0.060678] rcu: RCU event tracing is enabled.480worker1 # [ 0.037948] kvm-guest: PV spinlocks disabled, single CPU481lb # [ 0.031073] ACPI: PM-Timer IO Port: 0x608482client # [ 0.060679] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.483worker2 # [ 0.031335] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns484lb # [ 0.031087] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])485client # [ 0.060680] Trampoline variant of Tasks RCU enabled.486worker2 # [ 0.035769] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1487lb # [ 0.031116] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23488client # [ 0.060680] Rude variant of Tasks RCU enabled.489worker2 # [ 0.037822] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152490client # [ 0.060680] Tracing variant of Tasks RCU enabled.491lb # [ 0.031118] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)492worker2 # [ 0.037870] kvm-guest: PV spinlocks disabled, single CPU493lb # [ 0.031120] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)494client # [ 0.060681] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.495worker1 # [ 0.037950] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hvv0rrwgpqzhm46a4280mwzmbapcmqq9-nixos-system-worker1-test/init regInfo=/nix/store/vhr1b62dfjs04ywz0rz399x3gf2shwsl-closure-info/registration console=ttyS0,115200n8 console=tty0496client # [ 0.060682] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1497lb # [ 0.031121] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)498lb # [ 0.031122] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)499client # [ 0.060702] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.500worker1 # [ 0.038044] Unknown kernel command line parameters "regInfo=/nix/store/vhr1b62dfjs04ywz0rz399x3gf2shwsl-closure-info/registration", will be passed to user space.501lb # [ 0.031123] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)502worker1 # [ 0.038057] random: crng init done503client # [ 0.060704] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.504lb # [ 0.031125] ACPI: Using ACPI (MADT) for SMP configuration information505worker2 # [ 0.037872] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x5qgax5h37ybfdjp7r7k01yx9abl6wij-nixos-system-worker2-test/init regInfo=/nix/store/dq71v172s5jppb7nnfi3vkq85w35rkbj-closure-info/registration console=ttyS0,115200n8 console=tty0506worker1 # [ 0.038058] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes507lb # [ 0.031127] ACPI: HPET id: 0x8086a201 base: 0xfed00000508client # [ 0.060704] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.509lb # [ 0.031131] TSC deadline timer available510worker1 # [ 0.040091] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)511client # [ 0.065071] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16512lb # [ 0.031136] CPU topo: Max. logical packages: 1513worker2 # [ 0.037968] Unknown kernel command line parameters "regInfo=/nix/store/dq71v172s5jppb7nnfi3vkq85w35rkbj-closure-info/registration", will be passed to user space.514worker1 # [ 0.041257] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)515worker2 # [ 0.037981] random: crng init done516lb # [ 0.031136] CPU topo: Max. logical dies: 1517client # [ 0.065338] rcu: srcu_init: Setting srcu_struct sizes based on contention.518worker1 # [ 0.041290] Fallback order for Node 0: 0519lb # [ 0.031137] CPU topo: Max. dies per package: 1520worker2 # [ 0.037982] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes521lb # [ 0.031140] CPU topo: Max. threads per core: 1522client # [ 0.065346] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns523worker1 # [ 0.041293] Built 1 zonelists, mobility grouping on. Total pages: 393078524lb # [ 0.031141] CPU topo: Num. cores per package: 1525worker1 # [ 0.041294] Policy zone: DMA32526worker2 # [ 0.039991] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)527lb # [ 0.031141] CPU topo: Num. threads per package: 1528client # [ 0.065448] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)529worker1 # [ 0.043681] mem auto-init: stack:all(zero), heap alloc:on, heap free:off530worker2 # [ 0.041147] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)531lb # [ 0.031141] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs532client # [ 0.068968] Console: colour VGA+ 80x25533worker2 # [ 0.041178] Fallback order for Node 0: 0534worker1 # [ 0.046814] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1535client # [ 0.068970] printk: legacy console [tty0] enabled536lb # [ 0.031165] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()537worker1 # [ 0.049990] allocated 3145728 bytes of page_ext538worker2 # [ 0.041181] Built 1 zonelists, mobility grouping on. Total pages: 393078539client # [ 0.098355] printk: legacy console [ttyS0] enabled540worker2 # [ 0.041182] Policy zone: DMA32541worker1 # [ 0.059925] ftrace: allocating 48731 entries in 192 pages542lb # [ 0.031201] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]543client # [ 0.195739] ACPI: Core revision 20250807544worker1 # [ 0.059927] ftrace: allocated 192 pages with 2 groups545worker2 # [ 0.043555] mem auto-init: stack:all(zero), heap alloc:on, heap free:off546worker1 # [ 0.060755] Dynamic Preempt: lazy547lb # [ 0.031203] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]548worker2 # [ 0.046682] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1549worker1 # [ 0.060920] rcu: Preemptible hierarchical RCU implementation.550lb # [ 0.031204] [mem 0x60000000-0xafffffff] available for PCI devices551worker2 # [ 0.049824] allocated 3145728 bytes of page_ext552client # [ 0.196594] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns553worker1 # [ 0.060921] rcu: RCU event tracing is enabled.554lb # [ 0.031206] Booting paravirtualized kernel on KVM555worker2 # [ 0.059709] ftrace: allocating 48731 entries in 192 pages556client # [ 0.198104] APIC: Switch to symmetric I/O mode setup557worker1 # [ 0.060921] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.558worker2 # [ 0.059711] ftrace: allocated 192 pages with 2 groups559client # [ 0.199042] x2apic enabled560lb # [ 0.031210] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns561worker2 # [ 0.060606] Dynamic Preempt: lazy562worker1 # [ 0.060923] Trampoline variant of Tasks RCU enabled.563worker1 # [ 0.060923] Rude variant of Tasks RCU enabled.564worker2 # [ 0.060747] rcu: Preemptible hierarchical RCU implementation.565lb # [ 0.035644] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1566client # [ 0.199783] APIC: Switched APIC routing to: physical x2apic567worker2 # [ 0.060748] rcu: RCU event tracing is enabled.568worker1 # [ 0.060924] Tracing variant of Tasks RCU enabled.569lb # [ 0.037697] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152570worker2 # [ 0.060749] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.571worker1 # [ 0.060924] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.572lb # [ 0.037739] kvm-guest: PV spinlocks disabled, single CPU573worker2 # [ 0.060750] Trampoline variant of Tasks RCU enabled.574worker1 # [ 0.060925] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1575client # [ 0.201568] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1576worker2 # [ 0.060751] Rude variant of Tasks RCU enabled.577worker2 # [ 0.060751] Tracing variant of Tasks RCU enabled.578worker1 # [ 0.060935] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.579worker2 # [ 0.060752] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.580client # [ 0.202530] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns581worker1 # [ 0.060936] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.582worker2 # [ 0.060753] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1583lb # [ 0.037740] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0584worker1 # [ 0.060937] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.585client # [ 0.204199] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)586worker2 # [ 0.060806] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.587worker1 # [ 0.065413] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16588client # [ 0.205293] x86/cpu: User Mode Instruction Prevention (UMIP) activated589worker2 # [ 0.060808] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.590worker1 # [ 0.065701] rcu: srcu_init: Setting srcu_struct sizes based on contention.591lb # [ 0.037845] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.592lb # [ 0.037857] random: crng init done593client # [ 0.206342] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127594worker2 # [ 0.060809] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.595worker1 # [ 0.065709] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns596lb # [ 0.037858] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes597worker2 # [ 0.065305] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16598client # [ 0.207196] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0599worker1 # [ 0.065816] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)600lb # [ 0.039891] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)601worker2 # [ 0.065599] rcu: srcu_init: Setting srcu_struct sizes based on contention.602worker1 # [ 0.069359] Console: colour VGA+ 80x25603lb # [ 0.041042] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)604worker1 # [ 0.069362] printk: legacy console [tty0] enabled605client # [ 0.208199] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto606worker2 # [ 0.065607] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns607lb # [ 0.041074] Fallback order for Node 0: 0608worker1 # [ 0.098784] printk: legacy console [ttyS0] enabled609lb # [ 0.041077] Built 1 zonelists, mobility grouping on. Total pages: 393078610worker1 # [ 0.194984] ACPI: Core revision 20250807611worker2 # [ 0.065714] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)612client # [ 0.210197] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl613lb # [ 0.041078] Policy zone: DMA32614worker2 # [ 0.069261] Console: colour VGA+ 80x25615lb # [ 0.043451] mem auto-init: stack:all(zero), heap alloc:on, heap free:off616worker2 # [ 0.069264] printk: legacy console [tty0] enabled617client # [ 0.211196] Transient Scheduler Attacks: Vulnerable: No microcode618worker2 # [ 0.098668] printk: legacy console [ttyS0] enabled619lb # [ 0.046611] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1620worker1 # [ 0.195856] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns621client # [ 0.212196] Spectre V2 : Mitigation: Enhanced / Automatic IBRS622lb # [ 0.049748] allocated 3145728 bytes of page_ext623worker2 # [ 0.192949] ACPI: Core revision 20250807624worker1 # [ 0.197345] APIC: Switch to symmetric I/O mode setup625lb # [ 0.059561] ftrace: allocating 48731 entries in 192 pages626client # [ 0.213196] Speculative Return Stack Overflow: Mitigation: Safe RET627worker1 # [ 0.198326] x2apic enabled628lb # [ 0.059563] ftrace: allocated 192 pages with 2 groups629lb # [ 0.060368] Dynamic Preempt: lazy630worker2 # [ 0.193837] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns631worker1 # [ 0.199105] APIC: Switched APIC routing to: physical x2apic632lb # [ 0.060491] rcu: Preemptible hierarchical RCU implementation.633worker2 # [ 0.195338] APIC: Switch to symmetric I/O mode setup634lb # [ 0.060492] rcu: RCU event tracing is enabled.635worker2 # [ 0.196310] x2apic enabled636lb # [ 0.060493] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.637worker1 # [ 0.200939] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1638lb # [ 0.060494] Trampoline variant of Tasks RCU enabled.639worker2 # [ 0.197089] APIC: Switched APIC routing to: physical x2apic640client # [ 0.214196] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization641lb # [ 0.060494] Rude variant of Tasks RCU enabled.642lb # [ 0.060495] Tracing variant of Tasks RCU enabled.643client # [ 0.216209] Spectre V2 : Enabling IBPB for BPF644worker1 # [ 0.201922] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns645lb # [ 0.060496] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.646worker2 # [ 0.198872] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1647client # [ 0.217197] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier648worker1 # [ 0.203578] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)649lb # [ 0.060496] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1650client # [ 0.218196] active return thunk: srso_alias_return_thunk651worker2 # [ 0.199832] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns652worker1 # [ 0.204663] x86/cpu: User Mode Instruction Prevention (UMIP) activated653lb # [ 0.060518] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.654client # [ 0.219218] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'655worker1 # [ 0.205690] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127656lb # [ 0.060520] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.657worker2 # [ 0.201455] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)658client # [ 0.220196] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'659worker1 # [ 0.206576] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0660lb # [ 0.060521] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.661worker2 # [ 0.202540] x86/cpu: User Mode Instruction Prevention (UMIP) activated662lb # [ 0.064988] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16663client # [ 0.221196] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'664worker2 # [ 0.203570] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127665lb # [ 0.065289] rcu: srcu_init: Setting srcu_struct sizes based on contention.666worker1 # [ 0.207579] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto667client # [ 0.222196] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'668worker2 # [ 0.204453] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0669lb # [ 0.065295] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns670client # [ 0.223196] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'671worker1 # [ 0.209575] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl672worker2 # [ 0.205456] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto673client # [ 0.224196] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'674worker1 # [ 0.210576] Transient Scheduler Attacks: Vulnerable: No microcode675lb # [ 0.065395] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)676lb # [ 0.068928] Console: colour VGA+ 80x25677worker1 # [ 0.211575] Spectre V2 : Mitigation: Enhanced / Automatic IBRS678lb # [ 0.068932] printk: legacy console [tty0] enabled679client # [ 0.225195] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'680worker2 # [ 0.206453] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl681lb # [ 0.098252] printk: legacy console [ttyS0] enabled682worker1 # [ 0.212575] Speculative Return Stack Overflow: Mitigation: Safe RET683client # [ 0.227077] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256684worker2 # [ 0.207453] Transient Scheduler Attacks: Vulnerable: No microcode685lb # [ 0.193609] ACPI: Core revision 20250807686client # [ 0.227912] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64687worker2 # [ 0.208453] Spectre V2 : Mitigation: Enhanced / Automatic IBRS688lb # [ 0.194445] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns689client # [ 0.228933] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512690worker2 # [ 0.209453] Speculative Return Stack Overflow: Mitigation: Safe RET691lb # [ 0.196030] APIC: Switch to symmetric I/O mode setup692client # [ 0.229924] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024693lb # [ 0.196990] x2apic enabled694worker1 # [ 0.213575] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization695client # [ 0.230938] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8696lb # [ 0.197767] APIC: Switched APIC routing to: physical x2apic697worker1 # [ 0.215583] Spectre V2 : Enabling IBPB for BPF698client # [ 0.231896] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.699worker1 # [ 0.216576] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier700worker2 # [ 0.210452] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization701lb # [ 0.199556] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1702worker2 # [ 0.212460] Spectre V2 : Enabling IBPB for BPF703worker1 # [ 0.217576] active return thunk: srso_alias_return_thunk704worker1 # [ 0.218596] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'705lb # [ 0.200523] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns706worker2 # [ 0.213169] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier707worker2 # [ 0.214453] active return thunk: srso_alias_return_thunk708worker1 # [ 0.219575] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'709lb # [ 0.202186] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)710worker1 # [ 0.220575] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'711worker2 # [ 0.215474] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'712lb # [ 0.203267] x86/cpu: User Mode Instruction Prevention (UMIP) activated713worker1 # [ 0.221576] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'714worker2 # [ 0.216453] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'715lb # [ 0.204318] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127716worker1 # [ 0.222575] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'717worker2 # [ 0.217452] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'718lb # [ 0.205183] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0719worker1 # [ 0.223575] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'720worker2 # [ 0.218452] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'721worker2 # [ 0.219452] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'722lb # [ 0.206187] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto723worker1 # [ 0.224575] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'724worker2 # [ 0.220452] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'725worker1 # [ 0.226499] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256726lb # [ 0.208183] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl727worker1 # [ 0.227321] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64728worker2 # [ 0.221452] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'729lb # [ 0.209183] Transient Scheduler Attacks: Vulnerable: No microcode730worker1 # [ 0.228314] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512731worker2 # [ 0.222453] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256732lb # [ 0.210183] Spectre V2 : Mitigation: Enhanced / Automatic IBRS733worker1 # [ 0.229320] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024734worker2 # [ 0.224172] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64735lb # [ 0.211183] Speculative Return Stack Overflow: Mitigation: Safe RET736worker1 # [ 0.230317] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8737worker2 # [ 0.224452] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512738worker2 # [ 0.225452] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024739worker1 # [ 0.231332] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.740worker2 # [ 0.226452] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8741lb # [ 0.212183] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization742worker2 # [ 0.227453] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.743lb # [ 0.214190] Spectre V2 : Enabling IBPB for BPF744lb # [ 0.215184] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745lb # [ 0.216183] active return thunk: srso_alias_return_thunk746lb # [ 0.217204] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747lb # [ 0.218183] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748lb # [ 0.220183] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749lb # [ 0.221183] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750lb # [ 0.222183] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751lb # [ 0.223183] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752lb # [ 0.224183] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753lb # [ 0.225183] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754lb # [ 0.226183] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755lb # [ 0.227183] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756lb # [ 0.228183] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757lb # [ 0.229183] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758client # [ 0.266447] Freeing SMP alternatives memory: 44K759client # [ 0.267198] pid_max: default: 32768 minimum: 301760lb # [ 0.230183] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.761client # [ 0.268052] LSM: initializing lsm=capability,landlock,yama,bpf,ima762client # [ 0.269239] landlock: Up and running.763client # [ 0.269879] Yama: becoming mindful.764client # [ 0.270418] LSM support for eBPF active765client # [ 0.271310] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766client # [ 0.272236] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767client # [ 0.275266] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768client # [ 0.276768] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769client # [ 0.277205] ... version: 2770client # [ 0.277919] ... bit width: 48771client # [ 0.278198] ... generic counters: 6772client # [ 0.278922] ... generic bitmap: 000000000000003f773client # [ 0.279198] ... fixed-purpose counters: 0774worker1 # [ 0.266336] Freeing SMP alternatives memory: 44K775client # [ 0.279919] ... fixed-purpose bitmap: 0000000000000000776worker1 # [ 0.267166] pid_max: default: 32768 minimum: 301777client # [ 0.280199] ... value mask: 0000ffffffffffff778worker2 # [ 0.262275] Freeing SMP alternatives memory: 44K779worker1 # [ 0.267676] LSM: initializing lsm=capability,landlock,yama,bpf,ima780client # [ 0.281100] ... max period: 00007fffffffffff781worker2 # [ 0.263002] pid_max: default: 32768 minimum: 301782worker1 # [ 0.268686] landlock: Up and running.783client # [ 0.281869] ... global_ctrl mask: 000000000000003f784worker2 # [ 0.263543] LSM: initializing lsm=capability,landlock,yama,bpf,ima785worker1 # [ 0.269576] Yama: becoming mindful.786client # [ 0.282293] signal: max sigframe size: 3376787worker2 # [ 0.264555] landlock: Up and running.788worker1 # [ 0.270617] LSM support for eBPF active789client # [ 0.283075] rcu: Hierarchical SRCU implementation.790worker2 # [ 0.265453] Yama: becoming mindful.791client # [ 0.283794] rcu: Max phase no-delay instances is 400.792worker1 # [ 0.271373] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)793worker2 # [ 0.266491] LSM support for eBPF active794worker1 # [ 0.272604] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)795worker2 # [ 0.267205] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)796worker2 # [ 0.268470] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)797worker1 # [ 0.274896] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)798worker2 # [ 0.270726] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)799client # [ 0.288606] smp: Bringing up secondary CPUs ...800worker1 # [ 0.276134] Performance Events: Fam17h+ core perfctr, AMD PMU driver.801client # [ 0.289211] smp: Brought up 1 node, 1 CPU802worker1 # [ 0.276584] ... version: 2803worker2 # [ 0.272032] Performance Events: Fam17h+ core perfctr, AMD PMU driver.804worker1 # [ 0.277297] ... bit width: 48805client # [ 0.289915] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)806worker2 # [ 0.272462] ... version: 2807worker1 # [ 0.277578] ... generic counters: 6808worker2 # [ 0.273207] ... bit width: 48809worker1 # [ 0.278285] ... generic bitmap: 000000000000003f810worker2 # [ 0.273455] ... generic counters: 6811client # [ 0.290342] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)812worker1 # [ 0.278578] ... fixed-purpose counters: 0813worker2 # [ 0.274165] ... generic bitmap: 000000000000003f814client # [ 0.291451] devtmpfs: initialized815worker1 # [ 0.279284] ... fixed-purpose bitmap: 0000000000000000816worker2 # [ 0.274455] ... fixed-purpose counters: 0817worker1 # [ 0.279577] ... value mask: 0000ffffffffffff818client # [ 0.292308] x86/mm: Memory block size: 128MB819worker2 # [ 0.275191] ... fixed-purpose bitmap: 0000000000000000820worker1 # [ 0.280439] ... max period: 00007fffffffffff821worker2 # [ 0.275454] ... value mask: 0000ffffffffffff822worker1 # [ 0.281255] ... global_ctrl mask: 000000000000003f823client # [ 0.294019] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)824worker2 # [ 0.276372] ... max period: 00007fffffffffff825lb # [ 0.265386] Freeing SMP alternatives memory: 44K826worker1 # [ 0.281674] signal: max sigframe size: 3376827worker2 # [ 0.277102] ... global_ctrl mask: 000000000000003f828lb # [ 0.266143] pid_max: default: 32768 minimum: 301829worker1 # [ 0.282495] rcu: Hierarchical SRCU implementation.830client # [ 0.295110] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).831worker2 # [ 0.277563] signal: max sigframe size: 3376832worker1 # [ 0.283152] rcu: Max phase no-delay instances is 400.833lb # [ 0.266787] LSM: initializing lsm=capability,landlock,yama,bpf,ima834client # [ 0.296278] pinctrl core: initialized pinctrl subsystem835worker2 # [ 0.278320] rcu: Hierarchical SRCU implementation.836lb # [ 0.267283] landlock: Up and running.837lb # [ 0.268184] Yama: becoming mindful.838worker2 # [ 0.279059] rcu: Max phase no-delay instances is 400.839client # [ 0.297378] PM: RTC time: 09:04:24, date: 2026-09-20840lb # [ 0.269398] LSM support for eBPF active841lb # [ 0.270254] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)842client # [ 0.300786] NET: Registered PF_NETLINK/PF_ROUTE protocol family843lb # [ 0.271219] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)844worker1 # [ 0.288162] smp: Bringing up secondary CPUs ...845worker1 # [ 0.288592] smp: Brought up 1 node, 1 CPU846client # [ 0.301681] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations847worker2 # [ 0.283877] smp: Bringing up secondary CPUs ...848worker1 # [ 0.289274] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)849worker2 # [ 0.284470] smp: Brought up 1 node, 1 CPU850lb # [ 0.273869] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)851client # [ 0.302218] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations852worker2 # [ 0.285142] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)853lb # [ 0.274682] Performance Events: Fam17h+ core perfctr, AMD PMU driver.854client # [ 0.303464] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations855worker1 # [ 0.289800] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)856lb # [ 0.275188] ... version: 2857worker1 # [ 0.290830] devtmpfs: initialized858client # [ 0.304208] audit: initializing netlink subsys (disabled)859lb # [ 0.275870] ... bit width: 48860worker2 # [ 0.285654] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)861lb # [ 0.276186] ... generic counters: 6862worker1 # [ 0.291622] x86/mm: Memory block size: 128MB863client # [ 0.305335] thermal_sys: Registered thermal governor 'fair_share'864worker2 # [ 0.286691] devtmpfs: initialized865lb # [ 0.276866] ... generic bitmap: 000000000000003f866worker2 # [ 0.287431] x86/mm: Memory block size: 128MB867client # [ 0.305337] thermal_sys: Registered thermal governor 'bang_bang'868lb # [ 0.277230] ... fixed-purpose counters: 0869client # [ 0.306199] thermal_sys: Registered thermal governor 'step_wise'870worker1 # [ 0.293388] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)871lb # [ 0.277950] ... fixed-purpose bitmap: 0000000000000000872client # [ 0.307148] thermal_sys: Registered thermal governor 'user_space'873lb # [ 0.278185] ... value mask: 0000ffffffffffff874worker2 # [ 0.289084] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)875worker1 # [ 0.294481] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).876lb # [ 0.279052] ... max period: 00007fffffffffff877worker1 # [ 0.295665] pinctrl core: initialized pinctrl subsystem878client # [ 0.307942] audit: type=2000 audit(1789895065.133:1): state=initialized audit_enabled=0 res=1879worker2 # [ 0.289479] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).880lb # [ 0.279827] ... global_ctrl mask: 000000000000003f881worker1 # [ 0.296735] PM: RTC time: 09:04:24, date: 2026-09-20882client # [ 0.309201] thermal_sys: Registered thermal governor 'power_allocator'883lb # [ 0.280295] signal: max sigframe size: 3376884worker2 # [ 0.290538] pinctrl core: initialized pinctrl subsystem885client # [ 0.309227] cpuidle: using governor menu886lb # [ 0.281027] rcu: Hierarchical SRCU implementation.887worker2 # [ 0.291628] PM: RTC time: 09:04:24, date: 2026-09-20888lb # [ 0.281800] rcu: Max phase no-delay instances is 400.889client # [ 0.311432] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5890worker1 # [ 0.300165] NET: Registered PF_NETLINK/PF_ROUTE protocol family891client # [ 0.312434] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]892worker2 # [ 0.295042] NET: Registered PF_NETLINK/PF_ROUTE protocol family893client # [ 0.313201] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry894worker1 # [ 0.301043] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations895client # [ 0.314209] PCI: Using configuration type 1 for base access896worker1 # [ 0.301598] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations897worker2 # [ 0.295926] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations898lb # [ 0.286649] smp: Bringing up secondary CPUs ...899client # [ 0.315313] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.900worker2 # [ 0.296481] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations901lb # [ 0.287198] smp: Brought up 1 node, 1 CPU902worker1 # [ 0.302837] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations903worker1 # [ 0.303587] audit: initializing netlink subsys (disabled)904lb # [ 0.287901] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)905worker2 # [ 0.297714] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations906worker1 # [ 0.304694] thermal_sys: Registered thermal governor 'fair_share'907worker2 # [ 0.298464] audit: initializing netlink subsys (disabled)908worker1 # [ 0.304696] thermal_sys: Registered thermal governor 'bang_bang'909lb # [ 0.288351] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)910worker2 # [ 0.299594] thermal_sys: Registered thermal governor 'fair_share'911worker1 # [ 0.305579] thermal_sys: Registered thermal governor 'step_wise'912lb # [ 0.289439] devtmpfs: initialized913worker2 # [ 0.299597] thermal_sys: Registered thermal governor 'bang_bang'914worker1 # [ 0.306522] thermal_sys: Registered thermal governor 'user_space'915lb # [ 0.290180] x86/mm: Memory block size: 128MB916client # [ 0.320438] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages917worker2 # [ 0.300456] thermal_sys: Registered thermal governor 'step_wise'918client # [ 0.321200] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page919worker2 # [ 0.301389] thermal_sys: Registered thermal governor 'user_space'920worker1 # [ 0.307299] audit: type=2000 audit(1789895065.149:1): state=initialized audit_enabled=0 res=1921worker1 # [ 0.308581] thermal_sys: Registered thermal governor 'power_allocator'922lb # [ 0.292004] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)923worker2 # [ 0.302143] audit: type=2000 audit(1789895065.150:1): state=initialized audit_enabled=0 res=1924worker1 # [ 0.308595] cpuidle: using governor menu925worker2 # [ 0.303458] thermal_sys: Registered thermal governor 'power_allocator'926lb # [ 0.293101] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).927worker2 # [ 0.303472] cpuidle: using governor menu928worker1 # [ 0.310796] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5929lb # [ 0.294277] pinctrl core: initialized pinctrl subsystem930lb # [ 0.295432] PM: RTC time: 09:04:24, date: 2026-09-20931worker2 # [ 0.305671] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5932client # [ 0.326199] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages933worker1 # [ 0.311827] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]934client # [ 0.327198] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page935worker1 # [ 0.312581] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry936worker2 # [ 0.306686] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]937worker1 # [ 0.313590] PCI: Using configuration type 1 for base access938worker2 # [ 0.307458] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry939lb # [ 0.298767] NET: Registered PF_NETLINK/PF_ROUTE protocol family940worker2 # [ 0.308467] PCI: Using configuration type 1 for base access941worker1 # [ 0.314667] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.942lb # [ 0.299678] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations943worker2 # [ 0.309550] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.944lb # [ 0.300206] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations945lb # [ 0.301455] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations946lb # [ 0.302195] audit: initializing netlink subsys (disabled)947worker1 # [ 0.319832] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages948worker1 # [ 0.320580] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page949lb # [ 0.303188] audit: type=2000 audit(1789895065.169:1): state=initialized audit_enabled=0 res=1950worker2 # [ 0.314720] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages951client # [ 0.337528] ACPI: Added _OSI(Module Device)952lb # [ 0.304349] thermal_sys: Registered thermal governor 'fair_share'953worker2 # [ 0.315456] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page954client # [ 0.338200] ACPI: Added _OSI(Processor Device)955lb # [ 0.304351] thermal_sys: Registered thermal governor 'bang_bang'956client # [ 0.338940] ACPI: Added _OSI(Processor Aggregator Device)957lb # [ 0.305186] thermal_sys: Registered thermal governor 'step_wise'958lb # [ 0.306162] thermal_sys: Registered thermal governor 'user_space'959worker1 # [ 0.325579] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages960lb # [ 0.306945] thermal_sys: Registered thermal governor 'power_allocator'961worker1 # [ 0.326578] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page962lb # [ 0.307197] cpuidle: using governor menu963worker2 # [ 0.320456] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages964worker2 # [ 0.321455] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page965lb # [ 0.309404] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5966lb # [ 0.310418] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]967lb # [ 0.311188] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry968lb # [ 0.312197] PCI: Using configuration type 1 for base access969client # [ 0.347689] ACPI: 1 ACPI AML tables successfully acquired and loaded970lb # [ 0.313336] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.971worker1 # [ 0.336983] ACPI: Added _OSI(Module Device)972client # [ 0.351562] ACPI: Interpreter enabled973worker1 # [ 0.337580] ACPI: Added _OSI(Processor Device)974client # [ 0.352220] ACPI: PM: (supports S0 S3 S4 S5)975worker1 # [ 0.338317] ACPI: Added _OSI(Processor Aggregator Device)976client # [ 0.352940] ACPI: Using IOAPIC for interrupt routing977worker2 # [ 0.331860] ACPI: Added _OSI(Module Device)978worker2 # [ 0.332457] ACPI: Added _OSI(Processor Device)979client # [ 0.353261] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug980worker2 # [ 0.333231] ACPI: Added _OSI(Processor Aggregator Device)981lb # [ 0.320218] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages982client # [ 0.354200] PCI: Using E820 reservations for host bridge windows983lb # [ 0.321186] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page984client # [ 0.357314] ACPI: Enabled 2 GPEs in block 00 to 3F985lb # [ 0.326187] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages986worker1 # [ 0.347137] ACPI: 1 ACPI AML tables successfully acquired and loaded987lb # [ 0.327186] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page988worker2 # [ 0.341978] ACPI: 1 ACPI AML tables successfully acquired and loaded989worker1 # [ 0.350986] ACPI: Interpreter enabled990client # [ 0.365909] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])991worker1 # [ 0.351594] ACPI: PM: (supports S0 S3 S4 S5)992worker1 # [ 0.352302] ACPI: Using IOAPIC for interrupt routing993worker2 # [ 0.345892] ACPI: Interpreter enabled994client # [ 0.366205] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]995worker2 # [ 0.346471] ACPI: PM: (supports S0 S3 S4 S5)996worker1 # [ 0.352623] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug997worker2 # [ 0.347167] ACPI: Using IOAPIC for interrupt routing998client # [ 0.367668] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]999worker1 # [ 0.353578] PCI: Using E820 reservations for host bridge windows1000worker2 # [ 0.347522] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1001client # [ 0.368331] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1002worker2 # [ 0.348456] PCI: Using E820 reservations for host bridge windows1003client # [ 0.369560] PCI host bridge to bus 0000:001004lb # [ 0.337557] ACPI: Added _OSI(Module Device)1005lb # [ 0.338187] ACPI: Added _OSI(Processor Device)1006worker1 # [ 0.356672] ACPI: Enabled 2 GPEs in block 00 to 3F1007client # [ 0.370202] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1008lb # [ 0.338898] ACPI: Added _OSI(Processor Aggregator Device)1009client # [ 0.371198] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1010worker2 # [ 0.351581] ACPI: Enabled 2 GPEs in block 00 to 3F1011client # [ 0.372198] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1012client # [ 0.373199] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1013client # [ 0.374198] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1014client # [ 0.375198] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1015client # [ 0.376198] pci_bus 0000:00: root bus resource [bus 00-ff]1016client # [ 0.377191] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1017worker1 # [ 0.365235] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1018lb # [ 0.346699] ACPI: 1 ACPI AML tables successfully acquired and loaded1019worker1 # [ 0.365584] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1020client # [ 0.378631] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1021worker2 # [ 0.360234] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1022worker1 # [ 0.366885] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1023worker2 # [ 0.361200] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1024worker1 # [ 0.367709] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1025lb # [ 0.350586] ACPI: Interpreter enabled1026worker2 # [ 0.362870] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1027worker1 # [ 0.368931] PCI host bridge to bus 0000:001028lb # [ 0.351201] ACPI: PM: (supports S0 S3 S4 S5)1029lb # [ 0.351913] ACPI: Using IOAPIC for interrupt routing1030worker2 # [ 0.363585] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1031worker1 # [ 0.369582] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1032worker2 # [ 0.364824] PCI host bridge to bus 0000:001033worker1 # [ 0.370578] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1034lb # [ 0.352231] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1035worker2 # [ 0.365459] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1036client # [ 0.381232] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1037worker1 # [ 0.371578] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1038lb # [ 0.353186] PCI: Using E820 reservations for host bridge windows1039client # [ 0.382211] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1040worker2 # [ 0.366455] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1041worker1 # [ 0.372578] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1042client # [ 0.383135] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1043worker2 # [ 0.367455] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1044worker1 # [ 0.373578] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1045lb # [ 0.356252] ACPI: Enabled 2 GPEs in block 00 to 3F1046worker2 # [ 0.368455] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1047client # [ 0.384166] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1048worker1 # [ 0.374578] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1049worker1 # [ 0.375578] pci_bus 0000:00: root bus resource [bus 00-ff]1050worker2 # [ 0.369455] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1051client # [ 0.386271] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1052worker2 # [ 0.370455] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1053worker1 # [ 0.376536] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1054worker2 # [ 0.371465] pci_bus 0000:00: root bus resource [bus 00-ff]1055worker1 # [ 0.377995] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1056worker2 # [ 0.372510] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1057client # [ 0.388234] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1058client # [ 0.389099] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1059worker2 # [ 0.373938] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1060client # [ 0.389985] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1061lb # [ 0.364523] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1062client # [ 0.391076] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1063lb # [ 0.365193] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1064client # [ 0.392517] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1065lb # [ 0.366264] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1066worker1 # [ 0.380647] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1067lb # [ 0.367314] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1068worker1 # [ 0.381590] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1069client # [ 0.395205] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1070lb # [ 0.368549] PCI host bridge to bus 0000:001071worker1 # [ 0.382561] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1072worker2 # [ 0.376510] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1073client # [ 0.396043] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1074lb # [ 0.369190] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1075worker2 # [ 0.377467] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1076client # [ 0.396937] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1077lb # [ 0.370186] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1078worker1 # [ 0.383564] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1079worker2 # [ 0.378426] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1080lb # [ 0.371186] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1081client # [ 0.397778] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1082worker2 # [ 0.379658] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1083worker1 # [ 0.385521] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1084lb # [ 0.372186] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1085lb # [ 0.373185] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1086client # [ 0.399231] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1087worker2 # [ 0.381435] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1088lb # [ 0.374185] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1089worker1 # [ 0.387588] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1090client # [ 0.400088] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1091lb # [ 0.375186] pci_bus 0000:00: root bus resource [bus 00-ff]1092worker1 # [ 0.388439] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1093client # [ 0.401012] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1094lb # [ 0.376122] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1095worker1 # [ 0.389325] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1096worker2 # [ 0.384527] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1097worker1 # [ 0.389585] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1098worker2 # [ 0.385347] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1099client # [ 0.402758] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1100lb # [ 0.377611] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1101worker2 # [ 0.386155] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1102worker1 # [ 0.391126] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1103worker2 # [ 0.386461] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1104client # [ 0.404206] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1105client # [ 0.405053] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1106worker2 # [ 0.388036] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1107client # [ 0.405999] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1108worker1 # [ 0.392585] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1109worker1 # [ 0.393429] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1110client # [ 0.407608] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1111worker1 # [ 0.394341] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1112lb # [ 0.380241] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1113worker2 # [ 0.390491] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1114lb # [ 0.381198] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1115worker2 # [ 0.391393] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1116worker1 # [ 0.395138] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117lb # [ 0.382150] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1118worker2 # [ 0.392203] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1119client # [ 0.409233] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1120client # [ 0.410205] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1121lb # [ 0.383266] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1122worker2 # [ 0.393039] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1123worker1 # [ 0.397597] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1124client # [ 0.411177] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1125lb # [ 0.385294] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1126worker1 # [ 0.398426] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1127client # [ 0.412617] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1128worker1 # [ 0.399600] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1129worker2 # [ 0.395488] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1130client # [ 0.414233] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1131lb # [ 0.388220] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1132worker1 # [ 0.401145] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133worker2 # [ 0.396462] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1134client # [ 0.415108] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1135lb # [ 0.389036] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1136worker2 # [ 0.397413] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1137client # [ 0.415917] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1138lb # [ 0.389921] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1139worker1 # [ 0.402597] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1140lb # [ 0.390192] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1141worker2 # [ 0.398867] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1142worker1 # [ 0.403448] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1143client # [ 0.416793] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1144worker1 # [ 0.404328] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1145lb # [ 0.391705] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1146client # [ 0.418206] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1147worker2 # [ 0.401247] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1148client # [ 0.419098] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1149worker2 # [ 0.402134] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1150worker1 # [ 0.405141] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1151client # [ 0.419971] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1152worker2 # [ 0.402477] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1153lb # [ 0.394193] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1154client # [ 0.421068] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1155lb # [ 0.395041] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1156worker1 # [ 0.406597] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1157lb # [ 0.395917] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1158worker1 # [ 0.407463] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1159client # [ 0.422523] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1160worker2 # [ 0.404010] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1161worker1 # [ 0.408305] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1162lb # [ 0.396755] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1163client # [ 0.424211] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1164worker1 # [ 0.409178] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1165worker2 # [ 0.406294] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1166client # [ 0.425221] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1167worker2 # [ 0.407126] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1168lb # [ 0.399093] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1169worker2 # [ 0.407477] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1170client # [ 0.426753] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1171lb # [ 0.399846] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1172worker1 # [ 0.411567] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1173worker2 # [ 0.409013] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1174lb # [ 0.400207] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1175client # [ 0.428250] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1176worker1 # [ 0.412215] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1177client # [ 0.429116] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1178worker1 # [ 0.412601] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1179lb # [ 0.401737] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1180client # [ 0.429969] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1181worker1 # [ 0.414118] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1182worker2 # [ 0.411490] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1183client # [ 0.431602] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1184worker2 # [ 0.412462] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1185lb # [ 0.404065] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1186worker1 # [ 0.415588] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1187lb # [ 0.404863] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1188worker2 # [ 0.413446] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1189worker1 # [ 0.416449] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1190lb # [ 0.405207] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1191client # [ 0.433233] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1192worker1 # [ 0.417335] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1193worker2 # [ 0.414888] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1194client # [ 0.434206] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1195worker1 # [ 0.417585] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1196lb # [ 0.406798] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1197client # [ 0.435170] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1198worker2 # [ 0.417268] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1199client # [ 0.436612] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1200worker1 # [ 0.419084] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1201worker2 # [ 0.418082] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1202lb # [ 0.409226] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1203worker2 # [ 0.418476] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1204client # [ 0.437718] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1205worker1 # [ 0.420602] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1206lb # [ 0.410077] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1207worker2 # [ 0.419461] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1208client # [ 0.438397] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1209worker1 # [ 0.421545] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1210lb # [ 0.410937] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1211client # [ 0.439747] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1212worker1 # [ 0.422946] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1213worker2 # [ 0.421791] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1214lb # [ 0.411826] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1215worker2 # [ 0.423468] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1216worker1 # [ 0.425225] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1217lb # [ 0.414014] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1218worker1 # [ 0.425586] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1219worker2 # [ 0.424510] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1220lb # [ 0.414848] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1221worker1 # [ 0.426551] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1222worker2 # [ 0.425981] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1223lb # [ 0.415208] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1224worker1 # [ 0.428472] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1225lb # [ 0.416725] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1226worker2 # [ 0.427463] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1227worker1 # [ 0.430585] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1228worker2 # [ 0.428347] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1229lb # [ 0.418972] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1230worker1 # [ 0.431465] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1231worker2 # [ 0.429477] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1232lb # [ 0.419816] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1233worker1 # [ 0.432308] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1234client # [ 0.440393] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1235lb # [ 0.420207] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1236worker2 # [ 0.431038] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1237lb # [ 0.421191] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1238worker1 # [ 0.433152] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1239worker1 # [ 0.434255] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1240worker2 # [ 0.433124] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1241lb # [ 0.422706] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1242client # [ 0.443718] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1243worker2 # [ 0.433462] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1244worker1 # [ 0.434785] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1245worker2 # [ 0.434437] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1246client # [ 0.444442] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1247lb # [ 0.424198] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1248worker1 # [ 0.437289] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1249lb # [ 0.425186] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1250worker2 # [ 0.435835] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1251client # [ 0.446139] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1252lb # [ 0.426793] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1253client # [ 0.447226] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1254worker2 # [ 0.437934] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1255client # [ 0.448481] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1256worker2 # [ 0.438653] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1257lb # [ 0.429038] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1258client # [ 0.449439] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1259lb # [ 0.429855] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1260worker2 # [ 0.440174] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1261lb # [ 0.430208] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1262client # [ 0.451783] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1263client # [ 0.452206] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1264lb # [ 0.431737] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1265client # [ 0.453497] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1266lb # [ 0.433937] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1267client # [ 0.454990] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1268worker1 # [ 0.437809] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1269lb # [ 0.434193] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1270worker1 # [ 0.440251] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1271lb # [ 0.435176] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1272worker1 # [ 0.440847] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1273client # [ 0.458103] ACPI: PCI: Interrupt link LNKA configured for IRQ 101274lb # [ 0.436607] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1275worker1 # [ 0.442175] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1276client # [ 0.459044] ACPI: PCI: Interrupt link LNKB configured for IRQ 101277lb # [ 0.437910] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1278client # [ 0.460300] ACPI: PCI: Interrupt link LNKC configured for IRQ 111279worker1 # [ 0.442810] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1280worker2 # [ 0.440653] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1281client # [ 0.461318] ACPI: PCI: Interrupt link LNKD configured for IRQ 111282lb # [ 0.438382] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1283worker1 # [ 0.443881] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1284worker2 # [ 0.443233] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1285client # [ 0.462423] ACPI: PCI: Interrupt link LNKE configured for IRQ 101286lb # [ 0.440007] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1287client # [ 0.463306] ACPI: PCI: Interrupt link LNKF configured for IRQ 101288worker1 # [ 0.444843] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1289worker2 # [ 0.443681] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1290client # [ 0.464307] ACPI: PCI: Interrupt link LNKG configured for IRQ 111291worker1 # [ 0.446602] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1292client # [ 0.465296] ACPI: PCI: Interrupt link LNKH configured for IRQ 111293worker2 # [ 0.445485] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1294worker1 # [ 0.447451] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1295client # [ 0.466232] ACPI: PCI: Interrupt link GSIA configured for IRQ 161296worker2 # [ 0.446687] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1297client # [ 0.467207] ACPI: PCI: Interrupt link GSIB configured for IRQ 171298worker1 # [ 0.448630] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1299client # [ 0.468178] ACPI: PCI: Interrupt link GSIC configured for IRQ 181300worker2 # [ 0.447775] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1301worker1 # [ 0.450239] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1302client # [ 0.469084] ACPI: PCI: Interrupt link GSID configured for IRQ 191303worker2 # [ 0.448722] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1304client # [ 0.470052] ACPI: PCI: Interrupt link GSIE configured for IRQ 201305client # [ 0.470961] ACPI: PCI: Interrupt link GSIF configured for IRQ 211306worker2 # [ 0.450512] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1307client # [ 0.471213] ACPI: PCI: Interrupt link GSIG configured for IRQ 221308worker2 # [ 0.451364] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1309worker1 # [ 0.453531] ACPI: PCI: Interrupt link LNKA configured for IRQ 101310client # [ 0.472191] ACPI: PCI: Interrupt link GSIH configured for IRQ 231311worker1 # [ 0.454412] ACPI: PCI: Interrupt link LNKB configured for IRQ 101312client # [ 0.473943] iommu: Default domain type: Translated1313worker2 # [ 0.452506] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1314lb # [ 0.441009] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1315worker1 # [ 0.455429] ACPI: PCI: Interrupt link LNKC configured for IRQ 111316client # [ 0.474206] iommu: DMA domain TLB invalidation policy: lazy mode1317worker1 # [ 0.456366] ACPI: PCI: Interrupt link LNKD configured for IRQ 111318worker2 # [ 0.454196] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1319lb # [ 0.442984] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1320client # [ 0.475421] ACPI: bus type USB registered1321worker1 # [ 0.457417] ACPI: PCI: Interrupt link LNKE configured for IRQ 101322client # [ 0.476171] usbcore: registered new interface driver usbfs1323worker1 # [ 0.458395] ACPI: PCI: Interrupt link LNKF configured for IRQ 101324lb # [ 0.444067] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1325client # [ 0.476909] usbcore: registered new interface driver hub1326worker1 # [ 0.459382] ACPI: PCI: Interrupt link LNKG configured for IRQ 111327client # [ 0.477208] usbcore: registered new device driver usb1328lb # [ 0.445870] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1329worker2 # [ 0.457462] ACPI: PCI: Interrupt link LNKA configured for IRQ 101330worker1 # [ 0.460596] ACPI: PCI: Interrupt link LNKH configured for IRQ 111331client # [ 0.478881] NetLabel: Initializing1332worker2 # [ 0.458524] ACPI: PCI: Interrupt link LNKB configured for IRQ 101333worker1 # [ 0.461627] ACPI: PCI: Interrupt link GSIA configured for IRQ 161334client # [ 0.479205] NetLabel: domain hash size = 1281335lb # [ 0.446404] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1336worker2 # [ 0.459553] ACPI: PCI: Interrupt link LNKC configured for IRQ 111337worker1 # [ 0.462569] ACPI: PCI: Interrupt link GSIB configured for IRQ 171338client # [ 0.479908] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1339lb # [ 0.447502] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1340worker1 # [ 0.463294] ACPI: PCI: Interrupt link GSIC configured for IRQ 181341client # [ 0.480232] NetLabel: unlabeled traffic allowed by default1342worker2 # [ 0.460554] ACPI: PCI: Interrupt link LNKD configured for IRQ 111343client # [ 0.481103] PCI: Using ACPI for IRQ routing1344worker1 # [ 0.463593] ACPI: PCI: Interrupt link GSID configured for IRQ 191345worker2 # [ 0.461540] ACPI: PCI: Interrupt link LNKE configured for IRQ 101346lb # [ 0.448428] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1347worker1 # [ 0.464510] ACPI: PCI: Interrupt link GSIE configured for IRQ 201348worker2 # [ 0.462554] ACPI: PCI: Interrupt link LNKF configured for IRQ 101349worker1 # [ 0.465328] ACPI: PCI: Interrupt link GSIF configured for IRQ 211350worker2 # [ 0.463556] ACPI: PCI: Interrupt link LNKG configured for IRQ 111351lb # [ 0.450242] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1352worker1 # [ 0.465589] ACPI: PCI: Interrupt link GSIG configured for IRQ 221353worker2 # [ 0.464554] ACPI: PCI: Interrupt link LNKH configured for IRQ 111354lb # [ 0.451097] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1355worker1 # [ 0.466532] ACPI: PCI: Interrupt link GSIH configured for IRQ 231356worker2 # [ 0.465490] ACPI: PCI: Interrupt link GSIA configured for IRQ 161357lb # [ 0.452242] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1358worker2 # [ 0.466468] ACPI: PCI: Interrupt link GSIB configured for IRQ 171359worker1 # [ 0.468437] iommu: Default domain type: Translated1360worker2 # [ 0.467458] ACPI: PCI: Interrupt link GSIC configured for IRQ 181361worker1 # [ 0.469159] iommu: DMA domain TLB invalidation policy: lazy mode1362lb # [ 0.454213] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1363worker2 # [ 0.468462] ACPI: PCI: Interrupt link GSID configured for IRQ 191364worker1 # [ 0.469833] ACPI: bus type USB registered1365worker1 # [ 0.470586] usbcore: registered new interface driver usbfs1366worker2 # [ 0.469448] ACPI: PCI: Interrupt link GSIE configured for IRQ 201367worker1 # [ 0.471502] usbcore: registered new interface driver hub1368worker2 # [ 0.470441] ACPI: PCI: Interrupt link GSIF configured for IRQ 211369worker1 # [ 0.472261] usbcore: registered new device driver usb1370worker2 # [ 0.471238] ACPI: PCI: Interrupt link GSIG configured for IRQ 221371lb # [ 0.457998] ACPI: PCI: Interrupt link LNKA configured for IRQ 101372worker2 # [ 0.472415] ACPI: PCI: Interrupt link GSIH configured for IRQ 231373worker1 # [ 0.473498] NetLabel: Initializing1374lb # [ 0.459071] ACPI: PCI: Interrupt link LNKB configured for IRQ 101375worker1 # [ 0.474000] NetLabel: domain hash size = 1281376lb # [ 0.460031] ACPI: PCI: Interrupt link LNKC configured for IRQ 111377worker1 # [ 0.474578] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1378worker2 # [ 0.474373] iommu: Default domain type: Translated1379worker1 # [ 0.475515] NetLabel: unlabeled traffic allowed by default1380lb # [ 0.461011] ACPI: PCI: Interrupt link LNKD configured for IRQ 111381worker2 # [ 0.475097] iommu: DMA domain TLB invalidation policy: lazy mode1382worker1 # [ 0.476260] PCI: Using ACPI for IRQ routing1383lb # [ 0.462004] ACPI: PCI: Interrupt link LNKE configured for IRQ 101384worker2 # [ 0.475713] ACPI: bus type USB registered1385worker2 # [ 0.476494] usbcore: registered new interface driver usbfs1386lb # [ 0.463062] ACPI: PCI: Interrupt link LNKF configured for IRQ 101387worker2 # [ 0.477430] usbcore: registered new interface driver hub1388lb # [ 0.464071] ACPI: PCI: Interrupt link LNKG configured for IRQ 111389worker2 # [ 0.478200] usbcore: registered new device driver usb1390lb # [ 0.465087] ACPI: PCI: Interrupt link LNKH configured for IRQ 111391lb # [ 0.466015] ACPI: PCI: Interrupt link GSIA configured for IRQ 161392worker2 # [ 0.479409] NetLabel: Initializing1393worker2 # [ 0.479900] NetLabel: domain hash size = 1281394lb # [ 0.466995] ACPI: PCI: Interrupt link GSIB configured for IRQ 171395worker2 # [ 0.480455] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1396lb # [ 0.467980] ACPI: PCI: Interrupt link GSIC configured for IRQ 181397worker2 # [ 0.481519] NetLabel: unlabeled traffic allowed by default1398lb # [ 0.468979] ACPI: PCI: Interrupt link GSID configured for IRQ 191399worker2 # [ 0.482467] PCI: Using ACPI for IRQ routing1400lb # [ 0.469993] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401lb # [ 0.470991] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402lb # [ 0.471989] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403lb # [ 0.473130] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404lb # [ 0.475003] iommu: Default domain type: Translated1405lb # [ 0.475879] iommu: DMA domain TLB invalidation policy: lazy mode1406lb # [ 0.476460] ACPI: bus type USB registered1407lb # [ 0.477216] usbcore: registered new interface driver usbfs1408lb # [ 0.478170] usbcore: registered new interface driver hub1409lb # [ 0.478880] usbcore: registered new device driver usb1410lb # [ 0.480071] NetLabel: Initializing1411lb # [ 0.480668] NetLabel: domain hash size = 1281412lb # [ 0.481186] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413lb # [ 0.482227] NetLabel: unlabeled traffic allowed by default1414lb # [ 0.483198] PCI: Using ACPI for IRQ routing1415client # [ 0.524568] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416client # [ 0.525195] pci 0000:00:01.0: vgaarb: bridge control possible1417client # [ 0.525195] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418client # [ 0.525204] vgaarb: loaded1419client # [ 0.525962] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420client # [ 0.526207] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.531305] clocksource: Switched to clocksource kvm-clock1422client # [ 0.534658] VFS: Disk quotas dquot_6.6.01423client # [ 0.535340] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424client # [ 0.536584] pnp: PnP ACPI init1425worker1 # [ 0.519438] pci 0000:00:01.0: vgaarb: setting as boot VGA device1426client # [ 0.537355] ACPI: IRQ 4 override to edge(!), high(!)1427worker1 # [ 0.519574] pci 0000:00:01.0: vgaarb: bridge control possible1428client # [ 0.538273] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1429worker1 # [ 0.519574] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1430worker1 # [ 0.519583] vgaarb: loaded1431client # [ 0.539763] pnp: PnP ACPI: found 6 devices1432worker1 # [ 0.520353] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01433worker1 # [ 0.520578] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434worker2 # [ 0.527655] pci 0000:00:01.0: vgaarb: setting as boot VGA device1435worker2 # [ 0.528451] pci 0000:00:01.0: vgaarb: bridge control possible1436worker1 # [ 0.526679] clocksource: Switched to clocksource kvm-clock1437client # [ 0.547254] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1438worker2 # [ 0.528451] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1439client # [ 0.548633] clocksource: Switched to clocksource acpi_pm1440worker2 # [ 0.528460] vgaarb: loaded1441client # [ 0.549541] NET: Registered PF_INET protocol family1442worker2 # [ 0.529178] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01443worker1 # [ 0.530080] VFS: Disk quotas dquot_6.6.01444worker2 # [ 0.529457] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1445client # [ 0.550643] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1446worker1 # [ 0.530759] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1447worker1 # [ 0.532158] pnp: PnP ACPI init1448worker1 # [ 0.532990] ACPI: IRQ 4 override to edge(!), high(!)1449worker2 # [ 0.532544] clocksource: Switched to clocksource kvm-clock1450worker1 # [ 0.533971] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1451worker1 # [ 0.535523] pnp: PnP ACPI: found 6 devices1452worker2 # [ 0.535968] VFS: Disk quotas dquot_6.6.01453worker2 # [ 0.536692] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454worker2 # [ 0.538097] pnp: PnP ACPI init1455lb # [ 0.526954] pci 0000:00:01.0: vgaarb: setting as boot VGA device1456worker2 # [ 0.538941] ACPI: IRQ 4 override to edge(!), high(!)1457lb # [ 0.527182] pci 0000:00:01.0: vgaarb: bridge control possible1458worker2 # [ 0.539978] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1459lb # [ 0.527182] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1460lb # [ 0.527190] vgaarb: loaded1461worker2 # [ 0.541559] pnp: PnP ACPI: found 6 devices1462lb # [ 0.527935] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01463worker1 # [ 0.543190] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1464lb # [ 0.528186] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1465worker1 # [ 0.544628] clocksource: Switched to clocksource acpi_pm1466worker1 # [ 0.545613] NET: Registered PF_INET protocol family1467client # [ 0.566685] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1468worker1 # [ 0.546831] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1469client # [ 0.568178] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1470lb # [ 0.531272] clocksource: Switched to clocksource kvm-clock1471client # [ 0.569429] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1472lb # [ 0.532852] VFS: Disk quotas dquot_6.6.01473client # [ 0.570715] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1474worker2 # [ 0.549125] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1475client # [ 0.571929] TCP: Hash tables configured (established 16384 bind 16384)1476worker2 # [ 0.550564] clocksource: Switched to clocksource acpi_pm1477client # [ 0.572996] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1478lb # [ 0.535420] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1479worker2 # [ 0.551535] NET: Registered PF_INET protocol family1480client # [ 0.574200] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1481lb # [ 0.536752] pnp: PnP ACPI init1482client # [ 0.575239] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1483worker2 # [ 0.552664] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1484lb # [ 0.537559] ACPI: IRQ 4 override to edge(!), high(!)1485client # [ 0.576386] NET: Registered PF_UNIX/PF_LOCAL protocol family1486lb # [ 0.538544] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1487client # [ 0.577290] NET: Registered PF_XDP protocol family1488lb # [ 0.540077] pnp: PnP ACPI: found 6 devices1489client # [ 0.578091] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1490client # [ 0.579053] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1491client # [ 0.580014] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1492client # [ 0.581104] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1493client # [ 0.582157] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1494client # [ 0.583206] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1495worker1 # [ 0.563244] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1496client # [ 0.585085] ACPI: \_SB_.GSIA: Enabled at IRQ 161497worker1 # [ 0.564826] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1498lb # [ 0.548468] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1499worker1 # [ 0.566178] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1500client # [ 0.587501] ACPI: \_SB_.GSIB: Enabled at IRQ 171501lb # [ 0.549953] clocksource: Switched to clocksource acpi_pm1502worker1 # [ 0.567483] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1503lb # [ 0.550958] NET: Registered PF_INET protocol family1504client # [ 0.589356] ACPI: \_SB_.GSIC: Enabled at IRQ 181505worker1 # [ 0.568731] TCP: Hash tables configured (established 16384 bind 16384)1506lb # [ 0.552128] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1507worker1 # [ 0.569857] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1508client # [ 0.591214] ACPI: \_SB_.GSID: Enabled at IRQ 191509worker2 # [ 0.568653] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1510worker1 # [ 0.571127] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1511client # [ 0.592815] PCI: CLS 0 bytes, default 641512worker2 # [ 0.570201] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1513worker1 # [ 0.572239] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1514worker2 # [ 0.571510] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1515worker1 # [ 0.573440] NET: Registered PF_UNIX/PF_LOCAL protocol family1516client # [ 0.593671] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1517worker1 # [ 0.574396] NET: Registered PF_XDP protocol family1518client # [ 0.595312] Trying to unpack rootfs image as initramfs...1519worker2 # [ 0.572829] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1520worker1 # [ 0.575227] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1521worker2 # [ 0.574073] TCP: Hash tables configured (established 16384 bind 16384)1522worker1 # [ 0.576266] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1523worker2 # [ 0.575285] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1524worker1 # [ 0.577312] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1525worker2 # [ 0.576630] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1526worker1 # [ 0.578456] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1527worker2 # [ 0.577839] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1528worker1 # [ 0.579580] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1529worker2 # [ 0.579099] NET: Registered PF_UNIX/PF_LOCAL protocol family1530worker1 # [ 0.580680] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1531worker2 # [ 0.580070] NET: Registered PF_XDP protocol family1532worker1 # [ 0.582437] ACPI: \_SB_.GSIA: Enabled at IRQ 161533worker2 # [ 0.580960] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1534worker2 # [ 0.582008] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1535worker2 # [ 0.583069] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1536worker1 # [ 0.585040] ACPI: \_SB_.GSIB: Enabled at IRQ 171537worker2 # [ 0.584207] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1538worker1 # [ 0.586899] ACPI: \_SB_.GSIC: Enabled at IRQ 181539lb # [ 0.569132] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1540worker2 # [ 0.585374] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1541worker2 # [ 0.586449] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1542lb # [ 0.570675] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1543worker1 # [ 0.588723] ACPI: \_SB_.GSID: Enabled at IRQ 191544worker2 # [ 0.588215] ACPI: \_SB_.GSIA: Enabled at IRQ 161545lb # [ 0.571990] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1546worker1 # [ 0.590359] PCI: CLS 0 bytes, default 641547lb # [ 0.573351] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1548worker1 # [ 0.591272] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1549lb # [ 0.574605] TCP: Hash tables configured (established 16384 bind 16384)1550worker2 # [ 0.590771] ACPI: \_SB_.GSIB: Enabled at IRQ 171551worker1 # [ 0.592995] Trying to unpack rootfs image as initramfs...1552lb # [ 0.575714] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1553worker2 # [ 0.592585] ACPI: \_SB_.GSIC: Enabled at IRQ 181554lb # [ 0.577006] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1555lb # [ 0.578085] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1556worker2 # [ 0.594456] ACPI: \_SB_.GSID: Enabled at IRQ 191557lb # [ 0.579353] NET: Registered PF_UNIX/PF_LOCAL protocol family1558worker2 # [ 0.596095] PCI: CLS 0 bytes, default 641559lb # [ 0.580395] NET: Registered PF_XDP protocol family1560lb # [ 0.581266] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1561worker2 # [ 0.596993] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1562lb # [ 0.582281] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1563worker2 # [ 0.598725] Trying to unpack rootfs image as initramfs...1564lb # [ 0.583305] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565lb # [ 0.584436] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566lb # [ 0.585621] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567lb # [ 0.586754] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568lb # [ 0.588581] ACPI: \_SB_.GSIA: Enabled at IRQ 161569lb # [ 0.591320] ACPI: \_SB_.GSIB: Enabled at IRQ 171570lb # [ 0.593427] ACPI: \_SB_.GSIC: Enabled at IRQ 181571lb # [ 0.595397] ACPI: \_SB_.GSID: Enabled at IRQ 191572lb # [ 0.597145] PCI: CLS 0 bytes, default 641573lb # [ 0.598063] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574lb # [ 0.599922] Trying to unpack rootfs image as initramfs...1575client # [ 0.639290] Initialise system trusted keyrings1576client # [ 0.640224] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker1 # [ 0.638126] Initialise system trusted keyrings1578worker1 # [ 0.640935] workingset: timestamp_bits=40 max_order=19 bucket_order=01579client # [ 0.662137] Key type asymmetric registered1580client # [ 0.662900] Asymmetric key parser 'x509' registered1581client # [ 0.663743] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1582worker2 # [ 0.643928] Initialise system trusted keyrings1583client # [ 0.669054] io scheduler mq-deadline registered1584worker2 # [ 0.646914] workingset: timestamp_bits=40 max_order=19 bucket_order=01585client # [ 0.669793] io scheduler kyber registered1586client # [ 0.673903] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1587client # [ 0.675169] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1588client # [ 0.680695] Linux agpgart interface v0.1031589client # [ 0.681455] ACPI: bus type drm_connector registered1590lb # [ 0.644251] Initialise system trusted keyrings1591worker1 # [ 0.662244] Key type asymmetric registered1592worker1 # [ 0.663019] Asymmetric key parser 'x509' registered1593client # [ 0.684364] usbcore: registered new interface driver usbserial_generic1594client # [ 0.685387] usbserial: USB Serial support registered for generic1595lb # [ 0.647969] workingset: timestamp_bits=40 max_order=19 bucket_order=01596worker1 # [ 0.665949] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1597client # [ 0.688888] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1598worker1 # [ 0.668966] io scheduler mq-deadline registered1599client # [ 0.688888] Please enable it if your BIOS has the CPPC option.1600worker2 # [ 0.668081] Key type asymmetric registered1601worker1 # [ 0.669704] io scheduler kyber registered1602worker2 # [ 0.668802] Asymmetric key parser 'x509' registered1603client # [ 0.691018] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1604worker2 # [ 0.669630] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1605worker1 # [ 0.672499] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1606worker1 # [ 0.673818] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1607client # [ 0.695022] drop_monitor: Initializing network drop monitor service1608client # [ 0.696180] NET: Registered PF_INET6 protocol family1609worker2 # [ 0.674963] io scheduler mq-deadline registered1610worker2 # [ 0.675771] io scheduler kyber registered1611client # [ 0.699369] Segment Routing with IPv61612worker1 # [ 0.679287] Linux agpgart interface v0.1031613worker1 # [ 0.680114] ACPI: bus type drm_connector registered1614client # [ 0.701903] In-situ OAM (IOAM) with IPv61615worker2 # [ 0.679404] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1616client # [ 0.703000] IPI shorthand broadcast: enabled1617worker2 # [ 0.680719] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1618worker1 # [ 0.683330] usbcore: registered new interface driver usbserial_generic1619worker1 # [ 0.684455] usbserial: USB Serial support registered for generic1620worker2 # [ 0.684616] Linux agpgart interface v0.1031621lb # [ 0.669320] Key type asymmetric registered1622worker2 # [ 0.685422] ACPI: bus type drm_connector registered1623lb # [ 0.670056] Asymmetric key parser 'x509' registered1624worker1 # [ 0.687897] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1625worker1 # [ 0.687897] Please enable it if your BIOS has the CPPC option.1626worker2 # [ 0.688344] usbcore: registered new interface driver usbserial_generic1627worker1 # [ 0.690192] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1628lb # [ 0.672972] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1629client # [ 0.711272] sched_clock: Marking stable (576014060, 134848916)->(782421077, -71558101)1630worker2 # [ 0.689424] usbserial: USB Serial support registered for generic1631lb # [ 0.675992] io scheduler mq-deadline registered1632lb # [ 0.676770] io scheduler kyber registered1633worker1 # [ 0.694013] drop_monitor: Initializing network drop monitor service1634worker2 # [ 0.692886] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1635client # [ 0.716136] registered taskstats version 11636worker1 # [ 0.695233] NET: Registered PF_INET6 protocol family1637worker2 # [ 0.692886] Please enable it if your BIOS has the CPPC option.1638client # [ 0.717095] Loading compiled-in X.509 certificates1639worker2 # [ 0.695090] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1640lb # [ 0.679623] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1641worker1 # [ 0.698343] Segment Routing with IPv61642lb # [ 0.682915] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1643worker2 # [ 0.698991] drop_monitor: Initializing network drop monitor service1644worker1 # [ 0.700911] In-situ OAM (IOAM) with IPv61645worker2 # [ 0.700107] NET: Registered PF_INET6 protocol family1646worker1 # [ 0.701929] IPI shorthand broadcast: enabled1647lb # [ 0.686584] Linux agpgart interface v0.1031648worker2 # [ 0.703354] Segment Routing with IPv61649lb # [ 0.687404] ACPI: bus type drm_connector registered1650worker2 # [ 0.705894] In-situ OAM (IOAM) with IPv61651lb # [ 0.690439] usbcore: registered new interface driver usbserial_generic1652worker2 # [ 0.706923] IPI shorthand broadcast: enabled1653lb # [ 0.691542] usbserial: USB Serial support registered for generic1654worker1 # [ 0.710160] sched_clock: Marking stable (576013898, 133865221)->(786319038, -76439919)1655lb # [ 0.693919] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1656lb # [ 0.693919] Please enable it if your BIOS has the CPPC option.1657lb # [ 0.696212] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1658worker1 # [ 0.715106] registered taskstats version 11659client # [ 0.735878] Demotion targets for Node 0: null1660client # [ 0.736731] Key type .fscrypt registered1661worker1 # [ 0.716030] Loading compiled-in X.509 certificates1662client # [ 0.737397] Key type fscrypt-provisioning registered1663worker2 # [ 0.715065] sched_clock: Marking stable (583015129, 131845390)->(788513797, -73653278)1664lb # [ 0.700124] drop_monitor: Initializing network drop monitor service1665lb # [ 0.701326] NET: Registered PF_INET6 protocol family1666client # [ 0.739985] ima: No TPM chip found, activating TPM-bypass!1667client # [ 0.740877] ima: Allocated hash algorithm: sha11668client # [ 0.741631] ima: No architecture policies found1669worker2 # [ 0.719952] registered taskstats version 11670worker2 # [ 0.720928] Loading compiled-in X.509 certificates1671lb # [ 0.706481] Segment Routing with IPv61672lb # [ 0.707223] In-situ OAM (IOAM) with IPv61673client # [ 0.746061] PM: Magic number: 10:986:701674client # [ 0.746789] memory: hash matches1675lb # [ 0.710227] IPI shorthand broadcast: enabled1676client # [ 0.750207] RAS: Correctable Errors collector initialized.1677worker1 # [ 0.734900] Demotion targets for Node 0: null1678worker1 # [ 0.735832] Key type .fscrypt registered1679lb # [ 0.718508] sched_clock: Marking stable (585014201, 132887405)->(791829841, -73928235)1680worker1 # [ 0.736535] Key type fscrypt-provisioning registered1681client # [ 0.758878] clk: Disabling unused clocks1682client # [ 0.759581] PM: genpd: Disabling unused power domains1683lb # [ 0.722055] registered taskstats version 11684worker1 # [ 0.740010] ima: No TPM chip found, activating TPM-bypass!1685worker2 # [ 0.738882] Demotion targets for Node 0: null1686lb # [ 0.723050] Loading compiled-in X.509 certificates1687worker1 # [ 0.740965] ima: Allocated hash algorithm: sha11688worker2 # [ 0.739731] Key type .fscrypt registered1689worker1 # [ 0.741747] ima: No architecture policies found1690worker2 # [ 0.740415] Key type fscrypt-provisioning registered1691worker1 # [ 0.744069] PM: Magic number: 10:986:701692worker1 # [ 0.744820] memory: hash matches1693worker2 # [ 0.743983] ima: No TPM chip found, activating TPM-bypass!1694worker2 # [ 0.744941] ima: Allocated hash algorithm: sha11695worker2 # [ 0.745794] ima: No architecture policies found1696worker1 # [ 0.748292] RAS: Correctable Errors collector initialized.1697worker2 # [ 0.749885] PM: Magic number: 10:986:701698worker2 # [ 0.750636] memory: hash matches1699worker2 # [ 0.754124] RAS: Correctable Errors collector initialized.1700worker1 # [ 0.756970] clk: Disabling unused clocks1701worker1 # [ 0.757679] PM: genpd: Disabling unused power domains1702lb # [ 0.741930] Demotion targets for Node 0: null1703lb # [ 0.742865] Key type .fscrypt registered1704lb # [ 0.743558] Key type fscrypt-provisioning registered1705lb # [ 0.744565] ima: No TPM chip found, activating TPM-bypass!1706worker2 # [ 0.762770] clk: Disabling unused clocks1707worker2 # [ 0.763506] PM: genpd: Disabling unused power domains1708lb # [ 0.747934] ima: Allocated hash algorithm: sha11709lb # [ 0.748754] ima: No architecture policies found1710lb # [ 0.752920] PM: Magic number: 10:986:701711lb # [ 0.753753] memory: hash matches1712lb # [ 0.757385] RAS: Correctable Errors collector initialized.1713lb # [ 0.766164] clk: Disabling unused clocks1714lb # [ 0.766868] PM: genpd: Disabling unused power domains1715client # [ 0.915764] Freeing initrd memory: 29096K1716client # [ 0.918931] Freeing unused decrypted memory: 2028K1717client # [ 0.921497] Freeing unused kernel image (initmem) memory: 3644K1718client # [ 0.922579] Write protecting the kernel read-only data: 32768k1719client # [ 0.924451] Freeing unused kernel image (text/rodata gap) memory: 1208K1720client # [ 0.925986] Freeing unused kernel image (rodata/data gap) memory: 752K1721worker2 # [ 0.915921] Freeing initrd memory: 29092K1722worker2 # [ 0.919041] Freeing unused decrypted memory: 2028K1723worker1 # [ 0.921771] Freeing initrd memory: 29092K1724worker2 # [ 0.921584] Freeing unused kernel image (initmem) memory: 3644K1725worker2 # [ 0.922701] Write protecting the kernel read-only data: 32768k1726worker1 # [ 0.924919] Freeing unused decrypted memory: 2028K1727worker2 # [ 0.924582] Freeing unused kernel image (text/rodata gap) memory: 1208K1728worker1 # [ 0.927448] Freeing unused kernel image (initmem) memory: 3644K1729worker2 # [ 0.926121] Freeing unused kernel image (rodata/data gap) memory: 752K1730worker1 # [ 0.928547] Write protecting the kernel read-only data: 32768k1731worker1 # [ 0.930412] Freeing unused kernel image (text/rodata gap) memory: 1208K1732worker1 # [ 0.931946] Freeing unused kernel image (rodata/data gap) memory: 752K1733lb # [ 0.928644] Freeing initrd memory: 29092K1734lb # [ 0.932050] Freeing unused decrypted memory: 2028K1735lb # [ 0.934872] Freeing unused kernel image (initmem) memory: 3644K1736lb # [ 0.936027] Write protecting the kernel read-only data: 32768k1737lb # [ 0.937972] Freeing unused kernel image (text/rodata gap) memory: 1208K1738client # [ 0.977039] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739lb # [ 0.939536] Freeing unused kernel image (rodata/data gap) memory: 752K1740client # [ 0.978131] Run /init as init process1741client # [ 0.987963] systemd[1]: Inserted module 'autofs4'1742worker2 # [ 0.977125] x86/mm: Checked W+X mappings: passed, no W+X pages found.1743worker2 # [ 0.978238] Run /init as init process1744client # [ 1.003993] fuse: init (API version 7.45)1745worker1 # [ 0.983192] x86/mm: Checked W+X mappings: passed, no W+X pages found.1746worker1 # [ 0.984314] Run /init as init process1747client # [ 1.009750] ACPI: \_SB_.GSIG: Enabled at IRQ 221748worker2 # [ 0.988157] systemd[1]: Inserted module 'autofs4'1749client # [ 1.012321] ACPI: \_SB_.GSIH: Enabled at IRQ 231750worker1 # [ 0.994232] systemd[1]: Inserted module 'autofs4'1751client # [ 1.015361] ACPI: \_SB_.GSIE: Enabled at IRQ 201752client # [ 1.017640] ACPI: \_SB_.GSIF: Enabled at IRQ 211753worker2 # [ 1.004470] fuse: init (API version 7.45)1754lb # [ 0.990775] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755lb # [ 0.991916] Run /init as init process1756worker1 # [ 1.010535] fuse: init (API version 7.45)1757worker2 # [ 1.010358] ACPI: \_SB_.GSIG: Enabled at IRQ 221758worker2 # [ 1.013110] ACPI: \_SB_.GSIH: Enabled at IRQ 231759worker1 # [ 1.016320] ACPI: \_SB_.GSIG: Enabled at IRQ 221760worker2 # [ 1.016548] ACPI: \_SB_.GSIE: Enabled at IRQ 201761worker1 # [ 1.018976] ACPI: \_SB_.GSIH: Enabled at IRQ 231762lb # [ 1.002451] systemd[1]: Inserted module 'autofs4'1763worker2 # [ 1.018997] ACPI: \_SB_.GSIF: Enabled at IRQ 211764worker1 # [ 1.022155] ACPI: \_SB_.GSIE: Enabled at IRQ 201765client # [ 1.045057] systemd[1]: Successfully made /usr/ read-only.1766worker1 # [ 1.024592] ACPI: \_SB_.GSIF: Enabled at IRQ 211767lb # [ 1.019267] fuse: init (API version 7.45)1768lb # [ 1.026176] ACPI: \_SB_.GSIG: Enabled at IRQ 221769lb # [ 1.028564] ACPI: \_SB_.GSIH: Enabled at IRQ 231770worker2 # [ 1.045636] systemd[1]: Successfully made /usr/ read-only.1771lb # [ 1.031524] ACPI: \_SB_.GSIE: Enabled at IRQ 201772worker1 # [ 1.049631] systemd[1]: Successfully made /usr/ read-only.1773lb # [ 1.033639] ACPI: \_SB_.GSIF: Enabled at IRQ 211774lb # [ 1.060789] systemd[1]: Successfully made /usr/ read-only.1775client # [ 1.380691] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1776client # [ 1.385743] systemd[1]: Detected virtualization kvm.1777client # [ 1.386611] systemd[1]: Detected architecture x86-64.1778client # [ 1.387548] systemd[1]: Running in initrd.1779client # [ 1.388718] systemd[1]: Initializing machine ID from random generator.1780client # [ 1.389960] systemd[1]: Hostname set to <client>.1781worker2 # [ 1.382128] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1782worker2 # [ 1.395672] systemd[1]: Detected virtualization kvm.1783worker1 # [ 1.386272] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784worker2 # [ 1.398156] systemd[1]: Detected architecture x86-64.1785worker1 # [ 1.399826] systemd[1]: Detected virtualization kvm.1786worker2 # [ 1.400572] systemd[1]: Running in initrd.1787worker1 # [ 1.402365] systemd[1]: Detected architecture x86-64.1788worker1 # [ 1.404827] systemd[1]: Running in initrd.1789worker2 # [ 1.403351] systemd[1]: Initializing machine ID from random generator.1790worker1 # [ 1.407585] systemd[1]: Initializing machine ID from random generator.1791worker2 # [ 1.406716] systemd[1]: Hostname set to <worker2>.1792worker1 # [ 1.410954] systemd[1]: Hostname set to <worker1>.1793lb # [ 1.397558] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1794lb # [ 1.409635] systemd[1]: Detected virtualization kvm.1795lb # [ 1.411797] systemd[1]: Detected architecture x86-64.1796lb # [ 1.413987] systemd[1]: Running in initrd.1797lb # [ 1.416506] systemd[1]: Initializing machine ID from random generator.1798lb # [ 1.419437] systemd[1]: Hostname set to <lb>.1799client # [ 1.579175] systemd[1]: bpf-restrict-fs: LSM BPF program attached1800client # [ 1.619401] systemd[1]: Queued start job for default target Initrd Default Target.1801client # [ 1.623212] systemd[1]: Created slice Slice /system/modprobe.1802client # [ 1.624405] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1803client # [ 1.625817] systemd[1]: Expecting device /dev/disk/by-label/nixos...1804client # [ 1.626999] systemd[1]: Reached target Path Units.1805client # [ 1.627878] systemd[1]: Reached target Slice Units.1806client # [ 1.628748] systemd[1]: Reached target Swaps.1807client # [ 1.629609] systemd[1]: Reached target Timer Units.1808client # [ 1.630581] systemd[1]: Listening on D-Bus System Message Bus Socket.1809client # [ 1.631810] systemd[1]: Listening on Journal Socket (/dev/log).1810client # [ 1.633059] systemd[1]: Listening on Journal Sockets.1811client # [ 1.634066] systemd[1]: Listening on udev Control Socket.1812client # [ 1.635099] systemd[1]: Listening on udev Kernel Socket.1813client # [ 1.636075] systemd[1]: Reached target Socket Units.1814client # [ 1.637839] systemd[1]: Starting Create List of Static Device Nodes...1815worker2 # [ 1.615865] systemd[1]: bpf-restrict-fs: LSM BPF program attached1816worker1 # [ 1.618006] systemd[1]: bpf-restrict-fs: LSM BPF program attached1817client # [ 1.641710] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1818client # [ 1.648584] systemd[1]: Starting Load Kernel Module configfs...1819client # [ 1.663062] systemd[1]: Starting Journal Service...1820lb # [ 1.625339] systemd[1]: bpf-restrict-fs: LSM BPF program attached1821worker2 # [ 1.653706] systemd[1]: Queued start job for default target Initrd Default Target.1822worker1 # [ 1.656291] systemd[1]: Queued start job for default target Initrd Default Target.1823worker2 # [ 1.658129] systemd[1]: Created slice Slice /system/modprobe.1824worker1 # [ 1.660195] systemd[1]: Created slice Slice /system/modprobe.1825worker2 # [ 1.659283] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1826worker1 # [ 1.661485] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1827worker2 # [ 1.660633] systemd[1]: Expecting device /dev/disk/by-label/nixos...1828worker2 # [ 1.661739] systemd[1]: Reached target Path Units.1829worker1 # [ 1.663035] systemd[1]: Expecting device /dev/disk/by-label/nixos...1830worker2 # [ 1.662546] systemd[1]: Reached target Slice Units.1831worker1 # [ 1.664274] systemd[1]: Reached target Path Units.1832worker2 # [ 1.663373] systemd[1]: Reached target Swaps.1833worker1 # [ 1.665240] systemd[1]: Reached target Slice Units.1834worker2 # [ 1.664206] systemd[1]: Reached target Timer Units.1835worker1 # [ 1.666206] systemd[1]: Reached target Swaps.1836worker2 # [ 1.665153] systemd[1]: Listening on D-Bus System Message Bus Socket.1837worker1 # [ 1.667113] systemd[1]: Reached target Timer Units.1838worker2 # [ 1.666334] systemd[1]: Listening on Journal Socket (/dev/log).1839client # [ 1.677935] systemd[1]: Starting Load Kernel Modules...1840worker1 # [ 1.668181] systemd[1]: Listening on D-Bus System Message Bus Socket.1841worker2 # [ 1.667448] systemd[1]: Listening on Journal Sockets.1842worker1 # [ 1.669542] systemd[1]: Listening on Journal Socket (/dev/log).1843worker2 # [ 1.668423] systemd[1]: Listening on udev Control Socket.1844worker1 # [ 1.670853] systemd[1]: Listening on Journal Sockets.1845worker2 # [ 1.669435] systemd[1]: Listening on udev Kernel Socket.1846worker2 # [ 1.670372] systemd[1]: Reached target Socket Units.1847worker1 # [ 1.671979] systemd[1]: Listening on udev Control Socket.1848worker1 # [ 1.673111] systemd[1]: Listening on udev Kernel Socket.1849worker2 # [ 1.672105] systemd[1]: Starting Create List of Static Device Nodes...1850worker1 # [ 1.674172] systemd[1]: Reached target Socket Units.1851client # [ 1.696885] netfs: FS-Cache loaded1852worker1 # [ 1.676038] systemd[1]: Starting Create List of Static Device Nodes...1853worker2 # [ 1.675681] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1854worker1 # [ 1.679989] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1855client # [ 1.701587] 9pnet: Installing 9P2000 support1856lb # [ 1.664805] systemd[1]: Queued start job for default target Initrd Default Target.1857worker2 # [ 1.682409] systemd[1]: Starting Load Kernel Module configfs...1858lb # [ 1.669302] systemd[1]: Created slice Slice /system/modprobe.1859client # [ 1.707495] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1860lb # [ 1.670485] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1861lb # [ 1.671939] systemd[1]: Expecting device /dev/disk/by-label/nixos...1862worker1 # [ 1.689959] systemd[1]: Starting Load Kernel Module configfs...1863lb # [ 1.673048] systemd[1]: Reached target Path Units.1864lb # [ 1.673920] systemd[1]: Reached target Slice Units.1865lb # [ 1.674779] systemd[1]: Reached target Swaps.1866lb # [ 1.675612] systemd[1]: Reached target Timer Units.1867lb # [ 1.676612] systemd[1]: Listening on D-Bus System Message Bus Socket.1868lb # [ 1.677854] systemd[1]: Listening on Journal Socket (/dev/log).1869lb # [ 1.679116] systemd[1]: Listening on Journal Sockets.1870client # [ 1.718086] systemd[1]: Starting Coldplug All udev Devices...1871lb # [ 1.680137] systemd[1]: Listening on udev Control Socket.1872lb # [ 1.681164] systemd[1]: Listening on udev Kernel Socket.1873worker2 # [ 1.696927] systemd[1]: Starting Journal Service...1874lb # [ 1.682128] systemd[1]: Reached target Socket Units.1875worker1 # [ 1.700958] systemd[1]: Starting Journal Service...1876lb # [ 1.683919] systemd[1]: Starting Create List of Static Device Nodes...1877lb # [ 1.687721] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1878client # [ 1.733031] systemd[1]: Finished Create List of Static Device Nodes.1879lb # [ 1.695082] systemd[1]: Starting Load Kernel Module configfs...1880client # [ 1.738562] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1881worker2 # [ 1.708603] systemd[1]: Starting Load Kernel Modules...1882client # [ 1.743481] systemd-journald[67]: Collecting audit messages is disabled.1883lb # [ 1.708089] systemd[1]: Starting Journal Service...1884worker1 # [ 1.713978] systemd[1]: Starting Load Kernel Modules...1885client # [ 1.748255] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1886worker2 # [ 1.730219] netfs: FS-Cache loaded1887client # [ 1.753282] systemd[1]: modprobe@configfs.service: Deactivated successfully.1888worker1 # [ 1.733575] netfs: FS-Cache loaded1889worker2 # [ 1.735191] 9pnet: Installing 9P2000 support1890client # [ 1.756737] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1891worker1 # [ 1.738367] 9pnet: Installing 9P2000 support1892client # [ 1.762234] systemd[1]: Finished Load Kernel Module configfs.1893worker2 # [ 1.744135] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1894client # [ 1.766303] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1895worker1 # [ 1.746513] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1896lb # [ 1.720975] systemd[1]: Starting Load Kernel Modules...1897client # [ 1.771043] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1898worker2 # [ 1.750067] systemd[1]: Starting Coldplug All udev Devices...1899worker1 # [ 1.756298] systemd[1]: Starting Coldplug All udev Devices...1900lb # [ 1.740844] netfs: FS-Cache loaded1901client # [ 1.778956] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1902lb # [ 1.746602] 9pnet: Installing 9P2000 support1903worker2 # [ 1.765004] systemd[1]: Finished Create List of Static Device Nodes.1904worker1 # [ 1.769373] systemd[1]: Finished Create List of Static Device Nodes.1905lb # [ 1.752803] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1906worker2 # [ 1.772528] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1907worker1 # [ 1.775550] systemd-journald[67]: Collecting audit messages is disabled.1908worker2 # [ 1.775966] systemd-journald[67]: Collecting audit messages is disabled.1909worker1 # [ 1.778506] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1910lb # [ 1.763322] systemd[1]: Starting Coldplug All udev Devices...1911client # [ 1.802033] systemd[1]: Finished Load Kernel Modules.1912worker2 # [ 1.780292] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1913worker1 # [ 1.787076] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1914worker2 # [ 1.787317] systemd[1]: modprobe@configfs.service: Deactivated successfully.1915client # [ 1.810093] systemd[1]: Starting Apply Kernel Variables...1916worker1 # [ 1.791303] systemd[1]: modprobe@configfs.service: Deactivated successfully.1917lb # [ 1.776307] systemd[1]: Finished Create List of Static Device Nodes.1918worker2 # [ 1.792908] systemd[1]: Finished Load Kernel Module configfs.1919worker1 # [ 1.794761] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1920lb # [ 1.780593] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1921worker2 # [ 1.797278] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1922worker1 # [ 1.800259] systemd[1]: Finished Load Kernel Module configfs.1923worker2 # [ 1.800169] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1924client # [ 1.823641] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1925worker1 # [ 1.804320] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1926lb # [ 1.788101] systemd-journald[67]: Collecting audit messages is disabled.1927lb # [ 1.790718] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1928worker1 # [ 1.809035] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1929worker2 # [ 1.807890] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1930worker2 # [ 1.809504] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1931lb # [ 1.795252] systemd[1]: modprobe@configfs.service: Deactivated successfully.1932client # [ 1.836066] systemd[1]: Starting Create Static Device Nodes in /dev...1933worker1 # [ 1.817230] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1934lb # [ 1.801326] systemd[1]: Finished Load Kernel Module configfs.1935lb # [ 1.803243] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1936lb # [ 1.807425] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1937client # [ 1.850497] systemd[1]: Finished Apply Kernel Variables.1938lb # [ 1.813057] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1939lb # [ 1.817982] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1940worker1 # [ 1.839525] systemd[1]: Finished Load Kernel Modules.1941worker2 # [ 1.839387] systemd[1]: Finished Load Kernel Modules.1942client # [ 1.861948] systemd[1]: Started Journal Service.1943client # [ 1.730250] systemd-modules-load[68]: Inserted module 'dm_mod'1944client # [ 1.732614] systemd-modules-load[68]: Inserted module 'virtio_balloon'1945worker2 # [ 1.845949] systemd[1]: Starting Apply Kernel Variables...1946worker1 # [ 1.849120] systemd[1]: Starting Apply Kernel Variables...1947client # [ 1.735366] systemd-modules-load[68]: Inserted module 'virtio_gpu'1948lb # [ 1.842007] systemd[1]: Finished Load Kernel Modules.1949worker2 # [ 1.857980] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1950client # [ 1.746119] systemd[1]: Finished Create Static Device Nodes in /dev.1951worker1 # [ 1.861487] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1952client # [ 1.749036] systemd[1]: Reached target Preparation for Local File Systems.1953client # [ 1.749976] systemd[1]: Reached target Local File Systems.1954client # [ 1.753093] systemd[1]: Starting Create System Files and Directories...1955lb # [ 1.850090] systemd[1]: Starting Apply Kernel Variables...1956worker2 # [ 1.868486] systemd[1]: Starting Create Static Device Nodes in /dev...1957client # [ 1.758350] systemd[1]: Starting Rule-based Manager for Device Events and Files...1958worker1 # [ 1.872105] systemd[1]: Starting Create Static Device Nodes in /dev...1959lb # [ 1.863057] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1960worker2 # [ 1.881448] systemd[1]: Finished Apply Kernel Variables.1961lb # [ 1.874093] systemd[1]: Starting Create Static Device Nodes in /dev...1962worker2 # [ 1.890963] systemd[1]: Started Journal Service.1963worker1 # [ 1.892447] systemd[1]: Finished Apply Kernel Variables.1964worker2 # [ 1.762233] systemd-modules-load[68]: Inserted module 'dm_mod'1965client # [ 1.783511] systemd[1]: Finished Create System Files and Directories.1966worker1 # [ 1.897467] systemd[1]: Started Journal Service.1967worker2 # [ 1.767103] systemd-modules-load[68]: Inserted module 'virtio_balloon'1968worker1 # [ 1.764722] systemd-modules-load[68]: Inserted module 'dm_mod'1969worker2 # [ 1.768339] systemd-modules-load[68]: Inserted module 'virtio_gpu'1970worker1 # [ 1.768427] systemd-modules-load[68]: Inserted module 'virtio_balloon'1971lb # [ 1.886009] systemd[1]: Finished Apply Kernel Variables.1972worker1 # [ 1.770286] systemd-modules-load[68]: Inserted module 'virtio_gpu'1973worker2 # [ 1.779143] systemd[1]: Finished Create Static Device Nodes in /dev.1974worker2 # [ 1.780263] systemd[1]: Reached target Preparation for Local File Systems.1975worker2 # [ 1.781418] systemd[1]: Reached target Local File Systems.1976worker1 # [ 1.781197] systemd[1]: Finished Create Static Device Nodes in /dev.1977worker1 # [ 1.784079] systemd[1]: Reached target Preparation for Local File Systems.1978worker1 # [ 1.785210] systemd[1]: Reached target Local File Systems.1979worker2 # [ 1.786086] systemd[1]: Starting Create System Files and Directories...1980client # [ 1.806544] systemd-udevd[84]: Using default interface naming scheme 'v261'.1981lb # [ 1.904496] systemd[1]: Started Journal Service.1982worker1 # [ 1.788084] systemd[1]: Starting Create System Files and Directories...1983worker2 # [ 1.791131] systemd[1]: Starting Rule-based Manager for Device Events and Files...1984lb # [ 1.772634] systemd-modules-load[68]: Inserted module 'dm_mod'1985worker1 # [ 1.792683] systemd[1]: Starting Rule-based Manager for Device Events and Files...1986lb # [ 1.776889] systemd-modules-load[68]: Inserted module 'virtio_balloon'1987lb # [ 1.778292] systemd-modules-load[68]: Inserted module 'virtio_gpu'1988lb # [ 1.779325] systemd[1]: Finished Create Static Device Nodes in /dev.1989lb # [ 1.782471] systemd[1]: Reached target Preparation for Local File Systems.1990lb # [ 1.783643] systemd[1]: Reached target Local File Systems.1991lb # [ 1.785286] systemd[1]: Starting Create System Files and Directories...1992lb # [ 1.790130] systemd[1]: Starting Rule-based Manager for Device Events and Files...1993client # [ 1.830815] systemd[1]: Started Rule-based Manager for Device Events and Files.1994worker2 # [ 1.816549] systemd[1]: Finished Create System Files and Directories.1995worker1 # [ 1.818272] systemd[1]: Finished Create System Files and Directories.1996lb # [ 1.820382] systemd[1]: Finished Create System Files and Directories.1997worker2 # [ 1.838349] systemd-udevd[84]: Using default interface naming scheme 'v261'.1998worker1 # [ 1.841370] systemd-udevd[83]: Using default interface naming scheme 'v261'.1999client # [ 1.881668] systemd[1]: Finished Coldplug All udev Devices.2000lb # [ 1.845357] systemd-udevd[75]: Using default interface naming scheme 'v261'.

loading 1,894 hidden lines…

3895lb # [ 11.360431] dhcpcd[783]: eth0: offered 10.0.2.15 from 10.0.2.23896lb # [ 11.363163] dhcpcd[783]: eth0: probing address 10.0.2.15/243897worker1: (finished: waiting for unit network-addresses-eth1.service, in 1.15 seconds)3898worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3899worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3900worker2: waiting for unit network-addresses-eth1.service3901worker2: waiting for the VM to finish booting3902worker2: Guest shell says: b'Spawning backdoor root shell...\n'3903worker2: connected to guest root shell3904worker2: (connecting took 0.00 seconds)3905worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3906worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3907worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3908worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3909lb: waiting for unit niks3.service3910worker1 # [ 11.774137] dhcpcd[694]: eth0: soliciting a DHCP lease3911worker1 # [ 11.928419] NET: Registered PF_PACKET protocol family3912worker1 # [ 11.800911] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.23913worker1 # [ 11.806143] dhcpcd[694]: eth0: probing address 10.0.2.15/243914lb # [ 11.810897] dhcpcd[783]: eth0: soliciting an IPv6 router3915lb # [ 11.812337] dhcpcd[783]: eth0: Router Advertisement from fe80::23916lb # [ 11.813335] dhcpcd[783]: eth0: adding address fec0::5054:ff:fe12:3456/643917lb # [ 11.814527] dhcpcd[783]: eth0: adding route to fec0::/643918lb # [ 11.815463] dhcpcd[783]: eth0: adding default route via fe80::23919worker2 # [ 11.985086] dhcpcd[690]: eth0: soliciting a DHCP lease3920worker2 # [ 12.134665] NET: Registered PF_PACKET protocol family3921worker2 # [ 12.007749] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.23922worker2 # [ 12.011190] dhcpcd[690]: eth0: probing address 10.0.2.15/243923lb # [ 12.333093] postgresql-pre-start[799]: selecting default time zone ... UTC3924lb # [ 12.337869] postgresql-pre-start[799]: creating configuration files ... ok3925lb # [ 12.573186] postgresql-pre-start[799]: running bootstrap script ... ok3926worker1 # [ 12.863865] dhcpcd[694]: eth0: soliciting an IPv6 router3927worker1 # [ 12.865697] dhcpcd[694]: eth0: Router Advertisement from fe80::23928worker1 # [ 12.866838] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/643929worker1 # [ 12.868140] dhcpcd[694]: eth0: adding route to fec0::/643930worker1 # [ 12.869177] dhcpcd[694]: eth0: adding default route via fe80::23931worker2 # [ 12.917540] dhcpcd[690]: eth0: soliciting an IPv6 router3932worker2 # [ 12.919234] dhcpcd[690]: eth0: Router Advertisement from fe80::23933worker2 # [ 12.920564] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/643934worker2 # [ 12.921825] dhcpcd[690]: eth0: adding route to fec0::/643935worker2 # [ 12.922839] dhcpcd[690]: eth0: adding default route via fe80::23936lb # [ 13.162109] postgresql-pre-start[799]: performing post-bootstrap initialization ... ok3937lb # [ 13.288407] postgresql-pre-start[799]: syncing data to disk ... ok3938lb # [ 13.290081] postgresql-pre-start[799]: initdb: warning: enabling "trust" authentication for local connections3939lb # [ 13.291262] postgresql-pre-start[799]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3940lb # [ 13.293054] postgresql-pre-start[799]: Success. You can now start the database server using:3941lb # [ 13.294051] postgresql-pre-start[799]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3942lb # [ 13.394940] postgres[855]: [855] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3943lb # [ 13.399417] postgres[855]: [855] LOG: listening on IPv6 address "::1", port 54323944lb # [ 13.400492] postgres[855]: [855] LOG: listening on IPv4 address "127.0.0.1", port 54323945lb # [ 13.402610] postgres[855]: [855] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3946lb # [ 13.414641] postgres[864]: [864] LOG: database system was shut down at 2026-09-20 09:04:38 GMT3947lb # [ 13.419925] postgres[855]: [855] LOG: database system is ready to accept connections3948lb # [ 13.424404] systemd[1]: Started PostgreSQL Server.3949lb # [ 13.431110] systemd[1]: Starting PostgreSQL Setup Scripts...3950lb # [ 13.628901] postgresql-setup-start[875]: CREATE DATABASE3951lb # [ 13.675593] postgresql-setup-start[881]: CREATE ROLE3952lb # [ 13.697818] postgresql-setup-start[883]: ALTER DATABASE3953lb # [ 13.703943] systemd[1]: Finished PostgreSQL Setup Scripts.3954lb # [ 13.705696] systemd[1]: Reached target PostgreSQL.3955client # [ 14.742284] dhcpcd[566]: eth0: leased 10.0.2.15 for 86400 seconds3956client # [ 14.743250] dhcpcd[566]: eth0: adding route to 10.0.2.0/243957client # [ 14.743958] dhcpcd[566]: eth0: adding default route via 10.0.2.23958client # [ 14.843378] systemd[1]: Started DHCP Client.3959client # [ 14.845528] systemd[1]: Reached target Multi-User System.3960client # [ 14.846714] systemd[1]: Startup finished in 846ms (kernel) + 3.893s (initrd) + 10.106s (userspace) = 14.846s.3961lb # [ 16.525648] dhcpcd[783]: eth0: leased 10.0.2.15 for 86400 seconds3962lb # [ 16.529203] dhcpcd[783]: eth0: adding route to 10.0.2.0/243963lb # [ 16.531988] dhcpcd[783]: eth0: adding default route via 10.0.2.23964worker1 # [ 16.552893] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds3965worker1 # [ 16.554129] dhcpcd[694]: eth0: adding route to 10.0.2.0/243966worker1 # [ 16.554991] dhcpcd[694]: eth0: adding default route via 10.0.2.23967worker1 # [ 16.647886] systemd[1]: Started DHCP Client.3968worker1 # [ 16.649545] systemd[1]: Reached target Multi-User System.3969worker1 # [ 16.650468] systemd[1]: Startup finished in 853ms (kernel) + 4.863s (initrd) + 10.931s (userspace) = 16.649s.3970lb # [ 16.644319] systemd[1]: Started DHCP Client.3971lb # [ 16.646399] systemd[1]: Reached target Network is Online.3972lb # [ 16.650100] systemd[1]: Started Envoy reverse proxy.3973lb # [ 16.654415] systemd[1]: Started mock-oidc.service.3974lb # [ 16.757637] mock-oidc-server[974]: Mock OIDC Server running3975lb # [ 16.758650] mock-oidc-server[974]: OIDC Address: 192.168.1.2:80803976lb # [ 16.759829] mock-oidc-server[974]: Issue Address: 0.0.0.0:80813977lb # [ 16.761136] mock-oidc-server[974]: Issuer: http://192.168.1.2:8080/oidc3978lb # [ 16.762213] mock-oidc-server[974]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3979lb # [ 16.763422] mock-oidc-server[974]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3980lb # [ 16.765058] mock-oidc-server[974]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3981worker2 # [ 17.033705] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds3982worker2 # [ 17.036452] dhcpcd[690]: eth0: adding route to 10.0.2.0/243983worker2 # [ 17.037582] dhcpcd[690]: eth0: adding default route via 10.0.2.23984worker2 # [ 17.157505] systemd[1]: Started DHCP Client.3985worker2 # [ 17.159233] systemd[1]: Reached target Multi-User System.3986worker2 # [ 17.160711] systemd[1]: Startup finished in 849ms (kernel) + 4.839s (initrd) + 11.471s (userspace) = 17.160s.3987lb # [ 17.201568] envoy[973]: [2026-09-20 09:04:42.143][973][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3988lb # [ 17.203311] envoy[973]: [2026-09-20 09:04:42.143][973][info][main] [source/server/server.cc:469] statically linked extensions:3989lb # [ 17.205046] envoy[973]: [2026-09-20 09:04:42.143][973][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3990lb # [ 17.206710] envoy[973]: [2026-09-20 09:04:42.143][973][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3991lb # [ 17.210628] envoy[973]: [2026-09-20 09:04:42.143][973][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3992lb # [ 17.213066] envoy[973]: [2026-09-20 09:04:42.143][973][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3993lb # [ 17.215050] envoy[973]: [2026-09-20 09:04:42.143][973][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3994lb # [ 17.216630] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3995lb # [ 17.218480] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3996lb # [ 17.221506] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3997lb # [ 17.223944] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3998lb # [ 17.225749] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3999lb # [ 17.227433] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4000lb # [ 17.229437] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4001lb # [ 17.231448] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4002lb # [ 17.233570] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4003lb # [ 17.237159] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4004lb # [ 17.239130] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4005lb # [ 17.241264] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4006lb # [ 17.242955] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4007lb # [ 17.244620] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4008lb # [ 17.246663] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4009lb # [ 17.248340] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4010lb # [ 17.250752] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4011lb # [ 17.265443] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4012lb # [ 17.267678] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4013lb # [ 17.270252] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4014lb # [ 17.274073] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4015lb # [ 17.276309] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4016lb # [ 17.278773] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4017lb # [ 17.280439] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4018lb # [ 17.282029] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4019lb # [ 17.284784] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4020lb # [ 17.286465] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4021lb # [ 17.288964] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4022lb # [ 17.297586] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4023lb # [ 17.301791] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4024lb # [ 17.303707] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4025lb # [ 17.305178] envoy[973]: [2026-09-20 09:04:42.147][973][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4026lb # [ 17.309376] envoy[973]: [2026-09-20 09:04:42.149][973][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4027lb # [ 17.315394] envoy[973]: [2026-09-20 09:04:42.149][973][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4028lb # [ 17.320481] envoy[973]: [2026-09-20 09:04:42.149][973][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4029lb # [ 17.322769] envoy[973]: [2026-09-20 09:04:42.149][973][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4030lb # [ 17.324377] envoy[973]: [2026-09-20 09:04:42.149][973][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24031lb # [ 17.326049] envoy[973]: [2026-09-20 09:04:42.149][973][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4032lb # [ 17.327854] envoy[973]: [2026-09-20 09:04:42.149][973][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4033lb # [ 17.351996] envoy[973]: [2026-09-20 09:04:42.153][973][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4034lb # [ 17.354342] envoy[973]: [2026-09-20 09:04:42.153][973][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4035lb # [ 17.356600] envoy[973]: [2026-09-20 09:04:42.153][973][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4036lb # [ 17.358880] envoy[973]: [2026-09-20 09:04:42.153][973][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4037lb # [ 17.360663] envoy[973]: [2026-09-20 09:04:42.153][973][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4038lb # [ 17.366742] envoy[973]: [2026-09-20 09:04:42.153][973][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4039lb # [ 17.368460] envoy[973]: [2026-09-20 09:04:42.153][973][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4040lb # [ 17.372401] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4041lb # [ 17.374356] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4042lb # [ 17.376127] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4043lb # [ 17.378826] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4044lb # [ 17.381558] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4045lb # [ 17.383318] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4046lb # [ 17.385077] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4047lb # [ 17.386858] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4048lb # [ 17.388416] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4049lb # [ 17.389963] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4050lb # [ 17.394179] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4051lb # [ 17.396885] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4052lb # [ 17.402118] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4053lb # [ 17.404303] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4054lb # [ 17.407247] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4055lb # [ 17.409547] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4056lb # [ 17.411939] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4057lb # [ 17.413675] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4058lb # [ 17.417622] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4059lb # [ 17.419257] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4060lb # [ 17.421547] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4061lb # [ 17.423613] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4062lb # [ 17.426818] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24063lb # [ 17.428962] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4064lb # [ 17.431139] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4065lb # [ 17.433080] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4066lb # [ 17.436812] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4067lb # [ 17.438545] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4068lb # [ 17.440887] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4069lb # [ 17.442740] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4070lb # [ 17.444906] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4071lb # [ 17.446946] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4072lb # [ 17.449329] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4073lb # [ 17.451167] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4074lb # [ 17.453163] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4075lb # [ 17.457648] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4076lb # [ 17.459427] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4077lb # [ 17.461154] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4078lb # [ 17.466733] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4079lb # [ 17.468775] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4080lb # [ 17.470533] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4081lb # [ 17.476276] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4082lb # [ 17.477927] envoy[973]: [2026-09-20 09:04:42.157][973][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14083lb # [ 17.480122] envoy[973]: [2026-09-20 09:04:42.161][973][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4084lb # [ 17.481830] envoy[973]: [2026-09-20 09:04:42.161][973][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4085lb # [ 17.483631] envoy[973]: [2026-09-20 09:04:42.161][973][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4086lb # [ 17.494149] envoy[973]: [2026-09-20 09:04:42.161][973][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4087lb # [ 17.495904] envoy[973]: [2026-09-20 09:04:42.161][973][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4088lb # [ 17.498121] envoy[973]: [2026-09-20 09:04:42.161][973][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84089lb # [ 17.499728] envoy[973]: [2026-09-20 09:04:42.164][973][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4090lb # [ 17.502434] envoy[973]: [2026-09-20 09:04:42.164][973][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4091lb # [ 17.504604] envoy[973]: [2026-09-20 09:04:42.164][973][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24092lb # [ 17.506053] envoy[973]: [2026-09-20 09:04:42.166][973][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4093lb # [ 17.507506] envoy[973]: [2026-09-20 09:04:42.263][973][info][main] [source/server/server.cc:531] HTTP header map info:4094lb # [ 17.508869] envoy[973]: [2026-09-20 09:04:42.321][973][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4095lb # [ 17.521300] envoy[973]: [2026-09-20 09:04:42.321][973][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4096lb # [ 17.522785] envoy[973]: [2026-09-20 09:04:42.321][973][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4097lb # [ 17.530103] envoy[973]: [2026-09-20 09:04:42.321][973][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4098lb # [ 17.561084] envoy[973]: [2026-09-20 09:04:42.503][973][info][main] [source/server/server.cc:968] runtime: {}4099lb # [ 17.567663] envoy[973]: [2026-09-20 09:04:42.510][973][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4100lb # [ 17.569761] envoy[973]: [2026-09-20 09:04:42.512][973][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014101lb # [ 17.572481] envoy[973]: [2026-09-20 09:04:42.515][973][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014102lb # [ 17.575217] envoy[973]: [2026-09-20 09:04:42.517][973][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4103lb # [ 17.576775] envoy[973]: [2026-09-20 09:04:42.519][973][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4104lb # [ 17.578284] envoy[973]: [2026-09-20 09:04:42.519][973][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4105lb # [ 17.627834] envoy[973]: [2026-09-20 09:04:42.570][973][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4106worker1 # [ 17.646199] systemd[1]: Starting Nix worker-protocol over gRPC...4107worker2 # [ 17.652857] systemd[1]: Starting Nix worker-protocol over gRPC...4108lb # [ 17.651130] envoy[973]: [2026-09-20 09:04:42.593][973][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4109lb # [ 17.653632] envoy[973]: [2026-09-20 09:04:42.596][973][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4110lb # [ 17.656504] envoy[973]: [2026-09-20 09:04:42.599][973][info][main] [source/server/server.cc:1077] starting main dispatch loop4111worker1 # [ 17.861956] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4112worker1 # [ 17.873608] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14113worker2 # [ 17.882713] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4114worker2 # [ 17.896666] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14115worker1 # [ 17.913562] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4116worker1 # [ 17.917247] systemd[1]: Started Nix worker-protocol over gRPC.4117worker2 # [ 17.934800] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4118worker2 # [ 17.938489] systemd[1]: Started Nix worker-protocol over gRPC.4119lb # [ 17.951505] envoy[973]: [2026-09-20 09:04:42.894][973][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4120lb # [ 17.953412] envoy[973]: [2026-09-20 09:04:42.894][973][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4121lb # [ 17.955323] envoy[973]: [2026-09-20 09:04:42.894][973][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4122lb # [ 17.956824] envoy[973]: [2026-09-20 09:04:42.895][973][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4123worker1 # [ 17.989881] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=scheduler_connected addr=lb:500514124worker1 # [ 18.005574] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4125worker2 # [ 18.016115] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=scheduler_connected addr=lb:500514126worker2 # [ 18.020832] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4127worker1 # [ 18.206697] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=scheduler_connected addr=lb:500514128worker1 # [ 18.212152] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4129worker2 # [ 18.224548] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=scheduler_connected addr=lb:500514130worker2 # [ 18.227739] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4131worker1 # [ 18.412690] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=scheduler_connected addr=lb:500514132worker1 # [ 18.417673] nix-grpc-daemon[787]: ts=2026-09-20T09:04:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4133worker2 # [ 18.425388] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 18.428232] nix-grpc-daemon[783]: ts=2026-09-20T09:04:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4135worker1 # [ 18.620147] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514136worker1 # [ 18.623885] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4137worker2 # [ 18.629382] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514138worker2 # [ 18.631717] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4139worker1 # [ 18.821921] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514140worker1 # [ 18.827118] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4141worker2 # [ 18.832391] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514142worker2 # [ 18.834836] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker1 # [ 19.029241] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514144worker2 # [ 19.035926] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 19.033147] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker2 # [ 19.038192] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4147worker1 # [ 19.230750] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514148worker1 # [ 19.235645] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4149worker2 # [ 19.238778] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514150worker2 # [ 19.241214] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4151worker1 # [ 19.436572] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514152worker2 # [ 19.442091] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_connected addr=lb:500514153worker2 # [ 19.444622] nix-grpc-daemon[783]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker1 # [ 19.441682] nix-grpc-daemon[787]: ts=2026-09-20T09:04:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4155worker1 # [ 19.642922] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514156worker2 # [ 19.645726] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 19.647944] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 19.650927] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4159worker1 # [ 19.849180] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514160worker2 # [ 19.852230] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 19.854407] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker2 # [ 19.857688] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4163worker1 # [ 20.056203] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514164worker2 # [ 20.061165] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 20.061456] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker2 # [ 20.064441] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4167worker2 # [ 20.262253] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514168worker1 # [ 20.262415] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 20.268160] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker2 # [ 20.268308] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4171worker1 # [ 20.468415] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514172worker2 # [ 20.469109] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 20.471751] nix-grpc-daemon[787]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker2 # [ 20.473148] nix-grpc-daemon[783]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4175worker2 # [ 20.673831] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514176worker1 # [ 20.672980] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 20.676554] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker1 # [ 20.677752] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4179worker2 # [ 20.877319] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514180worker1 # [ 20.878605] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 20.883612] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker1 # [ 20.882874] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4183worker1 # [ 21.084743] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514184worker2 # [ 21.087216] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 21.089689] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4186worker2 # [ 21.090369] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4187worker2 # [ 21.287905] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514188worker2 # [ 21.290420] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4189worker1 # [ 21.292262] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 21.296516] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4191worker2 # [ 21.491072] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514192worker2 # [ 21.493955] nix-grpc-daemon[783]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4193worker1 # [ 21.496765] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 21.500681] nix-grpc-daemon[787]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4195worker2 # [ 21.694767] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514196worker2 # [ 21.697133] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4197worker1 # [ 21.701210] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514198worker1 # [ 21.705156] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4199worker2 # [ 21.898181] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514200worker2 # [ 21.900369] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4201worker1 # [ 21.905392] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 21.907230] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4203worker2 # [ 22.101571] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514204worker2 # [ 22.103330] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4205worker1 # [ 22.109473] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 22.112622] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4207worker2 # [ 22.304259] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514208worker2 # [ 22.306362] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4209worker1 # [ 22.310383] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514210worker1 # [ 22.314295] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4211worker2 # [ 22.507266] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514212worker2 # [ 22.509435] nix-grpc-daemon[783]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4213worker1 # [ 22.514781] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 22.518863] nix-grpc-daemon[787]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4215worker2 # [ 22.710279] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514216worker2 # [ 22.712398] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4217worker1 # [ 22.719676] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514218worker1 # [ 22.723782] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4219worker2 # [ 22.913290] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514220worker2 # [ 22.915352] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4221worker1 # [ 22.924229] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514222worker1 # [ 22.928669] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker2 # [ 23.118117] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514224worker2 # [ 23.122792] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4225worker1 # [ 23.130117] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 23.133840] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4227worker2 # [ 23.323714] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514228worker2 # [ 23.327791] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4229worker1 # [ 23.334738] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 23.338741] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4231worker2 # [ 23.528486] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514232worker2 # [ 23.531949] nix-grpc-daemon[783]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4233worker1 # [ 23.539376] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 23.542335] nix-grpc-daemon[787]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235worker2 # [ 23.732738] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514236worker2 # [ 23.737091] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4237worker1 # [ 23.742828] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514238worker1 # [ 23.745256] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4239worker2 # [ 23.937287] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514240worker2 # [ 23.939768] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4241worker1 # [ 23.946185] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 23.949916] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243worker2 # [ 24.141946] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514244worker2 # [ 24.145985] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4245worker1 # [ 24.151663] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 24.155678] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4247worker2 # [ 24.347302] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514248worker2 # [ 24.351536] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4249worker1 # [ 24.356397] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 24.360572] nix-grpc-daemon[787]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4251worker2 # [ 24.552531] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500514252worker2 # [ 24.556549] nix-grpc-daemon[783]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4253worker1 # [ 24.561090] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514254worker1 # [ 24.565169] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4255worker2 # [ 24.757519] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514256worker2 # [ 24.761713] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4257worker1 # [ 24.765652] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 24.769657] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4259worker2 # [ 24.962115] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514260worker2 # [ 24.964026] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4261worker1 # [ 24.970098] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514262worker1 # [ 24.975145] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4263lb # [ 25.005960] rustfs-bucket-start[1065]: mb s3://farm4264lb # [ 25.011575] systemd[1]: Finished rustfs-bucket.service.4265lb # [ 25.017909] systemd[1]: Starting niks3 server...4266worker2 # [ 25.166175] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514267worker2 # [ 25.170181] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker1 # [ 25.175310] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514269worker1 # [ 25.179496] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4270lb # [ 25.239556] postgres[1080]: [1080] ERROR: relation "goose_db_version" does not exist at character 364271lb # [ 25.240754] postgres[1080]: [1080] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4272lb # [ 25.278550] niks3-server[1074]: 2026/09/20 09:04:50 OK 20241026095416_initial_model.sql (20.46ms)4273lb # [ 25.281982] niks3-server[1074]: 2026/09/20 09:04:50 OK 20251210153512_drop_unused_gin_index.sql (2.31ms)4274lb # [ 25.287539] niks3-server[1074]: 2026/09/20 09:04:50 OK 20251218171726_add_pins.sql (5.35ms)4275lb # [ 25.292914] niks3-server[1074]: 2026/09/20 09:04:50 OK 20260628120000_add_object_size_and_stats.sql (3.92ms)4276lb # [ 25.297605] niks3-server[1074]: 2026/09/20 09:04:50 OK 20260905000000_add_claims.sql (3.29ms)4277lb # [ 25.301879] niks3-server[1074]: 2026/09/20 09:04:50 OK 20260920000000_drop_claims.sql (4.18ms)4278lb # [ 25.303084] niks3-server[1074]: 2026/09/20 09:04:50 goose: successfully migrated database to version: 202609200000004279lb # [ 25.308778] niks3-server[1074]: 2026/09/20 09:04:50 OK 1_commit_pending_closure.sql (6.88ms)4280lb # [ 25.311247] niks3-server[1074]: 2026/09/20 09:04:50 OK 2_object_stats_trigger.sql (2.45ms)4281lb # [ 25.312430] niks3-server[1074]: 2026/09/20 09:04:50 goose: up to current file version: 24282lb # [ 25.318700] niks3-server[1074]: 2026/09/20 09:04:50 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4283worker2 # [ 25.371416] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514284worker2 # [ 25.375479] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4285worker1 # [ 25.379952] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 25.383894] nix-grpc-daemon[787]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287lb # [ 25.391872] niks3-server[1074]: 2026/09/20 09:04:50 INFO Read proxy enabled — serving cache objects from S34288lb # [ 25.393653] niks3-server[1074]: 2026/09/20 09:04:50 INFO Using socket-activated listener address=0.0.0.0:57514289lb # [ 25.398608] niks3-server[1074]: 2026/09/20 09:04:50 INFO systemd watchdog enabled interval=15s4290lb # [ 25.399795] systemd[1]: Started niks3 server.4291lb # [ 25.400473] systemd[1]: Reached target Multi-User System.4292lb # [ 25.403036] systemd[1]: Startup finished in 862ms (kernel) + 3.944s (initrd) + 20.594s (userspace) = 25.402s.4293lb # [ 25.404658] niks3-server[1074]: 2026/09/20 09:04:50 INFO Starting HTTP server address=0.0.0.0:57514294lb # [ 25.410245] niks3-server[1074]: 2026/09/20 09:04:50 INFO lead: acquired remote=192.168.1.4:588444295worker2 # [ 25.433526] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_take_over4296worker2 # [ 25.576517] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500514297worker2 # [ 25.580710] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4298worker1 # [ 25.584956] nix-grpc-daemon[787]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500514299worker2 # [ 25.588345] nix-grpc-daemon[783]: ts=2026-09-20T09:04:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04300lb: (finished: waiting for unit niks3.service, in 14.18 seconds)4301lb: waiting for TCP port 5751 on localhost4302worker2 # [ 25.781975] nix-grpc-daemon[783]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500514303worker2 # [ 25.786264] nix-grpc-daemon[783]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4305lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4306lb: waiting for unit envoy.service4307lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4308lb: waiting for TCP port 50051 on localhost4309lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4310lb # [ 25.907507] envoy[973]: conn peer=[::1]:46094 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24311lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4312worker2 # [ 25.987095] nix-grpc-daemon[783]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500514313worker2 # [ 25.988949] nix-grpc-daemon[783]: ts=2026-09-20T09:04:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04314lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4315??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4316 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284317lb: must succeed: curl -sf localhost:9901/clusters4318lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4319lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)4320subtest: one node schedules and both builders hold a WorkerSession on it4321lb: must succeed: curl -sf localhost:9901/clusters4322lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4323worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4324worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4325(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.12 seconds)4326subtest: balancer auth: client cert, bearer token, nothing, unknown CN4327worker1 # [ 26.533321] nix-grpc-daemon[787]: ts=2026-09-20T09:04:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500064328worker1 # [ 26.548279] systemd[1]: Started Nix Daemon.4329worker1 # [ 26.793126] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4330worker1 # [ 26.836422] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)4331worker1 # [ 26.910417] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 2/5)4332worker1 # [ 26.999990] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 3/5)4333worker1 # [ 27.134768] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 748 ms (attempt 4/5)4334worker1 # [ 27.894257] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4335worker1 # [ 27.917146] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500064336worker1 # [ 27.927584] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4337worker1 # [ 27.937080] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500064338worker1 # [ 27.940700] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4339client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4340client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4341client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4342client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4343worker1 # [ 28.265591] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=info event=oidc_jwks provider=mock keys=14344worker1 # [ 28.270431] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:500064345worker1 # [ 28.282612] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:500064346worker1 # [ 28.291512] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4347worker1 # [ 28.300495] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:500064348worker1 # [ 28.309129] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=debug event=path_info_miss path=akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test error="error: path '/nix/store/akn52nnm33csynnyhwrqayy7c3050vjf-nixos-system-client-test' is required, but there is no substituter that can build it"4349client: must succeed: rm -r /var/lib/nix-grpc-store4350client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds)4351worker1 # [ 28.534403] nix-grpc-daemon[787]: ts=2026-09-20T09:04:52Z level=info event=denied method=QueryMissing cn=- role=none4352worker1 # [ 28.746178] nix-grpc-daemon[787]: ts=2026-09-20T09:04:53Z level=info event=denied method=QueryMissing cn=stranger role=none4353(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.55 seconds)4354subtest: DAG build is scheduled across workers and lands in the cache4355client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24356worker1 # [ 28.967706] nix-grpc-daemon[787]: ts=2026-09-20T09:04:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500064357client # don't know how to build these paths:4358client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4359worker1 # [ 28.980224] nix-grpc-daemon[787]: ts=2026-09-20T09:04:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064360worker2 # [ 29.018120] nix-grpc-daemon[783]: ts=2026-09-20T09:04:53Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04361worker2 # [ 29.019868] nix-grpc-daemon[783]: ts=2026-09-20T09:04:53Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14362worker1 # [ 29.069239] nix-grpc-daemon[787]: ts=2026-09-20T09:04:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064363worker1 # [ 29.087095] nix-grpc-daemon[787]: ts=2026-09-20T09:04:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064364client # copying 1 paths to 'lb:50051'...4365worker1 # [ 29.098575] nix-grpc-daemon[787]: ts=2026-09-20T09:04:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500064366client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4367worker1 # [ 29.127283] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4368worker1 # [ 29.150723] nix-grpc-daemon[787]: ts=2026-09-20T09:04:53Z level=info event=niks3_push_started pid=8534369worker1 # [ 29.576940] nix-daemon[843]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4370worker1 # [ 29.593287] nix-daemon[843]: reaped child process 869, status = succeeded4371worker1 # [ 29.727074] nix-daemon[843]: accepted connection from pid 871, user nix-grpc-daemon (trusted)4372worker1 # [ 29.740466] nix-daemon[843]: reaped child process 874, status = succeeded4373lb # [ 29.739109] niks3-server[1074]: 2026/09/20 09:04:54 INFO Received uploads request method=POST path=/api/pending_closures4374worker1 # [ 29.781673] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.232Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4375worker1 # [ 29.784611] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.235Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4376lb # [ 29.807915] niks3-server[1074]: 2026/09/20 09:04:54 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4377lb # [ 29.810963] niks3-server[1074]: 2026/09/20 09:04:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4378lb # [ 29.816066] niks3-server[1074]: 2026/09/20 09:04:54 INFO Signed narinfos id=1 count=14379worker1 # [ 29.834118] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.285Z level=INFO msg="Uploading 1 narinfos"4380lb # [ 29.826577] niks3-server[1074]: 2026/09/20 09:04:54 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4381lb # [ 29.836928] niks3-server[1074]: 2026/09/20 09:04:54 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4382lb # [ 29.842607] niks3-server[1074]: 2026/09/20 09:04:54 INFO Completed upload id=14383worker1 # [ 29.859666] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.310Z level=INFO msg="Upload complete. (441ms)"4384worker1 # [ 29.864770] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.314Z level=WARN msg="Failed to register uploaded object" key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo error="server returned 404: object is not pending upload\n"4385worker1 # [ 29.873683] nix-grpc-daemon[787]: ts=2026-09-20T09:04:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_in=5044386worker1 # [ 29.877583] nix-grpc-daemon[787]: ts=2026-09-20T09:04:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064387worker1 # [ 29.887071] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4388worker1 # [ 29.896837] nix-daemon[843]: reaped child process 851, status = succeeded4389client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4390client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4391worker1 # [ 29.900558] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4392client # farm-a> LOG-farm-a-t14393worker1 # [ 30.914295] nix-daemon[843]: reaped child process 878, status = succeeded4394worker1 # [ 31.048333] nix-daemon[843]: accepted connection from pid 894, user nix-grpc-daemon (trusted)4395worker1 # [ 31.059053] nix-daemon[843]: reaped child process 897, status = succeeded4396lb # [ 31.058732] niks3-server[1074]: 2026/09/20 09:04:56 INFO Received uploads request method=POST path=/api/pending_closures4397worker1 # [ 31.088446] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.539Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4398worker1 # [ 31.090079] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.541Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4399lb # [ 31.113807] niks3-server[1074]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4400lb # [ 31.120239] niks3-server[1074]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4401lb # [ 31.132246] niks3-server[1074]: 2026/09/20 09:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4402lb # [ 31.137232] niks3-server[1074]: 2026/09/20 09:04:56 INFO Signed narinfos id=2 count=14403lb # [ 31.140644] niks3-server[1074]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4404worker1 # [ 31.157127] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.608Z level=INFO msg="Uploading 1 narinfos"4405lb # [ 31.148063] niks3-server[1074]: 2026/09/20 09:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4406lb # [ 31.151879] niks3-server[1074]: 2026/09/20 09:04:56 INFO Completed upload id=24407lb # [ 31.153616] niks3-server[1074]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4408worker1 # [ 31.169808] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.621Z level=INFO msg="Upload complete. (261ms)"4409worker1 # [ 31.175921] nix-grpc-daemon[787]: ts=2026-09-20T09:04:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14410worker1 # [ 31.188608] nix-daemon[843]: reaped child process 876, status = succeeded4411worker2 # [ 31.192355] nix-grpc-daemon[783]: ts=2026-09-20T09:04:55Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04412worker2 # [ 31.196306] nix-grpc-daemon[783]: ts=2026-09-20T09:04:55Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14413worker1 # [ 31.237697] nix-grpc-daemon[787]: ts=2026-09-20T09:04:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064414worker1 # [ 31.250302] nix-grpc-daemon[787]: ts=2026-09-20T09:04:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064415worker1 # [ 31.263543] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.715Z level=INFO msg="All 1 paths already cached"4416client # copying 1 paths to 'lb:50051'...4417worker1 # [ 31.270603] nix-grpc-daemon[787]: ts=2026-09-20T09:04:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500064418client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4419worker1 # [ 31.282160] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4420worker1 # [ 31.452639] nix-daemon[843]: accepted connection from pid 901, user nix-grpc-daemon (trusted)4421worker1 # [ 31.467420] nix-daemon[843]: reaped child process 904, status = succeeded4422worker1 # [ 31.609532] nix-daemon[843]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4423worker1 # [ 31.623166] nix-daemon[843]: reaped child process 909, status = succeeded4424lb # [ 31.615237] niks3-server[1074]: 2026/09/20 09:04:56 INFO Received uploads request method=POST path=/api/pending_closures4425worker1 # [ 31.640185] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.091Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4426worker1 # [ 31.641743] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.093Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4427lb # [ 31.644610] niks3-server[1074]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4428lb # [ 31.654846] niks3-server[1074]: 2026/09/20 09:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4429worker1 # [ 31.676094] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.127Z level=INFO msg="Uploading 1 narinfos"4430lb # [ 31.659923] niks3-server[1074]: 2026/09/20 09:04:56 INFO Signed narinfos id=3 count=14431lb # [ 31.665522] niks3-server[1074]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4432lb # [ 31.676349] niks3-server[1074]: 2026/09/20 09:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4433lb # [ 31.683752] niks3-server[1074]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4434lb # [ 31.688891] niks3-server[1074]: 2026/09/20 09:04:56 INFO Completed upload id=34435worker1 # [ 31.705562] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.157Z level=INFO msg="Upload complete. (410ms)"4436worker1 # [ 31.709291] nix-grpc-daemon[787]: ts=2026-09-20T09:04:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_in=6244437worker1 # [ 31.714266] nix-grpc-daemon[787]: ts=2026-09-20T09:04:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064438worker1 # [ 31.722407] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4439worker1 # [ 31.732662] nix-daemon[843]: reaped child process 899, status = succeeded4440worker1 # [ 31.735597] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4441client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4442client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4443client # farm-b> LOG-farm-b-t14444worker1 # [ 32.749565] nix-daemon[843]: reaped child process 913, status = succeeded4445worker1 # [ 32.875736] nix-daemon[843]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4446worker1 # [ 32.887978] nix-daemon[843]: reaped child process 931, status = succeeded4447lb # [ 32.886699] niks3-server[1074]: 2026/09/20 09:04:57 INFO Received uploads request method=POST path=/api/pending_closures4448worker1 # [ 32.911957] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.363Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4449worker1 # [ 32.913893] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.365Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4450lb # [ 32.927045] niks3-server[1074]: 2026/09/20 09:04:57 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4451lb # [ 32.934621] niks3-server[1074]: 2026/09/20 09:04:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4452lb # [ 32.938199] niks3-server[1074]: 2026/09/20 09:04:57 INFO Signed narinfos id=4 count=14453worker1 # [ 32.957271] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.408Z level=INFO msg="Uploading 1 narinfos"4454lb # [ 32.944749] niks3-server[1074]: 2026/09/20 09:04:57 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4455lb # [ 32.950605] niks3-server[1074]: 2026/09/20 09:04:57 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4456lb # [ 32.957465] niks3-server[1074]: 2026/09/20 09:04:57 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4457lb # [ 32.961122] niks3-server[1074]: 2026/09/20 09:04:57 INFO Completed upload id=44458lb # [ 32.962612] niks3-server[1074]: 2026/09/20 09:04:57 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4459worker1 # [ 32.977710] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.429Z level=INFO msg="Upload complete. (235ms)"4460worker1 # [ 32.983513] nix-grpc-daemon[787]: ts=2026-09-20T09:04:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14461worker2 # [ 32.989381] nix-grpc-daemon[783]: ts=2026-09-20T09:04:57Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04462worker2 # [ 32.993572] nix-grpc-daemon[783]: ts=2026-09-20T09:04:57Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14463worker1 # [ 32.996110] nix-daemon[843]: reaped child process 911, status = succeeded4464worker1 # [ 33.032236] nix-grpc-daemon[787]: ts=2026-09-20T09:04:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064465worker1 # [ 33.046606] nix-grpc-daemon[787]: ts=2026-09-20T09:04:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064466client # copying 1 paths to 'lb:50051'...4467worker1 # [ 33.059627] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.510Z level=INFO msg="All 2 paths already cached"4468client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4469worker1 # [ 33.063538] nix-grpc-daemon[787]: ts=2026-09-20T09:04:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500064470worker1 # [ 33.073486] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4471worker1 # [ 33.242483] nix-daemon[843]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4472worker1 # [ 33.253193] nix-daemon[843]: reaped child process 939, status = succeeded4473worker1 # [ 33.384141] nix-daemon[843]: accepted connection from pid 941, user nix-grpc-daemon (trusted)4474worker1 # [ 33.396629] nix-daemon[843]: reaped child process 944, status = succeeded4475lb # [ 33.393579] niks3-server[1074]: 2026/09/20 09:04:58 INFO Received uploads request method=POST path=/api/pending_closures4476worker1 # [ 33.418026] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.869Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4477worker1 # [ 33.419882] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.871Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4478lb # [ 33.421077] niks3-server[1074]: 2026/09/20 09:04:58 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4479lb # [ 33.430055] niks3-server[1074]: 2026/09/20 09:04:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4480lb # [ 33.436800] niks3-server[1074]: 2026/09/20 09:04:58 INFO Signed narinfos id=5 count=14481worker1 # [ 33.456138] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.907Z level=INFO msg="Uploading 1 narinfos"4482lb # [ 33.440353] niks3-server[1074]: 2026/09/20 09:04:58 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4483lb # [ 33.452925] niks3-server[1074]: 2026/09/20 09:04:58 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4484lb # [ 33.459253] niks3-server[1074]: 2026/09/20 09:04:58 INFO Completed upload id=54485worker1 # [ 33.475891] nix-grpc-daemon[853]: time=2026-09-20T09:04:57.927Z level=INFO msg="Upload complete. (383ms)"4486lb # [ 33.462368] niks3-server[1074]: 2026/09/20 09:04:58 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4487worker1 # [ 33.479537] nix-grpc-daemon[787]: ts=2026-09-20T09:04:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_in=7524488worker1 # [ 33.485383] nix-grpc-daemon[787]: ts=2026-09-20T09:04:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064489worker1 # [ 33.493233] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4490worker1 # [ 33.497171] nix-daemon[843]: reaped child process 933, status = succeeded4491worker1 # [ 33.502113] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4492client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4493client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4494client # farm-top> LOG-farm-top-t14495worker1 # [ 34.323365] nix-daemon[843]: reaped child process 948, status = succeeded4496worker1 # [ 34.440736] nix-daemon[843]: accepted connection from pid 963, user nix-grpc-daemon (trusted)4497worker1 # [ 34.451673] nix-daemon[843]: reaped child process 966, status = succeeded4498lb # [ 34.445243] niks3-server[1074]: 2026/09/20 09:04:59 INFO Received uploads request method=POST path=/api/pending_closures4499worker1 # [ 34.470492] nix-grpc-daemon[853]: time=2026-09-20T09:04:58.922Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4500worker1 # [ 34.471962] nix-grpc-daemon[853]: time=2026-09-20T09:04:58.923Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4501lb # [ 34.482588] niks3-server[1074]: 2026/09/20 09:04:59 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4502lb # [ 34.490366] niks3-server[1074]: 2026/09/20 09:04:59 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4503lb # [ 34.500188] niks3-server[1074]: 2026/09/20 09:04:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4504lb # [ 34.504627] niks3-server[1074]: 2026/09/20 09:04:59 INFO Signed narinfos id=6 count=14505worker1 # [ 34.524136] nix-grpc-daemon[853]: time=2026-09-20T09:04:58.975Z level=INFO msg="Uploading 1 narinfos"4506lb # [ 34.512730] niks3-server[1074]: 2026/09/20 09:04:59 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4507lb # [ 34.520442] niks3-server[1074]: 2026/09/20 09:04:59 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4508lb # [ 34.526401] niks3-server[1074]: 2026/09/20 09:04:59 INFO Completed upload id=64509worker1 # [ 34.542970] nix-grpc-daemon[853]: time=2026-09-20T09:04:58.994Z level=INFO msg="Upload complete. (234ms)"4510lb # [ 34.529415] niks3-server[1074]: 2026/09/20 09:04:59 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4511worker1 # [ 34.547426] nix-grpc-daemon[787]: ts=2026-09-20T09:04:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14512worker1 # [ 34.559916] nix-daemon[843]: reaped child process 946, status = succeeded4513client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 5.81 seconds)4514client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4515client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.15 seconds)4516client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4517client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4518client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4519client # copying 3 paths...4520client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4521client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4522client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4523client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4524(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.32 seconds)4525subtest: repeat is answered Cached by the scheduler without building4526worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4527worker1 # finding garbage collector roots...4528worker1 # deleting specified paths...4529worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4530worker1 # deleting unused links...4531worker1 # note: hard linking is currently saving 0.0 KiB4532worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4533worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4534worker2 # finding garbage collector roots...4535worker2 # deleting specified paths...4536worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4537worker2 # deleting unused links...4538worker2 # note: hard linking is currently saving 0.0 KiB4539worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4540client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24541worker2 # [ 35.800762] nix-grpc-daemon[783]: ts=2026-09-20T09:05:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:554444542worker2 # [ 35.813931] systemd[1]: Started Nix Daemon.4543worker2 # [ 35.989026] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4544client # don't know how to build these paths:4545client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4546worker1 # [ 36.001705] nix-grpc-daemon[787]: ts=2026-09-20T09:05:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064547worker1 # [ 36.006651] nix-grpc-daemon[853]: time=2026-09-20T09:05:00.458Z level=INFO msg="All 2 paths already cached"4548worker2 # [ 36.014967] nix-grpc-daemon[783]: ts=2026-09-20T09:05:00Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14549client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.44 seconds)4550client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4551client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.15 seconds)4552lb: must succeed: curl -sf localhost:9901/clusters4553lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4554lb: must succeed: curl -sf localhost:9901/clusters4555lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4556worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4557worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.05 seconds)4558(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.35 seconds)4559subtest: inputs already in the cache are not sent to the scheduler4560lb: must succeed: curl -sf localhost:9901/clusters4561lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4562lb: must succeed: curl -sf localhost:9901/clusters4563lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4564worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4565worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4566client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24567worker1 # [ 36.700343] nix-grpc-daemon[787]: ts=2026-09-20T09:05:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500064568client # don't know how to build these paths:4569client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4570worker2 # [ 36.706341] nix-grpc-daemon[783]: ts=2026-09-20T09:05:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554444571worker2 # [ 36.724200] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5)4572worker2 # [ 36.774432] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5)4573worker2 # [ 36.928248] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 349 ms (attempt 3/5)4574worker2 # [ 37.277563] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 4/5)4575worker2 # [ 37.353954] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4576worker2 # [ 37.381697] nix-grpc-daemon[783]: ts=2026-09-20T09:05:01Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04577worker2 # [ 37.383781] nix-grpc-daemon[783]: ts=2026-09-20T09:05:01Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14578worker1 # [ 37.425113] nix-grpc-daemon[787]: ts=2026-09-20T09:05:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064579worker1 # [ 37.432876] nix-grpc-daemon[787]: ts=2026-09-20T09:05:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064580worker1 # [ 37.441938] nix-grpc-daemon[853]: time=2026-09-20T09:05:01.893Z level=INFO msg="All 2 paths already cached"4581client # copying 1 paths to 'lb:50051'...4582client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4583worker1 # [ 37.446404] nix-grpc-daemon[787]: ts=2026-09-20T09:05:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500064584worker1 # [ 37.452119] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4585worker1 # [ 37.608864] nix-daemon[843]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4586worker1 # [ 37.622846] nix-daemon[843]: reaped child process 987, status = succeeded4587lb # [ 37.636375] envoy[973]: conn peer=[2001:db8:1::1]:41144 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=364 ms=14574588lb # [ 37.640430] envoy[973]: conn peer=[2001:db8:1::1]:41158 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=734589lb # [ 37.645267] envoy[973]: conn peer=[2001:db8:1::1]:41174 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=144590lb # [ 37.648584] envoy[973]: conn peer=[2001:db8:1::1]:41190 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84591lb # [ 37.652100] envoy[973]: conn peer=[2001:db8:1::1]:41204 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=3820 ms=56254592lb # [ 37.655614] envoy[973]: conn peer=[2001:db8:1::1]:38766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=2374593worker1 # [ 37.789123] nix-daemon[843]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4594worker1 # [ 37.800667] nix-daemon[843]: reaped child process 992, status = succeeded4595lb # [ 37.798617] niks3-server[1074]: 2026/09/20 09:05:02 INFO Received uploads request method=POST path=/api/pending_closures4596worker1 # [ 37.824245] nix-grpc-daemon[853]: time=2026-09-20T09:05:02.275Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4597worker1 # [ 37.825577] nix-grpc-daemon[853]: time=2026-09-20T09:05:02.275Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4598lb # [ 37.827510] niks3-server[1074]: 2026/09/20 09:05:02 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4599lb # [ 37.838270] niks3-server[1074]: 2026/09/20 09:05:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4600worker1 # [ 37.861495] nix-grpc-daemon[853]: time=2026-09-20T09:05:02.313Z level=INFO msg="Uploading 1 narinfos"4601lb # [ 37.844863] niks3-server[1074]: 2026/09/20 09:05:02 INFO Signed narinfos id=7 count=14602lb # [ 37.851302] niks3-server[1074]: 2026/09/20 09:05:02 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4603lb # [ 37.862467] niks3-server[1074]: 2026/09/20 09:05:02 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4604lb # [ 37.868334] niks3-server[1074]: 2026/09/20 09:05:02 INFO Completed upload id=74605worker1 # [ 37.884843] nix-grpc-daemon[853]: time=2026-09-20T09:05:02.336Z level=INFO msg="Upload complete. (427ms)"4606worker1 # [ 37.888293] nix-grpc-daemon[787]: ts=2026-09-20T09:05:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_in=7524607lb # [ 37.873602] niks3-server[1074]: 2026/09/20 09:05:02 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4608worker1 # [ 37.894270] nix-grpc-daemon[787]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064609worker1 # [ 37.903245] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4610worker1 # [ 37.907950] nix-daemon[843]: reaped child process 982, status = succeeded4611client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4612client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4613worker1 # [ 37.914067] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4614client # farm-top> LOG-farm-top-t1b4615worker1 # [ 39.330201] nix-daemon[843]: reaped child process 996, status = succeeded4616worker1 # [ 39.489046] nix-daemon[843]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4617worker1 # [ 39.503932] nix-daemon[843]: reaped child process 1014, status = succeeded4618lb # [ 39.508283] niks3-server[1074]: 2026/09/20 09:05:04 INFO Received uploads request method=POST path=/api/pending_closures4619worker1 # [ 39.535148] nix-grpc-daemon[853]: time=2026-09-20T09:05:03.986Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4620worker1 # [ 39.539109] nix-grpc-daemon[853]: time=2026-09-20T09:05:03.988Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4621lb # [ 39.552945] niks3-server[1074]: 2026/09/20 09:05:04 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4622lb # [ 39.557410] niks3-server[1074]: 2026/09/20 09:05:04 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4623lb # [ 39.561938] niks3-server[1074]: 2026/09/20 09:05:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4624lb # [ 39.566872] niks3-server[1074]: 2026/09/20 09:05:04 INFO Signed narinfos id=8 count=14625worker1 # [ 39.585722] nix-grpc-daemon[853]: time=2026-09-20T09:05:04.037Z level=INFO msg="Uploading 1 narinfos"4626lb # [ 39.570726] niks3-server[1074]: 2026/09/20 09:05:04 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4627lb # [ 39.574397] niks3-server[1074]: 2026/09/20 09:05:04 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4628lb # [ 39.577676] niks3-server[1074]: 2026/09/20 09:05:04 INFO Completed upload id=84629worker1 # [ 39.594218] nix-grpc-daemon[853]: time=2026-09-20T09:05:04.045Z level=INFO msg="Upload complete. (273ms)"4630lb # [ 39.580547] niks3-server[1074]: 2026/09/20 09:05:04 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4631worker1 # [ 39.596638] nix-grpc-daemon[787]: ts=2026-09-20T09:05:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14632worker1 # [ 39.603339] nix-daemon[843]: reaped child process 994, status = succeeded4633client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.09 seconds)4634client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4635client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds)4636lb: must succeed: curl -sf localhost:9901/clusters4637lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4638lb: must succeed: curl -sf localhost:9901/clusters4639lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4640worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4641worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4642(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.53 seconds)4643subtest: two clients wanting the same drv build it once4644client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4645client # [ 40.039840] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4646client # Running as unit: dedup1.service; invocation ID: f35512d7ec264255b6ef2b444c827b264647client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4648client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4649worker1 # [ 40.226394] nix-grpc-daemon[787]: ts=2026-09-20T09:05:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500064650client # [ 40.253207] nix[883]: don't know how to build these paths:4651client # [ 40.254180] nix[883]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4652worker2 # [ 40.241708] nix-grpc-daemon[783]: ts=2026-09-20T09:05:04Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04653worker2 # [ 40.245934] nix-grpc-daemon[783]: ts=2026-09-20T09:05:04Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14654worker2 # [ 40.283869] nix-grpc-daemon[783]: ts=2026-09-20T09:05:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554444655worker2 # [ 40.306501] nix-grpc-daemon[783]: ts=2026-09-20T09:05:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554444656client # [ 40.335349] nix[883]: copying 1 paths to 'lb:50051'...4657worker2 # [ 40.316257] nix-grpc-daemon[783]: ts=2026-09-20T09:05:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:554444658client # [ 40.337270] nix[883]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4659worker2 # [ 40.329747] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4660worker2 # [ 40.350369] nix-grpc-daemon[783]: ts=2026-09-20T09:05:04Z level=info event=niks3_push_started pid=8984661worker2 # [ 40.829229] nix-daemon[862]: accepted connection from pid 909, user nix-grpc-daemon (trusted)4662worker2 # [ 40.845319] nix-daemon[862]: reaped child process 913, status = succeeded4663worker2 # [ 41.013262] nix-daemon[862]: accepted connection from pid 915, user nix-grpc-daemon (trusted)4664worker2 # [ 41.026420] nix-daemon[862]: reaped child process 918, status = succeeded4665lb # [ 41.024888] niks3-server[1074]: 2026/09/20 09:05:05 INFO Received uploads request method=POST path=/api/pending_closures4666worker2 # [ 41.048605] nix-grpc-daemon[898]: time=2026-09-20T09:05:05.435Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4667worker2 # [ 41.052207] nix-grpc-daemon[898]: time=2026-09-20T09:05:05.439Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4668lb # [ 41.052185] niks3-server[1074]: 2026/09/20 09:05:05 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4669lb # [ 41.055058] niks3-server[1074]: 2026/09/20 09:05:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4670lb # [ 41.057859] niks3-server[1074]: 2026/09/20 09:05:06 INFO Signed narinfos id=9 count=14671worker2 # [ 41.074943] nix-grpc-daemon[898]: time=2026-09-20T09:05:05.463Z level=INFO msg="Uploading 1 narinfos"4672lb # [ 41.060641] niks3-server[1074]: 2026/09/20 09:05:06 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4673lb # [ 41.065148] niks3-server[1074]: 2026/09/20 09:05:06 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4674lb # [ 41.068260] niks3-server[1074]: 2026/09/20 09:05:06 INFO Completed upload id=94675worker2 # [ 41.085380] nix-grpc-daemon[898]: time=2026-09-20T09:05:05.473Z level=INFO msg="Upload complete. (438ms)"4676lb # [ 41.070520] niks3-server[1074]: 2026/09/20 09:05:06 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4677worker2 # [ 41.087611] nix-grpc-daemon[783]: ts=2026-09-20T09:05:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=0 paths=1 nar_bytes_in=4324678worker2 # [ 41.093506] nix-daemon[862]: reaped child process 896, status = succeeded4679worker2 # [ 41.095525] nix-grpc-daemon[783]: ts=2026-09-20T09:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554444680worker2 # [ 41.099350] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4681worker2 # [ 41.106107] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4682client # [ 41.122190] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4683client # [ 41.134866] nix[883]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4684client # Running as unit: dedup2.service; invocation ID: 2d26d40f643b4346be5cbb60a817f69a4685client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4686client # [ 41.416536] nix[899]: don't know how to build these paths:4687client # [ 41.417427] nix[899]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4688worker1 # [ 41.395120] nix-grpc-daemon[787]: ts=2026-09-20T09:05:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500064689worker2 # [ 41.408877] nix-grpc-daemon[783]: ts=2026-09-20T09:05:05Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04690client # [ 41.433847] nix[899]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4691worker2 # [ 41.414377] nix-grpc-daemon[783]: ts=2026-09-20T09:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554444692client: must succeed: sleep 24693client: (finished: must succeed: sleep 2, in 2.05 seconds)4694??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4695 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394696client: waiting for success: ! systemctl is-active dedup1 dedup24697??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4698 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394699worker2 # [ 44.722773] nix-daemon[862]: reaped child process 922, status = succeeded4700worker2 # [ 44.860397] nix-daemon[862]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4701worker2 # [ 44.872712] nix-daemon[862]: reaped child process 957, status = succeeded4702lb # [ 44.868690] niks3-server[1074]: 2026/09/20 09:05:09 INFO Received uploads request method=POST path=/api/pending_closures4703worker2 # [ 44.891237] nix-grpc-daemon[898]: time=2026-09-20T09:05:09.279Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4704worker2 # [ 44.892795] nix-grpc-daemon[898]: time=2026-09-20T09:05:09.280Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4705lb # [ 44.907781] niks3-server[1074]: 2026/09/20 09:05:09 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4706lb # [ 44.920615] niks3-server[1074]: 2026/09/20 09:05:09 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4707lb # [ 44.932290] niks3-server[1074]: 2026/09/20 09:05:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4708lb # [ 44.937449] niks3-server[1074]: 2026/09/20 09:05:09 INFO Signed narinfos id=10 count=14709worker2 # [ 44.954679] nix-grpc-daemon[898]: time=2026-09-20T09:05:09.342Z level=INFO msg="Uploading 1 narinfos"4710lb # [ 44.942585] niks3-server[1074]: 2026/09/20 09:05:09 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4711lb # [ 44.950941] niks3-server[1074]: 2026/09/20 09:05:09 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4712lb # [ 44.953441] niks3-server[1074]: 2026/09/20 09:05:09 INFO Completed upload id=104713worker2 # [ 44.970638] nix-grpc-daemon[898]: time=2026-09-20T09:05:09.358Z level=INFO msg="Upload complete. (252ms)"4714worker2 # [ 44.975861] nix-grpc-daemon[898]: time=2026-09-20T09:05:09.361Z level=WARN msg="Failed to register uploaded object" key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo error="server returned 404: object is not pending upload\n"4715worker2 # [ 44.983577] nix-grpc-daemon[783]: ts=2026-09-20T09:05:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14716worker2 # [ 44.988064] nix-grpc-daemon[783]: ts=2026-09-20T09:05:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14717worker2 # [ 44.996175] nix-daemon[862]: reaped child process 920, status = succeeded4718client # [ 45.026990] systemd[1]: dedup2.service: Deactivated successfully.4719client # [ 45.028661] systemd[1]: dedup2.service: Consumed 134ms CPU time over 3.906s wall clock time, 33.1M memory peak, 7.6K incoming IP traffic, 6.5K outgoing IP traffic.4720client # [ 45.062599] systemd[1]: dedup1.service: Deactivated successfully.4721client # [ 45.064120] systemd[1]: dedup1.service: Consumed 113ms CPU time over 5.024s wall clock time, 39.3M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.4722client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4723client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4724client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4725worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4726worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4727worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4728worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4729worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4730worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4731worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4732worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4733(finished: subtest: two clients wanting the same drv build it once, in 5.93 seconds)4734subtest: build hook: nix-daemon with builders = grpc://lb4735client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4736client # [ 46.129578] systemd[1]: Started Nix Daemon.4737client # [ 46.294481] nix-daemon[942]: accepted connection from pid 939, user root (trusted)4738worker2 # [ 46.459827] nix-grpc-daemon[783]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:554444739worker1 # [ 46.470678] nix-grpc-daemon[787]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064740worker2 # [ 46.484390] nix-grpc-daemon[783]: ts=2026-09-20T09:05:10Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04741worker2 # [ 46.486389] nix-grpc-daemon[783]: ts=2026-09-20T09:05:10Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14742worker1 # [ 46.488075] nix-grpc-daemon[787]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064743worker1 # [ 46.500479] nix-grpc-daemon[787]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064744worker1 # [ 46.511189] nix-grpc-daemon[787]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500064745worker1 # [ 46.522278] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4746worker1 # [ 46.710272] nix-daemon[843]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4747worker1 # [ 46.725458] nix-daemon[843]: reaped child process 1046, status = succeeded4748worker1 # [ 46.890130] nix-daemon[843]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4749worker1 # [ 46.903520] nix-daemon[843]: reaped child process 1051, status = succeeded4750lb # [ 46.902832] niks3-server[1074]: 2026/09/20 09:05:11 INFO Received uploads request method=POST path=/api/pending_closures4751worker1 # [ 46.929345] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.380Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4752worker1 # [ 46.930817] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.380Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4753lb # [ 46.931205] niks3-server[1074]: 2026/09/20 09:05:11 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4754lb # [ 46.940875] niks3-server[1074]: 2026/09/20 09:05:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4755worker1 # [ 46.962317] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.413Z level=INFO msg="Uploading 1 narinfos"4756lb # [ 46.945804] niks3-server[1074]: 2026/09/20 09:05:11 INFO Signed narinfos id=11 count=14757lb # [ 46.951244] niks3-server[1074]: 2026/09/20 09:05:11 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4758lb # [ 46.964840] niks3-server[1074]: 2026/09/20 09:05:11 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4759lb # [ 46.970205] niks3-server[1074]: 2026/09/20 09:05:11 INFO Completed upload id=114760worker1 # [ 46.989131] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.440Z level=INFO msg="Upload complete. (453ms)"4761lb # [ 46.973070] niks3-server[1074]: 2026/09/20 09:05:11 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4762worker1 # [ 46.992494] nix-grpc-daemon[787]: ts=2026-09-20T09:05:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_in=5124763worker1 # [ 46.997812] nix-grpc-daemon[787]: ts=2026-09-20T09:05:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064764worker1 # [ 47.008852] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4765worker1 # [ 47.014685] nix-daemon[843]: reaped child process 1041, status = succeeded4766worker1 # [ 47.018644] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4767lb # [ 47.637430] envoy[973]: conn peer=[2001:db8:1::1]:38778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4152 tx=1710 ms=29094768lb # [ 47.641236] envoy[973]: conn peer=[2001:db8:1::1]:38802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1085 ms=35974769lb # [ 47.644693] envoy[973]: conn peer=[2001:db8:1::1]:38790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2998 tx=1345 ms=48054770worker1 # [ 48.434340] nix-daemon[843]: reaped child process 1055, status = succeeded4771worker1 # [ 48.577076] nix-daemon[843]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4772worker1 # [ 48.589027] nix-daemon[843]: reaped child process 1073, status = succeeded4773lb # [ 48.590305] niks3-server[1074]: 2026/09/20 09:05:13 INFO Received uploads request method=POST path=/api/pending_closures4774worker1 # [ 48.616286] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.066Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4775worker1 # [ 48.617673] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.066Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4776lb # [ 48.631805] niks3-server[1074]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4777lb # [ 48.638765] niks3-server[1074]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4778lb # [ 48.647379] niks3-server[1074]: 2026/09/20 09:05:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4779worker1 # [ 48.669387] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.120Z level=INFO msg="Uploading 1 narinfos"4780lb # [ 48.652879] niks3-server[1074]: 2026/09/20 09:05:13 INFO Signed narinfos id=12 count=14781lb # [ 48.658448] niks3-server[1074]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4782lb # [ 48.668532] niks3-server[1074]: 2026/09/20 09:05:13 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4783lb # [ 48.674698] niks3-server[1074]: 2026/09/20 09:05:13 INFO Completed upload id=124784lb # [ 48.675957] niks3-server[1074]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4785worker1 # [ 48.691469] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.143Z level=INFO msg="Upload complete. (264ms)"4786worker1 # [ 48.696696] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14787worker2 # [ 48.701774] nix-grpc-daemon[783]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554444788worker1 # [ 48.709958] nix-daemon[843]: reaped child process 1053, status = succeeded4789worker2 # [ 48.716758] nix-grpc-daemon[783]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4790worker1 # [ 48.754548] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:500064791worker1 # [ 48.760516] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_out=1284792worker2 # [ 48.986717] nix-grpc-daemon[783]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:554444793worker2 # [ 48.993755] nix-grpc-daemon[783]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554444794worker2 # [ 49.003381] nix-grpc-daemon[898]: time=2026-09-20T09:05:13.390Z level=INFO msg="All 1 paths already cached"4795worker2 # [ 49.016807] nix-grpc-daemon[783]: ts=2026-09-20T09:05:13Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04796worker2 # [ 49.020877] nix-grpc-daemon[783]: ts=2026-09-20T09:05:13Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14797worker1 # [ 49.060607] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064798worker1 # [ 49.073218] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064799worker1 # [ 49.085548] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.537Z level=INFO msg="All 1 paths already cached"4800worker1 # [ 49.093089] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500064801worker1 # [ 49.101259] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4802worker1 # [ 49.276837] nix-daemon[843]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4803worker1 # [ 49.290198] nix-daemon[843]: reaped child process 1080, status = succeeded4804worker1 # [ 49.441521] nix-daemon[843]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4805worker1 # [ 49.453855] nix-daemon[843]: reaped child process 1085, status = succeeded4806lb # [ 49.447988] niks3-server[1074]: 2026/09/20 09:05:14 INFO Received uploads request method=POST path=/api/pending_closures4807worker1 # [ 49.472337] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.924Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4808worker1 # [ 49.473794] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.925Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4809lb # [ 49.475560] niks3-server[1074]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4810lb # [ 49.487646] niks3-server[1074]: 2026/09/20 09:05:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4811lb # [ 49.491685] niks3-server[1074]: 2026/09/20 09:05:14 INFO Signed narinfos id=13 count=14812worker1 # [ 49.511262] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.962Z level=INFO msg="Uploading 1 narinfos"4813lb # [ 49.498813] niks3-server[1074]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4814lb # [ 49.509323] niks3-server[1074]: 2026/09/20 09:05:14 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4815lb # [ 49.515185] niks3-server[1074]: 2026/09/20 09:05:14 INFO Completed upload id=134816worker1 # [ 49.531785] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.983Z level=INFO msg="Upload complete. (416ms)"4817lb # [ 49.517437] niks3-server[1074]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4818worker1 # [ 49.535283] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_in=6244819worker1 # [ 49.541284] nix-grpc-daemon[787]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064820worker1 # [ 49.549572] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4821worker1 # [ 49.553558] nix-daemon[843]: reaped child process 1075, status = succeeded4822worker1 # [ 49.558495] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4823worker1 # [ 50.785824] nix-daemon[843]: reaped child process 1089, status = succeeded4824worker1 # [ 50.946098] nix-daemon[843]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4825worker1 # [ 50.958318] nix-daemon[843]: reaped child process 1107, status = succeeded4826lb # [ 50.957624] niks3-server[1074]: 2026/09/20 09:05:15 INFO Received uploads request method=POST path=/api/pending_closures4827worker1 # [ 50.978582] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.430Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4828worker1 # [ 50.980144] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.431Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4829worker1 # [ 50.995780] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.447Z level=INFO msg="Uploading 1 narinfos"4830lb # [ 50.979107] niks3-server[1074]: 2026/09/20 09:05:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4831lb # [ 50.980698] niks3-server[1074]: 2026/09/20 09:05:15 INFO Signed narinfos id=14 count=14832lb # [ 50.985388] niks3-server[1074]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4833lb # [ 50.989379] niks3-server[1074]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4834lb # [ 50.992368] niks3-server[1074]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4835lb # [ 50.996169] niks3-server[1074]: 2026/09/20 09:05:15 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4836lb # [ 50.999782] niks3-server[1074]: 2026/09/20 09:05:15 INFO Completed upload id=144837worker1 # [ 51.017415] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.469Z level=INFO msg="Upload complete. (251ms)"4838lb # [ 51.001830] niks3-server[1074]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4839worker1 # [ 51.019887] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14840worker1 # [ 51.026955] nix-daemon[843]: reaped child process 1087, status = succeeded4841worker1 # [ 51.066189] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500064842worker1 # [ 51.083892] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:500064843worker1 # [ 51.087593] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_out=1764844worker2 # [ 51.358881] nix-grpc-daemon[783]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:554444845worker1 # [ 51.361890] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064846worker1 # [ 51.371274] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.822Z level=INFO msg="All 2 paths already cached"4847worker2 # [ 51.386275] nix-grpc-daemon[783]: ts=2026-09-20T09:05:15Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04848worker2 # [ 51.389804] nix-grpc-daemon[783]: ts=2026-09-20T09:05:15Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14849worker1 # [ 51.395749] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064850worker1 # [ 51.406211] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064851worker1 # [ 51.417194] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.868Z level=INFO msg="All 2 paths already cached"4852worker1 # [ 51.423859] nix-grpc-daemon[787]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500064853worker1 # [ 51.431251] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4854worker1 # [ 51.612260] nix-daemon[843]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4855worker1 # [ 51.625056] nix-daemon[843]: reaped child process 1114, status = succeeded4856worker1 # [ 51.780037] nix-daemon[843]: accepted connection from pid 1116, user nix-grpc-daemon (trusted)4857worker1 # [ 51.792173] nix-daemon[843]: reaped child process 1119, status = succeeded4858lb # [ 51.786940] niks3-server[1074]: 2026/09/20 09:05:16 INFO Received uploads request method=POST path=/api/pending_closures4859worker1 # [ 51.811155] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.262Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4860worker1 # [ 51.812919] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.264Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4861lb # [ 51.813123] niks3-server[1074]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4862lb # [ 51.824122] niks3-server[1074]: 2026/09/20 09:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4863worker1 # [ 51.847424] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.298Z level=INFO msg="Uploading 1 narinfos"4864lb # [ 51.830789] niks3-server[1074]: 2026/09/20 09:05:16 INFO Signed narinfos id=15 count=14865lb # [ 51.835180] niks3-server[1074]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4866lb # [ 51.847453] niks3-server[1074]: 2026/09/20 09:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4867lb # [ 51.854425] niks3-server[1074]: 2026/09/20 09:05:16 INFO Completed upload id=154868worker1 # [ 51.870979] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.322Z level=INFO msg="Upload complete. (427ms)"4869lb # [ 51.856818] niks3-server[1074]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4870worker1 # [ 51.874645] nix-grpc-daemon[787]: ts=2026-09-20T09:05:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_in=7524871worker1 # [ 51.880394] nix-grpc-daemon[787]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500064872worker1 # [ 51.889098] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4873worker1 # [ 51.891283] nix-daemon[843]: reaped child process 1109, status = succeeded4874worker1 # [ 51.896332] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4875worker1 # [ 53.122840] nix-daemon[843]: reaped child process 1123, status = succeeded4876worker1 # [ 53.264301] nix-daemon[843]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)4877worker1 # [ 53.276620] nix-daemon[843]: reaped child process 1141, status = succeeded4878lb # [ 53.278223] niks3-server[1074]: 2026/09/20 09:05:18 INFO Received uploads request method=POST path=/api/pending_closures4879worker1 # [ 53.301437] nix-grpc-daemon[853]: time=2026-09-20T09:05:17.752Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4880worker1 # [ 53.306598] nix-grpc-daemon[853]: time=2026-09-20T09:05:17.754Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4881lb # [ 53.309373] niks3-server[1074]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4882lb # [ 53.321604] niks3-server[1074]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4883lb # [ 53.333734] niks3-server[1074]: 2026/09/20 09:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4884lb # [ 53.339142] niks3-server[1074]: 2026/09/20 09:05:18 INFO Signed narinfos id=16 count=14885worker1 # [ 53.355688] nix-grpc-daemon[853]: time=2026-09-20T09:05:17.807Z level=INFO msg="Uploading 1 narinfos"4886lb # [ 53.343780] niks3-server[1074]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4887lb # [ 53.353077] niks3-server[1074]: 2026/09/20 09:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4888lb # [ 53.357755] niks3-server[1074]: 2026/09/20 09:05:18 INFO Completed upload id=164889worker1 # [ 53.374542] nix-grpc-daemon[853]: time=2026-09-20T09:05:17.826Z level=INFO msg="Upload complete. (270ms)"4890lb # [ 53.360145] niks3-server[1074]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4891worker2 # [ 53.384388] nix-grpc-daemon[783]: ts=2026-09-20T09:05:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554444892worker1 # [ 53.380620] nix-grpc-daemon[787]: ts=2026-09-20T09:05:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14893worker2 # [ 53.391776] nix-grpc-daemon[783]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4894worker1 # [ 53.392667] nix-daemon[843]: reaped child process 1121, status = succeeded4895worker2 # [ 53.397824] nix-grpc-daemon[783]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4896worker2 # [ 53.416351] nix-grpc-daemon[783]: ts=2026-09-20T09:05:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:554444897worker2 # [ 53.419214] nix-grpc-daemon[783]: ts=2026-09-20T09:05:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=0 paths=1 nar_bytes_out=2324898client # [ 53.551786] nix-daemon[942]: reaped child process 944, status = succeeded4899client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.65 seconds)4900client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4901client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4902client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4903client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4904client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4905client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4906(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.74 seconds)4907subtest: an input only one worker has still reaches the builder4908client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4909client # this derivation will be built:4910client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4911client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4912client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.41 seconds)4913client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4914client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.15 seconds)4915worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4916worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)4917worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4918worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4919client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24920client # [ 54.583876] nix-daemon[942]: accepted connection from pid 1024, user root (trusted)4921client # this derivation will be built:4922client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4923worker1 # [ 54.737189] nix-grpc-daemon[787]: ts=2026-09-20T09:05:19Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:500064924worker1 # [ 54.742120] nix-grpc-daemon[787]: ts=2026-09-20T09:05:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500064925client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4926worker1 # [ 54.895471] nix-daemon[843]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4927worker1 # [ 54.906215] nix-daemon[843]: reaped child process 1151, status = succeeded4928lb # [ 54.907515] niks3-server[1074]: 2026/09/20 09:05:19 INFO Received uploads request method=POST path=/api/pending_closures4929worker1 # [ 54.931740] nix-grpc-daemon[853]: time=2026-09-20T09:05:19.383Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4930worker1 # [ 54.933805] nix-grpc-daemon[853]: time=2026-09-20T09:05:19.385Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4931lb # [ 54.934175] niks3-server[1074]: 2026/09/20 09:05:19 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4932lb # [ 54.944598] niks3-server[1074]: 2026/09/20 09:05:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4933lb # [ 54.948598] niks3-server[1074]: 2026/09/20 09:05:19 INFO Signed narinfos id=17 count=14934worker1 # [ 54.969339] nix-grpc-daemon[853]: time=2026-09-20T09:05:19.420Z level=INFO msg="Uploading 1 narinfos"4935lb # [ 54.954577] niks3-server[1074]: 2026/09/20 09:05:19 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4936lb # [ 54.967762] niks3-server[1074]: 2026/09/20 09:05:19 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4937lb # [ 54.972206] niks3-server[1074]: 2026/09/20 09:05:19 INFO Completed upload id=174938worker1 # [ 54.990901] nix-grpc-daemon[853]: time=2026-09-20T09:05:19.442Z level=INFO msg="Upload complete. (247ms)"4939lb # [ 54.975142] niks3-server[1074]: 2026/09/20 09:05:19 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4940worker2 # [ 55.007793] nix-grpc-daemon[783]: ts=2026-09-20T09:05:19Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04941worker2 # [ 55.013661] nix-grpc-daemon[783]: ts=2026-09-20T09:05:19Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14942worker2 # [ 55.018267] nix-grpc-daemon[783]: ts=2026-09-20T09:05:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554444943worker2 # [ 55.028671] nix-grpc-daemon[783]: ts=2026-09-20T09:05:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554444944client # copying 2 paths to 'lb:50051'...4945client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4946client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4947worker2 # [ 55.043612] nix-grpc-daemon[783]: ts=2026-09-20T09:05:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:554444948worker2 # [ 55.053890] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4949worker2 # [ 55.234930] nix-daemon[862]: accepted connection from pid 986, user nix-grpc-daemon (trusted)4950worker2 # [ 55.248488] nix-daemon[862]: reaped child process 989, status = succeeded4951worker2 # [ 55.409350] nix-daemon[862]: accepted connection from pid 992, user nix-grpc-daemon (trusted)4952worker2 # [ 55.421246] nix-daemon[862]: reaped child process 995, status = succeeded4953lb # [ 55.420787] niks3-server[1074]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures4954lb # [ 55.429176] niks3-server[1074]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures4955worker2 # [ 55.453676] nix-grpc-daemon[898]: time=2026-09-20T09:05:19.841Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4956worker2 # [ 55.455729] nix-grpc-daemon[898]: time=2026-09-20T09:05:19.843Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4957worker2 # [ 55.457844] nix-grpc-daemon[898]: time=2026-09-20T09:05:19.843Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4958lb # [ 55.471144] niks3-server[1074]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4959lb # [ 55.478453] niks3-server[1074]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4960lb # [ 55.488820] niks3-server[1074]: 2026/09/20 09:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4961lb # [ 55.493149] niks3-server[1074]: 2026/09/20 09:05:20 INFO Signed narinfos id=18 count=14962lb # [ 55.496735] niks3-server[1074]: 2026/09/20 09:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4963lb # [ 55.499921] niks3-server[1074]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4964lb # [ 55.502222] niks3-server[1074]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4965lb # [ 55.504046] niks3-server[1074]: 2026/09/20 09:05:20 INFO Signed narinfos id=19 count=24966worker2 # [ 55.523077] nix-grpc-daemon[898]: time=2026-09-20T09:05:19.910Z level=INFO msg="Uploading 3 narinfos"4967lb # [ 55.516414] niks3-server[1074]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4968lb # [ 55.519251] niks3-server[1074]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4969lb # [ 55.523075] niks3-server[1074]: 2026/09/20 09:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4970lb # [ 55.526913] niks3-server[1074]: 2026/09/20 09:05:20 INFO Completed upload id=184971lb # [ 55.528334] niks3-server[1074]: 2026/09/20 09:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4972lb # [ 55.530468] niks3-server[1074]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4973lb # [ 55.532714] niks3-server[1074]: 2026/09/20 09:05:20 INFO Completed upload id=194974worker2 # [ 55.550983] nix-grpc-daemon[898]: time=2026-09-20T09:05:19.939Z level=INFO msg="Upload complete. (479ms)"4975worker2 # [ 55.555655] nix-grpc-daemon[783]: ts=2026-09-20T09:05:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=0 paths=2 nar_bytes_in=9764976worker2 # [ 55.561538] nix-grpc-daemon[783]: ts=2026-09-20T09:05:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554444977worker2 # [ 55.572523] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4978worker2 # [ 55.582151] nix-daemon[862]: reaped child process 984, status = succeeded4979worker2 # [ 55.590844] nix-grpc-daemon[783]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4980client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4981worker2 # [ 55.602979] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4982client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4983worker2 # [ 56.815803] nix-daemon[862]: reaped child process 1000, status = succeeded4984worker2 # [ 56.954611] nix-daemon[862]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4985worker2 # [ 56.967041] nix-daemon[862]: reaped child process 1018, status = succeeded4986lb # [ 56.966611] niks3-server[1074]: 2026/09/20 09:05:21 INFO Received uploads request method=POST path=/api/pending_closures4987worker2 # [ 56.991776] nix-grpc-daemon[898]: time=2026-09-20T09:05:21.379Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4988lb # [ 56.994794] niks3-server[1074]: 2026/09/20 09:05:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4989worker2 # [ 57.019954] nix-grpc-daemon[898]: time=2026-09-20T09:05:21.407Z level=INFO msg="Uploading 1 narinfos"4990lb # [ 57.003164] niks3-server[1074]: 2026/09/20 09:05:21 INFO Signed narinfos id=20 count=14991lb # [ 57.017525] niks3-server[1074]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4992lb # [ 57.022554] niks3-server[1074]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4993lb # [ 57.032082] niks3-server[1074]: 2026/09/20 09:05:21 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4994lb # [ 57.039172] niks3-server[1074]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4995lb # [ 57.042487] niks3-server[1074]: 2026/09/20 09:05:21 INFO Completed upload id=204996worker2 # [ 57.059534] nix-grpc-daemon[898]: time=2026-09-20T09:05:21.447Z level=INFO msg="Upload complete. (249ms)"4997worker2 # [ 57.064236] nix-grpc-daemon[783]: ts=2026-09-20T09:05:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14998worker2 # [ 57.075750] nix-daemon[862]: reaped child process 997, status = succeeded4999client # copying 1 paths...5000worker1 # [ 57.107986] nix-grpc-daemon[787]: ts=2026-09-20T09:05:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500065001worker1 # [ 57.123961] nix-grpc-daemon[787]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5002client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5003worker2 # [ 57.163160] nix-grpc-daemon[783]: ts=2026-09-20T09:05:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:554445004worker2 # [ 57.167960] nix-grpc-daemon[783]: ts=2026-09-20T09:05:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=0 paths=1 nar_bytes_out=1205005client # [ 57.249807] nix-daemon[942]: reaped child process 1027, status = succeeded5006client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.83 seconds)5007client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25008client # [ 57.432106] nix-daemon[942]: accepted connection from pid 1046, user root (trusted)5009client # this derivation will be built:5010client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5011worker1 # [ 57.577555] nix-grpc-daemon[787]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:500065012client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5013worker2 # [ 57.581215] nix-grpc-daemon[783]: ts=2026-09-20T09:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554445014worker2 # [ 57.589609] nix-grpc-daemon[898]: time=2026-09-20T09:05:21.977Z level=INFO msg="All 1 paths already cached"5015worker2 # [ 57.602168] nix-grpc-daemon[783]: ts=2026-09-20T09:05:21Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05016worker2 # [ 57.606461] nix-grpc-daemon[783]: ts=2026-09-20T09:05:21Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15017worker1 # [ 57.646608] nix-grpc-daemon[787]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500065018lb # [ 57.639320] envoy[973]: conn peer=[2001:db8:1::1]:47354 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=285019lb # [ 57.643181] envoy[973]: conn peer=[2001:db8:1::1]:47346 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3399 tx=1749 ms=23185020lb # [ 57.646670] envoy[973]: conn peer=[2001:db8:1::1]:47358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3880 tx=1875 ms=21505021lb # [ 57.651063] envoy[973]: conn peer=[2001:db8:1::1]:47362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=525022lb # [ 57.654585] envoy[973]: conn peer=[2001:db8:1::1]:47364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2194 ms=21175023lb # [ 57.658700] envoy[973]: conn peer=[2001:db8:1::1]:57296 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=545024worker1 # [ 57.675832] nix-grpc-daemon[787]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500065025lb # [ 57.662193] envoy[973]: conn peer=[2001:db8:1::1]:57304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3852 tx=1878 ms=24425026lb # [ 57.666750] envoy[973]: conn peer=[2001:db8:1::1]:57312 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=185027client # copying 1 paths to 'lb:50051'...5028client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5029worker1 # [ 57.696511] nix-grpc-daemon[787]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500065030worker1 # [ 57.707387] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5031worker1 # [ 57.723409] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)5032worker1 # [ 57.790102] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 2/5)5033worker1 # [ 57.953371] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 357 ms (attempt 3/5)5034worker1 # [ 58.317520] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 777 ms (attempt 4/5)5035worker1 # [ 59.100611] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5036worker1 # [ 59.106455] nix-grpc-daemon[787]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5037worker1 # [ 59.297484] nix-daemon[843]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5038worker1 # [ 59.312679] nix-daemon[843]: reaped child process 1163, status = succeeded5039worker1 # [ 59.469601] nix-daemon[843]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5040worker1 # [ 59.480328] nix-daemon[843]: reaped child process 1168, status = succeeded5041lb # [ 59.479333] niks3-server[1074]: 2026/09/20 09:05:24 INFO Received uploads request method=POST path=/api/pending_closures5042worker1 # [ 59.505910] nix-grpc-daemon[853]: time=2026-09-20T09:05:23.957Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5043worker1 # [ 59.507426] nix-grpc-daemon[853]: time=2026-09-20T09:05:23.959Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5044lb # [ 59.510181] niks3-server[1074]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5045lb # [ 59.520125] niks3-server[1074]: 2026/09/20 09:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5046worker1 # [ 59.541410] nix-grpc-daemon[853]: time=2026-09-20T09:05:23.992Z level=INFO msg="Uploading 1 narinfos"5047lb # [ 59.525161] niks3-server[1074]: 2026/09/20 09:05:24 INFO Signed narinfos id=21 count=15048lb # [ 59.531538] niks3-server[1074]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5049lb # [ 59.540825] niks3-server[1074]: 2026/09/20 09:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5050lb # [ 59.547322] niks3-server[1074]: 2026/09/20 09:05:24 INFO Completed upload id=215051worker1 # [ 59.563515] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.015Z level=INFO msg="Upload complete. (437ms)"5052lb # [ 59.551100] niks3-server[1074]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5053worker1 # [ 59.567834] nix-grpc-daemon[787]: ts=2026-09-20T09:05:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=1 paths=1 nar_bytes_in=5605054worker1 # [ 59.573256] nix-grpc-daemon[787]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500065055worker1 # [ 59.581566] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5056worker1 # [ 59.588321] nix-daemon[843]: reaped child process 1154, status = succeeded5057worker1 # [ 59.591270] nix-daemon[843]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5058client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5059client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5060worker1 # [ 60.205322] nix-daemon[843]: reaped child process 1172, status = succeeded5061worker1 # [ 60.345840] nix-daemon[843]: accepted connection from pid 1187, user nix-grpc-daemon (trusted)5062worker1 # [ 60.358488] nix-daemon[843]: reaped child process 1190, status = succeeded5063lb # [ 60.357348] niks3-server[1074]: 2026/09/20 09:05:25 INFO Received uploads request method=POST path=/api/pending_closures5064worker1 # [ 60.381858] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.833Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5065lb # [ 60.390268] niks3-server[1074]: 2026/09/20 09:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5066lb # [ 60.395487] niks3-server[1074]: 2026/09/20 09:05:25 INFO Signed narinfos id=22 count=15067worker1 # [ 60.414946] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.866Z level=INFO msg="Uploading 1 narinfos"5068lb # [ 60.402570] niks3-server[1074]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5069lb # [ 60.408069] niks3-server[1074]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5070lb # [ 60.421398] niks3-server[1074]: 2026/09/20 09:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5071lb # [ 60.426439] niks3-server[1074]: 2026/09/20 09:05:25 INFO Completed upload id=225072worker1 # [ 60.445218] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.896Z level=INFO msg="Upload complete. (248ms)"5073lb # [ 60.429775] niks3-server[1074]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5074worker1 # [ 60.449118] nix-grpc-daemon[787]: ts=2026-09-20T09:05:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15075worker1 # [ 60.460735] nix-daemon[843]: reaped child process 1170, status = succeeded5076client # copying 1 paths...5077worker2 # [ 60.497220] nix-grpc-daemon[783]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554445078worker2 # [ 60.508342] nix-grpc-daemon[783]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5079client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5080worker2 # [ 60.540865] nix-grpc-daemon[783]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:554445081worker2 # [ 60.545434] nix-grpc-daemon[783]: ts=2026-09-20T09:05:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=0 paths=1 nar_bytes_out=1205082client # [ 60.669920] nix-daemon[942]: reaped child process 1049, status = succeeded5083client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.42 seconds)5084client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25085client # [ 60.846061] nix-daemon[942]: accepted connection from pid 1068, user root (trusted)5086client # this derivation will be built:5087client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5088worker1 # [ 60.998606] nix-grpc-daemon[787]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:500065089worker1 # [ 61.001183] nix-grpc-daemon[787]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500065090client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5091worker1 # [ 61.007156] nix-grpc-daemon[853]: time=2026-09-20T09:05:25.458Z level=INFO msg="All 1 paths already cached"5092worker2 # [ 61.018996] nix-grpc-daemon[783]: ts=2026-09-20T09:05:25Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05093worker2 # [ 61.024758] nix-grpc-daemon[783]: ts=2026-09-20T09:05:25Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15094worker2 # [ 61.030291] nix-grpc-daemon[783]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554445095worker2 # [ 61.040699] nix-grpc-daemon[783]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:554445096worker2 # [ 61.051173] nix-grpc-daemon[898]: time=2026-09-20T09:05:25.438Z level=INFO msg="All 1 paths already cached"5097client # copying 1 paths to 'lb:50051'...5098client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5099worker2 # [ 61.057224] nix-grpc-daemon[783]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:554445100worker2 # [ 61.069876] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5101worker2 # [ 61.242557] nix-daemon[862]: accepted connection from pid 1027, user nix-grpc-daemon (trusted)5102worker2 # [ 61.255208] nix-daemon[862]: reaped child process 1030, status = succeeded5103worker2 # [ 61.397356] nix-daemon[862]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5104worker2 # [ 61.410260] nix-daemon[862]: reaped child process 1035, status = succeeded5105lb # [ 61.403980] niks3-server[1074]: 2026/09/20 09:05:26 INFO Received uploads request method=POST path=/api/pending_closures5106worker2 # [ 61.425776] nix-grpc-daemon[898]: time=2026-09-20T09:05:25.813Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5107worker2 # [ 61.427128] nix-grpc-daemon[898]: time=2026-09-20T09:05:25.813Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5108lb # [ 61.418186] niks3-server[1074]: 2026/09/20 09:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5109lb # [ 61.420576] niks3-server[1074]: 2026/09/20 09:05:26 INFO Signed narinfos id=23 count=15110worker2 # [ 61.439164] nix-grpc-daemon[898]: time=2026-09-20T09:05:25.827Z level=INFO msg="Uploading 1 narinfos"5111lb # [ 61.423996] niks3-server[1074]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5112lb # [ 61.426623] niks3-server[1074]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5113lb # [ 61.431529] niks3-server[1074]: 2026/09/20 09:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5114lb # [ 61.434501] niks3-server[1074]: 2026/09/20 09:05:26 INFO Completed upload id=235115worker2 # [ 61.452675] nix-grpc-daemon[898]: time=2026-09-20T09:05:25.840Z level=INFO msg="Upload complete. (372ms)"5116lb # [ 61.436148] niks3-server[1074]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5117worker2 # [ 61.454666] nix-grpc-daemon[783]: ts=2026-09-20T09:05:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=0 paths=1 nar_bytes_in=5605118worker2 # [ 61.458237] nix-grpc-daemon[783]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:554445119worker2 # [ 61.464444] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5120worker2 # [ 61.466578] nix-daemon[862]: reaped child process 1025, status = succeeded5121worker2 # [ 61.472437] nix-daemon[862]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5122client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5123client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5124worker2 # [ 62.495458] nix-daemon[862]: reaped child process 1039, status = succeeded5125worker2 # [ 62.660680] nix-daemon[862]: accepted connection from pid 1054, user nix-grpc-daemon (trusted)5126worker2 # [ 62.672804] nix-daemon[862]: reaped child process 1057, status = succeeded5127lb # [ 62.674067] niks3-server[1074]: 2026/09/20 09:05:27 INFO Received uploads request method=POST path=/api/pending_closures5128worker2 # [ 62.699150] nix-grpc-daemon[898]: time=2026-09-20T09:05:27.087Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5129lb # [ 62.706058] niks3-server[1074]: 2026/09/20 09:05:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5130lb # [ 62.711092] niks3-server[1074]: 2026/09/20 09:05:27 INFO Signed narinfos id=24 count=15131worker2 # [ 62.730537] nix-grpc-daemon[898]: time=2026-09-20T09:05:27.118Z level=INFO msg="Uploading 1 narinfos"5132lb # [ 62.717856] niks3-server[1074]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5133lb # [ 62.726805] niks3-server[1074]: 2026/09/20 09:05:27 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5134lb # [ 62.729845] niks3-server[1074]: 2026/09/20 09:05:27 INFO Completed upload id=245135worker2 # [ 62.748432] nix-grpc-daemon[898]: time=2026-09-20T09:05:27.136Z level=INFO msg="Upload complete. (267ms)"5136lb # [ 62.732164] niks3-server[1074]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5137lb # [ 62.734653] niks3-server[1074]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5138worker2 # [ 62.751937] nix-grpc-daemon[783]: ts=2026-09-20T09:05:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55444 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15139worker2 # [ 62.758377] nix-daemon[862]: reaped child process 1037, status = succeeded5140client # copying 1 paths...5141worker2 # [ 62.796445] nix-grpc-daemon[783]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:554445142client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5143worker1 # [ 62.819852] nix-grpc-daemon[787]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:500065144worker1 # [ 62.832918] nix-grpc-daemon[787]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5145worker1 # [ 62.847155] nix-grpc-daemon[787]: ts=2026-09-20T09:05:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50006 duration_s=0 paths=1 nar_bytes_out=1205146client # [ 62.975924] nix-daemon[942]: reaped child process 1071, status = succeeded5147client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.30 seconds)5148(finished: subtest: an input only one worker has still reaches the builder, in 9.33 seconds)5149subtest: upload whose reference the worker lacks is completed from the cache5150client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5151client # this derivation will be built:5152client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5153client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5154client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.38 seconds)5155client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5156client # this derivation will be built:5157client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5158client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5159client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds)5160client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5161client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5162worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5163worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds)5164worker2 # [ 64.110844] systemd[1]: Stopping Nix worker-protocol over gRPC...5165worker2 # [ 64.959864] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=signal_exit5166worker2 # [ 65.221744] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=scheduler_yield5167worker2 # [ 65.226268] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=scheduler_restarting addr=lb:500515168lb # [ 65.210693] niks3-server[1074]: 2026/09/20 09:05:30 INFO lead: released remote=192.168.1.4:588445169worker2 # [ 65.231648] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:589745170worker1 # [ 65.233379] nix-grpc-daemon[787]: ts=2026-09-20T09:05:29Z level=info event=scheduler_restarting addr=lb:500515171worker2 # [ 65.236330] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=worker_gone addr=192.168.1.4:500515172worker2 # [ 65.239359] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:589745173worker2 # [ 65.242541] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=worker_gone addr=192.168.1.3:500515174worker2 # [ 65.426918] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=scheduler_connected addr=lb:500515175lb # [ 65.412309] niks3-server[1074]: 2026/09/20 09:05:30 INFO lead: acquired remote=192.168.1.3:459965176worker1 # [ 65.429576] nix-grpc-daemon[787]: ts=2026-09-20T09:05:29Z level=info event=scheduler_take_over5177worker1 # [ 65.433861] nix-grpc-daemon[787]: ts=2026-09-20T09:05:29Z level=info event=scheduler_connected addr=lb:500515178worker2 # [ 65.433888] nix-grpc-daemon[783]: ts=2026-09-20T09:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5179worker1 # [ 65.442688] nix-grpc-daemon[787]: ts=2026-09-20T09:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5180worker2 # [ 65.634559] nix-grpc-daemon[783]: ts=2026-09-20T09:05:30Z level=info event=scheduler_connected addr=lb:500515181worker1 # [ 65.636975] nix-grpc-daemon[787]: ts=2026-09-20T09:05:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05182worker1 # [ 65.643630] nix-grpc-daemon[787]: ts=2026-09-20T09:05:30Z level=info event=scheduler_connected addr=lb:500515183worker1 # [ 65.647451] nix-grpc-daemon[787]: ts=2026-09-20T09:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5184worker1 # [ 65.848146] nix-grpc-daemon[787]: ts=2026-09-20T09:05:30Z level=info event=scheduler_connected addr=lb:500515185worker1 # [ 65.852233] nix-grpc-daemon[787]: ts=2026-09-20T09:05:30Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05186worker2 # [ 66.224170] nix-grpc-daemon[783]: ts=2026-09-20T09:05:30Z level=info event=scheduler_restarting5187worker1 # [ 66.231515] nix-grpc-daemon[787]: ts=2026-09-20T09:05:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:579865188worker1 # [ 66.235925] nix-grpc-daemon[787]: ts=2026-09-20T09:05:30Z level=info event=worker_gone addr=192.168.1.4:500515189worker2 # [ 66.244446] nix-grpc-daemon[783]: ts=2026-09-20T09:05:30Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5190worker2 # [ 66.260765] nix-daemon[862]: reaped child process 864, status = succeeded5191worker2 # [ 67.077584] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5192worker2 # [ 67.080932] nix-grpc-daemon[783]: E0000 00:00:1789895131.464988 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5193worker2 # [ 67.085577] nix-grpc-daemon[783]: E0000 00:00:1789895131.465632 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5194lb # [ 67.638891] envoy[973]: conn peer=[2001:db8:1::1]:57332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=585195lb # [ 67.642564] envoy[973]: conn peer=[2001:db8:1::1]:57316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3730 tx=1934 ms=30175196lb # [ 67.646204] envoy[973]: conn peer=[2001:db8:1::1]:57340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3701 tx=1802 ms=19005197lb # [ 67.649719] envoy[973]: conn peer=[2001:db8:1::1]:33602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=835198lb # [ 67.653222] envoy[973]: conn peer=[2001:db8:1::4]:52548 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9142 tx=1851 ms=482265199worker2 # [ 67.956477] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5200worker2 # [ 67.958955] systemd[1]: Stopped Nix worker-protocol over gRPC.5201worker2 # [ 67.961593] systemd[1]: nix-grpc-daemon.service: Consumed 1.383s CPU time over 50.300s wall clock time, 52.7M memory peak, 50.5K incoming IP traffic, 94.1K outgoing IP traffic.5202worker2 # [ 67.972276] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5203worker2 # [ 67.976463] systemd[1]: Closed Nix worker-protocol over gRPC.5204worker2 # [ 67.980216] systemd[1]: nix-grpc-daemon.socket: Consumed 275us CPU time over 58.018s wall clock time, 256K memory peak, 88.6K incoming IP traffic, 75.5K outgoing IP traffic.5205lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5206lb: must succeed: curl -sf localhost:9901/clusters5207lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5208lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5209client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25210worker1 # [ 68.215168] nix-grpc-daemon[787]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500065211client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5212worker1 # [ 68.217522] nix-grpc-daemon[787]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500065213client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.18 seconds)5214worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5215worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5216worker2 # [ 68.319809] systemd[1]: Listening on Nix worker-protocol over gRPC.5217worker1 # [ 68.356387] systemd[1]: Stopping Nix worker-protocol over gRPC...5218worker1 # [ 68.934598] nix-grpc-daemon[787]: ts=2026-09-20T09:05:33Z level=info event=signal_exit5219worker2 # [ 68.944833] systemd[1]: Starting Nix worker-protocol over gRPC...5220worker2 # [ 69.112980] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5221worker2 # [ 69.115809] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15222worker2 # [ 69.122069] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5223worker2 # [ 69.125326] systemd[1]: Started Nix worker-protocol over gRPC.5224worker2 # [ 69.153247] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500515225worker2 # [ 69.157425] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5226worker1 # [ 69.202432] nix-grpc-daemon[787]: ts=2026-09-20T09:05:33Z level=info event=scheduler_yield5227lb # [ 69.187829] niks3-server[1074]: 2026/09/20 09:05:34 INFO lead: released remote=192.168.1.3:459965228worker1 # [ 69.208419] nix-grpc-daemon[787]: ts=2026-09-20T09:05:33Z level=info event=scheduler_restarting addr=lb:500515229worker1 # [ 69.213128] nix-grpc-daemon[787]: ts=2026-09-20T09:05:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:579865230worker1 # [ 69.216984] nix-grpc-daemon[787]: ts=2026-09-20T09:05:33Z level=info event=worker_gone addr=192.168.1.3:500515231worker2 # [ 69.358522] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500515232worker2 # [ 69.368970] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5233worker1 # [ 69.409469] nix-grpc-daemon[787]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500515234worker1 # [ 69.413674] nix-grpc-daemon[787]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5235worker2 # [ 69.569990] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500515236worker2 # [ 69.574140] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5237worker1 # [ 69.614374] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515238worker1 # [ 69.618127] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5239worker2 # [ 69.774763] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515240worker2 # [ 69.778879] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5241worker1 # [ 69.818844] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515242worker1 # [ 69.822919] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5243worker2 # [ 69.979543] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515244worker2 # [ 69.983658] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5245worker1 # [ 70.023563] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515246worker1 # [ 70.027653] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5247worker2 # [ 70.184974] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515248worker2 # [ 70.188961] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5249worker1 # [ 70.205689] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=scheduler_restarting5250worker1 # [ 70.241947] nix-daemon[843]: reaped child process 846, status = succeeded5251worker1 # [ 70.247656] nix-grpc-daemon[787]: ts=2026-09-20T09:05:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5252worker2 # [ 70.389887] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515253worker2 # [ 70.394961] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5254worker2 # [ 70.595915] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500515255worker1 # [ 70.598832] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5256worker1 # [ 70.602312] nix-grpc-daemon[787]: E0000 00:00:1789895135.049948 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5257worker1 # [ 71.062628] nix-grpc-daemon[787]: E0000 00:00:1789895135.514218 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5258worker1 # [ 71.068632] nix-grpc-daemon[787]: E0000 00:00:1789895135.520057 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5259worker2 # [ 71.877310] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5260worker1 # [ 71.894565] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5261worker1 # [ 71.898137] systemd[1]: Stopped Nix worker-protocol over gRPC.5262worker1 # [ 71.901965] systemd[1]: nix-grpc-daemon.service: Consumed 2.649s CPU time over 54.248s wall clock time, 61.4M memory peak, 86.7K incoming IP traffic, 158.4K outgoing IP traffic.5263worker1 # [ 71.914616] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5264worker1 # [ 71.918859] systemd[1]: Closed Nix worker-protocol over gRPC.5265worker1 # [ 71.922521] systemd[1]: nix-grpc-daemon.socket: Consumed 310us CPU time over 1min 2.000s wall clock time, 256K memory peak, 106.2K incoming IP traffic, 84K outgoing IP traffic.5266lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5267lb: must succeed: curl -sf localhost:9901/clusters5268lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5269lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5270client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25271worker2 # [ 72.077252] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500515272worker2 # [ 72.080359] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5273worker2 # [ 72.208031] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:491345274worker2 # [ 72.213520] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5275worker2 # [ 72.221575] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)5276worker2 # [ 72.234957] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5)5277worker2 # [ 72.272397] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 3/5)5278worker2 # [ 72.280888] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500515279worker2 # [ 72.283633] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5280worker2 # [ 72.416204] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 172 ms (attempt 4/5)5281worker2 # [ 72.487061] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500515282worker2 # [ 72.491862] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5283worker2 # [ 72.594846] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5284client # copying 2 paths...5285worker2 # [ 72.609580] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:491345286client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5287client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5288worker2 # [ 72.618386] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5289worker2 # [ 72.629215] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=niks3_push_started pid=11345290worker2 # [ 72.693412] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500515291worker2 # [ 72.696133] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5292worker2 # [ 72.899209] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500515293worker2 # [ 72.901475] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5294worker2 # [ 72.968979] nix-daemon[862]: accepted connection from pid 1147, user nix-grpc-daemon (trusted)5295worker2 # [ 72.980099] nix-daemon[862]: reaped child process 1150, status = succeeded5296lb # [ 72.980669] niks3-server[1074]: 2026/09/20 09:05:37 INFO Received uploads request method=POST path=/api/pending_closures5297lb # [ 72.985605] niks3-server[1074]: 2026/09/20 09:05:37 INFO Received uploads request method=POST path=/api/pending_closures5298worker2 # [ 73.006249] nix-grpc-daemon[1134]: time=2026-09-20T09:05:37.394Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5299worker2 # [ 73.007809] nix-grpc-daemon[1134]: time=2026-09-20T09:05:37.395Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5300worker2 # [ 73.011105] nix-grpc-daemon[1134]: time=2026-09-20T09:05:37.397Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5301lb # [ 73.013416] niks3-server[1074]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5302lb # [ 73.016069] niks3-server[1074]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5303lb # [ 73.023429] niks3-server[1074]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5304lb # [ 73.026251] niks3-server[1074]: 2026/09/20 09:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5305lb # [ 73.027901] niks3-server[1074]: 2026/09/20 09:05:37 INFO Signed narinfos id=25 count=15306lb # [ 73.030492] niks3-server[1074]: 2026/09/20 09:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5307lb # [ 73.032407] niks3-server[1074]: 2026/09/20 09:05:37 INFO Signed narinfos id=26 count=25308worker2 # [ 73.050329] nix-grpc-daemon[1134]: time=2026-09-20T09:05:37.437Z level=INFO msg="Uploading 3 narinfos"5309lb # [ 73.033823] niks3-server[1074]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5310lb # [ 73.044981] niks3-server[1074]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5311lb # [ 73.046959] niks3-server[1074]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5312lb # [ 73.053258] niks3-server[1074]: 2026/09/20 09:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5313lb # [ 73.057142] niks3-server[1074]: 2026/09/20 09:05:37 INFO Completed upload id=255314lb # [ 73.059199] niks3-server[1074]: 2026/09/20 09:05:38 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5315lb # [ 73.061888] niks3-server[1074]: 2026/09/20 09:05:38 INFO Completed upload id=265316worker2 # [ 73.079052] nix-grpc-daemon[1134]: time=2026-09-20T09:05:37.467Z level=INFO msg="Upload complete. (261ms)"5317lb # [ 73.063300] niks3-server[1074]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5318worker2 # [ 73.081309] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=0 paths=2 nar_bytes_in=3125319worker2 # [ 73.087401] nix-daemon[862]: reaped child process 1132, status = succeeded5320worker2 # [ 73.101909] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500515321worker2 # [ 73.103634] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5322client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.12 seconds)5323worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5324worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5325worker1 # [ 73.206520] systemd[1]: Listening on Nix worker-protocol over gRPC.5326worker1 # [ 73.213653] systemd[1]: Starting Nix worker-protocol over gRPC...5327worker2 # [ 73.307135] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500515328worker2 # [ 73.312417] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5329worker1 # [ 73.351472] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5330worker1 # [ 73.354807] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15331worker1 # [ 73.360422] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5332worker1 # [ 73.363953] systemd[1]: Started Nix worker-protocol over gRPC.5333lb # [ 73.353592] niks3-server[1074]: 2026/09/20 09:05:38 INFO lead: acquired remote=192.168.1.3:409405334worker1 # [ 73.376094] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:37Z level=info event=scheduler_take_over5335lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5336lb: must succeed: curl -sf localhost:9901/clusters5337worker1 # [ 73.394952] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500515338worker1 # [ 73.405438] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05339lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5340worker2 # [ 73.513601] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500515341worker2 # [ 73.518927] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5342worker2 # [ 73.720158] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:38Z level=info event=scheduler_connected addr=lb:500515343worker1 # [ 73.722649] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:38Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05344lb: must succeed: curl -sf localhost:9901/clusters5345lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5346lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.16 seconds)5347(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.57 seconds)5348subtest: scheduler down: the other node takes the lock and keeps it5349lb: must succeed: curl -sf localhost:9901/clusters5350lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5351lb: must succeed: curl -sf localhost:9901/clusters5352lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5353lb: must succeed: curl -sf localhost:9901/clusters5354lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5355lb: must succeed: curl -sf localhost:9901/clusters5356lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5357worker1 # [ 74.792629] systemd[1]: Stopping Nix worker-protocol over gRPC...5358worker1 # [ 75.364431] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:39Z level=info event=signal_exit5359worker1 # [ 75.571204] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_yield5360lb # [ 75.558769] niks3-server[1074]: 2026/09/20 09:05:40 INFO lead: released remote=192.168.1.3:409405361worker2 # [ 75.577957] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:39Z level=info event=scheduler_restarting addr=lb:500515362worker1 # [ 75.579527] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:406105363worker1 # [ 75.584739] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=worker_gone addr=192.168.1.4:500515364worker1 # [ 75.587800] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_restarting addr=lb:500515365worker1 # [ 75.590968] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:406105366worker1 # [ 75.594524] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=worker_gone addr=192.168.1.3:500515367worker2 # [ 75.778796] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515368worker2 # [ 75.783113] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5369worker1 # [ 75.784798] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515370worker1 # [ 75.789438] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5371worker2 # [ 75.984194] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515372worker2 # [ 75.989894] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5373worker1 # [ 75.990718] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515374worker1 # [ 75.998663] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5375worker2 # [ 76.190986] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515376worker2 # [ 76.196152] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5377worker1 # [ 76.199912] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515378worker1 # [ 76.205163] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5379worker2 # [ 76.397413] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515380worker2 # [ 76.402609] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5381worker1 # [ 76.408551] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515382worker1 # [ 76.411785] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5383worker1 # [ 76.576325] nix-grpc-daemon[1214]: ts=2026-09-20T09:05:41Z level=info event=scheduler_restarting5384worker2 # [ 76.605693] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500515385worker2 # [ 76.609497] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5386worker2 # [ 76.810544] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:41Z level=info event=scheduler_connected addr=lb:500515387worker1 # [ 76.812479] nix-grpc-daemon[1214]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5388worker1 # [ 76.815887] nix-grpc-daemon[1214]: E0000 00:00:1789895141.263987 1257 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5389worker1 # [ 76.885706] nix-grpc-daemon[1214]: E0000 00:00:1789895141.337254 1257 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5390worker1 # [ 76.890677] nix-grpc-daemon[1214]: E0000 00:00:1789895141.337681 1257 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5391worker2 # [ 77.374723] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:41Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5392worker1 # [ 77.394127] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5393worker1 # [ 77.397529] systemd[1]: Stopped Nix worker-protocol over gRPC.5394worker1 # [ 77.401734] systemd[1]: nix-grpc-daemon.service: Consumed 155ms CPU time over 4.180s wall clock time, 12.1M memory peak, 7.3K incoming IP traffic, 7.4K outgoing IP traffic.5395worker1 # [ 77.414377] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5396worker1 # [ 77.419169] systemd[1]: Closed Nix worker-protocol over gRPC.5397worker1 # [ 77.423464] systemd[1]: nix-grpc-daemon.socket: Consumed 543us CPU time over 4.217s wall clock time, 256K memory peak, 18.8K incoming IP traffic, 13K outgoing IP traffic.5398worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5399worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds)5400worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5401worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5402worker2 # [ 77.575380] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:41Z level=info event=scheduler_connected addr=lb:500515403worker2 # [ 77.577969] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5404lb # [ 77.639411] envoy[973]: conn peer=[2001:db8:1::1]:33612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=115405lb # [ 77.643296] envoy[973]: conn peer=[2001:db8:1::3]:45252 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10928 tx=2407 ms=522615406lb # [ 77.646958] envoy[973]: conn peer=[2001:db8:1::1]:33624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=282 ms=8865407lb # [ 77.650492] envoy[973]: conn peer=[2001:db8:1::3]:55284 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1348 tx=362 ms=32235408worker2 # [ 77.779933] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500515409worker2 # [ 77.783795] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5410worker2 # [ 77.984462] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500515411worker2 # [ 77.989337] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5412worker2 # [ 78.190343] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500515413worker2 # [ 78.194144] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5414worker2 # [ 78.395126] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500515415worker2 # [ 78.400266] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5416worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5417worker2 # [ 78.601430] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500515418worker2 # [ 78.605567] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5419worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5420worker2 # [ 78.809169] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:43Z level=info event=scheduler_connected addr=lb:500515421worker2 # [ 78.812310] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5422worker2 # [ 79.010076] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:43Z level=info event=scheduler_connected addr=lb:500515423worker2 # [ 79.014265] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5424lb # [ 79.116028] niks3-server[1074]: 2026/09/20 09:05:44 INFO lead: acquired remote=192.168.1.4:519965425worker2 # [ 79.133147] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:43Z level=info event=scheduler_take_over5426worker2 # [ 79.215408] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:43Z level=info event=scheduler_connected addr=lb:500515427worker2 # [ 79.219349] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05428worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5429worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5430client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25431worker2 # [ 79.941899] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:491345432client # don't know how to build these paths:5433client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5434worker2 # [ 79.947519] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:491345435worker2 # [ 79.972774] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05436worker2 # [ 79.975333] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=15437worker2 # [ 80.016585] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345438worker2 # [ 80.026156] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:491345439client # copying 1 paths to 'lb:50051'...5440client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5441worker2 # [ 80.033859] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:491345442worker2 # [ 80.038430] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5443worker2 # [ 80.217912] nix-daemon[862]: accepted connection from pid 1180, user nix-grpc-daemon (trusted)5444worker2 # [ 80.230215] nix-daemon[862]: reaped child process 1183, status = succeeded5445worker2 # [ 80.399247] nix-daemon[862]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)5446worker2 # [ 80.410980] nix-daemon[862]: reaped child process 1188, status = succeeded5447lb # [ 80.412878] niks3-server[1074]: 2026/09/20 09:05:45 INFO Received uploads request method=POST path=/api/pending_closures5448worker2 # [ 80.442572] nix-grpc-daemon[1134]: time=2026-09-20T09:05:44.830Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5449worker2 # [ 80.444089] nix-grpc-daemon[1134]: time=2026-09-20T09:05:44.830Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5450lb # [ 80.455602] niks3-server[1074]: 2026/09/20 09:05:45 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5451lb # [ 80.464123] niks3-server[1074]: 2026/09/20 09:05:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5452worker2 # [ 80.490329] nix-grpc-daemon[1134]: time=2026-09-20T09:05:44.878Z level=INFO msg="Uploading 1 narinfos"5453lb # [ 80.473319] niks3-server[1074]: 2026/09/20 09:05:45 INFO Signed narinfos id=27 count=15454lb # [ 80.488112] niks3-server[1074]: 2026/09/20 09:05:45 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5455lb # [ 80.498651] niks3-server[1074]: 2026/09/20 09:05:45 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5456lb # [ 80.500727] niks3-server[1074]: 2026/09/20 09:05:45 INFO Completed upload id=275457worker2 # [ 80.517723] nix-grpc-daemon[1134]: time=2026-09-20T09:05:44.905Z level=INFO msg="Upload complete. (472ms)"5458worker2 # [ 80.519936] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=0 paths=1 nar_bytes_in=5205459worker2 # [ 80.521908] nix-grpc-daemon[1134]: time=2026-09-20T09:05:44.907Z level=WARN msg="Failed to register uploaded object" key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo error="server returned 404: object is not pending upload\n"5460worker2 # [ 80.525116] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345461worker2 # [ 80.530072] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5462worker2 # [ 80.534496] nix-daemon[862]: reaped child process 1178, status = succeeded5463worker2 # [ 80.539545] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5464client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5465client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5466client # farm-a> LOG-farm-a-on-standby5467worker2 # [ 81.553185] nix-daemon[862]: reaped child process 1192, status = succeeded5468worker2 # [ 81.709280] nix-daemon[862]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5469worker2 # [ 81.720175] nix-daemon[862]: reaped child process 1210, status = succeeded5470lb # [ 81.722637] niks3-server[1074]: 2026/09/20 09:05:46 INFO Received uploads request method=POST path=/api/pending_closures5471worker2 # [ 81.750522] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.138Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5472worker2 # [ 81.752265] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.140Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5473lb # [ 81.772477] niks3-server[1074]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5474lb # [ 81.780838] niks3-server[1074]: 2026/09/20 09:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5475lb # [ 81.785317] niks3-server[1074]: 2026/09/20 09:05:46 INFO Signed narinfos id=28 count=15476worker2 # [ 81.805085] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.192Z level=INFO msg="Uploading 1 narinfos"5477lb # [ 81.790059] niks3-server[1074]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5478lb # [ 81.794106] niks3-server[1074]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5479lb # [ 81.802535] niks3-server[1074]: 2026/09/20 09:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5480lb # [ 81.805600] niks3-server[1074]: 2026/09/20 09:05:46 INFO Completed upload id=285481lb # [ 81.807843] niks3-server[1074]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5482worker2 # [ 81.824285] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.212Z level=INFO msg="Upload complete. (278ms)"5483worker2 # [ 81.831937] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15484worker2 # [ 81.843803] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05485worker2 # [ 81.847829] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=15486worker2 # [ 81.856505] nix-daemon[862]: reaped child process 1190, status = succeeded5487worker2 # [ 81.888760] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345488worker2 # [ 81.901912] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:491345489worker2 # [ 81.915704] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.303Z level=INFO msg="All 1 paths already cached"5490client # copying 1 paths to 'lb:50051'...5491client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5492worker2 # [ 81.924224] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:491345493worker2 # [ 81.932513] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5494worker2 # [ 82.122950] nix-daemon[862]: accepted connection from pid 1216, user nix-grpc-daemon (trusted)5495worker2 # [ 82.135643] nix-daemon[862]: reaped child process 1219, status = succeeded5496worker2 # [ 82.286495] nix-daemon[862]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5497worker2 # [ 82.298576] nix-daemon[862]: reaped child process 1224, status = succeeded5498lb # [ 82.294722] niks3-server[1074]: 2026/09/20 09:05:47 INFO Received uploads request method=POST path=/api/pending_closures5499worker2 # [ 82.320556] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.708Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5500worker2 # [ 82.322036] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.710Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5501lb # [ 82.325600] niks3-server[1074]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5502lb # [ 82.335804] niks3-server[1074]: 2026/09/20 09:05:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5503lb # [ 82.343985] niks3-server[1074]: 2026/09/20 09:05:47 INFO Signed narinfos id=29 count=15504worker2 # [ 82.364184] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.752Z level=INFO msg="Uploading 1 narinfos"5505lb # [ 82.347363] niks3-server[1074]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5506lb # [ 82.362255] niks3-server[1074]: 2026/09/20 09:05:47 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5507lb # [ 82.369364] niks3-server[1074]: 2026/09/20 09:05:47 INFO Completed upload id=295508worker2 # [ 82.386224] nix-grpc-daemon[1134]: time=2026-09-20T09:05:46.774Z level=INFO msg="Upload complete. (440ms)"5509lb # [ 82.372105] niks3-server[1074]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5510worker2 # [ 82.389646] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=0 paths=1 nar_bytes_in=6405511worker2 # [ 82.395488] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345512worker2 # [ 82.406102] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5513worker2 # [ 82.410218] nix-daemon[862]: reaped child process 1214, status = succeeded5514worker2 # [ 82.414493] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5515client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5516client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5517client # farm-b> LOG-farm-b-on-standby5518worker2 # [ 83.439722] nix-daemon[862]: reaped child process 1228, status = succeeded5519worker2 # [ 83.610716] nix-daemon[862]: accepted connection from pid 1243, user nix-grpc-daemon (trusted)5520worker2 # [ 83.622874] nix-daemon[862]: reaped child process 1246, status = succeeded5521lb # [ 83.625176] niks3-server[1074]: 2026/09/20 09:05:48 INFO Received uploads request method=POST path=/api/pending_closures5522worker2 # [ 83.647117] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.034Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5523worker2 # [ 83.648883] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.036Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5524lb # [ 83.662714] niks3-server[1074]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5525lb # [ 83.668263] niks3-server[1074]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5526lb # [ 83.678129] niks3-server[1074]: 2026/09/20 09:05:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5527worker2 # [ 83.700138] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.088Z level=INFO msg="Uploading 1 narinfos"5528lb # [ 83.684137] niks3-server[1074]: 2026/09/20 09:05:48 INFO Signed narinfos id=30 count=15529lb # [ 83.688548] niks3-server[1074]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5530lb # [ 83.696892] niks3-server[1074]: 2026/09/20 09:05:48 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5531lb # [ 83.703905] niks3-server[1074]: 2026/09/20 09:05:48 INFO Completed upload id=305532lb # [ 83.705495] niks3-server[1074]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5533worker2 # [ 83.721146] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.109Z level=INFO msg="Upload complete. (299ms)"5534worker2 # [ 83.727651] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15535worker2 # [ 83.739292] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05536worker2 # [ 83.743175] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=15537worker2 # [ 83.751515] nix-daemon[862]: reaped child process 1226, status = succeeded5538worker2 # [ 83.785117] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345539worker2 # [ 83.797849] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:491345540worker2 # [ 83.810783] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.198Z level=INFO msg="All 2 paths already cached"5541client # copying 1 paths to 'lb:50051'...5542client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5543worker2 # [ 83.819356] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:491345544worker2 # [ 83.827691] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5545worker2 # [ 84.003240] nix-daemon[862]: accepted connection from pid 1252, user nix-grpc-daemon (trusted)5546worker2 # [ 84.015640] nix-daemon[862]: reaped child process 1255, status = succeeded5547worker2 # [ 84.188556] nix-daemon[862]: accepted connection from pid 1257, user nix-grpc-daemon (trusted)5548worker2 # [ 84.200309] nix-daemon[862]: reaped child process 1260, status = succeeded5549lb # [ 84.200384] niks3-server[1074]: 2026/09/20 09:05:49 INFO Received uploads request method=POST path=/api/pending_closures5550worker2 # [ 84.226110] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.614Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5551worker2 # [ 84.227570] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.615Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5552lb # [ 84.228561] niks3-server[1074]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5553lb # [ 84.242075] niks3-server[1074]: 2026/09/20 09:05:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5554worker2 # [ 84.264291] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.652Z level=INFO msg="Uploading 1 narinfos"5555lb # [ 84.247244] niks3-server[1074]: 2026/09/20 09:05:49 INFO Signed narinfos id=31 count=15556lb # [ 84.253931] niks3-server[1074]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5557lb # [ 84.263621] niks3-server[1074]: 2026/09/20 09:05:49 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5558lb # [ 84.270865] niks3-server[1074]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5559lb # [ 84.275942] niks3-server[1074]: 2026/09/20 09:05:49 INFO Completed upload id=315560worker2 # [ 84.293039] nix-grpc-daemon[1134]: time=2026-09-20T09:05:48.681Z level=INFO msg="Upload complete. (451ms)"5561worker2 # [ 84.295159] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=0 paths=1 nar_bytes_in=7685562worker2 # [ 84.297961] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345563worker2 # [ 84.303258] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5564worker2 # [ 84.307508] nix-daemon[862]: reaped child process 1250, status = succeeded5565client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5566worker2 # [ 84.312526] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5567client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5568worker2 # [ 85.524623] nix-daemon[862]: reaped child process 1264, status = succeeded5569client # farm-top> LOG-farm-top-on-standby5570worker2 # [ 85.683383] nix-daemon[862]: accepted connection from pid 1279, user nix-grpc-daemon (trusted)5571worker2 # [ 85.695531] nix-daemon[862]: reaped child process 1282, status = succeeded5572lb # [ 85.698993] niks3-server[1074]: 2026/09/20 09:05:50 INFO Received uploads request method=POST path=/api/pending_closures5573worker2 # [ 85.726563] nix-grpc-daemon[1134]: time=2026-09-20T09:05:50.114Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5574worker2 # [ 85.728094] nix-grpc-daemon[1134]: time=2026-09-20T09:05:50.116Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5575lb # [ 85.736696] niks3-server[1074]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5576lb # [ 85.744197] niks3-server[1074]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5577lb # [ 85.754874] niks3-server[1074]: 2026/09/20 09:05:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5578lb # [ 85.760861] niks3-server[1074]: 2026/09/20 09:05:50 INFO Signed narinfos id=32 count=15579worker2 # [ 85.778132] nix-grpc-daemon[1134]: time=2026-09-20T09:05:50.165Z level=INFO msg="Uploading 1 narinfos"5580lb # [ 85.763201] niks3-server[1074]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5581lb # [ 85.767806] niks3-server[1074]: 2026/09/20 09:05:50 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5582lb # [ 85.774440] niks3-server[1074]: 2026/09/20 09:05:50 INFO Completed upload id=325583worker2 # [ 85.791650] nix-grpc-daemon[1134]: time=2026-09-20T09:05:50.179Z level=INFO msg="Upload complete. (273ms)"5584lb # [ 85.776436] niks3-server[1074]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5585worker2 # [ 85.798888] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15586worker2 # [ 85.809480] nix-daemon[862]: reaped child process 1262, status = succeeded5587client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.13 seconds)5588client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5589client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.22 seconds)5590worker1 # [ 86.126801] systemd[1]: Listening on Nix worker-protocol over gRPC.5591worker1 # [ 86.133115] systemd[1]: Starting Nix worker-protocol over gRPC...5592worker1 # [ 86.291380] nix-grpc-daemon[1278]: ts=2026-09-20T09:05:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5593worker1 # [ 86.294784] nix-grpc-daemon[1278]: ts=2026-09-20T09:05:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15594worker1 # [ 86.301960] nix-grpc-daemon[1278]: ts=2026-09-20T09:05:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5595worker1 # [ 86.307044] systemd[1]: Started Nix worker-protocol over gRPC.5596lb: must succeed: curl -sf localhost:9901/clusters5597worker1 # [ 86.334957] nix-grpc-daemon[1278]: ts=2026-09-20T09:05:50Z level=info event=scheduler_connected addr=lb:500515598worker2 # [ 86.337502] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05599lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5600worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5601worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5602lb: must succeed: curl -sf localhost:9901/clusters5603lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5604lb: must succeed: curl -sf localhost:9901/clusters5605lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5606worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5607worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5608(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.08 seconds)5609subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5610client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5611client # [ 86.698498] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5612client # Running as unit: rs.service; invocation ID: b32cb8a326b64d969b9e5464a04268465613client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.08 seconds)5614worker2 # [ 86.898319] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:491345615client # [ 86.924205] nix[1171]: don't know how to build these paths:5616client # [ 86.925180] nix[1171]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5617worker2 # [ 86.914851] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05618worker2 # [ 86.920070] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=15619worker2 # [ 86.958513] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345620worker2 # [ 86.970845] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:491345621client # [ 86.999172] nix[1171]: copying 1 paths to 'lb:50051'...5622client # [ 86.999985] nix[1171]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5623worker2 # [ 86.980487] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:491345624worker2 # [ 86.991725] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5625worker2 # [ 87.183186] nix-daemon[862]: accepted connection from pid 1297, user nix-grpc-daemon (trusted)5626worker2 # [ 87.195744] nix-daemon[862]: reaped child process 1300, status = succeeded5627worker2 # [ 87.357128] nix-daemon[862]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5628worker2 # [ 87.368932] nix-daemon[862]: reaped child process 1305, status = succeeded5629lb # [ 87.366725] niks3-server[1074]: 2026/09/20 09:05:52 INFO Received uploads request method=POST path=/api/pending_closures5630worker2 # [ 87.392338] nix-grpc-daemon[1134]: time=2026-09-20T09:05:51.780Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5631worker2 # [ 87.394175] nix-grpc-daemon[1134]: time=2026-09-20T09:05:51.781Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5632lb # [ 87.399063] niks3-server[1074]: 2026/09/20 09:05:52 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5633lb # [ 87.409913] niks3-server[1074]: 2026/09/20 09:05:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5634lb # [ 87.414958] niks3-server[1074]: 2026/09/20 09:05:52 INFO Signed narinfos id=33 count=15635worker2 # [ 87.435486] nix-grpc-daemon[1134]: time=2026-09-20T09:05:51.823Z level=INFO msg="Uploading 1 narinfos"5636lb # [ 87.422417] niks3-server[1074]: 2026/09/20 09:05:52 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5637lb # [ 87.432926] niks3-server[1074]: 2026/09/20 09:05:52 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5638worker2 # [ 87.457521] nix-grpc-daemon[1134]: time=2026-09-20T09:05:51.845Z level=INFO msg="Upload complete. (454ms)"5639lb # [ 87.440576] niks3-server[1074]: 2026/09/20 09:05:52 INFO Completed upload id=335640lb # [ 87.442777] niks3-server[1074]: 2026/09/20 09:05:52 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5641worker2 # [ 87.460320] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=0 paths=1 nar_bytes_in=4165642worker2 # [ 87.466351] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:491345643worker2 # [ 87.477105] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5644worker2 # [ 87.480556] nix-daemon[862]: reaped child process 1295, status = succeeded5645worker2 # [ 87.485415] nix-daemon[862]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5646client # [ 87.504587] nix[1171]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5647lb # [ 87.639914] envoy[973]: conn peer=[2001:db8:1::1]:37828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9603 tx=3866 ms=58705648lb: must succeed: curl -sf localhost:9901/clusters5649lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5650lb: must succeed: curl -sf localhost:9901/clusters5651lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5652lb: must succeed: curl -sf localhost:9901/clusters5653lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5654lb: must succeed: curl -sf localhost:9901/clusters5655lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5656worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5657worker1 # [ 89.534772] systemd-journald[287]: Received client request to rotate journal, rotating.5658worker1 # [ 89.553259] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/b12d4408c337458ca575ce01e7392999.5659worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5660worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5661worker2 # [ 89.470739] systemd[1]: Stopping Nix worker-protocol over gRPC...5662worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5663??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5664 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735665client: must succeed: sleep 5.05666worker2 # [ 90.131357] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:54Z level=info event=draining5667client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5668worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5669worker2 # [ 94.914807] nix-daemon[862]: reaped child process 1309, status = succeeded5670worker2 # [ 95.076420] nix-daemon[862]: accepted connection from pid 1349, user nix-grpc-daemon (trusted)5671worker2 # [ 95.088436] nix-daemon[862]: reaped child process 1352, status = succeeded5672lb # [ 95.089319] niks3-server[1074]: 2026/09/20 09:06:00 INFO Received uploads request method=POST path=/api/pending_closures5673worker2 # [ 95.111956] nix-grpc-daemon[1134]: time=2026-09-20T09:05:59.499Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5674worker2 # [ 95.113455] nix-grpc-daemon[1134]: time=2026-09-20T09:05:59.501Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5675lb # [ 95.112057] niks3-server[1074]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5676lb # [ 95.116697] niks3-server[1074]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5677lb # [ 95.119494] niks3-server[1074]: 2026/09/20 09:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5678lb # [ 95.121289] niks3-server[1074]: 2026/09/20 09:06:00 INFO Signed narinfos id=34 count=15679worker2 # [ 95.139697] nix-grpc-daemon[1134]: time=2026-09-20T09:05:59.527Z level=INFO msg="Uploading 1 narinfos"5680lb # [ 95.125326] niks3-server[1074]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5681lb # [ 95.129071] niks3-server[1074]: 2026/09/20 09:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5682lb # [ 95.132836] niks3-server[1074]: 2026/09/20 09:06:00 INFO Completed upload id=345683worker2 # [ 95.151090] nix-grpc-daemon[1134]: time=2026-09-20T09:05:59.539Z level=INFO msg="Upload complete. (253ms)"5684lb # [ 95.134619] niks3-server[1074]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5685worker2 # [ 95.155172] nix-grpc-daemon[1078]: ts=2026-09-20T09:05:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49134 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15686worker2 # [ 95.161095] nix-daemon[862]: reaped child process 1307, status = succeeded5687client # [ 95.215177] systemd[1]: rs.service: Deactivated successfully.5688client # [ 95.218974] systemd[1]: rs.service: Consumed 120ms CPU time over 8.519s wall clock time, 37.1M memory peak, 8.3K incoming IP traffic, 8.8K outgoing IP traffic.5689worker2 # [ 96.132805] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=signal_exit5690worker2 # [ 96.360840] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=scheduler_yield5691worker2 # [ 96.362807] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=scheduler_restarting addr=lb:500515692worker1 # [ 96.363958] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:00Z level=info event=scheduler_restarting addr=lb:500515693lb # [ 96.346588] niks3-server[1074]: 2026/09/20 09:06:01 INFO lead: released remote=192.168.1.4:519965694worker2 # [ 96.366762] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:491205695worker2 # [ 96.368207] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=worker_gone addr=192.168.1.4:500515696worker2 # [ 96.370184] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:491205697worker2 # [ 96.371552] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=worker_gone addr=192.168.1.3:500515698worker2 # [ 96.563952] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=scheduler_connected addr=lb:500515699worker1 # [ 96.564326] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515700worker1 # [ 96.574317] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5701worker2 # [ 96.577628] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5702worker1 # [ 96.774984] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515703worker1 # [ 96.779708] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5704worker2 # [ 96.778883] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515705worker2 # [ 96.783557] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5706worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.14 seconds)5707client: waiting for success: ! systemctl is-active rs5708client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5709client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5710client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5711client: must fail: journalctl -u rs | grep -q 'reconnecting'5712worker1 # [ 96.980405] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515713worker1 # [ 96.983363] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5714worker2 # [ 96.983947] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515715worker2 # [ 96.988257] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5716client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5717lb: must succeed: curl -sf localhost:9901/clusters5718lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5719worker1 # [ 97.184506] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515720worker2 # [ 97.188570] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515721worker2 # [ 97.190514] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5722worker1 # [ 97.188661] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5723worker2 # [ 97.361539] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=scheduler_restarting5724worker2 # [ 97.375426] nix-daemon[862]: reaped child process 1127, status = succeeded5725worker1 # [ 97.389452] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515726worker2 # [ 97.391606] nix-grpc-daemon[1078]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5727worker2 # [ 97.396370] nix-grpc-daemon[1078]: E0000 00:00:1789895161.779709 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5728worker2 # [ 97.399956] nix-grpc-daemon[1078]: ts=2026-09-20T09:06:01Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5729lb # [ 97.640564] envoy[973]: conn peer=[2001:db8:1::1]:35612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1333 ms=82695730lb # [ 97.644336] envoy[973]: conn peer=[2001:db8:1::4]:51274 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8174 tx=1882 ms=282435731lb: must succeed: curl -sf localhost:9901/clusters5732lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5733worker2 # [ 98.187741] nix-grpc-daemon[1078]: E0000 00:00:1789895162.575664 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5734worker2 # [ 98.192538] nix-grpc-daemon[1078]: E0000 00:00:1789895162.575809 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5735worker1 # [ 98.471109] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5736worker2 # [ 98.491542] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5737worker2 # [ 98.494913] systemd[1]: Stopped Nix worker-protocol over gRPC.5738worker2 # [ 98.497315] systemd[1]: nix-grpc-daemon.service: Consumed 1.372s CPU time over 29.546s wall clock time, 35.1M memory peak, 58.9K incoming IP traffic, 126.5K outgoing IP traffic.5739worker2 # [ 98.513859] systemd[1]: Starting Nix worker-protocol over gRPC...5740worker2 # [ 98.653286] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5741worker2 # [ 98.657227] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15742worker2 # [ 98.663657] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5743worker2 # [ 98.666497] systemd[1]: Started Nix worker-protocol over gRPC.5744worker1 # [ 98.671414] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515745worker2 # [ 98.673757] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:03Z level=info event=scheduler_take_over5746lb # [ 98.657893] niks3-server[1074]: 2026/09/20 09:06:03 INFO lead: acquired remote=192.168.1.4:396305747worker1 # [ 98.677493] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5748worker2 # [ 98.690139] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515749worker2 # [ 98.696299] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05750worker1 # [ 98.878084] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515751worker1 # [ 98.880616] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5752worker1 # [ 99.081749] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515753worker2 # [ 99.085124] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05754lb: must succeed: curl -sf localhost:9901/clusters5755lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5756lb: must succeed: curl -sf localhost:9901/clusters5757lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5758worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5759worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5760(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.69 seconds)5761subtest: scheduler restart mid-build: build finishes, no double build5762client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5763client # [ 100.381698] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5764client # Running as unit: mid.service; invocation ID: 4fc8b4726caf4ce29969d4ef02004a785765client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5766worker1 # [ 100.564468] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:338125767worker1 # [ 100.569685] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)5768client # [ 100.595897] nix[1207]: don't know how to build these paths:5769client # [ 100.596891] nix[1207]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5770worker2 # [ 100.582953] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:04Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05771worker2 # [ 100.585380] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:04Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15772worker2 # [ 100.631182] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:385065773worker2 # [ 100.636252] nix-daemon[862]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5774worker2 # [ 100.644225] nix-grpc-daemon[1359]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5)5775worker2 # [ 100.706682] nix-grpc-daemon[1359]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 2/5)5776worker2 # [ 100.900387] nix-grpc-daemon[1359]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 379 ms (attempt 3/5)5777worker2 # [ 101.282056] nix-grpc-daemon[1359]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 4/5)5778worker2 # [ 101.345966] nix-grpc-daemon[1359]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5779worker2 # [ 101.355757] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:385065780client # [ 101.380202] nix[1207]: copying 1 paths to 'lb:50051'...5781worker2 # [ 101.364032] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:385065782client # [ 101.384135] nix[1207]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5783worker2 # [ 101.371804] nix-daemon[862]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5784worker2 # [ 101.382052] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:05Z level=info event=niks3_push_started pid=14265785worker2 # [ 101.735594] nix-daemon[862]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5786worker2 # [ 101.746631] nix-daemon[862]: reaped child process 1446, status = succeeded5787worker2 # [ 101.890582] nix-daemon[862]: accepted connection from pid 1448, user nix-grpc-daemon (trusted)5788worker2 # [ 101.902408] nix-daemon[862]: reaped child process 1451, status = succeeded5789lb # [ 101.899312] niks3-server[1074]: 2026/09/20 09:06:06 INFO Received uploads request method=POST path=/api/pending_closures5790worker2 # [ 101.925961] nix-grpc-daemon[1426]: time=2026-09-20T09:06:06.312Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5791worker2 # [ 101.927713] nix-grpc-daemon[1426]: time=2026-09-20T09:06:06.312Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5792lb # [ 101.937106] niks3-server[1074]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5793lb # [ 101.942899] niks3-server[1074]: 2026/09/20 09:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5794lb # [ 101.950727] niks3-server[1074]: 2026/09/20 09:06:06 INFO Signed narinfos id=35 count=15795worker2 # [ 101.970623] nix-grpc-daemon[1426]: time=2026-09-20T09:06:06.358Z level=INFO msg="Uploading 1 narinfos"5796lb # [ 101.960908] niks3-server[1074]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5797lb # [ 101.969183] niks3-server[1074]: 2026/09/20 09:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5798lb # [ 101.976532] niks3-server[1074]: 2026/09/20 09:06:06 INFO Completed upload id=355799worker2 # [ 101.993775] nix-grpc-daemon[1426]: time=2026-09-20T09:06:06.381Z level=INFO msg="Upload complete. (425ms)"5800lb # [ 101.979453] niks3-server[1074]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5801worker2 # [ 101.999116] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38506 duration_s=0 paths=1 nar_bytes_in=4245802worker2 # [ 102.004159] nix-grpc-daemon[1359]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:385065803worker2 # [ 102.014974] nix-daemon[862]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5804worker2 # [ 102.016786] nix-daemon[862]: reaped child process 1424, status = succeeded5805worker2 # [ 102.021919] nix-daemon[862]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5806client # [ 102.042071] nix[1207]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5807lb: must succeed: curl -sf localhost:9901/clusters5808lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5809lb: must succeed: curl -sf localhost:9901/clusters5810lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5811worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5812worker2 # [ 104.058401] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1359 (nix-grpc-daemon) on client request.5813worker2 # [ 104.061799] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5814lb # [ 104.045548] niks3-server[1074]: 2026/09/20 09:06:08 INFO lead: released remote=192.168.1.4:396305815worker1 # [ 104.063385] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5816client # [ 104.084325] nix[1207]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5817client # [ 104.089196] nix[1207]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5818worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.07 seconds)5819client: must succeed: sleep 5.05820worker2 # [ 104.093256] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5821worker2 # [ 104.095439] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5822worker2 # [ 104.098156] systemd[1]: nix-grpc-daemon.service: Consumed 338ms CPU time over 5.579s wall clock time, 32.7M memory peak, 11.8K incoming IP traffic, 14.8K outgoing IP traffic.5823worker2 # [ 104.104437] nix-daemon[862]: reaped child process 1453, status = succeeded5824worker2 # [ 104.105829] nix-daemon[862]: reaped child process 1419, status = succeeded5825worker2 # [ 104.114291] nix-daemon[1455]: unexpected Nix daemon error: error: interrupted by the user5826worker2 # [ 104.119127] nix-daemon[862]: reaped child process 1455, status = failed with exit code 15827worker1 # [ 104.263677] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:08Z level=info event=scheduler_connected addr=lb:500515828worker2 # [ 104.267287] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5829worker2 # [ 104.277190] systemd[1]: Starting Nix worker-protocol over gRPC...5830worker2 # [ 104.465231] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5831worker2 # [ 104.469335] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15832worker2 # [ 104.477068] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5833worker2 # [ 104.481709] systemd[1]: Started Nix worker-protocol over gRPC.5834lb # [ 104.470314] niks3-server[1074]: 2026/09/20 09:06:09 INFO lead: acquired remote=192.168.1.4:514365835worker2 # [ 104.487494] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=info event=scheduler_take_over5836worker1 # [ 104.484284] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5837worker2 # [ 104.508627] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=info event=scheduler_connected addr=lb:500515838worker2 # [ 104.510383] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05839worker2 # [ 104.571149] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05840worker2 # [ 104.573486] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:08Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15841worker2 # [ 104.619871] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465445842worker2 # [ 104.629179] nix-daemon[862]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5843worker2 # [ 104.643593] nix-daemon[862]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5844client # [ 104.673461] nix[1207]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5845worker2 # [ 104.655735] nix-daemon[862]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5846worker2 # [ 104.686698] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05847worker1 # [ 104.685438] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:09Z level=info event=scheduler_connected addr=lb:500515848lb # [ 107.640952] envoy[973]: conn peer=[2001:db8:1::4]:41144 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=534 tx=226 ms=53765849client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5850client: waiting for success: ! systemctl is-active mid5851worker2 # [ 109.469899] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:13Z level=info event=niks3_push_started pid=15705852worker2 # [ 109.480949] nix-daemon[862]: reaped child process 1546, status = succeeded5853worker2 # [ 109.792228] nix-daemon[862]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5854worker2 # [ 109.804289] nix-daemon[862]: reaped child process 1586, status = succeeded5855lb # [ 109.805933] niks3-server[1074]: 2026/09/20 09:06:14 INFO Received uploads request method=POST path=/api/pending_closures5856worker2 # [ 109.831797] nix-grpc-daemon[1570]: time=2026-09-20T09:06:14.219Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5857worker2 # [ 109.834989] nix-grpc-daemon[1570]: time=2026-09-20T09:06:14.221Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5858lb # [ 109.851155] niks3-server[1074]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5859lb # [ 109.871600] niks3-server[1074]: 2026/09/20 09:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5860lb # [ 109.877526] niks3-server[1074]: 2026/09/20 09:06:14 INFO Signed narinfos id=36 count=15861worker2 # [ 109.895694] nix-grpc-daemon[1570]: time=2026-09-20T09:06:14.282Z level=INFO msg="Uploading 1 narinfos"5862lb # [ 109.885112] niks3-server[1074]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5863lb # [ 109.892089] niks3-server[1074]: 2026/09/20 09:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5864lb # [ 109.894262] niks3-server[1074]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5865lb # [ 109.896933] niks3-server[1074]: 2026/09/20 09:06:14 INFO Completed upload id=365866worker2 # [ 109.914263] nix-grpc-daemon[1570]: time=2026-09-20T09:06:14.302Z level=INFO msg="Upload complete. (268ms)"5867lb # [ 109.899266] niks3-server[1074]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5868worker2 # [ 109.920268] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46544 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15869worker2 # [ 109.933482] nix-daemon[862]: reaped child process 1544, status = succeeded5870client # [ 109.984426] systemd[1]: mid.service: Deactivated successfully.5871client # [ 109.988755] systemd[1]: mid.service: Consumed 132ms CPU time over 9.605s wall clock time, 39.1M memory peak, 9.6K incoming IP traffic, 10.7K outgoing IP traffic.5872client: (finished: waiting for success: ! systemctl is-active mid, in 1.07 seconds)5873client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5874client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5875(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.16 seconds)5876subtest: interrupting the client stops the build on the worker5877client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5878client # [ 110.518958] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5879client # Running as unit: intr.service; invocation ID: 4f7bb22171934caaa1f4615b669dc0c95880client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5881worker2 # [ 110.703180] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:465445882client # [ 110.729389] nix[1243]: don't know how to build these paths:5883client # [ 110.730359] nix[1243]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5884worker2 # [ 110.718777] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:15Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05885worker2 # [ 110.722995] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:15Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15886worker1 # [ 110.763755] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338125887worker1 # [ 110.776808] nix-grpc-daemon[1278]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 1/5)5888worker1 # [ 110.868872] nix-grpc-daemon[1278]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 2/5)5889worker1 # [ 110.956113] nix-grpc-daemon[1278]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 3/5)5890worker1 # [ 111.245305] nix-grpc-daemon[1278]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 4/5)5891worker1 # [ 111.323140] nix-grpc-daemon[1278]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5892worker1 # [ 111.340193] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338125893client # [ 111.371276] nix[1243]: copying 1 paths to 'lb:50051'...5894worker1 # [ 111.352451] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338125895client # [ 111.374224] nix[1243]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5896worker1 # [ 111.366538] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)5897worker1 # [ 111.384701] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:15Z level=info event=niks3_push_started pid=14185898worker1 # [ 111.753089] nix-daemon[843]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5899worker1 # [ 111.765844] nix-daemon[843]: reaped child process 1438, status = succeeded5900worker1 # [ 111.933403] nix-daemon[843]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5901worker1 # [ 111.947220] nix-daemon[843]: reaped child process 1443, status = succeeded5902lb # [ 111.944526] niks3-server[1074]: 2026/09/20 09:06:16 INFO Received uploads request method=POST path=/api/pending_closures5903worker1 # [ 111.968136] nix-grpc-daemon[1418]: time=2026-09-20T09:06:16.418Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5904worker1 # [ 111.969794] nix-grpc-daemon[1418]: time=2026-09-20T09:06:16.418Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5905lb # [ 111.965298] niks3-server[1074]: 2026/09/20 09:06:16 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5906lb # [ 111.968529] niks3-server[1074]: 2026/09/20 09:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5907lb # [ 111.970377] niks3-server[1074]: 2026/09/20 09:06:16 INFO Signed narinfos id=37 count=15908worker1 # [ 111.988976] nix-grpc-daemon[1418]: time=2026-09-20T09:06:16.440Z level=INFO msg="Uploading 1 narinfos"5909lb # [ 111.974458] niks3-server[1074]: 2026/09/20 09:06:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5910lb # [ 111.979221] niks3-server[1074]: 2026/09/20 09:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5911lb # [ 111.981905] niks3-server[1074]: 2026/09/20 09:06:16 INFO Completed upload id=375912worker1 # [ 111.999685] nix-grpc-daemon[1418]: time=2026-09-20T09:06:16.451Z level=INFO msg="Upload complete. (414ms)"5913lb # [ 111.984026] niks3-server[1074]: 2026/09/20 09:06:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5914worker1 # [ 112.003158] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=4245915worker1 # [ 112.005814] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338125916worker1 # [ 112.011261] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)5917worker1 # [ 112.016737] nix-daemon[843]: reaped child process 1416, status = succeeded5918client # [ 112.040975] nix[1243]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5919worker1 # [ 112.021542] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)5920client: must succeed: systemctl kill -s INT intr5921client # [ 114.071681] systemd[1]: intr.service: Sent signal SIGINT to main process 1243 (nix) on client request.5922worker1 # [ 114.054341] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:18Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5923client # [ 114.078656] nix[1243]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5924client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5925client # [ 114.085398] nix[1243]: error: interrupted by the user5926client # [ 114.117768] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5927client # [ 114.119243] systemd[1]: intr.service: Failed with result 'exit-code'.5928client # [ 114.121234] systemd[1]: intr.service: Consumed 115ms CPU time over 3.601s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.9K outgoing IP traffic.5929worker1 # [ 114.242160] nix-daemon[843]: reaped child process 1445, status = succeeded5930worker1 # [ 114.246243] nix-daemon[1447]: unexpected Nix daemon error: error: interrupted by the user5931worker1 # [ 114.251074] nix-daemon[843]: reaped child process 1447, status = failed with exit code 15932(finished: subtest: interrupting the client stops the build on the worker, in 4.84 seconds)5933subtest: a deploy mid-build drains: the build finishes, the new generation takes over5934client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5935client # [ 115.384593] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5936client # Running as unit: sw.service; invocation ID: 5183d051d76941bb909cb0289ea100755937client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5938worker1 # [ 115.570483] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:338125939client # [ 115.596774] nix[1264]: don't know how to build these paths:5940client # [ 115.597709] nix[1264]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5941worker2 # [ 115.586916] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:19Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05942worker2 # [ 115.592921] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:19Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15943worker2 # [ 115.635614] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465445944worker2 # [ 115.647590] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5)5945worker2 # [ 115.690591] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 115 ms (attempt 2/5)5946worker2 # [ 115.805995] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 3/5)5947worker2 # [ 115.956715] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 4/5)5948worker2 # [ 116.061650] nix-grpc-daemon[1491]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5949worker2 # [ 116.074380] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:465445950client # [ 116.101252] nix[1264]: copying 1 paths to 'lb:50051'...5951worker2 # [ 116.082683] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:465445952client # [ 116.105150] nix[1264]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5953worker2 # [ 116.089698] nix-daemon[862]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5954worker2 # [ 116.237641] nix-daemon[862]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)5955worker2 # [ 116.249861] nix-daemon[862]: reaped child process 1628, status = succeeded5956worker2 # [ 116.402235] nix-daemon[862]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)5957worker2 # [ 116.414150] nix-daemon[862]: reaped child process 1633, status = succeeded5958lb # [ 116.415554] niks3-server[1074]: 2026/09/20 09:06:21 INFO Received uploads request method=POST path=/api/pending_closures5959worker2 # [ 116.441349] nix-grpc-daemon[1570]: time=2026-09-20T09:06:20.828Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5960worker2 # [ 116.442792] nix-grpc-daemon[1570]: time=2026-09-20T09:06:20.828Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5961lb # [ 116.448654] niks3-server[1074]: 2026/09/20 09:06:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5962worker2 # [ 116.472183] nix-grpc-daemon[1570]: time=2026-09-20T09:06:20.860Z level=INFO msg="Uploading 1 narinfos"5963lb # [ 116.456144] niks3-server[1074]: 2026/09/20 09:06:21 INFO Signed narinfos id=38 count=15964lb # [ 116.462269] niks3-server[1074]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5965lb # [ 116.471433] niks3-server[1074]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5966lb # [ 116.479845] niks3-server[1074]: 2026/09/20 09:06:21 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5967lb # [ 116.489603] niks3-server[1074]: 2026/09/20 09:06:21 INFO Completed upload id=385968worker2 # [ 116.506705] nix-grpc-daemon[1570]: time=2026-09-20T09:06:20.894Z level=INFO msg="Upload complete. (412ms)"5969lb # [ 116.491570] niks3-server[1074]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5970worker2 # [ 116.508954] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46544 duration_s=0 paths=1 nar_bytes_in=4165971worker2 # [ 116.513089] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465445972worker2 # [ 116.521062] nix-daemon[862]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5973worker2 # [ 116.522401] nix-daemon[862]: reaped child process 1623, status = succeeded5974worker2 # [ 116.527709] nix-daemon[862]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5975client # [ 116.546581] nix[1264]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5976lb # [ 117.640785] envoy[973]: conn peer=[2001:db8:1::1]:34202 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1638 ms=93775977lb # [ 117.644569] envoy[973]: conn peer=[2001:db8:1::1]:34186 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=731 ms=33755978worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25979worker2 # Checking switch inhibitors... done5980worker2 # [ 119.682191] nixos[1672]: switching to system configuration /nix/store/sk820hc3azag8pgag8zqa4r8rvx2cp9w-nixos-system-worker2-test5981worker2 # activating the configuration...5982worker2 # [ 119.687838] systemd[1]: Stopped target Remote File Systems.5983worker2 # [ 119.688746] systemd[1]: Stopped target Local File Systems.5984worker2 # setting up /etc...5985worker2 # [ 120.327306] systemd[1]: Reload requested from client PID 1672 ('.switch-to-conf') (unit backdoor.service)...5986worker2 # [ 120.330160] systemd[1]: Reloading...5987worker2 # [ 120.992976] systemd[1]: Reloading finished in 661 ms.5988worker2 # restarting sysinit-reactivation.target5989worker2 # [ 121.052282] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5990worker2 # [ 121.193262] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5991worker2 # [ 121.197536] systemd[1]: Reached target Reactivate sysinit units.5992worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5993worker2 # [ 121.203284] systemd[1]: Reloading D-Bus System Message Bus...5994worker2 # [ 121.205478] dbus-broker-launch[533]: Caught SIGHUP, trigger reload.5995worker2 # [ 121.209198] systemd[1]: Reloading Nix worker-protocol over gRPC...5996worker2 # [ 121.234987] dbus-broker-launch[533]: Looking up NSS user entry for 'systemd-timesync'...5997worker2 # [ 121.241625] dbus-broker-launch[533]: NSS returned no entry for 'systemd-timesync'5998worker2 # [ 121.243556] dbus-broker-launch[533]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5999worker2 # [ 121.256664] systemd[1]: Reloaded Nix worker-protocol over gRPC.6000worker2 # [ 121.273734] systemd[1]: Reloaded D-Bus System Message Bus.6001worker2 # [ 121.278852] systemd[1]: Reached target Remote File Systems.6002worker2 # [ 121.283491] systemd[1]: Starting linger-users.service...6003worker2 # [ 121.285454] systemd[1]: Reached target Local File Systems.6004worker2 # [ 121.287059] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6005worker2 # [ 121.294575] systemd[1]: Starting Create SUID/SGID Wrappers...6006worker2 # [ 121.295439] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6007worker2 # [ 121.296660] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676008worker2 # [ 121.298588] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6009worker2 # [ 121.300052] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6010worker2 # [ 121.301195] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6011worker2 # [ 121.316436] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6012worker2 # [ 121.317811] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6013worker2 # [ 121.356486] systemd[1]: linger-users.service: Deactivated successfully.6014worker2 # [ 121.357469] systemd[1]: Finished linger-users.service.6015worker2 # [ 121.484626] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:25Z level=info event=draining6016worker2 # [ 121.749286] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6017worker2 # [ 121.750901] systemd[1]: Finished Create SUID/SGID Wrappers.6018worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6019worker2 # [ 122.007593] nixos[1672]: finished switching to system configuration /nix/store/sk820hc3azag8pgag8zqa4r8rvx2cp9w-nixos-system-worker2-test6020worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.07 seconds)6021worker2: must succeed: pgrep -f 'read -t [9]0 x'6022worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6023client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26024worker1 # [ 122.263487] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:338126025client # don't know how to build these paths:6026client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6027worker1 # [ 122.274593] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126028worker2 # [ 122.295503] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:26Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06029worker2 # [ 122.298147] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:26Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16030worker1 # [ 122.339120] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126031worker1 # [ 122.353895] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126032client # copying 1 paths to 'lb:50051'...6033worker1 # [ 122.365771] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126034client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6035worker1 # [ 122.379094] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6036worker1 # [ 122.552797] nix-daemon[843]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)6037worker1 # [ 122.566855] nix-daemon[843]: reaped child process 1504, status = succeeded6038worker1 # [ 122.725099] nix-daemon[843]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)6039worker1 # [ 122.739936] nix-daemon[843]: reaped child process 1509, status = succeeded6040lb # [ 122.737787] niks3-server[1074]: 2026/09/20 09:06:27 INFO Received uploads request method=POST path=/api/pending_closures6041worker1 # [ 122.762060] nix-grpc-daemon[1418]: time=2026-09-20T09:06:27.213Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6042worker1 # [ 122.763584] nix-grpc-daemon[1418]: time=2026-09-20T09:06:27.215Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6043lb # [ 122.767816] niks3-server[1074]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6044lb # [ 122.778250] niks3-server[1074]: 2026/09/20 09:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6045worker1 # [ 122.799799] nix-grpc-daemon[1418]: time=2026-09-20T09:06:27.251Z level=INFO msg="Uploading 1 narinfos"6046lb # [ 122.783598] niks3-server[1074]: 2026/09/20 09:06:27 INFO Signed narinfos id=39 count=16047lb # [ 122.788137] niks3-server[1074]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6048lb # [ 122.798423] niks3-server[1074]: 2026/09/20 09:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6049lb # [ 122.803799] niks3-server[1074]: 2026/09/20 09:06:27 INFO Completed upload id=396050worker1 # [ 122.820461] nix-grpc-daemon[1418]: time=2026-09-20T09:06:27.272Z level=INFO msg="Upload complete. (430ms)"6051lb # [ 122.805821] niks3-server[1074]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6052worker1 # [ 122.823613] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=5286053worker1 # [ 122.828655] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126054worker1 # [ 122.839134] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6055worker1 # [ 122.843570] nix-daemon[843]: reaped child process 1499, status = succeeded6056worker1 # [ 122.848842] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6057client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6058client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6059client # farm-a> LOG-farm-a-during-drain6060worker1 # [ 123.664905] nix-daemon[843]: reaped child process 1513, status = succeeded6061worker1 # [ 123.821101] nix-daemon[843]: accepted connection from pid 1528, user nix-grpc-daemon (trusted)6062worker1 # [ 123.834175] nix-daemon[843]: reaped child process 1531, status = succeeded6063lb # [ 123.832849] niks3-server[1074]: 2026/09/20 09:06:28 INFO Received uploads request method=POST path=/api/pending_closures6064worker1 # [ 123.859844] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.311Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6065worker1 # [ 123.864079] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.313Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6066lb # [ 123.871946] niks3-server[1074]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6067lb # [ 123.880057] niks3-server[1074]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6068lb # [ 123.892053] niks3-server[1074]: 2026/09/20 09:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6069lb # [ 123.899096] niks3-server[1074]: 2026/09/20 09:06:28 INFO Signed narinfos id=40 count=16070worker1 # [ 123.918277] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.369Z level=INFO msg="Uploading 1 narinfos"6071lb # [ 123.903438] niks3-server[1074]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6072lb # [ 123.916046] niks3-server[1074]: 2026/09/20 09:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6073lb # [ 123.919929] niks3-server[1074]: 2026/09/20 09:06:28 INFO Completed upload id=406074lb # [ 123.921589] niks3-server[1074]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6075worker1 # [ 123.937866] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.389Z level=INFO msg="Upload complete. (281ms)"6076worker2 # [ 123.948083] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:28Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06077worker1 # [ 123.944417] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16078worker2 # [ 123.949725] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:28Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16079worker1 # [ 123.958437] nix-daemon[843]: reaped child process 1511, status = succeeded6080worker1 # [ 123.997092] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126081worker1 # [ 124.009721] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126082worker1 # [ 124.022770] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.474Z level=INFO msg="All 1 paths already cached"6083client # copying 1 paths to 'lb:50051'...6084worker1 # [ 124.030970] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126085client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6086worker1 # [ 124.050345] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6087worker1 # [ 124.226827] nix-daemon[843]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6088worker1 # [ 124.240856] nix-daemon[843]: reaped child process 1538, status = succeeded6089worker1 # [ 124.408911] nix-daemon[843]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)6090worker1 # [ 124.422628] nix-daemon[843]: reaped child process 1543, status = succeeded6091lb # [ 124.422510] niks3-server[1074]: 2026/09/20 09:06:29 INFO Received uploads request method=POST path=/api/pending_closures6092worker1 # [ 124.447414] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.899Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6093worker1 # [ 124.448973] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.900Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6094lb # [ 124.451234] niks3-server[1074]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6095lb # [ 124.463218] niks3-server[1074]: 2026/09/20 09:06:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6096lb # [ 124.467751] niks3-server[1074]: 2026/09/20 09:06:29 INFO Signed narinfos id=41 count=16097worker1 # [ 124.487429] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.939Z level=INFO msg="Uploading 1 narinfos"6098lb # [ 124.477682] niks3-server[1074]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6099lb # [ 124.487284] niks3-server[1074]: 2026/09/20 09:06:29 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6100lb # [ 124.494374] niks3-server[1074]: 2026/09/20 09:06:29 INFO Completed upload id=416101worker1 # [ 124.510708] nix-grpc-daemon[1418]: time=2026-09-20T09:06:28.962Z level=INFO msg="Upload complete. (446ms)"6102lb # [ 124.497176] niks3-server[1074]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6103worker1 # [ 124.513973] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=6406104worker1 # [ 124.522256] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126105worker1 # [ 124.531061] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6106worker1 # [ 124.533735] nix-daemon[843]: reaped child process 1533, status = succeeded6107worker1 # [ 124.539561] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6108client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6109client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6110client # farm-b> LOG-farm-b-during-drain6111worker1 # [ 125.766336] nix-daemon[843]: reaped child process 1547, status = succeeded6112worker1 # [ 125.927564] nix-daemon[843]: accepted connection from pid 1562, user nix-grpc-daemon (trusted)6113worker1 # [ 125.941596] nix-daemon[843]: reaped child process 1565, status = succeeded6114lb # [ 125.939699] niks3-server[1074]: 2026/09/20 09:06:30 INFO Received uploads request method=POST path=/api/pending_closures6115worker1 # [ 125.964865] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.415Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6116worker1 # [ 125.966244] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.415Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6117lb # [ 125.972448] niks3-server[1074]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6118lb # [ 125.978304] niks3-server[1074]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6119lb # [ 125.990520] niks3-server[1074]: 2026/09/20 09:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6120worker1 # [ 126.012866] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.464Z level=INFO msg="Uploading 1 narinfos"6121lb # [ 125.996333] niks3-server[1074]: 2026/09/20 09:06:30 INFO Signed narinfos id=42 count=16122lb # [ 126.001522] niks3-server[1074]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6123lb # [ 126.009108] niks3-server[1074]: 2026/09/20 09:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6124lb # [ 126.015683] niks3-server[1074]: 2026/09/20 09:06:30 INFO Completed upload id=426125worker1 # [ 126.032530] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.484Z level=INFO msg="Upload complete. (284ms)"6126lb # [ 126.018848] niks3-server[1074]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6127worker2 # [ 126.043392] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:30Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06128worker2 # [ 126.045236] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:30Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16129worker1 # [ 126.038621] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16130worker1 # [ 126.054097] nix-daemon[843]: reaped child process 1545, status = succeeded6131worker1 # [ 126.087534] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126132worker1 # [ 126.105951] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126133worker1 # [ 126.118877] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.570Z level=INFO msg="All 2 paths already cached"6134client # copying 1 paths to 'lb:50051'...6135worker1 # [ 126.127634] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126136client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6137worker1 # [ 126.147398] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6138worker1 # [ 126.321578] nix-daemon[843]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)6139worker1 # [ 126.336217] nix-daemon[843]: reaped child process 1572, status = succeeded6140worker1 # [ 126.467659] nix-daemon[843]: accepted connection from pid 1574, user nix-grpc-daemon (trusted)6141worker1 # [ 126.482503] nix-daemon[843]: reaped child process 1577, status = succeeded6142lb # [ 126.475913] niks3-server[1074]: 2026/09/20 09:06:31 INFO Received uploads request method=POST path=/api/pending_closures6143worker1 # [ 126.499965] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.951Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6144worker1 # [ 126.501531] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.953Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6145lb # [ 126.503853] niks3-server[1074]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6146lb # [ 126.512327] niks3-server[1074]: 2026/09/20 09:06:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6147worker1 # [ 126.534458] nix-grpc-daemon[1418]: time=2026-09-20T09:06:30.986Z level=INFO msg="Uploading 1 narinfos"6148lb # [ 126.517888] niks3-server[1074]: 2026/09/20 09:06:31 INFO Signed narinfos id=43 count=16149lb # [ 126.527205] niks3-server[1074]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6150lb # [ 126.536876] niks3-server[1074]: 2026/09/20 09:06:31 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6151lb # [ 126.541119] niks3-server[1074]: 2026/09/20 09:06:31 INFO Completed upload id=436152worker1 # [ 126.559633] nix-grpc-daemon[1418]: time=2026-09-20T09:06:31.011Z level=INFO msg="Upload complete. (398ms)"6153lb # [ 126.543830] niks3-server[1074]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6154worker1 # [ 126.562644] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=7686155worker1 # [ 126.568291] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126156worker1 # [ 126.576613] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6157worker1 # [ 126.582905] nix-daemon[843]: reaped child process 1567, status = succeeded6158worker1 # [ 126.587435] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6159client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6160client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6161client # farm-top> LOG-farm-top-during-drain6162worker1 # [ 128.004831] nix-daemon[843]: reaped child process 1581, status = succeeded6163worker1 # [ 128.149104] nix-daemon[843]: accepted connection from pid 1596, user nix-grpc-daemon (trusted)6164worker1 # [ 128.161404] nix-daemon[843]: reaped child process 1599, status = succeeded6165lb # [ 128.159333] niks3-server[1074]: 2026/09/20 09:06:33 INFO Received uploads request method=POST path=/api/pending_closures6166worker1 # [ 128.181893] nix-grpc-daemon[1418]: time=2026-09-20T09:06:32.633Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6167worker1 # [ 128.183446] nix-grpc-daemon[1418]: time=2026-09-20T09:06:32.635Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6168lb # [ 128.189204] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6169lb # [ 128.202218] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6170lb # [ 128.211822] niks3-server[1074]: 2026/09/20 09:06:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6171worker1 # [ 128.233486] nix-grpc-daemon[1418]: time=2026-09-20T09:06:32.684Z level=INFO msg="Uploading 1 narinfos"6172lb # [ 128.216748] niks3-server[1074]: 2026/09/20 09:06:33 INFO Signed narinfos id=44 count=16173lb # [ 128.221945] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6174lb # [ 128.230923] niks3-server[1074]: 2026/09/20 09:06:33 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6175lb # [ 128.235662] niks3-server[1074]: 2026/09/20 09:06:33 INFO Completed upload id=446176worker1 # [ 128.254554] nix-grpc-daemon[1418]: time=2026-09-20T09:06:32.706Z level=INFO msg="Upload complete. (259ms)"6177lb # [ 128.239088] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6178worker1 # [ 128.260651] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16179worker1 # [ 128.272228] nix-daemon[843]: reaped child process 1579, status = succeeded6180client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.24 seconds)6181client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6182client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.20 seconds)6183worker2: must succeed: pkill -f 'read -t [9]0 x'6184worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6185client: waiting for success: ! systemctl is-active sw6186worker2 # [ 128.768897] nix-daemon[862]: reaped child process 1637, status = succeeded6187worker2 # [ 128.927278] nix-daemon[862]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6188worker2 # [ 128.939503] nix-daemon[862]: reaped child process 1821, status = succeeded6189lb # [ 128.939897] niks3-server[1074]: 2026/09/20 09:06:33 INFO Received uploads request method=POST path=/api/pending_closures6190worker2 # [ 128.965421] nix-grpc-daemon[1570]: time=2026-09-20T09:06:33.353Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6191worker2 # [ 128.967182] nix-grpc-daemon[1570]: time=2026-09-20T09:06:33.355Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6192lb # [ 128.974141] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6193lb # [ 128.989223] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6194lb # [ 128.993417] niks3-server[1074]: 2026/09/20 09:06:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6195lb # [ 128.997714] niks3-server[1074]: 2026/09/20 09:06:33 INFO Signed narinfos id=45 count=16196worker2 # [ 129.018137] nix-grpc-daemon[1570]: time=2026-09-20T09:06:33.405Z level=INFO msg="Uploading 1 narinfos"6197lb # [ 129.006250] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6198lb # [ 129.015846] niks3-server[1074]: 2026/09/20 09:06:33 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6199lb # [ 129.021653] niks3-server[1074]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6200lb # [ 129.023939] niks3-server[1074]: 2026/09/20 09:06:33 INFO Completed upload id=456201worker2 # [ 129.041154] nix-grpc-daemon[1570]: time=2026-09-20T09:06:33.429Z level=INFO msg="Upload complete. (291ms)"6202worker2 # [ 129.049858] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46544 duration_s=12 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16203worker2 # [ 129.063119] nix-daemon[862]: reaped child process 1635, status = succeeded6204client # [ 129.106584] systemd[1]: sw.service: Deactivated successfully.6205client # [ 129.111385] systemd[1]: sw.service: Consumed 129ms CPU time over 13.724s wall clock time, 37.1M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.6206worker2 # [ 129.487218] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=signal_exit6207worker2 # [ 129.492297] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=scheduler_yield6208lb # [ 129.476826] niks3-server[1074]: 2026/09/20 09:06:34 INFO lead: released remote=192.168.1.4:514366209worker1 # [ 129.498649] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:33Z level=info event=scheduler_restarting addr=lb:500516210worker2 # [ 129.498928] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465266211worker2 # [ 129.504994] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=worker_gone addr=192.168.1.3:500516212worker2 # [ 129.508608] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=scheduler_restarting addr=lb:500516213worker2 # [ 129.512137] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465266214worker2 # [ 129.515921] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:33Z level=info event=worker_gone addr=192.168.1.4:500516215client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6216client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6217client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6218worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6219worker1 # [ 129.699217] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516220worker2 # [ 129.705588] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516221worker1 # [ 129.706237] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6222worker2 # [ 129.714175] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6223worker1 # [ 129.907463] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516224worker1 # [ 129.912994] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6225worker2 # [ 129.914976] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516226worker2 # [ 129.920498] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6227worker1 # [ 130.114194] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516228worker1 # [ 130.119201] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6229worker2 # [ 130.123812] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516230worker2 # [ 130.126910] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6231worker1 # [ 130.320892] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516232worker2 # [ 130.324556] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516233worker1 # [ 130.325697] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6234worker2 # [ 130.329809] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6235worker2 # [ 130.493191] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=scheduler_restarting6236worker2 # [ 130.514716] nix-daemon[862]: reaped child process 1542, status = succeeded6237worker1 # [ 130.527809] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_connected addr=lb:500516238worker1 # [ 130.532690] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6239worker2 # [ 130.540883] nix-grpc-daemon[1491]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6240worker2 # [ 130.545448] nix-grpc-daemon[1491]: E0000 00:00:1789895194.928700 1534 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6241worker2 # [ 130.551362] nix-grpc-daemon[1491]: E0000 00:00:1789895194.928817 1534 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6242worker2 # [ 130.556903] nix-grpc-daemon[1491]: ts=2026-09-20T09:06:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6243worker1 # [ 130.733847] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:35Z level=info event=scheduler_connected addr=lb:500516244worker2 # [ 130.736335] nix-grpc-daemon[1491]: E0000 00:00:1789895195.124281 1534 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true6245lb # [ 131.297311] niks3-server[1074]: 2026/09/20 09:06:36 INFO lead: acquired remote=192.168.1.3:553486246worker1 # [ 131.313731] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:35Z level=info event=scheduler_take_over6247worker1 # [ 132.503116] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"6248worker2 # [ 132.522694] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6249worker2 # [ 132.526501] systemd[1]: nix-grpc-daemon.service: Consumed 680ms CPU time over 28.429s wall clock time, 33.1M memory peak, 23.9K incoming IP traffic, 32.6K outgoing IP traffic.6250worker2 # [ 132.542482] systemd[1]: Starting Nix worker-protocol over gRPC...6251worker1 # [ 132.704132] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:37Z level=info event=scheduler_connected addr=lb:500516252worker2 # [ 132.706978] nix-grpc-daemon[1835]: ts=2026-09-20T09:06:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6253worker2 # [ 132.711099] nix-grpc-daemon[1835]: ts=2026-09-20T09:06:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16254worker1 # [ 132.709800] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06255worker2 # [ 132.716994] nix-grpc-daemon[1835]: ts=2026-09-20T09:06:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6256worker2 # [ 132.721240] systemd[1]: Started Nix worker-protocol over gRPC.6257worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.05 seconds)6258lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6259lb: must succeed: curl -sf localhost:9901/clusters6260worker2 # [ 132.750524] nix-grpc-daemon[1835]: ts=2026-09-20T09:06:37Z level=info event=scheduler_connected addr=lb:500516261worker1 # [ 132.753193] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06262lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6263lb: must succeed: curl -sf localhost:9901/clusters6264lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6265lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.15 seconds)6266lb: must succeed: curl -sf localhost:9901/clusters6267lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6268worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6269worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)6270(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.67 seconds)6271subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6272client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16273worker1 # [ 134.166919] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:338126274worker1 # [ 134.173899] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126275worker1 # [ 134.212074] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06276worker1 # [ 134.216491] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16277worker1 # [ 134.220774] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06278worker1 # [ 134.224569] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06279worker1 # [ 134.255138] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126280worker1 # [ 134.267577] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126281worker1 # [ 134.278431] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126282worker1 # [ 134.290344] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6283worker1 # [ 134.469260] nix-daemon[843]: accepted connection from pid 1610, user nix-grpc-daemon (trusted)6284worker1 # [ 134.483084] nix-daemon[843]: reaped child process 1613, status = succeeded6285worker1 # [ 134.650471] nix-daemon[843]: accepted connection from pid 1615, user nix-grpc-daemon (trusted)6286worker1 # [ 134.663947] nix-daemon[843]: reaped child process 1618, status = succeeded6287lb # [ 134.662308] niks3-server[1074]: 2026/09/20 09:06:39 INFO Received uploads request method=POST path=/api/pending_closures6288worker1 # [ 134.685270] nix-grpc-daemon[1418]: time=2026-09-20T09:06:39.136Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6289worker1 # [ 134.687067] nix-grpc-daemon[1418]: time=2026-09-20T09:06:39.136Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6290lb # [ 134.679260] niks3-server[1074]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6291lb # [ 134.682552] niks3-server[1074]: 2026/09/20 09:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6292worker1 # [ 134.701411] nix-grpc-daemon[1418]: time=2026-09-20T09:06:39.152Z level=INFO msg="Uploading 1 narinfos"6293lb # [ 134.684615] niks3-server[1074]: 2026/09/20 09:06:39 INFO Signed narinfos id=46 count=16294lb # [ 134.690859] niks3-server[1074]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6295lb # [ 134.693115] niks3-server[1074]: 2026/09/20 09:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6296lb # [ 134.699056] niks3-server[1074]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6297lb # [ 134.708364] niks3-server[1074]: 2026/09/20 09:06:39 INFO Completed upload id=466298worker1 # [ 134.726236] nix-grpc-daemon[1418]: time=2026-09-20T09:06:39.177Z level=INFO msg="Upload complete. (424ms)"6299worker1 # [ 134.729075] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=5046300worker1 # [ 134.735717] nix-daemon[843]: reaped child process 1608, status = succeeded6301worker1 # [ 134.755362] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126302worker1 # [ 134.760277] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6303worker1 # [ 134.768669] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6304worker1 # [ 135.384401] nix-daemon[843]: reaped child process 1622, status = succeeded6305worker1 # [ 135.534421] nix-daemon[843]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6306worker1 # [ 135.548424] nix-daemon[843]: reaped child process 1640, status = succeeded6307lb # [ 135.545989] niks3-server[1074]: 2026/09/20 09:06:40 INFO Received uploads request method=POST path=/api/pending_closures6308worker1 # [ 135.574087] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.025Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6309worker1 # [ 135.575504] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.025Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6310lb # [ 135.584267] niks3-server[1074]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6311lb # [ 135.594438] niks3-server[1074]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6312lb # [ 135.602813] niks3-server[1074]: 2026/09/20 09:06:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6313worker1 # [ 135.624382] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.075Z level=INFO msg="Uploading 1 narinfos"6314lb # [ 135.607654] niks3-server[1074]: 2026/09/20 09:06:40 INFO Signed narinfos id=47 count=16315lb # [ 135.612338] niks3-server[1074]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6316lb # [ 135.617774] niks3-server[1074]: 2026/09/20 09:06:40 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6317lb # [ 135.620375] niks3-server[1074]: 2026/09/20 09:06:40 INFO Completed upload id=476318lb # [ 135.622766] niks3-server[1074]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6319worker1 # [ 135.638334] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.089Z level=INFO msg="Upload complete. (262ms)"6320worker1 # [ 135.645391] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16321worker1 # [ 135.659390] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16322worker1 # [ 135.662344] nix-daemon[843]: reaped child process 1620, status = succeeded6323worker1 # [ 135.686349] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126324worker1 # [ 135.693154] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06325worker1 # [ 135.699686] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126326worker1 # [ 135.707478] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126327worker1 # [ 135.715189] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6328worker1 # [ 135.870449] nix-daemon[843]: accepted connection from pid 1646, user nix-grpc-daemon (trusted)6329worker1 # [ 135.884694] nix-daemon[843]: reaped child process 1649, status = succeeded6330worker1 # [ 136.020401] nix-daemon[843]: accepted connection from pid 1651, user nix-grpc-daemon (trusted)6331worker1 # [ 136.034031] nix-daemon[843]: reaped child process 1654, status = succeeded6332lb # [ 136.029817] niks3-server[1074]: 2026/09/20 09:06:40 INFO Received uploads request method=POST path=/api/pending_closures6333worker1 # [ 136.051810] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.503Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6334worker1 # [ 136.053336] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.505Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6335lb # [ 136.055101] niks3-server[1074]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6336lb # [ 136.066448] niks3-server[1074]: 2026/09/20 09:06:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6337worker1 # [ 136.090214] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.541Z level=INFO msg="Uploading 1 narinfos"6338lb # [ 136.073381] niks3-server[1074]: 2026/09/20 09:06:41 INFO Signed narinfos id=48 count=16339lb # [ 136.078063] niks3-server[1074]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6340lb # [ 136.090399] niks3-server[1074]: 2026/09/20 09:06:41 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6341worker1 # [ 136.112040] nix-grpc-daemon[1418]: time=2026-09-20T09:06:40.563Z level=INFO msg="Upload complete. (391ms)"6342lb # [ 136.095544] niks3-server[1074]: 2026/09/20 09:06:41 INFO Completed upload id=486343worker1 # [ 136.114230] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=5046344worker1 # [ 136.116889] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126345lb # [ 136.101063] niks3-server[1074]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6346worker1 # [ 136.124060] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6347worker1 # [ 136.129181] nix-daemon[843]: reaped child process 1644, status = succeeded6348worker1 # [ 136.133439] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6349worker1 # [ 137.362121] nix-daemon[843]: reaped child process 1658, status = succeeded6350worker1 # [ 137.513077] nix-daemon[843]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6351worker1 # [ 137.526072] nix-daemon[843]: reaped child process 1676, status = succeeded6352lb # [ 137.522963] niks3-server[1074]: 2026/09/20 09:06:42 INFO Received uploads request method=POST path=/api/pending_closures6353worker1 # [ 137.548112] nix-grpc-daemon[1418]: time=2026-09-20T09:06:41.999Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6354worker1 # [ 137.552700] nix-grpc-daemon[1418]: time=2026-09-20T09:06:42.001Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6355lb # [ 137.563945] niks3-server[1074]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6356lb # [ 137.571380] niks3-server[1074]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6357lb # [ 137.582954] niks3-server[1074]: 2026/09/20 09:06:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6358lb # [ 137.590426] niks3-server[1074]: 2026/09/20 09:06:42 INFO Signed narinfos id=49 count=16359worker1 # [ 137.609605] nix-grpc-daemon[1418]: time=2026-09-20T09:06:42.061Z level=INFO msg="Uploading 1 narinfos"6360lb # [ 137.593244] niks3-server[1074]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6361lb # [ 137.604297] niks3-server[1074]: 2026/09/20 09:06:42 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6362lb # [ 137.609555] niks3-server[1074]: 2026/09/20 09:06:42 INFO Completed upload id=496363worker1 # [ 137.626469] nix-grpc-daemon[1418]: time=2026-09-20T09:06:42.078Z level=INFO msg="Upload complete. (284ms)"6364lb # [ 137.611514] niks3-server[1074]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6365worker1 # [ 137.634945] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16366worker1 # [ 137.641792] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16367worker1 # [ 137.646266] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126368worker1 # [ 137.649393] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06369lb # [ 137.641677] envoy[973]: conn peer=[2001:db8:1::1]:50030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9585 tx=3847 ms=60146370worker1 # [ 137.659393] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126371lb # [ 137.643362] envoy[973]: conn peer=[2001:db8:1::1]:50020 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1369 ms=134936372worker1 # [ 137.661630] nix-daemon[843]: reaped child process 1656, status = succeeded6373lb # [ 137.645733] envoy[973]: conn peer=[2001:db8:1::4]:32904 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1721 tx=552 ms=260256374worker1 # [ 137.666620] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126375worker1 # [ 137.670715] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6376worker1 # [ 137.829505] nix-daemon[843]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)6377worker1 # [ 137.844500] nix-daemon[843]: reaped child process 1685, status = succeeded6378worker1 # [ 138.006858] nix-daemon[843]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6379worker1 # [ 138.020425] nix-daemon[843]: reaped child process 1690, status = succeeded6380lb # [ 138.018476] niks3-server[1074]: 2026/09/20 09:06:42 INFO Received uploads request method=POST path=/api/pending_closures6381worker1 # [ 138.042480] nix-grpc-daemon[1418]: time=2026-09-20T09:06:42.494Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6382worker1 # [ 138.044065] nix-grpc-daemon[1418]: time=2026-09-20T09:06:42.495Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6383lb # [ 138.046215] niks3-server[1074]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6384lb # [ 138.057293] niks3-server[1074]: 2026/09/20 09:06:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6385lb # [ 138.061939] niks3-server[1074]: 2026/09/20 09:06:43 INFO Signed narinfos id=50 count=16386worker1 # [ 138.081456] nix-grpc-daemon[1418]: time=2026-09-20T09:06:42.533Z level=INFO msg="Uploading 1 narinfos"6387lb # [ 138.068568] niks3-server[1074]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6388lb # [ 138.079886] niks3-server[1074]: 2026/09/20 09:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6389worker1 # [ 138.102564] nix-grpc-daemon[1418]: time=2026-09-20T09:06:42.554Z level=INFO msg="Upload complete. (425ms)"6390lb # [ 138.086119] niks3-server[1074]: 2026/09/20 09:06:43 INFO Completed upload id=506391worker1 # [ 138.104784] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=5046392lb # [ 138.089525] niks3-server[1074]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6393worker1 # [ 138.111532] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126394worker1 # [ 138.116534] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6395worker1 # [ 138.119135] nix-daemon[843]: reaped child process 1680, status = succeeded6396worker1 # [ 138.124602] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6397worker1 # [ 138.940980] nix-daemon[843]: reaped child process 1694, status = succeeded6398worker1 # [ 139.070312] nix-daemon[843]: accepted connection from pid 1709, user nix-grpc-daemon (trusted)6399worker1 # [ 139.083869] nix-daemon[843]: reaped child process 1712, status = succeeded6400lb # [ 139.078125] niks3-server[1074]: 2026/09/20 09:06:44 INFO Received uploads request method=POST path=/api/pending_closures6401worker1 # [ 139.101226] nix-grpc-daemon[1418]: time=2026-09-20T09:06:43.552Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6402worker1 # [ 139.102726] nix-grpc-daemon[1418]: time=2026-09-20T09:06:43.554Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6403lb # [ 139.095746] niks3-server[1074]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6404lb # [ 139.101958] niks3-server[1074]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6405lb # [ 139.105954] niks3-server[1074]: 2026/09/20 09:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6406lb # [ 139.107936] niks3-server[1074]: 2026/09/20 09:06:44 INFO Signed narinfos id=51 count=16407worker1 # [ 139.125647] nix-grpc-daemon[1418]: time=2026-09-20T09:06:43.577Z level=INFO msg="Uploading 1 narinfos"6408lb # [ 139.111386] niks3-server[1074]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6409lb # [ 139.115911] niks3-server[1074]: 2026/09/20 09:06:44 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6410lb # [ 139.118730] niks3-server[1074]: 2026/09/20 09:06:44 INFO Completed upload id=516411worker1 # [ 139.135226] nix-grpc-daemon[1418]: time=2026-09-20T09:06:43.586Z level=INFO msg="Upload complete. (203ms)"6412lb # [ 139.121149] niks3-server[1074]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6413worker1 # [ 139.138381] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16414worker1 # [ 139.142138] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:43Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16415worker1 # [ 139.147879] nix-daemon[843]: reaped child process 1692, status = succeeded6416worker1 # [ 139.182074] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126417worker1 # [ 139.187946] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:43Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06418worker1 # [ 139.195236] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126419worker1 # [ 139.203637] nix-grpc-daemon[1418]: time=2026-09-20T09:06:43.655Z level=INFO msg="All 1 paths already cached"6420worker1 # [ 139.208420] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126421worker1 # [ 139.214074] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6422worker1 # [ 139.364603] nix-daemon[843]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6423worker1 # [ 139.379805] nix-daemon[843]: reaped child process 1721, status = succeeded6424worker1 # [ 139.543780] nix-daemon[843]: accepted connection from pid 1723, user nix-grpc-daemon (trusted)6425worker1 # [ 139.557389] nix-daemon[843]: reaped child process 1726, status = succeeded6426lb # [ 139.552950] niks3-server[1074]: 2026/09/20 09:06:44 INFO Received uploads request method=POST path=/api/pending_closures6427worker1 # [ 139.573260] nix-grpc-daemon[1418]: time=2026-09-20T09:06:44.025Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6428worker1 # [ 139.575228] nix-grpc-daemon[1418]: time=2026-09-20T09:06:44.026Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6429lb # [ 139.566493] niks3-server[1074]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6430lb # [ 139.571071] niks3-server[1074]: 2026/09/20 09:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6431lb # [ 139.573028] niks3-server[1074]: 2026/09/20 09:06:44 INFO Signed narinfos id=52 count=16432worker1 # [ 139.590852] nix-grpc-daemon[1418]: time=2026-09-20T09:06:44.042Z level=INFO msg="Uploading 1 narinfos"6433lb # [ 139.575641] niks3-server[1074]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6434lb # [ 139.580674] niks3-server[1074]: 2026/09/20 09:06:44 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6435lb # [ 139.583526] niks3-server[1074]: 2026/09/20 09:06:44 INFO Completed upload id=526436worker1 # [ 139.601317] nix-grpc-daemon[1418]: time=2026-09-20T09:06:44.053Z level=INFO msg="Upload complete. (381ms)"6437lb # [ 139.585283] niks3-server[1074]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6438worker1 # [ 139.603445] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=6246439worker1 # [ 139.606343] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126440worker1 # [ 139.612281] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6441worker1 # [ 139.619549] nix-daemon[843]: reaped child process 1716, status = succeeded6442worker1 # [ 139.622778] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6443worker1 # [ 141.246643] nix-daemon[843]: reaped child process 1730, status = succeeded6444worker1 # [ 141.413100] nix-daemon[843]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6445worker1 # [ 141.425924] nix-daemon[843]: reaped child process 1748, status = succeeded6446lb # [ 141.425693] niks3-server[1074]: 2026/09/20 09:06:46 INFO Received uploads request method=POST path=/api/pending_closures6447worker1 # [ 141.450027] nix-grpc-daemon[1418]: time=2026-09-20T09:06:45.901Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6448worker1 # [ 141.453058] nix-grpc-daemon[1418]: time=2026-09-20T09:06:45.903Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6449lb # [ 141.463256] niks3-server[1074]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6450lb # [ 141.471399] niks3-server[1074]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6451lb # [ 141.476646] niks3-server[1074]: 2026/09/20 09:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6452lb # [ 141.478838] niks3-server[1074]: 2026/09/20 09:06:46 INFO Signed narinfos id=53 count=16453worker1 # [ 141.495723] nix-grpc-daemon[1418]: time=2026-09-20T09:06:45.947Z level=INFO msg="Uploading 1 narinfos"6454lb # [ 141.482864] niks3-server[1074]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6455lb # [ 141.486653] niks3-server[1074]: 2026/09/20 09:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6456lb # [ 141.491250] niks3-server[1074]: 2026/09/20 09:06:46 INFO Completed upload id=536457lb # [ 141.492573] niks3-server[1074]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6458worker1 # [ 141.507927] nix-grpc-daemon[1418]: time=2026-09-20T09:06:45.959Z level=INFO msg="Upload complete. (274ms)"6459worker1 # [ 141.515756] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16460worker1 # [ 141.519391] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:45Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16461worker1 # [ 141.521880] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126462worker1 # [ 141.523520] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:45Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06463worker1 # [ 141.530383] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126464worker1 # [ 141.533911] nix-daemon[843]: reaped child process 1728, status = succeeded6465worker1 # [ 141.538690] nix-grpc-daemon[1418]: time=2026-09-20T09:06:45.990Z level=INFO msg="All 1 paths already cached"6466worker1 # [ 141.543081] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126467worker1 # [ 141.549084] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6468worker1 # [ 141.705642] nix-daemon[843]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)6469worker1 # [ 141.720546] nix-daemon[843]: reaped child process 1757, status = succeeded6470worker1 # [ 141.881450] nix-daemon[843]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6471worker1 # [ 141.895427] nix-daemon[843]: reaped child process 1762, status = succeeded6472lb # [ 141.888610] niks3-server[1074]: 2026/09/20 09:06:46 INFO Received uploads request method=POST path=/api/pending_closures6473worker1 # [ 141.909728] nix-grpc-daemon[1418]: time=2026-09-20T09:06:46.361Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6474worker1 # [ 141.911286] nix-grpc-daemon[1418]: time=2026-09-20T09:06:46.363Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6475lb # [ 141.904411] niks3-server[1074]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6476lb # [ 141.909049] niks3-server[1074]: 2026/09/20 09:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6477lb # [ 141.910904] niks3-server[1074]: 2026/09/20 09:06:46 INFO Signed narinfos id=54 count=16478worker1 # [ 141.928867] nix-grpc-daemon[1418]: time=2026-09-20T09:06:46.380Z level=INFO msg="Uploading 1 narinfos"6479lb # [ 141.913756] niks3-server[1074]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6480lb # [ 141.919289] niks3-server[1074]: 2026/09/20 09:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6481lb # [ 141.922104] niks3-server[1074]: 2026/09/20 09:06:46 INFO Completed upload id=546482worker1 # [ 141.939724] nix-grpc-daemon[1418]: time=2026-09-20T09:06:46.391Z level=INFO msg="Upload complete. (384ms)"6483lb # [ 141.924568] niks3-server[1074]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6484worker1 # [ 141.941745] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=6246485worker1 # [ 141.945808] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126486worker1 # [ 141.952369] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6487worker1 # [ 141.954734] nix-daemon[843]: reaped child process 1752, status = succeeded6488worker1 # [ 141.960192] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6489worker1 # [ 142.977114] nix-daemon[843]: reaped child process 1766, status = succeeded6490worker1 # [ 143.139104] nix-daemon[843]: accepted connection from pid 1781, user nix-grpc-daemon (trusted)6491worker1 # [ 143.152798] nix-daemon[843]: reaped child process 1784, status = succeeded6492lb # [ 143.155470] niks3-server[1074]: 2026/09/20 09:06:48 INFO Received uploads request method=POST path=/api/pending_closures6493worker1 # [ 143.184837] nix-grpc-daemon[1418]: time=2026-09-20T09:06:47.636Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6494worker1 # [ 143.186449] nix-grpc-daemon[1418]: time=2026-09-20T09:06:47.638Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6495lb # [ 143.193156] niks3-server[1074]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6496lb # [ 143.201833] niks3-server[1074]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6497lb # [ 143.212065] niks3-server[1074]: 2026/09/20 09:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6498lb # [ 143.215434] niks3-server[1074]: 2026/09/20 09:06:48 INFO Signed narinfos id=55 count=16499worker1 # [ 143.235191] nix-grpc-daemon[1418]: time=2026-09-20T09:06:47.686Z level=INFO msg="Uploading 1 narinfos"6500lb # [ 143.221907] niks3-server[1074]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6501lb # [ 143.232533] niks3-server[1074]: 2026/09/20 09:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6502lb # [ 143.236742] niks3-server[1074]: 2026/09/20 09:06:48 INFO Completed upload id=556503worker1 # [ 143.253345] nix-grpc-daemon[1418]: time=2026-09-20T09:06:47.705Z level=INFO msg="Upload complete. (285ms)"6504lb # [ 143.238774] niks3-server[1074]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6505worker1 # [ 143.256485] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16506worker1 # [ 143.261924] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:47Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16507worker1 # [ 143.265649] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126508worker1 # [ 143.268697] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:47Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06509worker1 # [ 143.277434] nix-daemon[843]: reaped child process 1764, status = succeeded6510worker1 # [ 143.279196] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126511worker1 # [ 143.285313] nix-grpc-daemon[1418]: time=2026-09-20T09:06:47.737Z level=INFO msg="All 1 paths already cached"6512worker1 # [ 143.289736] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126513worker1 # [ 143.294339] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6514worker1 # [ 143.464442] nix-daemon[843]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)6515worker1 # [ 143.478731] nix-daemon[843]: reaped child process 1793, status = succeeded6516worker1 # [ 143.648262] nix-daemon[843]: accepted connection from pid 1795, user nix-grpc-daemon (trusted)6517worker1 # [ 143.661794] nix-daemon[843]: reaped child process 1798, status = succeeded6518lb # [ 143.662897] niks3-server[1074]: 2026/09/20 09:06:48 INFO Received uploads request method=POST path=/api/pending_closures6519worker1 # [ 143.687533] nix-grpc-daemon[1418]: time=2026-09-20T09:06:48.138Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6520worker1 # [ 143.688880] nix-grpc-daemon[1418]: time=2026-09-20T09:06:48.139Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6521lb # [ 143.690147] niks3-server[1074]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6522lb # [ 143.697842] niks3-server[1074]: 2026/09/20 09:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6523lb # [ 143.704422] niks3-server[1074]: 2026/09/20 09:06:48 INFO Signed narinfos id=56 count=16524worker1 # [ 143.724136] nix-grpc-daemon[1418]: time=2026-09-20T09:06:48.175Z level=INFO msg="Uploading 1 narinfos"6525lb # [ 143.707652] niks3-server[1074]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6526lb # [ 143.721144] niks3-server[1074]: 2026/09/20 09:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6527worker1 # [ 143.743879] nix-grpc-daemon[1418]: time=2026-09-20T09:06:48.195Z level=INFO msg="Upload complete. (442ms)"6528lb # [ 143.727423] niks3-server[1074]: 2026/09/20 09:06:48 INFO Completed upload id=566529worker1 # [ 143.746362] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=6246530lb # [ 143.730514] niks3-server[1074]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6531worker1 # [ 143.750947] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126532worker1 # [ 143.757560] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6533worker1 # [ 143.759990] nix-daemon[843]: reaped child process 1788, status = succeeded6534worker1 # [ 143.765594] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6535worker1 # [ 145.195514] nix-daemon[843]: reaped child process 1802, status = succeeded6536worker1 # [ 145.361090] nix-daemon[843]: accepted connection from pid 1817, user nix-grpc-daemon (trusted)6537worker1 # [ 145.372119] nix-daemon[843]: reaped child process 1820, status = succeeded6538lb # [ 145.375821] niks3-server[1074]: 2026/09/20 09:06:50 INFO Received uploads request method=POST path=/api/pending_closures6539worker1 # [ 145.398990] nix-grpc-daemon[1418]: time=2026-09-20T09:06:49.850Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6540worker1 # [ 145.401609] nix-grpc-daemon[1418]: time=2026-09-20T09:06:49.852Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6541lb # [ 145.409084] niks3-server[1074]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6542lb # [ 145.422522] niks3-server[1074]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6543lb # [ 145.432531] niks3-server[1074]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6544lb # [ 145.436247] niks3-server[1074]: 2026/09/20 09:06:50 INFO Signed narinfos id=57 count=16545worker1 # [ 145.453137] nix-grpc-daemon[1418]: time=2026-09-20T09:06:49.904Z level=INFO msg="Uploading 1 narinfos"6546lb # [ 145.442268] niks3-server[1074]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6547lb # [ 145.450133] niks3-server[1074]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6548lb # [ 145.456148] niks3-server[1074]: 2026/09/20 09:06:50 INFO Completed upload id=576549worker1 # [ 145.472684] nix-grpc-daemon[1418]: time=2026-09-20T09:06:49.924Z level=INFO msg="Upload complete. (297ms)"6550lb # [ 145.458426] niks3-server[1074]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6551worker1 # [ 145.480631] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16552worker1 # [ 145.487243] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:49Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16553worker1 # [ 145.496341] nix-daemon[843]: reaped child process 1800, status = succeeded6554worker1 # [ 145.522314] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126555worker1 # [ 145.528809] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:49Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06556worker1 # [ 145.540386] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126557worker1 # [ 145.553110] nix-grpc-daemon[1418]: time=2026-09-20T09:06:50.004Z level=INFO msg="All 2 paths already cached"6558worker1 # [ 145.560148] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126559worker1 # [ 145.570116] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6560worker1 # [ 145.750832] nix-daemon[843]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)6561worker1 # [ 145.763110] nix-daemon[843]: reaped child process 1829, status = succeeded6562worker1 # [ 145.932115] nix-daemon[843]: accepted connection from pid 1831, user nix-grpc-daemon (trusted)6563worker1 # [ 145.943838] nix-daemon[843]: reaped child process 1834, status = succeeded6564lb # [ 145.942839] niks3-server[1074]: 2026/09/20 09:06:50 INFO Received uploads request method=POST path=/api/pending_closures6565worker1 # [ 145.967038] nix-grpc-daemon[1418]: time=2026-09-20T09:06:50.418Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6566worker1 # [ 145.968517] nix-grpc-daemon[1418]: time=2026-09-20T09:06:50.420Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6567lb # [ 145.971103] niks3-server[1074]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6568lb # [ 145.983102] niks3-server[1074]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6569lb # [ 145.988379] niks3-server[1074]: 2026/09/20 09:06:50 INFO Signed narinfos id=58 count=16570worker1 # [ 146.008213] nix-grpc-daemon[1418]: time=2026-09-20T09:06:50.459Z level=INFO msg="Uploading 1 narinfos"6571lb # [ 145.993476] niks3-server[1074]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6572lb # [ 146.004610] niks3-server[1074]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6573worker1 # [ 146.027383] nix-grpc-daemon[1418]: time=2026-09-20T09:06:50.479Z level=INFO msg="Upload complete. (447ms)"6574lb # [ 146.011144] niks3-server[1074]: 2026/09/20 09:06:50 INFO Completed upload id=586575worker1 # [ 146.029486] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=7526576lb # [ 146.014561] niks3-server[1074]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6577worker1 # [ 146.035461] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126578worker1 # [ 146.039614] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6579worker1 # [ 146.041943] nix-daemon[843]: reaped child process 1824, status = succeeded6580worker1 # [ 146.047369] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6581worker1 # [ 147.460892] nix-daemon[843]: reaped child process 1838, status = succeeded6582worker1 # [ 147.628694] nix-daemon[843]: accepted connection from pid 1853, user nix-grpc-daemon (trusted)6583worker1 # [ 147.639641] nix-daemon[843]: reaped child process 1856, status = succeeded6584lb # [ 147.642396] niks3-server[1074]: 2026/09/20 09:06:52 INFO Received uploads request method=POST path=/api/pending_closures6585worker1 # [ 147.670631] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.122Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6586worker1 # [ 147.672148] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.123Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6587lb # [ 147.686992] niks3-server[1074]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6588lb # [ 147.695577] niks3-server[1074]: 2026/09/20 09:06:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6589worker1 # [ 147.716407] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.167Z level=INFO msg="Uploading 1 narinfos"6590lb # [ 147.700138] niks3-server[1074]: 2026/09/20 09:06:52 INFO Signed narinfos id=59 count=16591lb # [ 147.708205] niks3-server[1074]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6592lb # [ 147.710487] niks3-server[1074]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6593lb # [ 147.714958] niks3-server[1074]: 2026/09/20 09:06:52 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6594lb # [ 147.717668] niks3-server[1074]: 2026/09/20 09:06:52 INFO Completed upload id=596595worker1 # [ 147.734313] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.185Z level=INFO msg="Upload complete. (280ms)"6596lb # [ 147.720278] niks3-server[1074]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6597worker1 # [ 147.738944] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16598worker1 # [ 147.745417] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:52Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16599worker1 # [ 147.753684] nix-daemon[843]: reaped child process 1836, status = succeeded6600worker1 # [ 147.787886] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126601worker1 # [ 147.799551] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126602worker1 # [ 147.811951] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.263Z level=INFO msg="All 2 paths already cached"6603worker1 # [ 147.819488] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126604worker1 # [ 147.829128] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6605worker1 # [ 148.002434] nix-daemon[843]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)6606worker1 # [ 148.014909] nix-daemon[843]: reaped child process 1863, status = succeeded6607worker1 # [ 148.191579] nix-daemon[843]: accepted connection from pid 1865, user nix-grpc-daemon (trusted)6608worker1 # [ 148.203777] nix-daemon[843]: reaped child process 1868, status = succeeded6609lb # [ 148.204272] niks3-server[1074]: 2026/09/20 09:06:53 INFO Received uploads request method=POST path=/api/pending_closures6610worker1 # [ 148.225255] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.677Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6611worker1 # [ 148.226764] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.678Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6612lb # [ 148.219558] niks3-server[1074]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6613lb # [ 148.223677] niks3-server[1074]: 2026/09/20 09:06:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6614lb # [ 148.226866] niks3-server[1074]: 2026/09/20 09:06:53 INFO Signed narinfos id=60 count=16615worker1 # [ 148.244915] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.696Z level=INFO msg="Uploading 1 narinfos"6616lb # [ 148.229841] niks3-server[1074]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6617lb # [ 148.235375] niks3-server[1074]: 2026/09/20 09:06:53 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6618lb # [ 148.237927] niks3-server[1074]: 2026/09/20 09:06:53 INFO Completed upload id=606619worker1 # [ 148.255639] nix-grpc-daemon[1418]: time=2026-09-20T09:06:52.707Z level=INFO msg="Upload complete. (417ms)"6620lb # [ 148.240423] niks3-server[1074]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6621worker1 # [ 148.257772] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=7526622worker1 # [ 148.261434] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126623worker1 # [ 148.268096] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6624worker1 # [ 148.270227] nix-daemon[843]: reaped child process 1858, status = succeeded6625worker1 # [ 148.275776] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6626worker1 # [ 149.490725] nix-daemon[843]: reaped child process 1872, status = succeeded6627worker1 # [ 149.636531] nix-daemon[843]: accepted connection from pid 1887, user nix-grpc-daemon (trusted)6628worker1 # [ 149.648552] nix-daemon[843]: reaped child process 1890, status = succeeded6629lb # [ 149.650756] niks3-server[1074]: 2026/09/20 09:06:54 INFO Received uploads request method=POST path=/api/pending_closures6630worker1 # [ 149.675406] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.126Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6631worker1 # [ 149.677046] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.128Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6632lb # [ 149.691328] niks3-server[1074]: 2026/09/20 09:06:54 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6633lb # [ 149.696656] niks3-server[1074]: 2026/09/20 09:06:54 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6634lb # [ 149.706634] niks3-server[1074]: 2026/09/20 09:06:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6635lb # [ 149.711659] niks3-server[1074]: 2026/09/20 09:06:54 INFO Signed narinfos id=61 count=16636worker1 # [ 149.731398] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.182Z level=INFO msg="Uploading 1 narinfos"6637lb # [ 149.718186] niks3-server[1074]: 2026/09/20 09:06:54 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6638lb # [ 149.726603] niks3-server[1074]: 2026/09/20 09:06:54 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6639lb # [ 149.732203] niks3-server[1074]: 2026/09/20 09:06:54 INFO Completed upload id=616640worker1 # [ 149.749065] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.200Z level=INFO msg="Upload complete. (265ms)"6641lb # [ 149.735284] niks3-server[1074]: 2026/09/20 09:06:54 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6642worker1 # [ 149.757530] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16643worker1 # [ 149.763164] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:54Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16644worker1 # [ 149.772903] nix-daemon[843]: reaped child process 1870, status = succeeded6645worker1 # [ 149.798222] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126646worker1 # [ 149.808672] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126647worker1 # [ 149.818757] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.270Z level=INFO msg="All 2 paths already cached"6648worker1 # [ 149.825324] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338126649worker1 # [ 149.835133] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6650worker1 # [ 150.001457] nix-daemon[843]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6651worker1 # [ 150.013721] nix-daemon[843]: reaped child process 1897, status = succeeded6652worker1 # [ 150.169040] nix-daemon[843]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6653worker1 # [ 150.180814] nix-daemon[843]: reaped child process 1902, status = succeeded6654lb # [ 150.180454] niks3-server[1074]: 2026/09/20 09:06:55 INFO Received uploads request method=POST path=/api/pending_closures6655worker1 # [ 150.201149] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.652Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6656worker1 # [ 150.203101] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.654Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6657lb # [ 150.193875] niks3-server[1074]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6658lb # [ 150.198055] niks3-server[1074]: 2026/09/20 09:06:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6659lb # [ 150.199817] niks3-server[1074]: 2026/09/20 09:06:55 INFO Signed narinfos id=62 count=16660worker1 # [ 150.217628] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.669Z level=INFO msg="Uploading 1 narinfos"6661lb # [ 150.205161] niks3-server[1074]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6662lb # [ 150.208192] niks3-server[1074]: 2026/09/20 09:06:55 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6663lb # [ 150.210780] niks3-server[1074]: 2026/09/20 09:06:55 INFO Completed upload id=626664worker1 # [ 150.227382] nix-grpc-daemon[1418]: time=2026-09-20T09:06:54.679Z level=INFO msg="Upload complete. (382ms)"6665lb # [ 150.213202] niks3-server[1074]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6666worker1 # [ 150.229241] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=0 paths=1 nar_bytes_in=7526667worker1 # [ 150.232217] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338126668worker1 # [ 150.238509] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6669worker1 # [ 150.241423] nix-daemon[843]: reaped child process 1892, status = succeeded6670worker1 # [ 150.246308] nix-daemon[843]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)6671worker1 # [ 151.060266] nix-daemon[843]: reaped child process 1906, status = succeeded6672worker1 # [ 151.198803] nix-daemon[843]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)6673worker1 # [ 151.211115] nix-daemon[843]: reaped child process 1924, status = succeeded6674lb # [ 151.210326] niks3-server[1074]: 2026/09/20 09:06:56 INFO Received uploads request method=POST path=/api/pending_closures6675worker1 # [ 151.231043] nix-grpc-daemon[1418]: time=2026-09-20T09:06:55.682Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6676worker1 # [ 151.232541] nix-grpc-daemon[1418]: time=2026-09-20T09:06:55.684Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6677lb # [ 151.231609] niks3-server[1074]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6678lb # [ 151.234160] niks3-server[1074]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6679lb # [ 151.236193] niks3-server[1074]: 2026/09/20 09:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6680lb # [ 151.238440] niks3-server[1074]: 2026/09/20 09:06:56 INFO Signed narinfos id=63 count=16681worker1 # [ 151.254996] nix-grpc-daemon[1418]: time=2026-09-20T09:06:55.706Z level=INFO msg="Uploading 1 narinfos"6682lb # [ 151.241390] niks3-server[1074]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6683lb # [ 151.245151] niks3-server[1074]: 2026/09/20 09:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6684lb # [ 151.248622] niks3-server[1074]: 2026/09/20 09:06:56 INFO Completed upload id=636685worker1 # [ 151.265070] nix-grpc-daemon[1418]: time=2026-09-20T09:06:55.716Z level=INFO msg="Upload complete. (210ms)"6686lb # [ 151.250141] niks3-server[1074]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6687worker1 # [ 151.267341] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33812 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16688worker1 # [ 151.274720] nix-daemon[843]: reaped child process 1904, status = succeeded6689client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.34 seconds)6690worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6691worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.05 seconds)6692client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16693worker2 # [ 151.573895] nix-grpc-daemon[1835]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:433906694worker2 # [ 151.585750] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6695worker1 # [ 151.597924] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126696worker1 # [ 151.608409] nix-grpc-daemon[1278]: ts=2026-09-20T09:06:56Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06697lb # [ 157.642284] envoy[973]: conn peer=[2001:db8:1::1]:50192 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27050 tx=10633 ms=171196698client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.26 seconds)6699(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 47.66 seconds)6700subtest: low disk drains a worker and builds go to the other6701worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6702worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.03 seconds)6703worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6704worker1 # [ 183.340683] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:27Z level=info event=unhealthy reason=min_free6705worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.07 seconds)6706client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26707worker1 # [ 183.886263] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:338126708client # don't know how to build these paths:6709client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6710worker1 # [ 183.895488] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338126711worker1 # [ 183.912154] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:28Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06712worker1 # [ 183.916737] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:28Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16713worker2 # [ 183.957193] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:433906714worker2 # [ 183.969152] nix-grpc-daemon[1835]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)6715worker2 # [ 183.992872] nix-grpc-daemon[1835]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 2/5)6716worker2 # [ 184.043785] nix-grpc-daemon[1835]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 3/5)6717worker2 # [ 184.103577] nix-grpc-daemon[1835]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 585 ms (attempt 4/5)6718worker2 # [ 184.694783] nix-grpc-daemon[1835]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6719worker2 # [ 184.709550] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:433906720client # copying 1 paths to 'lb:50051'...6721client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6722worker2 # [ 184.720631] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:433906723worker2 # [ 184.731877] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6724worker2 # [ 184.751066] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:29Z level=info event=niks3_push_started pid=18916725worker2 # [ 185.075928] nix-daemon[862]: accepted connection from pid 1904, user nix-grpc-daemon (trusted)6726worker2 # [ 185.087154] nix-daemon[862]: reaped child process 1907, status = succeeded6727worker2 # [ 185.234189] nix-daemon[862]: accepted connection from pid 1909, user nix-grpc-daemon (trusted)6728worker2 # [ 185.246159] nix-daemon[862]: reaped child process 1912, status = succeeded6729lb # [ 185.243971] niks3-server[1074]: 2026/09/20 09:07:30 INFO Received uploads request method=POST path=/api/pending_closures6730worker2 # [ 185.266422] nix-grpc-daemon[1891]: time=2026-09-20T09:07:29.654Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6731worker2 # [ 185.269683] nix-grpc-daemon[1891]: time=2026-09-20T09:07:29.655Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6732lb # [ 185.265279] niks3-server[1074]: 2026/09/20 09:07:30 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6733lb # [ 185.269143] niks3-server[1074]: 2026/09/20 09:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6734lb # [ 185.271299] niks3-server[1074]: 2026/09/20 09:07:30 INFO Signed narinfos id=64 count=16735worker2 # [ 185.288495] nix-grpc-daemon[1891]: time=2026-09-20T09:07:29.676Z level=INFO msg="Uploading 1 narinfos"6736lb # [ 185.277096] niks3-server[1074]: 2026/09/20 09:07:30 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6737lb # [ 185.281354] niks3-server[1074]: 2026/09/20 09:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6738lb # [ 185.284647] niks3-server[1074]: 2026/09/20 09:07:30 INFO Completed upload id=646739worker2 # [ 185.301723] nix-grpc-daemon[1891]: time=2026-09-20T09:07:29.689Z level=INFO msg="Upload complete. (374ms)"6740lb # [ 185.287436] niks3-server[1074]: 2026/09/20 09:07:30 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6741worker2 # [ 185.305172] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43390 duration_s=0 paths=1 nar_bytes_in=5126742worker2 # [ 185.307663] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:433906743worker2 # [ 185.312287] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6744worker2 # [ 185.316302] nix-daemon[862]: reaped child process 1889, status = succeeded6745client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6746client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6747worker2 # [ 185.322026] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6748client # farm-a> LOG-farm-a-drain6749worker2 # [ 186.134146] nix-daemon[862]: reaped child process 1916, status = succeeded6750worker2 # [ 186.270373] nix-daemon[862]: accepted connection from pid 1931, user nix-grpc-daemon (trusted)6751worker2 # [ 186.282532] nix-daemon[862]: reaped child process 1934, status = succeeded6752lb # [ 186.281689] niks3-server[1074]: 2026/09/20 09:07:31 INFO Received uploads request method=POST path=/api/pending_closures6753worker2 # [ 186.308733] nix-grpc-daemon[1891]: time=2026-09-20T09:07:30.696Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6754worker2 # [ 186.310329] nix-grpc-daemon[1891]: time=2026-09-20T09:07:30.698Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6755lb # [ 186.313945] niks3-server[1074]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6756lb # [ 186.327608] niks3-server[1074]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6757lb # [ 186.335902] niks3-server[1074]: 2026/09/20 09:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6758lb # [ 186.341621] niks3-server[1074]: 2026/09/20 09:07:31 INFO Signed narinfos id=65 count=16759worker2 # [ 186.360914] nix-grpc-daemon[1891]: time=2026-09-20T09:07:30.748Z level=INFO msg="Uploading 1 narinfos"6760lb # [ 186.343373] niks3-server[1074]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6761lb # [ 186.348421] niks3-server[1074]: 2026/09/20 09:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6762lb # [ 186.351655] niks3-server[1074]: 2026/09/20 09:07:31 INFO Completed upload id=656763worker2 # [ 186.368666] nix-grpc-daemon[1891]: time=2026-09-20T09:07:30.756Z level=INFO msg="Upload complete. (241ms)"6764lb # [ 186.353995] niks3-server[1074]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6765worker2 # [ 186.373213] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43390 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16766worker1 # [ 186.379525] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:30Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06767worker2 # [ 186.384224] nix-daemon[862]: reaped child process 1914, status = succeeded6768worker1 # [ 186.383674] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:30Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16769worker2 # [ 186.423212] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:433906770worker2 # [ 186.436077] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:433906771worker2 # [ 186.448619] nix-grpc-daemon[1891]: time=2026-09-20T09:07:30.836Z level=INFO msg="All 1 paths already cached"6772client # copying 1 paths to 'lb:50051'...6773client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6774worker2 # [ 186.455314] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:433906775worker2 # [ 186.463663] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6776worker2 # [ 186.602276] nix-daemon[862]: accepted connection from pid 1938, user nix-grpc-daemon (trusted)6777worker2 # [ 186.614561] nix-daemon[862]: reaped child process 1941, status = succeeded6778worker2 # [ 186.750638] nix-daemon[862]: accepted connection from pid 1943, user nix-grpc-daemon (trusted)6779worker2 # [ 186.762554] nix-daemon[862]: reaped child process 1946, status = succeeded6780lb # [ 186.760798] niks3-server[1074]: 2026/09/20 09:07:31 INFO Received uploads request method=POST path=/api/pending_closures6781worker2 # [ 186.785519] nix-grpc-daemon[1891]: time=2026-09-20T09:07:31.173Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6782worker2 # [ 186.787364] nix-grpc-daemon[1891]: time=2026-09-20T09:07:31.175Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6783lb # [ 186.787548] niks3-server[1074]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6784lb # [ 186.799372] niks3-server[1074]: 2026/09/20 09:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6785lb # [ 186.805993] niks3-server[1074]: 2026/09/20 09:07:31 INFO Signed narinfos id=66 count=16786worker2 # [ 186.826059] nix-grpc-daemon[1891]: time=2026-09-20T09:07:31.213Z level=INFO msg="Uploading 1 narinfos"6787lb # [ 186.809169] niks3-server[1074]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6788lb # [ 186.821393] niks3-server[1074]: 2026/09/20 09:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6789worker2 # [ 186.845298] nix-grpc-daemon[1891]: time=2026-09-20T09:07:31.233Z level=INFO msg="Upload complete. (368ms)"6790lb # [ 186.828336] niks3-server[1074]: 2026/09/20 09:07:31 INFO Completed upload id=666791worker2 # [ 186.847325] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43390 duration_s=0 paths=1 nar_bytes_in=6246792lb # [ 186.831470] niks3-server[1074]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6793worker2 # [ 186.852857] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:433906794worker2 # [ 186.861450] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6795worker2 # [ 186.864918] nix-daemon[862]: reaped child process 1936, status = succeeded6796client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6797client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6798worker2 # [ 186.869926] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6799lb # [ 187.643427] envoy[973]: conn peer=[2001:db8:1::1]:52186 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=300526800client # farm-b> LOG-farm-b-drain6801worker2 # [ 188.094690] nix-daemon[862]: reaped child process 1950, status = succeeded6802worker2 # [ 188.244423] nix-daemon[862]: accepted connection from pid 1965, user nix-grpc-daemon (trusted)6803worker2 # [ 188.255462] nix-daemon[862]: reaped child process 1968, status = succeeded6804lb # [ 188.254477] niks3-server[1074]: 2026/09/20 09:07:33 INFO Received uploads request method=POST path=/api/pending_closures6805worker2 # [ 188.279425] nix-grpc-daemon[1891]: time=2026-09-20T09:07:32.667Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6806worker2 # [ 188.280939] nix-grpc-daemon[1891]: time=2026-09-20T09:07:32.669Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6807lb # [ 188.292114] niks3-server[1074]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6808lb # [ 188.299700] niks3-server[1074]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6809lb # [ 188.309069] niks3-server[1074]: 2026/09/20 09:07:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6810worker2 # [ 188.331233] nix-grpc-daemon[1891]: time=2026-09-20T09:07:32.719Z level=INFO msg="Uploading 1 narinfos"6811lb # [ 188.314067] niks3-server[1074]: 2026/09/20 09:07:33 INFO Signed narinfos id=67 count=16812lb # [ 188.320355] niks3-server[1074]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6813lb # [ 188.328627] niks3-server[1074]: 2026/09/20 09:07:33 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6814lb # [ 188.333681] niks3-server[1074]: 2026/09/20 09:07:33 INFO Completed upload id=676815worker2 # [ 188.350453] nix-grpc-daemon[1891]: time=2026-09-20T09:07:32.738Z level=INFO msg="Upload complete. (271ms)"6816lb # [ 188.338454] niks3-server[1074]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6817worker2 # [ 188.355497] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43390 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16818worker1 # [ 188.361462] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:32Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06819worker1 # [ 188.363482] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:32Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16820worker2 # [ 188.370786] nix-daemon[862]: reaped child process 1948, status = succeeded6821worker2 # [ 188.405967] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:433906822worker2 # [ 188.418254] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:433906823worker2 # [ 188.431344] nix-grpc-daemon[1891]: time=2026-09-20T09:07:32.819Z level=INFO msg="All 2 paths already cached"6824client # copying 1 paths to 'lb:50051'...6825client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6826worker2 # [ 188.439505] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:433906827worker2 # [ 188.449157] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6828worker2 # [ 188.599991] nix-daemon[862]: accepted connection from pid 1972, user nix-grpc-daemon (trusted)6829worker2 # [ 188.612692] nix-daemon[862]: reaped child process 1975, status = succeeded6830worker2 # [ 188.760251] nix-daemon[862]: accepted connection from pid 1977, user nix-grpc-daemon (trusted)6831worker2 # [ 188.772287] nix-daemon[862]: reaped child process 1980, status = succeeded6832lb # [ 188.767062] niks3-server[1074]: 2026/09/20 09:07:33 INFO Received uploads request method=POST path=/api/pending_closures6833worker2 # [ 188.791479] nix-grpc-daemon[1891]: time=2026-09-20T09:07:33.179Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6834worker2 # [ 188.793080] nix-grpc-daemon[1891]: time=2026-09-20T09:07:33.181Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6835lb # [ 188.796878] niks3-server[1074]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6836lb # [ 188.806495] niks3-server[1074]: 2026/09/20 09:07:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6837worker2 # [ 188.828879] nix-grpc-daemon[1891]: time=2026-09-20T09:07:33.217Z level=INFO msg="Uploading 1 narinfos"6838lb # [ 188.811767] niks3-server[1074]: 2026/09/20 09:07:33 INFO Signed narinfos id=68 count=16839lb # [ 188.819160] niks3-server[1074]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6840lb # [ 188.829118] niks3-server[1074]: 2026/09/20 09:07:33 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6841worker2 # [ 188.852255] nix-grpc-daemon[1891]: time=2026-09-20T09:07:33.240Z level=INFO msg="Upload complete. (391ms)"6842lb # [ 188.835536] niks3-server[1074]: 2026/09/20 09:07:33 INFO Completed upload id=686843worker2 # [ 188.853693] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43390 duration_s=0 paths=1 nar_bytes_in=7526844lb # [ 188.838259] niks3-server[1074]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6845worker2 # [ 188.860532] nix-daemon[862]: reaped child process 1970, status = succeeded6846worker2 # [ 188.862187] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:433906847worker2 # [ 188.866121] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6848worker2 # [ 188.871947] nix-daemon[862]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6849client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6850client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6851worker2 # [ 190.285306] nix-daemon[862]: reaped child process 1984, status = succeeded6852client # farm-top> LOG-farm-top-drain6853worker2 # [ 190.417139] nix-daemon[862]: accepted connection from pid 1999, user nix-grpc-daemon (trusted)6854worker2 # [ 190.429452] nix-daemon[862]: reaped child process 2002, status = succeeded6855lb # [ 190.429408] niks3-server[1074]: 2026/09/20 09:07:35 INFO Received uploads request method=POST path=/api/pending_closures6856worker2 # [ 190.456483] nix-grpc-daemon[1891]: time=2026-09-20T09:07:34.844Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6857worker2 # [ 190.457961] nix-grpc-daemon[1891]: time=2026-09-20T09:07:34.846Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6858lb # [ 190.465464] niks3-server[1074]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6859lb # [ 190.477955] niks3-server[1074]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6860lb # [ 190.483991] niks3-server[1074]: 2026/09/20 09:07:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6861lb # [ 190.488497] niks3-server[1074]: 2026/09/20 09:07:35 INFO Signed narinfos id=69 count=16862worker2 # [ 190.508160] nix-grpc-daemon[1891]: time=2026-09-20T09:07:34.896Z level=INFO msg="Uploading 1 narinfos"6863lb # [ 190.495913] niks3-server[1074]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6864lb # [ 190.504357] niks3-server[1074]: 2026/09/20 09:07:35 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6865lb # [ 190.507317] niks3-server[1074]: 2026/09/20 09:07:35 INFO Completed upload id=696866lb # [ 190.509381] niks3-server[1074]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6867worker2 # [ 190.525749] nix-grpc-daemon[1891]: time=2026-09-20T09:07:34.913Z level=INFO msg="Upload complete. (247ms)"6868worker2 # [ 190.530756] nix-grpc-daemon[1835]: ts=2026-09-20T09:07:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43390 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16869worker2 # [ 190.543953] nix-daemon[862]: reaped child process 1982, status = succeeded6870client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.83 seconds)6871client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6872client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.20 seconds)6873worker1: must succeed: rm /nix/.rw-store/fill6874worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6875worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6876worker1 # [ 191.345140] nix-grpc-daemon[1278]: ts=2026-09-20T09:07:35Z level=info event=healthy reason=min_free6877worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.09 seconds)6878(finished: subtest: low disk drains a worker and builds go to the other, in 10.37 seconds)6879(finished: run the VM test script, in 192.87 seconds)6880test script finished in 193.05s6881cleanup6882kill QemuMachine (pid 49)6883client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6884kill QemuMachine (pid 50)6885lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6886kill QemuMachine (pid 51)6887worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6888kill QemuMachine (pid 52)6889worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6890(finished: cleanup, in 1.01 seconds)6891additionally exposed symbols:6892 client, lb, worker1, worker2,6893 vlan1,6894 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh

succeeded vm-test-run-nix-grpc-farm checks.x86_64-linux.farm · build #253 · raw

succeeded `vm-test-run-nix-grpc-farm` `checks.x86_64-linux.farm` · build #253 · raw