vm-test-run-nix-grpc-farm log

succeeded `vm-test-run-nix-grpc-farm` `checks.x86_64-linux.farm` · build #347 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1 # Formatting '/build/vm-state-worker1/tmp.0vs0dQIolL', fmt=raw size=107374182414worker1 # mke2fs 1.47.4 (6-Mar-2025)15worker1: QEMU running (pid 52)16worker1 # Discarding device blocks: 0/262144 done17worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes18worker1 # Filesystem UUID: 9aeba46f-387a-4a0a-9395-f65feb65787c19worker1 # Superblock backups stored on blocks:20worker1 # 32768, 98304, 163840, 22937621worker1 # 22worker1 # Allocating group tables: 0/8 done23worker1 # Writing inode tables: 0/8 done24worker1 # Creating journal (8192 blocks): done25worker1 # Writing superblocks and filesystem accounting information: 0/8 done26worker1 # 27worker1 # Virtualisation disk image created.28worker2 # Disk image does not exist, creating the virtualisation disk image...29lb # Disk image does not exist, creating the virtualisation disk image...30lb: QEMU running (pid 50)31worker2: QEMU running (pid 51)32worker2 # Formatting '/build/vm-state-worker2/tmp.liMgn8pX4z', fmt=raw size=107374182433lb # Formatting '/build/vm-state-lb/tmp.BvTZm6vC6Q', fmt=raw size=107374182434worker2 # mke2fs 1.47.4 (6-Mar-2025)35lb # mke2fs 1.47.4 (6-Mar-2025)36worker2 # Discarding device blocks: 0/262144 done37lb # Discarding device blocks: 0/262144 done38worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes39lb # Creating filesystem with 262144 4k blocks and 65536 inodes40worker2 # Filesystem UUID: e5e9abcc-a1b5-4443-b1d0-5459c0a99c2641lb # Filesystem UUID: 12614e92-e996-48be-b3a7-849374ef5f3942worker2 # Superblock backups stored on blocks:43lb # Superblock backups stored on blocks:44worker2 # 32768, 98304, 163840, 22937645lb # 32768, 98304, 163840, 22937646worker2 # 47lb # 48worker2 # Allocating group tables: 0/8 done49lb # Allocating group tables: 0/8 done50worker2 # Writing inode tables: 0/8 done51lb # Writing inode tables: 0/8 done52worker2 # Creating journal (8192 blocks): done53lb # Creating journal (8192 blocks): done54worker2 # Writing superblocks and filesystem accounting information: 0/8 done55lb # Writing superblocks and filesystem accounting information: 0/8 done56worker2 # 57lb # 58worker2 # Virtualisation disk image created.59lb # Virtualisation disk image created.60client: QEMU running (pid 49)61client # Disk image does not exist, creating the virtualisation disk image...62client # Formatting '/build/vm-state-client/tmp.YaWtFokrWi', fmt=raw size=107374182463client # mke2fs 1.47.4 (6-Mar-2025)64client # Discarding device blocks: 0/262144 done65client # Creating filesystem with 262144 4k blocks and 65536 inodes66client # Filesystem UUID: 4989c95f-8cf9-4ca3-b278-da0c9235356067client # Superblock backups stored on blocks:68client # 32768, 98304, 163840, 22937669client # 70client # Allocating group tables: 0/8 done71client # Writing inode tables: 0/8 done72client # Creating journal (8192 blocks): done73client # Writing superblocks and filesystem accounting information: 0/8 done74client # 75client # Virtualisation disk image created.76(finished: start all VMs, in 0.25 seconds)77client: waiting for unit network-addresses-eth1.service78client: waiting for the VM to finish booting79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87worker1 # 88worker1 # 89worker1 # 90worker1 # 91worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...93worker1 # 94worker1 # 95worker2 # 96worker2 # 97worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0098worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99worker2 # 100worker2 # 101worker2 # 102worker2 # 103worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104lb # 105lb # 106client # 107client # 108lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00109worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...110worker2 # 111worker2 # 112client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00113lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...114lb # 115lb # 116lb # 117lb # 118client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...119client # 120client # 121client # 122client # 123lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00124client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00125lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126lb # 127lb # 128client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129client # 130client # 131worker1 # Booting from ROM...132worker2 # Booting from ROM...133client # Booting from ROM...134lb # Booting from ROM...135worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9zv2kvdr1jmhf4arh2acgpj2chy4ib9c-nixos-system-worker1-test/init regInfo=/nix/store/p7xjjqy74f23crsj0hddnbhh332qfisj-closure-info/registration console=ttyS0,115200n8 console=tty0137worker1 # [ 0.000000] BIOS-provided physical RAM map:138worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148worker1 # [ 0.000000] NX (Execute Disable) protection: active149worker1 # [ 0.000000] APIC: Static calls initialized150worker1 # [ 0.000000] SMBIOS 2.8 present.151worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152worker1 # [ 0.000000] DMI: Memory slots populated: 1/1153worker1 # [ 0.000000] Hypervisor detected: KVM154worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000155worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00156worker1 # [ 0.000000] kvm-clock: using sched offset of 458396847 cycles157worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns158worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor159worker1 # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000160worker1 # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs161worker1 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT162worker1 # [ 0.002765] found SMP MP-table at [mem 0x000f5450-0x000f545f]163worker1 # [ 0.002777] Using GB pages for direct mapping164worker1 # [ 0.002857] RAMDISK: [mem 0x5e367000-0x5ffcffff]165worker1 # [ 0.002866] ACPI: Early table checksum verification disabled166worker1 # [ 0.002869] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )167worker1 # [ 0.002873] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)168worker1 # [ 0.002878] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)169worker1 # [ 0.002885] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)170worker1 # [ 0.002887] ACPI: FACS 0x000000005FFE0000 000040171worker1 # [ 0.002888] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)172worker1 # [ 0.002890] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)173client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026174worker1 # [ 0.002892] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)175worker1 # [ 0.002893] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)176worker1 # [ 0.002894] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]177worker1 # [ 0.002895] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]178client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test/init regInfo=/nix/store/j627gxpaj2mmx76wxa0wg4nq0zawq4qm-closure-info/registration console=ttyS0,115200n8 console=tty0179worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026180client # [ 0.000000] BIOS-provided physical RAM map:181worker1 # [ 0.002896] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]182client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable183worker1 # [ 0.002896] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]184client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved185worker1 # [ 0.002897] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]186client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved187worker1 # [ 0.002897] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]188worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/32cf2pxj1d7cxlr49wvmym02qvlfilsz-nixos-system-worker2-test/init regInfo=/nix/store/wfx2vfwzkznyhnzwm0qnjv1i5spkkbnv-closure-info/registration console=ttyS0,115200n8 console=tty0189client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable190worker1 # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]191worker2 # [ 0.000000] BIOS-provided physical RAM map:192worker1 # [ 0.003141] No NUMA configuration found193client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved194worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable195worker1 # [ 0.003141] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]196client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved197worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved198worker1 # [ 0.003144] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]199client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved200worker1 # [ 0.005485] Zone ranges:201worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved202client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved203worker1 # [ 0.005486] DMA [mem 0x0000000000001000-0x0000000000ffffff]204worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable205worker1 # [ 0.005487] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]206client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved207worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved208worker1 # [ 0.005488] Normal empty209worker1 # [ 0.005489] Device empty210client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved211worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved212worker1 # [ 0.005490] Movable zone start for each node213client # [ 0.000000] NX (Execute Disable) protection: active214worker1 # [ 0.005490] Early memory node ranges215worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved216client # [ 0.000000] APIC: Static calls initialized217client # [ 0.000000] SMBIOS 2.8 present.218worker1 # [ 0.005491] node 0: [mem 0x0000000000001000-0x000000000009efff]219worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved220worker1 # [ 0.005492] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]221client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014222worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved223worker1 # [ 0.005493] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]224client # [ 0.000000] DMI: Memory slots populated: 1/1225worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved226client # [ 0.000000] Hypervisor detected: KVM227worker1 # [ 0.005514] On node 0, zone DMA: 1 pages in unavailable ranges228worker2 # [ 0.000000] NX (Execute Disable) protection: active229client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000230worker1 # [ 0.006062] On node 0, zone DMA: 97 pages in unavailable ranges231worker2 # [ 0.000000] APIC: Static calls initialized232client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00233worker2 # [ 0.000000] SMBIOS 2.8 present.234worker1 # [ 0.033434] On node 0, zone DMA32: 40 pages in unavailable ranges235client # [ 0.000001] kvm-clock: using sched offset of 461923710 cycles236worker1 # [ 0.033899] ACPI: PM-Timer IO Port: 0x608237worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014238worker1 # [ 0.033913] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])239worker2 # [ 0.000000] DMI: Memory slots populated: 1/1240client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns241worker2 # [ 0.000000] Hypervisor detected: KVM242worker1 # [ 0.033944] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23243client # [ 0.000005] tsc: Detected 2400.012 MHz processor244worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000245worker1 # [ 0.033947] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)246client # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000247worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00248worker1 # [ 0.033949] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)249worker2 # [ 0.000001] kvm-clock: using sched offset of 475135424 cycles250client # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs251worker1 # [ 0.033951] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)252client # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT253worker1 # [ 0.033953] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)254worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns255client # [ 0.002743] found SMP MP-table at [mem 0x000f5450-0x000f545f]256worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor257worker1 # [ 0.033953] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)258client # [ 0.002754] Using GB pages for direct mapping259worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000260worker1 # [ 0.033956] ACPI: Using ACPI (MADT) for SMP configuration information261client # [ 0.002879] RAMDISK: [mem 0x5e366000-0x5ffcffff]262client # [ 0.002887] ACPI: Early table checksum verification disabled263worker1 # [ 0.033957] ACPI: HPET id: 0x8086a201 base: 0xfed00000264worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs265worker1 # [ 0.033961] TSC deadline timer available266lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026267client # [ 0.002890] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )268worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT269worker1 # [ 0.033966] CPU topo: Max. logical packages: 1270worker1 # [ 0.033967] CPU topo: Max. logical dies: 1271worker2 # [ 0.002768] found SMP MP-table at [mem 0x000f5450-0x000f545f]272client # [ 0.002894] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)273worker1 # [ 0.033968] CPU topo: Max. dies per package: 1274worker2 # [ 0.002782] Using GB pages for direct mapping275worker1 # [ 0.033972] CPU topo: Max. threads per core: 1276client # [ 0.002898] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)277worker2 # [ 0.002886] RAMDISK: [mem 0x5e367000-0x5ffcffff]278worker1 # [ 0.033973] CPU topo: Num. cores per package: 1279worker2 # [ 0.002896] ACPI: Early table checksum verification disabled280client # [ 0.002905] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)281worker1 # [ 0.033973] CPU topo: Num. threads per package: 1282worker2 # [ 0.002900] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )283lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0284client # [ 0.002907] ACPI: FACS 0x000000005FFE0000 000040285lb # [ 0.000000] BIOS-provided physical RAM map:286worker1 # [ 0.033973] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs287worker2 # [ 0.002904] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)288client # [ 0.002909] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)289worker1 # [ 0.033995] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()290lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable291worker2 # [ 0.002909] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)292worker1 # [ 0.034030] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]293client # [ 0.002910] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)294lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved295worker1 # [ 0.034031] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]296lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved297client # [ 0.002912] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)298worker2 # [ 0.002918] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)299worker2 # [ 0.002920] ACPI: FACS 0x000000005FFE0000 000040300worker1 # [ 0.034032] [mem 0x60000000-0xafffffff] available for PCI devices301lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable302client # [ 0.002913] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)303worker1 # [ 0.034034] Booting paravirtualized kernel on KVM304worker2 # [ 0.002922] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)305lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved306client # [ 0.002914] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]307lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved308worker1 # [ 0.034038] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns309worker2 # [ 0.002923] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)310client # [ 0.002916] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]311lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved312worker1 # [ 0.038500] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1313worker2 # [ 0.002925] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)314client # [ 0.002916] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]315lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved316worker1 # [ 0.040731] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152317client # [ 0.002917] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]318worker2 # [ 0.002927] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)319worker1 # [ 0.040771] kvm-guest: PV spinlocks disabled, single CPU320lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved321client # [ 0.002917] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]322worker2 # [ 0.002928] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]323lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved324client # [ 0.002918] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]325worker2 # [ 0.002929] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]326lb # [ 0.000000] NX (Execute Disable) protection: active327lb # [ 0.000000] APIC: Static calls initialized328client # [ 0.002918] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]329worker2 # [ 0.002929] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]330lb # [ 0.000000] SMBIOS 2.8 present.331client # [ 0.003149] No NUMA configuration found332worker2 # [ 0.002930] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]333client # [ 0.003150] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]334lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014335worker1 # [ 0.040773] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9zv2kvdr1jmhf4arh2acgpj2chy4ib9c-nixos-system-worker1-test/init regInfo=/nix/store/p7xjjqy74f23crsj0hddnbhh332qfisj-closure-info/registration console=ttyS0,115200n8 console=tty0336worker2 # [ 0.002930] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]337client # [ 0.003152] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]338lb # [ 0.000000] DMI: Memory slots populated: 1/1339client # [ 0.005450] Zone ranges:340lb # [ 0.000000] Hypervisor detected: KVM341worker2 # [ 0.002931] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]342client # [ 0.005451] DMA [mem 0x0000000000001000-0x0000000000ffffff]343lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000344worker1 # [ 0.040868] Unknown kernel command line parameters "regInfo=/nix/store/p7xjjqy74f23crsj0hddnbhh332qfisj-closure-info/registration", will be passed to user space.345worker2 # [ 0.002931] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]346worker1 # [ 0.040883] random: crng init done347client # [ 0.005453] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]348lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00349worker2 # [ 0.003170] No NUMA configuration found350client # [ 0.005454] Normal empty351client # [ 0.005455] Device empty352lb # [ 0.000001] kvm-clock: using sched offset of 497374393 cycles353worker1 # [ 0.040883] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes354worker2 # [ 0.003171] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]355client # [ 0.005455] Movable zone start for each node356client # [ 0.005456] Early memory node ranges357worker2 # [ 0.003173] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]358worker1 # [ 0.043048] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)359worker2 # [ 0.005595] Zone ranges:360lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns361client # [ 0.005456] node 0: [mem 0x0000000000001000-0x000000000009efff]362lb # [ 0.000006] tsc: Detected 2400.012 MHz processor363worker2 # [ 0.005596] DMA [mem 0x0000000000001000-0x0000000000ffffff]364worker1 # [ 0.044137] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)365client # [ 0.005457] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]366lb # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000367worker1 # [ 0.044169] Fallback order for Node 0: 0368worker2 # [ 0.005605] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]369worker2 # [ 0.005606] Normal empty370client # [ 0.005458] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]371worker1 # [ 0.044172] Built 1 zonelists, mobility grouping on. Total pages: 393078372worker2 # [ 0.005607] Device empty373lb # [ 0.000834] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs374worker1 # [ 0.044173] Policy zone: DMA32375worker2 # [ 0.005608] Movable zone start for each node376client # [ 0.005478] On node 0, zone DMA: 1 pages in unavailable ranges377lb # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT378worker2 # [ 0.005608] Early memory node ranges379worker1 # [ 0.046698] mem auto-init: stack:all(zero), heap alloc:on, heap free:off380client # [ 0.005751] On node 0, zone DMA: 97 pages in unavailable ranges381lb # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]382worker2 # [ 0.005609] node 0: [mem 0x0000000000001000-0x000000000009efff]383worker1 # [ 0.050359] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1384client # [ 0.032853] On node 0, zone DMA32: 40 pages in unavailable ranges385lb # [ 0.002746] Using GB pages for direct mapping386worker1 # [ 0.053746] allocated 3145728 bytes of page_ext387worker2 # [ 0.005610] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]388client # [ 0.033322] ACPI: PM-Timer IO Port: 0x608389lb # [ 0.002856] RAMDISK: [mem 0x5e367000-0x5ffcffff]390worker1 # [ 0.063950] ftrace: allocating 48731 entries in 192 pages391client # [ 0.033335] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])392worker2 # [ 0.005611] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]393lb # [ 0.002865] ACPI: Early table checksum verification disabled394worker1 # [ 0.063953] ftrace: allocated 192 pages with 2 groups395worker2 # [ 0.005634] On node 0, zone DMA: 1 pages in unavailable ranges396client # [ 0.033364] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23397worker1 # [ 0.064793] Dynamic Preempt: lazy398lb # [ 0.002868] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )399worker2 # [ 0.005936] On node 0, zone DMA: 97 pages in unavailable ranges400client # [ 0.033366] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)401worker1 # [ 0.064930] rcu: Preemptible hierarchical RCU implementation.402lb # [ 0.002873] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)403worker1 # [ 0.064931] rcu: RCU event tracing is enabled.404worker2 # [ 0.034345] On node 0, zone DMA32: 40 pages in unavailable ranges405client # [ 0.033368] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)406worker2 # [ 0.034833] ACPI: PM-Timer IO Port: 0x608407worker1 # [ 0.064932] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.408lb # [ 0.002877] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)409client # [ 0.033369] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)410worker2 # [ 0.034847] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])411worker1 # [ 0.064933] Trampoline variant of Tasks RCU enabled.412lb # [ 0.002885] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)413client # [ 0.033370] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)414worker1 # [ 0.064934] Rude variant of Tasks RCU enabled.415worker2 # [ 0.034878] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23416lb # [ 0.002887] ACPI: FACS 0x000000005FFE0000 000040417worker1 # [ 0.064934] Tracing variant of Tasks RCU enabled.418client # [ 0.033371] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)419worker2 # [ 0.034881] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)420worker1 # [ 0.064935] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.421client # [ 0.033373] ACPI: Using ACPI (MADT) for SMP configuration information422lb # [ 0.002888] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)423worker2 # [ 0.034883] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)424client # [ 0.033374] ACPI: HPET id: 0x8086a201 base: 0xfed00000425worker1 # [ 0.064935] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1426worker2 # [ 0.034884] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)427lb # [ 0.002890] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)428client # [ 0.033379] TSC deadline timer available429client # [ 0.033383] CPU topo: Max. logical packages: 1430worker2 # [ 0.034885] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)431worker1 # [ 0.064945] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.432lb # [ 0.002898] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)433client # [ 0.033384] CPU topo: Max. logical dies: 1434worker2 # [ 0.034886] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)435client # [ 0.033384] CPU topo: Max. dies per package: 1436worker1 # [ 0.064947] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.437lb # [ 0.002900] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)438client # [ 0.033388] CPU topo: Max. threads per core: 1439worker2 # [ 0.034888] ACPI: Using ACPI (MADT) for SMP configuration information440worker2 # [ 0.034890] ACPI: HPET id: 0x8086a201 base: 0xfed00000441client # [ 0.033388] CPU topo: Num. cores per package: 1442lb # [ 0.002901] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]443worker1 # [ 0.064948] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.444worker2 # [ 0.034895] TSC deadline timer available445client # [ 0.033389] CPU topo: Num. threads per package: 1446worker1 # [ 0.069345] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16447lb # [ 0.002902] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]448worker2 # [ 0.034899] CPU topo: Max. logical packages: 1449client # [ 0.033389] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs450worker1 # [ 0.069628] rcu: srcu_init: Setting srcu_struct sizes based on contention.451worker2 # [ 0.034900] CPU topo: Max. logical dies: 1452lb # [ 0.002903] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]453worker2 # [ 0.034901] CPU topo: Max. dies per package: 1454client # [ 0.033410] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()455lb # [ 0.002903] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]456worker2 # [ 0.034904] CPU topo: Max. threads per core: 1457worker1 # [ 0.069634] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns458client # [ 0.033443] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]459worker2 # [ 0.034905] CPU topo: Num. cores per package: 1460lb # [ 0.002904] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]461worker1 # [ 0.069737] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)462worker2 # [ 0.034905] CPU topo: Num. threads per package: 1463client # [ 0.033444] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]464lb # [ 0.002904] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]465worker1 # [ 0.073267] Console: colour VGA+ 80x25466worker2 # [ 0.034905] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs467client # [ 0.033445] [mem 0x60000000-0xafffffff] available for PCI devices468worker1 # [ 0.073270] printk: legacy console [tty0] enabled469lb # [ 0.002905] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]470client # [ 0.033447] Booting paravirtualized kernel on KVM471worker1 # [ 0.102608] printk: legacy console [ttyS0] enabled472worker2 # [ 0.034932] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()473lb # [ 0.003133] No NUMA configuration found474worker1 # [ 0.202157] ACPI: Core revision 20250807475worker2 # [ 0.034971] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]476lb # [ 0.003134] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]477client # [ 0.033450] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns478lb # [ 0.003137] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]479worker2 # [ 0.034972] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]480lb # [ 0.005503] Zone ranges:481client # [ 0.037902] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1482worker2 # [ 0.034974] [mem 0x60000000-0xafffffff] available for PCI devices483worker1 # [ 0.203025] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns484lb # [ 0.005504] DMA [mem 0x0000000000001000-0x0000000000ffffff]485client # [ 0.040108] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152486worker2 # [ 0.034976] Booting paravirtualized kernel on KVM487worker1 # [ 0.204588] APIC: Switch to symmetric I/O mode setup488lb # [ 0.005506] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]489client # [ 0.040153] kvm-guest: PV spinlocks disabled, single CPU490lb # [ 0.005507] Normal empty491worker1 # [ 0.205515] x2apic enabled492lb # [ 0.005508] Device empty493worker2 # [ 0.034980] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns494lb # [ 0.005509] Movable zone start for each node495lb # [ 0.005509] Early memory node ranges496worker1 # [ 0.206258] APIC: Switched APIC routing to: physical x2apic497worker2 # [ 0.039448] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1498lb # [ 0.005510] node 0: [mem 0x0000000000001000-0x000000000009efff]499worker2 # [ 0.041755] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152500lb # [ 0.005511] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]501worker2 # [ 0.041802] kvm-guest: PV spinlocks disabled, single CPU502worker1 # [ 0.208020] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1503client # [ 0.040154] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test/init regInfo=/nix/store/j627gxpaj2mmx76wxa0wg4nq0zawq4qm-closure-info/registration console=ttyS0,115200n8 console=tty0504lb # [ 0.005512] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]505lb # [ 0.005533] On node 0, zone DMA: 1 pages in unavailable ranges506worker1 # [ 0.208960] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns507lb # [ 0.005806] On node 0, zone DMA: 97 pages in unavailable ranges508client # [ 0.040247] Unknown kernel command line parameters "regInfo=/nix/store/j627gxpaj2mmx76wxa0wg4nq0zawq4qm-closure-info/registration", will be passed to user space.509client # [ 0.040261] random: crng init done510lb # [ 0.034336] On node 0, zone DMA32: 40 pages in unavailable ranges511lb # [ 0.034802] ACPI: PM-Timer IO Port: 0x608512worker1 # [ 0.210517] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)513client # [ 0.040261] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes514worker2 # [ 0.041804] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/32cf2pxj1d7cxlr49wvmym02qvlfilsz-nixos-system-worker2-test/init regInfo=/nix/store/wfx2vfwzkznyhnzwm0qnjv1i5spkkbnv-closure-info/registration console=ttyS0,115200n8 console=tty0515lb # [ 0.034816] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])516client # [ 0.042427] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)517worker1 # [ 0.212600] x86/cpu: User Mode Instruction Prevention (UMIP) activated518lb # [ 0.034850] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23519client # [ 0.043777] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)520worker2 # [ 0.041904] Unknown kernel command line parameters "regInfo=/nix/store/wfx2vfwzkznyhnzwm0qnjv1i5spkkbnv-closure-info/registration", will be passed to user space.521worker1 # [ 0.213640] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127522lb # [ 0.034853] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)523worker2 # [ 0.041918] random: crng init done524client # [ 0.043811] Fallback order for Node 0: 0525lb # [ 0.034855] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)526worker1 # [ 0.214515] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0527worker2 # [ 0.041919] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes528client # [ 0.043814] Built 1 zonelists, mobility grouping on. Total pages: 393078529client # [ 0.043815] Policy zone: DMA32530lb # [ 0.034856] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)531worker2 # [ 0.044506] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)532client # [ 0.046321] mem auto-init: stack:all(zero), heap alloc:on, heap free:off533lb # [ 0.034857] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)534worker1 # [ 0.215518] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto535worker2 # [ 0.045637] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)536client # [ 0.049559] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1537lb # [ 0.034858] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)538worker2 # [ 0.045672] Fallback order for Node 0: 0539client # [ 0.052919] allocated 3145728 bytes of page_ext540worker1 # [ 0.216515] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl541lb # [ 0.034860] ACPI: Using ACPI (MADT) for SMP configuration information542client # [ 0.062831] ftrace: allocating 48731 entries in 192 pages543worker2 # [ 0.045675] Built 1 zonelists, mobility grouping on. Total pages: 393078544worker2 # [ 0.045676] Policy zone: DMA32545lb # [ 0.034861] ACPI: HPET id: 0x8086a201 base: 0xfed00000546client # [ 0.062833] ftrace: allocated 192 pages with 2 groups547worker1 # [ 0.218516] Transient Scheduler Attacks: Vulnerable: No microcode548lb # [ 0.034866] TSC deadline timer available549client # [ 0.063667] Dynamic Preempt: lazy550worker2 # [ 0.048342] mem auto-init: stack:all(zero), heap alloc:on, heap free:off551lb # [ 0.034871] CPU topo: Max. logical packages: 1552worker1 # [ 0.219515] Spectre V2 : Mitigation: Enhanced / Automatic IBRS553client # [ 0.063825] rcu: Preemptible hierarchical RCU implementation.554worker2 # [ 0.051892] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1555lb # [ 0.034872] CPU topo: Max. logical dies: 1556client # [ 0.063826] rcu: RCU event tracing is enabled.557worker2 # [ 0.055694] allocated 3145728 bytes of page_ext558lb # [ 0.034872] CPU topo: Max. dies per package: 1559worker1 # [ 0.220515] Speculative Return Stack Overflow: Mitigation: Safe RET560client # [ 0.063827] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.561lb # [ 0.034876] CPU topo: Max. threads per core: 1562worker2 # [ 0.066236] ftrace: allocating 48731 entries in 192 pages563client # [ 0.063828] Trampoline variant of Tasks RCU enabled.564lb # [ 0.034877] CPU topo: Num. cores per package: 1565worker2 # [ 0.066239] ftrace: allocated 192 pages with 2 groups566client # [ 0.063829] Rude variant of Tasks RCU enabled.567worker2 # [ 0.067152] Dynamic Preempt: lazy568lb # [ 0.034877] CPU topo: Num. threads per package: 1569client # [ 0.063829] Tracing variant of Tasks RCU enabled.570worker2 # [ 0.067346] rcu: Preemptible hierarchical RCU implementation.571lb # [ 0.034877] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs572worker2 # [ 0.067347] rcu: RCU event tracing is enabled.573client # [ 0.063830] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.574lb # [ 0.034908] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()575worker2 # [ 0.067348] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.576client # [ 0.063831] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1577worker1 # [ 0.221447] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization578lb # [ 0.034947] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]579worker2 # [ 0.067350] Trampoline variant of Tasks RCU enabled.580worker1 # [ 0.222522] Spectre V2 : Enabling IBPB for BPF581worker2 # [ 0.067351] Rude variant of Tasks RCU enabled.582client # [ 0.063845] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.583lb # [ 0.034949] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]584worker2 # [ 0.067351] Tracing variant of Tasks RCU enabled.585lb # [ 0.034950] [mem 0x60000000-0xafffffff] available for PCI devices586client # [ 0.063847] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.587worker2 # [ 0.067352] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.588worker1 # [ 0.224028] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier589lb # [ 0.034952] Booting paravirtualized kernel on KVM590worker1 # [ 0.224515] active return thunk: srso_alias_return_thunk591worker2 # [ 0.067353] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1592client # [ 0.063848] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.593lb # [ 0.034956] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns594client # [ 0.068491] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16595worker2 # [ 0.067382] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.596worker1 # [ 0.226135] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'597lb # [ 0.039515] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1598client # [ 0.068790] rcu: srcu_init: Setting srcu_struct sizes based on contention.599worker1 # [ 0.226515] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'600worker2 # [ 0.067385] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.601lb # [ 0.041819] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152602client # [ 0.068796] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns603lb # [ 0.041863] kvm-guest: PV spinlocks disabled, single CPU604worker1 # [ 0.228226] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'605worker2 # [ 0.067386] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.606worker1 # [ 0.229224] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'607client # [ 0.068900] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)608worker2 # [ 0.071945] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16609client # [ 0.072500] Console: colour VGA+ 80x25610worker2 # [ 0.072245] rcu: srcu_init: Setting srcu_struct sizes based on contention.611worker1 # [ 0.229515] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'612client # [ 0.072503] printk: legacy console [tty0] enabled613client # [ 0.101959] printk: legacy console [ttyS0] enabled614worker2 # [ 0.072252] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns615worker1 # [ 0.230515] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'616client # [ 0.198304] ACPI: Core revision 20250807617lb # [ 0.041865] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0618worker2 # [ 0.072371] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)619worker1 # [ 0.231515] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'620worker2 # [ 0.075974] Console: colour VGA+ 80x25621client # [ 0.199155] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns622worker2 # [ 0.075978] printk: legacy console [tty0] enabled623worker1 # [ 0.232516] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256624lb # [ 0.041974] Unknown kernel command line parameters "regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration", will be passed to user space.625worker2 # [ 0.105877] printk: legacy console [ttyS0] enabled626lb # [ 0.041987] random: crng init done627client # [ 0.200658] APIC: Switch to symmetric I/O mode setup628worker1 # [ 0.234225] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64629worker2 # [ 0.201306] ACPI: Core revision 20250807630client # [ 0.201587] x2apic enabled631lb # [ 0.041988] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes632worker1 # [ 0.234515] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512633lb # [ 0.044254] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)634client # [ 0.202344] APIC: Switched APIC routing to: physical x2apic635worker1 # [ 0.235515] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024636worker2 # [ 0.202281] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns637lb # [ 0.045652] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)638worker2 # [ 0.203768] APIC: Switch to symmetric I/O mode setup639lb # [ 0.045686] Fallback order for Node 0: 0640worker1 # [ 0.236515] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8641client # [ 0.204138] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1642worker2 # [ 0.204709] x2apic enabled643lb # [ 0.045689] Built 1 zonelists, mobility grouping on. Total pages: 393078644lb # [ 0.045690] Policy zone: DMA32645worker1 # [ 0.237515] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.646worker2 # [ 0.205445] APIC: Switched APIC routing to: physical x2apic647lb # [ 0.048363] mem auto-init: stack:all(zero), heap alloc:on, heap free:off648client # [ 0.205087] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns649lb # [ 0.051915] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1650lb # [ 0.055457] allocated 3145728 bytes of page_ext651client # [ 0.206691] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)652worker2 # [ 0.207228] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1653lb # [ 0.065992] ftrace: allocating 48731 entries in 192 pages654lb # [ 0.065994] ftrace: allocated 192 pages with 2 groups655client # [ 0.207775] x86/cpu: User Mode Instruction Prevention (UMIP) activated656lb # [ 0.066880] Dynamic Preempt: lazy657worker2 # [ 0.208203] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns658lb # [ 0.067070] rcu: Preemptible hierarchical RCU implementation.659client # [ 0.208815] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127660lb # [ 0.067071] rcu: RCU event tracing is enabled.661client # [ 0.209688] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0662worker2 # [ 0.209856] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)663lb # [ 0.067072] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.664lb # [ 0.067073] Trampoline variant of Tasks RCU enabled.665worker2 # [ 0.210944] x86/cpu: User Mode Instruction Prevention (UMIP) activated666lb # [ 0.067074] Rude variant of Tasks RCU enabled.667client # [ 0.210692] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto668lb # [ 0.067074] Tracing variant of Tasks RCU enabled.669worker2 # [ 0.212032] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127670lb # [ 0.067075] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.671client # [ 0.211688] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl672worker2 # [ 0.213542] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0673lb # [ 0.067076] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1674client # [ 0.212688] Transient Scheduler Attacks: Vulnerable: No microcode675lb # [ 0.067098] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.676client # [ 0.213688] Spectre V2 : Mitigation: Enhanced / Automatic IBRS677worker2 # [ 0.213858] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto678lb # [ 0.067100] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.679client # [ 0.214688] Speculative Return Stack Overflow: Mitigation: Safe RET680worker2 # [ 0.215853] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl681lb # [ 0.067101] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.682lb # [ 0.071560] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16683worker2 # [ 0.216853] Transient Scheduler Attacks: Vulnerable: No microcode684lb # [ 0.071841] rcu: srcu_init: Setting srcu_struct sizes based on contention.685worker2 # [ 0.218639] Spectre V2 : Mitigation: Enhanced / Automatic IBRS686lb # [ 0.071846] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns687worker2 # [ 0.219597] Speculative Return Stack Overflow: Mitigation: Safe RET688client # [ 0.215688] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization689client # [ 0.217696] Spectre V2 : Enabling IBPB for BPF690lb # [ 0.072265] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)691lb # [ 0.075772] Console: colour VGA+ 80x25692lb # [ 0.075775] printk: legacy console [tty0] enabled693client # [ 0.218689] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier694lb # [ 0.105580] printk: legacy console [ttyS0] enabled695client # [ 0.219688] active return thunk: srso_alias_return_thunk696lb # [ 0.201736] ACPI: Core revision 20250807697worker2 # [ 0.220602] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization698client # [ 0.220710] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'699worker2 # [ 0.221862] Spectre V2 : Enabling IBPB for BPF700lb # [ 0.202678] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns701client # [ 0.221688] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'702client # [ 0.222688] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'703lb # [ 0.204311] APIC: Switch to symmetric I/O mode setup704worker2 # [ 0.223366] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier705lb # [ 0.205467] x2apic enabled706client # [ 0.223688] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'707worker2 # [ 0.224855] active return thunk: srso_alias_return_thunk708client # [ 0.224688] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'709lb # [ 0.206304] APIC: Switched APIC routing to: physical x2apic710worker2 # [ 0.225879] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'711client # [ 0.225688] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'712worker2 # [ 0.226853] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'713lb # [ 0.208276] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1714client # [ 0.226688] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'715worker2 # [ 0.228695] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'716client # [ 0.227688] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256717lb # [ 0.209306] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns718worker2 # [ 0.229681] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'719client # [ 0.228688] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64720worker2 # [ 0.230853] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'721client # [ 0.229688] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512722lb # [ 0.210948] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)723client # [ 0.230688] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024724worker2 # [ 0.231853] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'725lb # [ 0.213033] x86/cpu: User Mode Instruction Prevention (UMIP) activated726client # [ 0.231688] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8727worker2 # [ 0.232852] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'728lb # [ 0.214071] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127729worker2 # [ 0.233853] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256730lb # [ 0.214946] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0731client # [ 0.232688] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.732worker2 # [ 0.234853] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64733lb # [ 0.215950] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto734worker2 # [ 0.235852] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512735worker2 # [ 0.236853] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024736lb # [ 0.216946] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl737worker1 # [ 0.272887] Freeing SMP alternatives memory: 44K738worker1 # [ 0.273518] pid_max: default: 32768 minimum: 301739worker2 # [ 0.237852] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8740lb # [ 0.218946] Transient Scheduler Attacks: Vulnerable: No microcode741worker1 # [ 0.274530] LSM: initializing lsm=capability,landlock,yama,bpf,ima742lb # [ 0.219945] Spectre V2 : Mitigation: Enhanced / Automatic IBRS743worker2 # [ 0.238853] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.744worker1 # [ 0.275616] landlock: Up and running.745lb # [ 0.220945] Speculative Return Stack Overflow: Mitigation: Safe RET746worker1 # [ 0.276239] Yama: becoming mindful.747worker1 # [ 0.276743] LSM support for eBPF active748worker1 # [ 0.277636] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)749worker1 # [ 0.278560] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)750lb # [ 0.221946] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization751lb # [ 0.223955] Spectre V2 : Enabling IBPB for BPF752lb # [ 0.224681] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier753worker1 # [ 0.281462] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)754lb # [ 0.225946] active return thunk: srso_alias_return_thunk755worker1 # [ 0.282039] Performance Events: Fam17h+ core perfctr, AMD PMU driver.756lb # [ 0.226950] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'757worker1 # [ 0.282520] ... version: 2758lb # [ 0.227945] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'759worker1 # [ 0.283235] ... bit width: 48760lb # [ 0.228945] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'761worker1 # [ 0.283517] ... generic counters: 6762lb # [ 0.229945] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'763worker1 # [ 0.284246] ... generic bitmap: 000000000000003f764worker1 # [ 0.284565] ... fixed-purpose counters: 0765lb # [ 0.230945] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'766worker1 # [ 0.285265] ... fixed-purpose bitmap: 0000000000000000767lb # [ 0.231945] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'768worker1 # [ 0.285517] ... value mask: 0000ffffffffffff769lb # [ 0.232945] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'770worker1 # [ 0.286439] ... max period: 00007fffffffffff771lb # [ 0.233945] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256772worker1 # [ 0.287216] ... global_ctrl mask: 000000000000003f773lb # [ 0.234945] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64774worker1 # [ 0.287642] signal: max sigframe size: 3376775lb # [ 0.235945] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512776worker1 # [ 0.288481] rcu: Hierarchical SRCU implementation.777worker1 # [ 0.289120] rcu: Max phase no-delay instances is 400.778lb # [ 0.236945] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024779lb # [ 0.237945] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8780lb # [ 0.238945] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.781worker1 # [ 0.294144] smp: Bringing up secondary CPUs ...782worker1 # [ 0.294532] smp: Brought up 1 node, 1 CPU783worker1 # [ 0.295190] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)784worker1 # [ 0.295752] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)785worker1 # [ 0.296782] devtmpfs: initialized786worker1 # [ 0.297576] x86/mm: Memory block size: 128MB787client # [ 0.269108] Freeing SMP alternatives memory: 44K788client # [ 0.269692] pid_max: default: 32768 minimum: 301789worker1 # [ 0.299309] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)790client # [ 0.270782] LSM: initializing lsm=capability,landlock,yama,bpf,ima791client # [ 0.271791] landlock: Up and running.792worker1 # [ 0.300399] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).793client # [ 0.272390] Yama: becoming mindful.794worker1 # [ 0.301605] pinctrl core: initialized pinctrl subsystem795client # [ 0.272909] LSM support for eBPF active796worker1 # [ 0.302702] PM: RTC time: 12:45:04, date: 2026-09-20797client # [ 0.273796] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)798worker2 # [ 0.276124] Freeing SMP alternatives memory: 44K799client # [ 0.274732] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)800worker2 # [ 0.276858] pid_max: default: 32768 minimum: 301801worker2 # [ 0.277695] LSM: initializing lsm=capability,landlock,yama,bpf,ima802worker2 # [ 0.278902] landlock: Up and running.803worker2 # [ 0.279500] Yama: becoming mindful.804client # [ 0.277651] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)805worker1 # [ 0.306739] NET: Registered PF_NETLINK/PF_ROUTE protocol family806worker2 # [ 0.280075] LSM support for eBPF active807client # [ 0.278209] Performance Events: Fam17h+ core perfctr, AMD PMU driver.808worker1 # [ 0.308045] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations809worker2 # [ 0.280973] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)810client # [ 0.278693] ... version: 2811client # [ 0.279370] ... bit width: 48812worker1 # [ 0.308539] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations813worker2 # [ 0.281896] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)814client # [ 0.279691] ... generic counters: 6815client # [ 0.280368] ... generic bitmap: 000000000000003f816worker1 # [ 0.309795] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations817client # [ 0.280739] ... fixed-purpose counters: 0818worker1 # [ 0.310528] audit: initializing netlink subsys (disabled)819worker2 # [ 0.284641] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)820client # [ 0.281425] ... fixed-purpose bitmap: 0000000000000000821worker1 # [ 0.311520] audit: type=2000 audit(1789908305.289:1): state=initialized audit_enabled=0 res=1822client # [ 0.281691] ... value mask: 0000ffffffffffff823worker2 # [ 0.285415] Performance Events: Fam17h+ core perfctr, AMD PMU driver.824client # [ 0.282550] ... max period: 00007fffffffffff825worker1 # [ 0.312641] thermal_sys: Registered thermal governor 'fair_share'826worker2 # [ 0.285858] ... version: 2827client # [ 0.283342] ... global_ctrl mask: 000000000000003f828worker1 # [ 0.312643] thermal_sys: Registered thermal governor 'bang_bang'829worker2 # [ 0.286540] ... bit width: 48830client # [ 0.283806] signal: max sigframe size: 3376831worker2 # [ 0.286855] ... generic counters: 6832worker1 # [ 0.313518] thermal_sys: Registered thermal governor 'step_wise'833client # [ 0.284593] rcu: Hierarchical SRCU implementation.834worker2 # [ 0.287540] ... generic bitmap: 000000000000003f835worker1 # [ 0.314421] thermal_sys: Registered thermal governor 'user_space'836client # [ 0.285239] rcu: Max phase no-delay instances is 400.837worker2 # [ 0.287907] ... fixed-purpose counters: 0838worker1 # [ 0.315223] thermal_sys: Registered thermal governor 'power_allocator'839worker2 # [ 0.288603] ... fixed-purpose bitmap: 0000000000000000840worker1 # [ 0.315531] cpuidle: using governor menu841worker2 # [ 0.288856] ... value mask: 0000ffffffffffff842worker1 # [ 0.317712] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5843worker2 # [ 0.289739] ... max period: 00007fffffffffff844worker2 # [ 0.290538] ... global_ctrl mask: 000000000000003f845worker1 # [ 0.318764] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]846worker2 # [ 0.291000] signal: max sigframe size: 3376847worker1 # [ 0.319520] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry848worker2 # [ 0.291832] rcu: Hierarchical SRCU implementation.849client # [ 0.290409] smp: Bringing up secondary CPUs ...850client # [ 0.290706] smp: Brought up 1 node, 1 CPU851worker1 # [ 0.320529] PCI: Using configuration type 1 for base access852worker2 # [ 0.292402] rcu: Max phase no-delay instances is 400.853client # [ 0.291356] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)854lb # [ 0.276600] Freeing SMP alternatives memory: 44K855worker1 # [ 0.321586] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.856lb # [ 0.276951] pid_max: default: 32768 minimum: 301857lb # [ 0.278056] LSM: initializing lsm=capability,landlock,yama,bpf,ima858client # [ 0.291852] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)859lb # [ 0.279079] landlock: Up and running.860client # [ 0.292971] devtmpfs: initialized861lb # [ 0.279946] Yama: becoming mindful.862client # [ 0.293750] x86/mm: Memory block size: 128MB863lb # [ 0.280768] LSM support for eBPF active864worker2 # [ 0.297661] smp: Bringing up secondary CPUs ...865worker2 # [ 0.298483] smp: Brought up 1 node, 1 CPU866lb # [ 0.281530] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)867client # [ 0.295540] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)868worker2 # [ 0.298858] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)869lb # [ 0.282873] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)870client # [ 0.296577] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).871worker1 # [ 0.328543] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages872client # [ 0.297786] pinctrl core: initialized pinctrl subsystem873worker1 # [ 0.329518] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page874worker2 # [ 0.300040] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)875lb # [ 0.285224] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)876client # [ 0.298864] PM: RTC time: 12:45:04, date: 2026-09-20877worker1 # [ 0.330493] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages878worker2 # [ 0.301164] devtmpfs: initialized879worker2 # [ 0.301969] x86/mm: Memory block size: 128MB880lb # [ 0.286603] Performance Events: Fam17h+ core perfctr, AMD PMU driver.881lb # [ 0.286956] ... version: 2882lb # [ 0.287668] ... bit width: 48883worker2 # [ 0.303879] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)884lb # [ 0.287948] ... generic counters: 6885client # [ 0.302486] NET: Registered PF_NETLINK/PF_ROUTE protocol family886lb # [ 0.288620] ... generic bitmap: 000000000000003f887worker2 # [ 0.304881] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).888lb # [ 0.288948] ... fixed-purpose counters: 0889client # [ 0.303905] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations890worker1 # [ 0.335519] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page891worker2 # [ 0.305959] pinctrl core: initialized pinctrl subsystem892lb # [ 0.289642] ... fixed-purpose bitmap: 0000000000000000893client # [ 0.304716] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations894lb # [ 0.289948] ... value mask: 0000ffffffffffff895worker2 # [ 0.307118] PM: RTC time: 12:45:04, date: 2026-09-20896lb # [ 0.290815] ... max period: 00007fffffffffff897client # [ 0.305986] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations898lb # [ 0.291596] ... global_ctrl mask: 000000000000003f899client # [ 0.306706] audit: initializing netlink subsys (disabled)900lb # [ 0.292085] signal: max sigframe size: 3376901client # [ 0.307693] audit: type=2000 audit(1789908305.322:1): state=initialized audit_enabled=0 res=1902lb # [ 0.292876] rcu: Hierarchical SRCU implementation.903worker2 # [ 0.310780] NET: Registered PF_NETLINK/PF_ROUTE protocol family904lb # [ 0.293523] rcu: Max phase no-delay instances is 400.905client # [ 0.308879] thermal_sys: Registered thermal governor 'fair_share'906client # [ 0.308881] thermal_sys: Registered thermal governor 'bang_bang'907worker2 # [ 0.312142] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations908client # [ 0.309691] thermal_sys: Registered thermal governor 'step_wise'909worker1 # [ 0.343903] ACPI: Added _OSI(Module Device)910worker2 # [ 0.312885] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations911worker1 # [ 0.344519] ACPI: Added _OSI(Processor Device)912client # [ 0.310596] thermal_sys: Registered thermal governor 'user_space'913worker1 # [ 0.345218] ACPI: Added _OSI(Processor Aggregator Device)914client # [ 0.311379] thermal_sys: Registered thermal governor 'power_allocator'915worker2 # [ 0.314155] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations916client # [ 0.311706] cpuidle: using governor menu917worker2 # [ 0.314871] audit: initializing netlink subsys (disabled)918lb # [ 0.298801] smp: Bringing up secondary CPUs ...919client # [ 0.313727] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5920lb # [ 0.299550] smp: Brought up 1 node, 1 CPU921worker2 # [ 0.316193] thermal_sys: Registered thermal governor 'fair_share'922lb # [ 0.299949] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)923worker2 # [ 0.316195] thermal_sys: Registered thermal governor 'bang_bang'924client # [ 0.314945] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]925client # [ 0.315694] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry926worker2 # [ 0.316860] audit: type=2000 audit(1789908305.332:1): state=initialized audit_enabled=0 res=1927client # [ 0.316701] PCI: Using configuration type 1 for base access928lb # [ 0.301153] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)929worker2 # [ 0.318858] thermal_sys: Registered thermal governor 'step_wise'930lb # [ 0.302267] devtmpfs: initialized931worker2 # [ 0.318859] thermal_sys: Registered thermal governor 'user_space'932client # [ 0.317786] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.933lb # [ 0.303034] x86/mm: Memory block size: 128MB934worker2 # [ 0.319796] thermal_sys: Registered thermal governor 'power_allocator'935worker1 # [ 0.353071] ACPI: 1 ACPI AML tables successfully acquired and loaded936worker2 # [ 0.320622] cpuidle: using governor menu937lb # [ 0.304868] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)938worker2 # [ 0.322137] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5939lb # [ 0.305826] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).940worker2 # [ 0.323137] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]941lb # [ 0.307078] pinctrl core: initialized pinctrl subsystem942worker1 # [ 0.356950] ACPI: Interpreter enabled943worker2 # [ 0.323859] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry944worker1 # [ 0.357533] ACPI: PM: (supports S0 S3 S4 S5)945lb # [ 0.308193] PM: RTC time: 12:45:04, date: 2026-09-20946worker1 # [ 0.358224] ACPI: Using IOAPIC for interrupt routing947worker2 # [ 0.324870] PCI: Using configuration type 1 for base access948client # [ 0.324710] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages949client # [ 0.325692] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page950worker2 # [ 0.325997] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.951client # [ 0.326671] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages952lb # [ 0.312033] NET: Registered PF_NETLINK/PF_ROUTE protocol family953worker1 # [ 0.360554] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug954worker1 # [ 0.361517] PCI: Using E820 reservations for host bridge windows955lb # [ 0.313535] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations956lb # [ 0.313984] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations957worker1 # [ 0.364585] ACPI: Enabled 2 GPEs in block 00 to 3F958client # [ 0.331692] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page959lb # [ 0.315257] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations960lb # [ 0.315963] audit: initializing netlink subsys (disabled)961worker2 # [ 0.332895] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages962worker2 # [ 0.333858] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page963lb # [ 0.317139] thermal_sys: Registered thermal governor 'fair_share'964lb # [ 0.317141] thermal_sys: Registered thermal governor 'bang_bang'965lb # [ 0.317949] thermal_sys: Registered thermal governor 'step_wise'966lb # [ 0.318871] thermal_sys: Registered thermal governor 'user_space'967lb # [ 0.319649] audit: type=2000 audit(1789908305.354:1): state=initialized audit_enabled=0 res=1968worker2 # [ 0.338856] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages969lb # [ 0.320951] thermal_sys: Registered thermal governor 'power_allocator'970client # [ 0.340114] ACPI: Added _OSI(Module Device)971worker1 # [ 0.372767] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])972lb # [ 0.320969] cpuidle: using governor menu973worker2 # [ 0.339857] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page974client # [ 0.340692] ACPI: Added _OSI(Processor Device)975worker1 # [ 0.373523] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]976client # [ 0.341392] ACPI: Added _OSI(Processor Aggregator Device)977lb # [ 0.323171] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5978worker1 # [ 0.374597] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]979lb # [ 0.324249] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]980worker1 # [ 0.375645] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]981lb # [ 0.324952] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry982worker1 # [ 0.376859] PCI host bridge to bus 0000:00983lb # [ 0.325963] PCI: Using configuration type 1 for base access984worker1 # [ 0.377522] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]985lb # [ 0.327040] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.986worker1 # [ 0.378518] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]987worker1 # [ 0.379518] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]988worker1 # [ 0.380518] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]989client # [ 0.349291] ACPI: 1 ACPI AML tables successfully acquired and loaded990worker1 # [ 0.381517] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]991worker2 # [ 0.351144] ACPI: Added _OSI(Module Device)992worker2 # [ 0.351857] ACPI: Added _OSI(Processor Device)993worker1 # [ 0.382517] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]994lb # [ 0.332245] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages995worker2 # [ 0.352578] ACPI: Added _OSI(Processor Aggregator Device)996worker1 # [ 0.383518] pci_bus 0000:00: root bus resource [bus 00-ff]997lb # [ 0.332950] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page998client # [ 0.353096] ACPI: Interpreter enabled999lb # [ 0.333942] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1000worker1 # [ 0.384473] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1001client # [ 0.353709] ACPI: PM: (supports S0 S3 S4 S5)1002client # [ 0.354380] ACPI: Using IOAPIC for interrupt routing1003worker1 # [ 0.385940] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1004client # [ 0.356754] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1005client # [ 0.357691] PCI: Using E820 reservations for host bridge windows1006worker2 # [ 0.359115] ACPI: 1 ACPI AML tables successfully acquired and loaded1007lb # [ 0.340950] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1008client # [ 0.360748] ACPI: Enabled 2 GPEs in block 00 to 3F1009worker1 # [ 0.388597] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1010worker1 # [ 0.389530] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1011worker2 # [ 0.365134] ACPI: Interpreter enabled1012worker2 # [ 0.365803] ACPI: PM: (supports S0 S3 S4 S5)1013worker1 # [ 0.390649] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1014worker2 # [ 0.366386] ACPI: Using IOAPIC for interrupt routing1015worker1 # [ 0.391692] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1016worker2 # [ 0.366912] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1017lb # [ 0.349376] ACPI: Added _OSI(Module Device)1018worker2 # [ 0.367856] PCI: Using E820 reservations for host bridge windows1019lb # [ 0.349950] ACPI: Added _OSI(Processor Device)1020worker1 # [ 0.393421] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1021lb # [ 0.350697] ACPI: Added _OSI(Processor Aggregator Device)1022client # [ 0.369001] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1023client # [ 0.369697] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1024worker2 # [ 0.370986] ACPI: Enabled 2 GPEs in block 00 to 3F1025worker1 # [ 0.395525] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1026client # [ 0.370767] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1027worker1 # [ 0.396375] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1028client # [ 0.371811] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1029worker1 # [ 0.397290] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1030client # [ 0.373045] PCI host bridge to bus 0000:001031worker1 # [ 0.398400] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1032client # [ 0.373695] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1033client # [ 0.374690] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1034worker1 # [ 0.399959] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1035client # [ 0.375690] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1036client # [ 0.376690] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1037lb # [ 0.359551] ACPI: 1 ACPI AML tables successfully acquired and loaded1038worker1 # [ 0.401537] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1039worker2 # [ 0.379089] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1040client # [ 0.377690] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1041worker1 # [ 0.402375] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1042client # [ 0.378691] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1043worker2 # [ 0.379862] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1044worker1 # [ 0.403241] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1045client # [ 0.379691] pci_bus 0000:00: root bus resource [bus 00-ff]1046worker2 # [ 0.380948] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1047client # [ 0.380608] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1048lb # [ 0.363460] ACPI: Interpreter enabled1049worker2 # [ 0.381984] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1050worker1 # [ 0.404154] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1051lb # [ 0.363969] ACPI: PM: (supports S0 S3 S4 S5)1052worker2 # [ 0.383234] PCI host bridge to bus 0000:001053lb # [ 0.364665] ACPI: Using IOAPIC for interrupt routing1054client # [ 0.382097] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1055worker2 # [ 0.383861] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1056lb # [ 0.365027] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1057worker2 # [ 0.384856] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1058lb # [ 0.365951] PCI: Using E820 reservations for host bridge windows1059worker2 # [ 0.385855] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1060worker1 # [ 0.406527] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1061worker2 # [ 0.386856] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1062worker1 # [ 0.408217] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1063worker1 # [ 0.408542] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1064worker2 # [ 0.387856] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1065lb # [ 0.369145] ACPI: Enabled 2 GPEs in block 00 to 3F1066worker2 # [ 0.388855] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1067worker1 # [ 0.410158] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1068worker2 # [ 0.389863] pci_bus 0000:00: root bus resource [bus 00-ff]1069client # [ 0.384756] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1070worker2 # [ 0.390863] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1071client # [ 0.385704] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1072worker1 # [ 0.411526] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1073worker1 # [ 0.412344] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1074worker2 # [ 0.392350] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1075client # [ 0.386663] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1076worker1 # [ 0.413227] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1077client # [ 0.387868] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1078worker1 # [ 0.414110] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1079lb # [ 0.377920] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1080client # [ 0.389671] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1081lb # [ 0.378866] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1082worker1 # [ 0.416525] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1083worker1 # [ 0.417375] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1084client # [ 0.391699] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1085lb # [ 0.380991] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1086worker1 # [ 0.418244] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1087client # [ 0.392570] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1088client # [ 0.393392] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1089lb # [ 0.382111] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1090worker2 # [ 0.394936] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1091worker1 # [ 0.419075] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1092client # [ 0.393696] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1093lb # [ 0.383380] PCI host bridge to bus 0000:001094worker2 # [ 0.395868] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1095worker2 # [ 0.396834] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1096lb # [ 0.383957] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1097client # [ 0.395240] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1098lb # [ 0.384951] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1099worker2 # [ 0.398000] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1100worker1 # [ 0.421536] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1101lb # [ 0.385950] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1102worker1 # [ 0.422525] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1103client # [ 0.396698] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1104worker1 # [ 0.423463] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1105worker2 # [ 0.399664] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1106lb # [ 0.386950] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1107client # [ 0.397575] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1108client # [ 0.398374] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1109lb # [ 0.387951] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1110worker1 # [ 0.424881] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1111lb # [ 0.388950] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1112client # [ 0.399237] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1113worker2 # [ 0.401882] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1114lb # [ 0.389960] pci_bus 0000:00: root bus resource [bus 00-ff]1115worker1 # [ 0.426535] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1116worker2 # [ 0.402746] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1117worker1 # [ 0.427378] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1118worker2 # [ 0.403609] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1119lb # [ 0.391134] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1120worker1 # [ 0.428242] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1121worker2 # [ 0.403862] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1122worker1 # [ 0.428524] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1123client # [ 0.401698] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1124lb # [ 0.392458] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1125client # [ 0.402697] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1126worker2 # [ 0.405438] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1127client # [ 0.403641] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1128worker1 # [ 0.430030] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1129client # [ 0.405124] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1130worker2 # [ 0.406882] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1131worker1 # [ 0.432530] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1132worker2 # [ 0.407863] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1133worker1 # [ 0.433544] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1134client # [ 0.406697] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1135worker2 # [ 0.408847] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1136client # [ 0.407548] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1137worker1 # [ 0.435050] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1138client # [ 0.408425] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1139worker2 # [ 0.410354] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1140lb # [ 0.395067] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1141worker1 # [ 0.437377] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1142client # [ 0.409241] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143lb # [ 0.395965] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1144worker1 # [ 0.438199] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1145worker2 # [ 0.412882] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1146lb # [ 0.396971] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1147worker1 # [ 0.438540] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1148client # [ 0.410698] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1149worker2 # [ 0.413809] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1150client # [ 0.411511] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1151lb # [ 0.398273] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1152worker2 # [ 0.414588] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1153worker1 # [ 0.440077] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1154client # [ 0.412403] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1155worker2 # [ 0.415485] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1156lb # [ 0.399764] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1157client # [ 0.413286] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1158worker1 # [ 0.441525] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1159worker1 # [ 0.442382] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1160worker2 # [ 0.416882] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1161worker1 # [ 0.443241] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1162client # [ 0.414698] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1163lb # [ 0.402971] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1164worker2 # [ 0.417764] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1165lb # [ 0.403822] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1166client # [ 0.415504] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1167worker1 # [ 0.444100] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1168worker2 # [ 0.418606] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1169client # [ 0.416712] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1170lb # [ 0.404811] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1171worker1 # [ 0.445193] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1172worker2 # [ 0.419432] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1173lb # [ 0.405956] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1174client # [ 0.418275] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1175worker1 # [ 0.445723] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1176worker2 # [ 0.420880] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1177lb # [ 0.407591] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1178client # [ 0.419699] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1179worker1 # [ 0.447219] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1180worker2 # [ 0.421717] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1181client # [ 0.420527] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1182worker2 # [ 0.422566] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1183client # [ 0.421411] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1184client # [ 0.421697] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1185lb # [ 0.409976] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1186worker2 # [ 0.423449] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1187lb # [ 0.410933] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1188client # [ 0.423219] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1189lb # [ 0.411820] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1190client # [ 0.425071] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1191worker2 # [ 0.426132] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1192client # [ 0.425713] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1193lb # [ 0.414040] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1194worker2 # [ 0.426863] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1195worker2 # [ 0.427871] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1196client # [ 0.427281] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1197lb # [ 0.416976] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1198worker2 # [ 0.429659] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1199client # [ 0.428699] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1200lb # [ 0.417932] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1201worker1 # [ 0.447724] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1202client # [ 0.429515] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1203lb # [ 0.418790] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1204client # [ 0.430396] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1205worker2 # [ 0.431863] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1206worker1 # [ 0.450169] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1207worker2 # [ 0.432743] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1208lb # [ 0.420522] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1209worker1 # [ 0.450757] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1210worker2 # [ 0.433608] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1211client # [ 0.431238] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1212worker2 # [ 0.433862] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1213worker1 # [ 0.452101] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1214client # [ 0.432698] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1215client # [ 0.433565] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1216worker1 # [ 0.452784] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1217worker2 # [ 0.435393] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1218lb # [ 0.422997] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1219client # [ 0.434391] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1220worker1 # [ 0.453799] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1221lb # [ 0.423957] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1222worker2 # [ 0.436705] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1223client # [ 0.435245] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1224lb # [ 0.424978] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1225worker2 # [ 0.437593] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1226worker1 # [ 0.454767] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1227client # [ 0.436380] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1228worker2 # [ 0.438424] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1229worker1 # [ 0.456518] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1230lb # [ 0.426610] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1231worker1 # [ 0.457337] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1232client # [ 0.436890] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1233worker2 # [ 0.439888] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1234worker1 # [ 0.458560] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1235client # [ 0.438585] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1236lb # [ 0.428965] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1237worker2 # [ 0.440862] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1238worker1 # [ 0.460204] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1239worker2 # [ 0.441883] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1240lb # [ 0.429889] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1241lb # [ 0.430975] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1242worker2 # [ 0.443420] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1243lb # [ 0.432587] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1244worker1 # [ 0.464249] ACPI: PCI: Interrupt link LNKA configured for IRQ 101245worker2 # [ 0.444881] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1246worker1 # [ 0.464625] ACPI: PCI: Interrupt link LNKB configured for IRQ 101247worker2 # [ 0.445714] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1248worker1 # [ 0.465616] ACPI: PCI: Interrupt link LNKC configured for IRQ 111249worker2 # [ 0.446598] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1250lb # [ 0.434977] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1251worker1 # [ 0.466615] ACPI: PCI: Interrupt link LNKD configured for IRQ 111252worker1 # [ 0.467618] ACPI: PCI: Interrupt link LNKE configured for IRQ 101253lb # [ 0.435958] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1254worker2 # [ 0.448269] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1255worker1 # [ 0.468622] ACPI: PCI: Interrupt link LNKF configured for IRQ 101256lb # [ 0.436976] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1257worker2 # [ 0.449438] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1258worker1 # [ 0.469813] ACPI: PCI: Interrupt link LNKG configured for IRQ 111259client # [ 0.439863] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1260worker1 # [ 0.470631] ACPI: PCI: Interrupt link LNKH configured for IRQ 111261worker2 # [ 0.450715] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1262lb # [ 0.439248] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1263worker1 # [ 0.471558] ACPI: PCI: Interrupt link GSIA configured for IRQ 161264worker2 # [ 0.452451] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1265worker1 # [ 0.472534] ACPI: PCI: Interrupt link GSIB configured for IRQ 171266client # [ 0.443181] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1267worker1 # [ 0.473494] ACPI: PCI: Interrupt link GSIC configured for IRQ 181268lb # [ 0.441835] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1269client # [ 0.443944] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1270worker1 # [ 0.474265] ACPI: PCI: Interrupt link GSID configured for IRQ 191271lb # [ 0.442744] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1272worker1 # [ 0.474532] ACPI: PCI: Interrupt link GSIE configured for IRQ 201273worker1 # [ 0.475494] ACPI: PCI: Interrupt link GSIF configured for IRQ 211274client # [ 0.445684] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1275lb # [ 0.443830] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1276worker1 # [ 0.476243] ACPI: PCI: Interrupt link GSIG configured for IRQ 221277lb # [ 0.444922] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1278client # [ 0.446948] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1279worker1 # [ 0.476529] ACPI: PCI: Interrupt link GSIH configured for IRQ 231280client # [ 0.447982] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1281lb # [ 0.446403] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1282worker1 # [ 0.478497] iommu: Default domain type: Translated1283client # [ 0.448934] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1284worker1 # [ 0.479144] iommu: DMA domain TLB invalidation policy: lazy mode1285worker1 # [ 0.479786] ACPI: bus type USB registered1286lb # [ 0.447982] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1287worker1 # [ 0.480586] usbcore: registered new interface driver usbfs1288client # [ 0.451234] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1289lb # [ 0.448976] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1290worker1 # [ 0.481495] usbcore: registered new interface driver hub1291client # [ 0.451697] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1292worker1 # [ 0.482152] usbcore: registered new device driver usb1293worker2 # [ 0.453078] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1294lb # [ 0.450561] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1295worker1 # [ 0.483363] NetLabel: Initializing1296client # [ 0.452927] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1297worker2 # [ 0.455446] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1298worker1 # [ 0.483915] NetLabel: domain hash size = 1281299client # [ 0.454373] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1300worker1 # [ 0.484517] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1301worker2 # [ 0.456091] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1302worker1 # [ 0.485424] NetLabel: unlabeled traffic allowed by default1303lb # [ 0.452999] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1304worker1 # [ 0.486244] PCI: Using ACPI for IRQ routing1305worker2 # [ 0.457442] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1306lb # [ 0.453957] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1307worker2 # [ 0.458871] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1308client # [ 0.457615] ACPI: PCI: Interrupt link LNKA configured for IRQ 101309lb # [ 0.454980] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1310client # [ 0.458520] ACPI: PCI: Interrupt link LNKB configured for IRQ 101311worker2 # [ 0.460148] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1312client # [ 0.459800] ACPI: PCI: Interrupt link LNKC configured for IRQ 111313lb # [ 0.456569] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1314worker2 # [ 0.461132] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1315client # [ 0.460798] ACPI: PCI: Interrupt link LNKD configured for IRQ 111316client # [ 0.461785] ACPI: PCI: Interrupt link LNKE configured for IRQ 101317worker2 # [ 0.462803] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1318lb # [ 0.458847] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1319client # [ 0.462788] ACPI: PCI: Interrupt link LNKF configured for IRQ 101320worker2 # [ 0.463545] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1321lb # [ 0.459706] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1322client # [ 0.463790] ACPI: PCI: Interrupt link LNKG configured for IRQ 111323worker2 # [ 0.464180] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1324client # [ 0.464785] ACPI: PCI: Interrupt link LNKH configured for IRQ 111325lb # [ 0.460807] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1326client # [ 0.465722] ACPI: PCI: Interrupt link GSIA configured for IRQ 161327worker2 # [ 0.465575] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1328client # [ 0.466675] ACPI: PCI: Interrupt link GSIB configured for IRQ 171329client # [ 0.467453] ACPI: PCI: Interrupt link GSIC configured for IRQ 181330lb # [ 0.462528] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1331client # [ 0.467705] ACPI: PCI: Interrupt link GSID configured for IRQ 191332lb # [ 0.463868] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1333client # [ 0.468703] ACPI: PCI: Interrupt link GSIE configured for IRQ 201334worker2 # [ 0.468966] ACPI: PCI: Interrupt link LNKA configured for IRQ 101335client # [ 0.469684] ACPI: PCI: Interrupt link GSIF configured for IRQ 211336lb # [ 0.464955] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1337worker2 # [ 0.469966] ACPI: PCI: Interrupt link LNKB configured for IRQ 101338client # [ 0.470647] ACPI: PCI: Interrupt link GSIG configured for IRQ 221339worker2 # [ 0.470970] ACPI: PCI: Interrupt link LNKC configured for IRQ 111340client # [ 0.471461] ACPI: PCI: Interrupt link GSIH configured for IRQ 231341lb # [ 0.466773] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1342worker2 # [ 0.471979] ACPI: PCI: Interrupt link LNKD configured for IRQ 111343client # [ 0.472772] iommu: Default domain type: Translated1344worker2 # [ 0.472969] ACPI: PCI: Interrupt link LNKE configured for IRQ 101345client # [ 0.473536] iommu: DMA domain TLB invalidation policy: lazy mode1346worker2 # [ 0.473956] ACPI: PCI: Interrupt link LNKF configured for IRQ 101347client # [ 0.474673] ACPI: bus type USB registered1348worker2 # [ 0.474960] ACPI: PCI: Interrupt link LNKG configured for IRQ 111349client # [ 0.475265] usbcore: registered new interface driver usbfs1350worker2 # [ 0.475959] ACPI: PCI: Interrupt link LNKH configured for IRQ 111351client # [ 0.475706] usbcore: registered new interface driver hub1352client # [ 0.476559] usbcore: registered new device driver usb1353worker2 # [ 0.476892] ACPI: PCI: Interrupt link GSIA configured for IRQ 161354worker2 # [ 0.477873] ACPI: PCI: Interrupt link GSIB configured for IRQ 171355client # [ 0.478642] NetLabel: Initializing1356worker2 # [ 0.478872] ACPI: PCI: Interrupt link GSIC configured for IRQ 181357client # [ 0.479093] NetLabel: domain hash size = 1281358worker2 # [ 0.479861] ACPI: PCI: Interrupt link GSID configured for IRQ 191359client # [ 0.479690] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1360worker2 # [ 0.480858] ACPI: PCI: Interrupt link GSIE configured for IRQ 201361client # [ 0.480632] NetLabel: unlabeled traffic allowed by default1362worker2 # [ 0.481848] ACPI: PCI: Interrupt link GSIF configured for IRQ 211363client # [ 0.481379] PCI: Using ACPI for IRQ routing1364worker2 # [ 0.482645] ACPI: PCI: Interrupt link GSIG configured for IRQ 221365lb # [ 0.467937] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1366worker2 # [ 0.483789] ACPI: PCI: Interrupt link GSIH configured for IRQ 231367lb # [ 0.469820] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1368worker2 # [ 0.485867] iommu: Default domain type: Translated1369worker2 # [ 0.486676] iommu: DMA domain TLB invalidation policy: lazy mode1370lb # [ 0.471000] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1371worker2 # [ 0.487936] ACPI: bus type USB registered1372worker2 # [ 0.488698] usbcore: registered new interface driver usbfs1373lb # [ 0.472712] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1374worker2 # [ 0.489569] usbcore: registered new interface driver hub1375lb # [ 0.473270] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1376worker2 # [ 0.490631] usbcore: registered new device driver usb1377lb # [ 0.474284] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1378worker2 # [ 0.491778] NetLabel: Initializing1379worker2 # [ 0.492395] NetLabel: domain hash size = 1281380worker2 # [ 0.492855] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1381lb # [ 0.475263] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1382worker2 # [ 0.493916] NetLabel: unlabeled traffic allowed by default1383worker1 # [ 0.530366] pci 0000:00:01.0: vgaarb: setting as boot VGA device1384worker2 # [ 0.495011] PCI: Using ACPI for IRQ routing1385worker1 # [ 0.530514] pci 0000:00:01.0: vgaarb: bridge control possible1386lb # [ 0.478857] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1387worker1 # [ 0.530514] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1388lb # [ 0.479721] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1389worker1 # [ 0.530523] vgaarb: loaded1390worker1 # [ 0.531385] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01391lb # [ 0.481184] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1392worker1 # [ 0.532185] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1393lb # [ 0.483006] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1394worker1 # [ 0.535611] clocksource: Switched to clocksource kvm-clock1395worker1 # [ 0.539136] VFS: Disk quotas dquot_6.6.01396lb # [ 0.488229] ACPI: PCI: Interrupt link LNKA configured for IRQ 101397worker1 # [ 0.539846] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1398lb # [ 0.489081] ACPI: PCI: Interrupt link LNKB configured for IRQ 101399worker1 # [ 0.541217] pnp: PnP ACPI init1400worker1 # [ 0.542014] ACPI: IRQ 4 override to edge(!), high(!)1401lb # [ 0.490072] ACPI: PCI: Interrupt link LNKC configured for IRQ 111402lb # [ 0.491076] ACPI: PCI: Interrupt link LNKD configured for IRQ 111403worker1 # [ 0.543019] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1404worker1 # [ 0.544573] pnp: PnP ACPI: found 6 devices1405lb # [ 0.492064] ACPI: PCI: Interrupt link LNKE configured for IRQ 101406lb # [ 0.493065] ACPI: PCI: Interrupt link LNKF configured for IRQ 101407lb # [ 0.494141] ACPI: PCI: Interrupt link LNKG configured for IRQ 111408lb # [ 0.495315] ACPI: PCI: Interrupt link LNKH configured for IRQ 111409lb # [ 0.496004] ACPI: PCI: Interrupt link GSIA configured for IRQ 161410lb # [ 0.496976] ACPI: PCI: Interrupt link GSIB configured for IRQ 171411lb # [ 0.497967] ACPI: PCI: Interrupt link GSIC configured for IRQ 181412worker1 # [ 0.552195] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1413lb # [ 0.498969] ACPI: PCI: Interrupt link GSID configured for IRQ 191414worker1 # [ 0.553743] clocksource: Switched to clocksource acpi_pm1415lb # [ 0.499971] ACPI: PCI: Interrupt link GSIE configured for IRQ 201416worker1 # [ 0.554747] NET: Registered PF_INET protocol family1417client # [ 0.525134] pci 0000:00:01.0: vgaarb: setting as boot VGA device1418lb # [ 0.500968] ACPI: PCI: Interrupt link GSIF configured for IRQ 211419client # [ 0.525687] pci 0000:00:01.0: vgaarb: bridge control possible1420worker1 # [ 0.555947] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1421lb # [ 0.501968] ACPI: PCI: Interrupt link GSIG configured for IRQ 221422lb # [ 0.502992] ACPI: PCI: Interrupt link GSIH configured for IRQ 231423client # [ 0.525687] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1424client # [ 0.525699] vgaarb: loaded1425client # [ 0.526691] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01426lb # [ 0.505094] iommu: Default domain type: Translated1427client # [ 0.527675] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1428lb # [ 0.505958] iommu: DMA domain TLB invalidation policy: lazy mode1429lb # [ 0.507246] ACPI: bus type USB registered1430lb # [ 0.508030] usbcore: registered new interface driver usbfs1431lb # [ 0.508969] usbcore: registered new interface driver hub1432client # [ 0.529859] clocksource: Switched to clocksource kvm-clock1433lb # [ 0.509949] usbcore: registered new device driver usb1434lb # [ 0.511869] NetLabel: Initializing1435lb # [ 0.512450] NetLabel: domain hash size = 1281436lb # [ 0.512949] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1437client # [ 0.534811] VFS: Disk quotas dquot_6.6.01438lb # [ 0.513998] NetLabel: unlabeled traffic allowed by default1439client # [ 0.535730] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1440lb # [ 0.514968] PCI: Using ACPI for IRQ routing1441client # [ 0.537434] pnp: PnP ACPI init1442client # [ 0.538472] ACPI: IRQ 4 override to edge(!), high(!)1443worker1 # [ 0.573031] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1444client # [ 0.539669] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1445worker1 # [ 0.574467] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1446worker2 # [ 0.543145] pci 0000:00:01.0: vgaarb: setting as boot VGA device1447client # [ 0.541557] pnp: PnP ACPI: found 6 devices1448worker1 # [ 0.575781] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1449worker2 # [ 0.543851] pci 0000:00:01.0: vgaarb: bridge control possible1450worker1 # [ 0.577133] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1451worker2 # [ 0.543851] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1452worker1 # [ 0.578405] TCP: Hash tables configured (established 16384 bind 16384)1453worker2 # [ 0.543862] vgaarb: loaded1454worker1 # [ 0.579529] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1455worker2 # [ 0.544782] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01456worker1 # [ 0.580822] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1457worker2 # [ 0.545537] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1458worker1 # [ 0.581995] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1459worker1 # [ 0.583231] NET: Registered PF_UNIX/PF_LOCAL protocol family1460worker1 # [ 0.584272] NET: Registered PF_XDP protocol family1461client # [ 0.550030] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1462worker1 # [ 0.585142] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1463worker2 # [ 0.548980] clocksource: Switched to clocksource kvm-clock1464worker1 # [ 0.586134] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1465client # [ 0.551731] clocksource: Switched to clocksource acpi_pm1466worker1 # [ 0.587108] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1467client # [ 0.552924] NET: Registered PF_INET protocol family1468worker1 # [ 0.588240] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1469client # [ 0.554337] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1470worker1 # [ 0.589366] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1471worker2 # [ 0.553458] VFS: Disk quotas dquot_6.6.01472worker1 # [ 0.590468] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1473worker2 # [ 0.554427] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1474worker1 # [ 0.592207] ACPI: \_SB_.GSIA: Enabled at IRQ 161475worker2 # [ 0.556123] pnp: PnP ACPI init1476worker2 # [ 0.557206] ACPI: IRQ 4 override to edge(!), high(!)1477worker1 # [ 0.594875] ACPI: \_SB_.GSIB: Enabled at IRQ 171478worker2 # [ 0.558404] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1479worker1 # [ 0.596815] ACPI: \_SB_.GSIC: Enabled at IRQ 181480worker2 # [ 0.560273] pnp: PnP ACPI: found 6 devices1481worker1 # [ 0.598754] ACPI: \_SB_.GSID: Enabled at IRQ 191482worker1 # [ 0.600990] PCI: CLS 0 bytes, default 641483worker1 # [ 0.601849] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1484worker1 # [ 0.603692] Trying to unpack rootfs image as initramfs...1485worker2 # [ 0.568651] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1486worker2 # [ 0.570401] clocksource: Switched to clocksource acpi_pm1487worker2 # [ 0.571550] NET: Registered PF_INET protocol family1488worker2 # [ 0.572955] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1489client # [ 0.575844] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1490client # [ 0.577928] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1491client # [ 0.579495] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1492lb # [ 0.558657] pci 0000:00:01.0: vgaarb: setting as boot VGA device1493lb # [ 0.558944] pci 0000:00:01.0: vgaarb: bridge control possible1494client # [ 0.581056] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1495client # [ 0.582521] TCP: Hash tables configured (established 16384 bind 16384)1496lb # [ 0.558944] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1497lb # [ 0.558960] vgaarb: loaded1498client # [ 0.584005] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1499lb # [ 0.559793] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01500lb # [ 0.560635] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1501client # [ 0.585594] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1502client # [ 0.587010] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1503client # [ 0.588480] NET: Registered PF_UNIX/PF_LOCAL protocol family1504client # [ 0.589657] NET: Registered PF_XDP protocol family1505lb # [ 0.564089] clocksource: Switched to clocksource kvm-clock1506client # [ 0.590712] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1507client # [ 0.591885] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1508client # [ 0.593129] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1509lb # [ 0.568128] VFS: Disk quotas dquot_6.6.01510client # [ 0.594411] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1511lb # [ 0.568920] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1512client # [ 0.595768] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1513lb # [ 0.570465] pnp: PnP ACPI init1514client # [ 0.597087] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1515lb # [ 0.571441] ACPI: IRQ 4 override to edge(!), high(!)1516worker2 # [ 0.594815] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1517client # [ 0.599419] ACPI: \_SB_.GSIA: Enabled at IRQ 161518lb # [ 0.572695] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1519worker2 # [ 0.596630] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1520lb # [ 0.574988] pnp: PnP ACPI: found 6 devices1521worker2 # [ 0.598178] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1522worker2 # [ 0.599878] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1523client # [ 0.602672] ACPI: \_SB_.GSIB: Enabled at IRQ 171524worker2 # [ 0.601393] TCP: Hash tables configured (established 16384 bind 16384)1525client # [ 0.605455] ACPI: \_SB_.GSIC: Enabled at IRQ 181526worker2 # [ 0.602842] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1527worker2 # [ 0.604322] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1528client # [ 0.608383] ACPI: \_SB_.GSID: Enabled at IRQ 191529worker2 # [ 0.605677] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1530lb # [ 0.582794] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1531worker2 # [ 0.607146] NET: Registered PF_UNIX/PF_LOCAL protocol family1532lb # [ 0.584210] clocksource: Switched to clocksource acpi_pm1533client # [ 0.610544] PCI: CLS 0 bytes, default 641534worker2 # [ 0.608385] NET: Registered PF_XDP protocol family1535lb # [ 0.585198] NET: Registered PF_INET protocol family1536worker2 # [ 0.609356] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1537client # [ 0.611749] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1538lb # [ 0.586450] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1539worker2 # [ 0.610596] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1540client # [ 0.613833] Trying to unpack rootfs image as initramfs...1541worker2 # [ 0.611824] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1542worker1 # [ 0.649460] Initialise system trusted keyrings1543worker2 # [ 0.613144] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1544worker1 # [ 0.650416] workingset: timestamp_bits=40 max_order=19 bucket_order=01545worker2 # [ 0.614489] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1546worker2 # [ 0.615872] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1547worker2 # [ 0.618017] ACPI: \_SB_.GSIA: Enabled at IRQ 161548worker2 # [ 0.621043] ACPI: \_SB_.GSIB: Enabled at IRQ 171549worker2 # [ 0.623764] ACPI: \_SB_.GSIC: Enabled at IRQ 181550worker2 # [ 0.626297] ACPI: \_SB_.GSID: Enabled at IRQ 191551lb # [ 0.604272] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1552worker2 # [ 0.628463] PCI: CLS 0 bytes, default 641553lb # [ 0.605708] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1554worker2 # [ 0.629580] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1555lb # [ 0.607023] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1556lb # [ 0.608374] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1557worker2 # [ 0.632107] Trying to unpack rootfs image as initramfs...1558lb # [ 0.609589] TCP: Hash tables configured (established 16384 bind 16384)1559lb # [ 0.610715] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1560lb # [ 0.612007] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1561lb # [ 0.613049] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1562worker1 # [ 0.673982] Key type asymmetric registered1563worker1 # [ 0.674755] Asymmetric key parser 'x509' registered1564lb # [ 0.614331] NET: Registered PF_UNIX/PF_LOCAL protocol family1565lb # [ 0.615279] NET: Registered PF_XDP protocol family1566worker1 # [ 0.675644] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1567lb # [ 0.616119] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1568lb # [ 0.617088] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1569lb # [ 0.618051] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1570worker1 # [ 0.679030] io scheduler mq-deadline registered1571worker1 # [ 0.679825] io scheduler kyber registered1572lb # [ 0.619164] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1573lb # [ 0.620273] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1574lb # [ 0.621375] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1575lb # [ 0.623162] ACPI: \_SB_.GSIA: Enabled at IRQ 161576worker1 # [ 0.684077] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1577lb # [ 0.625342] ACPI: \_SB_.GSIB: Enabled at IRQ 171578worker1 # [ 0.685392] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1579lb # [ 0.627574] ACPI: \_SB_.GSIC: Enabled at IRQ 181580lb # [ 0.629586] ACPI: \_SB_.GSID: Enabled at IRQ 191581worker1 # [ 0.690658] Linux agpgart interface v0.1031582worker1 # [ 0.691446] ACPI: bus type drm_connector registered1583lb # [ 0.631342] PCI: CLS 0 bytes, default 641584lb # [ 0.632244] Trying to unpack rootfs image as initramfs...1585worker1 # [ 0.694367] usbcore: registered new interface driver usbserial_generic1586worker1 # [ 0.695474] usbserial: USB Serial support registered for generic1587lb # [ 0.636781] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1588worker1 # [ 0.697922] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1589worker1 # [ 0.697922] Please enable it if your BIOS has the CPPC option.1590worker1 # [ 0.700154] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1591worker1 # [ 0.704052] drop_monitor: Initializing network drop monitor service1592worker1 # [ 0.705311] NET: Registered PF_INET6 protocol family1593client # [ 0.672132] Initialise system trusted keyrings1594worker1 # [ 0.709367] Segment Routing with IPv61595client # [ 0.676191] workingset: timestamp_bits=40 max_order=19 bucket_order=01596worker1 # [ 0.711932] In-situ OAM (IOAM) with IPv61597worker1 # [ 0.713007] IPI shorthand broadcast: enabled1598worker1 # [ 0.721322] sched_clock: Marking stable (584014778, 136880676)->(795917261, -75021807)1599worker2 # [ 0.686059] Initialise system trusted keyrings1600worker1 # [ 0.726124] registered taskstats version 11601worker2 # [ 0.689684] workingset: timestamp_bits=40 max_order=19 bucket_order=01602worker1 # [ 0.727113] Loading compiled-in X.509 certificates1603client # [ 0.698988] Key type asymmetric registered1604client # [ 0.699755] Asymmetric key parser 'x509' registered1605lb # [ 0.679441] Initialise system trusted keyrings1606client # [ 0.705010] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1607client # [ 0.706750] io scheduler mq-deadline registered1608client # [ 0.707585] io scheduler kyber registered1609lb # [ 0.683731] workingset: timestamp_bits=40 max_order=19 bucket_order=01610worker1 # [ 0.744908] Demotion targets for Node 0: null1611client # [ 0.711958] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1612worker2 # [ 0.710999] Key type asymmetric registered1613worker1 # [ 0.747945] Key type .fscrypt registered1614client # [ 0.713418] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1615worker1 # [ 0.748659] Key type fscrypt-provisioning registered1616worker1 # [ 0.749584] ima: No TPM chip found, activating TPM-bypass!1617worker2 # [ 0.713635] Asymmetric key parser 'x509' registered1618worker2 # [ 0.714488] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1619worker1 # [ 0.751915] ima: Allocated hash algorithm: sha11620worker1 # [ 0.752706] ima: No architecture policies found1621client # [ 0.718980] Linux agpgart interface v0.1031622client # [ 0.719772] ACPI: bus type drm_connector registered1623worker2 # [ 0.717783] io scheduler mq-deadline registered1624worker2 # [ 0.718538] io scheduler kyber registered1625worker1 # [ 0.756911] PM: Magic number: 10:31:7851626worker2 # [ 0.721302] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1627worker1 # [ 0.758527] RAS: Correctable Errors collector initialized.1628client # [ 0.724531] usbcore: registered new interface driver usbserial_generic1629worker2 # [ 0.722586] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1630client # [ 0.725634] usbserial: USB Serial support registered for generic1631client # [ 0.728931] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1632worker2 # [ 0.728052] Linux agpgart interface v0.1031633client # [ 0.728931] Please enable it if your BIOS has the CPPC option.1634worker2 # [ 0.728846] ACPI: bus type drm_connector registered1635client # [ 0.731196] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1636lb # [ 0.706420] Key type asymmetric registered1637worker1 # [ 0.767614] clk: Disabling unused clocks1638lb # [ 0.707258] Asymmetric key parser 'x509' registered1639worker2 # [ 0.732099] usbcore: registered new interface driver usbserial_generic1640client # [ 0.735205] drop_monitor: Initializing network drop monitor service1641worker1 # [ 0.769914] PM: genpd: Disabling unused power domains1642worker2 # [ 0.733140] usbserial: USB Serial support registered for generic1643client # [ 0.736462] NET: Registered PF_INET6 protocol family1644lb # [ 0.710187] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1645lb # [ 0.713186] io scheduler mq-deadline registered1646client # [ 0.739577] Segment Routing with IPv61647worker2 # [ 0.736631] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1648lb # [ 0.713979] io scheduler kyber registered1649worker2 # [ 0.736631] Please enable it if your BIOS has the CPPC option.1650worker2 # [ 0.738958] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1651client # [ 0.741953] In-situ OAM (IOAM) with IPv61652client # [ 0.743168] IPI shorthand broadcast: enabled1653worker2 # [ 0.741787] drop_monitor: Initializing network drop monitor service1654lb # [ 0.718318] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1655worker2 # [ 0.742946] NET: Registered PF_INET6 protocol family1656lb # [ 0.719643] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1657worker2 # [ 0.746072] Segment Routing with IPv61658worker2 # [ 0.748634] In-situ OAM (IOAM) with IPv61659lb # [ 0.724987] Linux agpgart interface v0.1031660lb # [ 0.725787] ACPI: bus type drm_connector registered1661worker2 # [ 0.749671] IPI shorthand broadcast: enabled1662client # [ 0.751698] sched_clock: Marking stable (617019221, 133890941)->(825833631, -74923469)1663lb # [ 0.730617] usbcore: registered new interface driver usbserial_generic1664client # [ 0.757217] registered taskstats version 11665lb # [ 0.731747] usbserial: USB Serial support registered for generic1666client # [ 0.758240] Loading compiled-in X.509 certificates1667worker2 # [ 0.758012] sched_clock: Marking stable (624013913, 133600482)->(834837456, -77223061)1668lb # [ 0.735136] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1669lb # [ 0.735136] Please enable it if your BIOS has the CPPC option.1670lb # [ 0.737419] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1671worker2 # [ 0.762898] registered taskstats version 11672worker2 # [ 0.763887] Loading compiled-in X.509 certificates1673lb # [ 0.741272] drop_monitor: Initializing network drop monitor service1674lb # [ 0.742510] NET: Registered PF_INET6 protocol family1675lb # [ 0.745629] Segment Routing with IPv61676lb # [ 0.748145] In-situ OAM (IOAM) with IPv61677lb # [ 0.749297] IPI shorthand broadcast: enabled1678client # [ 0.777511] Demotion targets for Node 0: null1679client # [ 0.780005] Key type .fscrypt registered1680client # [ 0.780702] Key type fscrypt-provisioning registered1681client # [ 0.781769] ima: No TPM chip found, activating TPM-bypass!1682worker2 # [ 0.781633] Demotion targets for Node 0: null1683lb # [ 0.757788] sched_clock: Marking stable (623013457, 134098025)->(836304968, -79193486)1684worker2 # [ 0.783670] Key type .fscrypt registered1685client # [ 0.785939] ima: Allocated hash algorithm: sha11686worker2 # [ 0.784304] Key type fscrypt-provisioning registered1687client # [ 0.786783] ima: No architecture policies found1688worker2 # [ 0.785257] ima: No TPM chip found, activating TPM-bypass!1689client # [ 0.788923] PM: Magic number: 10:31:7851690lb # [ 0.763208] registered taskstats version 11691lb # [ 0.764199] Loading compiled-in X.509 certificates1692worker2 # [ 0.789631] ima: Allocated hash algorithm: sha11693worker2 # [ 0.790548] ima: No architecture policies found1694client # [ 0.793141] RAS: Correctable Errors collector initialized.1695worker2 # [ 0.792627] PM: Magic number: 10:31:7851696worker2 # [ 0.794295] RAS: Correctable Errors collector initialized.1697client # [ 0.802542] clk: Disabling unused clocks1698client # [ 0.804946] PM: genpd: Disabling unused power domains1699worker2 # [ 0.803398] clk: Disabling unused clocks1700lb # [ 0.783134] Demotion targets for Node 0: null1701lb # [ 0.784085] Key type .fscrypt registered1702worker2 # [ 0.807641] PM: genpd: Disabling unused power domains1703lb # [ 0.787124] Key type fscrypt-provisioning registered1704lb # [ 0.788124] ima: No TPM chip found, activating TPM-bypass!1705lb # [ 0.789088] ima: Allocated hash algorithm: sha11706lb # [ 0.791159] ima: No architecture policies found1707lb # [ 0.792165] PM: Magic number: 10:31:7851708lb # [ 0.793909] RAS: Correctable Errors collector initialized.1709lb # [ 0.805007] clk: Disabling unused clocks1710lb # [ 0.807132] PM: genpd: Disabling unused power domains1711worker1 # [ 0.937777] Freeing initrd memory: 29092K1712worker1 # [ 0.941087] Freeing unused decrypted memory: 2028K1713worker1 # [ 0.943760] Freeing unused kernel image (initmem) memory: 3644K1714worker1 # [ 0.944847] Write protecting the kernel read-only data: 32768k1715worker1 # [ 0.946730] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker1 # [ 0.948315] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker1 # [ 1.002522] x86/mm: Checked W+X mappings: passed, no W+X pages found.1718worker1 # [ 1.003687] Run /init as init process1719worker1 # [ 1.015641] systemd[1]: Inserted module 'autofs4'1720worker2 # [ 0.988868] Freeing initrd memory: 29092K1721worker2 # [ 0.992154] Freeing unused decrypted memory: 2028K1722worker2 # [ 0.994878] Freeing unused kernel image (initmem) memory: 3644K1723worker1 # [ 1.032555] fuse: init (API version 7.45)1724worker2 # [ 0.995928] Write protecting the kernel read-only data: 32768k1725worker2 # [ 0.997837] Freeing unused kernel image (text/rodata gap) memory: 1208K1726client # [ 1.001619] Freeing initrd memory: 29096K1727worker2 # [ 0.999360] Freeing unused kernel image (rodata/data gap) memory: 752K1728worker1 # [ 1.038331] ACPI: \_SB_.GSIG: Enabled at IRQ 221729client # [ 1.005208] Freeing unused decrypted memory: 2028K1730worker1 # [ 1.040942] ACPI: \_SB_.GSIH: Enabled at IRQ 231731client # [ 1.008229] Freeing unused kernel image (initmem) memory: 3644K1732client # [ 1.009288] Write protecting the kernel read-only data: 32768k1733worker1 # [ 1.044259] ACPI: \_SB_.GSIE: Enabled at IRQ 201734client # [ 1.011300] Freeing unused kernel image (text/rodata gap) memory: 1208K1735worker1 # [ 1.046708] ACPI: \_SB_.GSIF: Enabled at IRQ 211736client # [ 1.012852] Freeing unused kernel image (rodata/data gap) memory: 752K1737lb # [ 0.998963] Freeing initrd memory: 29092K1738lb # [ 1.002236] Freeing unused decrypted memory: 2028K1739lb # [ 1.004962] Freeing unused kernel image (initmem) memory: 3644K1740lb # [ 1.006066] Write protecting the kernel read-only data: 32768k1741lb # [ 1.008025] Freeing unused kernel image (text/rodata gap) memory: 1208K1742lb # [ 1.009628] Freeing unused kernel image (rodata/data gap) memory: 752K1743worker1 # [ 1.076241] systemd[1]: Successfully made /usr/ read-only.1744worker2 # [ 1.050556] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745worker2 # [ 1.051649] Run /init as init process1746client # [ 1.064025] x86/mm: Checked W+X mappings: passed, no W+X pages found.1747worker2 # [ 1.062124] systemd[1]: Inserted module 'autofs4'1748client # [ 1.065106] Run /init as init process1749client # [ 1.076424] systemd[1]: Inserted module 'autofs4'1750worker2 # [ 1.078510] fuse: init (API version 7.45)1751worker2 # [ 1.084360] ACPI: \_SB_.GSIG: Enabled at IRQ 221752lb # [ 1.061313] x86/mm: Checked W+X mappings: passed, no W+X pages found.1753lb # [ 1.062423] Run /init as init process1754worker2 # [ 1.086978] ACPI: \_SB_.GSIH: Enabled at IRQ 231755client # [ 1.093579] fuse: init (API version 7.45)1756worker2 # [ 1.091653] ACPI: \_SB_.GSIE: Enabled at IRQ 201757worker2 # [ 1.094116] ACPI: \_SB_.GSIF: Enabled at IRQ 211758lb # [ 1.072984] systemd[1]: Inserted module 'autofs4'1759client # [ 1.099618] ACPI: \_SB_.GSIG: Enabled at IRQ 221760client # [ 1.102129] ACPI: \_SB_.GSIH: Enabled at IRQ 231761client # [ 1.105186] ACPI: \_SB_.GSIE: Enabled at IRQ 201762client # [ 1.107379] ACPI: \_SB_.GSIF: Enabled at IRQ 211763lb # [ 1.090281] fuse: init (API version 7.45)1764lb # [ 1.096487] ACPI: \_SB_.GSIG: Enabled at IRQ 221765lb # [ 1.099156] ACPI: \_SB_.GSIH: Enabled at IRQ 231766worker2 # [ 1.124452] systemd[1]: Successfully made /usr/ read-only.1767lb # [ 1.103635] ACPI: \_SB_.GSIE: Enabled at IRQ 201768lb # [ 1.105854] ACPI: \_SB_.GSIF: Enabled at IRQ 211769client # [ 1.134963] systemd[1]: Successfully made /usr/ read-only.1770lb # [ 1.135877] systemd[1]: Successfully made /usr/ read-only.1771worker1 # [ 1.411975] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker1 # [ 1.416758] systemd[1]: Detected virtualization kvm.1773worker1 # [ 1.417627] systemd[1]: Detected architecture x86-64.1774worker1 # [ 1.418457] systemd[1]: Running in initrd.1775worker1 # [ 1.419662] systemd[1]: Initializing machine ID from random generator.1776worker1 # [ 1.420875] systemd[1]: Hostname set to <worker1>.1777worker2 # [ 1.460681] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker2 # [ 1.470184] systemd[1]: Detected virtualization kvm.1779worker2 # [ 1.471889] systemd[1]: Detected architecture x86-64.1780worker2 # [ 1.473584] systemd[1]: Running in initrd.1781worker2 # [ 1.475715] systemd[1]: Initializing machine ID from random generator.1782worker2 # [ 1.477961] systemd[1]: Hostname set to <worker2>.1783client # [ 1.471609] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784client # [ 1.483617] systemd[1]: Detected virtualization kvm.1785client # [ 1.485770] systemd[1]: Detected architecture x86-64.1786client # [ 1.487948] systemd[1]: Running in initrd.1787client # [ 1.490567] systemd[1]: Initializing machine ID from random generator.1788client # [ 1.493489] systemd[1]: Hostname set to <client>.1789lb # [ 1.472150] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790lb # [ 1.481754] systemd[1]: Detected virtualization kvm.1791lb # [ 1.483596] systemd[1]: Detected architecture x86-64.1792lb # [ 1.485383] systemd[1]: Running in initrd.1793lb # [ 1.487477] systemd[1]: Initializing machine ID from random generator.1794lb # [ 1.489831] systemd[1]: Hostname set to <lb>.1795worker1 # [ 1.631020] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker1 # [ 1.684938] systemd[1]: Queued start job for default target Initrd Default Target.1797worker1 # [ 1.688285] systemd[1]: Created slice Slice /system/modprobe.1798worker1 # [ 1.689544] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1799worker1 # [ 1.690988] systemd[1]: Expecting device /dev/disk/by-label/nixos...1800worker1 # [ 1.692139] systemd[1]: Reached target Path Units.1801worker1 # [ 1.693031] systemd[1]: Reached target Slice Units.1802worker1 # [ 1.693954] systemd[1]: Reached target Swaps.1803worker1 # [ 1.694756] systemd[1]: Reached target Timer Units.1804worker1 # [ 1.695799] systemd[1]: Listening on D-Bus System Message Bus Socket.1805worker1 # [ 1.697069] systemd[1]: Listening on Journal Socket (/dev/log).1806worker1 # [ 1.698285] systemd[1]: Listening on Journal Sockets.1807worker1 # [ 1.699321] systemd[1]: Listening on udev Control Socket.1808worker1 # [ 1.700402] systemd[1]: Listening on udev Kernel Socket.1809worker1 # [ 1.701371] systemd[1]: Reached target Socket Units.1810worker1 # [ 1.703275] systemd[1]: Starting Create List of Static Device Nodes...1811worker1 # [ 1.706976] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1812worker2 # [ 1.672924] systemd[1]: bpf-restrict-fs: LSM BPF program attached1813worker1 # [ 1.714972] systemd[1]: Starting Load Kernel Module configfs...1814worker1 # [ 1.729079] systemd[1]: Starting Journal Service...1815worker1 # [ 1.742222] systemd[1]: Starting Load Kernel Modules...1816worker2 # [ 1.711492] systemd[1]: Queued start job for default target Initrd Default Target.1817worker2 # [ 1.716017] systemd[1]: Created slice Slice /system/modprobe.1818worker2 # [ 1.717211] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1819worker2 # [ 1.718572] systemd[1]: Expecting device /dev/disk/by-label/nixos...1820worker2 # [ 1.719647] systemd[1]: Reached target Path Units.1821worker2 # [ 1.720455] systemd[1]: Reached target Slice Units.1822worker2 # [ 1.721293] systemd[1]: Reached target Swaps.1823worker2 # [ 1.722099] systemd[1]: Reached target Timer Units.1824client # [ 1.723542] systemd[1]: bpf-restrict-fs: LSM BPF program attached1825worker2 # [ 1.723081] systemd[1]: Listening on D-Bus System Message Bus Socket.1826worker2 # [ 1.724260] systemd[1]: Listening on Journal Socket (/dev/log).1827worker1 # [ 1.748976] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1828worker2 # [ 1.725412] systemd[1]: Listening on Journal Sockets.1829worker2 # [ 1.726374] systemd[1]: Listening on udev Control Socket.1830worker2 # [ 1.727337] systemd[1]: Listening on udev Kernel Socket.1831worker2 # [ 1.728317] systemd[1]: Reached target Socket Units.1832worker1 # [ 1.766828] netfs: FS-Cache loaded1833worker2 # [ 1.730111] systemd[1]: Starting Create List of Static Device Nodes...1834worker2 # [ 1.733685] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1835worker1 # [ 1.771561] 9pnet: Installing 9P2000 support1836lb # [ 1.709890] systemd[1]: bpf-restrict-fs: LSM BPF program attached1837worker2 # [ 1.739738] systemd[1]: Starting Load Kernel Module configfs...1838worker1 # [ 1.780155] systemd[1]: Starting Coldplug All udev Devices...1839worker2 # [ 1.752254] systemd[1]: Starting Journal Service...1840worker1 # [ 1.796074] systemd[1]: Finished Create List of Static Device Nodes.1841worker2 # [ 1.763683] systemd[1]: Starting Load Kernel Modules...1842worker1 # [ 1.801577] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1843client # [ 1.774425] systemd[1]: Queued start job for default target Initrd Default Target.1844worker1 # [ 1.810472] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1845client # [ 1.778341] systemd[1]: Created slice Slice /system/modprobe.1846client # [ 1.779511] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1847client # [ 1.780970] systemd[1]: Expecting device /dev/disk/by-label/nixos...1848worker1 # [ 1.815587] systemd[1]: modprobe@configfs.service: Deactivated successfully.1849client # [ 1.782076] systemd[1]: Reached target Path Units.1850client # [ 1.782961] systemd[1]: Reached target Slice Units.1851worker1 # [ 1.817688] systemd-journald[67]: Collecting audit messages is disabled.1852client # [ 1.783825] systemd[1]: Reached target Swaps.1853client # [ 1.784612] systemd[1]: Reached target Timer Units.1854worker2 # [ 1.770696] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1855client # [ 1.785620] systemd[1]: Listening on D-Bus System Message Bus Socket.1856client # [ 1.786977] systemd[1]: Listening on Journal Socket (/dev/log).1857client # [ 1.788189] systemd[1]: Listening on Journal Sockets.1858worker1 # [ 1.823390] systemd[1]: Finished Load Kernel Module configfs.1859client # [ 1.789232] systemd[1]: Listening on udev Control Socket.1860lb # [ 1.763435] systemd[1]: Queued start job for default target Initrd Default Target.1861client # [ 1.790257] systemd[1]: Listening on udev Kernel Socket.1862client # [ 1.791224] systemd[1]: Reached target Socket Units.1863worker2 # [ 1.790948] netfs: FS-Cache loaded1864client # [ 1.793105] systemd[1]: Starting Create List of Static Device Nodes...1865lb # [ 1.767415] systemd[1]: Created slice Slice /system/modprobe.1866lb # [ 1.768568] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1867worker1 # [ 1.829419] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1868lb # [ 1.769937] systemd[1]: Expecting device /dev/disk/by-label/nixos...1869lb # [ 1.770988] systemd[1]: Reached target Path Units.1870client # [ 1.796762] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1871worker2 # [ 1.795537] 9pnet: Installing 9P2000 support1872lb # [ 1.771824] systemd[1]: Reached target Slice Units.1873lb # [ 1.772669] systemd[1]: Reached target Swaps.1874lb # [ 1.773481] systemd[1]: Reached target Timer Units.1875lb # [ 1.774454] systemd[1]: Listening on D-Bus System Message Bus Socket.1876worker1 # [ 1.834406] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1877lb # [ 1.775637] systemd[1]: Listening on Journal Socket (/dev/log).1878lb # [ 1.776793] systemd[1]: Listening on Journal Sockets.1879lb # [ 1.777774] systemd[1]: Listening on udev Control Socket.1880client # [ 1.803659] systemd[1]: Starting Load Kernel Module configfs...1881lb # [ 1.778788] systemd[1]: Listening on udev Kernel Socket.1882worker2 # [ 1.803320] systemd[1]: Starting Coldplug All udev Devices...1883lb # [ 1.779807] systemd[1]: Reached target Socket Units.1884lb # [ 1.781615] systemd[1]: Starting Create List of Static Device Nodes...1885worker1 # [ 1.842162] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1886worker1 # [ 1.844934] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1887lb # [ 1.786181] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1888client # [ 1.819146] systemd[1]: Starting Journal Service...1889lb # [ 1.794320] systemd[1]: Starting Load Kernel Module configfs...1890worker2 # [ 1.818711] systemd[1]: Finished Create List of Static Device Nodes.1891worker2 # [ 1.823332] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1892client # [ 1.832824] systemd[1]: Starting Load Kernel Modules...1893worker2 # [ 1.831105] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1894lb # [ 1.809187] systemd[1]: Starting Journal Service...1895worker2 # [ 1.836026] systemd[1]: modprobe@configfs.service: Deactivated successfully.1896worker2 # [ 1.838452] systemd-journald[67]: Collecting audit messages is disabled.1897worker2 # [ 1.842997] systemd[1]: Finished Load Kernel Module configfs.1898lb # [ 1.821188] systemd[1]: Starting Load Kernel Modules...1899worker1 # [ 1.882067] systemd[1]: Finished Load Kernel Modules.1900worker2 # [ 1.847104] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1901client # [ 1.838993] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1902worker2 # [ 1.851059] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1903client # [ 1.856338] netfs: FS-Cache loaded1904worker1 # [ 1.891411] systemd[1]: Starting Apply Kernel Variables...1905worker2 # [ 1.855631] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1906client # [ 1.862791] 9pnet: Installing 9P2000 support1907worker2 # [ 1.860689] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1908lb # [ 1.828184] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1909lb # [ 1.844600] netfs: FS-Cache loaded1910worker1 # [ 1.909021] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1911client # [ 1.875155] systemd[1]: Starting Coldplug All udev Devices...1912lb # [ 1.849459] 9pnet: Installing 9P2000 support1913lb # [ 1.857892] systemd[1]: Starting Coldplug All udev Devices...1914worker1 # [ 1.921019] systemd[1]: Starting Create Static Device Nodes in /dev...1915client # [ 1.887446] systemd-journald[67]: Collecting audit messages is disabled.1916worker2 # [ 1.885489] systemd[1]: Finished Load Kernel Modules.1917client # [ 1.891037] systemd[1]: Finished Create List of Static Device Nodes.1918worker2 # [ 1.891819] systemd[1]: Starting Apply Kernel Variables...1919client # [ 1.896561] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1920lb # [ 1.871661] systemd[1]: Finished Create List of Static Device Nodes.1921lb # [ 1.878676] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1922client # [ 1.905341] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1923worker2 # [ 1.903721] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1924client # [ 1.911320] systemd[1]: modprobe@configfs.service: Deactivated successfully.1925lb # [ 1.886510] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1926worker1 # [ 1.810421] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.948554] systemd[1]: Started Journal Service.1927worker1 # 1928worker1 # [ 1.812634] systemd-modules-load[68]: Inserted module 'virtio_balloon'1929worker2 # [ 1.912805] systemd[1]: Starting Create Static Device Nodes in /dev...1930worker1 # [ 1.814424] systemd-modules-load[68]: Inserted module 'virtio_gpu'1931lb # [ 1.891555] systemd[1]: modprobe@configfs.service: Deactivated successfully.1932client # [ 1.919350] systemd[1]: Finished Load Kernel Module configfs.1933lb # [ 1.894643] systemd-journald[67]: Collecting audit messages is disabled.1934client # [ 1.923352] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1935worker1 # [ 1.822073] systemd[1]: Finished Apply Kernel Variables.1936lb # [ 1.900461] systemd[1]: Finished Load Kernel Module configfs.1937client # [ 1.927430] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1938lb # [ 1.905566] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1939worker2 # [ 1.931340] systemd[1]: Finished Apply Kernel Variables.1940client # [ 1.934941] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1941lb # [ 1.908373] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1942client # [ 1.936592] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1943worker1 # [ 1.838301] systemd[1]: Finished Create Static Device Nodes in /dev.1944worker1 # [ 1.840080] systemd[1]: Reached target Preparation for Local File Systems.1945lb # [ 1.916278] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1946worker1 # [ 1.841190] systemd[1]: Reached target Local File Systems.1947worker1 # [ 1.843958] systemd[1]: Starting Create System Files and Directories...1948lb # [ 1.920184] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1949worker2 # [ 1.947144] systemd[1]: Finished Create Static Device Nodes in /dev.1950worker2 # [ 1.950850] systemd[1]: Reached target Preparation for Local File Systems.1951worker2 # [ 1.954680] systemd[1]: Reached target Local File Systems.1952worker1 # [ 1.855084] systemd[1]: Starting Rule-based Manager for Device Events and Files...1953worker2 # [ 1.822175] systemd-modules-load[68]: Inserted module 'dm_mod'1954worker2 # [ 1.823373] systemd-modules-load[68]: Inserted module 'virtio_balloon'1955worker2 # [ 1.825261] systemd-modules-load[68]: Inserted module 'virtio_gpu'1956worker2 # [ 1.962812] systemd[1]: Starting Rule-based Manager for Device Events and Files...1957client # [ 1.967973] systemd[1]: Finished Load Kernel Modules.1958worker2 # [ 1.968753] systemd[1]: Started Journal Service.1959lb # [ 1.947143] systemd[1]: Finished Load Kernel Modules.1960client # [ 1.976139] systemd[1]: Starting Apply Kernel Variables...1961lb # [ 1.956309] systemd[1]: Starting Apply Kernel Variables...1962client # [ 1.986065] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1963worker2 # [ 1.852265] systemd[1]: Starting Create System Files and Directories...1964worker1 # [ 1.887037] systemd[1]: Finished Create System Files and Directories.1965lb # [ 1.966687] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1966client # [ 1.995991] systemd[1]: Starting Create Static Device Nodes in /dev...1967lb # [ 1.976318] systemd[1]: Starting Create Static Device Nodes in /dev...1968worker1 # [ 1.910500] systemd-udevd[83]: Using default interface naming scheme 'v261'.1969worker2 # [ 1.877436] systemd[1]: Finished Create System Files and Directories.1970client # [ 1.881236] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.016462] systemd[1]: Finished Apply Kernel Variables.1971client # 1972client # [ 1.883579] systemd-modules-load[68]: Inserted module 'virtio_balloon'1973client # [ 1.887354] systemd-modules-load[68]: Inserted module 'virtio_gpu'1974lb # [ 1.995209] systemd[1]: Finished Apply Kernel Variables.1975client # [ 2.023125] systemd[1]: Started Journal Service.1976worker2 # [ 1.888245] systemd-udevd[75]: Using default interface naming scheme 'v261'.1977lb # [ 2.009629] systemd[1]: Finished Create Static Device Nodes in /dev.1978client # [ 1.903150] systemd[1]: Finished Create Static Device Nodes in /dev.1979worker1 # [ 1.935120] systemd[1]: Started Rule-based Manager for Device Events and Files.1980client # [ 1.904172] systemd[1]: Reached target Preparation for Local File Systems.1981lb # [ 2.013445] systemd[1]: Started Journal Service.1982client # [ 1.906143] systemd[1]: Reached target Local File Systems.1983lb # [ 1.878861] systemd-modules-load[68]: Inserted module 'dm_mod'1984lb # [ 1.881218] systemd-modules-load[68]: Inserted module 'virtio_balloon'1985lb # [ 1.882463] systemd-modules-load[68]: Inserted module 'virtio_gpu'1986client # [ 1.910088] systemd[1]: Starting Create System Files and Directories...1987lb # [ 1.886274] systemd[1]: Reached target Preparation for Local File Systems.1988lb # [ 1.887562] systemd[1]: Reached target Local File Systems.1989client # [ 1.915149] systemd[1]: Starting Rule-based Manager for Device Events and Files...1990worker2 # [ 1.914072] systemd[1]: Started Rule-based Manager for Device Events and Files.1991lb # [ 1.892078] systemd[1]: Starting Create System Files and Directories...1992lb # [ 1.896076] systemd[1]: Starting Rule-based Manager for Device Events and Files...1993worker1 # [ 1.970191] systemd[1]: Finished Coldplug All udev Devices.1994worker1 # [ 1.971475] systemd[1]: Reached target System Initialization.1995worker1 # [ 1.973468] systemd[1]: Reached target Basic System.1996client # [ 1.944455] systemd[1]: Finished Create System Files and Directories.1997lb # [ 1.926559] systemd[1]: Finished Create System Files and Directories.1998client # [ 1.969466] systemd-udevd[83]: Using default interface naming scheme 'v261'.1999worker2 # [ 1.969695] systemd[1]: Finished Coldplug All udev Devices.2000worker2 # [ 1.970662] systemd[1]: Reached target System Initialization.

loading 1,859 hidden lines…

3860worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3861worker2: waiting for unit network-addresses-eth1.service3862worker2: waiting for the VM to finish booting3863worker2: Guest shell says: b'Spawning backdoor root shell...\n'3864worker2: connected to guest root shell3865worker2: (connecting took 0.00 seconds)3866client # [ 11.058297] dhcpcd[568]: DUID 00:01:00:01:32:42:91:db:52:54:00:12:34:563867worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3868client # [ 11.059448] dhcpcd[568]: eth0: IAID 00:12:34:563869client # [ 11.060377] dhcpcd[568]: eth0: adding address fe80::5054:ff:fe12:34563870worker1 # [ 11.232196] 8021q: adding VLAN 0 to HW filter on device eth03871worker1 # [ 11.096778] dhcpcd[692]: eth0: waiting for carrier3872worker1 # [ 11.097573] dhcpcd[692]: eth0: carrier acquired3873worker1 # [ 11.106984] dhcpcd[692]: DUID 00:01:00:01:32:42:91:dc:52:54:00:12:34:563874worker1 # [ 11.108051] dhcpcd[692]: eth0: IAID 00:12:34:563875worker1 # [ 11.108710] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:34563876client # [ 11.087835] systemd[1]: Finished Extra networking commands..3877client # [ 11.089945] systemd[1]: Reached target Network.3878client # [ 11.093364] systemd[1]: Starting Permit User Sessions...3879client # [ 11.123543] systemd[1]: Finished Permit User Sessions.3880client # [ 11.127577] systemd[1]: Started Getty on tty1.3881client # [ 11.128577] systemd[1]: Reached target Login Prompts.3882worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3883worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3884lb # [ 11.126646] postgresql-pre-start[733]: selecting default "max_connections" ... 1003885worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3886lb: waiting for unit niks3.service3887lb # [ 11.302470] kvm_amd: TSC scaling supported3888lb # [ 11.302974] kvm_amd: Nested Virtualization enabled3889lb # [ 11.304484] kvm_amd: Nested Paging enabled3890lb # [ 11.305539] kvm_amd: LBR virtualization supported3891lb # [ 11.307124] kvm_amd: Virtual VMLOAD VMSAVE supported3892lb # [ 11.307723] kvm_amd: Virtual GIF supported3893lb # [ 11.308791] kvm_amd: Virtual NMI enabled3894lb # [ 11.433673] EDAC MC: Ver: 3.0.03895lb # [ 11.329767] postgresql-pre-start[733]: selecting default "shared_buffers" ... 128MB3896lb # [ 11.437565] systemd-vconsole-setup[760]: Configuration of first virtual console was skipped, ignoring remaining ones.3897lb # [ 11.443064] systemd[1]: Finished Virtual Console Setup.3898lb # [ 11.516194] dhcpcd[710]: eth0: soliciting a DHCP lease3899lb # [ 11.665348] NET: Registered PF_PACKET protocol family3900lb # [ 11.536460] dhcpcd[710]: eth0: offered 10.0.2.15 from 10.0.2.23901lb # [ 11.539132] dhcpcd[710]: eth0: probing address 10.0.2.15/243902client # [ 11.727329] dhcpcd[568]: eth0: soliciting a DHCP lease3903client # [ 11.888924] NET: Registered PF_PACKET protocol family3904client # [ 11.762191] dhcpcd[568]: eth0: offered 10.0.2.15 from 10.0.2.23905client # [ 11.765428] dhcpcd[568]: eth0: probing address 10.0.2.15/243906worker2 # [ 12.502125] dhcpcd[690]: eth0: soliciting an IPv6 router3907worker2 # [ 12.503379] dhcpcd[690]: eth0: Router Advertisement from fe80::23908worker2 # [ 12.504203] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/643909worker2 # [ 12.505054] dhcpcd[690]: eth0: adding route to fec0::/643910worker2 # [ 12.505745] dhcpcd[690]: eth0: adding default route via fe80::23911worker1 # [ 12.675618] dhcpcd[692]: eth0: soliciting a DHCP lease3912worker1 # [ 12.829504] NET: Registered PF_PACKET protocol family3913worker1 # [ 12.696496] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.23914worker1 # [ 12.699153] dhcpcd[692]: eth0: probing address 10.0.2.15/243915client # [ 12.682683] dhcpcd[568]: eth0: soliciting an IPv6 router3916client # [ 12.685638] dhcpcd[568]: eth0: Router Advertisement from fe80::23917client # [ 12.687822] dhcpcd[568]: eth0: adding address fec0::5054:ff:fe12:3456/643918client # [ 12.689980] dhcpcd[568]: eth0: adding route to fec0::/643919client # [ 12.691899] dhcpcd[568]: eth0: adding default route via fe80::23920lb # [ 12.777227] dhcpcd[710]: eth0: soliciting an IPv6 router3921lb # [ 12.778972] dhcpcd[710]: eth0: Router Advertisement from fe80::23922lb # [ 12.780171] dhcpcd[710]: eth0: adding address fec0::5054:ff:fe12:3456/643923lb # [ 12.781513] dhcpcd[710]: eth0: adding route to fec0::/643924lb # [ 12.782411] dhcpcd[710]: eth0: adding default route via fe80::23925lb # [ 13.131661] postgresql-pre-start[733]: selecting default time zone ... UTC3926lb # [ 13.135494] postgresql-pre-start[733]: creating configuration files ... ok3927worker1 # [ 13.383354] dhcpcd[692]: eth0: soliciting an IPv6 router3928worker1 # [ 13.384802] dhcpcd[692]: eth0: Router Advertisement from fe80::23929worker1 # [ 13.385604] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643930worker1 # [ 13.386542] dhcpcd[692]: eth0: adding route to fec0::/643931worker1 # [ 13.387341] dhcpcd[692]: eth0: adding default route via fe80::23932lb # [ 13.371350] postgresql-pre-start[733]: running bootstrap script ... ok3933lb # [ 13.930424] postgresql-pre-start[733]: performing post-bootstrap initialization ... ok3934lb # [ 14.062903] postgresql-pre-start[733]: syncing data to disk ... ok3935lb # [ 14.063835] postgresql-pre-start[733]: initdb: warning: enabling "trust" authentication for local connections3936lb # [ 14.064985] postgresql-pre-start[733]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3937lb # [ 14.066792] postgresql-pre-start[733]: Success. You can now start the database server using:3938lb # [ 14.067791] postgresql-pre-start[733]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3939lb # [ 14.172464] postgres[811]: [811] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3940lb # [ 14.177243] postgres[811]: [811] LOG: listening on IPv6 address "::1", port 54323941lb # [ 14.178265] postgres[811]: [811] LOG: listening on IPv4 address "127.0.0.1", port 54323942lb # [ 14.181662] postgres[811]: [811] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3943lb # [ 14.194192] postgres[820]: [820] LOG: database system was shut down at 2026-09-20 12:45:19 GMT3944lb # [ 14.198593] postgres[811]: [811] LOG: database system is ready to accept connections3945lb # [ 14.204475] systemd[1]: Started PostgreSQL Server.3946lb # [ 14.209746] systemd[1]: Starting PostgreSQL Setup Scripts...3947lb # [ 14.394072] postgresql-setup-start[836]: CREATE DATABASE3948lb # [ 14.436746] postgresql-setup-start[841]: CREATE ROLE3949lb # [ 14.461273] postgresql-setup-start[843]: ALTER DATABASE3950lb # [ 14.466216] systemd[1]: Finished PostgreSQL Setup Scripts.3951lb # [ 14.469149] systemd[1]: Reached target PostgreSQL.3952worker2 # [ 15.613890] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds3953worker2 # [ 15.617314] dhcpcd[690]: eth0: adding route to 10.0.2.0/243954worker2 # [ 15.619424] dhcpcd[690]: eth0: adding default route via 10.0.2.23955worker2 # [ 15.734612] systemd[1]: Started DHCP Client.3956worker2 # [ 15.736116] systemd[1]: Reached target Multi-User System.3957worker2 # [ 15.736865] systemd[1]: Startup finished in 921ms (kernel) + 3.984s (initrd) + 10.829s (userspace) = 15.735s.3958lb # [ 16.763509] dhcpcd[710]: eth0: leased 10.0.2.15 for 86400 seconds3959lb # [ 16.765002] dhcpcd[710]: eth0: adding route to 10.0.2.0/243960lb # [ 16.765966] dhcpcd[710]: eth0: adding default route via 10.0.2.23961lb # [ 16.871831] systemd[1]: Started DHCP Client.3962lb # [ 16.874242] systemd[1]: Reached target Network is Online.3963lb # [ 16.878216] systemd[1]: Started Envoy reverse proxy.3964lb # [ 16.881403] systemd[1]: Started mock-oidc.service.3965lb # [ 16.967373] mock-oidc-server[929]: Mock OIDC Server running3966lb # [ 16.968389] mock-oidc-server[929]: OIDC Address: 192.168.1.2:80803967lb # [ 16.969821] mock-oidc-server[929]: Issue Address: 0.0.0.0:80813968lb # [ 16.970908] mock-oidc-server[929]: Issuer: http://192.168.1.2:8080/oidc3969lb # [ 16.971932] mock-oidc-server[929]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3970lb # [ 16.973137] mock-oidc-server[929]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3971lb # [ 16.974569] mock-oidc-server[929]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3972client # [ 17.230964] dhcpcd[568]: eth0: leased 10.0.2.15 for 86400 seconds3973client # [ 17.232737] dhcpcd[568]: eth0: adding route to 10.0.2.0/243974client # [ 17.233969] dhcpcd[568]: eth0: adding default route via 10.0.2.23975client # [ 17.323982] systemd[1]: Started DHCP Client.3976client # [ 17.326291] systemd[1]: Reached target Multi-User System.3977client # [ 17.327428] systemd[1]: Startup finished in 935ms (kernel) + 3.993s (initrd) + 12.398s (userspace) = 17.327s.3978worker1 # [ 17.437446] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3979worker1 # [ 17.439181] dhcpcd[692]: eth0: adding route to 10.0.2.0/243980worker1 # [ 17.440290] dhcpcd[692]: eth0: adding default route via 10.0.2.23981lb # [ 17.387755] envoy[928]: [2026-09-20 12:45:22.494][928][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3982lb # [ 17.389838] envoy[928]: [2026-09-20 12:45:22.497][928][info][main] [source/server/server.cc:469] statically linked extensions:3983lb # [ 17.391432] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3984lb # [ 17.393970] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3985lb # [ 17.396468] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3986lb # [ 17.399159] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3987lb # [ 17.402372] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3988lb # [ 17.403939] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3989lb # [ 17.405802] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23990lb # [ 17.407324] envoy[928]: [2026-09-20 12:45:22.498][928][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3991lb # [ 17.408813] envoy[928]: [2026-09-20 12:45:22.499][928][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3992lb # [ 17.411080] envoy[928]: [2026-09-20 12:45:22.499][928][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3993lb # [ 17.413305] envoy[928]: [2026-09-20 12:45:22.499][928][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3994lb # [ 17.415177] envoy[928]: [2026-09-20 12:45:22.499][928][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3995lb # [ 17.417105] envoy[928]: [2026-09-20 12:45:22.499][928][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3996lb # [ 17.436741] envoy[928]: [2026-09-20 12:45:22.499][928][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3997lb # [ 17.438511] envoy[928]: [2026-09-20 12:45:22.501][928][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3998lb # [ 17.440120] envoy[928]: [2026-09-20 12:45:22.501][928][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3999lb # [ 17.441855] envoy[928]: [2026-09-20 12:45:22.501][928][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4000lb # [ 17.447959] envoy[928]: [2026-09-20 12:45:22.501][928][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4001lb # [ 17.449767] envoy[928]: [2026-09-20 12:45:22.501][928][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4002lb # [ 17.452300] envoy[928]: [2026-09-20 12:45:22.501][928][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4003lb # [ 17.454161] envoy[928]: [2026-09-20 12:45:22.501][928][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4004lb # [ 17.456411] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4005lb # [ 17.458408] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4006lb # [ 17.460694] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4007lb # [ 17.464712] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4008lb # [ 17.466435] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4009worker1 # [ 17.525666] systemd[1]: Started DHCP Client.4010worker1 # [ 17.527342] systemd[1]: Reached target Multi-User System.4011lb # [ 17.468247] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4012worker1 # [ 17.528164] systemd[1]: Startup finished in 870ms (kernel) + 4.958s (initrd) + 11.697s (userspace) = 17.526s.4013lb # [ 17.470727] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4014lb # [ 17.472402] envoy[928]: [2026-09-20 12:45:22.504][928][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4015lb # [ 17.474174] envoy[928]: [2026-09-20 12:45:22.506][928][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4016lb # [ 17.477951] envoy[928]: [2026-09-20 12:45:22.506][928][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4017lb # [ 17.479761] envoy[928]: [2026-09-20 12:45:22.506][928][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4018lb # [ 17.482837] envoy[928]: [2026-09-20 12:45:22.506][928][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4019lb # [ 17.484543] envoy[928]: [2026-09-20 12:45:22.506][928][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4020lb # [ 17.486749] envoy[928]: [2026-09-20 12:45:22.506][928][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4021lb # [ 17.489285] envoy[928]: [2026-09-20 12:45:22.506][928][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4022lb # [ 17.492123] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4023lb # [ 17.495103] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4024lb # [ 17.499253] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4025lb # [ 17.502362] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4026lb # [ 17.504689] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4027lb # [ 17.506670] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4028lb # [ 17.509623] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4029lb # [ 17.511286] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4030lb # [ 17.513119] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4031lb # [ 17.519551] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4032lb # [ 17.521972] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4033lb # [ 17.529323] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4034lb # [ 17.531827] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4035lb # [ 17.536409] envoy[928]: [2026-09-20 12:45:22.509][928][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4036lb # [ 17.538692] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4037lb # [ 17.541263] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4038lb # [ 17.546164] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4039lb # [ 17.548187] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4040lb # [ 17.549909] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4041lb # [ 17.551846] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4042lb # [ 17.553887] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4043lb # [ 17.557041] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4044lb # [ 17.559942] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4045lb # [ 17.561922] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4046lb # [ 17.568121] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4047lb # [ 17.570059] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4048lb # [ 17.574063] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4049lb # [ 17.576077] envoy[928]: [2026-09-20 12:45:22.510][928][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4050lb # [ 17.578916] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4051lb # [ 17.585275] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4052lb # [ 17.587606] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4053lb # [ 17.589496] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4054lb # [ 17.593780] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4055lb # [ 17.595486] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4056lb # [ 17.597667] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4057lb # [ 17.600061] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4058lb # [ 17.601578] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4059lb # [ 17.603293] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4060lb # [ 17.605636] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4061lb # [ 17.611106] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84062lb # [ 17.612782] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4063lb # [ 17.616059] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4064lb # [ 17.642072] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4065lb # [ 17.644608] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4066lb # [ 17.647108] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4067lb # [ 17.658421] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24068lb # [ 17.660157] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4069lb # [ 17.661856] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4070lb # [ 17.663963] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4071lb # [ 17.666342] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4072lb # [ 17.668671] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14073lb # [ 17.670805] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4074lb # [ 17.672546] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4075lb # [ 17.674549] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4076lb # [ 17.677162] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4077lb # [ 17.680368] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4078lb # [ 17.684995] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24079lb # [ 17.687548] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4080lb # [ 17.689906] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4081lb # [ 17.691865] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4082lb # [ 17.693823] envoy[928]: [2026-09-20 12:45:22.513][928][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4083lb # [ 17.696287] envoy[928]: [2026-09-20 12:45:22.524][928][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4084lb # [ 17.699958] envoy[928]: [2026-09-20 12:45:22.524][928][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4085lb # [ 17.704481] envoy[928]: [2026-09-20 12:45:22.524][928][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4086lb # [ 17.707226] envoy[928]: [2026-09-20 12:45:22.524][928][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4087lb # [ 17.712772] envoy[928]: [2026-09-20 12:45:22.524][928][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4088lb # [ 17.714393] envoy[928]: [2026-09-20 12:45:22.524][928][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4089lb # [ 17.716713] envoy[928]: [2026-09-20 12:45:22.533][928][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4090lb # [ 17.718678] envoy[928]: [2026-09-20 12:45:22.646][928][info][main] [source/server/server.cc:531] HTTP header map info:4091lb # [ 17.720171] envoy[928]: [2026-09-20 12:45:22.697][928][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4092lb # [ 17.733430] envoy[928]: [2026-09-20 12:45:22.697][928][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4093lb # [ 17.734963] envoy[928]: [2026-09-20 12:45:22.697][928][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4094lb # [ 17.742588] envoy[928]: [2026-09-20 12:45:22.697][928][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4095lb # [ 17.787895] envoy[928]: [2026-09-20 12:45:22.895][928][info][main] [source/server/server.cc:968] runtime: {}4096lb # [ 17.794293] envoy[928]: [2026-09-20 12:45:22.901][928][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4097lb # [ 17.796391] envoy[928]: [2026-09-20 12:45:22.904][928][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014098lb # [ 17.799109] envoy[928]: [2026-09-20 12:45:22.906][928][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014099lb # [ 17.801804] envoy[928]: [2026-09-20 12:45:22.909][928][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4100lb # [ 17.803535] envoy[928]: [2026-09-20 12:45:22.909][928][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4101lb # [ 17.805342] envoy[928]: [2026-09-20 12:45:22.909][928][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4102lb # [ 17.856863] envoy[928]: [2026-09-20 12:45:22.964][928][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4103worker2 # [ 17.883657] systemd[1]: Reached target Network is Online.4104worker1 # [ 17.919896] systemd[1]: Starting Nix worker-protocol over gRPC...4105worker2 # [ 17.891802] systemd[1]: Starting scheduler-token.service...4106lb # [ 17.876647] envoy[928]: [2026-09-20 12:45:22.984][928][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4107lb # [ 17.878979] envoy[928]: [2026-09-20 12:45:22.986][928][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4108lb # [ 17.882302] envoy[928]: [2026-09-20 12:45:22.986][928][info][main] [source/server/server.cc:1077] starting main dispatch loop4109worker2 # [ 17.987685] systemd[1]: scheduler-token.service: Deactivated successfully.4110worker2 # [ 17.989290] systemd[1]: Finished scheduler-token.service.4111worker2 # [ 17.990539] systemd[1]: scheduler-token.service: Consumed 28ms CPU time over 97ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4112worker2 # [ 17.996036] systemd[1]: Starting Nix worker-protocol over gRPC...4113worker1 # [ 18.150339] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4114worker1 # [ 18.159154] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4115worker1 # [ 18.164478] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14116worker2 # [ 18.150353] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4117worker2 # [ 18.158817] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4118worker2 # [ 18.166275] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14119worker1 # [ 18.204388] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4120worker1 # [ 18.207797] systemd[1]: Started Nix worker-protocol over gRPC.4121worker2 # [ 18.204159] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4122worker2 # [ 18.207961] systemd[1]: Started Nix worker-protocol over gRPC.4123worker1 # [ 18.239811] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4124lb # [ 18.204866] envoy[928]: [2026-09-20 12:45:23.312][928][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4125lb # [ 18.209445] envoy[928]: [2026-09-20 12:45:23.316][928][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4126lb # [ 18.213995] envoy[928]: [2026-09-20 12:45:23.316][928][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4127lb # [ 18.220092] envoy[928]: [2026-09-20 12:45:23.321][928][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4128worker2 # [ 18.276172] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_connected addr=lb:500514129worker2 # [ 18.286959] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4130worker1 # [ 18.443641] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4131worker2 # [ 18.489506] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_connected addr=lb:500514132worker2 # [ 18.493308] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4133worker2 # [ 18.693817] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 18.695735] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4135worker1 # [ 18.844268] nix-grpc-daemon[785]: ts=2026-09-20T12:45:23Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4136worker2 # [ 18.896994] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 18.900766] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4138worker2 # [ 19.101861] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_connected addr=lb:500514139worker2 # [ 19.106601] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4140worker2 # [ 19.308962] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 19.312769] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4142worker2 # [ 19.510148] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_connected addr=lb:500514143worker2 # [ 19.511807] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4144worker1 # [ 19.648829] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 19.652300] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4146worker2 # [ 19.712495] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 19.714186] nix-grpc-daemon[785]: ts=2026-09-20T12:45:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4148worker1 # [ 19.854115] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 19.858795] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4150worker2 # [ 19.914734] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 19.916643] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4152worker1 # [ 20.059092] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 20.060824] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4154worker2 # [ 20.117490] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514155worker2 # [ 20.119472] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4156worker1 # [ 20.261499] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 20.265529] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4158worker2 # [ 20.321990] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 20.325258] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4160worker1 # [ 20.466525] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 20.470608] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4162worker2 # [ 20.523153] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 20.527091] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4164worker1 # [ 20.673543] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 20.674850] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4166worker2 # [ 20.727962] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 20.730041] nix-grpc-daemon[785]: ts=2026-09-20T12:45:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4168worker1 # [ 20.874035] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 20.875866] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4170worker2 # [ 20.930961] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 20.932693] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4172worker1 # [ 21.076409] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 21.078893] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4174worker2 # [ 21.133975] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 21.137863] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4176worker1 # [ 21.279695] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 21.284233] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4178worker2 # [ 21.338838] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 21.340616] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4180worker1 # [ 21.484573] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514181worker1 # [ 21.486471] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4182worker2 # [ 21.541940] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514183worker2 # [ 21.545064] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4184worker1 # [ 21.688823] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 21.692183] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4186worker2 # [ 21.746287] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 21.750127] nix-grpc-daemon[785]: ts=2026-09-20T12:45:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4188worker1 # [ 21.889438] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 21.893313] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4190worker2 # [ 21.950719] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 21.952899] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4192worker1 # [ 22.093652] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 22.095359] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4194worker2 # [ 22.153630] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 22.156902] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4196worker1 # [ 22.295708] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 22.297442] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4198worker2 # [ 22.357533] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 22.360059] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4200worker1 # [ 22.497869] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 22.499626] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4202worker2 # [ 22.560942] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 22.563047] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4204worker1 # [ 22.701572] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 22.704918] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4206worker2 # [ 22.763644] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 22.765435] nix-grpc-daemon[785]: ts=2026-09-20T12:45:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4208worker1 # [ 22.905391] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 22.907270] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4210worker2 # [ 22.966212] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514211worker2 # [ 22.968676] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4212worker1 # [ 23.107614] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 23.109411] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4214lb # [ 23.143656] rustfs-bucket-start[991]: mb s3://farm4215worker2 # [ 23.169836] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514216worker2 # [ 23.171682] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4217lb # [ 23.149937] systemd[1]: Finished rustfs-bucket.service.4218lb # [ 23.156946] systemd[1]: Starting niks3 server...4219worker1 # [ 23.310295] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514220worker1 # [ 23.313976] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4221worker2 # [ 23.374478] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514222worker2 # [ 23.377716] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4223lb # [ 23.398859] postgres[1009]: [1009] ERROR: relation "goose_db_version" does not exist at character 364224lb # [ 23.400147] postgres[1009]: [1009] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4225lb # [ 23.431322] niks3-server[999]: 2026/09/20 12:45:28 OK 20241026095416_initial_model.sql (15.15ms)4226lb # [ 23.434510] niks3-server[999]: 2026/09/20 12:45:28 OK 20251210153512_drop_unused_gin_index.sql (3.5ms)4227lb # [ 23.439189] niks3-server[999]: 2026/09/20 12:45:28 OK 20251218171726_add_pins.sql (4.75ms)4228lb # [ 23.444192] niks3-server[999]: 2026/09/20 12:45:28 OK 20260628120000_add_object_size_and_stats.sql (3.81ms)4229lb # [ 23.448569] niks3-server[999]: 2026/09/20 12:45:28 OK 20260905000000_add_claims.sql (2.94ms)4230lb # [ 23.452767] niks3-server[999]: 2026/09/20 12:45:28 OK 20260920000000_drop_claims.sql (4.06ms)4231worker1 # [ 23.511480] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514232lb # [ 23.453960] niks3-server[999]: 2026/09/20 12:45:28 goose: successfully migrated database to version: 202609200000004233worker1 # [ 23.513681] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4234lb # [ 23.459732] niks3-server[999]: 2026/09/20 12:45:28 OK 1_commit_pending_closure.sql (6.92ms)4235lb # [ 23.462252] niks3-server[999]: 2026/09/20 12:45:28 OK 2_object_stats_trigger.sql (2.54ms)4236lb # [ 23.463499] niks3-server[999]: 2026/09/20 12:45:28 goose: up to current file version: 24237lb # [ 23.470267] niks3-server[999]: 2026/09/20 12:45:28 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4238lb # [ 23.545717] niks3-server[999]: 2026/09/20 12:45:28 INFO Read proxy enabled — serving cache objects from S34239lb # [ 23.547711] niks3-server[999]: 2026/09/20 12:45:28 INFO Using socket-activated listener address=0.0.0.0:57514240worker2 # [ 23.575157] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 23.577039] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4242lb # [ 23.554477] niks3-server[999]: 2026/09/20 12:45:28 INFO systemd watchdog enabled interval=15s4243lb # [ 23.555628] systemd[1]: Started niks3 server.4244lb # [ 23.556292] systemd[1]: Reached target Multi-User System.4245lb # [ 23.558543] systemd[1]: Startup finished in 931ms (kernel) + 4.950s (initrd) + 17.676s (userspace) = 23.558s.4246lb # [ 23.560243] niks3-server[999]: 2026/09/20 12:45:28 INFO Starting HTTP server address=0.0.0.0:57514247lb # [ 23.565817] niks3-server[999]: 2026/09/20 12:45:28 INFO lead: acquired remote=192.168.1.4:454064248worker2 # [ 23.595435] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_take_over4249worker1 # [ 23.715302] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 23.716807] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4251worker2 # [ 23.779433] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_connected addr=lb:500514252worker2 # [ 23.782658] nix-grpc-daemon[785]: ts=2026-09-20T12:45:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4253worker1 # [ 23.915908] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_connected addr=lb:500514254worker1 # [ 23.917599] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4255worker2 # [ 23.980839] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_connected addr=lb:500514256worker2 # [ 23.984827] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4257worker1 # [ 24.118492] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 24.121655] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4259worker2 # [ 24.185517] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_connected addr=lb:500514260worker2 # [ 24.187476] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4261lb: (finished: waiting for unit niks3.service, in 13.11 seconds)4262lb: waiting for TCP port 5751 on localhost4263worker1 # [ 24.322445] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_connected addr=lb:500514264worker2 # [ 24.296967] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:422944265worker2 # [ 24.299485] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04266lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4267lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4268lb: waiting for unit envoy.service4269lb: (finished: waiting for unit envoy.service, in 0.04 seconds)4270lb: waiting for TCP port 50051 on localhost4271worker2 # [ 24.388859] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=scheduler_connected addr=lb:500514272worker2 # [ 24.409281] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=oidc_jwks provider=mock keys=14273worker2 # [ 24.411199] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:422944274lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4275worker2 # [ 24.412987] nix-grpc-daemon[785]: ts=2026-09-20T12:45:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04276lb # [ 24.390763] envoy[928]: conn peer=[::1]:36922 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24277lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4278worker2 # [ 24.514420] systemd[1]: Starting scheduler-token.service...4279worker2 # [ 24.582912] systemd[1]: scheduler-token.service: Deactivated successfully.4280worker2 # [ 24.584081] systemd[1]: Finished scheduler-token.service.4281worker2 # [ 24.585281] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 68ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4282lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4283lb: must succeed: curl -sf localhost:9901/clusters4284lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4285lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)4286subtest: one node schedules and both builders hold a WorkerSession on it4287lb: must succeed: curl -sf localhost:9901/clusters4288lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4289worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4290worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4291lb: must succeed: curl -sf localhost:9901/clusters4292lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4293lb: must succeed: curl -sf localhost:9901/clusters4294lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4295lb: must succeed: curl -sf localhost:9901/clusters4296lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4297lb: must succeed: curl -sf localhost:9901/clusters4298lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4299worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'4300worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.03 seconds)4301worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4302worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4303lb: must succeed: curl -sf localhost:9901/clusters4304lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4305lb: must succeed: curl -sf localhost:9901/clusters4306lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4307worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4308worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4309worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4310worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4311worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4312worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4313worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4314worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4315(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.55 seconds)4316subtest: balancer auth: client cert, bearer token, nothing, unknown CN4317worker1 # [ 25.549810] nix-grpc-daemon[785]: ts=2026-09-20T12:45:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476744318worker1 # [ 25.556302] systemd[1]: Started Nix Daemon.4319worker1 # [ 25.758359] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4320worker1 # [ 25.806795] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5)4321worker1 # [ 25.860426] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 2/5)4322worker1 # [ 26.045072] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 3/5)4323worker1 # [ 26.050151] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 706 ms (attempt 4/5)4324worker1 # [ 26.762118] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4325worker1 # [ 26.779638] nix-grpc-daemon[785]: ts=2026-09-20T12:45:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:476744326worker1 # [ 26.787798] nix-grpc-daemon[785]: ts=2026-09-20T12:45:31Z level=debug event=path_info_miss path=9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test error="error: path '/nix/store/9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test' is required, but there is no substituter that can build it"4327worker1 # [ 26.791727] nix-grpc-daemon[785]: ts=2026-09-20T12:45:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:476744328worker1 # [ 26.795354] nix-grpc-daemon[785]: ts=2026-09-20T12:45:31Z level=debug event=path_info_miss path=9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test error="error: path '/nix/store/9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test' is required, but there is no substituter that can build it"4329client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4330client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4331client: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4332client: (finished: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4333worker2 # [ 27.133064] nix-grpc-daemon[785]: ts=2026-09-20T12:45:32Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:423084334worker2 # [ 27.139653] systemd[1]: Started Nix Daemon.4335worker2 # [ 27.357317] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4336worker2 # [ 27.387116] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 1/5)4337worker2 # [ 27.395452] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 2/5)4338worker2 # [ 27.405792] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 257 ms (attempt 3/5)4339worker2 # [ 27.665793] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 667 ms (attempt 4/5)4340lb # [ 27.866165] envoy[928]: conn peer=[2001:db8:1::1]:38396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=363 ms=12934341worker2 # [ 28.342704] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4342worker1 # [ 28.405953] nix-grpc-daemon[785]: ts=2026-09-20T12:45:33Z level=info event=oidc_jwks provider=mock keys=14343worker1 # [ 28.409839] nix-grpc-daemon[785]: ts=2026-09-20T12:45:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:476744344worker1 # [ 28.415841] nix-grpc-daemon[785]: ts=2026-09-20T12:45:33Z level=debug event=path_info_miss path=9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test error="error: path '/nix/store/9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test' is required, but there is no substituter that can build it"4345worker1 # [ 28.424997] nix-grpc-daemon[785]: ts=2026-09-20T12:45:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:476744346worker1 # [ 28.432902] nix-grpc-daemon[785]: ts=2026-09-20T12:45:33Z level=debug event=path_info_miss path=9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test error="error: path '/nix/store/9vmky0q27b7yfkzkxd8jb0a7wnp9fi02-nixos-system-client-test' is required, but there is no substituter that can build it"4347client: must succeed: rm -r /var/lib/nix-grpc-store4348client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)4349worker1 # [ 28.693115] nix-grpc-daemon[785]: ts=2026-09-20T12:45:33Z level=info event=denied method=QueryMissing cn=- role=none4350worker1 # [ 28.921760] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=info event=denied method=QueryMissing cn=stranger role=none4351(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.70 seconds)4352subtest: DAG build is scheduled across workers and lands in the cache4353client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24354worker1 # [ 29.186657] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476744355client # don't know how to build these paths:4356client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4357worker2 # [ 29.164790] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423084358worker2 # [ 29.190176] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04359worker2 # [ 29.192206] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14360worker1 # [ 29.279453] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744361worker1 # [ 29.301719] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744362client # copying 1 paths to 'lb:50051'...4363worker1 # [ 29.316419] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476744364client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4365worker1 # [ 29.345696] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4366worker1 # [ 29.373300] nix-grpc-daemon[785]: ts=2026-09-20T12:45:34Z level=info event=niks3_push_started pid=8544367worker1 # [ 29.639325] nix-grpc-daemon[854]: time=2026-09-20T12:45:34.782Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""4368worker1 # [ 29.813722] nix-daemon[844]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4369worker1 # [ 29.828396] nix-daemon[844]: reaped child process 870, status = succeeded4370worker1 # [ 29.954524] nix-daemon[844]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4371worker1 # [ 29.966676] nix-daemon[844]: reaped child process 875, status = succeeded4372lb # [ 29.917749] niks3-server[999]: 2026/09/20 12:45:35 INFO Received uploads request method=POST path=/api/pending_closures4373worker1 # [ 29.991085] nix-grpc-daemon[854]: time=2026-09-20T12:45:35.137Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4374worker1 # [ 29.993210] nix-grpc-daemon[854]: time=2026-09-20T12:45:35.139Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4375lb # [ 29.963569] niks3-server[999]: 2026/09/20 12:45:35 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4376lb # [ 29.966478] niks3-server[999]: 2026/09/20 12:45:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4377lb # [ 29.973300] niks3-server[999]: 2026/09/20 12:45:35 INFO Signed narinfos id=1 count=14378worker1 # [ 30.033133] nix-grpc-daemon[854]: time=2026-09-20T12:45:35.179Z level=INFO msg="Uploading 1 narinfos"4379lb # [ 29.990562] niks3-server[999]: 2026/09/20 12:45:35 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4380lb # [ 29.993237] niks3-server[999]: 2026/09/20 12:45:35 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4381lb # [ 29.997715] niks3-server[999]: 2026/09/20 12:45:35 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4382lb # [ 30.002817] niks3-server[999]: 2026/09/20 12:45:35 INFO Completed upload id=14383worker1 # [ 30.060638] nix-grpc-daemon[854]: time=2026-09-20T12:45:35.207Z level=INFO msg="Upload complete. (411ms)"4384worker1 # [ 30.064181] nix-grpc-daemon[785]: ts=2026-09-20T12:45:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=5044385worker1 # [ 30.068880] nix-daemon[844]: reaped child process 852, status = succeeded4386worker1 # [ 30.070418] nix-grpc-daemon[785]: ts=2026-09-20T12:45:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744387worker1 # [ 30.074247] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4388client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4389client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4390worker1 # [ 30.082062] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4391client # farm-a> LOG-farm-a-t14392worker1 # [ 31.111529] nix-daemon[844]: reaped child process 879, status = succeeded4393worker1 # [ 31.273376] nix-daemon[844]: accepted connection from pid 895, user nix-grpc-daemon (trusted)4394worker1 # [ 31.287985] nix-daemon[844]: reaped child process 898, status = succeeded4395lb # [ 31.237991] niks3-server[999]: 2026/09/20 12:45:36 INFO Received uploads request method=POST path=/api/pending_closures4396worker1 # [ 31.301896] nix-grpc-daemon[854]: time=2026-09-20T12:45:36.448Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4397worker1 # [ 31.303554] nix-grpc-daemon[854]: time=2026-09-20T12:45:36.448Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4398lb # [ 31.266320] niks3-server[999]: 2026/09/20 12:45:36 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4399lb # [ 31.273080] niks3-server[999]: 2026/09/20 12:45:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4400lb # [ 31.278090] niks3-server[999]: 2026/09/20 12:45:36 INFO Signed narinfos id=2 count=14401worker1 # [ 31.336231] nix-grpc-daemon[854]: time=2026-09-20T12:45:36.482Z level=INFO msg="Uploading 1 narinfos"4402lb # [ 31.279304] niks3-server[999]: 2026/09/20 12:45:36 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4403lb # [ 31.290910] niks3-server[999]: 2026/09/20 12:45:36 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4404lb # [ 31.294452] niks3-server[999]: 2026/09/20 12:45:36 INFO Completed upload id=24405worker1 # [ 31.352282] nix-grpc-daemon[854]: time=2026-09-20T12:45:36.498Z level=INFO msg="Upload complete. (260ms)"4406lb # [ 31.297472] niks3-server[999]: 2026/09/20 12:45:36 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4407worker1 # [ 31.355704] nix-grpc-daemon[785]: ts=2026-09-20T12:45:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14408lb # [ 31.303773] niks3-server[999]: 2026/09/20 12:45:36 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4409worker1 # [ 31.362516] nix-daemon[844]: reaped child process 877, status = succeeded4410worker2 # [ 31.334379] nix-grpc-daemon[785]: ts=2026-09-20T12:45:36Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04411worker2 # [ 31.336150] nix-grpc-daemon[785]: ts=2026-09-20T12:45:36Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14412worker1 # [ 31.418268] nix-grpc-daemon[785]: ts=2026-09-20T12:45:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744413worker1 # [ 31.432466] nix-grpc-daemon[785]: ts=2026-09-20T12:45:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744414worker1 # [ 31.446284] nix-grpc-daemon[854]: time=2026-09-20T12:45:36.592Z level=INFO msg="All 1 paths already cached"4415client # copying 1 paths to 'lb:50051'...4416worker1 # [ 31.454827] nix-grpc-daemon[785]: ts=2026-09-20T12:45:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476744417client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4418worker1 # [ 31.476495] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4419worker1 # [ 31.659846] nix-daemon[844]: accepted connection from pid 902, user nix-grpc-daemon (trusted)4420worker1 # [ 31.674127] nix-daemon[844]: reaped child process 905, status = succeeded4421worker1 # [ 31.839608] nix-daemon[844]: accepted connection from pid 907, user nix-grpc-daemon (trusted)4422worker1 # [ 31.853245] nix-daemon[844]: reaped child process 910, status = succeeded4423lb # [ 31.807162] niks3-server[999]: 2026/09/20 12:45:36 INFO Received uploads request method=POST path=/api/pending_closures4424worker1 # [ 31.882813] nix-grpc-daemon[854]: time=2026-09-20T12:45:37.029Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4425worker1 # [ 31.884580] nix-grpc-daemon[854]: time=2026-09-20T12:45:37.031Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4426lb # [ 31.849685] niks3-server[999]: 2026/09/20 12:45:36 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4427lb # [ 31.857404] niks3-server[999]: 2026/09/20 12:45:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4428lb # [ 31.862248] niks3-server[999]: 2026/09/20 12:45:36 INFO Signed narinfos id=3 count=14429worker1 # [ 31.922885] nix-grpc-daemon[854]: time=2026-09-20T12:45:37.069Z level=INFO msg="Uploading 1 narinfos"4430lb # [ 31.871253] niks3-server[999]: 2026/09/20 12:45:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4431lb # [ 31.879557] niks3-server[999]: 2026/09/20 12:45:36 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4432lb # [ 31.892412] niks3-server[999]: 2026/09/20 12:45:36 INFO Completed upload id=34433worker1 # [ 31.950366] nix-grpc-daemon[854]: time=2026-09-20T12:45:37.096Z level=INFO msg="Upload complete. (456ms)"4434lb # [ 31.894258] niks3-server[999]: 2026/09/20 12:45:37 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4435worker1 # [ 31.952944] nix-grpc-daemon[785]: ts=2026-09-20T12:45:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=6244436worker1 # [ 31.956287] nix-grpc-daemon[785]: ts=2026-09-20T12:45:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744437worker1 # [ 31.963332] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4438worker1 # [ 31.966377] nix-daemon[844]: reaped child process 900, status = succeeded4439client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4440worker1 # [ 31.972026] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4441client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4442client # farm-b> LOG-farm-b-t14443worker1 # [ 32.794905] nix-daemon[844]: reaped child process 914, status = succeeded4444worker1 # [ 32.932188] nix-daemon[844]: accepted connection from pid 929, user nix-grpc-daemon (trusted)4445worker1 # [ 32.943905] nix-daemon[844]: reaped child process 932, status = succeeded4446lb # [ 32.901708] niks3-server[999]: 2026/09/20 12:45:38 INFO Received uploads request method=POST path=/api/pending_closures4447worker1 # [ 32.971075] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.117Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4448worker1 # [ 32.973255] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.119Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4449lb # [ 32.947435] niks3-server[999]: 2026/09/20 12:45:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4450lb # [ 32.953629] niks3-server[999]: 2026/09/20 12:45:38 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4451worker1 # [ 33.016792] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.163Z level=INFO msg="Uploading 1 narinfos"4452lb # [ 32.959136] niks3-server[999]: 2026/09/20 12:45:38 INFO Signed narinfos id=4 count=14453lb # [ 32.961657] niks3-server[999]: 2026/09/20 12:45:38 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4454lb # [ 32.971248] niks3-server[999]: 2026/09/20 12:45:38 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4455lb # [ 32.978682] niks3-server[999]: 2026/09/20 12:45:38 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4456lb # [ 32.984587] niks3-server[999]: 2026/09/20 12:45:38 INFO Completed upload id=44457worker1 # [ 33.042500] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.188Z level=INFO msg="Upload complete. (264ms)"4458lb # [ 32.986409] niks3-server[999]: 2026/09/20 12:45:38 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4459worker1 # [ 33.049694] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14460worker2 # [ 33.022844] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04461worker1 # [ 33.062645] nix-daemon[844]: reaped child process 912, status = succeeded4462worker2 # [ 33.027356] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14463worker1 # [ 33.100683] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744464worker1 # [ 33.113773] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744465worker1 # [ 33.126644] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.273Z level=INFO msg="All 2 paths already cached"4466client # copying 1 paths to 'lb:50051'...4467client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4468worker1 # [ 33.135110] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476744469worker1 # [ 33.149163] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4470worker1 # [ 33.282167] nix-daemon[844]: accepted connection from pid 936, user nix-grpc-daemon (trusted)4471worker1 # [ 33.294356] nix-daemon[844]: reaped child process 939, status = succeeded4472worker1 # [ 33.429818] nix-daemon[844]: accepted connection from pid 941, user nix-grpc-daemon (trusted)4473worker1 # [ 33.462616] nix-daemon[844]: reaped child process 944, status = succeeded4474lb # [ 33.409090] niks3-server[999]: 2026/09/20 12:45:38 INFO Received uploads request method=POST path=/api/pending_closures4475worker1 # [ 33.474696] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.621Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4476worker1 # [ 33.476744] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.622Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4477lb # [ 33.435948] niks3-server[999]: 2026/09/20 12:45:38 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4478lb # [ 33.446121] niks3-server[999]: 2026/09/20 12:45:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4479lb # [ 33.450781] niks3-server[999]: 2026/09/20 12:45:38 INFO Signed narinfos id=5 count=14480worker1 # [ 33.511700] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.658Z level=INFO msg="Uploading 1 narinfos"4481lb # [ 33.455982] niks3-server[999]: 2026/09/20 12:45:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4482lb # [ 33.466905] niks3-server[999]: 2026/09/20 12:45:38 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4483lb # [ 33.469754] niks3-server[999]: 2026/09/20 12:45:38 INFO Completed upload id=54484worker1 # [ 33.527557] nix-grpc-daemon[854]: time=2026-09-20T12:45:38.674Z level=INFO msg="Upload complete. (366ms)"4485lb # [ 33.472173] niks3-server[999]: 2026/09/20 12:45:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4486worker1 # [ 33.529451] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=7524487worker1 # [ 33.532471] nix-grpc-daemon[785]: ts=2026-09-20T12:45:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744488worker1 # [ 33.538066] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4489worker1 # [ 33.542362] nix-daemon[844]: reaped child process 934, status = succeeded4490worker1 # [ 33.547632] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4491client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4492client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4493client # farm-top> LOG-farm-top-t14494worker1 # [ 34.161419] nix-daemon[844]: reaped child process 949, status = succeeded4495worker1 # [ 34.291100] nix-daemon[844]: accepted connection from pid 964, user nix-grpc-daemon (trusted)4496worker1 # [ 34.302820] nix-daemon[844]: reaped child process 967, status = succeeded4497lb # [ 34.257867] niks3-server[999]: 2026/09/20 12:45:39 INFO Received uploads request method=POST path=/api/pending_closures4498worker1 # [ 34.326896] nix-grpc-daemon[854]: time=2026-09-20T12:45:39.473Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4499worker1 # [ 34.328860] nix-grpc-daemon[854]: time=2026-09-20T12:45:39.474Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4500lb # [ 34.305222] niks3-server[999]: 2026/09/20 12:45:39 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4501lb # [ 34.310535] niks3-server[999]: 2026/09/20 12:45:39 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4502lb # [ 34.318528] niks3-server[999]: 2026/09/20 12:45:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4503worker1 # [ 34.381482] nix-grpc-daemon[854]: time=2026-09-20T12:45:39.527Z level=INFO msg="Uploading 1 narinfos"4504lb # [ 34.323710] niks3-server[999]: 2026/09/20 12:45:39 INFO Signed narinfos id=6 count=14505lb # [ 34.329094] niks3-server[999]: 2026/09/20 12:45:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4506lb # [ 34.336820] niks3-server[999]: 2026/09/20 12:45:39 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4507lb # [ 34.339678] niks3-server[999]: 2026/09/20 12:45:39 INFO Completed upload id=64508worker1 # [ 34.397663] nix-grpc-daemon[854]: time=2026-09-20T12:45:39.544Z level=INFO msg="Upload complete. (243ms)"4509lb # [ 34.342021] niks3-server[999]: 2026/09/20 12:45:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4510worker1 # [ 34.404533] nix-grpc-daemon[785]: ts=2026-09-20T12:45:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14511worker1 # [ 34.416581] nix-daemon[844]: reaped child process 947, status = succeeded4512client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 5.49 seconds)4513client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4514client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds)4515client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4516client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4517client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4518client # copying 3 paths...4519client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4520client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4521client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4522client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.43 seconds)4523(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.22 seconds)4524subtest: repeat is answered Cached by the scheduler without building4525worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4526worker1 # finding garbage collector roots...4527worker1 # deleting specified paths...4528worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4529worker1 # deleting unused links...4530worker1 # note: hard linking is currently saving 0.0 KiB4531worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.22 seconds)4532worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4533worker2 # finding garbage collector roots...4534worker2 # deleting specified paths...4535worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4536worker2 # deleting unused links...4537worker2 # note: hard linking is currently saving 0.0 KiB4538worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4539client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24540worker2 # [ 35.804379] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423084541client # don't know how to build these paths:4542client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4543worker2 # [ 35.812726] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423084544worker2 # [ 35.833445] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14545client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.23 seconds)4546client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4547client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds)4548lb: must succeed: curl -sf localhost:9901/clusters4549lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4550lb: must succeed: curl -sf localhost:9901/clusters4551lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4552worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4553worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4554(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.10 seconds)4555subtest: inputs already in the cache are not sent to the scheduler4556lb: must succeed: curl -sf localhost:9901/clusters4557lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4558lb: must succeed: curl -sf localhost:9901/clusters4559lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4560worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4561worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4562client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24563worker2 # [ 36.548597] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423084564client # don't know how to build these paths:4565client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4566worker1 # [ 36.591857] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744567worker1 # [ 36.607074] nix-grpc-daemon[854]: time=2026-09-20T12:45:41.752Z level=INFO msg="All 2 paths already cached"4568worker2 # [ 36.581272] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04569worker2 # [ 36.585678] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14570worker1 # [ 36.658782] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744571worker1 # [ 36.666646] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744572worker1 # [ 36.683920] nix-grpc-daemon[854]: time=2026-09-20T12:45:41.830Z level=INFO msg="All 2 paths already cached"4573client # copying 1 paths to 'lb:50051'...4574client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4575worker1 # [ 36.688933] nix-grpc-daemon[785]: ts=2026-09-20T12:45:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476744576worker1 # [ 36.694895] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4577worker1 # [ 36.846086] nix-daemon[844]: accepted connection from pid 985, user nix-grpc-daemon (trusted)4578worker1 # [ 36.859723] nix-daemon[844]: reaped child process 988, status = succeeded4579worker1 # [ 37.014377] nix-daemon[844]: accepted connection from pid 990, user nix-grpc-daemon (trusted)4580worker1 # [ 37.027486] nix-daemon[844]: reaped child process 993, status = succeeded4581lb # [ 36.980212] niks3-server[999]: 2026/09/20 12:45:42 INFO Received uploads request method=POST path=/api/pending_closures4582worker1 # [ 37.043346] nix-grpc-daemon[854]: time=2026-09-20T12:45:42.189Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4583worker1 # [ 37.044813] nix-grpc-daemon[854]: time=2026-09-20T12:45:42.191Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4584lb # [ 37.000862] niks3-server[999]: 2026/09/20 12:45:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4585worker1 # [ 37.060579] nix-grpc-daemon[854]: time=2026-09-20T12:45:42.207Z level=INFO msg="Uploading 1 narinfos"4586lb # [ 37.003201] niks3-server[999]: 2026/09/20 12:45:42 INFO Signed narinfos id=7 count=14587lb # [ 37.006572] niks3-server[999]: 2026/09/20 12:45:42 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4588lb # [ 37.008710] niks3-server[999]: 2026/09/20 12:45:42 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4589lb # [ 37.013789] niks3-server[999]: 2026/09/20 12:45:42 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4590lb # [ 37.016995] niks3-server[999]: 2026/09/20 12:45:42 INFO Completed upload id=74591worker1 # [ 37.075870] nix-grpc-daemon[854]: time=2026-09-20T12:45:42.222Z level=INFO msg="Upload complete. (375ms)"4592lb # [ 37.019410] niks3-server[999]: 2026/09/20 12:45:42 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4593worker1 # [ 37.078180] nix-grpc-daemon[785]: ts=2026-09-20T12:45:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=7524594worker1 # [ 37.081600] nix-grpc-daemon[785]: ts=2026-09-20T12:45:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744595worker1 # [ 37.088163] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4596worker1 # [ 37.090790] nix-daemon[844]: reaped child process 983, status = succeeded4597worker1 # [ 37.095913] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4598client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4599client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4600worker1 # [ 37.908616] nix-daemon[844]: reaped child process 997, status = succeeded4601lb # [ 37.867183] envoy[928]: conn peer=[2001:db8:1::1]:38404 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=12834602lb # [ 37.871105] envoy[928]: conn peer=[2001:db8:1::1]:38416 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=84603lb # [ 37.875179] envoy[928]: conn peer=[2001:db8:1::1]:38428 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=94604lb # [ 37.879145] envoy[928]: conn peer=[2001:db8:1::1]:38434 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=3841 ms=52904605client # farm-top> LOG-farm-top-t1b4606lb # [ 37.884165] envoy[928]: conn peer=[2001:db8:1::1]:53456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=474607worker1 # [ 38.038487] nix-daemon[844]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)4608worker1 # [ 38.052132] nix-daemon[844]: reaped child process 1015, status = succeeded4609lb # [ 38.003699] niks3-server[999]: 2026/09/20 12:45:43 INFO Received uploads request method=POST path=/api/pending_closures4610worker1 # [ 38.067286] nix-grpc-daemon[854]: time=2026-09-20T12:45:43.213Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4611worker1 # [ 38.068874] nix-grpc-daemon[854]: time=2026-09-20T12:45:43.215Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4612lb # [ 38.028336] niks3-server[999]: 2026/09/20 12:45:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4613lb # [ 38.031103] niks3-server[999]: 2026/09/20 12:45:43 INFO Signed narinfos id=8 count=14614worker1 # [ 38.090120] nix-grpc-daemon[854]: time=2026-09-20T12:45:43.236Z level=INFO msg="Uploading 1 narinfos"4615lb # [ 38.035324] niks3-server[999]: 2026/09/20 12:45:43 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4616lb # [ 38.038278] niks3-server[999]: 2026/09/20 12:45:43 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4617lb # [ 38.041891] niks3-server[999]: 2026/09/20 12:45:43 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4618lb # [ 38.046283] niks3-server[999]: 2026/09/20 12:45:43 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4619lb # [ 38.048739] niks3-server[999]: 2026/09/20 12:45:43 INFO Completed upload id=84620worker1 # [ 38.106496] nix-grpc-daemon[854]: time=2026-09-20T12:45:43.252Z level=INFO msg="Upload complete. (204ms)"4621lb # [ 38.051149] niks3-server[999]: 2026/09/20 12:45:43 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4622worker1 # [ 38.109193] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14623worker1 # [ 38.116531] nix-daemon[844]: reaped child process 995, status = succeeded4624client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.78 seconds)4625client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4626client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.16 seconds)4627lb: must succeed: curl -sf localhost:9901/clusters4628lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4629lb: must succeed: curl -sf localhost:9901/clusters4630lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4631worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4632worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds)4633(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.17 seconds)4634subtest: two clients wanting the same drv build it once4635client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4636client # [ 38.443530] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4637client # Running as unit: dedup1.service; invocation ID: a0c60c0767b34d499cb04d794c2fd7f64638client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.05 seconds)4639client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4640client # [ 38.653395] nix[889]: don't know how to build these paths:4641client # [ 38.654394] nix[889]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4642worker2 # [ 38.650764] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423084643worker2 # [ 38.662210] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04644worker2 # [ 38.669257] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14645worker2 # [ 38.675901] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423084646worker2 # [ 38.700650] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423084647client # [ 38.714132] nix[889]: copying 1 paths to 'lb:50051'...4648client # [ 38.716457] nix[889]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4649worker2 # [ 38.713576] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423084650worker2 # [ 38.726069] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4651worker2 # [ 38.747077] nix-grpc-daemon[785]: ts=2026-09-20T12:45:43Z level=info event=niks3_push_started pid=9154652worker2 # [ 39.029683] nix-grpc-daemon[915]: time=2026-09-20T12:45:44.226Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""4653worker2 # [ 39.238073] nix-daemon[865]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4654worker2 # [ 39.254456] nix-daemon[865]: reaped child process 931, status = succeeded4655worker2 # [ 39.406415] nix-daemon[865]: accepted connection from pid 933, user nix-grpc-daemon (trusted)4656worker2 # [ 39.425046] nix-daemon[865]: reaped child process 936, status = succeeded4657lb # [ 39.415834] niks3-server[999]: 2026/09/20 12:45:44 INFO Received uploads request method=POST path=/api/pending_closures4658worker2 # [ 39.446111] nix-grpc-daemon[915]: time=2026-09-20T12:45:44.646Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4659worker2 # [ 39.448454] nix-grpc-daemon[915]: time=2026-09-20T12:45:44.648Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4660lb # [ 39.442236] niks3-server[999]: 2026/09/20 12:45:44 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4661lb # [ 39.445548] niks3-server[999]: 2026/09/20 12:45:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4662lb # [ 39.447494] niks3-server[999]: 2026/09/20 12:45:44 INFO Signed narinfos id=9 count=14663worker2 # [ 39.473660] nix-grpc-daemon[915]: time=2026-09-20T12:45:44.673Z level=INFO msg="Uploading 1 narinfos"4664lb # [ 39.451889] niks3-server[999]: 2026/09/20 12:45:44 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4665lb # [ 39.457295] niks3-server[999]: 2026/09/20 12:45:44 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4666lb # [ 39.460028] niks3-server[999]: 2026/09/20 12:45:44 INFO Completed upload id=94667worker2 # [ 39.484362] nix-grpc-daemon[915]: time=2026-09-20T12:45:44.684Z level=INFO msg="Upload complete. (437ms)"4668lb # [ 39.462277] niks3-server[999]: 2026/09/20 12:45:44 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4669worker2 # [ 39.486679] nix-grpc-daemon[785]: ts=2026-09-20T12:45:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=1 nar_bytes_in=4324670worker2 # [ 39.492236] nix-grpc-daemon[785]: ts=2026-09-20T12:45:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423084671worker2 # [ 39.498462] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4672worker2 # [ 39.500953] nix-daemon[865]: reaped child process 913, status = succeeded4673worker2 # [ 39.506397] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4674client # [ 39.508356] nix[889]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4675client # [ 39.513311] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4676client # Running as unit: dedup2.service; invocation ID: d524113fe0334a05a9ccb3c38e78c4264677client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.07 seconds)4678worker1 # [ 39.769736] nix-grpc-daemon[785]: ts=2026-09-20T12:45:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476744679client # [ 39.743385] nix[906]: don't know how to build these paths:4680client # [ 39.744245] nix[906]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4681worker2 # [ 39.752480] nix-grpc-daemon[785]: ts=2026-09-20T12:45:44Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04682worker2 # [ 39.761663] nix-grpc-daemon[785]: ts=2026-09-20T12:45:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423084683client # [ 39.768699] nix[906]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4684client: must succeed: sleep 24685client: (finished: must succeed: sleep 2, in 2.05 seconds)4686client: waiting for success: ! systemctl is-active dedup1 dedup24687worker2 # [ 44.136484] nix-daemon[865]: reaped child process 940, status = succeeded4688worker2 # [ 44.307260] nix-daemon[865]: accepted connection from pid 976, user nix-grpc-daemon (trusted)4689worker2 # [ 44.320596] nix-daemon[865]: reaped child process 979, status = succeeded4690lb # [ 44.313412] niks3-server[999]: 2026/09/20 12:45:49 INFO Received uploads request method=POST path=/api/pending_closures4691worker2 # [ 44.346149] nix-grpc-daemon[915]: time=2026-09-20T12:45:49.546Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4692worker2 # [ 44.347794] nix-grpc-daemon[915]: time=2026-09-20T12:45:49.547Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4693lb # [ 44.361139] niks3-server[999]: 2026/09/20 12:45:49 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4694lb # [ 44.365082] niks3-server[999]: 2026/09/20 12:45:49 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4695lb # [ 44.380069] niks3-server[999]: 2026/09/20 12:45:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4696worker2 # [ 44.410932] nix-grpc-daemon[915]: time=2026-09-20T12:45:49.610Z level=INFO msg="Uploading 1 narinfos"4697lb # [ 44.386324] niks3-server[999]: 2026/09/20 12:45:49 INFO Signed narinfos id=10 count=14698lb # [ 44.396296] niks3-server[999]: 2026/09/20 12:45:49 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4699lb # [ 44.416528] niks3-server[999]: 2026/09/20 12:45:49 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4700lb # [ 44.418747] niks3-server[999]: 2026/09/20 12:45:49 INFO Completed upload id=104701worker2 # [ 44.443348] nix-grpc-daemon[915]: time=2026-09-20T12:45:49.643Z level=INFO msg="Upload complete. (321ms)"4702lb # [ 44.420694] niks3-server[999]: 2026/09/20 12:45:49 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4703worker2 # [ 44.452441] nix-grpc-daemon[785]: ts=2026-09-20T12:45:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14704worker2 # [ 44.459428] nix-grpc-daemon[785]: ts=2026-09-20T12:45:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14705worker2 # [ 44.471990] nix-daemon[865]: reaped child process 938, status = succeeded4706client # [ 44.496351] systemd[1]: dedup1.service: Deactivated successfully.4707client # [ 44.500759] systemd[1]: dedup1.service: Consumed 114ms CPU time over 6.055s wall clock time, 37.3M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.4708client # [ 44.537454] systemd[1]: dedup2.service: Deactivated successfully.4709client # [ 44.538910] systemd[1]: dedup2.service: Consumed 123ms CPU time over 5.025s wall clock time, 33.2M memory peak, 7.5K incoming IP traffic, 6.5K outgoing IP traffic.4710client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4711client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4712client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4713worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4714worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4715worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4716worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4717worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4718worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4719worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4720worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4721(finished: subtest: two clients wanting the same drv build it once, in 6.85 seconds)4722subtest: build hook: nix-daemon with builders = grpc://lb4723client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4724client # [ 45.412651] systemd[1]: Started Nix Daemon.4725client # [ 45.587513] nix-daemon[949]: accepted connection from pid 946, user root (trusted)4726worker2 # [ 45.772605] nix-grpc-daemon[785]: ts=2026-09-20T12:45:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:423084727worker2 # [ 45.777830] nix-grpc-daemon[785]: ts=2026-09-20T12:45:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423084728worker2 # [ 45.787478] nix-grpc-daemon[785]: ts=2026-09-20T12:45:50Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04729worker2 # [ 45.791758] nix-grpc-daemon[785]: ts=2026-09-20T12:45:50Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14730worker1 # [ 45.866557] nix-grpc-daemon[785]: ts=2026-09-20T12:45:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744731worker1 # [ 45.876848] nix-grpc-daemon[785]: ts=2026-09-20T12:45:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744732worker1 # [ 45.886207] nix-grpc-daemon[785]: ts=2026-09-20T12:45:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476744733worker1 # [ 45.897201] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4734worker1 # [ 46.049038] nix-daemon[844]: accepted connection from pid 1046, user nix-grpc-daemon (trusted)4735worker1 # [ 46.062492] nix-daemon[844]: reaped child process 1049, status = succeeded4736worker1 # [ 46.194566] nix-daemon[844]: accepted connection from pid 1051, user nix-grpc-daemon (trusted)4737worker1 # [ 46.207492] nix-daemon[844]: reaped child process 1054, status = succeeded4738lb # [ 46.161936] niks3-server[999]: 2026/09/20 12:45:51 INFO Received uploads request method=POST path=/api/pending_closures4739worker1 # [ 46.294338] nix-grpc-daemon[854]: time=2026-09-20T12:45:51.440Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4740worker1 # [ 46.296040] nix-grpc-daemon[854]: time=2026-09-20T12:45:51.440Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4741lb # [ 46.252563] niks3-server[999]: 2026/09/20 12:45:51 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4742lb # [ 46.264207] niks3-server[999]: 2026/09/20 12:45:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4743worker1 # [ 46.328644] nix-grpc-daemon[854]: time=2026-09-20T12:45:51.474Z level=INFO msg="Uploading 1 narinfos"4744lb # [ 46.270859] niks3-server[999]: 2026/09/20 12:45:51 INFO Signed narinfos id=11 count=14745lb # [ 46.275125] niks3-server[999]: 2026/09/20 12:45:51 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4746lb # [ 46.287137] niks3-server[999]: 2026/09/20 12:45:51 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4747lb # [ 46.292044] niks3-server[999]: 2026/09/20 12:45:51 INFO Completed upload id=114748worker1 # [ 46.352233] nix-grpc-daemon[854]: time=2026-09-20T12:45:51.498Z level=INFO msg="Upload complete. (443ms)"4749lb # [ 46.296461] niks3-server[999]: 2026/09/20 12:45:51 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4750worker1 # [ 46.356695] nix-grpc-daemon[785]: ts=2026-09-20T12:45:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=5124751worker1 # [ 46.362453] nix-grpc-daemon[785]: ts=2026-09-20T12:45:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744752worker1 # [ 46.373305] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4753worker1 # [ 46.386680] nix-daemon[844]: reaped child process 1044, status = succeeded4754worker1 # [ 46.393190] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4755worker1 # [ 47.211642] nix-daemon[844]: reaped child process 1058, status = succeeded4756worker1 # [ 47.346761] nix-daemon[844]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)4757worker1 # [ 47.358742] nix-daemon[844]: reaped child process 1076, status = succeeded4758lb # [ 47.316391] niks3-server[999]: 2026/09/20 12:45:52 INFO Received uploads request method=POST path=/api/pending_closures4759worker1 # [ 47.707683] nix-grpc-daemon[854]: time=2026-09-20T12:45:52.853Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4760worker1 # [ 47.720237] nix-grpc-daemon[854]: time=2026-09-20T12:45:52.853Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4761lb # [ 47.700360] niks3-server[999]: 2026/09/20 12:45:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4762lb # [ 47.705399] niks3-server[999]: 2026/09/20 12:45:52 INFO Signed narinfos id=12 count=14763worker1 # [ 47.766616] nix-grpc-daemon[854]: time=2026-09-20T12:45:52.912Z level=INFO msg="Uploading 1 narinfos"4764lb # [ 47.714264] niks3-server[999]: 2026/09/20 12:45:52 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4765lb # [ 47.721964] niks3-server[999]: 2026/09/20 12:45:52 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4766lb # [ 47.727773] niks3-server[999]: 2026/09/20 12:45:52 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4767lb # [ 47.734104] niks3-server[999]: 2026/09/20 12:45:52 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4768lb # [ 47.738736] niks3-server[999]: 2026/09/20 12:45:52 INFO Completed upload id=124769worker1 # [ 47.799481] nix-grpc-daemon[854]: time=2026-09-20T12:45:52.945Z level=INFO msg="Upload complete. (596ms)"4770lb # [ 47.744138] niks3-server[999]: 2026/09/20 12:45:52 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4771worker1 # [ 47.805703] nix-grpc-daemon[785]: ts=2026-09-20T12:45:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14772worker1 # [ 47.819490] nix-daemon[844]: reaped child process 1056, status = succeeded4773worker1 # [ 47.852240] nix-grpc-daemon[785]: ts=2026-09-20T12:45:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:476744774worker1 # [ 47.872827] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:476744775worker1 # [ 47.878133] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_out=1284776lb # [ 47.869101] envoy[928]: conn peer=[2001:db8:1::1]:53460 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4152 tx=1684 ms=15894777lb # [ 47.872797] envoy[928]: conn peer=[2001:db8:1::1]:53466 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2985 tx=1373 ms=58254778lb # [ 47.876367] envoy[928]: conn peer=[2001:db8:1::1]:53468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=47804779lb # [ 47.879920] envoy[928]: conn peer=[2001:db8:1::1]:49326 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3413 tx=1632 ms=21244780lb # [ 47.883390] envoy[928]: conn peer=[2001:db8:1::1]:49332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=574781worker1 # [ 48.102679] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:476744782worker1 # [ 48.108909] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744783worker1 # [ 48.114186] nix-grpc-daemon[854]: time=2026-09-20T12:45:53.259Z level=INFO msg="All 1 paths already cached"4784worker2 # [ 48.091913] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04785worker2 # [ 48.096933] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14786worker1 # [ 48.132543] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744787worker1 # [ 48.145438] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744788worker1 # [ 48.159084] nix-grpc-daemon[854]: time=2026-09-20T12:45:53.304Z level=INFO msg="All 1 paths already cached"4789worker1 # [ 48.164071] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476744790worker1 # [ 48.174177] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4791worker1 # [ 48.349564] nix-daemon[844]: accepted connection from pid 1080, user nix-grpc-daemon (trusted)4792worker1 # [ 48.364922] nix-daemon[844]: reaped child process 1083, status = succeeded4793worker1 # [ 48.503614] nix-daemon[844]: accepted connection from pid 1085, user nix-grpc-daemon (trusted)4794worker1 # [ 48.515359] nix-daemon[844]: reaped child process 1088, status = succeeded4795lb # [ 48.469594] niks3-server[999]: 2026/09/20 12:45:53 INFO Received uploads request method=POST path=/api/pending_closures4796worker1 # [ 48.550127] nix-grpc-daemon[854]: time=2026-09-20T12:45:53.696Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4797worker1 # [ 48.551464] nix-grpc-daemon[854]: time=2026-09-20T12:45:53.696Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4798worker1 # [ 48.560686] nix-grpc-daemon[854]: time=2026-09-20T12:45:53.707Z level=INFO msg="Uploading 1 narinfos"4799lb # [ 48.503030] niks3-server[999]: 2026/09/20 12:45:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4800lb # [ 48.504552] niks3-server[999]: 2026/09/20 12:45:53 INFO Signed narinfos id=13 count=14801lb # [ 48.510103] niks3-server[999]: 2026/09/20 12:45:53 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4802lb # [ 48.663874] niks3-server[999]: 2026/09/20 12:45:53 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4803lb # [ 48.672704] niks3-server[999]: 2026/09/20 12:45:53 INFO Completed upload id=134804worker1 # [ 48.730671] nix-grpc-daemon[854]: time=2026-09-20T12:45:53.876Z level=INFO msg="Upload complete. (543ms)"4805lb # [ 48.679399] niks3-server[999]: 2026/09/20 12:45:53 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4806worker1 # [ 48.736352] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=6244807worker1 # [ 48.743256] nix-grpc-daemon[785]: ts=2026-09-20T12:45:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744808lb # [ 48.691205] niks3-server[999]: 2026/09/20 12:45:53 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4809worker1 # [ 48.756131] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4810worker1 # [ 48.766204] nix-daemon[844]: reaped child process 1078, status = succeeded4811worker1 # [ 48.776432] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4812worker1 # [ 49.595462] nix-daemon[844]: reaped child process 1092, status = succeeded4813worker1 # [ 49.733329] nix-daemon[844]: accepted connection from pid 1107, user nix-grpc-daemon (trusted)4814worker1 # [ 49.745410] nix-daemon[844]: reaped child process 1110, status = succeeded4815lb # [ 49.702870] niks3-server[999]: 2026/09/20 12:45:54 INFO Received uploads request method=POST path=/api/pending_closures4816worker1 # [ 50.350666] nix-grpc-daemon[854]: time=2026-09-20T12:45:55.493Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4817worker1 # [ 50.354287] nix-grpc-daemon[854]: time=2026-09-20T12:45:55.493Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4818lb # [ 50.317209] niks3-server[999]: 2026/09/20 12:45:55 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4819lb # [ 50.339910] niks3-server[999]: 2026/09/20 12:45:55 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4820lb # [ 50.349455] niks3-server[999]: 2026/09/20 12:45:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4821worker1 # [ 50.414178] nix-grpc-daemon[854]: time=2026-09-20T12:45:55.560Z level=INFO msg="Uploading 1 narinfos"4822lb # [ 50.356114] niks3-server[999]: 2026/09/20 12:45:55 INFO Signed narinfos id=14 count=14823lb # [ 50.361510] niks3-server[999]: 2026/09/20 12:45:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4824lb # [ 50.370680] niks3-server[999]: 2026/09/20 12:45:55 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4825lb # [ 50.376587] niks3-server[999]: 2026/09/20 12:45:55 INFO Completed upload id=144826worker1 # [ 50.434223] nix-grpc-daemon[854]: time=2026-09-20T12:45:55.580Z level=INFO msg="Upload complete. (846ms)"4827lb # [ 50.379048] niks3-server[999]: 2026/09/20 12:45:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4828worker1 # [ 50.437406] nix-grpc-daemon[785]: ts=2026-09-20T12:45:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14829worker1 # [ 50.443971] nix-daemon[844]: reaped child process 1090, status = succeeded4830worker2 # [ 50.448913] nix-grpc-daemon[785]: ts=2026-09-20T12:45:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:423084831worker2 # [ 50.462268] nix-grpc-daemon[785]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4832worker2 # [ 50.471095] nix-grpc-daemon[785]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4833worker2 # [ 50.494743] nix-grpc-daemon[785]: ts=2026-09-20T12:45:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:423084834worker2 # [ 50.499683] nix-grpc-daemon[785]: ts=2026-09-20T12:45:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=1 nar_bytes_out=1764835worker1 # [ 50.814187] nix-grpc-daemon[785]: ts=2026-09-20T12:45:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:476744836worker2 # [ 50.784729] nix-grpc-daemon[785]: ts=2026-09-20T12:45:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423084837worker2 # [ 50.795186] nix-grpc-daemon[915]: time=2026-09-20T12:45:55.994Z level=INFO msg="All 2 paths already cached"4838worker2 # [ 50.811745] nix-grpc-daemon[785]: ts=2026-09-20T12:45:56Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04839worker2 # [ 50.816826] nix-grpc-daemon[785]: ts=2026-09-20T12:45:56Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14840worker1 # [ 50.853492] nix-grpc-daemon[785]: ts=2026-09-20T12:45:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744841worker1 # [ 50.866225] nix-grpc-daemon[785]: ts=2026-09-20T12:45:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744842worker1 # [ 50.878652] nix-grpc-daemon[854]: time=2026-09-20T12:45:56.025Z level=INFO msg="All 2 paths already cached"4843worker1 # [ 50.885836] nix-grpc-daemon[785]: ts=2026-09-20T12:45:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476744844worker1 # [ 50.894817] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4845worker1 # [ 51.045877] nix-daemon[844]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)4846worker1 # [ 51.058470] nix-daemon[844]: reaped child process 1117, status = succeeded4847worker1 # [ 51.206785] nix-daemon[844]: accepted connection from pid 1119, user nix-grpc-daemon (trusted)4848worker1 # [ 51.219079] nix-daemon[844]: reaped child process 1122, status = succeeded4849lb # [ 51.175665] niks3-server[999]: 2026/09/20 12:45:56 INFO Received uploads request method=POST path=/api/pending_closures4850worker1 # [ 51.291222] nix-grpc-daemon[854]: time=2026-09-20T12:45:56.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4851worker1 # [ 51.292603] nix-grpc-daemon[854]: time=2026-09-20T12:45:56.437Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4852lb # [ 51.253103] niks3-server[999]: 2026/09/20 12:45:56 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4853lb # [ 51.261722] niks3-server[999]: 2026/09/20 12:45:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4854lb # [ 51.266105] niks3-server[999]: 2026/09/20 12:45:56 INFO Signed narinfos id=15 count=14855worker1 # [ 51.327234] nix-grpc-daemon[854]: time=2026-09-20T12:45:56.473Z level=INFO msg="Uploading 1 narinfos"4856lb # [ 51.278481] niks3-server[999]: 2026/09/20 12:45:56 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4857lb # [ 51.285721] niks3-server[999]: 2026/09/20 12:45:56 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4858lb # [ 51.291682] niks3-server[999]: 2026/09/20 12:45:56 INFO Completed upload id=154859worker1 # [ 51.350463] nix-grpc-daemon[854]: time=2026-09-20T12:45:56.495Z level=INFO msg="Upload complete. (441ms)"4860lb # [ 51.295807] niks3-server[999]: 2026/09/20 12:45:56 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4861worker1 # [ 51.356362] nix-grpc-daemon[785]: ts=2026-09-20T12:45:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=7524862worker1 # [ 51.362325] nix-grpc-daemon[785]: ts=2026-09-20T12:45:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476744863worker1 # [ 51.373455] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4864worker1 # [ 51.382820] nix-daemon[844]: reaped child process 1112, status = succeeded4865worker1 # [ 51.392107] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4866worker1 # [ 52.619950] nix-daemon[844]: reaped child process 1126, status = succeeded4867worker1 # [ 52.778621] nix-daemon[844]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4868worker1 # [ 52.789967] nix-daemon[844]: reaped child process 1144, status = succeeded4869lb # [ 52.748579] niks3-server[999]: 2026/09/20 12:45:57 INFO Received uploads request method=POST path=/api/pending_closures4870worker1 # [ 53.157649] nix-grpc-daemon[854]: time=2026-09-20T12:45:58.303Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4871worker1 # [ 53.171229] nix-grpc-daemon[854]: time=2026-09-20T12:45:58.303Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4872lb # [ 53.150574] niks3-server[999]: 2026/09/20 12:45:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4873lb # [ 53.155374] niks3-server[999]: 2026/09/20 12:45:58 INFO Signed narinfos id=16 count=14874worker1 # [ 53.216769] nix-grpc-daemon[854]: time=2026-09-20T12:45:58.362Z level=INFO msg="Uploading 1 narinfos"4875lb # [ 53.161126] niks3-server[999]: 2026/09/20 12:45:58 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4876lb # [ 53.174366] niks3-server[999]: 2026/09/20 12:45:58 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4877lb # [ 53.179101] niks3-server[999]: 2026/09/20 12:45:58 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4878lb # [ 53.191102] niks3-server[999]: 2026/09/20 12:45:58 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4879worker1 # [ 53.265404] nix-grpc-daemon[854]: time=2026-09-20T12:45:58.411Z level=INFO msg="Upload complete. (660ms)"4880lb # [ 53.207657] niks3-server[999]: 2026/09/20 12:45:58 INFO Completed upload id=164881worker1 # [ 53.268386] nix-grpc-daemon[785]: ts=2026-09-20T12:45:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14882worker1 # [ 53.275711] nix-grpc-daemon[785]: ts=2026-09-20T12:45:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:476744883worker1 # [ 53.277726] nix-daemon[844]: reaped child process 1124, status = succeeded4884lb # [ 53.216902] niks3-server[999]: 2026/09/20 12:45:58 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4885worker1 # [ 53.296413] nix-grpc-daemon[785]: ts=2026-09-20T12:45:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:476744886worker1 # [ 53.301657] nix-grpc-daemon[785]: ts=2026-09-20T12:45:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_out=2324887client # [ 53.388269] nix-daemon[949]: reaped child process 951, status = succeeded4888client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.15 seconds)4889client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4890client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4891client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4892client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4893client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4894client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4895(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.24 seconds)4896subtest: an input only one worker has still reaches the builder4897client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4898client # this derivation will be built:4899client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4900client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4901client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.41 seconds)4902client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4903client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4904worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4905worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)4906worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4907worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4908client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24909client # [ 54.463552] nix-daemon[949]: accepted connection from pid 1032, user root (trusted)4910client # this derivation will be built:4911client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4912worker1 # [ 54.656904] nix-grpc-daemon[785]: ts=2026-09-20T12:45:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:476744913worker1 # [ 54.662264] nix-grpc-daemon[785]: ts=2026-09-20T12:45:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476744914client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4915worker1 # [ 54.811372] nix-daemon[844]: accepted connection from pid 1151, user nix-grpc-daemon (trusted)4916worker1 # [ 54.826522] nix-daemon[844]: reaped child process 1154, status = succeeded4917lb # [ 54.779304] niks3-server[999]: 2026/09/20 12:45:59 INFO Received uploads request method=POST path=/api/pending_closures4918worker1 # [ 54.841574] nix-grpc-daemon[854]: time=2026-09-20T12:45:59.987Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4919worker1 # [ 54.842916] nix-grpc-daemon[854]: time=2026-09-20T12:45:59.987Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4920lb # [ 54.793704] niks3-server[999]: 2026/09/20 12:45:59 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4921lb # [ 54.795455] niks3-server[999]: 2026/09/20 12:45:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4922lb # [ 54.798274] niks3-server[999]: 2026/09/20 12:45:59 INFO Signed narinfos id=17 count=14923worker1 # [ 54.856154] nix-grpc-daemon[854]: time=2026-09-20T12:46:00.002Z level=INFO msg="Uploading 1 narinfos"4924lb # [ 54.802086] niks3-server[999]: 2026/09/20 12:45:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4925lb # [ 54.807084] niks3-server[999]: 2026/09/20 12:45:59 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4926lb # [ 54.809977] niks3-server[999]: 2026/09/20 12:45:59 INFO Completed upload id=174927worker1 # [ 54.867703] nix-grpc-daemon[854]: time=2026-09-20T12:46:00.014Z level=INFO msg="Upload complete. (203ms)"4928lb # [ 54.812817] niks3-server[999]: 2026/09/20 12:45:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4929worker2 # [ 54.851926] nix-grpc-daemon[785]: ts=2026-09-20T12:46:00Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04930worker2 # [ 54.856359] nix-grpc-daemon[785]: ts=2026-09-20T12:46:00Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14931worker2 # [ 54.894864] nix-grpc-daemon[785]: ts=2026-09-20T12:46:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423084932worker2 # [ 54.907607] nix-grpc-daemon[785]: ts=2026-09-20T12:46:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423084933client # copying 2 paths to 'lb:50051'...4934client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4935worker2 # [ 54.924531] nix-grpc-daemon[785]: ts=2026-09-20T12:46:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423084936client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4937worker2 # [ 54.933976] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4938worker2 # [ 55.111977] nix-daemon[865]: accepted connection from pid 1005, user nix-grpc-daemon (trusted)4939worker2 # [ 55.126679] nix-daemon[865]: reaped child process 1008, status = succeeded4940worker2 # [ 55.296644] nix-daemon[865]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4941worker2 # [ 55.310366] nix-daemon[865]: reaped child process 1014, status = succeeded4942lb # [ 55.299478] niks3-server[999]: 2026/09/20 12:46:00 INFO Received uploads request method=POST path=/api/pending_closures4943lb # [ 55.600931] niks3-server[999]: 2026/09/20 12:46:00 INFO Received uploads request method=POST path=/api/pending_closures4944worker2 # [ 55.675645] nix-grpc-daemon[915]: time=2026-09-20T12:46:00.874Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4945worker2 # [ 55.680647] nix-grpc-daemon[915]: time=2026-09-20T12:46:00.874Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4946worker2 # [ 55.684643] nix-grpc-daemon[915]: time=2026-09-20T12:46:00.874Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4947lb # [ 55.682540] niks3-server[999]: 2026/09/20 12:46:00 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4948lb # [ 55.698759] niks3-server[999]: 2026/09/20 12:46:00 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4949lb # [ 55.706106] niks3-server[999]: 2026/09/20 12:46:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4950lb # [ 55.714958] niks3-server[999]: 2026/09/20 12:46:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4951lb # [ 55.720587] niks3-server[999]: 2026/09/20 12:46:00 INFO Signed narinfos id=18 count=14952lb # [ 55.724110] niks3-server[999]: 2026/09/20 12:46:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4953lb # [ 55.727195] niks3-server[999]: 2026/09/20 12:46:00 INFO Signed narinfos id=19 count=24954lb # [ 55.728680] niks3-server[999]: 2026/09/20 12:46:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4955worker2 # [ 55.753589] nix-grpc-daemon[915]: time=2026-09-20T12:46:00.953Z level=INFO msg="Uploading 3 narinfos"4956lb # [ 55.743664] niks3-server[999]: 2026/09/20 12:46:00 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4957lb # [ 55.747913] niks3-server[999]: 2026/09/20 12:46:00 INFO Completed upload id=184958lb # [ 55.750100] niks3-server[999]: 2026/09/20 12:46:00 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4959lb # [ 55.752521] niks3-server[999]: 2026/09/20 12:46:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4960lb # [ 55.756411] niks3-server[999]: 2026/09/20 12:46:00 INFO Completed upload id=194961worker2 # [ 55.780833] nix-grpc-daemon[915]: time=2026-09-20T12:46:00.981Z level=INFO msg="Upload complete. (829ms)"4962lb # [ 55.757786] niks3-server[999]: 2026/09/20 12:46:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4963worker2 # [ 55.783157] nix-grpc-daemon[785]: ts=2026-09-20T12:46:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=2 nar_bytes_in=9764964lb # [ 55.760580] niks3-server[999]: 2026/09/20 12:46:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4965worker2 # [ 55.787331] nix-grpc-daemon[785]: ts=2026-09-20T12:46:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423084966worker2 # [ 55.794210] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4967worker2 # [ 55.796736] nix-daemon[865]: reaped child process 1003, status = succeeded4968worker2 # [ 55.804986] nix-grpc-daemon[785]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4969client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4970client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4971worker2 # [ 55.814304] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4972worker2 # [ 56.828830] nix-daemon[865]: reaped child process 1019, status = succeeded4973worker2 # [ 56.968090] nix-daemon[865]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4974worker2 # [ 56.979355] nix-daemon[865]: reaped child process 1037, status = succeeded4975lb # [ 56.971493] niks3-server[999]: 2026/09/20 12:46:02 INFO Received uploads request method=POST path=/api/pending_closures4976worker2 # [ 57.005901] nix-grpc-daemon[915]: time=2026-09-20T12:46:02.205Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4977lb # [ 57.005189] niks3-server[999]: 2026/09/20 12:46:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4978lb # [ 57.013315] niks3-server[999]: 2026/09/20 12:46:02 INFO Signed narinfos id=20 count=14979worker2 # [ 57.041676] nix-grpc-daemon[915]: time=2026-09-20T12:46:02.241Z level=INFO msg="Uploading 1 narinfos"4980lb # [ 57.020308] niks3-server[999]: 2026/09/20 12:46:02 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4981lb # [ 57.027697] niks3-server[999]: 2026/09/20 12:46:02 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4982lb # [ 57.038752] niks3-server[999]: 2026/09/20 12:46:02 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4983worker2 # [ 57.071066] nix-grpc-daemon[915]: time=2026-09-20T12:46:02.271Z level=INFO msg="Upload complete. (250ms)"4984lb # [ 57.046813] niks3-server[999]: 2026/09/20 12:46:02 INFO Completed upload id=204985worker2 # [ 57.073568] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14986lb # [ 57.050187] niks3-server[999]: 2026/09/20 12:46:02 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4987worker2 # [ 57.081056] nix-daemon[865]: reaped child process 1016, status = succeeded4988client # copying 1 paths...4989worker2 # [ 57.118914] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:423084990client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4991worker2 # [ 57.139153] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:423084992worker2 # [ 57.143349] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=1 nar_bytes_out=1204993client # [ 57.247573] nix-daemon[949]: reaped child process 1035, status = succeeded4994client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.95 seconds)4995client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24996client # [ 57.434608] nix-daemon[949]: accepted connection from pid 1054, user root (trusted)4997client # this derivation will be built:4998client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4999worker1 # [ 57.627502] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:476745000client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5001worker1 # [ 57.633338] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476745002worker1 # [ 57.639375] nix-grpc-daemon[854]: time=2026-09-20T12:46:02.784Z level=INFO msg="All 1 paths already cached"5003worker2 # [ 57.616703] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05004worker2 # [ 57.621546] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15005worker1 # [ 57.657819] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476745006worker1 # [ 57.670274] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476745007client # copying 1 paths to 'lb:50051'...5008client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5009worker1 # [ 57.689570] nix-grpc-daemon[785]: ts=2026-09-20T12:46:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476745010worker1 # [ 57.695290] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5011worker1 # [ 57.702988] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)5012worker1 # [ 57.776988] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 2/5)5013lb # [ 57.870155] envoy[928]: conn peer=[2001:db8:1::1]:49338 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3880 tx=1966 ms=24845014lb # [ 57.874374] envoy[928]: conn peer=[2001:db8:1::1]:49350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=595015lb # [ 57.877964] envoy[928]: conn peer=[2001:db8:1::1]:49356 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2109 ms=25405016worker1 # [ 57.937960] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 3/5)5017lb # [ 57.881647] envoy[928]: conn peer=[2001:db8:1::1]:58578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=605018lb # [ 57.885142] envoy[928]: conn peer=[2001:db8:1::1]:58590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=1765 ms=25675019lb # [ 57.889695] envoy[928]: conn peer=[2001:db8:1::1]:58596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=535020worker1 # [ 57.971064] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 4/5)5021worker1 # [ 57.996746] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5022worker1 # [ 57.999522] nix-grpc-daemon[785]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5023worker1 # [ 58.194676] nix-daemon[844]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)5024worker1 # [ 58.213476] nix-daemon[844]: reaped child process 1165, status = succeeded5025worker1 # [ 58.398127] nix-daemon[844]: accepted connection from pid 1167, user nix-grpc-daemon (trusted)5026worker1 # [ 58.414079] nix-daemon[844]: reaped child process 1170, status = succeeded5027lb # [ 58.377517] niks3-server[999]: 2026/09/20 12:46:03 INFO Received uploads request method=POST path=/api/pending_closures5028worker1 # [ 58.448094] nix-grpc-daemon[854]: time=2026-09-20T12:46:03.594Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5029worker1 # [ 58.449518] nix-grpc-daemon[854]: time=2026-09-20T12:46:03.594Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5030lb # [ 58.412421] niks3-server[999]: 2026/09/20 12:46:03 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5031lb # [ 58.423304] niks3-server[999]: 2026/09/20 12:46:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5032lb # [ 58.428373] niks3-server[999]: 2026/09/20 12:46:03 INFO Signed narinfos id=21 count=15033worker1 # [ 58.486504] nix-grpc-daemon[854]: time=2026-09-20T12:46:03.632Z level=INFO msg="Uploading 1 narinfos"5034lb # [ 58.434032] niks3-server[999]: 2026/09/20 12:46:03 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5035lb # [ 58.451133] niks3-server[999]: 2026/09/20 12:46:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5036lb # [ 58.459261] niks3-server[999]: 2026/09/20 12:46:03 INFO Completed upload id=215037worker1 # [ 58.517191] nix-grpc-daemon[854]: time=2026-09-20T12:46:03.663Z level=INFO msg="Upload complete. (500ms)"5038lb # [ 58.461617] niks3-server[999]: 2026/09/20 12:46:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5039worker1 # [ 58.519808] nix-grpc-daemon[785]: ts=2026-09-20T12:46:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=0 paths=1 nar_bytes_in=5605040worker1 # [ 58.523567] nix-grpc-daemon[785]: ts=2026-09-20T12:46:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476745041worker1 # [ 58.529303] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5042worker1 # [ 58.539153] nix-daemon[844]: reaped child process 1156, status = succeeded5043client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5044worker1 # [ 58.545316] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5045client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5046worker1 # [ 59.776581] nix-daemon[844]: reaped child process 1174, status = succeeded5047worker1 # [ 59.937503] nix-daemon[844]: accepted connection from pid 1189, user nix-grpc-daemon (trusted)5048worker1 # [ 59.948233] nix-daemon[844]: reaped child process 1192, status = succeeded5049lb # [ 59.906660] niks3-server[999]: 2026/09/20 12:46:05 INFO Received uploads request method=POST path=/api/pending_closures5050worker1 # [ 59.971703] nix-grpc-daemon[854]: time=2026-09-20T12:46:05.117Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5051lb # [ 59.936691] niks3-server[999]: 2026/09/20 12:46:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5052lb # [ 59.942747] niks3-server[999]: 2026/09/20 12:46:05 INFO Signed narinfos id=22 count=15053worker1 # [ 60.003584] nix-grpc-daemon[854]: time=2026-09-20T12:46:05.150Z level=INFO msg="Uploading 1 narinfos"5054lb # [ 59.948144] niks3-server[999]: 2026/09/20 12:46:05 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5055lb # [ 59.955957] niks3-server[999]: 2026/09/20 12:46:05 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5056lb # [ 59.967785] niks3-server[999]: 2026/09/20 12:46:05 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5057lb # [ 59.972502] niks3-server[999]: 2026/09/20 12:46:05 INFO Completed upload id=225058worker1 # [ 60.032543] nix-grpc-daemon[854]: time=2026-09-20T12:46:05.178Z level=INFO msg="Upload complete. (278ms)"5059lb # [ 59.975427] niks3-server[999]: 2026/09/20 12:46:05 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5060worker1 # [ 60.035462] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47674 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15061worker1 # [ 60.047441] nix-daemon[844]: reaped child process 1172, status = succeeded5062client # copying 1 paths...5063worker2 # [ 60.052101] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:423085064worker2 # [ 60.062428] nix-grpc-daemon[785]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5065client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5066worker2 # [ 60.095579] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:423085067worker2 # [ 60.100728] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=1 nar_bytes_out=1205068client # [ 60.196035] nix-daemon[949]: reaped child process 1057, status = succeeded5069client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.94 seconds)5070client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25071client # [ 60.351106] nix-daemon[949]: accepted connection from pid 1076, user root (trusted)5072client # this derivation will be built:5073client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5074worker1 # [ 60.552662] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:476745075client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5076worker1 # [ 60.558745] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476745077worker1 # [ 60.563907] nix-grpc-daemon[854]: time=2026-09-20T12:46:05.709Z level=INFO msg="All 1 paths already cached"5078worker2 # [ 60.541695] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05079worker2 # [ 60.547469] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15080worker2 # [ 60.586121] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423085081worker2 # [ 60.598821] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423085082client # copying 1 paths to 'lb:50051'...5083worker2 # [ 60.614844] nix-grpc-daemon[915]: time=2026-09-20T12:46:05.813Z level=INFO msg="All 1 paths already cached"5084client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5085worker2 # [ 60.619532] nix-grpc-daemon[785]: ts=2026-09-20T12:46:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423085086worker2 # [ 60.630292] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5087worker2 # [ 60.796660] nix-daemon[865]: accepted connection from pid 1046, user nix-grpc-daemon (trusted)5088worker2 # [ 60.810383] nix-daemon[865]: reaped child process 1049, status = succeeded5089worker2 # [ 60.969215] nix-daemon[865]: accepted connection from pid 1051, user nix-grpc-daemon (trusted)5090worker2 # [ 60.982626] nix-daemon[865]: reaped child process 1054, status = succeeded5091lb # [ 60.969456] niks3-server[999]: 2026/09/20 12:46:06 INFO Received uploads request method=POST path=/api/pending_closures5092worker2 # [ 61.001627] nix-grpc-daemon[915]: time=2026-09-20T12:46:06.201Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5093worker2 # [ 61.002982] nix-grpc-daemon[915]: time=2026-09-20T12:46:06.201Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5094lb # [ 60.994291] niks3-server[999]: 2026/09/20 12:46:06 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5095lb # [ 61.000829] niks3-server[999]: 2026/09/20 12:46:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5096lb # [ 61.002784] niks3-server[999]: 2026/09/20 12:46:06 INFO Signed narinfos id=23 count=15097worker2 # [ 61.027052] nix-grpc-daemon[915]: time=2026-09-20T12:46:06.227Z level=INFO msg="Uploading 1 narinfos"5098lb # [ 61.005273] niks3-server[999]: 2026/09/20 12:46:06 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5099lb # [ 61.010306] niks3-server[999]: 2026/09/20 12:46:06 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5100lb # [ 61.012582] niks3-server[999]: 2026/09/20 12:46:06 INFO Completed upload id=235101worker2 # [ 61.036963] nix-grpc-daemon[915]: time=2026-09-20T12:46:06.237Z level=WARN msg="Failed to register uploaded object" key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo error="server returned 404: object is not pending upload\n"5102worker2 # [ 61.040269] nix-grpc-daemon[915]: time=2026-09-20T12:46:06.239Z level=INFO msg="Upload complete. (397ms)"5103worker2 # [ 61.042131] nix-grpc-daemon[785]: ts=2026-09-20T12:46:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=1 nar_bytes_in=5605104worker2 # [ 61.044479] nix-grpc-daemon[785]: ts=2026-09-20T12:46:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423085105worker2 # [ 61.049327] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5106worker2 # [ 61.054934] nix-daemon[865]: reaped child process 1044, status = succeeded5107worker2 # [ 61.059429] nix-daemon[865]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5108client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5109client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5110worker2 # [ 62.273178] nix-daemon[865]: reaped child process 1058, status = succeeded5111worker2 # [ 62.429880] nix-daemon[865]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)5112worker2 # [ 62.442272] nix-daemon[865]: reaped child process 1076, status = succeeded5113lb # [ 62.434762] niks3-server[999]: 2026/09/20 12:46:07 INFO Received uploads request method=POST path=/api/pending_closures5114worker2 # [ 62.469932] nix-grpc-daemon[915]: time=2026-09-20T12:46:07.669Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5115lb # [ 62.457096] niks3-server[999]: 2026/09/20 12:46:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5116lb # [ 62.459835] niks3-server[999]: 2026/09/20 12:46:07 INFO Signed narinfos id=24 count=15117worker2 # [ 62.484405] nix-grpc-daemon[915]: time=2026-09-20T12:46:07.684Z level=INFO msg="Uploading 1 narinfos"5118lb # [ 62.463493] niks3-server[999]: 2026/09/20 12:46:07 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5119lb # [ 62.466469] niks3-server[999]: 2026/09/20 12:46:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5120lb # [ 62.470675] niks3-server[999]: 2026/09/20 12:46:07 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5121lb # [ 62.473435] niks3-server[999]: 2026/09/20 12:46:07 INFO Completed upload id=245122worker2 # [ 62.497788] nix-grpc-daemon[915]: time=2026-09-20T12:46:07.698Z level=INFO msg="Upload complete. (231ms)"5123lb # [ 62.476031] niks3-server[999]: 2026/09/20 12:46:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5124worker2 # [ 62.501232] nix-grpc-daemon[785]: ts=2026-09-20T12:46:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15125worker2 # [ 62.507829] nix-daemon[865]: reaped child process 1056, status = succeeded5126client # copying 1 paths...5127worker2 # [ 62.546159] nix-grpc-daemon[785]: ts=2026-09-20T12:46:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:423085128client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5129worker2 # [ 62.566150] nix-grpc-daemon[785]: ts=2026-09-20T12:46:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:423085130worker2 # [ 62.570877] nix-grpc-daemon[785]: ts=2026-09-20T12:46:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=1 nar_bytes_out=1205131client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.48 seconds)5132(finished: subtest: an input only one worker has still reaches the builder, in 9.19 seconds)5133subtest: upload whose reference the worker lacks is completed from the cache5134client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5135client # [ 62.712909] nix-daemon[949]: reaped child process 1079, status = succeeded5136client # this derivation will be built:5137client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5138client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5139client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.37 seconds)5140client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5141client # this derivation will be built:5142client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5143client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5144client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.38 seconds)5145client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5146client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.19 seconds)5147worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5148worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds)5149worker2 # [ 63.866159] systemd[1]: Stopping Nix worker-protocol over gRPC...5150worker2 # [ 64.224487] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=signal_exit5151worker2 # [ 64.477555] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=scheduler_yield5152lb # [ 64.457833] niks3-server[999]: 2026/09/20 12:46:09 INFO lead: released remote=192.168.1.4:454065153worker2 # [ 64.482266] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=scheduler_restarting addr=lb:500515154worker1 # [ 64.523756] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=scheduler_restarting addr=lb:500515155worker2 # [ 64.490420] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422945156worker2 # [ 64.495149] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=worker_gone addr=192.168.1.4:500515157worker2 # [ 64.498227] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422945158worker2 # [ 64.501496] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=worker_gone addr=192.168.1.3:500515159worker2 # [ 64.683285] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=scheduler_connected addr=lb:500515160worker2 # [ 64.687152] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5161worker1 # [ 64.724384] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=scheduler_connected addr=lb:500515162worker1 # [ 64.728186] nix-grpc-daemon[785]: ts=2026-09-20T12:46:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5163worker2 # [ 64.887898] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515164worker2 # [ 64.891865] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5165worker1 # [ 64.928945] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515166worker1 # [ 64.932893] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5167worker2 # [ 65.092931] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515168worker2 # [ 65.096905] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5169worker1 # [ 65.133555] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515170worker1 # [ 65.137519] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5171worker2 # [ 65.299439] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515172worker2 # [ 65.302503] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5173worker1 # [ 65.337945] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515174worker1 # [ 65.341791] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5175worker2 # [ 65.481983] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_restarting5176worker1 # [ 65.543733] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515177worker2 # [ 65.512563] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5178worker1 # [ 65.547196] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5179worker2 # [ 65.520248] nix-daemon[865]: reaped child process 867, status = succeeded5180worker1 # [ 65.747976] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_connected addr=lb:500515181worker1 # [ 65.752500] nix-grpc-daemon[785]: ts=2026-09-20T12:46:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5182worker1 # [ 65.953370] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_connected addr=lb:500515183worker1 # [ 65.957781] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5184worker1 # [ 66.158678] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_connected addr=lb:500515185worker1 # [ 66.162680] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5186worker1 # [ 66.363372] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_connected addr=lb:500515187worker1 # [ 66.367271] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5188worker2 # [ 66.356719] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5189worker2 # [ 66.360180] nix-grpc-daemon[785]: E0000 00:00:1789908371.555747 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5190worker2 # [ 66.364765] nix-grpc-daemon[785]: E0000 00:00:1789908371.556236 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5191worker1 # [ 66.568727] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_connected addr=lb:500515192worker1 # [ 66.572492] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5193worker1 # [ 66.773287] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_connected addr=lb:500515194worker1 # [ 66.777120] nix-grpc-daemon[785]: ts=2026-09-20T12:46:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5195worker1 # [ 66.977914] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_connected addr=lb:500515196worker1 # [ 66.982095] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5197worker1 # [ 67.182920] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_connected addr=lb:500515198worker1 # [ 67.186838] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5199worker2 # [ 67.304799] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5200worker2 # [ 67.310460] systemd[1]: Stopped Nix worker-protocol over gRPC.5201worker2 # [ 67.312593] systemd[1]: nix-grpc-daemon.service: Consumed 1.369s CPU time over 49.307s wall clock time, 50.3M memory peak, 51.1K incoming IP traffic, 145K outgoing IP traffic.5202worker2 # [ 67.323756] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5203worker2 # [ 67.328208] systemd[1]: Closed Nix worker-protocol over gRPC.5204worker2 # [ 67.331296] systemd[1]: nix-grpc-daemon.socket: Consumed 298us CPU time over 58.106s wall clock time, 256K memory peak, 69.6K incoming IP traffic, 59.2K outgoing IP traffic.5205lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5206lb: must succeed: curl -sf localhost:9901/clusters5207worker1 # [ 67.387197] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_connected addr=lb:500515208worker1 # [ 67.388932] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5209lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5210lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.04 seconds)5211client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25212worker1 # [ 67.590843] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_connected addr=lb:500515213worker1 # [ 67.594622] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5214worker1 # [ 67.634628] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476745215worker1 # [ 67.641979] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:476745216client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5217client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.26 seconds)5218worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5219worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5220worker2 # [ 67.719790] systemd[1]: Listening on Nix worker-protocol over gRPC.5221worker1 # [ 67.795569] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_connected addr=lb:500515222worker1 # [ 67.800164] nix-grpc-daemon[785]: ts=2026-09-20T12:46:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5223worker1 # [ 67.819507] systemd[1]: Stopping Nix worker-protocol over gRPC...5224lb # [ 67.870309] envoy[928]: conn peer=[2001:db8:1::1]:58610 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1913 ms=25575225lb # [ 67.874063] envoy[928]: conn peer=[2001:db8:1::1]:58614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=585226lb # [ 67.877490] envoy[928]: conn peer=[2001:db8:1::1]:58634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=605227lb # [ 67.880939] envoy[928]: conn peer=[2001:db8:1::1]:58624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1803 ms=21035228lb # [ 67.884339] envoy[928]: conn peer=192.168.1.4:58412 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=29856 tx=1647 ms=472535229lb # [ 67.887935] envoy[928]: conn peer=[2001:db8:1::1]:51212 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=215230worker1 # [ 68.000584] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_connected addr=lb:500515231worker1 # [ 68.005261] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5232worker1 # [ 68.205695] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_connected addr=lb:500515233worker1 # [ 68.209753] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5234worker1 # [ 68.225360] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=signal_exit5235worker2 # [ 68.292628] systemd[1]: Starting scheduler-token.service...5236worker1 # [ 68.410579] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_connected addr=lb:500515237worker1 # [ 68.414421] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5238worker2 # [ 68.384195] systemd[1]: scheduler-token.service: Deactivated successfully.5239worker2 # [ 68.386346] systemd[1]: Finished scheduler-token.service.5240worker2 # [ 68.388561] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 91ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5241worker2 # [ 68.396232] systemd[1]: Starting Nix worker-protocol over gRPC...5242worker2 # [ 68.543501] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5243worker2 # [ 68.546147] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5244worker2 # [ 68.550438] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15245worker2 # [ 68.557480] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5246worker2 # [ 68.561152] systemd[1]: Started Nix worker-protocol over gRPC.5247worker2 # [ 68.570714] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=scheduler_take_over5248lb # [ 68.547154] niks3-server[999]: 2026/09/20 12:46:13 INFO lead: acquired remote=192.168.1.4:548585249worker2 # [ 68.584381] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=scheduler_connected addr=lb:500515250worker1 # [ 68.615915] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_connected addr=lb:500515251worker1 # [ 68.620126] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5252worker2 # [ 68.591057] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=oidc_jwks provider=mock keys=15253worker2 # [ 68.592510] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:443405254worker2 # [ 68.594144] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05255worker1 # [ 68.821235] nix-grpc-daemon[785]: ts=2026-09-20T12:46:13Z level=info event=scheduler_connected addr=lb:500515256worker2 # [ 68.790244] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:443405257worker2 # [ 68.794531] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05258worker1 # [ 69.500370] nix-grpc-daemon[785]: ts=2026-09-20T12:46:14Z level=info event=scheduler_restarting5259worker2 # [ 69.475324] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:443405260worker2 # [ 69.477188] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:14Z level=info event=worker_gone addr=192.168.1.3:500515261worker1 # [ 69.523852] nix-grpc-daemon[785]: ts=2026-09-20T12:46:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5262worker1 # [ 69.543124] nix-daemon[844]: reaped child process 846, status = succeeded5263worker1 # [ 70.339572] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5264worker1 # [ 70.343199] nix-grpc-daemon[785]: E0000 00:00:1789908375.485282 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5265worker1 # [ 70.348704] nix-grpc-daemon[785]: E0000 00:00:1789908375.485669 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5266worker1 # [ 71.264350] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5267worker1 # [ 71.266699] systemd[1]: Stopped Nix worker-protocol over gRPC.5268worker1 # [ 71.268619] systemd[1]: nix-grpc-daemon.service: Consumed 2.615s CPU time over 53.344s wall clock time, 58.9M memory peak, 87.7K incoming IP traffic, 160.8K outgoing IP traffic.5269worker1 # [ 71.274193] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5270worker1 # [ 71.276449] systemd[1]: Closed Nix worker-protocol over gRPC.5271worker1 # [ 71.277847] systemd[1]: nix-grpc-daemon.socket: Consumed 385us CPU time over 1min 999ms wall clock time, 256K memory peak, 74.6K incoming IP traffic, 60.3K outgoing IP traffic.5272lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5273lb: must succeed: curl -sf localhost:9901/clusters5274lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5275lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5276client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25277worker2 # [ 71.501829] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:443425278worker2 # [ 71.513478] nix-daemon[865]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)5279worker2 # [ 71.530288] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5280worker2 # [ 71.572152] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 2/5)5281worker2 # [ 71.591147] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 3/5)5282worker2 # [ 71.727556] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 358 ms (attempt 4/5)5283worker2 # [ 72.091850] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5284client # copying 2 paths...5285client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5286worker2 # [ 72.114584] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:443425287client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5288worker2 # [ 72.125318] nix-daemon[865]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)5289worker2 # [ 72.250514] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:17Z level=info event=niks3_push_started pid=11565290worker2 # [ 72.456278] nix-grpc-daemon[1156]: time=2026-09-20T12:46:17.655Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5291worker2 # [ 72.615437] nix-daemon[865]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)5292worker2 # [ 72.628100] nix-daemon[865]: reaped child process 1172, status = succeeded5293lb # [ 72.618790] niks3-server[999]: 2026/09/20 12:46:17 INFO Received uploads request method=POST path=/api/pending_closures5294lb # [ 72.625320] niks3-server[999]: 2026/09/20 12:46:17 INFO Received uploads request method=POST path=/api/pending_closures5295worker2 # [ 72.652749] nix-grpc-daemon[1156]: time=2026-09-20T12:46:17.853Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5296worker2 # [ 72.654356] nix-grpc-daemon[1156]: time=2026-09-20T12:46:17.854Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5297worker2 # [ 72.657056] nix-grpc-daemon[1156]: time=2026-09-20T12:46:17.856Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5298lb # [ 72.653992] niks3-server[999]: 2026/09/20 12:46:17 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5299lb # [ 72.657705] niks3-server[999]: 2026/09/20 12:46:17 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5300lb # [ 72.662995] niks3-server[999]: 2026/09/20 12:46:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5301lb # [ 72.666375] niks3-server[999]: 2026/09/20 12:46:17 INFO Signed narinfos id=25 count=15302lb # [ 72.669105] niks3-server[999]: 2026/09/20 12:46:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5303lb # [ 72.671242] niks3-server[999]: 2026/09/20 12:46:17 INFO Signed narinfos id=26 count=25304worker2 # [ 72.696807] nix-grpc-daemon[1156]: time=2026-09-20T12:46:17.895Z level=INFO msg="Uploading 3 narinfos"5305lb # [ 72.673472] niks3-server[999]: 2026/09/20 12:46:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5306lb # [ 72.677288] niks3-server[999]: 2026/09/20 12:46:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5307lb # [ 72.689670] niks3-server[999]: 2026/09/20 12:46:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5308lb # [ 72.692498] niks3-server[999]: 2026/09/20 12:46:17 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5309lb # [ 72.695467] niks3-server[999]: 2026/09/20 12:46:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5310lb # [ 72.699455] niks3-server[999]: 2026/09/20 12:46:17 INFO Completed upload id=265311lb # [ 72.701255] niks3-server[999]: 2026/09/20 12:46:17 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5312lb # [ 72.703814] niks3-server[999]: 2026/09/20 12:46:17 INFO Completed upload id=255313worker2 # [ 72.728031] nix-grpc-daemon[1156]: time=2026-09-20T12:46:17.928Z level=INFO msg="Upload complete. (268ms)"5314worker2 # [ 72.731381] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44342 duration_s=0 paths=2 nar_bytes_in=3125315worker2 # [ 72.736594] nix-grpc-daemon[1156]: time=2026-09-20T12:46:17.936Z level=WARN msg="Failed to register uploaded object" key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo error="server returned 404: object is not pending upload\n"5316worker2 # [ 72.742496] nix-daemon[865]: reaped child process 1154, status = succeeded5317client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.45 seconds)5318worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5319worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5320worker1 # [ 72.875755] systemd[1]: Listening on Nix worker-protocol over gRPC.5321worker1 # [ 72.879437] systemd[1]: Starting Nix worker-protocol over gRPC...5322worker1 # [ 73.007323] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:18Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5323worker1 # [ 73.009090] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5324worker1 # [ 73.012981] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15325worker1 # [ 73.019065] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5326worker1 # [ 73.022431] systemd[1]: Started Nix worker-protocol over gRPC.5327lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5328lb: must succeed: curl -sf localhost:9901/clusters5329worker1 # [ 73.032736] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:18Z level=info event=scheduler_connected addr=lb:500515330worker2 # [ 73.001315] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:443405331worker2 # [ 73.004832] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05332lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5333lb: must succeed: curl -sf localhost:9901/clusters5334lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5335lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5336(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.43 seconds)5337subtest: scheduler down: the other node takes the lock and keeps it5338lb: must succeed: curl -sf localhost:9901/clusters5339lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5340lb: must succeed: curl -sf localhost:9901/clusters5341lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5342lb: must succeed: curl -sf localhost:9901/clusters5343lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5344lb: must succeed: curl -sf localhost:9901/clusters5345lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5346worker2 # [ 74.348142] systemd[1]: Stopping Nix worker-protocol over gRPC...5347worker2 # [ 74.562506] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:19Z level=info event=signal_exit5348worker2 # [ 74.774064] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:19Z level=info event=scheduler_yield5349worker1 # [ 74.810748] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:19Z level=info event=scheduler_restarting addr=lb:500515350lb # [ 74.752329] niks3-server[999]: 2026/09/20 12:46:19 INFO lead: released remote=192.168.1.4:548585351worker2 # [ 74.780608] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:443405352worker2 # [ 74.786619] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:19Z level=info event=worker_gone addr=192.168.1.3:500515353worker2 # [ 74.789848] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:443405354worker2 # [ 74.793275] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:19Z level=info event=worker_gone addr=192.168.1.4:500515355worker2 # [ 74.796379] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:19Z level=info event=scheduler_restarting addr=lb:500515356worker1 # [ 75.011434] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515357worker1 # [ 75.015980] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5358worker2 # [ 74.987096] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515359worker2 # [ 74.988921] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5360worker1 # [ 75.216860] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515361worker1 # [ 75.220897] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5362worker2 # [ 75.190311] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515363worker2 # [ 75.194158] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5364worker1 # [ 75.421651] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515365worker1 # [ 75.425654] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5366worker2 # [ 75.394623] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515367worker2 # [ 75.398306] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5368worker1 # [ 75.626371] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515369worker1 # [ 75.630574] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5370worker2 # [ 75.600156] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515371worker2 # [ 75.603832] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5372worker2 # [ 75.778872] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:20Z level=info event=scheduler_restarting5373worker1 # [ 75.832435] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_connected addr=lb:500515374worker2 # [ 75.799507] nix-daemon[865]: reaped child process 1149, status = succeeded5375worker1 # [ 75.836940] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5376worker2 # [ 75.811890] nix-grpc-daemon[1100]: ts=2026-09-20T12:46:21Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5377worker1 # [ 76.034128] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_connected addr=lb:500515378worker1 # [ 76.038474] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5379worker1 # [ 76.239369] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_connected addr=lb:500515380worker1 # [ 76.244114] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5381worker1 # [ 76.444878] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_connected addr=lb:500515382worker1 # [ 76.448750] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5383worker2 # [ 76.589753] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5384worker2 # [ 76.592439] systemd[1]: Stopped Nix worker-protocol over gRPC.5385worker2 # [ 76.596281] systemd[1]: nix-grpc-daemon.service: Consumed 342ms CPU time over 8.192s wall clock time, 30.3M memory peak, 19.4K incoming IP traffic, 25.8K outgoing IP traffic.5386worker2 # [ 76.608463] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5387worker2 # [ 76.612740] systemd[1]: Closed Nix worker-protocol over gRPC.5388worker1 # [ 76.649277] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_connected addr=lb:500515389worker1 # [ 76.651197] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5390worker2 # [ 76.616826] systemd[1]: nix-grpc-daemon.socket: Consumed 284us CPU time over 8.897s wall clock time, 256K memory peak, 20.7K incoming IP traffic, 15.1K outgoing IP traffic.5391worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5392worker1 # [ 76.852769] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:21Z level=info event=scheduler_connected addr=lb:500515393worker1 # [ 76.856527] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5394worker1 # [ 77.057416] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_connected addr=lb:500515395worker1 # [ 77.061391] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5396worker1 # [ 77.262234] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_connected addr=lb:500515397worker1 # [ 77.266426] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5398worker1 # [ 77.467168] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_connected addr=lb:500515399worker1 # [ 77.471393] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5400worker1 # [ 77.672277] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_connected addr=lb:500515401worker1 # [ 77.676309] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5402worker1 # [ 77.878469] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=scheduler_connected addr=lb:500515403worker1 # [ 77.881565] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5404lb # [ 77.869793] envoy[928]: conn peer=[2001:db8:1::3]:52770 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10885 tx=2322 ms=503875405lb # [ 77.871412] envoy[928]: conn peer=[2001:db8:1::1]:51226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=280 ms=12475406lb # [ 77.873478] envoy[928]: conn peer=[2001:db8:1::4]:60504 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4478 tx=349 ms=72305407lb # [ 77.970744] niks3-server[999]: 2026/09/20 12:46:23 INFO lead: acquired remote=192.168.1.3:442405408worker1 # [ 78.028697] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=scheduler_take_over5409worker1 # [ 78.079243] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=scheduler_connected addr=lb:500515410worker1 # [ 78.083091] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5411worker1 # [ 78.283650] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=scheduler_connected addr=lb:500515412worker1 # [ 78.290772] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:505025413worker1 # [ 78.295243] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05414worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.17 seconds)5415worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5416worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5417client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25418worker1 # [ 79.096808] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:505105419worker1 # [ 79.106530] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5420client # don't know how to build these paths:5421client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5422worker1 # [ 79.121330] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505105423worker1 # [ 79.131840] nix-grpc-daemon[1215]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5)5424worker1 # [ 79.153384] nix-grpc-daemon[1215]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 2/5)5425worker1 # [ 79.299959] nix-grpc-daemon[1215]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 3/5)5426worker1 # [ 79.411078] nix-grpc-daemon[1215]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 4/5)5427worker1 # [ 79.548822] nix-grpc-daemon[1215]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5428worker1 # [ 79.571273] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05429worker1 # [ 79.577228] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15430worker1 # [ 79.619137] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105431worker1 # [ 79.629841] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505105432client # copying 1 paths to 'lb:50051'...5433client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5434worker1 # [ 79.640167] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505105435worker1 # [ 79.648293] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5436worker1 # [ 79.668948] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:24Z level=info event=niks3_push_started pid=12945437worker1 # [ 79.850793] nix-grpc-daemon[1294]: time=2026-09-20T12:46:24.996Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5438worker1 # [ 80.011637] nix-daemon[844]: accepted connection from pid 1307, user nix-grpc-daemon (trusted)5439worker1 # [ 80.022783] nix-daemon[844]: reaped child process 1310, status = succeeded5440worker1 # [ 80.176864] nix-daemon[844]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5441worker1 # [ 80.188436] nix-daemon[844]: reaped child process 1315, status = succeeded5442lb # [ 80.149739] niks3-server[999]: 2026/09/20 12:46:25 INFO Received uploads request method=POST path=/api/pending_closures5443worker1 # [ 80.213978] nix-grpc-daemon[1294]: time=2026-09-20T12:46:25.360Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5444worker1 # [ 80.217053] nix-grpc-daemon[1294]: time=2026-09-20T12:46:25.361Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5445lb # [ 80.184631] niks3-server[999]: 2026/09/20 12:46:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5446worker1 # [ 80.251503] nix-grpc-daemon[1294]: time=2026-09-20T12:46:25.397Z level=INFO msg="Uploading 1 narinfos"5447lb # [ 80.193430] niks3-server[999]: 2026/09/20 12:46:25 INFO Signed narinfos id=27 count=15448lb # [ 80.200347] niks3-server[999]: 2026/09/20 12:46:25 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5449lb # [ 80.206169] niks3-server[999]: 2026/09/20 12:46:25 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5450lb # [ 80.217752] niks3-server[999]: 2026/09/20 12:46:25 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5451lb # [ 80.225252] niks3-server[999]: 2026/09/20 12:46:25 INFO Completed upload id=275452worker1 # [ 80.282555] nix-grpc-daemon[1294]: time=2026-09-20T12:46:25.428Z level=INFO msg="Upload complete. (428ms)"5453lb # [ 80.227563] niks3-server[999]: 2026/09/20 12:46:25 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5454worker1 # [ 80.287644] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=0 paths=1 nar_bytes_in=5205455worker1 # [ 80.292489] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105456worker1 # [ 80.300649] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5457worker1 # [ 80.304422] nix-daemon[844]: reaped child process 1292, status = succeeded5458worker1 # [ 80.309108] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5459client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5460client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5461client # farm-a> LOG-farm-a-on-standby5462worker1 # [ 81.122977] nix-daemon[844]: reaped child process 1319, status = succeeded5463worker1 # [ 81.252466] nix-daemon[844]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)5464worker1 # [ 81.264585] nix-daemon[844]: reaped child process 1337, status = succeeded5465lb # [ 81.225222] niks3-server[999]: 2026/09/20 12:46:26 INFO Received uploads request method=POST path=/api/pending_closures5466worker1 # [ 81.321177] nix-grpc-daemon[1294]: time=2026-09-20T12:46:26.467Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5467worker1 # [ 81.323337] nix-grpc-daemon[1294]: time=2026-09-20T12:46:26.469Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5468lb # [ 81.285089] niks3-server[999]: 2026/09/20 12:46:26 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5469lb # [ 81.304408] niks3-server[999]: 2026/09/20 12:46:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5470lb # [ 81.311561] niks3-server[999]: 2026/09/20 12:46:26 INFO Signed narinfos id=28 count=15471worker1 # [ 81.373210] nix-grpc-daemon[1294]: time=2026-09-20T12:46:26.518Z level=INFO msg="Uploading 1 narinfos"5472lb # [ 81.328359] niks3-server[999]: 2026/09/20 12:46:26 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5473lb # [ 81.334628] niks3-server[999]: 2026/09/20 12:46:26 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5474lb # [ 81.340435] niks3-server[999]: 2026/09/20 12:46:26 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5475lb # [ 81.343425] niks3-server[999]: 2026/09/20 12:46:26 INFO Completed upload id=285476lb # [ 81.345095] niks3-server[999]: 2026/09/20 12:46:26 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5477worker1 # [ 81.401451] nix-grpc-daemon[1294]: time=2026-09-20T12:46:26.547Z level=INFO msg="Upload complete. (286ms)"5478worker1 # [ 81.412641] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15479worker1 # [ 81.429549] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:26Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05480worker1 # [ 81.433747] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:26Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15481worker1 # [ 81.440318] nix-daemon[844]: reaped child process 1317, status = succeeded5482worker1 # [ 81.473692] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105483worker1 # [ 81.485692] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505105484worker1 # [ 81.497936] nix-grpc-daemon[1294]: time=2026-09-20T12:46:26.644Z level=INFO msg="All 1 paths already cached"5485client # copying 1 paths to 'lb:50051'...5486client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5487worker1 # [ 81.506073] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505105488worker1 # [ 81.514448] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5489worker1 # [ 81.686336] nix-daemon[844]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5490worker1 # [ 81.698679] nix-daemon[844]: reaped child process 1346, status = succeeded5491worker1 # [ 81.856599] nix-daemon[844]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5492worker1 # [ 81.868591] nix-daemon[844]: reaped child process 1351, status = succeeded5493lb # [ 81.826297] niks3-server[999]: 2026/09/20 12:46:26 INFO Received uploads request method=POST path=/api/pending_closures5494worker1 # [ 81.892603] nix-grpc-daemon[1294]: time=2026-09-20T12:46:27.039Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5495worker1 # [ 81.894170] nix-grpc-daemon[1294]: time=2026-09-20T12:46:27.040Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5496lb # [ 81.863113] niks3-server[999]: 2026/09/20 12:46:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5497worker1 # [ 81.925707] nix-grpc-daemon[1294]: time=2026-09-20T12:46:27.072Z level=INFO msg="Uploading 1 narinfos"5498lb # [ 81.868175] niks3-server[999]: 2026/09/20 12:46:26 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5499lb # [ 81.873277] niks3-server[999]: 2026/09/20 12:46:26 INFO Signed narinfos id=29 count=15500lb # [ 81.883539] niks3-server[999]: 2026/09/20 12:46:26 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5501lb # [ 82.007470] niks3-server[999]: 2026/09/20 12:46:27 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5502lb # [ 82.017064] niks3-server[999]: 2026/09/20 12:46:27 INFO Completed upload id=295503worker1 # [ 82.074969] nix-grpc-daemon[1294]: time=2026-09-20T12:46:27.221Z level=INFO msg="Upload complete. (547ms)"5504worker1 # [ 82.080162] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=0 paths=1 nar_bytes_in=6405505lb # [ 82.028073] niks3-server[999]: 2026/09/20 12:46:27 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5506worker1 # [ 82.086471] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105507worker1 # [ 82.100130] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5508worker1 # [ 82.110634] nix-daemon[844]: reaped child process 1341, status = succeeded5509client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5510client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5511worker1 # [ 82.119166] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5512client # farm-b> LOG-farm-b-on-standby5513worker1 # [ 82.935675] nix-daemon[844]: reaped child process 1355, status = succeeded5514worker1 # [ 83.092722] nix-daemon[844]: accepted connection from pid 1370, user nix-grpc-daemon (trusted)5515worker1 # [ 83.103629] nix-daemon[844]: reaped child process 1373, status = succeeded5516lb # [ 83.064407] niks3-server[999]: 2026/09/20 12:46:28 INFO Received uploads request method=POST path=/api/pending_closures5517worker1 # [ 83.134120] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.280Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5518worker1 # [ 83.136442] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.282Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5519lb # [ 83.103915] niks3-server[999]: 2026/09/20 12:46:28 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5520lb # [ 83.120447] niks3-server[999]: 2026/09/20 12:46:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5521lb # [ 83.125986] niks3-server[999]: 2026/09/20 12:46:28 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5522lb # [ 83.130077] niks3-server[999]: 2026/09/20 12:46:28 INFO Signed narinfos id=30 count=15523worker1 # [ 83.190401] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.336Z level=INFO msg="Uploading 1 narinfos"5524lb # [ 83.136328] niks3-server[999]: 2026/09/20 12:46:28 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5525lb # [ 83.143216] niks3-server[999]: 2026/09/20 12:46:28 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5526lb # [ 83.154041] niks3-server[999]: 2026/09/20 12:46:28 INFO Completed upload id=305527worker1 # [ 83.212052] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.358Z level=INFO msg="Upload complete. (285ms)"5528lb # [ 83.160608] niks3-server[999]: 2026/09/20 12:46:28 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5529worker1 # [ 83.222198] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15530worker1 # [ 83.230450] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05531worker1 # [ 83.235233] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15532worker1 # [ 83.243940] nix-daemon[844]: reaped child process 1353, status = succeeded5533worker1 # [ 83.273708] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105534worker1 # [ 83.286523] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505105535worker1 # [ 83.306442] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.452Z level=INFO msg="All 2 paths already cached"5536client # copying 1 paths to 'lb:50051'...5537client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5538worker1 # [ 83.315599] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505105539worker1 # [ 83.323578] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5540worker1 # [ 83.474171] nix-daemon[844]: accepted connection from pid 1379, user nix-grpc-daemon (trusted)5541worker1 # [ 83.486622] nix-daemon[844]: reaped child process 1382, status = succeeded5542worker1 # [ 83.620435] nix-daemon[844]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5543worker1 # [ 83.632976] nix-daemon[844]: reaped child process 1387, status = succeeded5544lb # [ 83.591131] niks3-server[999]: 2026/09/20 12:46:28 INFO Received uploads request method=POST path=/api/pending_closures5545worker1 # [ 83.657888] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.804Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5546worker1 # [ 83.659696] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.805Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5547lb # [ 83.619737] niks3-server[999]: 2026/09/20 12:46:28 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5548lb # [ 83.632829] niks3-server[999]: 2026/09/20 12:46:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5549worker1 # [ 83.698597] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.844Z level=INFO msg="Uploading 1 narinfos"5550lb # [ 83.640503] niks3-server[999]: 2026/09/20 12:46:28 INFO Signed narinfos id=31 count=15551lb # [ 83.644213] niks3-server[999]: 2026/09/20 12:46:28 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5552lb # [ 83.657292] niks3-server[999]: 2026/09/20 12:46:28 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5553lb # [ 83.661756] niks3-server[999]: 2026/09/20 12:46:28 INFO Completed upload id=315554worker1 # [ 83.719707] nix-grpc-daemon[1294]: time=2026-09-20T12:46:28.866Z level=INFO msg="Upload complete. (382ms)"5555lb # [ 83.663722] niks3-server[999]: 2026/09/20 12:46:28 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5556worker1 # [ 83.723201] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=0 paths=1 nar_bytes_in=7685557worker1 # [ 83.728647] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105558worker1 # [ 83.738106] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5559worker1 # [ 83.742506] nix-daemon[844]: reaped child process 1377, status = succeeded5560worker1 # [ 83.747802] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5561client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5562client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5563client # farm-top> LOG-farm-top-on-standby5564worker1 # [ 84.562312] nix-daemon[844]: reaped child process 1391, status = succeeded5565worker1 # [ 84.714137] nix-daemon[844]: accepted connection from pid 1406, user nix-grpc-daemon (trusted)5566worker1 # [ 84.727251] nix-daemon[844]: reaped child process 1409, status = succeeded5567lb # [ 84.687519] niks3-server[999]: 2026/09/20 12:46:29 INFO Received uploads request method=POST path=/api/pending_closures5568worker1 # [ 84.753367] nix-grpc-daemon[1294]: time=2026-09-20T12:46:29.899Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5569worker1 # [ 84.755025] nix-grpc-daemon[1294]: time=2026-09-20T12:46:29.901Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5570lb # [ 84.718904] niks3-server[999]: 2026/09/20 12:46:29 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5571lb # [ 84.734126] niks3-server[999]: 2026/09/20 12:46:29 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5572lb # [ 84.742460] niks3-server[999]: 2026/09/20 12:46:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5573lb # [ 84.749505] niks3-server[999]: 2026/09/20 12:46:29 INFO Signed narinfos id=32 count=15574worker1 # [ 84.809669] nix-grpc-daemon[1294]: time=2026-09-20T12:46:29.955Z level=INFO msg="Uploading 1 narinfos"5575lb # [ 84.753385] niks3-server[999]: 2026/09/20 12:46:29 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5576lb # [ 84.762882] niks3-server[999]: 2026/09/20 12:46:29 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5577lb # [ 84.767946] niks3-server[999]: 2026/09/20 12:46:29 INFO Completed upload id=325578worker1 # [ 84.825957] nix-grpc-daemon[1294]: time=2026-09-20T12:46:29.972Z level=INFO msg="Upload complete. (270ms)"5579lb # [ 84.771249] niks3-server[999]: 2026/09/20 12:46:29 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5580worker1 # [ 84.834303] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15581worker1 # [ 84.846408] nix-daemon[844]: reaped child process 1389, status = succeeded5582client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.00 seconds)5583client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5584client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.18 seconds)5585worker2 # [ 85.074452] systemd[1]: Listening on Nix worker-protocol over gRPC.5586worker2 # [ 85.080958] systemd[1]: Starting scheduler-token.service...5587worker2 # [ 85.146959] systemd[1]: scheduler-token.service: Deactivated successfully.5588worker2 # [ 85.148531] systemd[1]: Finished scheduler-token.service.5589worker2 # [ 85.149996] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 67ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5590worker2 # [ 85.155504] systemd[1]: Starting Nix worker-protocol over gRPC...5591worker2 # [ 85.316888] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5592worker2 # [ 85.318606] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5593worker2 # [ 85.321883] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15594worker2 # [ 85.329107] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5595worker2 # [ 85.334335] systemd[1]: Started Nix worker-protocol over gRPC.5596lb: must succeed: curl -sf localhost:9901/clusters5597worker2 # [ 85.347700] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:30Z level=info event=scheduler_connected addr=lb:500515598worker1 # [ 85.390265] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:30Z level=info event=oidc_jwks provider=mock keys=15599worker1 # [ 85.394750] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:30Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:505025600worker1 # [ 85.398719] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05601lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5602worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5603worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5604lb: must succeed: curl -sf localhost:9901/clusters5605lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5606lb: must succeed: curl -sf localhost:9901/clusters5607lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5608worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5609worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5610(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.54 seconds)5611subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5612client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5613client # [ 85.722975] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5614client # Running as unit: rs.service; invocation ID: edfe26ae1db2458398c7a11669969d135615client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.08 seconds)5616worker2 # [ 85.936978] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492525617worker2 # [ 85.949282] nix-daemon[865]: accepted connection from pid 1196, user nix-grpc-daemon (trusted)5618client # [ 85.964920] nix[1179]: don't know how to build these paths:5619client # [ 85.965901] nix[1179]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5620worker1 # [ 86.003908] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:31Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05621worker1 # [ 86.006139] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:31Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15622worker1 # [ 86.049074] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105623worker1 # [ 86.060962] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505105624client # [ 86.039445] nix[1179]: copying 1 paths to 'lb:50051'...5625worker1 # [ 86.071836] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505105626client # [ 86.042148] nix[1179]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5627worker1 # [ 86.084470] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5628worker1 # [ 86.246648] nix-daemon[844]: accepted connection from pid 1422, user nix-grpc-daemon (trusted)5629worker1 # [ 86.258559] nix-daemon[844]: reaped child process 1425, status = succeeded5630worker1 # [ 86.391153] nix-daemon[844]: accepted connection from pid 1427, user nix-grpc-daemon (trusted)5631worker1 # [ 86.403192] nix-daemon[844]: reaped child process 1430, status = succeeded5632lb # [ 86.362407] niks3-server[999]: 2026/09/20 12:46:31 INFO Received uploads request method=POST path=/api/pending_closures5633worker1 # [ 86.430236] nix-grpc-daemon[1294]: time=2026-09-20T12:46:31.576Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5634worker1 # [ 86.431757] nix-grpc-daemon[1294]: time=2026-09-20T12:46:31.578Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5635lb # [ 86.398186] niks3-server[999]: 2026/09/20 12:46:31 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5636lb # [ 86.407410] niks3-server[999]: 2026/09/20 12:46:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5637lb # [ 86.411579] niks3-server[999]: 2026/09/20 12:46:31 INFO Signed narinfos id=33 count=15638worker1 # [ 86.471827] nix-grpc-daemon[1294]: time=2026-09-20T12:46:31.618Z level=INFO msg="Uploading 1 narinfos"5639lb # [ 86.423536] niks3-server[999]: 2026/09/20 12:46:31 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5640lb # [ 86.427914] niks3-server[999]: 2026/09/20 12:46:31 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5641lb # [ 86.430703] niks3-server[999]: 2026/09/20 12:46:31 INFO Completed upload id=335642worker1 # [ 86.488486] nix-grpc-daemon[1294]: time=2026-09-20T12:46:31.634Z level=INFO msg="Upload complete. (393ms)"5643lb # [ 86.433331] niks3-server[999]: 2026/09/20 12:46:31 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5644worker1 # [ 86.492244] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=0 paths=1 nar_bytes_in=4165645worker1 # [ 86.497269] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505105646worker1 # [ 86.507108] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5647worker1 # [ 86.511575] nix-daemon[844]: reaped child process 1420, status = succeeded5648client # [ 86.484421] nix[1179]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5649worker1 # [ 86.516548] nix-daemon[844]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5650lb # [ 87.871163] envoy[928]: conn peer=[2001:db8:1::1]:33790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=3859 ms=57545651lb: must succeed: curl -sf localhost:9901/clusters5652lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5653lb: must succeed: curl -sf localhost:9901/clusters5654lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5655lb: must succeed: curl -sf localhost:9901/clusters5656lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5657lb: must succeed: curl -sf localhost:9901/clusters5658lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5659worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5660worker2 # [ 88.542922] systemd-journald[287]: Received client request to rotate journal, rotating.5661worker2 # [ 88.559227] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/247d08b27f3d4a7cbce1ec7cd5986b93.5662worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5663worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5664worker1 # [ 88.511800] systemd[1]: Stopping Nix worker-protocol over gRPC...5665worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5666client: must succeed: sleep 5.05667worker1 # [ 89.025317] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:34Z level=info event=draining5668client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5669worker1 # [ 93.736669] nix-daemon[844]: reaped child process 1434, status = succeeded5670worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5671worker1 # [ 93.894088] nix-daemon[844]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)5672worker1 # [ 93.904711] nix-daemon[844]: reaped child process 1477, status = succeeded5673lb # [ 93.863896] niks3-server[999]: 2026/09/20 12:46:38 INFO Received uploads request method=POST path=/api/pending_closures5674worker1 # [ 93.930046] nix-grpc-daemon[1294]: time=2026-09-20T12:46:39.076Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5675worker1 # [ 93.931501] nix-grpc-daemon[1294]: time=2026-09-20T12:46:39.077Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5676lb # [ 93.902580] niks3-server[999]: 2026/09/20 12:46:39 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5677lb # [ 93.914053] niks3-server[999]: 2026/09/20 12:46:39 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5678lb # [ 93.922902] niks3-server[999]: 2026/09/20 12:46:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5679worker1 # [ 93.986714] nix-grpc-daemon[1294]: time=2026-09-20T12:46:39.132Z level=INFO msg="Uploading 1 narinfos"5680lb # [ 93.928808] niks3-server[999]: 2026/09/20 12:46:39 INFO Signed narinfos id=34 count=15681lb # [ 93.932981] niks3-server[999]: 2026/09/20 12:46:39 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5682lb # [ 93.942580] niks3-server[999]: 2026/09/20 12:46:39 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5683lb # [ 93.947748] niks3-server[999]: 2026/09/20 12:46:39 INFO Completed upload id=345684lb # [ 93.950699] niks3-server[999]: 2026/09/20 12:46:39 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5685worker1 # [ 94.007299] nix-grpc-daemon[1294]: time=2026-09-20T12:46:39.153Z level=INFO msg="Upload complete. (278ms)"5686worker1 # [ 94.015469] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50510 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15687worker1 # [ 94.027381] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=signal_exit5688worker1 # [ 94.029939] nix-daemon[844]: reaped child process 1432, status = succeeded5689client # [ 94.015822] systemd[1]: rs.service: Deactivated successfully.5690client # [ 94.019221] systemd[1]: rs.service: Consumed 109ms CPU time over 8.295s wall clock time, 37.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5691worker1 # [ 94.254362] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=scheduler_yield5692lb # [ 94.199087] niks3-server[999]: 2026/09/20 12:46:39 INFO lead: released remote=192.168.1.3:442405693worker1 # [ 94.259885] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=scheduler_restarting addr=lb:500515694worker2 # [ 94.227955] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:39Z level=info event=scheduler_restarting addr=lb:500515695worker1 # [ 94.263867] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:505025696worker1 # [ 94.267676] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=worker_gone addr=192.168.1.3:500515697worker1 # [ 94.270704] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:505025698worker1 # [ 94.273935] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=worker_gone addr=192.168.1.4:500515699worker1 # [ 94.460932] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500515700worker2 # [ 94.428451] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500515701worker1 # [ 94.465124] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5702worker2 # [ 94.433153] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5703worker1 # [ 94.665789] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500515704worker2 # [ 94.634664] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500515705worker1 # [ 94.670106] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5706worker2 # [ 94.638367] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5707worker2 # [ 94.835822] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515708worker1 # [ 94.870794] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515709worker1 # [ 94.874683] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5710worker2 # [ 94.841402] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5711worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.10 seconds)5712client: waiting for success: ! systemctl is-active rs5713client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5714client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5715client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5716client: must fail: journalctl -u rs | grep -q 'reconnecting'5717client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5718lb: must succeed: curl -sf localhost:9901/clusters5719worker1 # [ 95.072441] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515720worker1 # [ 95.076330] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5721worker2 # [ 95.041599] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515722lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5723worker2 # [ 95.046118] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5724worker1 # [ 95.259140] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:40Z level=info event=scheduler_restarting5725worker2 # [ 95.248423] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515726worker2 # [ 95.252147] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5727worker1 # [ 95.288459] nix-grpc-daemon[1215]: ts=2026-09-20T12:46:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5728worker1 # [ 95.295991] nix-daemon[844]: reaped child process 1285, status = succeeded5729worker1 # [ 95.311336] nix-grpc-daemon[1215]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5730worker1 # [ 95.314740] nix-grpc-daemon[1215]: E0000 00:00:1789908400.457621 1258 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5731worker1 # [ 95.319608] nix-grpc-daemon[1215]: E0000 00:00:1789908400.457726 1258 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5732lb # [ 95.314275] niks3-server[999]: 2026/09/20 12:46:40 INFO lead: acquired remote=192.168.1.4:435805733worker2 # [ 95.340537] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_take_over5734worker2 # [ 95.448718] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515735worker2 # [ 95.450502] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5736worker1 # [ 95.552556] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5737worker1 # [ 95.556752] systemd[1]: Stopped Nix worker-protocol over gRPC.5738worker1 # [ 95.558778] systemd[1]: nix-grpc-daemon.service: Consumed 1.255s CPU time over 22.671s wall clock time, 33.5M memory peak, 48.7K incoming IP traffic, 94.5K outgoing IP traffic.5739worker1 # [ 95.572779] systemd[1]: Starting Nix worker-protocol over gRPC...5740worker2 # [ 95.651251] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515741worker2 # [ 95.652992] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5742worker1 # [ 95.727364] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5743worker1 # [ 95.729975] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5744worker1 # [ 95.733603] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15745worker1 # [ 95.740063] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5746worker1 # [ 95.743571] systemd[1]: Started Nix worker-protocol over gRPC.5747worker1 # [ 95.755562] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500515748worker2 # [ 95.726926] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:463705749worker2 # [ 95.731658] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05750worker2 # [ 95.853668] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500515751worker2 # [ 95.860061] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:41Z level=info event=oidc_jwks provider=mock keys=15752worker2 # [ 95.861757] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:41Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:463705753worker2 # [ 95.863324] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05754lb: must succeed: curl -sf localhost:9901/clusters5755lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5756worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5757worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5758(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.52 seconds)5759subtest: scheduler restart mid-build: build finishes, no double build5760client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5761client # [ 96.232970] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5762client # Running as unit: mid.service; invocation ID: 3464b5aa453a46118826506662d1bf645763client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.05 seconds)5764worker2 # [ 96.430142] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492525765client # [ 96.437865] nix[1215]: don't know how to build these paths:5766client # [ 96.438889] nix[1215]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5767worker2 # [ 96.443151] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:41Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05768worker2 # [ 96.447266] nix-grpc-daemon[1196]: ts=2026-09-20T12:46:41Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15769worker1 # [ 96.528176] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:367885770worker1 # [ 96.546460] nix-daemon[844]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5771worker1 # [ 96.562894] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5)5772worker1 # [ 96.612738] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5)5773worker1 # [ 96.661451] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 3/5)5774worker1 # [ 96.766080] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 617 ms (attempt 4/5)5775worker1 # [ 97.384151] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5776worker1 # [ 97.402986] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:367885777client # [ 97.383764] nix[1215]: copying 1 paths to 'lb:50051'...5778client # [ 97.386066] nix[1215]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5779worker1 # [ 97.416610] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:367885780worker1 # [ 97.429142] nix-daemon[844]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5781worker1 # [ 97.455803] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:42Z level=info event=niks3_push_started pid=15485782worker1 # [ 97.646327] nix-grpc-daemon[1548]: time=2026-09-20T12:46:42.792Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5783worker1 # [ 97.798889] nix-daemon[844]: accepted connection from pid 1561, user nix-grpc-daemon (trusted)5784worker1 # [ 97.812320] nix-daemon[844]: reaped child process 1564, status = succeeded5785lb # [ 97.871427] envoy[928]: conn peer=[2001:db8:1::1]:55822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1308 ms=80595786lb # [ 97.875185] envoy[928]: conn peer=[2001:db8:1::3]:56368 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5568 tx=1315 ms=222485787worker1 # [ 97.968092] nix-daemon[844]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)5788worker1 # [ 97.980674] nix-daemon[844]: reaped child process 1569, status = succeeded5789lb # [ 97.934067] niks3-server[999]: 2026/09/20 12:46:43 INFO Received uploads request method=POST path=/api/pending_closures5790worker1 # [ 98.002694] nix-grpc-daemon[1548]: time=2026-09-20T12:46:43.148Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5791worker1 # [ 98.004327] nix-grpc-daemon[1548]: time=2026-09-20T12:46:43.148Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5792lb # [ 97.972745] niks3-server[999]: 2026/09/20 12:46:43 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5793lb # [ 97.981776] niks3-server[999]: 2026/09/20 12:46:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5794lb # [ 97.988847] niks3-server[999]: 2026/09/20 12:46:43 INFO Signed narinfos id=35 count=15795worker1 # [ 98.049708] nix-grpc-daemon[1548]: time=2026-09-20T12:46:43.195Z level=INFO msg="Uploading 1 narinfos"5796lb # [ 98.001534] niks3-server[999]: 2026/09/20 12:46:43 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5797lb # [ 98.008696] niks3-server[999]: 2026/09/20 12:46:43 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5798lb # [ 98.014122] niks3-server[999]: 2026/09/20 12:46:43 INFO Completed upload id=355799lb # [ 98.015966] niks3-server[999]: 2026/09/20 12:46:43 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5800worker1 # [ 98.073266] nix-grpc-daemon[1548]: time=2026-09-20T12:46:43.219Z level=INFO msg="Upload complete. (423ms)"5801worker1 # [ 98.077712] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36788 duration_s=0 paths=1 nar_bytes_in=4245802worker1 # [ 98.083394] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:367885803worker1 # [ 98.091773] nix-daemon[844]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5804worker1 # [ 98.100297] nix-daemon[844]: reaped child process 1545, status = succeeded5805worker1 # [ 98.104392] nix-daemon[844]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5806client # [ 98.073319] nix[1215]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5807lb: must succeed: curl -sf localhost:9901/clusters5808lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5809lb: must succeed: curl -sf localhost:9901/clusters5810lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5811worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5812worker2 # [ 100.029747] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1196 (nix-grpc-daemon) on client request.5813lb # [ 100.018569] niks3-server[999]: 2026/09/20 12:46:45 INFO lead: released remote=192.168.1.4:435805814worker2 # [ 100.046238] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5815worker1 # [ 100.086951] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5816client # [ 100.056516] nix[1215]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5817worker2 # [ 100.061693] nix-daemon[865]: reaped child process 1252, status = succeeded5818worker2 # [ 100.068676] systemd[1]: Starting scheduler-token.service...5819worker2 # [ 100.075212] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5820worker2 # [ 100.076723] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5821worker2 # [ 100.079658] systemd[1]: nix-grpc-daemon.service: Consumed 192ms CPU time over 14.918s wall clock time, 11.4M memory peak, 11.7K incoming IP traffic, 23.2K outgoing IP traffic.5822worker2 # [ 100.142063] systemd[1]: scheduler-token.service: Deactivated successfully.5823worker2 # [ 100.143347] systemd[1]: Finished scheduler-token.service.5824worker2 # [ 100.144992] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 73ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5825worker2 # [ 100.147601] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5826worker2 # [ 100.152075] systemd[1]: Starting scheduler-token.service...5827worker2 # [ 100.213074] systemd[1]: scheduler-token.service: Deactivated successfully.5828worker2 # [ 100.215360] systemd[1]: Finished scheduler-token.service.5829worker2 # [ 100.216156] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 60ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5830worker2 # [ 100.220945] systemd[1]: Starting Nix worker-protocol over gRPC...5831worker1 # [ 100.287252] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:45Z level=info event=scheduler_connected addr=lb:500515832worker2 # [ 100.372860] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5833worker2 # [ 100.374593] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5834worker2 # [ 100.377850] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15835worker2 # [ 100.384820] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5836worker2 # [ 100.386407] systemd[1]: Started Nix worker-protocol over gRPC.5837worker2 # [ 100.396671] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=scheduler_take_over5838worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.41 seconds)5839lb # [ 100.372546] niks3-server[999]: 2026/09/20 12:46:45 INFO lead: acquired remote=192.168.1.4:421665840client: must succeed: sleep 5.05841worker2 # [ 100.404328] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:463865842worker2 # [ 100.406984] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15843worker2 # [ 100.409989] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=scheduler_connected addr=lb:500515844worker2 # [ 100.415449] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=oidc_jwks provider=mock keys=15845worker2 # [ 100.417097] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:463865846worker2 # [ 100.418893] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05847client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5848client: waiting for success: ! systemctl is-active mid5849worker1 # [ 105.724203] nix-daemon[844]: reaped child process 1573, status = succeeded5850worker1 # [ 105.883186] nix-daemon[844]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5851worker1 # [ 105.895519] nix-daemon[844]: reaped child process 1612, status = succeeded5852lb # [ 105.857305] niks3-server[999]: 2026/09/20 12:46:50 INFO Received uploads request method=POST path=/api/pending_closures5853worker1 # [ 105.922790] nix-grpc-daemon[1548]: time=2026-09-20T12:46:51.069Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5854worker1 # [ 105.925057] nix-grpc-daemon[1548]: time=2026-09-20T12:46:51.070Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5855lb # [ 105.892701] niks3-server[999]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5856lb # [ 105.912546] niks3-server[999]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5857lb # [ 105.916223] niks3-server[999]: 2026/09/20 12:46:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5858worker1 # [ 105.981029] nix-grpc-daemon[1548]: time=2026-09-20T12:46:51.126Z level=INFO msg="Uploading 1 narinfos"5859lb # [ 105.923441] niks3-server[999]: 2026/09/20 12:46:51 INFO Signed narinfos id=36 count=15860lb # [ 105.936774] niks3-server[999]: 2026/09/20 12:46:51 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5861lb # [ 105.941818] niks3-server[999]: 2026/09/20 12:46:51 INFO Completed upload id=365862worker1 # [ 105.999287] nix-grpc-daemon[1548]: time=2026-09-20T12:46:51.145Z level=INFO msg="Upload complete. (281ms)"5863lb # [ 105.949085] niks3-server[999]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5864worker1 # [ 106.003808] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36788 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15865lb # [ 105.954579] niks3-server[999]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5866worker1 # [ 106.016709] nix-daemon[844]: reaped child process 1571, status = succeeded5867client # [ 106.019339] systemd[1]: mid.service: Deactivated successfully.5868client # [ 106.023680] systemd[1]: mid.service: Consumed 122ms CPU time over 9.789s wall clock time, 39.3M memory peak, 9.1K incoming IP traffic, 9.3K outgoing IP traffic.5869client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)5870client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5871client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5872(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.63 seconds)5873subtest: interrupting the client stops the build on the worker5874client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5875client # [ 106.843458] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5876client # Running as unit: intr.service; invocation ID: 3d8a6e6b14a3484e9990f6a1eea750e85877client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5878worker2 # [ 107.047342] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406445879worker2 # [ 107.059104] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5880client # [ 107.074230] nix[1251]: don't know how to build these paths:5881client # [ 107.075124] nix[1251]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5882worker2 # [ 107.082160] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:52Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05883worker2 # [ 107.086325] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:52Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15884worker2 # [ 107.135127] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406445885worker2 # [ 107.147381] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 1/5)5886worker2 # [ 107.181253] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 177 ms (attempt 2/5)5887worker2 # [ 107.363899] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 322 ms (attempt 3/5)5888worker2 # [ 107.691949] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 4/5)5889lb # [ 107.871184] envoy[928]: conn peer=[2001:db8:1::4]:49920 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7778 tx=551 ms=147095890lb # [ 107.875081] envoy[928]: conn peer=[2001:db8:1::1]:38552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3031 tx=1422 ms=95565891worker2 # [ 107.918235] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5892worker2 # [ 107.936136] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406445893client # [ 107.949222] nix[1251]: copying 1 paths to 'lb:50051'...5894worker2 # [ 107.948702] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406445895client # [ 107.952159] nix[1251]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5896worker2 # [ 107.959307] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5897worker2 # [ 108.482885] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:53Z level=info event=niks3_push_started pid=14045898worker2 # [ 108.692698] nix-grpc-daemon[1404]: time=2026-09-20T12:46:53.892Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5899worker2 # [ 108.847583] nix-daemon[865]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5900worker2 # [ 108.858573] nix-daemon[865]: reaped child process 1420, status = succeeded5901worker2 # [ 109.005670] nix-daemon[865]: accepted connection from pid 1422, user nix-grpc-daemon (trusted)5902worker2 # [ 109.018181] nix-daemon[865]: reaped child process 1425, status = succeeded5903lb # [ 109.011330] niks3-server[999]: 2026/09/20 12:46:54 INFO Received uploads request method=POST path=/api/pending_closures5904worker2 # [ 109.046540] nix-grpc-daemon[1404]: time=2026-09-20T12:46:54.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5905worker2 # [ 109.048136] nix-grpc-daemon[1404]: time=2026-09-20T12:46:54.248Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5906lb # [ 109.047146] niks3-server[999]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5907lb # [ 109.057891] niks3-server[999]: 2026/09/20 12:46:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5908lb # [ 109.063405] niks3-server[999]: 2026/09/20 12:46:54 INFO Signed narinfos id=37 count=15909worker2 # [ 109.090909] nix-grpc-daemon[1404]: time=2026-09-20T12:46:54.290Z level=INFO msg="Uploading 1 narinfos"5910lb # [ 109.073519] niks3-server[999]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5911lb # [ 109.084410] niks3-server[999]: 2026/09/20 12:46:54 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5912lb # [ 109.091568] niks3-server[999]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5913lb # [ 109.095683] niks3-server[999]: 2026/09/20 12:46:54 INFO Completed upload id=375914worker2 # [ 109.120390] nix-grpc-daemon[1404]: time=2026-09-20T12:46:54.320Z level=INFO msg="Upload complete. (424ms)"5915worker2 # [ 109.124364] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 paths=1 nar_bytes_in=4245916worker2 # [ 109.131338] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406445917worker2 # [ 109.141111] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5918worker2 # [ 109.149406] nix-daemon[865]: reaped child process 1398, status = succeeded5919worker2 # [ 109.153570] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5920client # [ 109.155600] nix[1251]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5921client: must succeed: systemctl kill -s INT intr5922client # [ 110.379641] systemd[1]: intr.service: Sent signal SIGINT to main process 1251 (nix) on client request.5923worker2 # [ 110.384559] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:55Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5924client # [ 110.387244] nix[1251]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5925client: (finished: must succeed: systemctl kill -s INT intr, in 0.06 seconds)5926client # [ 110.393688] nix[1251]: error: interrupted by the user5927client # [ 110.425728] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5928client # [ 110.427440] systemd[1]: intr.service: Failed with result 'exit-code'.5929client # [ 110.429552] systemd[1]: intr.service: Consumed 111ms CPU time over 3.583s wall clock time, 39.3M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5930worker2 # [ 110.572269] nix-daemon[865]: reaped child process 1427, status = succeeded5931worker2 # [ 110.575231] nix-daemon[1429]: unexpected Nix daemon error: error: interrupted by the user5932worker2 # [ 110.579691] nix-daemon[865]: reaped child process 1429, status = failed with exit code 15933(finished: subtest: interrupting the client stops the build on the worker, in 4.84 seconds)5934subtest: a deploy mid-build drains: the build finishes, the new generation takes over5935client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5936client # [ 111.705504] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5937client # Running as unit: sw.service; invocation ID: 0371369021354fb28d10e2db97733fe85938client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5939client # [ 111.906193] nix[1272]: don't know how to build these paths:5940client # [ 111.907088] nix[1272]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5941worker2 # [ 111.903247] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406445942worker2 # [ 111.917079] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:57Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05943worker2 # [ 111.921321] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:57Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=15944worker1 # [ 111.996361] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:367885945worker1 # [ 112.008649] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:367885946client # [ 111.987353] nix[1272]: copying 1 paths to 'lb:50051'...5947worker1 # [ 112.019818] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:367885948client # [ 111.990158] nix[1272]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5949worker1 # [ 112.032865] nix-daemon[844]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5950worker1 # [ 112.218421] nix-daemon[844]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)5951worker1 # [ 112.230384] nix-daemon[844]: reaped child process 1647, status = succeeded5952worker1 # [ 112.400994] nix-daemon[844]: accepted connection from pid 1649, user nix-grpc-daemon (trusted)5953worker1 # [ 112.411854] nix-daemon[844]: reaped child process 1652, status = succeeded5954lb # [ 112.372643] niks3-server[999]: 2026/09/20 12:46:57 INFO Received uploads request method=POST path=/api/pending_closures5955worker1 # [ 112.441685] nix-grpc-daemon[1548]: time=2026-09-20T12:46:57.587Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5956worker1 # [ 112.443914] nix-grpc-daemon[1548]: time=2026-09-20T12:46:57.587Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5957lb # [ 112.396363] niks3-server[999]: 2026/09/20 12:46:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5958lb # [ 112.399496] niks3-server[999]: 2026/09/20 12:46:57 INFO Signed narinfos id=38 count=15959worker1 # [ 112.459268] nix-grpc-daemon[1548]: time=2026-09-20T12:46:57.605Z level=INFO msg="Uploading 1 narinfos"5960lb # [ 112.407439] niks3-server[999]: 2026/09/20 12:46:57 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5961lb # [ 112.419939] niks3-server[999]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5962lb # [ 112.423831] niks3-server[999]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5963lb # [ 112.426651] niks3-server[999]: 2026/09/20 12:46:57 INFO Completed upload id=385964worker1 # [ 112.484300] nix-grpc-daemon[1548]: time=2026-09-20T12:46:57.630Z level=INFO msg="Upload complete. (439ms)"5965lb # [ 112.429134] niks3-server[999]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5966worker1 # [ 112.486535] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36788 duration_s=0 paths=1 nar_bytes_in=4165967worker1 # [ 112.489674] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:367885968worker1 # [ 112.496260] nix-daemon[844]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5969worker1 # [ 112.498802] nix-daemon[844]: reaped child process 1642, status = succeeded5970worker1 # [ 112.503564] nix-daemon[844]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5971client # [ 112.471501] nix[1272]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5972worker1: must succeed: systemctl reload nix-grpc-daemon.service5973worker1 # [ 114.288778] systemd[1]: Reloading Nix worker-protocol over gRPC...5974worker1 # [ 114.334704] systemd[1]: Reloaded Nix worker-protocol over gRPC.5975worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.09 seconds)5976worker1: must succeed: pgrep -f 'read -t [9]0 x'5977worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5978client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25979worker2 # [ 114.536244] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406445980client # don't know how to build these paths:5981client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5982worker2 # [ 114.544823] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406445983worker2 # [ 114.567062] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:59Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05984worker2 # [ 114.572735] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:59Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=15985worker2 # [ 114.615683] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406445986worker2 # [ 114.627975] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406445987client # copying 1 paths to 'lb:50051'...5988worker2 # [ 114.640739] nix-grpc-daemon[1330]: ts=2026-09-20T12:46:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406445989client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5990worker2 # [ 114.663305] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5991worker1 # [ 114.750061] nix-grpc-daemon[1484]: ts=2026-09-20T12:46:59Z level=info event=draining5992worker2 # [ 114.849121] nix-daemon[865]: accepted connection from pid 1483, user nix-grpc-daemon (trusted)5993worker2 # [ 114.861461] nix-daemon[865]: reaped child process 1486, status = succeeded5994worker2 # [ 115.032540] nix-daemon[865]: accepted connection from pid 1488, user nix-grpc-daemon (trusted)5995worker2 # [ 115.045078] nix-daemon[865]: reaped child process 1491, status = succeeded5996lb # [ 115.034814] niks3-server[999]: 2026/09/20 12:47:00 INFO Received uploads request method=POST path=/api/pending_closures5997worker2 # [ 115.067685] nix-grpc-daemon[1404]: time=2026-09-20T12:47:00.267Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5998worker2 # [ 115.069210] nix-grpc-daemon[1404]: time=2026-09-20T12:47:00.269Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5999lb # [ 115.063651] niks3-server[999]: 2026/09/20 12:47:00 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6000lb # [ 115.076529] niks3-server[999]: 2026/09/20 12:47:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6001worker2 # [ 115.107939] nix-grpc-daemon[1404]: time=2026-09-20T12:47:00.307Z level=INFO msg="Uploading 1 narinfos"6002lb # [ 115.083409] niks3-server[999]: 2026/09/20 12:47:00 INFO Signed narinfos id=39 count=16003lb # [ 115.087561] niks3-server[999]: 2026/09/20 12:47:00 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6004lb # [ 115.100586] niks3-server[999]: 2026/09/20 12:47:00 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6005lb # [ 115.104911] niks3-server[999]: 2026/09/20 12:47:00 INFO Completed upload id=396006worker2 # [ 115.129188] nix-grpc-daemon[1404]: time=2026-09-20T12:47:00.329Z level=INFO msg="Upload complete. (453ms)"6007lb # [ 115.107439] niks3-server[999]: 2026/09/20 12:47:00 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6008worker2 # [ 115.133356] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=5286009worker2 # [ 115.138498] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446010worker2 # [ 115.148210] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6011worker2 # [ 115.154071] nix-daemon[865]: reaped child process 1481, status = succeeded6012worker2 # [ 115.158966] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6013client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6014client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6015client # farm-a> LOG-farm-a-during-drain6016worker2 # [ 115.992331] nix-daemon[865]: reaped child process 1495, status = succeeded6017worker2 # [ 116.156916] nix-daemon[865]: accepted connection from pid 1510, user nix-grpc-daemon (trusted)6018worker2 # [ 116.168255] nix-daemon[865]: reaped child process 1513, status = succeeded6019lb # [ 116.160771] niks3-server[999]: 2026/09/20 12:47:01 INFO Received uploads request method=POST path=/api/pending_closures6020worker2 # [ 116.193383] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.393Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6021worker2 # [ 116.194902] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.395Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6022lb # [ 116.199850] niks3-server[999]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6023lb # [ 116.205217] niks3-server[999]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6024lb # [ 116.218915] niks3-server[999]: 2026/09/20 12:47:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6025worker2 # [ 116.248510] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.448Z level=INFO msg="Uploading 1 narinfos"6026lb # [ 116.224136] niks3-server[999]: 2026/09/20 12:47:01 INFO Signed narinfos id=40 count=16027lb # [ 116.228892] niks3-server[999]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6028lb # [ 116.239411] niks3-server[999]: 2026/09/20 12:47:01 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6029lb # [ 116.244360] niks3-server[999]: 2026/09/20 12:47:01 INFO Completed upload id=406030lb # [ 116.247561] niks3-server[999]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6031worker2 # [ 116.270322] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.470Z level=INFO msg="Upload complete. (304ms)"6032worker2 # [ 116.281154] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=16033worker2 # [ 116.287445] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:01Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06034worker2 # [ 116.292201] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:01Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16035worker2 # [ 116.300844] nix-daemon[865]: reaped child process 1493, status = succeeded6036worker2 # [ 116.337531] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446037worker2 # [ 116.350702] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406446038worker2 # [ 116.365325] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.565Z level=INFO msg="All 1 paths already cached"6039client # copying 1 paths to 'lb:50051'...6040worker2 # [ 116.373478] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406446041client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6042worker2 # [ 116.391744] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6043worker2 # [ 116.541664] nix-daemon[865]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6044worker2 # [ 116.555590] nix-daemon[865]: reaped child process 1522, status = succeeded6045worker2 # [ 116.710634] nix-daemon[865]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6046worker2 # [ 116.723335] nix-daemon[865]: reaped child process 1527, status = succeeded6047lb # [ 116.712896] niks3-server[999]: 2026/09/20 12:47:01 INFO Received uploads request method=POST path=/api/pending_closures6048worker2 # [ 116.758222] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.958Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6049worker2 # [ 116.760556] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.960Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6050lb # [ 116.757826] niks3-server[999]: 2026/09/20 12:47:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6051lb # [ 116.763646] niks3-server[999]: 2026/09/20 12:47:01 INFO Signed narinfos id=41 count=16052worker2 # [ 116.790902] nix-grpc-daemon[1404]: time=2026-09-20T12:47:01.990Z level=INFO msg="Uploading 1 narinfos"6053lb # [ 116.768779] niks3-server[999]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6054lb # [ 116.784197] niks3-server[999]: 2026/09/20 12:47:01 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6055lb # [ 116.797161] niks3-server[999]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6056worker2 # [ 116.832984] nix-grpc-daemon[1404]: time=2026-09-20T12:47:02.033Z level=INFO msg="Upload complete. (426ms)"6057lb # [ 116.808684] niks3-server[999]: 2026/09/20 12:47:01 INFO Completed upload id=416058worker2 # [ 116.835028] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=6406059worker2 # [ 116.837806] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446060lb # [ 116.815453] niks3-server[999]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6061worker2 # [ 116.846142] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6062worker2 # [ 116.847441] nix-daemon[865]: reaped child process 1517, status = succeeded6063client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6064worker2 # [ 116.852934] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6065client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6066lb # [ 117.871713] envoy[928]: conn peer=[2001:db8:1::1]:59210 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=734 ms=33586067client # farm-b> LOG-farm-b-during-drain6068worker2 # [ 118.067115] nix-daemon[865]: reaped child process 1531, status = succeeded6069worker2 # [ 118.201942] nix-daemon[865]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6070worker2 # [ 118.214190] nix-daemon[865]: reaped child process 1549, status = succeeded6071lb # [ 118.205327] niks3-server[999]: 2026/09/20 12:47:03 INFO Received uploads request method=POST path=/api/pending_closures6072worker2 # [ 118.240723] nix-grpc-daemon[1404]: time=2026-09-20T12:47:03.440Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6073worker2 # [ 118.242154] nix-grpc-daemon[1404]: time=2026-09-20T12:47:03.440Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6074lb # [ 118.246683] niks3-server[999]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6075lb # [ 118.255099] niks3-server[999]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6076lb # [ 118.263851] niks3-server[999]: 2026/09/20 12:47:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6077lb # [ 118.270318] niks3-server[999]: 2026/09/20 12:47:03 INFO Signed narinfos id=42 count=16078worker2 # [ 118.297280] nix-grpc-daemon[1404]: time=2026-09-20T12:47:03.497Z level=INFO msg="Uploading 1 narinfos"6079lb # [ 118.274880] niks3-server[999]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6080lb # [ 118.285373] niks3-server[999]: 2026/09/20 12:47:03 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6081lb # [ 118.289021] niks3-server[999]: 2026/09/20 12:47:03 INFO Completed upload id=426082lb # [ 118.290639] niks3-server[999]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6083worker2 # [ 118.313555] nix-grpc-daemon[1404]: time=2026-09-20T12:47:03.513Z level=INFO msg="Upload complete. (252ms)"6084worker2 # [ 118.324677] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=16085worker2 # [ 118.331257] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:03Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06086worker2 # [ 118.335344] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:03Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16087worker2 # [ 118.344050] nix-daemon[865]: reaped child process 1529, status = succeeded6088worker2 # [ 118.375656] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446089worker2 # [ 118.388322] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406446090worker2 # [ 118.401271] nix-grpc-daemon[1404]: time=2026-09-20T12:47:03.601Z level=INFO msg="All 2 paths already cached"6091client # copying 1 paths to 'lb:50051'...6092worker2 # [ 118.409858] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406446093client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6094worker2 # [ 118.426145] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6095worker2 # [ 118.593549] nix-daemon[865]: accepted connection from pid 1555, user nix-grpc-daemon (trusted)6096worker2 # [ 118.605861] nix-daemon[865]: reaped child process 1558, status = succeeded6097worker2 # [ 118.757120] nix-daemon[865]: accepted connection from pid 1560, user nix-grpc-daemon (trusted)6098worker2 # [ 118.769886] nix-daemon[865]: reaped child process 1563, status = succeeded6099lb # [ 118.754509] niks3-server[999]: 2026/09/20 12:47:03 INFO Received uploads request method=POST path=/api/pending_closures6100worker2 # [ 118.787177] nix-grpc-daemon[1404]: time=2026-09-20T12:47:03.987Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6101worker2 # [ 118.789054] nix-grpc-daemon[1404]: time=2026-09-20T12:47:03.988Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6102lb # [ 118.782162] niks3-server[999]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6103lb # [ 118.792276] niks3-server[999]: 2026/09/20 12:47:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6104lb # [ 118.797257] niks3-server[999]: 2026/09/20 12:47:03 INFO Signed narinfos id=43 count=16105worker2 # [ 118.824964] nix-grpc-daemon[1404]: time=2026-09-20T12:47:04.025Z level=INFO msg="Uploading 1 narinfos"6106lb # [ 118.805856] niks3-server[999]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6107lb # [ 118.814656] niks3-server[999]: 2026/09/20 12:47:03 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6108lb # [ 118.819476] niks3-server[999]: 2026/09/20 12:47:03 INFO Completed upload id=436109worker2 # [ 118.843913] nix-grpc-daemon[1404]: time=2026-09-20T12:47:04.044Z level=INFO msg="Upload complete. (405ms)"6110lb # [ 118.821043] niks3-server[999]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6111worker2 # [ 118.847595] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=7686112worker2 # [ 118.852417] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446113worker2 # [ 118.861063] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6114worker2 # [ 118.865363] nix-daemon[865]: reaped child process 1553, status = succeeded6115client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6116worker2 # [ 118.870263] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6117client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6118client # farm-top> LOG-farm-top-during-drain6119worker2 # [ 119.898510] nix-daemon[865]: reaped child process 1567, status = succeeded6120worker2 # [ 120.063851] nix-daemon[865]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)6121worker2 # [ 120.075667] nix-daemon[865]: reaped child process 1585, status = succeeded6122lb # [ 120.066321] niks3-server[999]: 2026/09/20 12:47:05 INFO Received uploads request method=POST path=/api/pending_closures6123worker2 # [ 120.140268] nix-grpc-daemon[1404]: time=2026-09-20T12:47:05.340Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6124worker2 # [ 120.142251] nix-grpc-daemon[1404]: time=2026-09-20T12:47:05.342Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6125lb # [ 120.148157] niks3-server[999]: 2026/09/20 12:47:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6126worker2 # [ 120.174252] nix-grpc-daemon[1404]: time=2026-09-20T12:47:05.373Z level=INFO msg="Uploading 1 narinfos"6127lb # [ 120.151998] niks3-server[999]: 2026/09/20 12:47:05 INFO Signed narinfos id=44 count=16128lb # [ 120.164521] niks3-server[999]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6129lb # [ 120.169754] niks3-server[999]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6130lb # [ 120.177560] niks3-server[999]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6131lb # [ 120.183535] niks3-server[999]: 2026/09/20 12:47:05 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6132lb # [ 120.202818] niks3-server[999]: 2026/09/20 12:47:05 INFO Completed upload id=446133worker2 # [ 120.227463] nix-grpc-daemon[1404]: time=2026-09-20T12:47:05.427Z level=INFO msg="Upload complete. (348ms)"6134lb # [ 120.205355] niks3-server[999]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6135worker2 # [ 120.236180] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=16136worker2 # [ 120.249600] nix-daemon[865]: reaped child process 1565, status = succeeded6137client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 5.93 seconds)6138client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6139client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.17 seconds)6140worker1: must succeed: pkill -f 'read -t [9]0 x'6141worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6142client: waiting for success: ! systemctl is-active sw6143worker1 # [ 120.736630] nix-daemon[844]: reaped child process 1656, status = succeeded6144worker1 # [ 120.914088] nix-daemon[844]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)6145worker1 # [ 120.925129] nix-daemon[844]: reaped child process 1699, status = succeeded6146lb # [ 120.883308] niks3-server[999]: 2026/09/20 12:47:05 INFO Received uploads request method=POST path=/api/pending_closures6147worker1 # [ 120.945414] nix-grpc-daemon[1548]: time=2026-09-20T12:47:06.091Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6148worker1 # [ 120.947552] nix-grpc-daemon[1548]: time=2026-09-20T12:47:06.093Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6149lb # [ 120.900386] niks3-server[999]: 2026/09/20 12:47:06 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6150lb # [ 120.903746] niks3-server[999]: 2026/09/20 12:47:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6151lb # [ 120.906445] niks3-server[999]: 2026/09/20 12:47:06 INFO Signed narinfos id=45 count=16152worker1 # [ 120.965807] nix-grpc-daemon[1548]: time=2026-09-20T12:47:06.112Z level=INFO msg="Uploading 1 narinfos"6153lb # [ 120.908941] niks3-server[999]: 2026/09/20 12:47:06 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6154lb # [ 120.910932] niks3-server[999]: 2026/09/20 12:47:06 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6155lb # [ 120.915533] niks3-server[999]: 2026/09/20 12:47:06 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6156lb # [ 120.919398] niks3-server[999]: 2026/09/20 12:47:06 INFO Completed upload id=456157worker1 # [ 120.978325] nix-grpc-daemon[1548]: time=2026-09-20T12:47:06.124Z level=INFO msg="Upload complete. (260ms)"6158lb # [ 120.921040] niks3-server[999]: 2026/09/20 12:47:06 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6159worker1 # [ 120.982059] nix-grpc-daemon[1484]: ts=2026-09-20T12:47:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36788 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=16160worker1 # [ 120.987495] nix-daemon[844]: reaped child process 1654, status = succeeded6161client # [ 120.983348] systemd[1]: sw.service: Deactivated successfully.6162client # [ 120.986971] systemd[1]: sw.service: Consumed 110ms CPU time over 9.277s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.6163client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds)6164client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6165client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6166worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6167worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.05 seconds)6168lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6169lb: must succeed: curl -sf localhost:9901/clusters6170worker1 # [ 121.751406] nix-grpc-daemon[1484]: ts=2026-09-20T12:47:06Z level=info event=signal_exit6171lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6172lb: must succeed: curl -sf localhost:9901/clusters6173lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6174worker1 # [ 122.971718] nix-grpc-daemon[1484]: ts=2026-09-20T12:47:08Z level=info event=scheduler_restarting6175worker1 # [ 122.978963] nix-grpc-daemon[1484]: ts=2026-09-20T12:47:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6176worker2 # [ 122.943405] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:463866177worker2 # [ 122.947702] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:08Z level=info event=worker_gone addr=192.168.1.3:500516178worker1 # [ 122.989145] nix-daemon[844]: reaped child process 1537, status = succeeded6179worker1 # [ 123.579822] nix-grpc-daemon[1484]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6180worker1 # [ 123.581291] nix-grpc-daemon[1484]: E0000 00:00:1789908428.726154 1527 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true6181worker1 # [ 123.583168] nix-grpc-daemon[1484]: E0000 00:00:1789908428.726265 1527 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6182worker1 # [ 123.788548] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6183worker1 # [ 123.792168] systemd[1]: nix-grpc-daemon.service: Consumed 762ms CPU time over 28.216s wall clock time, 31M memory peak, 24K incoming IP traffic, 33.4K outgoing IP traffic.6184lb: must succeed: curl -sf localhost:9901/clusters6185lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6186worker1 # [ 124.772831] systemd[1]: Starting Nix worker-protocol over gRPC...6187worker1 # [ 124.913532] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:10Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6188worker1 # [ 124.915307] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6189worker1 # [ 124.918669] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16190worker1 # [ 124.925445] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6191worker1 # [ 124.928886] systemd[1]: Started Nix worker-protocol over gRPC.6192worker1 # [ 124.939630] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:10Z level=info event=scheduler_connected addr=lb:500516193lb: must succeed: curl -sf localhost:9901/clusters6194worker2 # [ 124.908712] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:10Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:463866195worker2 # [ 124.912826] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06196lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6197lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 3.26 seconds)6198lb: must succeed: curl -sf localhost:9901/clusters6199lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6200worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6201worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6202(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.42 seconds)6203subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6204client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16205worker1 # [ 125.317151] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:448906206worker1 # [ 125.329349] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6207worker2 # [ 125.310385] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406446208worker2 # [ 125.353890] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:10Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06209worker2 # [ 125.357999] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:10Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16210worker2 # [ 125.362408] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:10Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06211worker2 # [ 125.366511] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:10Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06212worker1 # [ 125.432425] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906213worker1 # [ 125.444196] nix-grpc-daemon[1711]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5)6214worker1 # [ 125.524254] nix-grpc-daemon[1711]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 2/5)6215worker1 # [ 125.662753] nix-grpc-daemon[1711]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 384 ms (attempt 3/5)6216worker1 # [ 126.053298] nix-grpc-daemon[1711]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 286 ms (attempt 4/5)6217worker1 # [ 126.345585] nix-grpc-daemon[1711]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6218worker1 # [ 126.363165] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906219worker1 # [ 126.376642] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906220worker1 # [ 126.387914] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6221worker1 # [ 126.407138] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:11Z level=info event=niks3_push_started pid=17676222worker1 # [ 126.608194] nix-grpc-daemon[1767]: time=2026-09-20T12:47:11.754Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""6223worker1 # [ 126.778089] nix-daemon[844]: accepted connection from pid 1780, user nix-grpc-daemon (trusted)6224worker1 # [ 126.788787] nix-daemon[844]: reaped child process 1783, status = succeeded6225worker1 # [ 126.963248] nix-daemon[844]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)6226worker1 # [ 126.976168] nix-daemon[844]: reaped child process 1788, status = succeeded6227lb # [ 126.934258] niks3-server[999]: 2026/09/20 12:47:12 INFO Received uploads request method=POST path=/api/pending_closures6228worker1 # [ 127.000197] nix-grpc-daemon[1767]: time=2026-09-20T12:47:12.146Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6229worker1 # [ 127.003490] nix-grpc-daemon[1767]: time=2026-09-20T12:47:12.148Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6230lb # [ 126.957252] niks3-server[999]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6231lb # [ 126.962245] niks3-server[999]: 2026/09/20 12:47:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6232lb # [ 126.964742] niks3-server[999]: 2026/09/20 12:47:12 INFO Signed narinfos id=46 count=16233worker1 # [ 127.024154] nix-grpc-daemon[1767]: time=2026-09-20T12:47:12.170Z level=INFO msg="Uploading 1 narinfos"6234lb # [ 126.971067] niks3-server[999]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6235lb # [ 126.973712] niks3-server[999]: 2026/09/20 12:47:12 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6236worker1 # [ 127.035518] nix-grpc-daemon[1767]: time=2026-09-20T12:47:12.181Z level=INFO msg="Upload complete. (423ms)"6237lb # [ 126.977676] niks3-server[999]: 2026/09/20 12:47:12 INFO Completed upload id=466238worker1 # [ 127.037530] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=5046239lb # [ 126.980336] niks3-server[999]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6240worker1 # [ 127.040682] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906241worker1 # [ 127.045523] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6242worker1 # [ 127.050807] nix-daemon[844]: reaped child process 1765, status = succeeded6243worker1 # [ 127.054872] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6244lb # [ 127.873236] envoy[928]: conn peer=[2001:db8:1::1]:33626 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9529 tx=3810 ms=57156245lb # [ 127.876967] envoy[928]: conn peer=[2001:db8:1::1]:59214 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1349 ms=90596246lb # [ 127.880721] envoy[928]: conn peer=[2001:db8:1::3]:50184 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1165 tx=359 ms=272266247worker1 # [ 128.482431] nix-daemon[844]: reaped child process 1792, status = succeeded6248worker1 # [ 128.645792] nix-daemon[844]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6249worker1 # [ 128.656451] nix-daemon[844]: reaped child process 1810, status = succeeded6250lb # [ 128.615948] niks3-server[999]: 2026/09/20 12:47:13 INFO Received uploads request method=POST path=/api/pending_closures6251worker1 # [ 128.679510] nix-grpc-daemon[1767]: time=2026-09-20T12:47:13.825Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6252worker1 # [ 128.681112] nix-grpc-daemon[1767]: time=2026-09-20T12:47:13.827Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6253lb # [ 128.635069] niks3-server[999]: 2026/09/20 12:47:13 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6254lb # [ 128.640865] niks3-server[999]: 2026/09/20 12:47:13 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6255lb # [ 128.644520] niks3-server[999]: 2026/09/20 12:47:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6256lb # [ 128.646460] niks3-server[999]: 2026/09/20 12:47:13 INFO Signed narinfos id=47 count=16257worker1 # [ 128.705478] nix-grpc-daemon[1767]: time=2026-09-20T12:47:13.851Z level=INFO msg="Uploading 1 narinfos"6258lb # [ 128.649701] niks3-server[999]: 2026/09/20 12:47:13 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6259lb # [ 128.655066] niks3-server[999]: 2026/09/20 12:47:13 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6260lb # [ 128.658236] niks3-server[999]: 2026/09/20 12:47:13 INFO Completed upload id=476261worker1 # [ 128.715848] nix-grpc-daemon[1767]: time=2026-09-20T12:47:13.862Z level=INFO msg="Upload complete. (253ms)"6262lb # [ 128.660785] niks3-server[999]: 2026/09/20 12:47:13 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6263worker1 # [ 128.718152] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=16264worker2 # [ 128.687666] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:13Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16265worker1 # [ 128.725428] nix-daemon[844]: reaped child process 1790, status = succeeded6266worker1 # [ 128.727504] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906267worker2 # [ 128.697418] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:13Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06268worker1 # [ 128.733717] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906269worker1 # [ 128.739179] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906270worker1 # [ 128.743175] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6271worker1 # [ 128.899559] nix-daemon[844]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)6272worker1 # [ 128.911763] nix-daemon[844]: reaped child process 1817, status = succeeded6273worker1 # [ 129.088084] nix-daemon[844]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)6274worker1 # [ 129.099818] nix-daemon[844]: reaped child process 1822, status = succeeded6275lb # [ 129.059570] niks3-server[999]: 2026/09/20 12:47:14 INFO Received uploads request method=POST path=/api/pending_closures6276worker1 # [ 129.125115] nix-grpc-daemon[1767]: time=2026-09-20T12:47:14.271Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6277worker1 # [ 129.126664] nix-grpc-daemon[1767]: time=2026-09-20T12:47:14.273Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6278lb # [ 129.087257] niks3-server[999]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6279lb # [ 129.099639] niks3-server[999]: 2026/09/20 12:47:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6280lb # [ 129.105500] niks3-server[999]: 2026/09/20 12:47:14 INFO Signed narinfos id=48 count=16281worker1 # [ 129.166359] nix-grpc-daemon[1767]: time=2026-09-20T12:47:14.312Z level=INFO msg="Uploading 1 narinfos"6282lb # [ 129.109318] niks3-server[999]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6283lb # [ 129.121677] niks3-server[999]: 2026/09/20 12:47:14 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6284worker1 # [ 129.185716] nix-grpc-daemon[1767]: time=2026-09-20T12:47:14.332Z level=INFO msg="Upload complete. (437ms)"6285lb # [ 129.128069] niks3-server[999]: 2026/09/20 12:47:14 INFO Completed upload id=486286worker1 # [ 129.187771] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=5046287lb # [ 129.131439] niks3-server[999]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6288worker1 # [ 129.193117] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906289worker1 # [ 129.201298] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6290worker1 # [ 129.206403] nix-daemon[844]: reaped child process 1812, status = succeeded6291worker1 # [ 129.211136] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6292worker1 # [ 130.639476] nix-daemon[844]: reaped child process 1826, status = succeeded6293worker1 # [ 130.812558] nix-daemon[844]: accepted connection from pid 1841, user nix-grpc-daemon (trusted)6294worker1 # [ 130.825573] nix-daemon[844]: reaped child process 1844, status = succeeded6295lb # [ 130.784347] niks3-server[999]: 2026/09/20 12:47:15 INFO Received uploads request method=POST path=/api/pending_closures6296worker1 # [ 130.852527] nix-grpc-daemon[1767]: time=2026-09-20T12:47:15.998Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6297worker1 # [ 130.854365] nix-grpc-daemon[1767]: time=2026-09-20T12:47:16.000Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6298lb # [ 130.822853] niks3-server[999]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6299lb # [ 130.828098] niks3-server[999]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6300lb # [ 130.836059] niks3-server[999]: 2026/09/20 12:47:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6301lb # [ 130.839495] niks3-server[999]: 2026/09/20 12:47:15 INFO Signed narinfos id=49 count=16302worker1 # [ 130.897316] nix-grpc-daemon[1767]: time=2026-09-20T12:47:16.043Z level=INFO msg="Uploading 1 narinfos"6303lb # [ 130.848382] niks3-server[999]: 2026/09/20 12:47:15 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6304lb # [ 130.850685] niks3-server[999]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6305lb # [ 130.854574] niks3-server[999]: 2026/09/20 12:47:15 INFO Completed upload id=496306worker1 # [ 130.912586] nix-grpc-daemon[1767]: time=2026-09-20T12:47:16.058Z level=INFO msg="Upload complete. (293ms)"6307lb # [ 130.856210] niks3-server[999]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6308worker2 # [ 130.883985] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:16Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16309worker1 # [ 130.916993] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16310worker2 # [ 130.890203] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:16Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06311worker1 # [ 130.924755] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906312worker1 # [ 130.934793] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906313worker1 # [ 130.936534] nix-daemon[844]: reaped child process 1824, status = succeeded6314worker1 # [ 130.941615] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906315worker1 # [ 130.945505] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6316worker1 # [ 131.098514] nix-daemon[844]: accepted connection from pid 1848, user nix-grpc-daemon (trusted)6317worker1 # [ 131.110852] nix-daemon[844]: reaped child process 1851, status = succeeded6318worker1 # [ 131.267756] nix-daemon[844]: accepted connection from pid 1853, user nix-grpc-daemon (trusted)6319worker1 # [ 131.279826] nix-daemon[844]: reaped child process 1856, status = succeeded6320lb # [ 131.237891] niks3-server[999]: 2026/09/20 12:47:16 INFO Received uploads request method=POST path=/api/pending_closures6321worker1 # [ 131.300171] nix-grpc-daemon[1767]: time=2026-09-20T12:47:16.446Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6322worker1 # [ 131.301972] nix-grpc-daemon[1767]: time=2026-09-20T12:47:16.448Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6323lb # [ 131.252535] niks3-server[999]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6324lb # [ 131.257475] niks3-server[999]: 2026/09/20 12:47:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6325lb # [ 131.259231] niks3-server[999]: 2026/09/20 12:47:16 INFO Signed narinfos id=50 count=16326worker1 # [ 131.318292] nix-grpc-daemon[1767]: time=2026-09-20T12:47:16.464Z level=INFO msg="Uploading 1 narinfos"6327lb # [ 131.263030] niks3-server[999]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6328lb # [ 131.267896] niks3-server[999]: 2026/09/20 12:47:16 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6329lb # [ 131.270662] niks3-server[999]: 2026/09/20 12:47:16 INFO Completed upload id=506330worker1 # [ 131.328488] nix-grpc-daemon[1767]: time=2026-09-20T12:47:16.474Z level=INFO msg="Upload complete. (376ms)"6331worker1 # [ 131.330392] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=5046332lb # [ 131.273955] niks3-server[999]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6333worker1 # [ 131.334105] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906334worker1 # [ 131.340571] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6335worker1 # [ 131.342822] nix-daemon[844]: reaped child process 1846, status = succeeded6336worker1 # [ 131.347848] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6337worker1 # [ 132.161259] nix-daemon[844]: reaped child process 1860, status = succeeded6338worker1 # [ 132.286176] nix-daemon[844]: accepted connection from pid 1875, user nix-grpc-daemon (trusted)6339worker1 # [ 132.298351] nix-daemon[844]: reaped child process 1878, status = succeeded6340lb # [ 132.258409] niks3-server[999]: 2026/09/20 12:47:17 INFO Received uploads request method=POST path=/api/pending_closures6341worker1 # [ 132.324031] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.470Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6342worker1 # [ 132.325523] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.471Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6343lb # [ 132.289274] niks3-server[999]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6344lb # [ 132.304350] niks3-server[999]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6345lb # [ 132.313407] niks3-server[999]: 2026/09/20 12:47:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6346lb # [ 132.320111] niks3-server[999]: 2026/09/20 12:47:17 INFO Signed narinfos id=51 count=16347worker1 # [ 132.380595] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.526Z level=INFO msg="Uploading 1 narinfos"6348lb # [ 132.322770] niks3-server[999]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6349lb # [ 132.332664] niks3-server[999]: 2026/09/20 12:47:17 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6350lb # [ 132.335621] niks3-server[999]: 2026/09/20 12:47:17 INFO Completed upload id=516351worker1 # [ 132.393709] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.540Z level=INFO msg="Upload complete. (239ms)"6352lb # [ 132.337182] niks3-server[999]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6353worker2 # [ 132.365602] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:17Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16354worker2 # [ 132.370726] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:17Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06355worker1 # [ 132.401105] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16356worker1 # [ 132.406714] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906357worker1 # [ 132.414656] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906358worker1 # [ 132.422747] nix-daemon[844]: reaped child process 1858, status = succeeded6359worker1 # [ 132.424145] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.570Z level=INFO msg="All 1 paths already cached"6360worker1 # [ 132.425916] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906361worker1 # [ 132.429619] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6362worker1 # [ 132.592533] nix-daemon[844]: accepted connection from pid 1882, user nix-grpc-daemon (trusted)6363worker1 # [ 132.604617] nix-daemon[844]: reaped child process 1885, status = succeeded6364worker1 # [ 132.769324] nix-daemon[844]: accepted connection from pid 1887, user nix-grpc-daemon (trusted)6365worker1 # [ 132.781183] nix-daemon[844]: reaped child process 1890, status = succeeded6366lb # [ 132.740469] niks3-server[999]: 2026/09/20 12:47:17 INFO Received uploads request method=POST path=/api/pending_closures6367worker1 # [ 132.805770] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.952Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6368worker1 # [ 132.807273] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.953Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6369lb # [ 132.768488] niks3-server[999]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6370lb # [ 132.780885] niks3-server[999]: 2026/09/20 12:47:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6371lb # [ 132.786511] niks3-server[999]: 2026/09/20 12:47:17 INFO Signed narinfos id=52 count=16372worker1 # [ 132.847106] nix-grpc-daemon[1767]: time=2026-09-20T12:47:17.993Z level=INFO msg="Uploading 1 narinfos"6373lb # [ 132.789989] niks3-server[999]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6374lb # [ 132.803854] niks3-server[999]: 2026/09/20 12:47:17 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6375worker1 # [ 132.867681] nix-grpc-daemon[1767]: time=2026-09-20T12:47:18.014Z level=INFO msg="Upload complete. (432ms)"6376lb # [ 132.810086] niks3-server[999]: 2026/09/20 12:47:17 INFO Completed upload id=526377lb # [ 132.812473] niks3-server[999]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6378worker1 # [ 132.870726] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=6246379worker1 # [ 132.876734] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906380worker1 # [ 132.886624] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6381worker1 # [ 132.889157] nix-daemon[844]: reaped child process 1880, status = succeeded6382worker1 # [ 132.894840] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6383worker1 # [ 134.310179] nix-daemon[844]: reaped child process 1894, status = succeeded6384worker1 # [ 134.458518] nix-daemon[844]: accepted connection from pid 1909, user nix-grpc-daemon (trusted)6385worker1 # [ 134.470486] nix-daemon[844]: reaped child process 1912, status = succeeded6386lb # [ 134.431811] niks3-server[999]: 2026/09/20 12:47:19 INFO Received uploads request method=POST path=/api/pending_closures6387worker1 # [ 134.496913] nix-grpc-daemon[1767]: time=2026-09-20T12:47:19.643Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6388worker1 # [ 134.498452] nix-grpc-daemon[1767]: time=2026-09-20T12:47:19.644Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6389lb # [ 134.467136] niks3-server[999]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6390lb # [ 134.479163] niks3-server[999]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6391lb # [ 134.487696] niks3-server[999]: 2026/09/20 12:47:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6392lb # [ 134.492557] niks3-server[999]: 2026/09/20 12:47:19 INFO Signed narinfos id=53 count=16393worker1 # [ 134.553048] nix-grpc-daemon[1767]: time=2026-09-20T12:47:19.699Z level=INFO msg="Uploading 1 narinfos"6394lb # [ 134.497526] niks3-server[999]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6395lb # [ 134.506369] niks3-server[999]: 2026/09/20 12:47:19 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6396lb # [ 134.511876] niks3-server[999]: 2026/09/20 12:47:19 INFO Completed upload id=536397worker1 # [ 134.569896] nix-grpc-daemon[1767]: time=2026-09-20T12:47:19.716Z level=INFO msg="Upload complete. (267ms)"6398lb # [ 134.514191] niks3-server[999]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6399worker1 # [ 134.576427] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16400worker2 # [ 134.542717] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:19Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16401worker1 # [ 134.584249] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906402worker2 # [ 134.552200] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:19Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06403worker1 # [ 134.595545] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906404worker1 # [ 134.600781] nix-daemon[844]: reaped child process 1892, status = succeeded6405worker1 # [ 134.606686] nix-grpc-daemon[1767]: time=2026-09-20T12:47:19.753Z level=INFO msg="All 1 paths already cached"6406worker1 # [ 134.612568] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906407worker1 # [ 134.619443] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6408worker1 # [ 134.767507] nix-daemon[844]: accepted connection from pid 1916, user nix-grpc-daemon (trusted)6409worker1 # [ 134.779804] nix-daemon[844]: reaped child process 1919, status = succeeded6410worker1 # [ 134.927596] nix-daemon[844]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)6411worker1 # [ 134.940629] nix-daemon[844]: reaped child process 1924, status = succeeded6412lb # [ 134.897127] niks3-server[999]: 2026/09/20 12:47:20 INFO Received uploads request method=POST path=/api/pending_closures6413worker1 # [ 134.961904] nix-grpc-daemon[1767]: time=2026-09-20T12:47:20.108Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6414worker1 # [ 134.963296] nix-grpc-daemon[1767]: time=2026-09-20T12:47:20.108Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6415lb # [ 134.913754] niks3-server[999]: 2026/09/20 12:47:20 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6416lb # [ 134.916556] niks3-server[999]: 2026/09/20 12:47:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6417lb # [ 134.918849] niks3-server[999]: 2026/09/20 12:47:20 INFO Signed narinfos id=54 count=16418worker1 # [ 134.976594] nix-grpc-daemon[1767]: time=2026-09-20T12:47:20.122Z level=INFO msg="Uploading 1 narinfos"6419lb # [ 134.921784] niks3-server[999]: 2026/09/20 12:47:20 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6420lb # [ 134.925754] niks3-server[999]: 2026/09/20 12:47:20 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6421lb # [ 134.928333] niks3-server[999]: 2026/09/20 12:47:20 INFO Completed upload id=546422worker1 # [ 134.987442] nix-grpc-daemon[1767]: time=2026-09-20T12:47:20.133Z level=INFO msg="Upload complete. (362ms)"6423lb # [ 134.930734] niks3-server[999]: 2026/09/20 12:47:20 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6424worker1 # [ 134.989433] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=6246425worker1 # [ 134.992765] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906426worker1 # [ 134.999230] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6427worker1 # [ 135.001720] nix-daemon[844]: reaped child process 1914, status = succeeded6428worker1 # [ 135.007064] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6429worker1 # [ 135.820074] nix-daemon[844]: reaped child process 1928, status = succeeded6430worker1 # [ 135.975570] nix-daemon[844]: accepted connection from pid 1943, user nix-grpc-daemon (trusted)6431worker1 # [ 135.987677] nix-daemon[844]: reaped child process 1946, status = succeeded6432lb # [ 135.946818] niks3-server[999]: 2026/09/20 12:47:21 INFO Received uploads request method=POST path=/api/pending_closures6433worker1 # [ 136.017582] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.163Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6434worker1 # [ 136.019173] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.165Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6435lb # [ 135.991250] niks3-server[999]: 2026/09/20 12:47:21 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6436lb # [ 136.002131] niks3-server[999]: 2026/09/20 12:47:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6437lb # [ 136.007420] niks3-server[999]: 2026/09/20 12:47:21 INFO Signed narinfos id=55 count=16438worker1 # [ 136.067673] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.213Z level=INFO msg="Uploading 1 narinfos"6439lb # [ 136.013591] niks3-server[999]: 2026/09/20 12:47:21 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6440lb # [ 136.018153] niks3-server[999]: 2026/09/20 12:47:21 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6441lb # [ 136.025518] niks3-server[999]: 2026/09/20 12:47:21 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6442lb # [ 136.028260] niks3-server[999]: 2026/09/20 12:47:21 INFO Completed upload id=556443worker1 # [ 136.086283] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.232Z level=INFO msg="Upload complete. (273ms)"6444lb # [ 136.030512] niks3-server[999]: 2026/09/20 12:47:21 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6445worker1 # [ 136.094161] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16446worker2 # [ 136.058959] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:21Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16447worker1 # [ 136.099619] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906448worker2 # [ 136.069468] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:21Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06449worker1 # [ 136.111121] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906450worker1 # [ 136.113653] nix-daemon[844]: reaped child process 1926, status = succeeded6451worker1 # [ 136.118046] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.264Z level=INFO msg="All 1 paths already cached"6452worker1 # [ 136.122190] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906453worker1 # [ 136.125942] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6454worker1 # [ 136.272131] nix-daemon[844]: accepted connection from pid 1950, user nix-grpc-daemon (trusted)6455worker1 # [ 136.284620] nix-daemon[844]: reaped child process 1953, status = succeeded6456worker1 # [ 136.454104] nix-daemon[844]: accepted connection from pid 1955, user nix-grpc-daemon (trusted)6457worker1 # [ 136.465968] nix-daemon[844]: reaped child process 1958, status = succeeded6458lb # [ 136.424797] niks3-server[999]: 2026/09/20 12:47:21 INFO Received uploads request method=POST path=/api/pending_closures6459worker1 # [ 136.489863] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.636Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6460worker1 # [ 136.491397] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.637Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6461lb # [ 136.453638] niks3-server[999]: 2026/09/20 12:47:21 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6462lb # [ 136.465471] niks3-server[999]: 2026/09/20 12:47:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6463lb # [ 136.470759] niks3-server[999]: 2026/09/20 12:47:21 INFO Signed narinfos id=56 count=16464worker1 # [ 136.531437] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.677Z level=INFO msg="Uploading 1 narinfos"6465lb # [ 136.474349] niks3-server[999]: 2026/09/20 12:47:21 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6466lb # [ 136.486355] niks3-server[999]: 2026/09/20 12:47:21 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6467worker1 # [ 136.550689] nix-grpc-daemon[1767]: time=2026-09-20T12:47:21.697Z level=INFO msg="Upload complete. (419ms)"6468lb # [ 136.492876] niks3-server[999]: 2026/09/20 12:47:21 INFO Completed upload id=566469lb # [ 136.496161] niks3-server[999]: 2026/09/20 12:47:21 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6470worker1 # [ 136.552982] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=6246471worker1 # [ 136.558206] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906472worker1 # [ 136.568637] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6473worker1 # [ 136.574630] nix-daemon[844]: reaped child process 1948, status = succeeded6474worker1 # [ 136.577717] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6475worker1 # [ 137.201907] nix-daemon[844]: reaped child process 1962, status = succeeded6476worker1 # [ 137.358642] nix-daemon[844]: accepted connection from pid 1977, user nix-grpc-daemon (trusted)6477worker1 # [ 137.370446] nix-daemon[844]: reaped child process 1980, status = succeeded6478lb # [ 137.329497] niks3-server[999]: 2026/09/20 12:47:22 INFO Received uploads request method=POST path=/api/pending_closures6479worker1 # [ 137.392303] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.537Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6480worker1 # [ 137.393741] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.537Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6481lb # [ 137.343902] niks3-server[999]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6482lb # [ 137.348505] niks3-server[999]: 2026/09/20 12:47:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6483lb # [ 137.351059] niks3-server[999]: 2026/09/20 12:47:22 INFO Signed narinfos id=57 count=16484worker1 # [ 137.408679] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.555Z level=INFO msg="Uploading 1 narinfos"6485lb # [ 137.353529] niks3-server[999]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6486lb # [ 137.356841] niks3-server[999]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6487lb # [ 137.360250] niks3-server[999]: 2026/09/20 12:47:22 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6488lb # [ 137.364194] niks3-server[999]: 2026/09/20 12:47:22 INFO Completed upload id=576489worker1 # [ 137.421887] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.568Z level=INFO msg="Upload complete. (237ms)"6490lb # [ 137.365709] niks3-server[999]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6491worker1 # [ 137.424174] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16492worker1 # [ 137.429089] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906493worker2 # [ 137.395679] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:22Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16494worker1 # [ 137.433735] nix-daemon[844]: reaped child process 1960, status = succeeded6495worker1 # [ 137.436932] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906496worker2 # [ 137.403860] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:22Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06497worker1 # [ 137.442304] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.588Z level=INFO msg="All 2 paths already cached"6498worker1 # [ 137.445403] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906499worker1 # [ 137.450107] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6500worker1 # [ 137.612050] nix-daemon[844]: accepted connection from pid 1984, user nix-grpc-daemon (trusted)6501worker1 # [ 137.623819] nix-daemon[844]: reaped child process 1987, status = succeeded6502worker1 # [ 137.788025] nix-daemon[844]: accepted connection from pid 1989, user nix-grpc-daemon (trusted)6503worker1 # [ 137.799667] nix-daemon[844]: reaped child process 1992, status = succeeded6504lb # [ 137.757441] niks3-server[999]: 2026/09/20 12:47:22 INFO Received uploads request method=POST path=/api/pending_closures6505worker1 # [ 137.819551] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.966Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6506worker1 # [ 137.821121] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.967Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6507lb # [ 137.772739] niks3-server[999]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6508lb # [ 137.776477] niks3-server[999]: 2026/09/20 12:47:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6509lb # [ 137.778953] niks3-server[999]: 2026/09/20 12:47:22 INFO Signed narinfos id=58 count=16510worker1 # [ 137.836741] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.983Z level=INFO msg="Uploading 1 narinfos"6511lb # [ 137.781766] niks3-server[999]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6512lb # [ 137.786199] niks3-server[999]: 2026/09/20 12:47:22 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6513lb # [ 137.789092] niks3-server[999]: 2026/09/20 12:47:22 INFO Completed upload id=586514worker1 # [ 137.846654] nix-grpc-daemon[1767]: time=2026-09-20T12:47:22.993Z level=INFO msg="Upload complete. (391ms)"6515lb # [ 137.791420] niks3-server[999]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6516worker1 # [ 137.848584] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=7526517worker1 # [ 137.851433] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906518worker1 # [ 137.857759] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6519worker1 # [ 137.860695] nix-daemon[844]: reaped child process 1982, status = succeeded6520worker1 # [ 137.865595] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6521worker1 # [ 139.491913] nix-daemon[844]: reaped child process 1996, status = succeeded6522worker1 # [ 139.643086] nix-daemon[844]: accepted connection from pid 2011, user nix-grpc-daemon (trusted)6523worker1 # [ 139.653845] nix-daemon[844]: reaped child process 2014, status = succeeded6524lb # [ 139.614579] niks3-server[999]: 2026/09/20 12:47:24 INFO Received uploads request method=POST path=/api/pending_closures6525worker1 # [ 139.679381] nix-grpc-daemon[1767]: time=2026-09-20T12:47:24.825Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6526worker1 # [ 139.682059] nix-grpc-daemon[1767]: time=2026-09-20T12:47:24.827Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6527lb # [ 139.648535] niks3-server[999]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6528lb # [ 139.660980] niks3-server[999]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6529lb # [ 139.672814] niks3-server[999]: 2026/09/20 12:47:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6530worker1 # [ 139.734452] nix-grpc-daemon[1767]: time=2026-09-20T12:47:24.880Z level=INFO msg="Uploading 1 narinfos"6531lb # [ 139.677064] niks3-server[999]: 2026/09/20 12:47:24 INFO Signed narinfos id=59 count=16532lb # [ 139.682552] niks3-server[999]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6533lb # [ 139.690893] niks3-server[999]: 2026/09/20 12:47:24 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6534lb # [ 139.695714] niks3-server[999]: 2026/09/20 12:47:24 INFO Completed upload id=596535worker1 # [ 139.753814] nix-grpc-daemon[1767]: time=2026-09-20T12:47:24.900Z level=INFO msg="Upload complete. (279ms)"6536lb # [ 139.698191] niks3-server[999]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6537worker2 # [ 139.726707] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:24Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16538worker1 # [ 139.761363] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16539worker1 # [ 139.773194] nix-daemon[844]: reaped child process 1994, status = succeeded6540worker1 # [ 139.803385] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906541worker1 # [ 139.815674] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906542worker1 # [ 139.827632] nix-grpc-daemon[1767]: time=2026-09-20T12:47:24.974Z level=INFO msg="All 2 paths already cached"6543worker1 # [ 139.834756] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906544worker1 # [ 139.844159] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6545worker1 # [ 140.008603] nix-daemon[844]: accepted connection from pid 2018, user nix-grpc-daemon (trusted)6546worker1 # [ 140.021144] nix-daemon[844]: reaped child process 2021, status = succeeded6547worker1 # [ 140.173859] nix-daemon[844]: accepted connection from pid 2023, user nix-grpc-daemon (trusted)6548worker1 # [ 140.185568] nix-daemon[844]: reaped child process 2026, status = succeeded6549lb # [ 140.144286] niks3-server[999]: 2026/09/20 12:47:25 INFO Received uploads request method=POST path=/api/pending_closures6550worker1 # [ 140.211953] nix-grpc-daemon[1767]: time=2026-09-20T12:47:25.358Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6551worker1 # [ 140.213348] nix-grpc-daemon[1767]: time=2026-09-20T12:47:25.358Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6552lb # [ 140.170555] niks3-server[999]: 2026/09/20 12:47:25 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6553lb # [ 140.182660] niks3-server[999]: 2026/09/20 12:47:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6554worker1 # [ 140.246721] nix-grpc-daemon[1767]: time=2026-09-20T12:47:25.393Z level=INFO msg="Uploading 1 narinfos"6555lb # [ 140.189114] niks3-server[999]: 2026/09/20 12:47:25 INFO Signed narinfos id=60 count=16556lb # [ 140.194331] niks3-server[999]: 2026/09/20 12:47:25 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6557lb # [ 140.206708] niks3-server[999]: 2026/09/20 12:47:25 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6558lb # [ 140.212248] niks3-server[999]: 2026/09/20 12:47:25 INFO Completed upload id=606559worker1 # [ 140.269842] nix-grpc-daemon[1767]: time=2026-09-20T12:47:25.416Z level=INFO msg="Upload complete. (414ms)"6560lb # [ 140.215104] niks3-server[999]: 2026/09/20 12:47:25 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6561worker1 # [ 140.273339] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=7526562worker1 # [ 140.279616] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906563worker1 # [ 140.288928] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6564worker1 # [ 140.291451] nix-daemon[844]: reaped child process 2016, status = succeeded6565worker1 # [ 140.296554] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6566worker1 # [ 141.108944] nix-daemon[844]: reaped child process 2030, status = succeeded6567worker1 # [ 141.252921] nix-daemon[844]: accepted connection from pid 2045, user nix-grpc-daemon (trusted)6568worker1 # [ 141.265265] nix-daemon[844]: reaped child process 2048, status = succeeded6569lb # [ 141.222926] niks3-server[999]: 2026/09/20 12:47:26 INFO Received uploads request method=POST path=/api/pending_closures6570worker1 # [ 141.289476] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.435Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6571worker1 # [ 141.291078] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.437Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6572lb # [ 141.261839] niks3-server[999]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6573lb # [ 141.270141] niks3-server[999]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6574lb # [ 141.280369] niks3-server[999]: 2026/09/20 12:47:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6575lb # [ 141.284948] niks3-server[999]: 2026/09/20 12:47:26 INFO Signed narinfos id=61 count=16576worker1 # [ 141.345799] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.492Z level=INFO msg="Uploading 1 narinfos"6577lb # [ 141.293946] niks3-server[999]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6578lb # [ 141.301168] niks3-server[999]: 2026/09/20 12:47:26 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6579lb # [ 141.306765] niks3-server[999]: 2026/09/20 12:47:26 INFO Completed upload id=616580lb # [ 141.308406] niks3-server[999]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6581worker1 # [ 141.364826] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.511Z level=INFO msg="Upload complete. (262ms)"6582worker2 # [ 141.337984] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:26Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16583worker1 # [ 141.372852] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16584worker1 # [ 141.378689] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906585worker1 # [ 141.389533] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906586worker1 # [ 141.395651] nix-daemon[844]: reaped child process 2028, status = succeeded6587worker1 # [ 141.401058] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.547Z level=INFO msg="All 2 paths already cached"6588worker1 # [ 141.407157] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448906589worker1 # [ 141.415162] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6590worker1 # [ 141.568152] nix-daemon[844]: accepted connection from pid 2052, user nix-grpc-daemon (trusted)6591worker1 # [ 141.580526] nix-daemon[844]: reaped child process 2055, status = succeeded6592worker1 # [ 141.732069] nix-daemon[844]: accepted connection from pid 2057, user nix-grpc-daemon (trusted)6593worker1 # [ 141.743714] nix-daemon[844]: reaped child process 2060, status = succeeded6594lb # [ 141.701486] niks3-server[999]: 2026/09/20 12:47:26 INFO Received uploads request method=POST path=/api/pending_closures6595worker1 # [ 141.767873] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.914Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6596worker1 # [ 141.769232] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.914Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6597lb # [ 141.728318] niks3-server[999]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6598lb # [ 141.740433] niks3-server[999]: 2026/09/20 12:47:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6599lb # [ 141.745663] niks3-server[999]: 2026/09/20 12:47:26 INFO Signed narinfos id=62 count=16600worker1 # [ 141.806421] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.952Z level=INFO msg="Uploading 1 narinfos"6601lb # [ 141.752715] niks3-server[999]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6602lb # [ 141.763066] niks3-server[999]: 2026/09/20 12:47:26 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6603lb # [ 141.769417] niks3-server[999]: 2026/09/20 12:47:26 INFO Completed upload id=626604worker1 # [ 141.827297] nix-grpc-daemon[1767]: time=2026-09-20T12:47:26.973Z level=INFO msg="Upload complete. (406ms)"6605lb # [ 141.772067] niks3-server[999]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6606worker1 # [ 141.830985] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=0 paths=1 nar_bytes_in=7526607worker1 # [ 141.836138] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448906608worker1 # [ 141.846061] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6609worker1 # [ 141.850072] nix-daemon[844]: reaped child process 2050, status = succeeded6610worker1 # [ 141.855098] nix-daemon[844]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6611worker1 # [ 142.868757] nix-daemon[844]: reaped child process 2064, status = succeeded6612worker1 # [ 143.009678] nix-daemon[844]: accepted connection from pid 2079, user nix-grpc-daemon (trusted)6613worker1 # [ 143.021854] nix-daemon[844]: reaped child process 2082, status = succeeded6614lb # [ 142.980205] niks3-server[999]: 2026/09/20 12:47:28 INFO Received uploads request method=POST path=/api/pending_closures6615worker1 # [ 143.042676] nix-grpc-daemon[1767]: time=2026-09-20T12:47:28.188Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6616worker1 # [ 143.044170] nix-grpc-daemon[1767]: time=2026-09-20T12:47:28.190Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6617lb # [ 142.999105] niks3-server[999]: 2026/09/20 12:47:28 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6618lb # [ 143.004508] niks3-server[999]: 2026/09/20 12:47:28 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6619lb # [ 143.007724] niks3-server[999]: 2026/09/20 12:47:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6620lb # [ 143.010065] niks3-server[999]: 2026/09/20 12:47:28 INFO Signed narinfos id=63 count=16621worker1 # [ 143.067912] nix-grpc-daemon[1767]: time=2026-09-20T12:47:28.214Z level=INFO msg="Uploading 1 narinfos"6622lb # [ 143.012947] niks3-server[999]: 2026/09/20 12:47:28 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6623lb # [ 143.018108] niks3-server[999]: 2026/09/20 12:47:28 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6624lb # [ 143.020913] niks3-server[999]: 2026/09/20 12:47:28 INFO Completed upload id=636625worker1 # [ 143.078687] nix-grpc-daemon[1767]: time=2026-09-20T12:47:28.225Z level=INFO msg="Upload complete. (216ms)"6626lb # [ 143.022475] niks3-server[999]: 2026/09/20 12:47:28 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6627worker1 # [ 143.081033] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44890 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16628worker1 # [ 143.087491] nix-daemon[844]: reaped child process 2062, status = succeeded6629client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.05 seconds)6630worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6631worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6632client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]'6633client # [ 143.217303] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6634client # Running as unit: gpu.service; invocation ID: a3bd7b151d9448a3a02543654eee6bb56635client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.04 seconds)6636lb: must succeed: curl -sf localhost:9901/clusters6637lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6638lb: must succeed: curl -sf localhost:9901/clusters6639lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6640worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6641worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6642worker2 # [ 143.418445] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406446643client # [ 143.426568] nix[1352]: don't know how to build these paths:6644client # [ 143.427547] nix[1352]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv6645worker1 # [ 143.459827] nix-grpc-daemon[1711]: ts=2026-09-20T12:47:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906646client # [ 143.451523] nix[1352]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker6647worker2 # [ 143.448891] nix-grpc-daemon[1330]: ts=2026-09-20T12:47:28Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06648lb: must succeed: curl -sf localhost:9901/clusters6649lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6650lb: must succeed: curl -sf localhost:9901/clusters6651lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6652worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6653worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6654client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6655lb # [ 147.873804] envoy[928]: conn peer=[2001:db8:1::1]:42640 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26990 tx=10653 ms=178236656client # [ 173.452517] nix[1352]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}6657client # [ 173.458620] nix[1352]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed6658client # [ 173.486219] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6659client # [ 173.487647] systemd[1]: gpu.service: Failed with result 'exit-code'.6660client # [ 173.489936] systemd[1]: gpu.service: Consumed 119ms CPU time over 30.271s wall clock time, 33.4M memory peak, 6.7K incoming IP traffic, 5.8K outgoing IP traffic.6661client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.66 seconds)6662client: must succeed: journalctl -u gpu -o cat6663client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)6664lb: must succeed: curl -sf localhost:9901/clusters6665lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6666lb: must succeed: curl -sf localhost:9901/clusters6667lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6668worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6669worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6670(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.34 seconds)6671subtest: low disk drains a worker and builds go to the other6672worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6673worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds)6674worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6675worker1 # [ 175.944712] nix-grpc-daemon[1711]: ts=2026-09-20T12:48:01Z level=info event=unhealthy reason=min_free6676worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)6677client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26678worker2 # [ 176.729920] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406446679client # don't know how to build these paths:6680client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6681worker1 # [ 176.772900] nix-grpc-daemon[1711]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448906682worker2 # [ 176.762994] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:01Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06683worker2 # [ 176.768650] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:01Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16684worker2 # [ 176.807901] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446685worker2 # [ 176.822183] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406446686client # copying 1 paths to 'lb:50051'...6687client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6688worker2 # [ 176.834640] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406446689worker2 # [ 176.843964] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6690worker2 # [ 177.011360] nix-daemon[865]: accepted connection from pid 1619, user nix-grpc-daemon (trusted)6691worker2 # [ 177.023674] nix-daemon[865]: reaped child process 1622, status = succeeded6692worker2 # [ 177.176135] nix-daemon[865]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)6693worker2 # [ 177.187626] nix-daemon[865]: reaped child process 1627, status = succeeded6694lb # [ 177.178195] niks3-server[999]: 2026/09/20 12:48:02 INFO Received uploads request method=POST path=/api/pending_closures6695worker2 # [ 177.212159] nix-grpc-daemon[1404]: time=2026-09-20T12:48:02.412Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6696worker2 # [ 177.214108] nix-grpc-daemon[1404]: time=2026-09-20T12:48:02.414Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6697lb # [ 177.213842] niks3-server[999]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6698lb # [ 177.222305] niks3-server[999]: 2026/09/20 12:48:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6699worker2 # [ 177.252272] nix-grpc-daemon[1404]: time=2026-09-20T12:48:02.452Z level=INFO msg="Uploading 1 narinfos"6700lb # [ 177.229130] niks3-server[999]: 2026/09/20 12:48:02 INFO Signed narinfos id=64 count=16701lb # [ 177.235319] niks3-server[999]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6702lb # [ 177.244370] niks3-server[999]: 2026/09/20 12:48:02 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6703worker2 # [ 177.277194] nix-grpc-daemon[1404]: time=2026-09-20T12:48:02.477Z level=INFO msg="Upload complete. (419ms)"6704lb # [ 177.253447] niks3-server[999]: 2026/09/20 12:48:02 INFO Completed upload id=646705lb # [ 177.257132] niks3-server[999]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6706worker2 # [ 177.281150] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=5126707worker2 # [ 177.286108] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446708worker2 # [ 177.296113] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6709worker2 # [ 177.302514] nix-daemon[865]: reaped child process 1617, status = succeeded6710worker2 # [ 177.306804] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6711client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6712client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6713lb # [ 177.877662] envoy[928]: conn peer=[2001:db8:1::1]:53622 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=300496714client # farm-a> LOG-farm-a-drain6715worker2 # [ 178.532876] nix-daemon[865]: reaped child process 1631, status = succeeded6716worker2 # [ 178.684657] nix-daemon[865]: accepted connection from pid 1646, user nix-grpc-daemon (trusted)6717worker2 # [ 178.696697] nix-daemon[865]: reaped child process 1649, status = succeeded6718lb # [ 178.686863] niks3-server[999]: 2026/09/20 12:48:03 INFO Received uploads request method=POST path=/api/pending_closures6719worker2 # [ 178.715938] nix-grpc-daemon[1404]: time=2026-09-20T12:48:03.916Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6720worker2 # [ 178.717533] nix-grpc-daemon[1404]: time=2026-09-20T12:48:03.917Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6721lb # [ 178.724473] niks3-server[999]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6722lb # [ 178.729540] niks3-server[999]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6723lb # [ 178.737900] niks3-server[999]: 2026/09/20 12:48:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6724lb # [ 178.742107] niks3-server[999]: 2026/09/20 12:48:03 INFO Signed narinfos id=65 count=16725worker2 # [ 178.766800] nix-grpc-daemon[1404]: time=2026-09-20T12:48:03.966Z level=INFO msg="Uploading 1 narinfos"6726lb # [ 178.745521] niks3-server[999]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6727lb # [ 178.749145] niks3-server[999]: 2026/09/20 12:48:03 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6728lb # [ 178.753021] niks3-server[999]: 2026/09/20 12:48:03 INFO Completed upload id=656729worker2 # [ 178.777474] nix-grpc-daemon[1404]: time=2026-09-20T12:48:03.977Z level=INFO msg="Upload complete. (262ms)"6730lb # [ 178.754631] niks3-server[999]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6731worker2 # [ 178.782787] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16732worker2 # [ 178.792727] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:03Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06733worker2 # [ 178.794705] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:03Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16734worker2 # [ 178.799864] nix-daemon[865]: reaped child process 1629, status = succeeded6735worker2 # [ 178.836978] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446736worker2 # [ 178.850212] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406446737worker2 # [ 178.862878] nix-grpc-daemon[1404]: time=2026-09-20T12:48:04.063Z level=INFO msg="All 1 paths already cached"6738client # copying 1 paths to 'lb:50051'...6739client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6740worker2 # [ 178.871683] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406446741worker2 # [ 178.879900] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6742worker2 # [ 179.031075] nix-daemon[865]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)6743worker2 # [ 179.045227] nix-daemon[865]: reaped child process 1658, status = succeeded6744worker2 # [ 179.184303] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted)6745worker2 # [ 179.196530] nix-daemon[865]: reaped child process 1663, status = succeeded6746lb # [ 179.187698] niks3-server[999]: 2026/09/20 12:48:04 INFO Received uploads request method=POST path=/api/pending_closures6747worker2 # [ 179.220391] nix-grpc-daemon[1404]: time=2026-09-20T12:48:04.420Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6748worker2 # [ 179.222279] nix-grpc-daemon[1404]: time=2026-09-20T12:48:04.422Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6749lb # [ 179.214070] niks3-server[999]: 2026/09/20 12:48:04 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6750lb # [ 179.227185] niks3-server[999]: 2026/09/20 12:48:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6751lb # [ 179.232721] niks3-server[999]: 2026/09/20 12:48:04 INFO Signed narinfos id=66 count=16752worker2 # [ 179.260339] nix-grpc-daemon[1404]: time=2026-09-20T12:48:04.460Z level=INFO msg="Uploading 1 narinfos"6753lb # [ 179.239618] niks3-server[999]: 2026/09/20 12:48:04 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6754lb # [ 179.252313] niks3-server[999]: 2026/09/20 12:48:04 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6755lb # [ 179.257891] niks3-server[999]: 2026/09/20 12:48:04 INFO Completed upload id=666756worker2 # [ 179.284669] nix-grpc-daemon[1404]: time=2026-09-20T12:48:04.484Z level=INFO msg="Upload complete. (392ms)"6757lb # [ 179.261106] niks3-server[999]: 2026/09/20 12:48:04 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6758worker2 # [ 179.287326] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=6246759worker2 # [ 179.293272] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446760worker2 # [ 179.302527] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6761worker2 # [ 179.307556] nix-daemon[865]: reaped child process 1653, status = succeeded6762client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6763worker2 # [ 179.312568] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6764client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6765client # farm-b> LOG-farm-b-drain6766worker2 # [ 180.140702] nix-daemon[865]: reaped child process 1667, status = succeeded6767worker2 # [ 180.301219] nix-daemon[865]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)6768worker2 # [ 180.314467] nix-daemon[865]: reaped child process 1685, status = succeeded6769lb # [ 180.306458] niks3-server[999]: 2026/09/20 12:48:05 INFO Received uploads request method=POST path=/api/pending_closures6770worker2 # [ 180.339468] nix-grpc-daemon[1404]: time=2026-09-20T12:48:05.539Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6771worker2 # [ 180.341108] nix-grpc-daemon[1404]: time=2026-09-20T12:48:05.541Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6772lb # [ 180.350262] niks3-server[999]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6773lb # [ 180.356708] niks3-server[999]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6774lb # [ 180.365443] niks3-server[999]: 2026/09/20 12:48:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6775lb # [ 180.371901] niks3-server[999]: 2026/09/20 12:48:05 INFO Signed narinfos id=67 count=16776worker2 # [ 180.399105] nix-grpc-daemon[1404]: time=2026-09-20T12:48:05.599Z level=INFO msg="Uploading 1 narinfos"6777lb # [ 180.376706] niks3-server[999]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6778lb # [ 180.387463] niks3-server[999]: 2026/09/20 12:48:05 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6779lb # [ 180.393384] niks3-server[999]: 2026/09/20 12:48:05 INFO Completed upload id=676780worker2 # [ 180.417841] nix-grpc-daemon[1404]: time=2026-09-20T12:48:05.618Z level=INFO msg="Upload complete. (298ms)"6781lb # [ 180.396433] niks3-server[999]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6782worker2 # [ 180.423949] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16783worker2 # [ 180.436711] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:05Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06784worker2 # [ 180.441240] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:05Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16785worker2 # [ 180.451081] nix-daemon[865]: reaped child process 1665, status = succeeded6786worker2 # [ 180.480425] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446787worker2 # [ 180.493126] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406446788worker2 # [ 180.506636] nix-grpc-daemon[1404]: time=2026-09-20T12:48:05.706Z level=INFO msg="All 2 paths already cached"6789client # copying 1 paths to 'lb:50051'...6790client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6791worker2 # [ 180.514839] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406446792worker2 # [ 180.523367] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6793worker2 # [ 180.703667] nix-daemon[865]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)6794worker2 # [ 180.722547] nix-daemon[865]: reaped child process 1694, status = succeeded6795worker2 # [ 180.878389] nix-daemon[865]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)6796worker2 # [ 180.893303] nix-daemon[865]: reaped child process 1699, status = succeeded6797lb # [ 180.883636] niks3-server[999]: 2026/09/20 12:48:05 INFO Received uploads request method=POST path=/api/pending_closures6798worker2 # [ 180.915890] nix-grpc-daemon[1404]: time=2026-09-20T12:48:06.116Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6799worker2 # [ 180.917844] nix-grpc-daemon[1404]: time=2026-09-20T12:48:06.117Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6800lb # [ 180.911142] niks3-server[999]: 2026/09/20 12:48:06 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6801lb # [ 180.919092] niks3-server[999]: 2026/09/20 12:48:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6802worker2 # [ 180.947789] nix-grpc-daemon[1404]: time=2026-09-20T12:48:06.147Z level=INFO msg="Uploading 1 narinfos"6803lb # [ 180.923252] niks3-server[999]: 2026/09/20 12:48:06 INFO Signed narinfos id=68 count=16804lb # [ 180.928261] niks3-server[999]: 2026/09/20 12:48:06 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6805lb # [ 180.939217] niks3-server[999]: 2026/09/20 12:48:06 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6806lb # [ 180.945308] niks3-server[999]: 2026/09/20 12:48:06 INFO Completed upload id=686807worker2 # [ 180.969619] nix-grpc-daemon[1404]: time=2026-09-20T12:48:06.169Z level=INFO msg="Upload complete. (433ms)"6808lb # [ 180.946960] niks3-server[999]: 2026/09/20 12:48:06 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6809worker2 # [ 180.972906] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=7526810worker2 # [ 180.975496] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406446811worker2 # [ 180.982460] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6812worker2 # [ 180.989674] nix-daemon[865]: reaped child process 1689, status = succeeded6813client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6814worker2 # [ 180.995363] nix-daemon[865]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6815client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6816client # farm-top> LOG-farm-top-drain6817worker2 # [ 181.621965] nix-daemon[865]: reaped child process 1703, status = succeeded6818worker2 # [ 181.777117] nix-daemon[865]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6819worker2 # [ 181.791138] nix-daemon[865]: reaped child process 1721, status = succeeded6820lb # [ 181.783336] niks3-server[999]: 2026/09/20 12:48:06 INFO Received uploads request method=POST path=/api/pending_closures6821worker2 # [ 181.816431] nix-grpc-daemon[1404]: time=2026-09-20T12:48:07.016Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6822worker2 # [ 181.818146] nix-grpc-daemon[1404]: time=2026-09-20T12:48:07.018Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6823lb # [ 181.821356] niks3-server[999]: 2026/09/20 12:48:06 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6824lb # [ 181.831538] niks3-server[999]: 2026/09/20 12:48:06 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6825lb # [ 181.842769] niks3-server[999]: 2026/09/20 12:48:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6826worker2 # [ 181.872054] nix-grpc-daemon[1404]: time=2026-09-20T12:48:07.072Z level=INFO msg="Uploading 1 narinfos"6827lb # [ 181.847229] niks3-server[999]: 2026/09/20 12:48:06 INFO Signed narinfos id=69 count=16828lb # [ 181.852454] niks3-server[999]: 2026/09/20 12:48:06 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6829lb # [ 181.860918] niks3-server[999]: 2026/09/20 12:48:06 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6830lb # [ 181.864472] niks3-server[999]: 2026/09/20 12:48:06 INFO Completed upload id=696831worker2 # [ 181.888803] nix-grpc-daemon[1404]: time=2026-09-20T12:48:07.089Z level=INFO msg="Upload complete. (286ms)"6832lb # [ 181.866209] niks3-server[999]: 2026/09/20 12:48:06 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6833worker2 # [ 181.891471] nix-grpc-daemon[1330]: ts=2026-09-20T12:48:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16834worker2 # [ 181.898845] nix-daemon[865]: reaped child process 1701, status = succeeded6835client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 5.42 seconds)6836client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6837client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.19 seconds)6838worker1: must succeed: rm /nix/.rw-store/fill6839worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.11 seconds)6840worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6841worker1 # [ 182.951722] nix-grpc-daemon[1711]: ts=2026-09-20T12:48:08Z level=info event=healthy reason=min_free6842worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6843(finished: subtest: low disk drains a worker and builds go to the other, in 8.99 seconds)6844(finished: run the VM test script, in 184.31 seconds)6845test script finished in 184.53s6846cleanup6847kill QemuMachine (pid 49)6848client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6849kill QemuMachine (pid 50)6850lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6851kill QemuMachine (pid 52)6852worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6853kill QemuMachine (pid 51)6854worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6855(finished: cleanup, in 1.04 seconds)6856additionally exposed symbols:6857 client, lb, worker1, worker2,6858 vlan1,6859 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh

succeeded vm-test-run-nix-grpc-farm checks.x86_64-linux.farm · build #347 · raw

succeeded `vm-test-run-nix-grpc-farm` `checks.x86_64-linux.farm` · build #347 · raw