vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #422
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2: QEMU running (pid 52)13worker2 # Disk image does not exist, creating the virtualisation disk image...14worker2 # Formatting '/build/vm-state-worker2/tmp.Ll0Q8DwGH9', fmt=raw size=107374182415worker2 # mke2fs 1.47.4 (6-Mar-2025)16worker2 # Discarding device blocks: 0/262144 done17worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes18worker2 # Filesystem UUID: 82e4d7cc-d8de-402d-9058-e8b3fe697dad19worker2 # Superblock backups stored on blocks:20worker2 # 32768, 98304, 163840, 22937621client # Disk image does not exist, creating the virtualisation disk image...22worker1 # Disk image does not exist, creating the virtualisation disk image...23client: QEMU running (pid 49)24client # Formatting '/build/vm-state-client/tmp.jFpGDO5Bw4', fmt=raw size=107374182425worker1 # Formatting '/build/vm-state-worker1/tmp.EG74dhyhIC', fmt=raw size=107374182426worker2 # 27worker1: QEMU running (pid 50)28client # mke2fs 1.47.4 (6-Mar-2025)29worker1 # mke2fs 1.47.4 (6-Mar-2025)30lb: QEMU running (pid 51)31client # Discarding device blocks: 0/262144 done32worker1 # Discarding device blocks: 0/262144 done33lb # Disk image does not exist, creating the virtualisation disk image...34worker2 # Allocating group tables: 0/8 done35(finished: start all VMs, in 0.24 seconds)36lb # Formatting '/build/vm-state-lb/tmp.gYsemyZ3dE', fmt=raw size=107374182437worker2 # Writing inode tables: 0/8 done38client: waiting for unit network-addresses-eth1.service39lb # mke2fs 1.47.4 (6-Mar-2025)40worker2 # Creating journal (8192 blocks): done41client: waiting for the VM to finish booting42lb # Discarding device blocks: 0/262144 done43worker2 # Writing superblocks and filesystem accounting information: 0/8 done44worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes45client # Creating filesystem with 262144 4k blocks and 65536 inodes46lb # Creating filesystem with 262144 4k blocks and 65536 inodes47worker2 # 48worker1 # Filesystem UUID: af53c2e0-642a-49cc-b19d-ec18541002f349client # Filesystem UUID: 2fb76945-539f-4226-851c-40055d5a10bd50lb # Filesystem UUID: d3541df4-d93d-4b75-92e7-2adfdb9acae551worker2 # Virtualisation disk image created.52worker1 # Superblock backups stored on blocks:53client # Superblock backups stored on blocks:54worker1 # 32768, 98304, 163840, 22937655client # 32768, 98304, 163840, 22937656worker1 # 57client # 58worker1 # Allocating group tables: 0/8 done59client # Allocating group tables: 0/8 done60worker1 # Writing inode tables: 0/8 done61client # Writing inode tables: 0/8 done62worker1 # Creating journal (8192 blocks): done63client # Creating journal (8192 blocks): done64worker1 # Writing superblocks and filesystem accounting information: 0/8 done65client # Writing superblocks and filesystem accounting information: 0/8 done66worker1 # 67client # 68worker1 # Virtualisation disk image created.69client # Virtualisation disk image created.70lb # Superblock backups stored on blocks:71lb # 32768, 98304, 163840, 22937672lb # 73lb # Allocating group tables: 0/8 done74lb # Writing inode tables: 0/8 done75lb # Creating journal (8192 blocks): done76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker1 # 87worker1 # 88worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...89worker2 # 90worker2 # 91worker2 # 92worker2 # 93worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0094worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0095worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...96worker1 # 97worker1 # 98worker1 # 99worker1 # 100worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...101worker2 # 102worker2 # 103worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104lb # 105lb # 106worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...107worker1 # 108worker1 # 109lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00110lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...111lb # 112lb # 113lb # 114lb # 115lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117lb # 118lb # 119client # 120client # 121client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123client # 124client # 125client # 126client # 127worker2 # Booting from ROM...128client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00129client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...130client # 131client # 132worker1 # Booting from ROM...133lb # Booting from ROM...134client # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/avgz1xwnsdcr89ixhzpjxxamx0a17iya-nixos-system-worker2-test/init regInfo=/nix/store/7095zbkawwfjv2rh6pws5rlyd41c40m6-closure-info/registration console=ttyS0,115200n8 console=tty0137worker2 # [ 0.000000] BIOS-provided physical RAM map:138worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148worker2 # [ 0.000000] NX (Execute Disable) protection: active149worker2 # [ 0.000000] APIC: Static calls initialized150worker2 # [ 0.000000] SMBIOS 2.8 present.151worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152worker2 # [ 0.000000] DMI: Memory slots populated: 1/1153worker2 # [ 0.000000] Hypervisor detected: KVM154worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000155worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00156worker2 # [ 0.000000] kvm-clock: using sched offset of 439777440 cycles157worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns158worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor159worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000160worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026161worker2 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs162worker2 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT163worker2 # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]164worker2 # [ 0.002748] Using GB pages for direct mapping165worker2 # [ 0.002855] RAMDISK: [mem 0x5e367000-0x5ffcffff]166worker2 # [ 0.002862] ACPI: Early table checksum verification disabled167worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i5n01gwf2bafd8bgcinnp973afrcvq8l-nixos-system-worker1-test/init regInfo=/nix/store/7lskfnniqbw7gxgzhdfpqij5r4pagw88-closure-info/registration console=ttyS0,115200n8 console=tty0168worker2 # [ 0.002865] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )169worker1 # [ 0.000000] BIOS-provided physical RAM map:170worker2 # [ 0.002869] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)171worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable172worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved173worker2 # [ 0.002873] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)174worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved175worker2 # [ 0.002879] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)176worker2 # [ 0.002882] ACPI: FACS 0x000000005FFE0000 000040177worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable178worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved179worker2 # [ 0.002883] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)180worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved181worker2 # [ 0.002885] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)182worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved183worker2 # [ 0.002886] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)184lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026185worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved186worker2 # [ 0.002888] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)187worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved188worker2 # [ 0.002889] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]189worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved190worker1 # [ 0.000000] NX (Execute Disable) protection: active191worker2 # [ 0.002890] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]192worker1 # [ 0.000000] APIC: Static calls initialized193worker1 # [ 0.000000] SMBIOS 2.8 present.194worker2 # [ 0.002891] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]195lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0196lb # [ 0.000000] BIOS-provided physical RAM map:197worker2 # [ 0.002891] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]198worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014199lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable200worker2 # [ 0.002892] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]201worker1 # [ 0.000000] DMI: Memory slots populated: 1/1202worker1 # [ 0.000000] Hypervisor detected: KVM203lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved204worker2 # [ 0.002892] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]205worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000206lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved207worker2 # [ 0.002893] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]208worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00209worker2 # [ 0.003111] No NUMA configuration found210lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable211worker1 # [ 0.000000] kvm-clock: using sched offset of 471451123 cycles212worker2 # [ 0.003112] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]213lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved214worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns215worker2 # [ 0.003114] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]216worker2 # [ 0.005278] Zone ranges:217lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved218worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor219worker2 # [ 0.005279] DMA [mem 0x0000000000001000-0x0000000000ffffff]220lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved221worker1 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000222worker2 # [ 0.005280] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]223lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved224worker2 # [ 0.005281] Normal empty225worker1 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs226worker2 # [ 0.005282] Device empty227lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved228worker2 # [ 0.005283] Movable zone start for each node229worker1 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT230worker2 # [ 0.005283] Early memory node ranges231lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved232worker1 # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]233worker2 # [ 0.005284] node 0: [mem 0x0000000000001000-0x000000000009efff]234worker1 # [ 0.002748] Using GB pages for direct mapping235lb # [ 0.000000] NX (Execute Disable) protection: active236lb # [ 0.000000] APIC: Static calls initialized237worker1 # [ 0.002838] RAMDISK: [mem 0x5e367000-0x5ffcffff]238worker2 # [ 0.005285] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]239lb # [ 0.000000] SMBIOS 2.8 present.240worker1 # [ 0.002846] ACPI: Early table checksum verification disabled241worker2 # [ 0.005286] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]242worker1 # [ 0.002849] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )243lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014244worker2 # [ 0.005311] On node 0, zone DMA: 1 pages in unavailable ranges245lb # [ 0.000000] DMI: Memory slots populated: 1/1246worker2 # [ 0.005562] On node 0, zone DMA: 97 pages in unavailable ranges247worker1 # [ 0.002853] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)248lb # [ 0.000000] Hypervisor detected: KVM249worker2 # [ 0.030607] On node 0, zone DMA32: 40 pages in unavailable ranges250lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000251worker1 # [ 0.002857] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)252worker2 # [ 0.031057] ACPI: PM-Timer IO Port: 0x608253lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00254worker2 # [ 0.031066] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])255client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026256worker1 # [ 0.002864] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)257lb # [ 0.000000] kvm-clock: using sched offset of 462002760 cycles258worker2 # [ 0.031092] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23259worker1 # [ 0.002867] ACPI: FACS 0x000000005FFE0000 000040260lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns261worker2 # [ 0.031095] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)262worker1 # [ 0.002868] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)263lb # [ 0.000005] tsc: Detected 2400.012 MHz processor264worker2 # [ 0.031096] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)265lb # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000266worker1 # [ 0.002870] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)267worker2 # [ 0.031097] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)268lb # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs269worker1 # [ 0.002871] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)270client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test/init regInfo=/nix/store/w8xq6gaqmarh41h237zaqb1pr4hq8yrq-closure-info/registration console=ttyS0,115200n8 console=tty0271worker2 # [ 0.031098] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)272client # [ 0.000000] BIOS-provided physical RAM map:273lb # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT274worker1 # [ 0.002873] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)275worker2 # [ 0.031099] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)276client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable277lb # [ 0.002743] found SMP MP-table at [mem 0x000f5450-0x000f545f]278worker2 # [ 0.031102] ACPI: Using ACPI (MADT) for SMP configuration information279lb # [ 0.002754] Using GB pages for direct mapping280worker1 # [ 0.002874] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]281client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved282worker2 # [ 0.031103] ACPI: HPET id: 0x8086a201 base: 0xfed00000283lb # [ 0.002911] RAMDISK: [mem 0x5e367000-0x5ffcffff]284worker1 # [ 0.002875] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]285worker2 # [ 0.031106] TSC deadline timer available286lb # [ 0.002919] ACPI: Early table checksum verification disabled287client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved288worker2 # [ 0.031110] CPU topo: Max. logical packages: 1289worker1 # [ 0.002876] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]290client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable291lb # [ 0.002922] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )292worker2 # [ 0.031111] CPU topo: Max. logical dies: 1293worker1 # [ 0.002876] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]294worker2 # [ 0.031111] CPU topo: Max. dies per package: 1295client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved296lb # [ 0.002926] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)297worker2 # [ 0.031115] CPU topo: Max. threads per core: 1298worker1 # [ 0.002877] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]299client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved300worker2 # [ 0.031115] CPU topo: Num. cores per package: 1301lb # [ 0.002930] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)302worker1 # [ 0.002877] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]303worker2 # [ 0.031116] CPU topo: Num. threads per package: 1304client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved305worker1 # [ 0.002877] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]306worker2 # [ 0.031116] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs307lb # [ 0.002937] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)308client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved309worker1 # [ 0.003102] No NUMA configuration found310lb # [ 0.002939] ACPI: FACS 0x000000005FFE0000 000040311worker2 # [ 0.031133] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()312client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved313worker1 # [ 0.003102] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]314lb # [ 0.002941] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)315worker2 # [ 0.031163] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]316worker1 # [ 0.003105] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]317client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved318worker1 # [ 0.005628] Zone ranges:319client # [ 0.000000] NX (Execute Disable) protection: active320lb # [ 0.002942] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)321worker2 # [ 0.031165] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]322client # [ 0.000000] APIC: Static calls initialized323worker1 # [ 0.005629] DMA [mem 0x0000000000001000-0x0000000000ffffff]324client # [ 0.000000] SMBIOS 2.8 present.325worker2 # [ 0.031166] [mem 0x60000000-0xafffffff] available for PCI devices326lb # [ 0.002944] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)327worker1 # [ 0.005631] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]328worker2 # [ 0.031168] Booting paravirtualized kernel on KVM329worker1 # [ 0.005632] Normal empty330worker1 # [ 0.005633] Device empty331client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014332lb # [ 0.002945] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)333worker1 # [ 0.005633] Movable zone start for each node334worker2 # [ 0.031170] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns335client # [ 0.000000] DMI: Memory slots populated: 1/1336lb # [ 0.002947] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]337worker1 # [ 0.005634] Early memory node ranges338client # [ 0.000000] Hypervisor detected: KVM339worker2 # [ 0.035619] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1340client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000341worker1 # [ 0.005634] node 0: [mem 0x0000000000001000-0x000000000009efff]342lb # [ 0.002948] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]343client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00344worker2 # [ 0.037673] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152345worker1 # [ 0.005636] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]346lb # [ 0.002948] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]347worker2 # [ 0.037711] kvm-guest: PV spinlocks disabled, single CPU348client # [ 0.000001] kvm-clock: using sched offset of 500594017 cycles349worker1 # [ 0.005636] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]350lb # [ 0.002949] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]351worker1 # [ 0.005657] On node 0, zone DMA: 1 pages in unavailable ranges352client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns353lb # [ 0.002949] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]354worker1 # [ 0.005916] On node 0, zone DMA: 97 pages in unavailable ranges355client # [ 0.000005] tsc: Detected 2400.012 MHz processor356lb # [ 0.002950] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]357worker1 # [ 0.032537] On node 0, zone DMA32: 40 pages in unavailable ranges358client # [ 0.000805] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000359worker1 # [ 0.033006] ACPI: PM-Timer IO Port: 0x608360lb # [ 0.002950] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]361lb # [ 0.003182] No NUMA configuration found362client # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs363worker1 # [ 0.033019] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])364worker2 # [ 0.037712] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/avgz1xwnsdcr89ixhzpjxxamx0a17iya-nixos-system-worker2-test/init regInfo=/nix/store/7095zbkawwfjv2rh6pws5rlyd41c40m6-closure-info/registration console=ttyS0,115200n8 console=tty0365lb # [ 0.003182] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]366client # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT367worker1 # [ 0.033048] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23368client # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f]369lb # [ 0.003185] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]370worker1 # [ 0.033050] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)371lb # [ 0.005465] Zone ranges:372worker2 # [ 0.037802] Unknown kernel command line parameters "regInfo=/nix/store/7095zbkawwfjv2rh6pws5rlyd41c40m6-closure-info/registration", will be passed to user space.373client # [ 0.002738] Using GB pages for direct mapping374worker2 # [ 0.037815] random: crng init done375worker1 # [ 0.033052] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)376lb # [ 0.005466] DMA [mem 0x0000000000001000-0x0000000000ffffff]377client # [ 0.002848] RAMDISK: [mem 0x5e366000-0x5ffcffff]378worker2 # [ 0.037815] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes379worker1 # [ 0.033053] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)380lb # [ 0.005468] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]381client # [ 0.002856] ACPI: Early table checksum verification disabled382lb # [ 0.005469] Normal empty383client # [ 0.002859] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )384lb # [ 0.005470] Device empty385worker1 # [ 0.033054] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)386worker2 # [ 0.039840] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)387lb # [ 0.005470] Movable zone start for each node388worker1 # [ 0.033055] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)389client # [ 0.002863] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)390worker2 # [ 0.041082] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)391lb # [ 0.005471] Early memory node ranges392worker2 # [ 0.041112] Fallback order for Node 0: 0393worker1 # [ 0.033057] ACPI: Using ACPI (MADT) for SMP configuration information394lb # [ 0.005472] node 0: [mem 0x0000000000001000-0x000000000009efff]395client # [ 0.002866] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)396worker1 # [ 0.033058] ACPI: HPET id: 0x8086a201 base: 0xfed00000397worker2 # [ 0.041115] Built 1 zonelists, mobility grouping on. Total pages: 393078398lb # [ 0.005473] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]399worker2 # [ 0.041116] Policy zone: DMA32400worker1 # [ 0.033063] TSC deadline timer available401client # [ 0.002873] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)402lb # [ 0.005473] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]403worker1 # [ 0.033067] CPU topo: Max. logical packages: 1404worker2 # [ 0.043617] mem auto-init: stack:all(zero), heap alloc:on, heap free:off405client # [ 0.002875] ACPI: FACS 0x000000005FFE0000 000040406worker1 # [ 0.033068] CPU topo: Max. logical dies: 1407lb # [ 0.005492] On node 0, zone DMA: 1 pages in unavailable ranges408worker2 # [ 0.046548] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1409worker1 # [ 0.033069] CPU topo: Max. dies per package: 1410client # [ 0.002876] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)411lb # [ 0.005758] On node 0, zone DMA: 97 pages in unavailable ranges412worker2 # [ 0.049695] allocated 3145728 bytes of page_ext413worker1 # [ 0.033072] CPU topo: Max. threads per core: 1414lb # [ 0.032225] On node 0, zone DMA32: 40 pages in unavailable ranges415worker2 # [ 0.059164] ftrace: allocating 48731 entries in 192 pages416worker1 # [ 0.033073] CPU topo: Num. cores per package: 1417client # [ 0.002878] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)418lb # [ 0.032679] ACPI: PM-Timer IO Port: 0x608419worker1 # [ 0.033073] CPU topo: Num. threads per package: 1420worker2 # [ 0.059166] ftrace: allocated 192 pages with 2 groups421worker2 # [ 0.059994] Dynamic Preempt: lazy422client # [ 0.002880] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)423lb # [ 0.032691] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])424worker1 # [ 0.033073] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs425worker2 # [ 0.060171] rcu: Preemptible hierarchical RCU implementation.426lb # [ 0.032719] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23427client # [ 0.002881] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)428worker2 # [ 0.060172] rcu: RCU event tracing is enabled.429worker1 # [ 0.033095] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()430lb # [ 0.032722] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)431client # [ 0.002882] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]432worker1 # [ 0.033130] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]433worker2 # [ 0.060172] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.434lb # [ 0.032724] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)435worker2 # [ 0.060174] Trampoline variant of Tasks RCU enabled.436client # [ 0.002883] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]437worker1 # [ 0.033132] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]438worker2 # [ 0.060174] Rude variant of Tasks RCU enabled.439lb # [ 0.032725] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)440client # [ 0.002884] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]441worker2 # [ 0.060174] Tracing variant of Tasks RCU enabled.442worker1 # [ 0.033133] [mem 0x60000000-0xafffffff] available for PCI devices443lb # [ 0.032726] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)444worker1 # [ 0.033135] Booting paravirtualized kernel on KVM445client # [ 0.002884] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]446worker2 # [ 0.060175] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.447lb # [ 0.032727] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)448client # [ 0.002885] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]449worker1 # [ 0.033138] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns450worker2 # [ 0.060176] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1451lb # [ 0.032729] ACPI: Using ACPI (MADT) for SMP configuration information452client # [ 0.002885] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]453lb # [ 0.032730] ACPI: HPET id: 0x8086a201 base: 0xfed00000454worker1 # [ 0.037607] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1455worker2 # [ 0.060197] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.456lb # [ 0.032734] TSC deadline timer available457client # [ 0.002886] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]458worker1 # [ 0.039789] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152459lb # [ 0.032738] CPU topo: Max. logical packages: 1460client # [ 0.003124] No NUMA configuration found461worker2 # [ 0.060199] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.462worker1 # [ 0.039833] kvm-guest: PV spinlocks disabled, single CPU463lb # [ 0.032739] CPU topo: Max. logical dies: 1464client # [ 0.003125] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]465lb # [ 0.032740] CPU topo: Max. dies per package: 1466worker2 # [ 0.060200] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.467client # [ 0.003127] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]468lb # [ 0.032743] CPU topo: Max. threads per core: 1469client # [ 0.005438] Zone ranges:470worker2 # [ 0.064616] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16471lb # [ 0.032744] CPU topo: Num. cores per package: 1472client # [ 0.005439] DMA [mem 0x0000000000001000-0x0000000000ffffff]473lb # [ 0.032744] CPU topo: Num. threads per package: 1474worker2 # [ 0.064876] rcu: srcu_init: Setting srcu_struct sizes based on contention.475client # [ 0.005441] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]476lb # [ 0.032745] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs477client # [ 0.005442] Normal empty478worker2 # [ 0.064882] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns479client # [ 0.005443] Device empty480worker1 # [ 0.039834] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i5n01gwf2bafd8bgcinnp973afrcvq8l-nixos-system-worker1-test/init regInfo=/nix/store/7lskfnniqbw7gxgzhdfpqij5r4pagw88-closure-info/registration console=ttyS0,115200n8 console=tty0481lb # [ 0.032764] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()482client # [ 0.005444] Movable zone start for each node483client # [ 0.005444] Early memory node ranges484worker2 # [ 0.064980] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)485lb # [ 0.032797] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]486worker2 # [ 0.068492] Console: colour VGA+ 80x25487client # [ 0.005445] node 0: [mem 0x0000000000001000-0x000000000009efff]488worker1 # [ 0.039931] Unknown kernel command line parameters "regInfo=/nix/store/7lskfnniqbw7gxgzhdfpqij5r4pagw88-closure-info/registration", will be passed to user space.489lb # [ 0.032799] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]490worker2 # [ 0.068495] printk: legacy console [tty0] enabled491worker1 # [ 0.039945] random: crng init done492client # [ 0.005446] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]493worker2 # [ 0.097966] printk: legacy console [ttyS0] enabled494lb # [ 0.032800] [mem 0x60000000-0xafffffff] available for PCI devices495worker1 # [ 0.039946] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes496lb # [ 0.032802] Booting paravirtualized kernel on KVM497client # [ 0.005447] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]498worker2 # [ 0.193708] ACPI: Core revision 20250807499client # [ 0.005471] On node 0, zone DMA: 1 pages in unavailable ranges500worker1 # [ 0.042086] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)501lb # [ 0.032805] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns502client # [ 0.005736] On node 0, zone DMA: 97 pages in unavailable ranges503worker1 # [ 0.043172] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)504worker2 # [ 0.194561] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns505client # [ 0.032526] On node 0, zone DMA32: 40 pages in unavailable ranges506lb # [ 0.037268] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1507worker1 # [ 0.043214] Fallback order for Node 0: 0508client # [ 0.032989] ACPI: PM-Timer IO Port: 0x608509worker2 # [ 0.196047] APIC: Switch to symmetric I/O mode setup510lb # [ 0.039432] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152511worker1 # [ 0.043217] Built 1 zonelists, mobility grouping on. Total pages: 393078512client # [ 0.033001] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])513worker1 # [ 0.043218] Policy zone: DMA32514worker2 # [ 0.196968] x2apic enabled515lb # [ 0.039474] kvm-guest: PV spinlocks disabled, single CPU516client # [ 0.033031] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23517worker1 # [ 0.045898] mem auto-init: stack:all(zero), heap alloc:on, heap free:off518worker2 # [ 0.197704] APIC: Switched APIC routing to: physical x2apic519client # [ 0.033034] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)520worker1 # [ 0.049276] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1521worker1 # [ 0.052659] allocated 3145728 bytes of page_ext522client # [ 0.033036] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)523worker1 # [ 0.062749] ftrace: allocating 48731 entries in 192 pages524worker2 # [ 0.199488] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1525client # [ 0.033037] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)526worker1 # [ 0.062751] ftrace: allocated 192 pages with 2 groups527worker1 # [ 0.063592] Dynamic Preempt: lazy528lb # [ 0.039475] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0529client # [ 0.033038] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)530worker1 # [ 0.063782] rcu: Preemptible hierarchical RCU implementation.531client # [ 0.033039] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)532worker2 # [ 0.200433] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns533worker1 # [ 0.063783] rcu: RCU event tracing is enabled.534client # [ 0.033041] ACPI: Using ACPI (MADT) for SMP configuration information535lb # [ 0.039570] Unknown kernel command line parameters "regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration", will be passed to user space.536worker1 # [ 0.063784] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.537lb # [ 0.039582] random: crng init done538worker2 # [ 0.202016] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)539client # [ 0.033042] ACPI: HPET id: 0x8086a201 base: 0xfed00000540worker1 # [ 0.063786] Trampoline variant of Tasks RCU enabled.541client # [ 0.033046] TSC deadline timer available542lb # [ 0.039583] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes543worker1 # [ 0.063786] Rude variant of Tasks RCU enabled.544worker2 # [ 0.204099] x86/cpu: User Mode Instruction Prevention (UMIP) activated545client # [ 0.033050] CPU topo: Max. logical packages: 1546worker1 # [ 0.063786] Tracing variant of Tasks RCU enabled.547client # [ 0.033051] CPU topo: Max. logical dies: 1548lb # [ 0.041705] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)549client # [ 0.033051] CPU topo: Max. dies per package: 1550worker2 # [ 0.205177] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127551worker1 # [ 0.063787] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.552lb # [ 0.042958] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)553client # [ 0.033054] CPU topo: Max. threads per core: 1554worker1 # [ 0.063788] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1555lb # [ 0.042988] Fallback order for Node 0: 0556worker2 # [ 0.206020] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0557client # [ 0.033055] CPU topo: Num. cores per package: 1558client # [ 0.033056] CPU topo: Num. threads per package: 1559lb # [ 0.042991] Built 1 zonelists, mobility grouping on. Total pages: 393078560worker1 # [ 0.063802] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.561lb # [ 0.042992] Policy zone: DMA32562client # [ 0.033056] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs563worker2 # [ 0.207017] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto564lb # [ 0.045490] mem auto-init: stack:all(zero), heap alloc:on, heap free:off565worker1 # [ 0.063804] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.566client # [ 0.033075] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()567lb # [ 0.048663] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1568client # [ 0.033107] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]569worker1 # [ 0.063805] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570worker2 # [ 0.208014] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl571lb # [ 0.051973] allocated 3145728 bytes of page_ext572lb # [ 0.061949] ftrace: allocating 48731 entries in 192 pages573worker1 # [ 0.068192] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16574client # [ 0.033108] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]575worker2 # [ 0.209014] Transient Scheduler Attacks: Vulnerable: No microcode576lb # [ 0.061952] ftrace: allocated 192 pages with 2 groups577worker1 # [ 0.068472] rcu: srcu_init: Setting srcu_struct sizes based on contention.578client # [ 0.033110] [mem 0x60000000-0xafffffff] available for PCI devices579lb # [ 0.062784] Dynamic Preempt: lazy580worker2 # [ 0.210014] Spectre V2 : Mitigation: Enhanced / Automatic IBRS581client # [ 0.033111] Booting paravirtualized kernel on KVM582lb # [ 0.062916] rcu: Preemptible hierarchical RCU implementation.583worker1 # [ 0.068479] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns584worker2 # [ 0.211014] Speculative Return Stack Overflow: Mitigation: Safe RET585lb # [ 0.062917] rcu: RCU event tracing is enabled.586client # [ 0.033114] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns587lb # [ 0.062918] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.588worker1 # [ 0.068585] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)589client # [ 0.037555] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1590worker1 # [ 0.072125] Console: colour VGA+ 80x25591lb # [ 0.062919] Trampoline variant of Tasks RCU enabled.592worker1 # [ 0.072128] printk: legacy console [tty0] enabled593lb # [ 0.062920] Rude variant of Tasks RCU enabled.594client # [ 0.039724] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152595worker1 # [ 0.101590] printk: legacy console [ttyS0] enabled596lb # [ 0.062920] Tracing variant of Tasks RCU enabled.597client # [ 0.039769] kvm-guest: PV spinlocks disabled, single CPU598worker1 # [ 0.197622] ACPI: Core revision 20250807599lb # [ 0.062921] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.600worker2 # [ 0.212014] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization601lb # [ 0.062922] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1602worker2 # [ 0.214021] Spectre V2 : Enabling IBPB for BPF603worker1 # [ 0.198495] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns604lb # [ 0.062980] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.605worker1 # [ 0.199988] APIC: Switch to symmetric I/O mode setup606worker2 # [ 0.214730] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier607lb # [ 0.062982] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.608client # [ 0.039771] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test/init regInfo=/nix/store/w8xq6gaqmarh41h237zaqb1pr4hq8yrq-closure-info/registration console=ttyS0,115200n8 console=tty0609worker1 # [ 0.200911] x2apic enabled610worker2 # [ 0.216014] active return thunk: srso_alias_return_thunk611lb # [ 0.062983] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612worker1 # [ 0.201648] APIC: Switched APIC routing to: physical x2apic613client # [ 0.039864] Unknown kernel command line parameters "regInfo=/nix/store/w8xq6gaqmarh41h237zaqb1pr4hq8yrq-closure-info/registration", will be passed to user space.614worker2 # [ 0.217035] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'615lb # [ 0.067542] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16616client # [ 0.039876] random: crng init done617lb # [ 0.067828] rcu: srcu_init: Setting srcu_struct sizes based on contention.618worker2 # [ 0.218014] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'619client # [ 0.039877] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes620worker1 # [ 0.203446] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1621worker2 # [ 0.219013] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'622lb # [ 0.067834] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns623client # [ 0.042010] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)624worker1 # [ 0.204411] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns625worker2 # [ 0.220014] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'626lb # [ 0.067937] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)627client # [ 0.043260] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)628client # [ 0.043291] Fallback order for Node 0: 0629lb # [ 0.071457] Console: colour VGA+ 80x25630worker2 # [ 0.221013] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'631lb # [ 0.071460] printk: legacy console [tty0] enabled632worker1 # [ 0.206049] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)633client # [ 0.043294] Built 1 zonelists, mobility grouping on. Total pages: 393078634lb # [ 0.101329] printk: legacy console [ttyS0] enabled635client # [ 0.043295] Policy zone: DMA32636worker2 # [ 0.222014] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'637lb # [ 0.196804] ACPI: Core revision 20250807638client # [ 0.046175] mem auto-init: stack:all(zero), heap alloc:on, heap free:off639worker1 # [ 0.207134] x86/cpu: User Mode Instruction Prevention (UMIP) activated640worker2 # [ 0.223014] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'641client # [ 0.049282] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1642worker1 # [ 0.208221] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127643client # [ 0.052606] allocated 3145728 bytes of page_ext644lb # [ 0.197669] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns645worker2 # [ 0.224014] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256646client # [ 0.062384] ftrace: allocating 48731 entries in 192 pages647worker1 # [ 0.209046] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0648lb # [ 0.199143] APIC: Switch to symmetric I/O mode setup649client # [ 0.062386] ftrace: allocated 192 pages with 2 groups650worker2 # [ 0.225013] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64651client # [ 0.063231] Dynamic Preempt: lazy652lb # [ 0.200081] x2apic enabled653client # [ 0.063361] rcu: Preemptible hierarchical RCU implementation.654worker2 # [ 0.226013] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512655worker1 # [ 0.210050] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto656client # [ 0.063362] rcu: RCU event tracing is enabled.657lb # [ 0.200818] APIC: Switched APIC routing to: physical x2apic658worker2 # [ 0.227014] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024659client # [ 0.063363] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.660worker1 # [ 0.211046] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl661worker2 # [ 0.228014] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8662client # [ 0.063364] Trampoline variant of Tasks RCU enabled.663lb # [ 0.202593] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1664client # [ 0.063365] Rude variant of Tasks RCU enabled.665worker1 # [ 0.212046] Transient Scheduler Attacks: Vulnerable: No microcode666client # [ 0.063365] Tracing variant of Tasks RCU enabled.667worker2 # [ 0.229014] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.668worker1 # [ 0.213046] Spectre V2 : Mitigation: Enhanced / Automatic IBRS669client # [ 0.063366] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.670lb # [ 0.203546] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns671worker1 # [ 0.214046] Speculative Return Stack Overflow: Mitigation: Safe RET672client # [ 0.063367] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1673lb # [ 0.205122] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)674client # [ 0.063383] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.675lb # [ 0.207208] x86/cpu: User Mode Instruction Prevention (UMIP) activated676client # [ 0.063385] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.677lb # [ 0.208275] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127678client # [ 0.063386] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.679worker1 # [ 0.215046] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization680client # [ 0.068032] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16681lb # [ 0.209120] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0682worker1 # [ 0.217054] Spectre V2 : Enabling IBPB for BPF683client # [ 0.068307] rcu: srcu_init: Setting srcu_struct sizes based on contention.684lb # [ 0.210122] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto685worker1 # [ 0.218047] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier686client # [ 0.068315] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns687worker1 # [ 0.219046] active return thunk: srso_alias_return_thunk688lb # [ 0.212119] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl689client # [ 0.068418] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)690client # [ 0.071982] Console: colour VGA+ 80x25691worker1 # [ 0.220068] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'692lb # [ 0.213119] Transient Scheduler Attacks: Vulnerable: No microcode693client # [ 0.071985] printk: legacy console [tty0] enabled694client # [ 0.101487] printk: legacy console [ttyS0] enabled695worker1 # [ 0.221046] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'696lb # [ 0.214119] Spectre V2 : Mitigation: Enhanced / Automatic IBRS697client # [ 0.197366] ACPI: Core revision 20250807698worker1 # [ 0.222046] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'699lb # [ 0.215119] Speculative Return Stack Overflow: Mitigation: Safe RET700worker1 # [ 0.223046] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'701client # [ 0.198254] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns702worker1 # [ 0.224046] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'703client # [ 0.199775] APIC: Switch to symmetric I/O mode setup704client # [ 0.200748] x2apic enabled705worker1 # [ 0.225046] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'706client # [ 0.201514] APIC: Switched APIC routing to: physical x2apic707lb # [ 0.216119] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization708worker1 # [ 0.226046] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'709lb # [ 0.218126] Spectre V2 : Enabling IBPB for BPF710worker1 # [ 0.228047] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256711client # [ 0.203311] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1712lb # [ 0.219120] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier713worker1 # [ 0.229046] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64714lb # [ 0.220119] active return thunk: srso_alias_return_thunk715worker1 # [ 0.230046] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512716client # [ 0.204253] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns717lb # [ 0.221140] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'718worker1 # [ 0.231046] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024719client # [ 0.205850] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)720lb # [ 0.222119] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'721worker1 # [ 0.232046] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8722client # [ 0.206936] x86/cpu: User Mode Instruction Prevention (UMIP) activated723lb # [ 0.223853] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'724worker1 # [ 0.232969] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.725client # [ 0.208003] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127726lb # [ 0.224884] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'727client # [ 0.208848] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0728lb # [ 0.225864] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'729lb # [ 0.226912] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'730client # [ 0.209851] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto731lb # [ 0.227932] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'732client # [ 0.210848] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl733lb # [ 0.229119] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256734client # [ 0.211848] Transient Scheduler Attacks: Vulnerable: No microcode735lb # [ 0.230119] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64736client # [ 0.212847] Spectre V2 : Mitigation: Enhanced / Automatic IBRS737lb # [ 0.231119] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512738client # [ 0.213848] Speculative Return Stack Overflow: Mitigation: Safe RET739lb # [ 0.232119] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024740lb # [ 0.233119] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8741lb # [ 0.234119] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.742client # [ 0.214847] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization743worker2 # [ 0.263647] Freeing SMP alternatives memory: 44K744client # [ 0.216856] Spectre V2 : Enabling IBPB for BPF745worker2 # [ 0.264017] pid_max: default: 32768 minimum: 301746client # [ 0.217848] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier747worker2 # [ 0.265096] LSM: initializing lsm=capability,landlock,yama,bpf,ima748client # [ 0.218848] active return thunk: srso_alias_return_thunk749worker2 # [ 0.266114] landlock: Up and running.750worker2 # [ 0.267014] Yama: becoming mindful.751client # [ 0.219869] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'752worker2 # [ 0.267819] LSM support for eBPF active753client # [ 0.220847] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'754worker2 # [ 0.268615] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)755client # [ 0.221847] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'756client # [ 0.222847] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'757worker2 # [ 0.269963] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)758client # [ 0.223847] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'759client # [ 0.224847] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'760worker2 # [ 0.272235] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)761client # [ 0.225847] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'762worker2 # [ 0.273543] Performance Events: Fam17h+ core perfctr, AMD PMU driver.763client # [ 0.227848] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256764worker2 # [ 0.274023] ... version: 2765client # [ 0.228847] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64766worker2 # [ 0.274774] ... bit width: 48767client # [ 0.229847] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512768worker2 # [ 0.275016] ... generic counters: 6769client # [ 0.230817] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024770worker2 # [ 0.275746] ... generic bitmap: 000000000000003f771worker2 # [ 0.276016] ... fixed-purpose counters: 0772client # [ 0.231579] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8773worker2 # [ 0.276748] ... fixed-purpose bitmap: 0000000000000000774client # [ 0.232590] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.775worker2 # [ 0.277016] ... value mask: 0000ffffffffffff776worker2 # [ 0.277882] ... max period: 00007fffffffffff777worker2 # [ 0.278729] ... global_ctrl mask: 000000000000003f778worker2 # [ 0.279122] signal: max sigframe size: 3376779worker2 # [ 0.279987] rcu: Hierarchical SRCU implementation.780worker2 # [ 0.280640] rcu: Max phase no-delay instances is 400.781worker1 # [ 0.267579] Freeing SMP alternatives memory: 44K782worker1 # [ 0.268049] pid_max: default: 32768 minimum: 301783worker1 # [ 0.269151] LSM: initializing lsm=capability,landlock,yama,bpf,ima784worker1 # [ 0.270154] landlock: Up and running.785worker1 # [ 0.271047] Yama: becoming mindful.786worker2 # [ 0.285510] smp: Bringing up secondary CPUs ...787worker1 # [ 0.272075] LSM support for eBPF active788worker2 # [ 0.286030] smp: Brought up 1 node, 1 CPU789worker1 # [ 0.272832] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)790worker2 # [ 0.286733] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)791worker1 # [ 0.274084] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)792worker2 # [ 0.287168] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)793worker2 # [ 0.288229] devtmpfs: initialized794worker1 # [ 0.276429] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)795worker2 # [ 0.288971] x86/mm: Memory block size: 128MB796lb # [ 0.268678] Freeing SMP alternatives memory: 44K797lb # [ 0.269122] pid_max: default: 32768 minimum: 301798worker1 # [ 0.277986] Performance Events: Fam17h+ core perfctr, AMD PMU driver.799lb # [ 0.270208] LSM: initializing lsm=capability,landlock,yama,bpf,ima800worker2 # [ 0.290564] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)801worker1 # [ 0.278854] ... version: 2802lb # [ 0.271228] landlock: Up and running.803worker1 # [ 0.279049] ... bit width: 48804lb # [ 0.272120] Yama: becoming mindful.805worker2 # [ 0.291044] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).806worker1 # [ 0.279772] ... generic counters: 6807lb # [ 0.272908] LSM support for eBPF active808worker1 # [ 0.280059] ... generic bitmap: 000000000000003f809worker2 # [ 0.292103] pinctrl core: initialized pinctrl subsystem810worker1 # [ 0.280898] ... fixed-purpose counters: 0811worker2 # [ 0.293177] PM: RTC time: 13:34:00, date: 2026-09-20812lb # [ 0.273662] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)813worker1 # [ 0.281560] ... fixed-purpose bitmap: 0000000000000000814lb # [ 0.274160] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)815worker1 # [ 0.282048] ... value mask: 0000ffffffffffff816worker1 # [ 0.282970] ... max period: 00007fffffffffff817worker1 # [ 0.283798] ... global_ctrl mask: 000000000000003f818worker2 # [ 0.296574] NET: Registered PF_NETLINK/PF_ROUTE protocol family819lb # [ 0.277273] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)820worker1 # [ 0.284178] signal: max sigframe size: 3376821worker1 # [ 0.284989] rcu: Hierarchical SRCU implementation.822worker2 # [ 0.297494] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations823lb # [ 0.278697] Performance Events: Fam17h+ core perfctr, AMD PMU driver.824worker1 # [ 0.285595] rcu: Max phase no-delay instances is 400.825lb # [ 0.279128] ... version: 2826worker2 # [ 0.298035] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations827lb # [ 0.279801] ... bit width: 48828lb # [ 0.280121] ... generic counters: 6829worker2 # [ 0.299274] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations830lb # [ 0.280855] ... generic bitmap: 000000000000003f831worker2 # [ 0.300026] audit: initializing netlink subsys (disabled)832lb # [ 0.281121] ... fixed-purpose counters: 0833lb # [ 0.281843] ... fixed-purpose bitmap: 0000000000000000834worker2 # [ 0.301205] thermal_sys: Registered thermal governor 'fair_share'835lb # [ 0.282121] ... value mask: 0000ffffffffffff836worker2 # [ 0.301207] thermal_sys: Registered thermal governor 'bang_bang'837worker1 # [ 0.290579] smp: Bringing up secondary CPUs ...838worker1 # [ 0.291061] smp: Brought up 1 node, 1 CPU839lb # [ 0.282990] ... max period: 00007fffffffffff840worker2 # [ 0.302017] thermal_sys: Registered thermal governor 'step_wise'841client # [ 0.267098] Freeing SMP alternatives memory: 44K842client # [ 0.267851] pid_max: default: 32768 minimum: 301843worker1 # [ 0.291701] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)844lb # [ 0.283752] ... global_ctrl mask: 000000000000003f845worker2 # [ 0.302942] thermal_sys: Registered thermal governor 'user_space'846lb # [ 0.284235] signal: max sigframe size: 3376847client # [ 0.268652] LSM: initializing lsm=capability,landlock,yama,bpf,ima848worker2 # [ 0.303732] audit: type=2000 audit(1789911241.419:1): state=initialized audit_enabled=0 res=1849lb # [ 0.285017] rcu: Hierarchical SRCU implementation.850client # [ 0.269652] landlock: Up and running.851worker1 # [ 0.292238] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)852client # [ 0.270269] Yama: becoming mindful.853lb # [ 0.285719] rcu: Max phase no-delay instances is 400.854worker2 # [ 0.305019] thermal_sys: Registered thermal governor 'power_allocator'855worker1 # [ 0.293323] devtmpfs: initialized856client # [ 0.271074] LSM support for eBPF active857worker2 # [ 0.305034] cpuidle: using governor menu858worker1 # [ 0.294101] x86/mm: Memory block size: 128MB859client # [ 0.271862] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)860worker2 # [ 0.307222] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5861client # [ 0.272892] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)862worker1 # [ 0.295809] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)863worker2 # [ 0.308237] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]864worker2 # [ 0.309019] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry865worker1 # [ 0.296970] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).866lb # [ 0.290654] smp: Bringing up secondary CPUs ...867client # [ 0.275437] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)868worker2 # [ 0.310028] PCI: Using configuration type 1 for base access869lb # [ 0.291136] smp: Brought up 1 node, 1 CPU870worker1 # [ 0.298126] pinctrl core: initialized pinctrl subsystem871lb # [ 0.291787] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)872worker1 # [ 0.299233] PM: RTC time: 13:34:00, date: 2026-09-20873client # [ 0.276431] Performance Events: Fam17h+ core perfctr, AMD PMU driver.874worker2 # [ 0.311114] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.875client # [ 0.276852] ... version: 2876client # [ 0.277560] ... bit width: 48877lb # [ 0.292367] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)878client # [ 0.277850] ... generic counters: 6879lb # [ 0.293375] devtmpfs: initialized880client # [ 0.278545] ... generic bitmap: 000000000000003f881worker1 # [ 0.302733] NET: Registered PF_NETLINK/PF_ROUTE protocol family882client # [ 0.278855] ... fixed-purpose counters: 0883lb # [ 0.294224] x86/mm: Memory block size: 128MB884client # [ 0.279543] ... fixed-purpose bitmap: 0000000000000000885worker1 # [ 0.303548] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations886client # [ 0.279850] ... value mask: 0000ffffffffffff887worker2 # [ 0.316294] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages888lb # [ 0.295987] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)889client # [ 0.280702] ... max period: 00007fffffffffff890worker1 # [ 0.304072] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations891worker2 # [ 0.317017] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page892client # [ 0.281471] ... global_ctrl mask: 000000000000003f893lb # [ 0.296995] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).894worker1 # [ 0.305329] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations895client # [ 0.281960] signal: max sigframe size: 3376896lb # [ 0.298229] pinctrl core: initialized pinctrl subsystem897worker1 # [ 0.306060] audit: initializing netlink subsys (disabled)898client # [ 0.282730] rcu: Hierarchical SRCU implementation.899lb # [ 0.299338] PM: RTC time: 13:34:00, date: 2026-09-20900client # [ 0.283451] rcu: Max phase no-delay instances is 400.901worker1 # [ 0.307255] thermal_sys: Registered thermal governor 'fair_share'902worker1 # [ 0.307257] thermal_sys: Registered thermal governor 'bang_bang'903worker2 # [ 0.322017] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages904worker1 # [ 0.308050] thermal_sys: Registered thermal governor 'step_wise'905worker2 # [ 0.323016] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page906worker1 # [ 0.309034] thermal_sys: Registered thermal governor 'user_space'907lb # [ 0.302915] NET: Registered PF_NETLINK/PF_ROUTE protocol family908worker1 # [ 0.309780] audit: type=2000 audit(1789911241.441:1): state=initialized audit_enabled=0 res=1909lb # [ 0.304334] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations910client # [ 0.288561] smp: Bringing up secondary CPUs ...911worker1 # [ 0.311051] thermal_sys: Registered thermal governor 'power_allocator'912client # [ 0.288863] smp: Brought up 1 node, 1 CPU913lb # [ 0.305145] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations914worker1 # [ 0.311084] cpuidle: using governor menu915client # [ 0.289517] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)916lb # [ 0.306397] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations917worker1 # [ 0.313276] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5918lb # [ 0.307131] audit: initializing netlink subsys (disabled)919client # [ 0.290025] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)920worker1 # [ 0.314279] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]921lb # [ 0.308260] thermal_sys: Registered thermal governor 'fair_share'922client # [ 0.291138] devtmpfs: initialized923worker1 # [ 0.315052] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry924lb # [ 0.308263] thermal_sys: Registered thermal governor 'bang_bang'925client # [ 0.291917] x86/mm: Memory block size: 128MB926worker1 # [ 0.316061] PCI: Using configuration type 1 for base access927lb # [ 0.309123] thermal_sys: Registered thermal governor 'step_wise'928worker2 # [ 0.333355] ACPI: Added _OSI(Module Device)929lb # [ 0.310091] thermal_sys: Registered thermal governor 'user_space'930worker1 # [ 0.317155] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.931client # [ 0.293693] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)932worker2 # [ 0.334018] ACPI: Added _OSI(Processor Device)933lb # [ 0.310888] audit: type=2000 audit(1789911241.454:1): state=initialized audit_enabled=0 res=1934worker2 # [ 0.334751] ACPI: Added _OSI(Processor Aggregator Device)935client # [ 0.294721] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).936lb # [ 0.312124] thermal_sys: Registered thermal governor 'power_allocator'937client # [ 0.295932] pinctrl core: initialized pinctrl subsystem938lb # [ 0.312138] cpuidle: using governor menu939client # [ 0.297061] PM: RTC time: 13:34:00, date: 2026-09-20940lb # [ 0.314370] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5941lb # [ 0.315367] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]942worker1 # [ 0.324063] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages943client # [ 0.300628] NET: Registered PF_NETLINK/PF_ROUTE protocol family944lb # [ 0.316125] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry945worker1 # [ 0.325049] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page946lb # [ 0.317133] PCI: Using configuration type 1 for base access947client # [ 0.302047] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations948lb # [ 0.318226] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.949client # [ 0.302875] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations950worker2 # [ 0.343136] ACPI: 1 ACPI AML tables successfully acquired and loaded951client # [ 0.304128] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations952client # [ 0.304860] audit: initializing netlink subsys (disabled)953worker1 # [ 0.330050] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages954client # [ 0.306014] thermal_sys: Registered thermal governor 'fair_share'955worker1 # [ 0.331050] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page956worker2 # [ 0.347438] ACPI: Interpreter enabled957client # [ 0.306016] thermal_sys: Registered thermal governor 'bang_bang'958lb # [ 0.323360] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages959worker2 # [ 0.348032] ACPI: PM: (supports S0 S3 S4 S5)960client # [ 0.306851] thermal_sys: Registered thermal governor 'step_wise'961worker2 # [ 0.348734] ACPI: Using IOAPIC for interrupt routing962lb # [ 0.324123] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page963client # [ 0.307761] thermal_sys: Registered thermal governor 'user_space'964worker2 # [ 0.349050] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug965client # [ 0.308545] audit: type=2000 audit(1789911241.468:1): state=initialized audit_enabled=0 res=1966worker2 # [ 0.350016] PCI: Using E820 reservations for host bridge windows967client # [ 0.309853] thermal_sys: Registered thermal governor 'power_allocator'968client # [ 0.309867] cpuidle: using governor menu969lb # [ 0.329123] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages970client # [ 0.312080] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5971worker2 # [ 0.353138] ACPI: Enabled 2 GPEs in block 00 to 3F972lb # [ 0.330122] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page973client # [ 0.313148] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]974worker1 # [ 0.340847] ACPI: Added _OSI(Module Device)975client # [ 0.313853] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry976worker1 # [ 0.341627] ACPI: Added _OSI(Processor Device)977client # [ 0.314862] PCI: Using configuration type 1 for base access978worker1 # [ 0.342050] ACPI: Added _OSI(Processor Aggregator Device)979client # [ 0.315982] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.980worker2 # [ 0.361696] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])981worker2 # [ 0.362023] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]982client # [ 0.321137] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages983lb # [ 0.340531] ACPI: Added _OSI(Module Device)984client # [ 0.321852] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page985lb # [ 0.341123] ACPI: Added _OSI(Processor Device)986worker2 # [ 0.363907] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]987lb # [ 0.341898] ACPI: Added _OSI(Processor Aggregator Device)988worker1 # [ 0.351529] ACPI: 1 ACPI AML tables successfully acquired and loaded989worker2 # [ 0.365036] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]990worker2 # [ 0.366388] PCI host bridge to bus 0000:00991worker1 # [ 0.352947] ACPI: Interpreter enabled992worker2 # [ 0.367021] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]993worker1 # [ 0.353555] ACPI: PM: (supports S0 S3 S4 S5)994client # [ 0.326851] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages995worker2 # [ 0.368017] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]996client # [ 0.327850] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page997worker2 # [ 0.369016] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]998worker1 # [ 0.356049] ACPI: Using IOAPIC for interrupt routing999worker2 # [ 0.370017] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1000worker1 # [ 0.356960] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1001worker2 # [ 0.371017] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1002worker2 # [ 0.372016] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1003lb # [ 0.350656] ACPI: 1 ACPI AML tables successfully acquired and loaded1004worker2 # [ 0.373017] pci_bus 0000:00: root bus resource [bus 00-ff]1005worker1 # [ 0.360050] PCI: Using E820 reservations for host bridge windows1006worker1 # [ 0.361176] ACPI: Enabled 2 GPEs in block 00 to 3F1007worker2 # [ 0.374089] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1008lb # [ 0.354526] ACPI: Interpreter enabled1009worker2 # [ 0.375500] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1010lb # [ 0.355138] ACPI: PM: (supports S0 S3 S4 S5)1011client # [ 0.338222] ACPI: Added _OSI(Module Device)1012lb # [ 0.355886] ACPI: Using IOAPIC for interrupt routing1013client # [ 0.338851] ACPI: Added _OSI(Processor Device)1014lb # [ 0.356185] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1015client # [ 0.339603] ACPI: Added _OSI(Processor Aggregator Device)1016lb # [ 0.357123] PCI: Using E820 reservations for host bridge windows1017worker1 # [ 0.369826] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1018lb # [ 0.360256] ACPI: Enabled 2 GPEs in block 00 to 3F1019worker2 # [ 0.378101] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1020worker1 # [ 0.370828] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1021worker2 # [ 0.379029] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1022worker2 # [ 0.380008] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1023worker1 # [ 0.372126] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1024worker1 # [ 0.373203] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1025worker2 # [ 0.381196] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1026worker1 # [ 0.374410] PCI host bridge to bus 0000:001027client # [ 0.348011] ACPI: 1 ACPI AML tables successfully acquired and loaded1028worker1 # [ 0.375054] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1029worker2 # [ 0.382753] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1030worker1 # [ 0.376049] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1031worker1 # [ 0.377049] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1032lb # [ 0.368899] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1033client # [ 0.352283] ACPI: Interpreter enabled1034worker2 # [ 0.385054] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1035worker1 # [ 0.378050] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1036client # [ 0.352866] ACPI: PM: (supports S0 S3 S4 S5)1037worker2 # [ 0.385888] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1038lb # [ 0.369916] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1039worker1 # [ 0.379050] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1040client # [ 0.353541] ACPI: Using IOAPIC for interrupt routing1041worker2 # [ 0.386741] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1042worker1 # [ 0.380049] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1043lb # [ 0.371946] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1044client # [ 0.353932] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1045worker2 # [ 0.387022] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1046worker1 # [ 0.381049] pci_bus 0000:00: root bus resource [bus 00-ff]1047client # [ 0.354851] PCI: Using E820 reservations for host bridge windows1048lb # [ 0.373106] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1049worker1 # [ 0.381991] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1050lb # [ 0.374349] PCI host bridge to bus 0000:001051worker2 # [ 0.388548] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1052lb # [ 0.375028] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1053client # [ 0.357919] ACPI: Enabled 2 GPEs in block 00 to 3F1054worker1 # [ 0.383526] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1055lb # [ 0.375996] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1056worker2 # [ 0.390050] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1057lb # [ 0.376980] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1058worker2 # [ 0.390918] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1059lb # [ 0.378072] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1060worker2 # [ 0.391806] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1061lb # [ 0.379069] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1062worker2 # [ 0.393428] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1063lb # [ 0.380089] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1064lb # [ 0.381076] pci_bus 0000:00: root bus resource [bus 00-ff]1065lb # [ 0.381885] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1066worker1 # [ 0.386234] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1067client # [ 0.366591] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1068worker1 # [ 0.387062] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1069worker2 # [ 0.396024] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1070lb # [ 0.383613] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1071worker1 # [ 0.388002] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1072client # [ 0.366857] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1073worker2 # [ 0.397028] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1074worker2 # [ 0.397985] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1075worker1 # [ 0.389132] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1076client # [ 0.368696] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1077worker2 # [ 0.399455] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1078client # [ 0.369887] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1079worker1 # [ 0.390802] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1080client # [ 0.371207] PCI host bridge to bus 0000:001081client # [ 0.371855] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1082worker2 # [ 0.401054] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1083worker2 # [ 0.401895] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1084client # [ 0.372850] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1085worker1 # [ 0.394094] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1086worker2 # [ 0.402741] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1087client # [ 0.373850] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1088lb # [ 0.386288] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1089worker1 # [ 0.394950] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1090lb # [ 0.387136] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1091client # [ 0.374850] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1092worker1 # [ 0.395820] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1093lb # [ 0.388067] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1094worker2 # [ 0.403633] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1095client # [ 0.375850] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1096worker1 # [ 0.396877] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1097client # [ 0.376850] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1098lb # [ 0.389347] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1099client # [ 0.377857] pci_bus 0000:00: root bus resource [bus 00-ff]1100worker2 # [ 0.405024] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1101worker1 # [ 0.398877] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1102worker2 # [ 0.405832] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1103client # [ 0.378811] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1104lb # [ 0.390867] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1105worker2 # [ 0.406783] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1106worker1 # [ 0.401986] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1107client # [ 0.380316] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1108worker2 # [ 0.407605] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1109worker1 # [ 0.402716] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1110lb # [ 0.393160] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1111lb # [ 0.394018] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1112worker1 # [ 0.403073] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1113lb # [ 0.394946] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1114worker2 # [ 0.409940] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1115worker1 # [ 0.404631] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116lb # [ 0.396021] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1117worker2 # [ 0.410659] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1118lb # [ 0.397667] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1119worker2 # [ 0.411039] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1120client # [ 0.382948] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1121worker2 # [ 0.412652] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1122worker1 # [ 0.407357] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1123lb # [ 0.399152] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1124client # [ 0.383863] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1125worker1 # [ 0.408698] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1126lb # [ 0.399999] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1127client # [ 0.384807] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1128worker1 # [ 0.409071] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1129worker2 # [ 0.414024] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1130lb # [ 0.400902] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1131worker2 # [ 0.414867] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1132client # [ 0.385843] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1133worker1 # [ 0.410602] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1134worker2 # [ 0.415761] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1135lb # [ 0.402614] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1136worker2 # [ 0.416022] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1137client # [ 0.387619] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1138worker1 # [ 0.412740] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1139worker1 # [ 0.413056] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1140worker2 # [ 0.417580] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1141client # [ 0.389874] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1142lb # [ 0.405457] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1143worker1 # [ 0.414027] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1144client # [ 0.390723] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1145lb # [ 0.406129] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1146worker2 # [ 0.419029] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1147client # [ 0.391600] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1148lb # [ 0.407101] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1149worker2 # [ 0.420001] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1150client # [ 0.391857] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1151worker1 # [ 0.416120] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1152lb # [ 0.408493] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1153worker2 # [ 0.421388] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1154client # [ 0.393410] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1155worker1 # [ 0.418078] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1156lb # [ 0.410130] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1157worker1 # [ 0.418951] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1158lb # [ 0.411016] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1159worker2 # [ 0.423684] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1160worker1 # [ 0.419821] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1161client # [ 0.394877] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1162worker2 # [ 0.424023] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1163lb # [ 0.411893] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1164client # [ 0.395784] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1165worker1 # [ 0.420666] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1166client # [ 0.396609] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1167worker2 # [ 0.424966] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1168lb # [ 0.413531] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1169client # [ 0.397420] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1170worker2 # [ 0.426592] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1171lb # [ 0.415130] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1172lb # [ 0.415969] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1173worker1 # [ 0.423295] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1174worker2 # [ 0.428050] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1175lb # [ 0.416893] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1176worker1 # [ 0.424718] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1177worker2 # [ 0.428910] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1178worker1 # [ 0.425070] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1179client # [ 0.399879] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1180worker2 # [ 0.429740] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1181lb # [ 0.418574] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1182client # [ 0.400858] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1183worker1 # [ 0.426621] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1184client # [ 0.401812] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1185worker2 # [ 0.430595] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1186worker2 # [ 0.431664] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1187client # [ 0.403268] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1188lb # [ 0.421149] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1189worker1 # [ 0.428056] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1190lb # [ 0.422144] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1191worker1 # [ 0.428913] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1192worker2 # [ 0.432970] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1193client # [ 0.404880] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1194lb # [ 0.423137] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1195worker1 # [ 0.429854] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1196client # [ 0.405710] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1197worker2 # [ 0.434653] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1198worker1 # [ 0.430853] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1199lb # [ 0.424694] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1200client # [ 0.406605] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1201worker1 # [ 0.432591] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1202lb # [ 0.426155] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1203client # [ 0.407415] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1204lb # [ 0.427034] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1205worker1 # [ 0.434080] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1206lb # [ 0.427909] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1207client # [ 0.408876] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1208worker1 # [ 0.435077] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1209lb # [ 0.428982] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1210client # [ 0.409745] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1211client # [ 0.410582] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1212worker1 # [ 0.436589] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1213lb # [ 0.430446] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1214client # [ 0.411478] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1215lb # [ 0.431921] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1216worker1 # [ 0.438057] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1217lb # [ 0.432886] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1218worker1 # [ 0.438899] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1219client # [ 0.413700] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1220worker2 # [ 0.435239] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1221worker1 # [ 0.440072] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1222lb # [ 0.433668] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1223client # [ 0.414490] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1224worker2 # [ 0.437605] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1225worker1 # [ 0.441609] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1226client # [ 0.414872] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1227lb # [ 0.435129] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1228worker2 # [ 0.438241] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1229lb # [ 0.435978] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1230client # [ 0.416391] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1231worker1 # [ 0.443056] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1232worker2 # [ 0.439623] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1233lb # [ 0.436871] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1234worker1 # [ 0.443915] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1235client # [ 0.417879] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1236worker1 # [ 0.444842] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1237lb # [ 0.437713] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1238worker2 # [ 0.440969] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1239client # [ 0.418745] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1240client # [ 0.419577] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1241worker1 # [ 0.446435] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1242worker2 # [ 0.442253] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1243lb # [ 0.439129] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1244client # [ 0.419855] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1245lb # [ 0.439979] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1246worker2 # [ 0.443277] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1247worker1 # [ 0.448355] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1248lb # [ 0.440864] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1249client # [ 0.421367] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1250worker2 # [ 0.445023] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1251worker1 # [ 0.449276] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1252lb # [ 0.442509] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1253worker2 # [ 0.445846] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1254client # [ 0.422666] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1255worker1 # [ 0.450688] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1256lb # [ 0.443721] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1257client # [ 0.423604] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1258worker2 # [ 0.447023] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1259lb # [ 0.444319] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1260client # [ 0.424386] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1261worker2 # [ 0.448698] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1262lb # [ 0.445624] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1263client # [ 0.425858] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1264client # [ 0.426819] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1265worker2 # [ 0.451956] ACPI: PCI: Interrupt link LNKA configured for IRQ 101266client # [ 0.427649] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1267worker2 # [ 0.452825] ACPI: PCI: Interrupt link LNKB configured for IRQ 101268worker2 # [ 0.453807] ACPI: PCI: Interrupt link LNKC configured for IRQ 111269client # [ 0.429301] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1270worker2 # [ 0.454809] ACPI: PCI: Interrupt link LNKD configured for IRQ 111271worker2 # [ 0.455809] ACPI: PCI: Interrupt link LNKE configured for IRQ 101272client # [ 0.431878] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1273worker2 # [ 0.456811] ACPI: PCI: Interrupt link LNKF configured for IRQ 101274client # [ 0.432759] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1275worker1 # [ 0.451247] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1276worker2 # [ 0.457812] ACPI: PCI: Interrupt link LNKG configured for IRQ 111277client # [ 0.433596] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1278worker2 # [ 0.459027] ACPI: PCI: Interrupt link LNKH configured for IRQ 111279worker1 # [ 0.453682] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1280worker2 # [ 0.460062] ACPI: PCI: Interrupt link GSIA configured for IRQ 161281client # [ 0.434401] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1282worker2 # [ 0.461016] ACPI: PCI: Interrupt link GSIB configured for IRQ 171283worker1 # [ 0.454299] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1284lb # [ 0.446317] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1285client # [ 0.435446] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1286worker2 # [ 0.461958] ACPI: PCI: Interrupt link GSIC configured for IRQ 181287lb # [ 0.448679] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1288worker2 # [ 0.462745] ACPI: PCI: Interrupt link GSID configured for IRQ 191289worker1 # [ 0.456003] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1290client # [ 0.436046] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1291worker2 # [ 0.463029] ACPI: PCI: Interrupt link GSIE configured for IRQ 201292lb # [ 0.449358] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1293worker1 # [ 0.457015] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1294worker2 # [ 0.463958] ACPI: PCI: Interrupt link GSIF configured for IRQ 211295client # [ 0.437878] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1296lb # [ 0.450651] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1297worker2 # [ 0.464723] ACPI: PCI: Interrupt link GSIG configured for IRQ 221298worker1 # [ 0.458311] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1299worker2 # [ 0.465032] ACPI: PCI: Interrupt link GSIH configured for IRQ 231300lb # [ 0.451380] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1301worker1 # [ 0.459308] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1302worker2 # [ 0.466992] iommu: Default domain type: Translated1303lb # [ 0.452408] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1304worker2 # [ 0.467652] iommu: DMA domain TLB invalidation policy: lazy mode1305worker1 # [ 0.461038] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1306worker2 # [ 0.468256] ACPI: bus type USB registered1307lb # [ 0.453430] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1308worker1 # [ 0.461752] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1309worker2 # [ 0.468963] usbcore: registered new interface driver usbfs1310worker2 # [ 0.469738] usbcore: registered new interface driver hub1311lb # [ 0.454928] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1312worker1 # [ 0.462370] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1313worker2 # [ 0.470026] usbcore: registered new device driver usb1314lb # [ 0.455778] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1315worker1 # [ 0.463715] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1316worker2 # [ 0.471674] NetLabel: Initializing1317lb # [ 0.456469] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1318worker2 # [ 0.472017] NetLabel: domain hash size = 1281319worker2 # [ 0.472761] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1320lb # [ 0.457698] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1321worker2 # [ 0.473051] NetLabel: unlabeled traffic allowed by default1322worker2 # [ 0.474004] PCI: Using ACPI for IRQ routing1323client # [ 0.438922] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1324worker1 # [ 0.466997] ACPI: PCI: Interrupt link LNKA configured for IRQ 101325worker1 # [ 0.467886] ACPI: PCI: Interrupt link LNKB configured for IRQ 101326client # [ 0.441430] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1327worker1 # [ 0.468943] ACPI: PCI: Interrupt link LNKC configured for IRQ 111328lb # [ 0.461211] ACPI: PCI: Interrupt link LNKA configured for IRQ 101329client # [ 0.442152] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1330worker1 # [ 0.469912] ACPI: PCI: Interrupt link LNKD configured for IRQ 111331lb # [ 0.462226] ACPI: PCI: Interrupt link LNKB configured for IRQ 101332lb # [ 0.463222] ACPI: PCI: Interrupt link LNKC configured for IRQ 111333worker1 # [ 0.470861] ACPI: PCI: Interrupt link LNKE configured for IRQ 101334client # [ 0.443404] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1335lb # [ 0.464220] ACPI: PCI: Interrupt link LNKD configured for IRQ 111336worker1 # [ 0.472039] ACPI: PCI: Interrupt link LNKF configured for IRQ 101337client # [ 0.444073] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1338lb # [ 0.465231] ACPI: PCI: Interrupt link LNKE configured for IRQ 101339worker1 # [ 0.472883] ACPI: PCI: Interrupt link LNKG configured for IRQ 111340lb # [ 0.466220] ACPI: PCI: Interrupt link LNKF configured for IRQ 101341worker1 # [ 0.473898] ACPI: PCI: Interrupt link LNKH configured for IRQ 111342client # [ 0.445445] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1343lb # [ 0.467221] ACPI: PCI: Interrupt link LNKG configured for IRQ 111344worker1 # [ 0.474842] ACPI: PCI: Interrupt link GSIA configured for IRQ 161345lb # [ 0.468218] ACPI: PCI: Interrupt link LNKH configured for IRQ 111346client # [ 0.446153] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1347worker1 # [ 0.475841] ACPI: PCI: Interrupt link GSIB configured for IRQ 171348worker1 # [ 0.476803] ACPI: PCI: Interrupt link GSIC configured for IRQ 181349lb # [ 0.469179] ACPI: PCI: Interrupt link GSIA configured for IRQ 161350client # [ 0.447824] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1351worker1 # [ 0.477065] ACPI: PCI: Interrupt link GSID configured for IRQ 191352lb # [ 0.470146] ACPI: PCI: Interrupt link GSIB configured for IRQ 171353client # [ 0.448577] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1354lb # [ 0.471140] ACPI: PCI: Interrupt link GSIC configured for IRQ 181355worker1 # [ 0.478035] ACPI: PCI: Interrupt link GSIE configured for IRQ 201356lb # [ 0.472078] ACPI: PCI: Interrupt link GSID configured for IRQ 191357worker1 # [ 0.478932] ACPI: PCI: Interrupt link GSIF configured for IRQ 211358client # [ 0.449180] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1359lb # [ 0.472837] ACPI: PCI: Interrupt link GSIE configured for IRQ 201360worker1 # [ 0.479776] ACPI: PCI: Interrupt link GSIG configured for IRQ 221361lb # [ 0.473136] ACPI: PCI: Interrupt link GSIF configured for IRQ 211362worker1 # [ 0.480065] ACPI: PCI: Interrupt link GSIH configured for IRQ 231363client # [ 0.450410] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1364lb # [ 0.474070] ACPI: PCI: Interrupt link GSIG configured for IRQ 221365lb # [ 0.474845] ACPI: PCI: Interrupt link GSIH configured for IRQ 231366worker1 # [ 0.482156] iommu: Default domain type: Translated1367worker1 # [ 0.483006] iommu: DMA domain TLB invalidation policy: lazy mode1368lb # [ 0.476172] iommu: Default domain type: Translated1369worker1 # [ 0.484099] ACPI: bus type USB registered1370client # [ 0.454136] ACPI: PCI: Interrupt link LNKA configured for IRQ 101371lb # [ 0.476976] iommu: DMA domain TLB invalidation policy: lazy mode1372worker1 # [ 0.484819] usbcore: registered new interface driver usbfs1373lb # [ 0.478101] ACPI: bus type USB registered1374client # [ 0.454958] ACPI: PCI: Interrupt link LNKB configured for IRQ 101375worker1 # [ 0.485065] usbcore: registered new interface driver hub1376lb # [ 0.478671] usbcore: registered new interface driver usbfs1377worker1 # [ 0.485943] usbcore: registered new device driver usb1378client # [ 0.455947] ACPI: PCI: Interrupt link LNKC configured for IRQ 111379lb # [ 0.479135] usbcore: registered new interface driver hub1380client # [ 0.456952] ACPI: PCI: Interrupt link LNKD configured for IRQ 111381lb # [ 0.480000] usbcore: registered new device driver usb1382worker1 # [ 0.487547] NetLabel: Initializing1383client # [ 0.457951] ACPI: PCI: Interrupt link LNKE configured for IRQ 101384worker1 # [ 0.488050] NetLabel: domain hash size = 1281385lb # [ 0.481583] NetLabel: Initializing1386worker1 # [ 0.488860] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1387client # [ 0.458946] ACPI: PCI: Interrupt link LNKF configured for IRQ 101388lb # [ 0.482122] NetLabel: domain hash size = 1281389worker1 # [ 0.489838] NetLabel: unlabeled traffic allowed by default1390client # [ 0.459952] ACPI: PCI: Interrupt link LNKG configured for IRQ 111391lb # [ 0.482820] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1392worker1 # [ 0.490768] PCI: Using ACPI for IRQ routing1393lb # [ 0.483159] NetLabel: unlabeled traffic allowed by default1394client # [ 0.460949] ACPI: PCI: Interrupt link LNKH configured for IRQ 111395lb # [ 0.484048] PCI: Using ACPI for IRQ routing1396client # [ 0.461888] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397client # [ 0.462863] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398client # [ 0.463866] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399client # [ 0.464865] ACPI: PCI: Interrupt link GSID configured for IRQ 191400client # [ 0.465865] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401client # [ 0.466862] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402client # [ 0.467874] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403client # [ 0.468865] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404client # [ 0.470951] iommu: Default domain type: Translated1405client # [ 0.471799] iommu: DMA domain TLB invalidation policy: lazy mode1406client # [ 0.472921] ACPI: bus type USB registered1407client # [ 0.473710] usbcore: registered new interface driver usbfs1408client # [ 0.474582] usbcore: registered new interface driver hub1409client # [ 0.474861] usbcore: registered new device driver usb1410worker2 # [ 0.517354] pci 0000:00:01.0: vgaarb: setting as boot VGA device1411client # [ 0.476638] NetLabel: Initializing1412client # [ 0.476856] NetLabel: domain hash size = 1281413worker2 # [ 0.518012] pci 0000:00:01.0: vgaarb: bridge control possible1414client # [ 0.477682] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1415client # [ 0.478644] NetLabel: unlabeled traffic allowed by default1416worker2 # [ 0.518012] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1417client # [ 0.479577] PCI: Using ACPI for IRQ routing1418worker2 # [ 0.518022] vgaarb: loaded1419worker2 # [ 0.518741] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker2 # [ 0.519018] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker2 # [ 0.523101] clocksource: Switched to clocksource kvm-clock1422worker2 # [ 0.526500] VFS: Disk quotas dquot_6.6.01423worker2 # [ 0.527247] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424worker2 # [ 0.528638] pnp: PnP ACPI init1425worker2 # [ 0.529461] ACPI: IRQ 4 override to edge(!), high(!)1426worker2 # [ 0.530499] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1427worker2 # [ 0.532110] pnp: PnP ACPI: found 6 devices1428worker2 # [ 0.539763] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1429worker2 # [ 0.541278] clocksource: Switched to clocksource acpi_pm1430worker1 # [ 0.534488] pci 0000:00:01.0: vgaarb: setting as boot VGA device1431worker2 # [ 0.542240] NET: Registered PF_INET protocol family1432lb # [ 0.527988] pci 0000:00:01.0: vgaarb: setting as boot VGA device1433lb # [ 0.528118] pci 0000:00:01.0: vgaarb: bridge control possible1434worker1 # [ 0.535045] pci 0000:00:01.0: vgaarb: bridge control possible1435worker2 # [ 0.543397] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1436lb # [ 0.528118] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1437worker1 # [ 0.535045] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1438lb # [ 0.528126] vgaarb: loaded1439worker1 # [ 0.535054] vgaarb: loaded1440lb # [ 0.528862] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01441worker1 # [ 0.535817] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01442lb # [ 0.529122] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1443worker1 # [ 0.536051] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1444lb # [ 0.532210] clocksource: Switched to clocksource kvm-clock1445worker1 # [ 0.540142] clocksource: Switched to clocksource kvm-clock1446lb # [ 0.535763] VFS: Disk quotas dquot_6.6.01447lb # [ 0.536490] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1448worker1 # [ 0.544145] VFS: Disk quotas dquot_6.6.01449lb # [ 0.537839] pnp: PnP ACPI init1450worker1 # [ 0.544874] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1451lb # [ 0.538636] ACPI: IRQ 4 override to edge(!), high(!)1452worker1 # [ 0.546263] pnp: PnP ACPI init1453lb # [ 0.539609] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1454worker1 # [ 0.547104] ACPI: IRQ 4 override to edge(!), high(!)1455lb # [ 0.541143] pnp: PnP ACPI: found 6 devices1456worker2 # [ 0.559729] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1457worker1 # [ 0.548101] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1458worker1 # [ 0.549640] pnp: PnP ACPI: found 6 devices1459worker2 # [ 0.561228] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1460client # [ 0.523895] pci 0000:00:01.0: vgaarb: setting as boot VGA device1461worker2 # [ 0.562549] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1462client # [ 0.524846] pci 0000:00:01.0: vgaarb: bridge control possible1463worker2 # [ 0.563887] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1464client # [ 0.524846] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1465worker2 # [ 0.565168] TCP: Hash tables configured (established 16384 bind 16384)1466client # [ 0.524857] vgaarb: loaded1467client # [ 0.525605] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01468worker2 # [ 0.566286] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1469client # [ 0.525852] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1470worker2 # [ 0.567550] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1471lb # [ 0.548746] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1472lb # [ 0.550178] clocksource: Switched to clocksource acpi_pm1473worker2 # [ 0.568618] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1474worker1 # [ 0.557205] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1475worker2 # [ 0.569829] NET: Registered PF_UNIX/PF_LOCAL protocol family1476lb # [ 0.551113] NET: Registered PF_INET protocol family1477worker2 # [ 0.570759] NET: Registered PF_XDP protocol family1478worker1 # [ 0.558613] clocksource: Switched to clocksource acpi_pm1479lb # [ 0.552257] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1480worker1 # [ 0.559561] NET: Registered PF_INET protocol family1481worker2 # [ 0.571575] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1482client # [ 0.529942] clocksource: Switched to clocksource kvm-clock1483worker2 # [ 0.572579] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1484worker1 # [ 0.560755] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1485worker2 # [ 0.573577] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1486worker2 # [ 0.574699] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1487client # [ 0.533427] VFS: Disk quotas dquot_6.6.01488worker2 # [ 0.575839] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1489client # [ 0.534130] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1490worker2 # [ 0.576936] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1491client # [ 0.535480] pnp: PnP ACPI init1492worker2 # [ 0.578718] ACPI: \_SB_.GSIA: Enabled at IRQ 161493client # [ 0.536303] ACPI: IRQ 4 override to edge(!), high(!)1494client # [ 0.537285] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1495worker2 # [ 0.580885] ACPI: \_SB_.GSIB: Enabled at IRQ 171496client # [ 0.538876] pnp: PnP ACPI: found 6 devices1497worker2 # [ 0.582927] ACPI: \_SB_.GSIC: Enabled at IRQ 181498worker2 # [ 0.584856] ACPI: \_SB_.GSID: Enabled at IRQ 191499worker2 # [ 0.586512] PCI: CLS 0 bytes, default 641500lb # [ 0.568767] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1501worker2 # [ 0.587415] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1502worker2 # [ 0.589183] Trying to unpack rootfs image as initramfs...1503lb # [ 0.570325] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1504client # [ 0.546491] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1505worker1 # [ 0.577140] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1506client # [ 0.547880] clocksource: Switched to clocksource acpi_pm1507lb # [ 0.571553] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1508worker1 # [ 0.578659] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1509client # [ 0.548817] NET: Registered PF_INET protocol family1510lb # [ 0.572877] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1511worker1 # [ 0.579984] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1512client # [ 0.549963] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1513lb # [ 0.574122] TCP: Hash tables configured (established 16384 bind 16384)1514worker1 # [ 0.581345] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1515lb # [ 0.575207] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1516worker1 # [ 0.582626] TCP: Hash tables configured (established 16384 bind 16384)1517lb # [ 0.576483] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1518worker1 # [ 0.583798] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1519lb # [ 0.577565] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1520worker1 # [ 0.585080] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1521lb # [ 0.578765] NET: Registered PF_UNIX/PF_LOCAL protocol family1522lb # [ 0.579703] NET: Registered PF_XDP protocol family1523worker1 # [ 0.586201] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1524lb # [ 0.580548] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1525worker1 # [ 0.587435] NET: Registered PF_UNIX/PF_LOCAL protocol family1526lb # [ 0.581551] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1527worker1 # [ 0.588397] NET: Registered PF_XDP protocol family1528worker1 # [ 0.589273] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1529lb # [ 0.582570] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1530worker1 # [ 0.590300] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1531lb # [ 0.583655] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1532worker1 # [ 0.591314] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1533lb # [ 0.584770] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1534worker1 # [ 0.592459] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1535lb # [ 0.585877] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1536worker1 # [ 0.593607] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1537lb # [ 0.587647] ACPI: \_SB_.GSIA: Enabled at IRQ 161538worker1 # [ 0.595011] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1539lb # [ 0.589974] ACPI: \_SB_.GSIB: Enabled at IRQ 171540worker1 # [ 0.596839] ACPI: \_SB_.GSIA: Enabled at IRQ 161541client # [ 0.567309] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1542lb # [ 0.592115] ACPI: \_SB_.GSIC: Enabled at IRQ 181543worker1 # [ 0.599181] ACPI: \_SB_.GSIB: Enabled at IRQ 171544client # [ 0.568966] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1545lb # [ 0.594164] ACPI: \_SB_.GSID: Enabled at IRQ 191546worker1 # [ 0.601127] ACPI: \_SB_.GSIC: Enabled at IRQ 181547client # [ 0.570371] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1548lb # [ 0.595959] PCI: CLS 0 bytes, default 641549client # [ 0.571783] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1550worker1 # [ 0.603089] ACPI: \_SB_.GSID: Enabled at IRQ 191551client # [ 0.573150] TCP: Hash tables configured (established 16384 bind 16384)1552lb # [ 0.596829] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1553worker1 # [ 0.604823] PCI: CLS 0 bytes, default 641554lb # [ 0.598584] Trying to unpack rootfs image as initramfs...1555client # [ 0.574332] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1556client # [ 0.575659] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1557worker1 # [ 0.605739] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1558worker1 # [ 0.607468] Trying to unpack rootfs image as initramfs...1559client # [ 0.576812] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560client # [ 0.578132] NET: Registered PF_UNIX/PF_LOCAL protocol family1561client # [ 0.579176] NET: Registered PF_XDP protocol family1562client # [ 0.580098] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563client # [ 0.581178] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564client # [ 0.582255] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565client # [ 0.583426] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566client # [ 0.584648] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567client # [ 0.585844] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568client # [ 0.587808] ACPI: \_SB_.GSIA: Enabled at IRQ 161569client # [ 0.590190] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker2 # [ 0.634548] Initialise system trusted keyrings1571client # [ 0.592490] ACPI: \_SB_.GSIC: Enabled at IRQ 181572client # [ 0.594572] ACPI: \_SB_.GSID: Enabled at IRQ 191573worker2 # [ 0.638204] workingset: timestamp_bits=40 max_order=19 bucket_order=01574client # [ 0.596316] PCI: CLS 0 bytes, default 641575client # [ 0.597292] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1576client # [ 0.599173] Trying to unpack rootfs image as initramfs...1577worker2 # [ 0.658516] Key type asymmetric registered1578worker2 # [ 0.661195] Asymmetric key parser 'x509' registered1579worker2 # [ 0.662067] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1580lb # [ 0.644378] Initialise system trusted keyrings1581lb # [ 0.645346] workingset: timestamp_bits=40 max_order=19 bucket_order=01582worker1 # [ 0.652650] Initialise system trusted keyrings1583worker2 # [ 0.665257] io scheduler mq-deadline registered1584worker2 # [ 0.666020] io scheduler kyber registered1585worker1 # [ 0.655642] workingset: timestamp_bits=40 max_order=19 bucket_order=01586worker2 # [ 0.669704] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1587worker2 # [ 0.671014] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1588worker2 # [ 0.674949] Linux agpgart interface v0.1031589worker2 # [ 0.675737] ACPI: bus type drm_connector registered1590worker2 # [ 0.680561] usbcore: registered new interface driver usbserial_generic1591worker2 # [ 0.681673] usbserial: USB Serial support registered for generic1592lb # [ 0.666227] Key type asymmetric registered1593worker2 # [ 0.685170] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1594worker2 # [ 0.685170] Please enable it if your BIOS has the CPPC option.1595client # [ 0.644970] Initialise system trusted keyrings1596worker2 # [ 0.687434] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1597client # [ 0.645907] workingset: timestamp_bits=40 max_order=19 bucket_order=01598worker1 # [ 0.676920] Key type asymmetric registered1599lb # [ 0.670339] Asymmetric key parser 'x509' registered1600worker1 # [ 0.677655] Asymmetric key parser 'x509' registered1601lb # [ 0.671188] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1602worker2 # [ 0.690326] drop_monitor: Initializing network drop monitor service1603worker1 # [ 0.678552] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1604lb # [ 0.672572] io scheduler mq-deadline registered1605worker2 # [ 0.691481] NET: Registered PF_INET6 protocol family1606lb # [ 0.675326] io scheduler kyber registered1607worker2 # [ 0.694572] Segment Routing with IPv61608worker1 # [ 0.683730] io scheduler mq-deadline registered1609worker1 # [ 0.684533] io scheduler kyber registered1610worker2 # [ 0.697164] In-situ OAM (IOAM) with IPv61611worker2 # [ 0.698234] IPI shorthand broadcast: enabled1612lb # [ 0.679337] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1613worker1 # [ 0.687152] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1614lb # [ 0.680609] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1615worker1 # [ 0.688451] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1616lb # [ 0.686123] Linux agpgart interface v0.1031617lb # [ 0.686907] ACPI: bus type drm_connector registered1618worker1 # [ 0.694219] Linux agpgart interface v0.1031619worker2 # [ 0.706224] sched_clock: Marking stable (573013595, 133130954)->(783003195, -76858646)1620worker1 # [ 0.695011] ACPI: bus type drm_connector registered1621lb # [ 0.689767] usbcore: registered new interface driver usbserial_generic1622worker2 # [ 0.709319] registered taskstats version 11623lb # [ 0.690866] usbserial: USB Serial support registered for generic1624worker2 # [ 0.710282] Loading compiled-in X.509 certificates1625worker1 # [ 0.698081] usbcore: registered new interface driver usbserial_generic1626worker1 # [ 0.699150] usbserial: USB Serial support registered for generic1627client # [ 0.670210] Key type asymmetric registered1628client # [ 0.671000] Asymmetric key parser 'x509' registered1629lb # [ 0.694319] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1630lb # [ 0.694319] Please enable it if your BIOS has the CPPC option.1631worker1 # [ 0.702609] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1632lb # [ 0.696564] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1633worker1 # [ 0.702609] Please enable it if your BIOS has the CPPC option.1634client # [ 0.673622] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1635worker1 # [ 0.704890] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1636client # [ 0.676627] io scheduler mq-deadline registered1637lb # [ 0.700433] drop_monitor: Initializing network drop monitor service1638client # [ 0.677433] io scheduler kyber registered1639lb # [ 0.701597] NET: Registered PF_INET6 protocol family1640worker1 # [ 0.708738] drop_monitor: Initializing network drop monitor service1641worker1 # [ 0.709934] NET: Registered PF_INET6 protocol family1642client # [ 0.680212] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1643lb # [ 0.704767] Segment Routing with IPv61644worker1 # [ 0.713050] Segment Routing with IPv61645lb # [ 0.707317] In-situ OAM (IOAM) with IPv61646client # [ 0.683561] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1647lb # [ 0.708411] IPI shorthand broadcast: enabled1648worker1 # [ 0.715631] In-situ OAM (IOAM) with IPv61649worker2 # [ 0.728161] Demotion targets for Node 0: null1650worker1 # [ 0.716697] IPI shorthand broadcast: enabled1651client # [ 0.687171] Linux agpgart interface v0.1031652worker2 # [ 0.730203] Key type .fscrypt registered1653client # [ 0.687954] ACPI: bus type drm_connector registered1654worker2 # [ 0.730884] Key type fscrypt-provisioning registered1655worker2 # [ 0.731797] ima: No TPM chip found, activating TPM-bypass!1656client # [ 0.691085] usbcore: registered new interface driver usbserial_generic1657client # [ 0.692216] usbserial: USB Serial support registered for generic1658lb # [ 0.716632] sched_clock: Marking stable (583015001, 133284043)->(783536982, -67237938)1659worker2 # [ 0.736170] ima: Allocated hash algorithm: sha11660worker2 # [ 0.736981] ima: No architecture policies found1661worker1 # [ 0.725007] sched_clock: Marking stable (591013065, 133566762)->(796134160, -71554333)1662client # [ 0.695566] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1663worker2 # [ 0.739158] PM: Magic number: 10:928:5841664client # [ 0.695566] Please enable it if your BIOS has the CPPC option.1665lb # [ 0.721385] registered taskstats version 11666worker2 # [ 0.740689] RAS: Correctable Errors collector initialized.1667client # [ 0.697884] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1668lb # [ 0.722377] Loading compiled-in X.509 certificates1669worker1 # [ 0.730684] registered taskstats version 11670worker1 # [ 0.731656] Loading compiled-in X.509 certificates1671client # [ 0.701693] drop_monitor: Initializing network drop monitor service1672client # [ 0.702917] NET: Registered PF_INET6 protocol family1673worker2 # [ 0.748810] clk: Disabling unused clocks1674client # [ 0.707662] Segment Routing with IPv61675client # [ 0.708352] In-situ OAM (IOAM) with IPv61676worker2 # [ 0.752162] PM: genpd: Disabling unused power domains1677client # [ 0.710829] IPI shorthand broadcast: enabled1678lb # [ 0.741320] Demotion targets for Node 0: null1679worker1 # [ 0.748133] Demotion targets for Node 0: null1680lb # [ 0.742200] Key type .fscrypt registered1681lb # [ 0.742925] Key type fscrypt-provisioning registered1682client # [ 0.719017] sched_clock: Marking stable (585014427, 133531882)->(792380068, -73833759)1683worker1 # [ 0.751648] Key type .fscrypt registered1684worker1 # [ 0.752333] Key type fscrypt-provisioning registered1685lb # [ 0.746427] ima: No TPM chip found, activating TPM-bypass!1686worker1 # [ 0.753299] ima: No TPM chip found, activating TPM-bypass!1687lb # [ 0.747363] ima: Allocated hash algorithm: sha11688client # [ 0.723744] registered taskstats version 11689lb # [ 0.748184] ima: No architecture policies found1690client # [ 0.724746] Loading compiled-in X.509 certificates1691worker1 # [ 0.755598] ima: Allocated hash algorithm: sha11692worker1 # [ 0.756360] ima: No architecture policies found1693lb # [ 0.750475] PM: Magic number: 10:928:5841694worker1 # [ 0.758592] PM: Magic number: 10:928:5841695lb # [ 0.752135] RAS: Correctable Errors collector initialized.1696worker1 # [ 0.760254] RAS: Correctable Errors collector initialized.1697worker1 # [ 0.769310] clk: Disabling unused clocks1698lb # [ 0.762996] clk: Disabling unused clocks1699lb # [ 0.765311] PM: genpd: Disabling unused power domains1700worker1 # [ 0.772598] PM: genpd: Disabling unused power domains1701client # [ 0.743570] Demotion targets for Node 0: null1702client # [ 0.744474] Key type .fscrypt registered1703client # [ 0.745220] Key type fscrypt-provisioning registered1704client # [ 0.746190] ima: No TPM chip found, activating TPM-bypass!1705client # [ 0.750570] ima: Allocated hash algorithm: sha11706client # [ 0.751408] ima: No architecture policies found1707client # [ 0.752425] PM: Magic number: 10:928:5841708client # [ 0.756138] RAS: Correctable Errors collector initialized.1709client # [ 0.764808] clk: Disabling unused clocks1710client # [ 0.765523] PM: genpd: Disabling unused power domains1711worker2 # [ 0.907297] Freeing initrd memory: 29092K1712worker2 # [ 0.910352] Freeing unused decrypted memory: 2028K1713worker2 # [ 0.912860] Freeing unused kernel image (initmem) memory: 3644K1714worker2 # [ 0.913991] Write protecting the kernel read-only data: 32768k1715worker2 # [ 0.915874] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker2 # [ 0.917419] Freeing unused kernel image (rodata/data gap) memory: 752K1717lb # [ 0.924897] Freeing initrd memory: 29092K1718lb # [ 0.928106] Freeing unused decrypted memory: 2028K1719worker1 # [ 0.936069] Freeing initrd memory: 29092K1720lb # [ 0.930984] Freeing unused kernel image (initmem) memory: 3644K1721lb # [ 0.932110] Write protecting the kernel read-only data: 32768k1722worker1 # [ 0.939237] Freeing unused decrypted memory: 2028K1723lb # [ 0.933982] Freeing unused kernel image (text/rodata gap) memory: 1208K1724worker1 # [ 0.941845] Freeing unused kernel image (initmem) memory: 3644K1725lb # [ 0.935549] Freeing unused kernel image (rodata/data gap) memory: 752K1726worker1 # [ 0.942924] Write protecting the kernel read-only data: 32768k1727worker1 # [ 0.944804] Freeing unused kernel image (text/rodata gap) memory: 1208K1728worker1 # [ 0.946319] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker2 # [ 0.968705] x86/mm: Checked W+X mappings: passed, no W+X pages found.1730worker2 # [ 0.969852] Run /init as init process1731worker2 # [ 0.979838] systemd[1]: Inserted module 'autofs4'1732client # [ 0.937579] Freeing initrd memory: 29096K1733client # [ 0.940850] Freeing unused decrypted memory: 2028K1734client # [ 0.943519] Freeing unused kernel image (initmem) memory: 3644K1735client # [ 0.944695] Write protecting the kernel read-only data: 32768k1736client # [ 0.946654] Freeing unused kernel image (text/rodata gap) memory: 1208K1737client # [ 0.948237] Freeing unused kernel image (rodata/data gap) memory: 752K1738worker2 # [ 0.995921] fuse: init (API version 7.45)1739worker2 # [ 1.001828] ACPI: \_SB_.GSIG: Enabled at IRQ 221740worker2 # [ 1.004297] ACPI: \_SB_.GSIH: Enabled at IRQ 231741lb # [ 0.986719] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742lb # [ 0.987804] Run /init as init process1743worker2 # [ 1.008330] ACPI: \_SB_.GSIE: Enabled at IRQ 201744worker1 # [ 0.997397] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745worker1 # [ 0.998485] Run /init as init process1746worker2 # [ 1.011077] ACPI: \_SB_.GSIF: Enabled at IRQ 211747lb # [ 0.998009] systemd[1]: Inserted module 'autofs4'1748worker1 # [ 1.009026] systemd[1]: Inserted module 'autofs4'1749lb # [ 1.014373] fuse: init (API version 7.45)1750worker1 # [ 1.025306] fuse: init (API version 7.45)1751lb # [ 1.020159] ACPI: \_SB_.GSIG: Enabled at IRQ 221752worker2 # [ 1.039954] systemd[1]: Successfully made /usr/ read-only.1753lb # [ 1.022571] ACPI: \_SB_.GSIH: Enabled at IRQ 231754client # [ 0.999513] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755worker1 # [ 1.031131] ACPI: \_SB_.GSIG: Enabled at IRQ 221756client # [ 1.000683] Run /init as init process1757lb # [ 1.026069] ACPI: \_SB_.GSIE: Enabled at IRQ 201758worker1 # [ 1.034131] ACPI: \_SB_.GSIH: Enabled at IRQ 231759lb # [ 1.028848] ACPI: \_SB_.GSIF: Enabled at IRQ 211760worker1 # [ 1.037243] ACPI: \_SB_.GSIE: Enabled at IRQ 201761worker1 # [ 1.039437] ACPI: \_SB_.GSIF: Enabled at IRQ 211762client # [ 1.011573] systemd[1]: Inserted module 'autofs4'1763client # [ 1.028505] fuse: init (API version 7.45)1764client # [ 1.034475] ACPI: \_SB_.GSIG: Enabled at IRQ 221765client # [ 1.036897] ACPI: \_SB_.GSIH: Enabled at IRQ 231766lb # [ 1.063120] systemd[1]: Successfully made /usr/ read-only.1767client # [ 1.040052] ACPI: \_SB_.GSIE: Enabled at IRQ 201768worker1 # [ 1.070758] systemd[1]: Successfully made /usr/ read-only.1769client # [ 1.042355] ACPI: \_SB_.GSIF: Enabled at IRQ 211770client # [ 1.070728] systemd[1]: Successfully made /usr/ read-only.1771worker2 # [ 1.375527] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker2 # [ 1.380672] systemd[1]: Detected virtualization kvm.1773worker2 # [ 1.381551] systemd[1]: Detected architecture x86-64.1774worker2 # [ 1.382453] systemd[1]: Running in initrd.1775worker2 # [ 1.383554] systemd[1]: Initializing machine ID from random generator.1776worker2 # [ 1.384788] systemd[1]: Hostname set to <worker2>.1777lb # [ 1.398675] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778lb # [ 1.403819] systemd[1]: Detected virtualization kvm.1779lb # [ 1.404680] systemd[1]: Detected architecture x86-64.1780lb # [ 1.405602] systemd[1]: Running in initrd.1781worker1 # [ 1.406394] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1782lb # [ 1.406789] systemd[1]: Initializing machine ID from random generator.1783worker1 # [ 1.413798] systemd[1]: Detected virtualization kvm.1784lb # [ 1.408062] systemd[1]: Hostname set to <lb>.1785worker1 # [ 1.415603] systemd[1]: Detected architecture x86-64.1786worker1 # [ 1.417347] systemd[1]: Running in initrd.1787worker1 # [ 1.419636] systemd[1]: Initializing machine ID from random generator.1788worker1 # [ 1.421960] systemd[1]: Hostname set to <worker1>.1789client # [ 1.406322] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790client # [ 1.411503] systemd[1]: Detected virtualization kvm.1791client # [ 1.412429] systemd[1]: Detected architecture x86-64.1792client # [ 1.413344] systemd[1]: Running in initrd.1793client # [ 1.414616] systemd[1]: Initializing machine ID from random generator.1794client # [ 1.415902] systemd[1]: Hostname set to <client>.1795worker2 # [ 1.589764] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker2 # [ 1.636182] systemd[1]: Queued start job for default target Initrd Default Target.1797lb # [ 1.617604] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798worker2 # [ 1.639474] systemd[1]: Created slice Slice /system/modprobe.1799worker2 # [ 1.640690] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1800worker2 # [ 1.642117] systemd[1]: Expecting device /dev/disk/by-label/nixos...1801worker2 # [ 1.643289] systemd[1]: Reached target Path Units.1802worker2 # [ 1.644179] systemd[1]: Reached target Slice Units.1803worker2 # [ 1.645056] systemd[1]: Reached target Swaps.1804worker2 # [ 1.645871] systemd[1]: Reached target Timer Units.1805worker2 # [ 1.646899] systemd[1]: Listening on D-Bus System Message Bus Socket.1806worker2 # [ 1.648170] systemd[1]: Listening on Journal Socket (/dev/log).1807worker2 # [ 1.649388] systemd[1]: Listening on Journal Sockets.1808worker2 # [ 1.650469] systemd[1]: Listening on udev Control Socket.1809worker2 # [ 1.651548] systemd[1]: Listening on udev Kernel Socket.1810worker2 # [ 1.652548] systemd[1]: Reached target Socket Units.1811worker2 # [ 1.655221] systemd[1]: Starting Create List of Static Device Nodes...1812worker1 # [ 1.643216] systemd[1]: bpf-restrict-fs: LSM BPF program attached1813worker2 # [ 1.658211] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1814client # [ 1.618705] systemd[1]: bpf-restrict-fs: LSM BPF program attached1815worker2 # [ 1.663830] systemd[1]: Starting Load Kernel Module configfs...1816worker2 # [ 1.677218] systemd[1]: Starting Journal Service...1817lb # [ 1.668470] systemd[1]: Queued start job for default target Initrd Default Target.1818worker2 # [ 1.688230] systemd[1]: Starting Load Kernel Modules...1819lb # [ 1.672614] systemd[1]: Created slice Slice /system/modprobe.1820lb # [ 1.673897] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1821lb # [ 1.675424] systemd[1]: Expecting device /dev/disk/by-label/nixos...1822lb # [ 1.676648] systemd[1]: Reached target Path Units.1823lb # [ 1.677614] systemd[1]: Reached target Slice Units.1824lb # [ 1.678630] systemd[1]: Reached target Swaps.1825lb # [ 1.679526] systemd[1]: Reached target Timer Units.1826lb # [ 1.680595] systemd[1]: Listening on D-Bus System Message Bus Socket.1827lb # [ 1.681876] systemd[1]: Listening on Journal Socket (/dev/log).1828lb # [ 1.683198] systemd[1]: Listening on Journal Sockets.1829lb # [ 1.684264] systemd[1]: Listening on udev Control Socket.1830lb # [ 1.685344] systemd[1]: Listening on udev Kernel Socket.1831lb # [ 1.686321] systemd[1]: Reached target Socket Units.1832lb # [ 1.688142] systemd[1]: Starting Create List of Static Device Nodes...1833worker2 # [ 1.696204] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1834lb # [ 1.692155] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1835worker1 # [ 1.699207] systemd[1]: Queued start job for default target Initrd Default Target.1836worker2 # [ 1.714253] netfs: FS-Cache loaded1837client # [ 1.672483] systemd[1]: Queued start job for default target Initrd Default Target.1838worker1 # [ 1.703985] systemd[1]: Created slice Slice /system/modprobe.1839worker1 # [ 1.705162] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1840lb # [ 1.699498] systemd[1]: Starting Load Kernel Module configfs...1841worker1 # [ 1.706512] systemd[1]: Expecting device /dev/disk/by-label/nixos...1842worker2 # [ 1.718999] 9pnet: Installing 9P2000 support1843worker1 # [ 1.707654] systemd[1]: Reached target Path Units.1844client # [ 1.677028] systemd[1]: Created slice Slice /system/modprobe.1845worker1 # [ 1.708459] systemd[1]: Reached target Slice Units.1846worker1 # [ 1.709301] systemd[1]: Reached target Swaps.1847client # [ 1.678259] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1848worker1 # [ 1.710067] systemd[1]: Reached target Timer Units.1849client # [ 1.679717] systemd[1]: Expecting device /dev/disk/by-label/nixos...1850worker1 # [ 1.711078] systemd[1]: Listening on D-Bus System Message Bus Socket.1851client # [ 1.680856] systemd[1]: Reached target Path Units.1852client # [ 1.681716] systemd[1]: Reached target Slice Units.1853worker1 # [ 1.712261] systemd[1]: Listening on Journal Socket (/dev/log).1854client # [ 1.682632] systemd[1]: Reached target Swaps.1855worker1 # [ 1.713384] systemd[1]: Listening on Journal Sockets.1856client # [ 1.683439] systemd[1]: Reached target Timer Units.1857worker1 # [ 1.714369] systemd[1]: Listening on udev Control Socket.1858worker2 # [ 1.727196] systemd[1]: Starting Coldplug All udev Devices...1859client # [ 1.684472] systemd[1]: Listening on D-Bus System Message Bus Socket.1860worker1 # [ 1.715374] systemd[1]: Listening on udev Kernel Socket.1861worker1 # [ 1.716310] systemd[1]: Reached target Socket Units.1862client # [ 1.685703] systemd[1]: Listening on Journal Socket (/dev/log).1863client # [ 1.686872] systemd[1]: Listening on Journal Sockets.1864worker1 # [ 1.718164] systemd[1]: Starting Create List of Static Device Nodes...1865client # [ 1.687941] systemd[1]: Listening on udev Control Socket.1866client # [ 1.688981] systemd[1]: Listening on udev Kernel Socket.1867client # [ 1.689955] systemd[1]: Reached target Socket Units.1868lb # [ 1.713915] systemd[1]: Starting Journal Service...1869worker1 # [ 1.722672] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1870client # [ 1.692622] systemd[1]: Starting Create List of Static Device Nodes...1871client # [ 1.695614] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1872worker1 # [ 1.729319] systemd[1]: Starting Load Kernel Module configfs...1873worker2 # [ 1.741243] systemd[1]: Finished Create List of Static Device Nodes.1874client # [ 1.702291] systemd[1]: Starting Load Kernel Module configfs...1875lb # [ 1.726364] systemd[1]: Starting Load Kernel Modules...1876worker2 # [ 1.747722] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1877worker2 # [ 1.755537] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1878worker1 # [ 1.744661] systemd[1]: Starting Journal Service...1879client # [ 1.718669] systemd[1]: Starting Journal Service...1880worker2 # [ 1.761583] systemd[1]: modprobe@configfs.service: Deactivated successfully.1881lb # [ 1.731377] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1882worker2 # [ 1.763265] systemd-journald[67]: Collecting audit messages is disabled.1883lb # [ 1.749060] netfs: FS-Cache loaded1884worker2 # [ 1.768485] systemd[1]: Finished Load Kernel Module configfs.1885worker1 # [ 1.757896] systemd[1]: Starting Load Kernel Modules...1886lb # [ 1.753754] 9pnet: Installing 9P2000 support1887worker2 # [ 1.773574] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1888client # [ 1.732644] systemd[1]: Starting Load Kernel Modules...1889worker2 # [ 1.776085] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1890lb # [ 1.763088] systemd[1]: Starting Coldplug All udev Devices...1891worker2 # [ 1.784211] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1892worker1 # [ 1.763138] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1893worker2 # [ 1.787275] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1894worker1 # [ 1.781244] netfs: FS-Cache loaded1895client # [ 1.739642] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1896lb # [ 1.776853] systemd[1]: Finished Create List of Static Device Nodes.1897client # [ 1.755599] netfs: FS-Cache loaded1898worker1 # [ 1.788710] 9pnet: Installing 9P2000 support1899lb # [ 1.782908] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1900client # [ 1.762048] 9pnet: Installing 9P2000 support1901lb # [ 1.790360] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1902worker2 # [ 1.812619] systemd[1]: Finished Load Kernel Modules.1903lb # [ 1.797771] systemd[1]: modprobe@configfs.service: Deactivated successfully.1904client # [ 1.775818] systemd[1]: Starting Coldplug All udev Devices...1905lb # [ 1.800744] systemd-journald[67]: Collecting audit messages is disabled.1906worker1 # [ 1.807853] systemd[1]: Starting Coldplug All udev Devices...1907worker2 # [ 1.821230] systemd[1]: Starting Apply Kernel Variables...1908lb # [ 1.803355] systemd[1]: Finished Load Kernel Module configfs.1909worker1 # [ 1.814495] systemd-journald[67]: Collecting audit messages is disabled.1910lb # [ 1.809770] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1911lb # [ 1.812071] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1912client # [ 1.789843] systemd-journald[67]: Collecting audit messages is disabled.1913worker2 # [ 1.834251] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1914worker1 # [ 1.822456] systemd[1]: Finished Create List of Static Device Nodes.1915client # [ 1.792610] systemd[1]: Finished Create List of Static Device Nodes.1916client # [ 1.795372] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1917worker1 # [ 1.828248] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1918lb # [ 1.821455] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1919lb # [ 1.823142] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1920worker2 # [ 1.845450] systemd[1]: Starting Create Static Device Nodes in /dev...1921client # [ 1.804086] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1922worker1 # [ 1.835994] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1923worker1 # [ 1.840975] systemd[1]: modprobe@configfs.service: Deactivated successfully.1924client # [ 1.813111] systemd[1]: modprobe@configfs.service: Deactivated successfully.1925worker2 # [ 1.857274] systemd[1]: Finished Apply Kernel Variables.1926worker1 # [ 1.849027] systemd[1]: Finished Load Kernel Module configfs.1927client # [ 1.820063] systemd[1]: Finished Load Kernel Module configfs.1928worker1 # [ 1.855027] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1929client # [ 1.825162] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1930lb # [ 1.852854] systemd[1]: Finished Load Kernel Modules.1931worker1 # [ 1.859606] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1932client # [ 1.829134] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1933worker2 # [ 1.742276] systemd-modules-load[68]: Inserted module 'dm_mod'1934worker2 # [ 1.876588] systemd[1]: Started Journal Service.1935worker2 # [ 1.744292] systemd-modules-load[68]: Inserted module 'virtio_balloon'1936worker2 # [ 1.745674] systemd-modules-load[68]: Inserted module 'virtio_gpu'1937worker1 # [ 1.866674] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1938lb # [ 1.860487] systemd[1]: Starting Apply Kernel Variables...1939worker1 # [ 1.868138] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1940client # [ 1.840790] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1941worker2 # [ 1.750862] systemd[1]: Finished Create Static Device Nodes in /dev.1942client # [ 1.842341] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1943lb # [ 1.870460] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1944worker2 # [ 1.758122] systemd[1]: Reached target Preparation for Local File Systems.1945worker2 # [ 1.759116] systemd[1]: Reached target Local File Systems.1946worker2 # [ 1.761970] systemd[1]: Starting Create System Files and Directories...1947lb # [ 1.880379] systemd[1]: Starting Create Static Device Nodes in /dev...1948worker2 # [ 1.769068] systemd[1]: Starting Rule-based Manager for Device Events and Files...1949worker1 # [ 1.898127] systemd[1]: Finished Load Kernel Modules.1950client # [ 1.874194] systemd[1]: Finished Load Kernel Modules.1951worker1 # [ 1.906817] systemd[1]: Starting Apply Kernel Variables...1952lb # [ 1.902440] systemd[1]: Finished Apply Kernel Variables.1953worker2 # [ 1.792344] systemd[1]: Finished Create System Files and Directories.1954client # [ 1.882766] systemd[1]: Starting Apply Kernel Variables...1955worker1 # [ 1.916702] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1956lb # [ 1.914743] systemd[1]: Started Journal Service.1957lb # [ 1.783242] systemd-modules-load[68]: Inserted module 'dm_mod'1958client # [ 1.893669] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1959worker1 # [ 1.925790] systemd[1]: Starting Create Static Device Nodes in /dev...1960lb # [ 1.786351] systemd-modules-load[68]: Inserted module 'virtio_balloon'1961lb # [ 1.788363] systemd-modules-load[68]: Inserted module 'virtio_gpu'1962lb # [ 1.790258] systemd[1]: Finished Create Static Device Nodes in /dev.1963lb # [ 1.792336] systemd[1]: Reached target Preparation for Local File Systems.1964lb # [ 1.793448] systemd[1]: Reached target Local File Systems.1965client # [ 1.902754] systemd[1]: Starting Create Static Device Nodes in /dev...1966worker2 # [ 1.812856] systemd-udevd[83]: Using default interface naming scheme 'v261'.1967lb # [ 1.795257] systemd[1]: Starting Create System Files and Directories...1968worker1 # [ 1.800860] systemd-modules-load[68]: Inserted module 'dm_mod'1969worker1 # [ 1.804884] systemd-modules-load[68]: Inserted module 'virtio_balloon'1970lb # [ 1.798920] systemd[1]: Starting Rule-based Manager for Device Events and Files...1971worker1 # [ 1.805903] systemd-modules-load[68]: Inserted module 'virtio_gpu'1972worker1 # [ 1.940605] systemd[1]: Started Journal Service.1973worker1 # [ 1.814555] systemd[1]: Finished Apply Kernel Variables.1974client # [ 1.783615] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.919905] systemd[1]: Started Journal Service.1975client # 1976client # [ 1.788316] systemd-modules-load[68]: Inserted module 'virtio_balloon'1977client # [ 1.789405] systemd-modules-load[68]: Inserted module 'virtio_gpu'1978worker2 # [ 1.838764] systemd[1]: Started Rule-based Manager for Device Events and Files.1979worker1 # [ 1.829671] systemd[1]: Finished Create Static Device Nodes in /dev.1980worker1 # [ 1.830931] systemd[1]: Reached target Preparation for Local File Systems.1981client # [ 1.800895] systemd[1]: Finished Apply Kernel Variables.1982lb # [ 1.826596] systemd[1]: Finished Create System Files and Directories.1983worker1 # [ 1.834069] systemd[1]: Reached target Local File Systems.1984worker1 # [ 1.835834] systemd[1]: Starting Create System Files and Directories...1985client # [ 1.810143] systemd[1]: Finished Create Static Device Nodes in /dev.1986client # [ 1.811436] systemd[1]: Reached target Preparation for Local File Systems.1987worker1 # [ 1.843081] systemd[1]: Starting Rule-based Manager for Device Events and Files...1988client # [ 1.813877] systemd[1]: Reached target Local File Systems.1989client # [ 1.816901] systemd[1]: Starting Create System Files and Directories...1990client # [ 1.822350] systemd[1]: Starting Rule-based Manager for Device Events and Files...1991lb # [ 1.855424] systemd-udevd[76]: Using default interface naming scheme 'v261'.1992worker1 # [ 1.869473] systemd[1]: Finished Create System Files and Directories.1993worker2 # [ 1.893073] systemd[1]: Finished Coldplug All udev Devices.1994worker2 # [ 1.893902] systemd[1]: Reached target System Initialization.1995client # [ 1.851120] systemd[1]: Finished Create System Files and Directories.1996worker2 # [ 1.894761] systemd[1]: Reached target Basic System.1997lb # [ 1.880097] systemd[1]: Started Rule-based Manager for Device Events and Files.1998worker1 # [ 1.887660] systemd-udevd[83]: Using default interface naming scheme 'v261'.1999client # [ 1.871826] systemd-udevd[83]: Using default interface naming scheme 'v261'.2000worker1 # [ 1.912023] systemd[1]: Started Rule-based Manager for Device Events and Files.
loading 1,867 hidden lines…
3868lb # [ 10.387044] postgresql-pre-start[729]: selecting default "max_connections" ... 1003869lb # [ 10.460785] postgresql-pre-start[729]: selecting default "shared_buffers" ... 128MB3870lb # [ 10.539329] systemd-vconsole-setup[734]: Configuration of first virtual console was skipped, ignoring remaining ones.3871lb # [ 10.544369] systemd[1]: Finished Virtual Console Setup.3872client: (finished: waiting for unit network-addresses-eth1.service, in 11.40 seconds)3873client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3874client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3875lb: waiting for unit network-addresses-eth1.service3876lb: waiting for the VM to finish booting3877lb: Guest shell says: b'Spawning backdoor root shell...\n'3878lb: connected to guest root shell3879lb: (connecting took 0.00 seconds)3880lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3881lb: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3882lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3883lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3884worker1: waiting for unit network-addresses-eth1.service3885worker1: waiting for the VM to finish booting3886worker1: Guest shell says: b'Spawning backdoor root shell...\n'3887worker1: connected to guest root shell3888worker1: (connecting took 0.00 seconds)3889worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3890worker1 # [ 10.896817] dhcpcd[695]: eth0: soliciting a DHCP lease3891worker1 # [ 11.059250] NET: Registered PF_PACKET protocol family3892worker1 # [ 10.932535] dhcpcd[695]: eth0: offered 10.0.2.15 from 10.0.2.23893worker1 # [ 10.938434] dhcpcd[695]: eth0: probing address 10.0.2.15/243894worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds)3895worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3896worker2 # [ 11.023417] dhcpcd[692]: eth0: soliciting a DHCP lease3897worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3898worker2: waiting for unit network-addresses-eth1.service3899worker2: waiting for the VM to finish booting3900worker2: Guest shell says: b'Spawning backdoor root shell...\n'3901worker2: connected to guest root shell3902worker2: (connecting took 0.00 seconds)3903worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3904worker2 # [ 11.186540] NET: Registered PF_PACKET protocol family3905worker2 # [ 11.062257] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.23906worker2 # [ 11.067611] dhcpcd[692]: eth0: probing address 10.0.2.15/243907worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3908worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3909worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3910lb: waiting for unit niks3.service3911client # [ 11.330861] dhcpcd[562]: eth0: soliciting an IPv6 router3912client # [ 11.332285] dhcpcd[562]: eth0: Router Advertisement from fe80::23913client # [ 11.333154] dhcpcd[562]: eth0: adding address fec0::5054:ff:fe12:3456/643914client # [ 11.334039] dhcpcd[562]: eth0: adding route to fec0::/643915client # [ 11.334818] dhcpcd[562]: eth0: adding default route via fe80::23916lb # [ 11.734468] dhcpcd[714]: eth0: soliciting a DHCP lease3917lb # [ 11.881174] NET: Registered PF_PACKET protocol family3918lb # [ 11.751378] dhcpcd[714]: eth0: offered 10.0.2.15 from 10.0.2.23919lb # [ 11.754168] dhcpcd[714]: eth0: probing address 10.0.2.15/243920lb # [ 12.221386] postgresql-pre-start[729]: selecting default time zone ... UTC3921lb # [ 12.224825] postgresql-pre-start[729]: creating configuration files ... ok3922lb # [ 12.463298] postgresql-pre-start[729]: running bootstrap script ... ok3923worker2 # [ 12.741851] dhcpcd[692]: eth0: soliciting an IPv6 router3924worker2 # [ 12.743840] dhcpcd[692]: eth0: Router Advertisement from fe80::23925worker2 # [ 12.745962] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643926worker2 # [ 12.748238] dhcpcd[692]: eth0: adding route to fec0::/643927worker2 # [ 12.750171] dhcpcd[692]: eth0: adding default route via fe80::23928lb # [ 12.995126] postgresql-pre-start[729]: performing post-bootstrap initialization ... ok3929worker1 # [ 13.056916] dhcpcd[695]: eth0: soliciting an IPv6 router3930worker1 # [ 13.058978] dhcpcd[695]: eth0: Router Advertisement from fe80::23931worker1 # [ 13.061229] dhcpcd[695]: eth0: adding address fec0::5054:ff:fe12:3456/643932worker1 # [ 13.063371] dhcpcd[695]: eth0: adding route to fec0::/643933worker1 # [ 13.065381] dhcpcd[695]: eth0: adding default route via fe80::23934lb # [ 13.110409] dhcpcd[714]: eth0: soliciting an IPv6 router3935lb # [ 13.111798] dhcpcd[714]: eth0: Router Advertisement from fe80::23936lb # [ 13.112786] dhcpcd[714]: eth0: adding address fec0::5054:ff:fe12:3456/643937lb # [ 13.113722] dhcpcd[714]: eth0: adding route to fec0::/643938lb # [ 13.114418] dhcpcd[714]: eth0: adding default route via fe80::23939lb # [ 13.133547] postgresql-pre-start[729]: syncing data to disk ... ok3940lb # [ 13.134454] postgresql-pre-start[729]: initdb: warning: enabling "trust" authentication for local connections3941lb # [ 13.135656] postgresql-pre-start[729]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3942lb # [ 13.137497] postgresql-pre-start[729]: Success. You can now start the database server using:3943lb # [ 13.138556] postgresql-pre-start[729]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3944lb # [ 13.253621] postgres[793]: [793] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3945lb # [ 13.258239] postgres[793]: [793] LOG: listening on IPv6 address "::1", port 54323946lb # [ 13.259324] postgres[793]: [793] LOG: listening on IPv4 address "127.0.0.1", port 54323947lb # [ 13.261776] postgres[793]: [793] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3948lb # [ 13.275340] postgres[802]: [802] LOG: database system was shut down at 2026-09-20 13:34:13 GMT3949lb # [ 13.281565] postgres[793]: [793] LOG: database system is ready to accept connections3950lb # [ 13.286357] systemd[1]: Started PostgreSQL Server.3951lb # [ 13.293061] systemd[1]: Starting PostgreSQL Setup Scripts...3952lb # [ 13.493116] postgresql-setup-start[822]: CREATE DATABASE3953lb # [ 13.530220] postgresql-setup-start[827]: CREATE ROLE3954lb # [ 13.547740] postgresql-setup-start[829]: ALTER DATABASE3955lb # [ 13.552868] systemd[1]: Finished PostgreSQL Setup Scripts.3956lb # [ 13.554577] systemd[1]: Reached target PostgreSQL.3957client # [ 14.738454] dhcpcd[562]: eth0: leased 10.0.2.15 for 86400 seconds3958client # [ 14.741691] dhcpcd[562]: eth0: adding route to 10.0.2.0/243959client # [ 14.743898] dhcpcd[562]: eth0: adding default route via 10.0.2.23960client # [ 14.870920] systemd[1]: Started DHCP Client.3961client # [ 14.873641] systemd[1]: Reached target Multi-User System.3962client # [ 14.875228] systemd[1]: Startup finished in 870ms (kernel) + 4.147s (initrd) + 9.856s (userspace) = 14.874s.3963worker2 # [ 15.090625] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3964worker2 # [ 15.093678] dhcpcd[692]: eth0: adding route to 10.0.2.0/243965worker2 # [ 15.096103] dhcpcd[692]: eth0: adding default route via 10.0.2.23966worker2 # [ 15.253988] systemd[1]: Started DHCP Client.3967worker2 # [ 15.255770] systemd[1]: Reached target Multi-User System.3968worker2 # [ 15.256982] systemd[1]: Startup finished in 840ms (kernel) + 4.083s (initrd) + 10.332s (userspace) = 15.256s.3969worker1 # [ 16.104716] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds3970worker1 # [ 16.107699] dhcpcd[695]: eth0: adding route to 10.0.2.0/243971worker1 # [ 16.109986] dhcpcd[695]: eth0: adding default route via 10.0.2.23972worker1 # [ 16.222714] systemd[1]: Started DHCP Client.3973worker1 # [ 16.224246] systemd[1]: Reached target Multi-User System.3974worker1 # [ 16.224960] systemd[1]: Startup finished in 868ms (kernel) + 4.077s (initrd) + 11.278s (userspace) = 16.223s.3975lb # [ 17.136568] dhcpcd[714]: eth0: leased 10.0.2.15 for 86400 seconds3976lb # [ 17.139282] dhcpcd[714]: eth0: adding route to 10.0.2.0/243977lb # [ 17.141564] dhcpcd[714]: eth0: adding default route via 10.0.2.23978lb # [ 17.258753] systemd[1]: Started DHCP Client.3979lb # [ 17.260911] systemd[1]: Reached target Network is Online.3980lb # [ 17.265051] systemd[1]: Started Envoy reverse proxy.3981lb # [ 17.268412] systemd[1]: Started mock-oidc.service.3982lb # [ 17.360413] mock-oidc-server[921]: Mock OIDC Server running3983lb # [ 17.361465] mock-oidc-server[921]: OIDC Address: 192.168.1.2:80803984lb # [ 17.362661] mock-oidc-server[921]: Issue Address: 0.0.0.0:80813985lb # [ 17.363623] mock-oidc-server[921]: Issuer: http://192.168.1.2:8080/oidc3986lb # [ 17.364954] mock-oidc-server[921]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3987lb # [ 17.366158] mock-oidc-server[921]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3988lb # [ 17.367627] mock-oidc-server[921]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3989lb # [ 17.833439] envoy[920]: [2026-09-20 13:34:18.724][920][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3990lb # [ 17.835255] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:469] statically linked extensions:3991lb # [ 17.836638] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3992lb # [ 17.840446] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3993lb # [ 17.842323] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3994lb # [ 17.844456] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3995lb # [ 17.846210] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3996lb # [ 17.847826] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23997lb # [ 17.849506] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3998lb # [ 17.854438] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3999lb # [ 17.867815] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4000lb # [ 17.870265] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4001lb # [ 17.871733] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4002lb # [ 17.873375] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4003lb # [ 17.875611] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4004lb # [ 17.877340] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4005lb # [ 17.884167] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84006lb # [ 17.885887] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4007lb # [ 17.887612] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4008lb # [ 17.890501] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4009lb # [ 17.892291] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4010lb # [ 17.894426] envoy[920]: [2026-09-20 13:34:18.725][920][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4011lb # [ 17.896081] envoy[920]: [2026-09-20 13:34:18.732][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4012lb # [ 17.897901] envoy[920]: [2026-09-20 13:34:18.732][920][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4013lb # [ 17.900114] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4014lb # [ 17.902690] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4015lb # [ 17.904908] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4016lb # [ 17.907862] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4017lb # [ 17.910081] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4018lb # [ 17.912643] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4019lb # [ 17.917064] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4020lb # [ 17.919132] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24021lb # [ 17.921206] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4022lb # [ 17.923123] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4023lb # [ 17.924769] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4024lb # [ 17.928591] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4025lb # [ 17.930452] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4026lb # [ 17.934097] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4027lb # [ 17.935752] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4028lb # [ 17.938086] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4029lb # [ 17.940812] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4030lb # [ 17.942914] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4031lb # [ 17.944524] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4032lb # [ 17.946724] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4033lb # [ 17.955831] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4034lb # [ 17.961023] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4035lb # [ 17.962862] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4036lb # [ 17.968170] envoy[920]: [2026-09-20 13:34:18.734][920][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4037lb # [ 17.969968] envoy[920]: [2026-09-20 13:34:18.736][920][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4038lb # [ 17.972867] envoy[920]: [2026-09-20 13:34:18.740][920][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4039lb # [ 17.975276] envoy[920]: [2026-09-20 13:34:18.740][920][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4040lb # [ 17.977099] envoy[920]: [2026-09-20 13:34:18.740][920][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4041lb # [ 17.978684] envoy[920]: [2026-09-20 13:34:18.740][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4042lb # [ 17.980845] envoy[920]: [2026-09-20 13:34:18.740][920][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4043lb # [ 17.986743] envoy[920]: [2026-09-20 13:34:18.741][920][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4044lb # [ 17.988437] envoy[920]: [2026-09-20 13:34:18.741][920][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4045lb # [ 17.990253] envoy[920]: [2026-09-20 13:34:18.741][920][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4046lb # [ 17.991969] envoy[920]: [2026-09-20 13:34:18.741][920][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4047lb # [ 17.993813] envoy[920]: [2026-09-20 13:34:18.741][920][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4048lb # [ 17.995877] envoy[920]: [2026-09-20 13:34:18.741][920][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4049lb # [ 17.997579] envoy[920]: [2026-09-20 13:34:18.741][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4050lb # [ 17.999503] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4051lb # [ 18.005473] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4052lb # [ 18.009337] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4053lb # [ 18.011777] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4054lb # [ 18.014022] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4055lb # [ 18.016571] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4056lb # [ 18.021114] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14057lb # [ 18.023346] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4058lb # [ 18.025276] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4059lb # [ 18.027453] envoy[920]: [2026-09-20 13:34:18.746][920][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4060lb # [ 18.029475] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4061lb # [ 18.031570] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4062lb # [ 18.033573] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4063lb # [ 18.046160] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4064lb # [ 18.048776] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4065lb # [ 18.050729] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4066lb # [ 18.052300] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4067lb # [ 18.054915] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4068lb # [ 18.057595] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4069lb # [ 18.062477] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4070lb # [ 18.065409] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4071lb # [ 18.067527] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4072lb # [ 18.069441] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4073lb # [ 18.074548] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4074lb # [ 18.101631] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4075lb # [ 18.104645] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4076lb # [ 18.107879] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4077lb # [ 18.111347] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4078lb # [ 18.113946] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4079lb # [ 18.116853] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4080lb # [ 18.119165] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4081lb # [ 18.121234] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4082lb # [ 18.123202] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4083lb # [ 18.126155] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4084lb # [ 18.132937] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4085lb # [ 18.135577] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4086lb # [ 18.137824] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4087lb # [ 18.140446] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4088lb # [ 18.144500] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4089lb # [ 18.146203] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4090lb # [ 18.148231] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4091lb # [ 18.150261] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4092lb # [ 18.152973] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4093lb # [ 18.154813] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24094lb # [ 18.156687] envoy[920]: [2026-09-20 13:34:18.752][920][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4095lb # [ 18.160082] envoy[920]: [2026-09-20 13:34:18.872][920][info][main] [source/server/server.cc:531] HTTP header map info:4096lb # [ 18.161468] envoy[920]: [2026-09-20 13:34:18.919][920][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4097lb # [ 18.175261] envoy[920]: [2026-09-20 13:34:18.919][920][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4098lb # [ 18.176783] envoy[920]: [2026-09-20 13:34:18.919][920][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4099lb # [ 18.184725] envoy[920]: [2026-09-20 13:34:18.919][920][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4100lb # [ 18.221799] envoy[920]: [2026-09-20 13:34:19.113][920][info][main] [source/server/server.cc:968] runtime: {}4101lb # [ 18.228764] envoy[920]: [2026-09-20 13:34:19.120][920][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4102lb # [ 18.230875] envoy[920]: [2026-09-20 13:34:19.123][920][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014103lb # [ 18.233781] envoy[920]: [2026-09-20 13:34:19.126][920][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014104lb # [ 18.236967] envoy[920]: [2026-09-20 13:34:19.129][920][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4105lb # [ 18.238642] envoy[920]: [2026-09-20 13:34:19.130][920][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4106lb # [ 18.240320] envoy[920]: [2026-09-20 13:34:19.130][920][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4107lb # [ 18.290304] envoy[920]: [2026-09-20 13:34:19.182][920][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4108worker1 # [ 18.300813] systemd[1]: Starting Nix worker-protocol over gRPC...4109worker2 # [ 18.312756] systemd[1]: Reached target Network is Online.4110worker2 # [ 18.321946] systemd[1]: Starting scheduler-token.service...4111lb # [ 18.313584] envoy[920]: [2026-09-20 13:34:19.205][920][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4112lb # [ 18.316073] envoy[920]: [2026-09-20 13:34:19.208][920][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4113lb # [ 18.319099] envoy[920]: [2026-09-20 13:34:19.208][920][info][main] [source/server/server.cc:1077] starting main dispatch loop4114worker2 # [ 18.413108] systemd[1]: scheduler-token.service: Deactivated successfully.4115worker2 # [ 18.415185] systemd[1]: Finished scheduler-token.service.4116worker2 # [ 18.415961] systemd[1]: scheduler-token.service: Consumed 26ms CPU time over 92ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4117worker2 # [ 18.421195] systemd[1]: Starting Nix worker-protocol over gRPC...4118worker1 # [ 18.496631] nix-grpc-daemon[786]: ts=2026-09-20T13:34:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4119worker1 # [ 18.505754] nix-grpc-daemon[786]: ts=2026-09-20T13:34:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4120worker1 # [ 18.510755] nix-grpc-daemon[786]: ts=2026-09-20T13:34:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14121worker1 # [ 18.553899] nix-grpc-daemon[786]: ts=2026-09-20T13:34:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4122worker1 # [ 18.556778] systemd[1]: Started Nix worker-protocol over gRPC.4123worker2 # [ 18.597210] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4124worker2 # [ 18.606596] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4125worker2 # [ 18.613370] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14126worker1 # [ 18.603074] nix-grpc-daemon[786]: ts=2026-09-20T13:34:19Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4127lb # [ 18.599746] envoy[920]: [2026-09-20 13:34:19.491][920][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4128lb # [ 18.604162] envoy[920]: [2026-09-20 13:34:19.496][920][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4129lb # [ 18.608824] envoy[920]: [2026-09-20 13:34:19.496][920][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4130lb # [ 18.613250] envoy[920]: [2026-09-20 13:34:19.500][920][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4131worker2 # [ 18.654362] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4132worker2 # [ 18.657777] systemd[1]: Started Nix worker-protocol over gRPC.4133worker2 # [ 18.709741] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 18.722655] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4135worker1 # [ 18.804079] nix-grpc-daemon[786]: ts=2026-09-20T13:34:19Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4136worker2 # [ 18.925481] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 18.929338] nix-grpc-daemon[787]: ts=2026-09-20T13:34:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4138worker2 # [ 19.130483] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_connected addr=lb:500514139worker2 # [ 19.134288] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4140worker1 # [ 19.204453] nix-grpc-daemon[786]: ts=2026-09-20T13:34:20Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4141worker2 # [ 19.335804] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_connected addr=lb:500514142worker2 # [ 19.339815] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4143worker2 # [ 19.540370] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_connected addr=lb:500514144worker2 # [ 19.542085] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4145worker2 # [ 19.742928] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_connected addr=lb:500514146worker2 # [ 19.744525] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4147worker2 # [ 19.945478] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_connected addr=lb:500514148worker2 # [ 19.948749] nix-grpc-daemon[787]: ts=2026-09-20T13:34:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4149worker1 # [ 20.007110] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514150worker1 # [ 20.009315] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4151worker2 # [ 20.150312] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514152worker2 # [ 20.154299] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4153worker1 # [ 20.210550] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514154worker1 # [ 20.214504] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4155worker2 # [ 20.355704] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514156worker2 # [ 20.359586] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4157worker1 # [ 20.416426] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514158worker1 # [ 20.420143] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4159worker2 # [ 20.560941] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514160worker2 # [ 20.564845] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4161worker1 # [ 20.620850] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514162worker1 # [ 20.624798] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4163worker2 # [ 20.766883] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514164worker2 # [ 20.769967] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4165worker1 # [ 20.825842] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514166worker1 # [ 20.829619] nix-grpc-daemon[786]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4167worker2 # [ 20.967929] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_connected addr=lb:500514168worker2 # [ 20.971804] nix-grpc-daemon[787]: ts=2026-09-20T13:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4169worker1 # [ 21.031733] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514170worker1 # [ 21.034893] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4171worker2 # [ 21.172423] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514172worker2 # [ 21.174414] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4173worker1 # [ 21.232623] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514174worker1 # [ 21.236509] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4175worker2 # [ 21.375751] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514176worker2 # [ 21.379618] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4177worker1 # [ 21.437480] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514178worker1 # [ 21.441397] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4179worker2 # [ 21.580803] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514180worker2 # [ 21.584716] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4181worker1 # [ 21.642148] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 21.646277] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4183worker2 # [ 21.786929] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514184worker2 # [ 21.790120] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4185worker1 # [ 21.847135] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514186worker1 # [ 21.850936] nix-grpc-daemon[786]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4187worker2 # [ 21.987426] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_connected addr=lb:500514188worker2 # [ 21.991683] nix-grpc-daemon[787]: ts=2026-09-20T13:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4189worker1 # [ 22.052622] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 22.056221] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4191worker2 # [ 22.193092] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514192worker2 # [ 22.197111] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4193worker1 # [ 22.256944] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 22.260854] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4195worker2 # [ 22.398854] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514196worker2 # [ 22.403209] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4197worker1 # [ 22.461807] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514198worker1 # [ 22.465663] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4199worker2 # [ 22.604415] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514200worker2 # [ 22.608494] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4201worker1 # [ 22.666471] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 22.670466] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4203worker2 # [ 22.811758] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514204worker2 # [ 22.815274] nix-grpc-daemon[787]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4205worker1 # [ 22.870891] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 22.872644] nix-grpc-daemon[786]: ts=2026-09-20T13:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4207worker2 # [ 23.012834] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514208worker2 # [ 23.016458] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4209worker1 # [ 23.073607] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514210worker1 # [ 23.075357] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4211worker2 # [ 23.217494] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514212worker2 # [ 23.220920] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4213worker1 # [ 23.276023] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 23.277836] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4215worker2 # [ 23.421727] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514216worker2 # [ 23.423606] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4217worker1 # [ 23.478381] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514218worker1 # [ 23.480163] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4219worker2 # [ 23.625466] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514220worker2 # [ 23.629655] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4221worker1 # [ 23.680652] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514222worker1 # [ 23.682369] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4223worker2 # [ 23.832721] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514224worker2 # [ 23.835901] nix-grpc-daemon[787]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4225worker1 # [ 23.883372] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 23.887260] nix-grpc-daemon[786]: ts=2026-09-20T13:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4227worker2 # [ 24.034200] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514228worker2 # [ 24.038515] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4229worker1 # [ 24.089510] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 24.092699] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4231worker2 # [ 24.240317] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514232worker2 # [ 24.244415] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4233worker1 # [ 24.290521] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 24.294337] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4235worker2 # [ 24.445822] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514236worker2 # [ 24.450136] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4237worker1 # [ 24.495144] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514238worker1 # [ 24.499190] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4239worker2 # [ 24.651437] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514240worker2 # [ 24.655947] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4241worker1 # [ 24.699906] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 24.703924] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4243worker2 # [ 24.859123] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514244worker2 # [ 24.862378] nix-grpc-daemon[787]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4245worker1 # [ 24.904744] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 24.908711] nix-grpc-daemon[786]: ts=2026-09-20T13:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4247worker2 # [ 25.060425] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514248worker2 # [ 25.064620] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4249worker1 # [ 25.109541] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 25.111328] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4251worker2 # [ 25.265996] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514252worker2 # [ 25.270204] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4253worker1 # [ 25.312313] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514254worker1 # [ 25.316142] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4255worker2 # [ 25.471855] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514256worker2 # [ 25.476184] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4257worker1 # [ 25.516528] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 25.518295] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4259worker2 # [ 25.676893] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514260worker2 # [ 25.678722] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4261worker1 # [ 25.718889] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514262worker1 # [ 25.720746] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4263worker2 # [ 25.881617] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514264worker2 # [ 25.884746] nix-grpc-daemon[787]: ts=2026-09-20T13:34:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4265worker1 # [ 25.921267] nix-grpc-daemon[786]: ts=2026-09-20T13:34:26Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 25.923029] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4267worker2 # [ 26.083115] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514268worker2 # [ 26.084978] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4269worker1 # [ 26.124208] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 26.126195] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4271lb # [ 26.221831] rustfs-bucket-start[1011]: mb s3://farm4272lb # [ 26.226739] systemd[1]: Finished rustfs-bucket.service.4273lb # [ 26.232522] systemd[1]: Starting niks3 server...4274worker2 # [ 26.286047] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514275worker2 # [ 26.288290] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4276worker1 # [ 26.326639] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514277worker1 # [ 26.328471] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4278lb # [ 26.459378] postgres[1031]: [1031] ERROR: relation "goose_db_version" does not exist at character 364279lb # [ 26.460567] postgres[1031]: [1031] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4280worker2 # [ 26.489953] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514281worker2 # [ 26.494158] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4282lb # [ 26.501659] niks3-server[1021]: 2026/09/20 13:34:27 OK 20241026095416_initial_model.sql (21.31ms)4283lb # [ 26.506049] niks3-server[1021]: 2026/09/20 13:34:27 OK 20251210153512_drop_unused_gin_index.sql (2.43ms)4284lb # [ 26.511611] niks3-server[1021]: 2026/09/20 13:34:27 OK 20251218171726_add_pins.sql (5.07ms)4285lb # [ 26.516580] niks3-server[1021]: 2026/09/20 13:34:27 OK 20260628120000_add_object_size_and_stats.sql (5.46ms)4286lb # [ 26.521021] niks3-server[1021]: 2026/09/20 13:34:27 OK 20260905000000_add_claims.sql (2.96ms)4287worker1 # [ 26.529174] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514288worker1 # [ 26.530984] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4289lb # [ 26.526164] niks3-server[1021]: 2026/09/20 13:34:27 OK 20260920000000_drop_claims.sql (5.04ms)4290lb # [ 26.527350] niks3-server[1021]: 2026/09/20 13:34:27 goose: successfully migrated database to version: 202609200000004291lb # [ 26.533414] niks3-server[1021]: 2026/09/20 13:34:27 OK 1_commit_pending_closure.sql (7.3ms)4292lb # [ 26.536203] niks3-server[1021]: 2026/09/20 13:34:27 OK 2_object_stats_trigger.sql (1.47ms)4293lb # [ 26.537478] niks3-server[1021]: 2026/09/20 13:34:27 goose: up to current file version: 24294lb # [ 26.544500] niks3-server[1021]: 2026/09/20 13:34:27 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4295lb # [ 26.623465] niks3-server[1021]: 2026/09/20 13:34:27 INFO Read proxy enabled — serving cache objects from S34296lb # [ 26.625552] niks3-server[1021]: 2026/09/20 13:34:27 INFO Using socket-activated listener address=0.0.0.0:57514297lb # [ 26.630386] niks3-server[1021]: 2026/09/20 13:34:27 INFO systemd watchdog enabled interval=15s4298lb # [ 26.631641] systemd[1]: Started niks3 server.4299lb # [ 26.632308] systemd[1]: Reached target Multi-User System.4300lb # [ 26.634816] systemd[1]: Startup finished in 857ms (kernel) + 4.043s (initrd) + 21.732s (userspace) = 26.634s.4301lb # [ 26.638245] niks3-server[1021]: 2026/09/20 13:34:27 INFO Starting HTTP server address=0.0.0.0:57514302lb # [ 26.643325] niks3-server[1021]: 2026/09/20 13:34:27 INFO lead: acquired remote=192.168.1.4:495004303worker2 # [ 26.668800] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_take_over4304worker2 # [ 26.694812] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514305worker2 # [ 26.698543] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4306worker1 # [ 26.731982] nix-grpc-daemon[786]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514307worker2 # [ 26.755109] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:537244308worker2 # [ 26.760518] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04309worker2 # [ 26.899649] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=scheduler_connected addr=lb:500514310worker2 # [ 26.924205] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=oidc_jwks provider=mock keys=14311worker2 # [ 26.926293] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:537244312worker2 # [ 26.927982] nix-grpc-daemon[787]: ts=2026-09-20T13:34:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04313lb: (finished: waiting for unit niks3.service, in 16.32 seconds)4314lb: waiting for TCP port 5751 on localhost4315lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4316lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4317lb: waiting for unit envoy.service4318lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4319lb: waiting for TCP port 50051 on localhost4320lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4321lb # [ 27.638505] envoy[920]: conn peer=[::1]:55062 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34322lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4323worker2 # [ 27.772234] systemd[1]: Starting scheduler-token.service...4324worker2 # [ 27.842930] systemd[1]: scheduler-token.service: Deactivated successfully.4325worker2 # [ 27.844599] systemd[1]: Finished scheduler-token.service.4326worker2 # [ 27.846136] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 72ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4327lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4328??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4329 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284330lb: must succeed: curl -sf localhost:9901/clusters4331lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4332lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.10 seconds)4333subtest: one node schedules and both builders hold a WorkerSession on it4334lb: must succeed: curl -sf localhost:9901/clusters4335lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4336worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4337worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4338lb: must succeed: curl -sf localhost:9901/clusters4339lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4340lb: must succeed: curl -sf localhost:9901/clusters4341lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4342worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'4343worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.03 seconds)4344(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.20 seconds)4345subtest: balancer auth: client cert, bearer token, nothing, unknown CN4346worker1 # [ 28.448580] nix-grpc-daemon[786]: ts=2026-09-20T13:34:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483024347worker1 # [ 28.454958] systemd[1]: Started Nix Daemon.4348worker1 # [ 28.669370] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4349worker1 # [ 28.731401] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5)4350worker1 # [ 28.803286] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 2/5)4351worker1 # [ 28.827973] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 3/5)4352worker1 # [ 28.881884] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 463 ms (attempt 4/5)4353worker1 # [ 29.357397] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4354worker2 # [ 29.425879] nix-grpc-daemon[787]: ts=2026-09-20T13:34:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:537304355worker2 # [ 29.442584] systemd[1]: Started Nix Daemon.4356worker2 # [ 29.671164] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4357worker2 # [ 29.705951] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 1/5)4358worker2 # [ 29.733473] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 2/5)4359worker2 # [ 29.918327] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 218 ms (attempt 3/5)4360worker2 # [ 30.142528] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 4/5)4361worker2 # [ 30.200693] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4362worker2 # [ 30.216906] nix-grpc-daemon[787]: ts=2026-09-20T13:34:31Z level=debug event=path_info_miss path=d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test error="error: path '/nix/store/d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test' is required, but there is no substituter that can build it"4363worker1 # [ 30.218282] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:483024364worker1 # [ 30.231200] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=debug event=path_info_miss path=d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test error="error: path '/nix/store/d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test' is required, but there is no substituter that can build it"4365client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4366client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4367client: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4368client: (finished: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4369worker1 # [ 30.572692] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=info event=oidc_jwks provider=mock keys=14370worker1 # [ 30.575187] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:483024371worker1 # [ 30.584570] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:483024372worker1 # [ 30.589926] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=debug event=path_info_miss path=d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test error="error: path '/nix/store/d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test' is required, but there is no substituter that can build it"4373worker1 # [ 30.594028] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:483024374worker1 # [ 30.599347] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=debug event=path_info_miss path=d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test error="error: path '/nix/store/d5p6gygndnzhwrc9rvbcg4xfmn8nlb09-nixos-system-client-test' is required, but there is no substituter that can build it"4375client: must succeed: rm -r /var/lib/nix-grpc-store4376client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds)4377worker1 # [ 30.797123] nix-grpc-daemon[786]: ts=2026-09-20T13:34:31Z level=info event=denied method=QueryMissing cn=- role=none4378worker2 # [ 31.029874] nix-grpc-daemon[787]: ts=2026-09-20T13:34:32Z level=info event=denied method=QueryMissing cn=stranger role=none4379(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.90 seconds)4380subtest: DAG build is scheduled across workers and lands in the cache4381client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24382client # don't know how to build these paths:4383client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4384worker1 # [ 31.222648] nix-grpc-daemon[786]: ts=2026-09-20T13:34:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483024385worker2 # [ 31.242228] nix-grpc-daemon[787]: ts=2026-09-20T13:34:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537304386worker2 # [ 31.273145] nix-grpc-daemon[787]: ts=2026-09-20T13:34:32Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04387worker2 # [ 31.275047] nix-grpc-daemon[787]: ts=2026-09-20T13:34:32Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14388worker1 # [ 31.312780] nix-grpc-daemon[786]: ts=2026-09-20T13:34:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024389worker1 # [ 31.332852] nix-grpc-daemon[786]: ts=2026-09-20T13:34:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024390client # copying 1 paths to 'lb:50051'...4391worker1 # [ 31.344924] nix-grpc-daemon[786]: ts=2026-09-20T13:34:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483024392client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4393worker1 # [ 31.362309] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4394worker1 # [ 31.390845] nix-grpc-daemon[786]: ts=2026-09-20T13:34:32Z level=info event=niks3_push_started pid=8534395worker1 # [ 31.670518] nix-grpc-daemon[853]: time=2026-09-20T13:34:32.745Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""4396worker1 # [ 31.837152] nix-daemon[843]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4397worker1 # [ 31.851383] nix-daemon[843]: reaped child process 869, status = succeeded4398worker1 # [ 32.000927] nix-daemon[843]: accepted connection from pid 871, user nix-grpc-daemon (trusted)4399worker1 # [ 32.016140] nix-daemon[843]: reaped child process 874, status = succeeded4400lb # [ 32.020522] niks3-server[1021]: 2026/09/20 13:34:32 INFO Received uploads request method=POST path=/api/pending_closures4401worker1 # [ 32.062029] nix-grpc-daemon[853]: time=2026-09-20T13:34:33.139Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4402worker1 # [ 32.064147] nix-grpc-daemon[853]: time=2026-09-20T13:34:33.141Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4403lb # [ 32.101313] niks3-server[1021]: 2026/09/20 13:34:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4404lb # [ 32.107278] niks3-server[1021]: 2026/09/20 13:34:32 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4405lb # [ 32.128969] niks3-server[1021]: 2026/09/20 13:34:33 INFO Signed narinfos id=1 count=14406worker1 # [ 32.137659] nix-grpc-daemon[853]: time=2026-09-20T13:34:33.214Z level=INFO msg="Uploading 1 narinfos"4407lb # [ 32.139500] niks3-server[1021]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4408lb # [ 32.146662] niks3-server[1021]: 2026/09/20 13:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4409lb # [ 32.155587] niks3-server[1021]: 2026/09/20 13:34:33 INFO Completed upload id=14410worker1 # [ 32.162476] nix-grpc-daemon[853]: time=2026-09-20T13:34:33.239Z level=INFO msg="Upload complete. (478ms)"4411lb # [ 32.161409] niks3-server[1021]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4412worker1 # [ 32.166679] nix-grpc-daemon[786]: ts=2026-09-20T13:34:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=5044413worker1 # [ 32.172975] nix-grpc-daemon[786]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024414worker1 # [ 32.183603] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4415worker1 # [ 32.194127] nix-daemon[843]: reaped child process 851, status = succeeded4416client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4417client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4418worker1 # [ 32.205153] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4419worker1 # [ 33.621181] nix-daemon[843]: reaped child process 878, status = succeeded4420client # farm-a> LOG-farm-a-t14421worker1 # [ 33.760736] nix-daemon[843]: accepted connection from pid 894, user nix-grpc-daemon (trusted)4422worker1 # [ 33.773281] nix-daemon[843]: reaped child process 897, status = succeeded4423lb # [ 33.781388] niks3-server[1021]: 2026/09/20 13:34:34 INFO Received uploads request method=POST path=/api/pending_closures4424worker1 # [ 33.794427] nix-grpc-daemon[853]: time=2026-09-20T13:34:34.871Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4425worker1 # [ 33.795893] nix-grpc-daemon[853]: time=2026-09-20T13:34:34.873Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4426lb # [ 33.808269] niks3-server[1021]: 2026/09/20 13:34:34 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4427lb # [ 33.814955] niks3-server[1021]: 2026/09/20 13:34:34 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4428lb # [ 33.818677] niks3-server[1021]: 2026/09/20 13:34:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4429lb # [ 33.820779] niks3-server[1021]: 2026/09/20 13:34:34 INFO Signed narinfos id=2 count=14430worker1 # [ 33.828994] nix-grpc-daemon[853]: time=2026-09-20T13:34:34.905Z level=INFO msg="Uploading 1 narinfos"4431lb # [ 33.824637] niks3-server[1021]: 2026/09/20 13:34:34 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4432lb # [ 33.829628] niks3-server[1021]: 2026/09/20 13:34:34 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4433lb # [ 33.836114] niks3-server[1021]: 2026/09/20 13:34:34 INFO Completed upload id=24434worker1 # [ 33.842624] nix-grpc-daemon[853]: time=2026-09-20T13:34:34.919Z level=INFO msg="Upload complete. (227ms)"4435lb # [ 33.837347] niks3-server[1021]: 2026/09/20 13:34:34 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4436worker1 # [ 33.845965] nix-grpc-daemon[786]: ts=2026-09-20T13:34:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14437worker1 # [ 33.851894] nix-daemon[843]: reaped child process 876, status = succeeded4438worker2 # [ 33.878688] nix-grpc-daemon[787]: ts=2026-09-20T13:34:34Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04439worker2 # [ 33.882889] nix-grpc-daemon[787]: ts=2026-09-20T13:34:34Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14440worker1 # [ 33.917621] nix-grpc-daemon[786]: ts=2026-09-20T13:34:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024441worker1 # [ 33.930972] nix-grpc-daemon[786]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024442worker1 # [ 33.960885] nix-grpc-daemon[853]: time=2026-09-20T13:34:35.038Z level=INFO msg="All 1 paths already cached"4443client # copying 1 paths to 'lb:50051'...4444worker1 # [ 33.969766] nix-grpc-daemon[786]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483024445client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4446worker1 # [ 33.992188] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4447worker1 # [ 34.162667] nix-daemon[843]: accepted connection from pid 901, user nix-grpc-daemon (trusted)4448worker1 # [ 34.177091] nix-daemon[843]: reaped child process 904, status = succeeded4449worker1 # [ 34.329193] nix-daemon[843]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4450worker1 # [ 34.341200] nix-daemon[843]: reaped child process 909, status = succeeded4451lb # [ 34.349382] niks3-server[1021]: 2026/09/20 13:34:35 INFO Received uploads request method=POST path=/api/pending_closures4452worker1 # [ 34.367828] nix-grpc-daemon[853]: time=2026-09-20T13:34:35.445Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4453worker1 # [ 34.369472] nix-grpc-daemon[853]: time=2026-09-20T13:34:35.446Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4454lb # [ 34.373518] niks3-server[1021]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4455lb # [ 34.377921] niks3-server[1021]: 2026/09/20 13:34:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4456worker1 # [ 34.387483] nix-grpc-daemon[853]: time=2026-09-20T13:34:35.464Z level=INFO msg="Uploading 1 narinfos"4457lb # [ 34.380768] niks3-server[1021]: 2026/09/20 13:34:35 INFO Signed narinfos id=3 count=14458lb # [ 34.383073] niks3-server[1021]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4459lb # [ 34.387681] niks3-server[1021]: 2026/09/20 13:34:35 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4460lb # [ 34.391817] niks3-server[1021]: 2026/09/20 13:34:35 INFO Completed upload id=34461worker1 # [ 34.398242] nix-grpc-daemon[853]: time=2026-09-20T13:34:35.475Z level=INFO msg="Upload complete. (392ms)"4462lb # [ 34.393272] niks3-server[1021]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4463worker1 # [ 34.400142] nix-grpc-daemon[786]: ts=2026-09-20T13:34:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=6244464worker1 # [ 34.404291] nix-grpc-daemon[786]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024465worker1 # [ 34.409789] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4466worker1 # [ 34.411950] nix-daemon[843]: reaped child process 899, status = succeeded4467client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4468worker1 # [ 34.417926] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4469client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4470worker1 # [ 35.030169] nix-daemon[843]: reaped child process 913, status = succeeded4471client # farm-b> LOG-farm-b-t14472worker1 # [ 35.170244] nix-daemon[843]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4473worker1 # [ 35.181134] nix-daemon[843]: reaped child process 931, status = succeeded4474lb # [ 35.190620] niks3-server[1021]: 2026/09/20 13:34:36 INFO Received uploads request method=POST path=/api/pending_closures4475worker1 # [ 35.205878] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.282Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4476worker1 # [ 35.207374] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.284Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4477lb # [ 35.223671] niks3-server[1021]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4478lb # [ 35.238696] niks3-server[1021]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4479lb # [ 35.242794] niks3-server[1021]: 2026/09/20 13:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4480lb # [ 35.247117] niks3-server[1021]: 2026/09/20 13:34:36 INFO Signed narinfos id=4 count=14481worker1 # [ 35.256771] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.333Z level=INFO msg="Uploading 1 narinfos"4482lb # [ 35.259303] niks3-server[1021]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4483lb # [ 35.266544] niks3-server[1021]: 2026/09/20 13:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4484lb # [ 35.273313] niks3-server[1021]: 2026/09/20 13:34:36 INFO Completed upload id=44485worker1 # [ 35.280219] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.357Z level=INFO msg="Upload complete. (257ms)"4486lb # [ 35.275304] niks3-server[1021]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4487worker1 # [ 35.286614] nix-grpc-daemon[786]: ts=2026-09-20T13:34:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14488worker2 # [ 35.305636] nix-grpc-daemon[787]: ts=2026-09-20T13:34:36Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04489worker2 # [ 35.309739] nix-grpc-daemon[787]: ts=2026-09-20T13:34:36Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14490worker1 # [ 35.299891] nix-daemon[843]: reaped child process 911, status = succeeded4491worker1 # [ 35.336449] nix-grpc-daemon[786]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024492worker1 # [ 35.348115] nix-grpc-daemon[786]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024493worker1 # [ 35.361678] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.438Z level=INFO msg="All 2 paths already cached"4494client # copying 1 paths to 'lb:50051'...4495client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4496worker1 # [ 35.369978] nix-grpc-daemon[786]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483024497worker1 # [ 35.380275] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4498worker1 # [ 35.558222] nix-daemon[843]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4499worker1 # [ 35.570988] nix-daemon[843]: reaped child process 938, status = succeeded4500worker1 # [ 35.727884] nix-daemon[843]: accepted connection from pid 940, user nix-grpc-daemon (trusted)4501worker1 # [ 35.739561] nix-daemon[843]: reaped child process 943, status = succeeded4502lb # [ 35.750138] niks3-server[1021]: 2026/09/20 13:34:36 INFO Received uploads request method=POST path=/api/pending_closures4503worker1 # [ 35.768122] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.845Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4504worker1 # [ 35.770280] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.847Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4505lb # [ 35.787824] niks3-server[1021]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4506lb # [ 35.803277] niks3-server[1021]: 2026/09/20 13:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4507worker1 # [ 35.815467] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.892Z level=INFO msg="Uploading 1 narinfos"4508lb # [ 35.809106] niks3-server[1021]: 2026/09/20 13:34:36 INFO Signed narinfos id=5 count=14509lb # [ 35.817857] niks3-server[1021]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4510lb # [ 35.826841] niks3-server[1021]: 2026/09/20 13:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4511lb # [ 35.832553] niks3-server[1021]: 2026/09/20 13:34:36 INFO Completed upload id=54512worker1 # [ 35.839070] nix-grpc-daemon[853]: time=2026-09-20T13:34:36.916Z level=INFO msg="Upload complete. (446ms)"4513lb # [ 35.834053] niks3-server[1021]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4514worker1 # [ 35.841042] nix-grpc-daemon[786]: ts=2026-09-20T13:34:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=7524515worker1 # [ 35.845541] nix-grpc-daemon[786]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024516worker1 # [ 35.851088] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4517worker1 # [ 35.853281] nix-daemon[843]: reaped child process 933, status = succeeded4518client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4519client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4520worker1 # [ 35.858573] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4521client # farm-top> LOG-farm-top-t14522worker1 # [ 37.274912] nix-daemon[843]: reaped child process 948, status = succeeded4523worker1 # [ 37.396084] nix-daemon[843]: accepted connection from pid 963, user nix-grpc-daemon (trusted)4524worker1 # [ 37.408181] nix-daemon[843]: reaped child process 966, status = succeeded4525lb # [ 37.414687] niks3-server[1021]: 2026/09/20 13:34:38 INFO Received uploads request method=POST path=/api/pending_closures4526worker1 # [ 37.431293] nix-grpc-daemon[853]: time=2026-09-20T13:34:38.507Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4527worker1 # [ 37.432654] nix-grpc-daemon[853]: time=2026-09-20T13:34:38.507Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4528lb # [ 37.452823] niks3-server[1021]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4529lb # [ 37.465249] niks3-server[1021]: 2026/09/20 13:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4530lb # [ 37.470917] niks3-server[1021]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4531lb # [ 37.478276] niks3-server[1021]: 2026/09/20 13:34:38 INFO Signed narinfos id=6 count=14532worker1 # [ 37.487297] nix-grpc-daemon[853]: time=2026-09-20T13:34:38.564Z level=INFO msg="Uploading 1 narinfos"4533lb # [ 37.483307] niks3-server[1021]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4534lb # [ 37.494112] niks3-server[1021]: 2026/09/20 13:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4535lb # [ 37.499803] niks3-server[1021]: 2026/09/20 13:34:38 INFO Completed upload id=64536worker1 # [ 37.506205] nix-grpc-daemon[853]: time=2026-09-20T13:34:38.583Z level=INFO msg="Upload complete. (240ms)"4537lb # [ 37.500979] niks3-server[1021]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4538worker1 # [ 37.508837] nix-grpc-daemon[786]: ts=2026-09-20T13:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14539worker1 # [ 37.515442] nix-daemon[843]: reaped child process 946, status = succeeded4540client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.50 seconds)4541client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4542client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds)4543client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4544client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4545client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4546client # copying 3 paths...4547client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4548client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4549client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4550client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4551(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.05 seconds)4552subtest: repeat is answered Cached by the scheduler without building4553worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4554worker1 # finding garbage collector roots...4555lb # [ 38.300375] envoy[920]: conn peer=[2001:db8:1::1]:32884 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=383 ms=18364556lb # [ 38.304206] envoy[920]: conn peer=[2001:db8:1::1]:32890 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=454557lb # [ 38.307638] envoy[920]: conn peer=[2001:db8:1::1]:32894 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=144558lb # [ 38.310880] envoy[920]: conn peer=[2001:db8:1::1]:32896 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=134559lb # [ 38.314380] envoy[920]: conn peer=[2001:db8:1::1]:32900 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=3814 ms=63284560worker1 # deleting specified paths...4561worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4562worker1 # deleting unused links...4563worker1 # note: hard linking is currently saving 0.0 KiB4564worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4565worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4566worker2 # finding garbage collector roots...4567worker2 # deleting specified paths...4568worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4569worker2 # deleting unused links...4570worker2 # note: hard linking is currently saving 0.0 KiB4571worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.30 seconds)4572client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24573worker2 # [ 38.900941] nix-grpc-daemon[787]: ts=2026-09-20T13:34:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:537304574client # don't know how to build these paths:4575client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4576worker1 # [ 38.902576] nix-grpc-daemon[786]: ts=2026-09-20T13:34:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024577worker1 # [ 38.914803] nix-grpc-daemon[853]: time=2026-09-20T13:34:39.991Z level=INFO msg="All 2 paths already cached"4578worker2 # [ 38.941910] nix-grpc-daemon[787]: ts=2026-09-20T13:34:39Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14579client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.30 seconds)4580client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4581client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds)4582lb: must succeed: curl -sf localhost:9901/clusters4583lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4584lb: must succeed: curl -sf localhost:9901/clusters4585lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4586worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4587worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4588(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.31 seconds)4589subtest: inputs already in the cache are not sent to the scheduler4590lb: must succeed: curl -sf localhost:9901/clusters4591lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4592lb: must succeed: curl -sf localhost:9901/clusters4593lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4594worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4595worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4596client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24597worker2 # [ 39.766450] nix-grpc-daemon[787]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:537304598client # don't know how to build these paths:4599client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4600worker2 # [ 39.774478] nix-grpc-daemon[787]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537304601worker2 # [ 39.792800] nix-grpc-daemon[787]: ts=2026-09-20T13:34:40Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04602worker2 # [ 39.796817] nix-grpc-daemon[787]: ts=2026-09-20T13:34:40Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14603worker1 # [ 39.824344] nix-grpc-daemon[786]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024604worker1 # [ 39.836897] nix-grpc-daemon[786]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024605worker1 # [ 39.850910] nix-grpc-daemon[853]: time=2026-09-20T13:34:40.928Z level=INFO msg="All 2 paths already cached"4606client # copying 1 paths to 'lb:50051'...4607client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4608worker1 # [ 39.858905] nix-grpc-daemon[786]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483024609worker1 # [ 39.870091] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4610worker1 # [ 40.031229] nix-daemon[843]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4611worker1 # [ 40.047179] nix-daemon[843]: reaped child process 987, status = succeeded4612worker1 # [ 40.183237] nix-daemon[843]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4613worker1 # [ 40.196855] nix-daemon[843]: reaped child process 992, status = succeeded4614lb # [ 40.206813] niks3-server[1021]: 2026/09/20 13:34:41 INFO Received uploads request method=POST path=/api/pending_closures4615worker1 # [ 40.221939] nix-grpc-daemon[853]: time=2026-09-20T13:34:41.298Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4616worker1 # [ 40.223493] nix-grpc-daemon[853]: time=2026-09-20T13:34:41.300Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4617lb # [ 40.234152] niks3-server[1021]: 2026/09/20 13:34:41 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4618lb # [ 40.246171] niks3-server[1021]: 2026/09/20 13:34:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4619worker1 # [ 40.257261] nix-grpc-daemon[853]: time=2026-09-20T13:34:41.334Z level=INFO msg="Uploading 1 narinfos"4620lb # [ 40.250885] niks3-server[1021]: 2026/09/20 13:34:41 INFO Signed narinfos id=7 count=14621lb # [ 40.256315] niks3-server[1021]: 2026/09/20 13:34:41 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4622lb # [ 40.268316] niks3-server[1021]: 2026/09/20 13:34:41 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4623worker1 # [ 40.281569] nix-grpc-daemon[853]: time=2026-09-20T13:34:41.358Z level=INFO msg="Upload complete. (400ms)"4624lb # [ 40.275250] niks3-server[1021]: 2026/09/20 13:34:41 INFO Completed upload id=74625lb # [ 40.278738] niks3-server[1021]: 2026/09/20 13:34:41 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4626worker1 # [ 40.284853] nix-grpc-daemon[786]: ts=2026-09-20T13:34:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=7524627worker1 # [ 40.290281] nix-grpc-daemon[786]: ts=2026-09-20T13:34:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024628worker1 # [ 40.299302] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4629worker1 # [ 40.307134] nix-daemon[843]: reaped child process 982, status = succeeded4630worker1 # [ 40.310847] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4631client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4632client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4633worker1 # [ 41.325675] nix-daemon[843]: reaped child process 996, status = succeeded4634client # farm-top> LOG-farm-top-t1b4635worker1 # [ 41.453738] nix-daemon[843]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4636worker1 # [ 41.466143] nix-daemon[843]: reaped child process 1014, status = succeeded4637lb # [ 41.473683] niks3-server[1021]: 2026/09/20 13:34:42 INFO Received uploads request method=POST path=/api/pending_closures4638worker1 # [ 41.486966] nix-grpc-daemon[853]: time=2026-09-20T13:34:42.563Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4639worker1 # [ 41.488527] nix-grpc-daemon[853]: time=2026-09-20T13:34:42.565Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4640lb # [ 41.510872] niks3-server[1021]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4641lb # [ 41.519807] niks3-server[1021]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4642lb # [ 41.529362] niks3-server[1021]: 2026/09/20 13:34:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4643lb # [ 41.534354] niks3-server[1021]: 2026/09/20 13:34:42 INFO Signed narinfos id=8 count=14644worker1 # [ 41.543717] nix-grpc-daemon[853]: time=2026-09-20T13:34:42.621Z level=INFO msg="Uploading 1 narinfos"4645lb # [ 41.539692] niks3-server[1021]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4646lb # [ 41.550149] niks3-server[1021]: 2026/09/20 13:34:42 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4647lb # [ 41.555554] niks3-server[1021]: 2026/09/20 13:34:42 INFO Completed upload id=84648worker1 # [ 41.562575] nix-grpc-daemon[853]: time=2026-09-20T13:34:42.639Z level=INFO msg="Upload complete. (244ms)"4649lb # [ 41.560024] niks3-server[1021]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4650worker1 # [ 41.567828] nix-grpc-daemon[786]: ts=2026-09-20T13:34:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14651worker1 # [ 41.580439] nix-daemon[843]: reaped child process 994, status = succeeded4652client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.06 seconds)4653client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4654client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.17 seconds)4655lb: must succeed: curl -sf localhost:9901/clusters4656lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4657lb: must succeed: curl -sf localhost:9901/clusters4658lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4659worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4660worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds)4661(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.53 seconds)4662subtest: two clients wanting the same drv build it once4663client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4664client # [ 41.952060] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4665client # Running as unit: dedup1.service; invocation ID: ab1a24dd33224bebb921a552f7b4d6b44666client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4667client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4668worker1 # [ 42.195792] nix-grpc-daemon[786]: ts=2026-09-20T13:34:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483024669client # [ 42.170610] nix[889]: don't know how to build these paths:4670client # [ 42.171522] nix[889]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4671worker2 # [ 42.224806] nix-grpc-daemon[787]: ts=2026-09-20T13:34:43Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04672worker2 # [ 42.229848] nix-grpc-daemon[787]: ts=2026-09-20T13:34:43Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14673worker2 # [ 42.235484] nix-grpc-daemon[787]: ts=2026-09-20T13:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537304674worker2 # [ 42.247642] nix-grpc-daemon[787]: ts=2026-09-20T13:34:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537304675client # [ 42.216139] nix[889]: copying 1 paths to 'lb:50051'...4676client # [ 42.216980] nix[889]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4677worker2 # [ 42.259746] nix-grpc-daemon[787]: ts=2026-09-20T13:34:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537304678worker2 # [ 42.271164] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4679worker2 # [ 42.292559] nix-grpc-daemon[787]: ts=2026-09-20T13:34:43Z level=info event=niks3_push_started pid=9064680worker2 # [ 42.565155] nix-grpc-daemon[906]: time=2026-09-20T13:34:43.550Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""4681worker2 # [ 42.766899] nix-daemon[855]: accepted connection from pid 920, user nix-grpc-daemon (trusted)4682worker2 # [ 42.781780] nix-daemon[855]: reaped child process 923, status = succeeded4683worker2 # [ 42.948887] nix-daemon[855]: accepted connection from pid 925, user nix-grpc-daemon (trusted)4684worker2 # [ 42.960972] nix-daemon[855]: reaped child process 928, status = succeeded4685lb # [ 42.959304] niks3-server[1021]: 2026/09/20 13:34:43 INFO Received uploads request method=POST path=/api/pending_closures4686worker2 # [ 42.988511] nix-grpc-daemon[906]: time=2026-09-20T13:34:43.977Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4687worker2 # [ 42.991102] nix-grpc-daemon[906]: time=2026-09-20T13:34:43.980Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4688lb # [ 42.996615] niks3-server[1021]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4689lb # [ 43.008169] niks3-server[1021]: 2026/09/20 13:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4690lb # [ 43.013756] niks3-server[1021]: 2026/09/20 13:34:43 INFO Signed narinfos id=9 count=14691worker2 # [ 43.035738] nix-grpc-daemon[906]: time=2026-09-20T13:34:44.024Z level=INFO msg="Uploading 1 narinfos"4692lb # [ 43.024817] niks3-server[1021]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4693lb # [ 43.033884] niks3-server[1021]: 2026/09/20 13:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4694lb # [ 43.039993] niks3-server[1021]: 2026/09/20 13:34:43 INFO Completed upload id=94695worker2 # [ 43.059570] nix-grpc-daemon[906]: time=2026-09-20T13:34:44.048Z level=INFO msg="Upload complete. (475ms)"4696worker2 # [ 43.061618] nix-grpc-daemon[787]: ts=2026-09-20T13:34:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=0 paths=1 nar_bytes_in=4324697lb # [ 43.044480] niks3-server[1021]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4698worker2 # [ 43.070709] nix-daemon[855]: reaped child process 904, status = succeeded4699worker2 # [ 43.072504] nix-grpc-daemon[787]: ts=2026-09-20T13:34:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537304700worker2 # [ 43.077760] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4701worker2 # [ 43.083781] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4702client # [ 43.040607] nix[889]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4703client # [ 43.046976] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4704client # Running as unit: dedup2.service; invocation ID: fab3b4d1edf64940a0f1004eea6ecf824705client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.10 seconds)4706client # [ 43.328504] nix[906]: don't know how to build these paths:4707client # [ 43.329938] nix[906]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4708worker1 # [ 43.358126] nix-grpc-daemon[786]: ts=2026-09-20T13:34:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483024709worker2 # [ 43.381464] nix-grpc-daemon[787]: ts=2026-09-20T13:34:44Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04710worker2 # [ 43.386953] nix-grpc-daemon[787]: ts=2026-09-20T13:34:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537304711client # [ 43.348892] nix[906]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4712client: must succeed: sleep 24713client: (finished: must succeed: sleep 2, in 2.05 seconds)4714??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4715 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394716client: waiting for success: ! systemctl is-active dedup1 dedup24717??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4718 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394719worker2 # [ 46.711897] nix-daemon[855]: reaped child process 932, status = succeeded4720worker2 # [ 46.883381] nix-daemon[855]: accepted connection from pid 963, user nix-grpc-daemon (trusted)4721worker2 # [ 46.895083] nix-daemon[855]: reaped child process 966, status = succeeded4722lb # [ 46.895313] niks3-server[1021]: 2026/09/20 13:34:47 INFO Received uploads request method=POST path=/api/pending_closures4723worker2 # [ 46.924568] nix-grpc-daemon[906]: time=2026-09-20T13:34:47.913Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4724worker2 # [ 46.926090] nix-grpc-daemon[906]: time=2026-09-20T13:34:47.915Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4725lb # [ 46.933155] niks3-server[1021]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4726lb # [ 46.945667] niks3-server[1021]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4727lb # [ 46.957805] niks3-server[1021]: 2026/09/20 13:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4728worker2 # [ 46.982832] nix-grpc-daemon[906]: time=2026-09-20T13:34:47.971Z level=INFO msg="Uploading 1 narinfos"4729lb # [ 46.963136] niks3-server[1021]: 2026/09/20 13:34:47 INFO Signed narinfos id=10 count=14730lb # [ 46.968203] niks3-server[1021]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4731lb # [ 46.976587] niks3-server[1021]: 2026/09/20 13:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4732lb # [ 46.982531] niks3-server[1021]: 2026/09/20 13:34:47 INFO Completed upload id=104733worker2 # [ 47.001756] nix-grpc-daemon[906]: time=2026-09-20T13:34:47.990Z level=INFO msg="Upload complete. (306ms)"4734lb # [ 46.984682] niks3-server[1021]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4735worker2 # [ 47.010210] nix-grpc-daemon[787]: ts=2026-09-20T13:34:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14736worker2 # [ 47.016775] nix-grpc-daemon[787]: ts=2026-09-20T13:34:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14737worker2 # [ 47.027342] nix-daemon[855]: reaped child process 930, status = succeeded4738client # [ 47.008980] systemd[1]: dedup1.service: Deactivated successfully.4739client # [ 47.013660] systemd[1]: dedup1.service: Consumed 118ms CPU time over 5.058s wall clock time, 39.4M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4740client # [ 47.050250] systemd[1]: dedup2.service: Deactivated successfully.4741client # [ 47.051284] systemd[1]: dedup2.service: Consumed 142ms CPU time over 4.003s wall clock time, 33.2M memory peak, 7.6K incoming IP traffic, 6.3K outgoing IP traffic.4742client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4743client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4744client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4745worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4746worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4747worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4748worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4749worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4750worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4751worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4752worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4753(finished: subtest: two clients wanting the same drv build it once, in 6.02 seconds)4754subtest: build hook: nix-daemon with builders = grpc://lb4755client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4756client # [ 48.122341] systemd[1]: Started Nix Daemon.4757client # [ 48.275904] nix-daemon[948]: accepted connection from pid 945, user root (trusted)4758lb # [ 48.300519] envoy[920]: conn peer=[2001:db8:1::1]:50086 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=481 ms=594759lb # [ 48.304670] envoy[920]: conn peer=[2001:db8:1::1]:50102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4152 tx=1684 ms=18214760lb # [ 48.308453] envoy[920]: conn peer=[2001:db8:1::1]:50108 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1373 ms=48194761lb # [ 48.312262] envoy[920]: conn peer=[2001:db8:1::1]:54628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=37114762worker1 # [ 48.480442] nix-grpc-daemon[786]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:483024763worker1 # [ 48.485876] nix-grpc-daemon[786]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024764worker2 # [ 48.508810] nix-grpc-daemon[787]: ts=2026-09-20T13:34:49Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04765worker2 # [ 48.513709] nix-grpc-daemon[787]: ts=2026-09-20T13:34:49Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14766worker1 # [ 48.544334] nix-grpc-daemon[786]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024767worker1 # [ 48.557565] nix-grpc-daemon[786]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024768worker1 # [ 48.570983] nix-grpc-daemon[786]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483024769worker1 # [ 48.582543] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4770worker1 # [ 48.781576] nix-daemon[843]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4771worker1 # [ 48.796487] nix-daemon[843]: reaped child process 1043, status = succeeded4772worker1 # [ 48.954438] nix-daemon[843]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)4773worker1 # [ 48.968698] nix-daemon[843]: reaped child process 1048, status = succeeded4774lb # [ 48.978846] niks3-server[1021]: 2026/09/20 13:34:49 INFO Received uploads request method=POST path=/api/pending_closures4775worker1 # [ 48.993757] nix-grpc-daemon[853]: time=2026-09-20T13:34:50.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4776worker1 # [ 48.995189] nix-grpc-daemon[853]: time=2026-09-20T13:34:50.070Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4777lb # [ 49.008514] niks3-server[1021]: 2026/09/20 13:34:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4778lb # [ 49.015419] niks3-server[1021]: 2026/09/20 13:34:49 INFO Signed narinfos id=11 count=14779worker1 # [ 49.025202] nix-grpc-daemon[853]: time=2026-09-20T13:34:50.102Z level=INFO msg="Uploading 1 narinfos"4780lb # [ 49.023608] niks3-server[1021]: 2026/09/20 13:34:49 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4781lb # [ 49.034253] niks3-server[1021]: 2026/09/20 13:34:49 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4782lb # [ 49.041280] niks3-server[1021]: 2026/09/20 13:34:49 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4783lb # [ 49.047942] niks3-server[1021]: 2026/09/20 13:34:49 INFO Completed upload id=114784worker1 # [ 49.054386] nix-grpc-daemon[853]: time=2026-09-20T13:34:50.131Z level=INFO msg="Upload complete. (456ms)"4785lb # [ 49.051615] niks3-server[1021]: 2026/09/20 13:34:49 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4786worker1 # [ 49.058181] nix-grpc-daemon[786]: ts=2026-09-20T13:34:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=5124787worker1 # [ 49.064305] nix-grpc-daemon[786]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024788worker1 # [ 49.071988] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4789worker1 # [ 49.080250] nix-daemon[843]: reaped child process 1038, status = succeeded4790worker1 # [ 49.083453] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4791worker1 # [ 50.513920] nix-daemon[843]: reaped child process 1052, status = succeeded4792worker1 # [ 50.660329] nix-daemon[843]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4793worker1 # [ 50.676956] nix-daemon[843]: reaped child process 1070, status = succeeded4794lb # [ 50.685426] niks3-server[1021]: 2026/09/20 13:34:51 INFO Received uploads request method=POST path=/api/pending_closures4795worker1 # [ 50.700930] nix-grpc-daemon[853]: time=2026-09-20T13:34:51.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4796worker1 # [ 50.706262] nix-grpc-daemon[853]: time=2026-09-20T13:34:51.779Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4797lb # [ 50.723130] niks3-server[1021]: 2026/09/20 13:34:51 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4798lb # [ 50.736580] niks3-server[1021]: 2026/09/20 13:34:51 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4799lb # [ 50.745583] niks3-server[1021]: 2026/09/20 13:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4800worker1 # [ 50.758753] nix-grpc-daemon[853]: time=2026-09-20T13:34:51.835Z level=INFO msg="Uploading 1 narinfos"4801lb # [ 50.752196] niks3-server[1021]: 2026/09/20 13:34:51 INFO Signed narinfos id=12 count=14802lb # [ 50.756082] niks3-server[1021]: 2026/09/20 13:34:51 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4803lb # [ 50.766290] niks3-server[1021]: 2026/09/20 13:34:51 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4804lb # [ 50.772561] niks3-server[1021]: 2026/09/20 13:34:51 INFO Completed upload id=124805lb # [ 50.773798] niks3-server[1021]: 2026/09/20 13:34:51 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4806worker1 # [ 50.779458] nix-grpc-daemon[853]: time=2026-09-20T13:34:51.856Z level=INFO msg="Upload complete. (285ms)"4807worker1 # [ 50.786596] nix-grpc-daemon[786]: ts=2026-09-20T13:34:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14808worker1 # [ 50.794178] nix-grpc-daemon[786]: ts=2026-09-20T13:34:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:483024809worker1 # [ 50.804644] nix-daemon[843]: reaped child process 1050, status = succeeded4810worker2 # [ 50.831157] nix-grpc-daemon[787]: ts=2026-09-20T13:34:51Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:537304811worker2 # [ 50.845896] nix-grpc-daemon[787]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4812worker2 # [ 50.865785] nix-grpc-daemon[787]: ts=2026-09-20T13:34:51Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=0 paths=1 nar_bytes_out=1284813worker1 # [ 51.129753] nix-grpc-daemon[786]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:483024814worker2 # [ 51.146234] nix-grpc-daemon[787]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537304815worker2 # [ 51.157396] nix-grpc-daemon[906]: time=2026-09-20T13:34:52.145Z level=INFO msg="All 1 paths already cached"4816worker2 # [ 51.171704] nix-grpc-daemon[787]: ts=2026-09-20T13:34:52Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04817worker2 # [ 51.176608] nix-grpc-daemon[787]: ts=2026-09-20T13:34:52Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14818worker1 # [ 51.166891] nix-grpc-daemon[786]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024819worker1 # [ 51.180134] nix-grpc-daemon[786]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024820worker1 # [ 51.193345] nix-grpc-daemon[853]: time=2026-09-20T13:34:52.270Z level=INFO msg="All 1 paths already cached"4821worker1 # [ 51.200148] nix-grpc-daemon[786]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483024822worker1 # [ 51.210355] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4823worker1 # [ 51.394400] nix-daemon[843]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4824worker1 # [ 51.410818] nix-daemon[843]: reaped child process 1077, status = succeeded4825worker1 # [ 51.573849] nix-daemon[843]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4826worker1 # [ 51.589605] nix-daemon[843]: reaped child process 1082, status = succeeded4827lb # [ 51.598966] niks3-server[1021]: 2026/09/20 13:34:52 INFO Received uploads request method=POST path=/api/pending_closures4828worker1 # [ 51.613355] nix-grpc-daemon[853]: time=2026-09-20T13:34:52.690Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4829worker1 # [ 51.614913] nix-grpc-daemon[853]: time=2026-09-20T13:34:52.692Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4830lb # [ 51.619640] niks3-server[1021]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4831lb # [ 51.622531] niks3-server[1021]: 2026/09/20 13:34:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4832lb # [ 51.624423] niks3-server[1021]: 2026/09/20 13:34:52 INFO Signed narinfos id=13 count=14833worker1 # [ 51.632262] nix-grpc-daemon[853]: time=2026-09-20T13:34:52.709Z level=INFO msg="Uploading 1 narinfos"4834lb # [ 51.627993] niks3-server[1021]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4835lb # [ 51.633487] niks3-server[1021]: 2026/09/20 13:34:52 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4836lb # [ 51.636875] niks3-server[1021]: 2026/09/20 13:34:52 INFO Completed upload id=134837worker1 # [ 51.644672] nix-grpc-daemon[853]: time=2026-09-20T13:34:52.721Z level=INFO msg="Upload complete. (420ms)"4838lb # [ 51.638515] niks3-server[1021]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4839worker1 # [ 51.646844] nix-grpc-daemon[786]: ts=2026-09-20T13:34:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=6244840worker1 # [ 51.650132] nix-grpc-daemon[786]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024841worker1 # [ 51.655749] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4842worker1 # [ 51.661829] nix-daemon[843]: reaped child process 1072, status = succeeded4843worker1 # [ 51.666983] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4844worker1 # [ 52.893674] nix-daemon[843]: reaped child process 1086, status = succeeded4845worker1 # [ 53.048882] nix-daemon[843]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4846worker1 # [ 53.063042] nix-daemon[843]: reaped child process 1104, status = succeeded4847lb # [ 53.072542] niks3-server[1021]: 2026/09/20 13:34:53 INFO Received uploads request method=POST path=/api/pending_closures4848worker1 # [ 53.087037] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.164Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4849worker1 # [ 53.088565] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.165Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4850lb # [ 53.102123] niks3-server[1021]: 2026/09/20 13:34:53 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4851lb # [ 53.115560] niks3-server[1021]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4852lb # [ 53.127862] niks3-server[1021]: 2026/09/20 13:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4853lb # [ 53.134404] niks3-server[1021]: 2026/09/20 13:34:54 INFO Signed narinfos id=14 count=14854worker1 # [ 53.143590] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.220Z level=INFO msg="Uploading 1 narinfos"4855lb # [ 53.137239] niks3-server[1021]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4856lb # [ 53.148089] niks3-server[1021]: 2026/09/20 13:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4857lb # [ 53.152705] niks3-server[1021]: 2026/09/20 13:34:54 INFO Completed upload id=144858worker1 # [ 53.160986] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.238Z level=INFO msg="Upload complete. (284ms)"4859lb # [ 53.155370] niks3-server[1021]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4860worker1 # [ 53.164456] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14861worker1 # [ 53.169082] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:483024862worker1 # [ 53.173059] nix-daemon[843]: reaped child process 1084, status = succeeded4863worker1 # [ 53.183085] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:483024864worker1 # [ 53.185889] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_out=1764865worker1 # [ 53.443778] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:483024866worker2 # [ 53.460841] nix-grpc-daemon[787]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537304867worker2 # [ 53.476747] nix-grpc-daemon[906]: time=2026-09-20T13:34:54.465Z level=INFO msg="All 1 paths already cached"4868worker2 # [ 53.490249] nix-grpc-daemon[787]: ts=2026-09-20T13:34:54Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04869worker2 # [ 53.494614] nix-grpc-daemon[787]: ts=2026-09-20T13:34:54Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14870worker1 # [ 53.484171] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024871worker1 # [ 53.494272] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024872worker1 # [ 53.503668] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.580Z level=INFO msg="All 2 paths already cached"4873worker1 # [ 53.510917] nix-grpc-daemon[786]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483024874worker1 # [ 53.521144] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4875worker1 # [ 53.699187] nix-daemon[843]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4876worker1 # [ 53.712161] nix-daemon[843]: reaped child process 1111, status = succeeded4877worker1 # [ 53.875409] nix-daemon[843]: accepted connection from pid 1113, user nix-grpc-daemon (trusted)4878worker1 # [ 53.888278] nix-daemon[843]: reaped child process 1116, status = succeeded4879lb # [ 53.896706] niks3-server[1021]: 2026/09/20 13:34:54 INFO Received uploads request method=POST path=/api/pending_closures4880worker1 # [ 53.907282] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.984Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4881worker1 # [ 53.909065] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.986Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4882lb # [ 53.909520] niks3-server[1021]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4883lb # [ 53.913720] niks3-server[1021]: 2026/09/20 13:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4884lb # [ 53.915397] niks3-server[1021]: 2026/09/20 13:34:54 INFO Signed narinfos id=15 count=14885worker1 # [ 53.922167] nix-grpc-daemon[853]: time=2026-09-20T13:34:54.999Z level=INFO msg="Uploading 1 narinfos"4886lb # [ 53.919446] niks3-server[1021]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4887lb # [ 53.923704] niks3-server[1021]: 2026/09/20 13:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4888lb # [ 53.926367] niks3-server[1021]: 2026/09/20 13:34:54 INFO Completed upload id=154889worker1 # [ 53.932933] nix-grpc-daemon[853]: time=2026-09-20T13:34:55.010Z level=INFO msg="Upload complete. (399ms)"4890worker1 # [ 53.934805] nix-grpc-daemon[786]: ts=2026-09-20T13:34:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=7524891lb # [ 53.928900] niks3-server[1021]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4892worker1 # [ 53.938591] nix-grpc-daemon[786]: ts=2026-09-20T13:34:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483024893worker1 # [ 53.945974] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4894worker1 # [ 53.947349] nix-daemon[843]: reaped child process 1106, status = succeeded4895worker1 # [ 53.952793] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4896worker1 # [ 54.765699] nix-daemon[843]: reaped child process 1120, status = succeeded4897worker1 # [ 54.901255] nix-daemon[843]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)4898worker1 # [ 54.913648] nix-daemon[843]: reaped child process 1138, status = succeeded4899lb # [ 54.924641] niks3-server[1021]: 2026/09/20 13:34:55 INFO Received uploads request method=POST path=/api/pending_closures4900worker1 # [ 54.939272] nix-grpc-daemon[853]: time=2026-09-20T13:34:56.016Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4901worker1 # [ 54.940965] nix-grpc-daemon[853]: time=2026-09-20T13:34:56.018Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4902lb # [ 54.967757] niks3-server[1021]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4903lb # [ 54.977431] niks3-server[1021]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4904lb # [ 54.982713] niks3-server[1021]: 2026/09/20 13:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4905lb # [ 54.985961] niks3-server[1021]: 2026/09/20 13:34:55 INFO Signed narinfos id=16 count=14906worker1 # [ 54.995307] nix-grpc-daemon[853]: time=2026-09-20T13:34:56.072Z level=INFO msg="Uploading 1 narinfos"4907lb # [ 54.996824] niks3-server[1021]: 2026/09/20 13:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4908lb # [ 55.003528] niks3-server[1021]: 2026/09/20 13:34:55 INFO Completed upload id=164909worker1 # [ 55.010157] nix-grpc-daemon[853]: time=2026-09-20T13:34:56.087Z level=INFO msg="Upload complete. (251ms)"4910lb # [ 55.005332] niks3-server[1021]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4911lb # [ 55.008258] niks3-server[1021]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4912worker1 # [ 55.016547] nix-grpc-daemon[786]: ts=2026-09-20T13:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14913worker1 # [ 55.022319] nix-grpc-daemon[786]: ts=2026-09-20T13:34:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:483024914worker1 # [ 55.031889] nix-daemon[843]: reaped child process 1118, status = succeeded4915worker1 # [ 55.035118] nix-grpc-daemon[786]: ts=2026-09-20T13:34:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:483024916worker1 # [ 55.036642] nix-grpc-daemon[786]: ts=2026-09-20T13:34:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_out=2324917client # [ 55.119809] nix-daemon[948]: reaped child process 950, status = succeeded4918client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.22 seconds)4919client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4920client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4921client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4922client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4923client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4924client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4925(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.30 seconds)4926subtest: an input only one worker has still reaches the builder4927client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4928client # this derivation will be built:4929client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4930client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4931client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.41 seconds)4932client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4933client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.18 seconds)4934worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4935worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)4936worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4937worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4938client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24939client # [ 56.194286] nix-daemon[948]: accepted connection from pid 1031, user root (trusted)4940client # this derivation will be built:4941client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4942worker1 # [ 56.398396] nix-grpc-daemon[786]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:483024943client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4944worker1 # [ 56.402669] nix-grpc-daemon[786]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483024945worker1 # [ 56.583321] nix-daemon[843]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4946worker1 # [ 56.595989] nix-daemon[843]: reaped child process 1148, status = succeeded4947lb # [ 56.603956] niks3-server[1021]: 2026/09/20 13:34:57 INFO Received uploads request method=POST path=/api/pending_closures4948worker1 # [ 56.618791] nix-grpc-daemon[853]: time=2026-09-20T13:34:57.695Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4949worker1 # [ 56.620730] nix-grpc-daemon[853]: time=2026-09-20T13:34:57.697Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4950lb # [ 56.632188] niks3-server[1021]: 2026/09/20 13:34:57 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4951lb # [ 56.642705] niks3-server[1021]: 2026/09/20 13:34:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4952lb # [ 56.649309] niks3-server[1021]: 2026/09/20 13:34:57 INFO Signed narinfos id=17 count=14953worker1 # [ 56.659527] nix-grpc-daemon[853]: time=2026-09-20T13:34:57.736Z level=INFO msg="Uploading 1 narinfos"4954lb # [ 56.656274] niks3-server[1021]: 2026/09/20 13:34:57 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4955lb # [ 56.670340] niks3-server[1021]: 2026/09/20 13:34:57 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4956lb # [ 56.675599] niks3-server[1021]: 2026/09/20 13:34:57 INFO Completed upload id=174957worker1 # [ 56.682315] nix-grpc-daemon[853]: time=2026-09-20T13:34:57.759Z level=INFO msg="Upload complete. (280ms)"4958lb # [ 56.678183] niks3-server[1021]: 2026/09/20 13:34:57 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4959worker2 # [ 56.710293] nix-grpc-daemon[787]: ts=2026-09-20T13:34:57Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04960worker2 # [ 56.712088] nix-grpc-daemon[787]: ts=2026-09-20T13:34:57Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14961worker2 # [ 56.753129] nix-grpc-daemon[787]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537304962worker2 # [ 56.761597] nix-grpc-daemon[787]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537304963client # copying 2 paths to 'lb:50051'...4964client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4965worker2 # [ 56.772341] nix-grpc-daemon[787]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537304966client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4967worker2 # [ 56.777848] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4968worker2 # [ 56.943642] nix-daemon[855]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4969worker2 # [ 56.957477] nix-daemon[855]: reaped child process 994, status = succeeded4970worker2 # [ 57.128720] nix-daemon[855]: accepted connection from pid 996, user nix-grpc-daemon (trusted)4971worker2 # [ 57.139086] nix-daemon[855]: reaped child process 999, status = succeeded4972lb # [ 57.135797] niks3-server[1021]: 2026/09/20 13:34:58 INFO Received uploads request method=POST path=/api/pending_closures4973lb # [ 57.140777] niks3-server[1021]: 2026/09/20 13:34:58 INFO Received uploads request method=POST path=/api/pending_closures4974worker2 # [ 57.163952] nix-grpc-daemon[906]: time=2026-09-20T13:34:58.152Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4975worker2 # [ 57.165558] nix-grpc-daemon[906]: time=2026-09-20T13:34:58.154Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4976worker2 # [ 57.168165] nix-grpc-daemon[906]: time=2026-09-20T13:34:58.154Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4977lb # [ 57.162659] niks3-server[1021]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4978lb # [ 57.168471] niks3-server[1021]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4979lb # [ 57.171833] niks3-server[1021]: 2026/09/20 13:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4980lb # [ 57.173904] niks3-server[1021]: 2026/09/20 13:34:58 INFO Signed narinfos id=18 count=14981lb # [ 57.176987] niks3-server[1021]: 2026/09/20 13:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4982lb # [ 57.179317] niks3-server[1021]: 2026/09/20 13:34:58 INFO Signed narinfos id=19 count=24983worker2 # [ 57.198948] nix-grpc-daemon[906]: time=2026-09-20T13:34:58.187Z level=INFO msg="Uploading 3 narinfos"4984lb # [ 57.181142] niks3-server[1021]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4985lb # [ 57.183866] niks3-server[1021]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4986lb # [ 57.196416] niks3-server[1021]: 2026/09/20 13:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4987lb # [ 57.199462] niks3-server[1021]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4988lb # [ 57.201576] niks3-server[1021]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4989lb # [ 57.204687] niks3-server[1021]: 2026/09/20 13:34:58 INFO Completed upload id=184990lb # [ 57.205962] niks3-server[1021]: 2026/09/20 13:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4991lb # [ 57.208222] niks3-server[1021]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4992lb # [ 57.210408] niks3-server[1021]: 2026/09/20 13:34:58 INFO Completed upload id=194993worker2 # [ 57.230644] nix-grpc-daemon[906]: time=2026-09-20T13:34:58.219Z level=INFO msg="Upload complete. (445ms)"4994worker2 # [ 57.232706] nix-grpc-daemon[787]: ts=2026-09-20T13:34:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=0 paths=2 nar_bytes_in=9764995worker2 # [ 57.235560] nix-grpc-daemon[787]: ts=2026-09-20T13:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537304996worker2 # [ 57.241590] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4997worker2 # [ 57.244640] nix-daemon[855]: reaped child process 989, status = succeeded4998worker2 # [ 57.250954] nix-grpc-daemon[787]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4999client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5000worker2 # [ 57.259088] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5001client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5002worker2 # [ 58.270200] nix-daemon[855]: reaped child process 1004, status = succeeded5003lb # [ 58.301067] envoy[920]: conn peer=[2001:db8:1::1]:54644 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=975004lb # [ 58.304727] envoy[920]: conn peer=[2001:db8:1::1]:54640 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3429 tx=1637 ms=24285005lb # [ 58.308242] envoy[920]: conn peer=[2001:db8:1::1]:54656 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=1875 ms=21105006lb # [ 58.311751] envoy[920]: conn peer=[2001:db8:1::1]:55576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=545007lb # [ 58.315491] envoy[920]: conn peer=[2001:db8:1::1]:55580 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4316 tx=2084 ms=16445008lb # [ 58.319297] envoy[920]: conn peer=[2001:db8:1::1]:55594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=525009worker2 # [ 58.416174] nix-daemon[855]: accepted connection from pid 1019, user nix-grpc-daemon (trusted)5010worker2 # [ 58.427742] nix-daemon[855]: reaped child process 1022, status = succeeded5011lb # [ 58.426418] niks3-server[1021]: 2026/09/20 13:34:59 INFO Received uploads request method=POST path=/api/pending_closures5012worker2 # [ 58.459644] nix-grpc-daemon[906]: time=2026-09-20T13:34:59.448Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5013lb # [ 58.462288] niks3-server[1021]: 2026/09/20 13:34:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5014worker2 # [ 58.491529] nix-grpc-daemon[906]: time=2026-09-20T13:34:59.480Z level=INFO msg="Uploading 1 narinfos"5015lb # [ 58.472180] niks3-server[1021]: 2026/09/20 13:34:59 INFO Signed narinfos id=20 count=15016lb # [ 58.478182] niks3-server[1021]: 2026/09/20 13:34:59 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5017lb # [ 58.484053] niks3-server[1021]: 2026/09/20 13:34:59 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5018lb # [ 58.492057] niks3-server[1021]: 2026/09/20 13:34:59 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5019lb # [ 58.500307] niks3-server[1021]: 2026/09/20 13:34:59 INFO Completed upload id=205020worker2 # [ 58.519527] nix-grpc-daemon[906]: time=2026-09-20T13:34:59.508Z level=INFO msg="Upload complete. (254ms)"5021worker2 # [ 58.524945] nix-grpc-daemon[787]: ts=2026-09-20T13:34:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15022worker2 # [ 58.535746] nix-daemon[855]: reaped child process 1001, status = succeeded5023client # copying 1 paths...5024worker2 # [ 58.569410] nix-grpc-daemon[787]: ts=2026-09-20T13:34:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:537305025client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5026worker2 # [ 58.592159] nix-grpc-daemon[787]: ts=2026-09-20T13:34:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:537305027worker2 # [ 58.596592] nix-grpc-daemon[787]: ts=2026-09-20T13:34:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=0 paths=1 nar_bytes_out=1205028lb # [ 58.630673] niks3-server[1021]: 2026/09/20 13:34:59 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5029client # [ 58.650656] nix-daemon[948]: reaped child process 1034, status = succeeded5030client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.64 seconds)5031client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25032client # [ 58.828377] nix-daemon[948]: accepted connection from pid 1052, user root (trusted)5033client # this derivation will be built:5034client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5035worker2 # [ 59.047160] nix-grpc-daemon[787]: ts=2026-09-20T13:35:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:537305036client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5037worker1 # [ 59.038653] nix-grpc-daemon[786]: ts=2026-09-20T13:35:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483025038worker1 # [ 59.046804] nix-grpc-daemon[853]: time=2026-09-20T13:35:00.123Z level=INFO msg="All 1 paths already cached"5039worker2 # [ 59.072131] nix-grpc-daemon[787]: ts=2026-09-20T13:35:00Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05040worker2 # [ 59.076918] nix-grpc-daemon[787]: ts=2026-09-20T13:35:00Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15041worker1 # [ 59.066559] nix-grpc-daemon[786]: ts=2026-09-20T13:35:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483025042worker1 # [ 59.077401] nix-grpc-daemon[786]: ts=2026-09-20T13:35:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483025043client # copying 1 paths to 'lb:50051'...5044client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5045worker1 # [ 59.093623] nix-grpc-daemon[786]: ts=2026-09-20T13:35:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483025046worker1 # [ 59.100783] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5047worker1 # [ 59.115812] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)5048worker1 # [ 59.217824] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 2/5)5049worker1 # [ 59.285084] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 370 ms (attempt 3/5)5050worker1 # [ 59.661258] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 794 ms (attempt 4/5)5051worker1 # [ 60.462217] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5052worker1 # [ 60.464691] nix-grpc-daemon[786]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5053worker1 # [ 60.621485] nix-daemon[843]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)5054worker1 # [ 60.636621] nix-daemon[843]: reaped child process 1159, status = succeeded5055worker1 # [ 60.776122] nix-daemon[843]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5056worker1 # [ 60.790142] nix-daemon[843]: reaped child process 1164, status = succeeded5057lb # [ 60.797897] niks3-server[1021]: 2026/09/20 13:35:01 INFO Received uploads request method=POST path=/api/pending_closures5058worker1 # [ 60.816250] nix-grpc-daemon[853]: time=2026-09-20T13:35:01.893Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5059worker1 # [ 60.818177] nix-grpc-daemon[853]: time=2026-09-20T13:35:01.895Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5060lb # [ 60.828703] niks3-server[1021]: 2026/09/20 13:35:01 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5061lb # [ 60.840526] niks3-server[1021]: 2026/09/20 13:35:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5062worker1 # [ 60.852220] nix-grpc-daemon[853]: time=2026-09-20T13:35:01.929Z level=INFO msg="Uploading 1 narinfos"5063lb # [ 60.846107] niks3-server[1021]: 2026/09/20 13:35:01 INFO Signed narinfos id=21 count=15064lb # [ 60.850591] niks3-server[1021]: 2026/09/20 13:35:01 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5065lb # [ 60.862747] niks3-server[1021]: 2026/09/20 13:35:01 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5066lb # [ 60.867096] niks3-server[1021]: 2026/09/20 13:35:01 INFO Completed upload id=215067worker1 # [ 60.873742] nix-grpc-daemon[853]: time=2026-09-20T13:35:01.951Z level=INFO msg="Upload complete. (392ms)"5068lb # [ 60.869294] niks3-server[1021]: 2026/09/20 13:35:01 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5069worker1 # [ 60.876152] nix-grpc-daemon[786]: ts=2026-09-20T13:35:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 paths=1 nar_bytes_in=5605070worker1 # [ 60.880355] nix-grpc-daemon[786]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483025071worker1 # [ 60.887566] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5072worker1 # [ 60.890362] nix-daemon[843]: reaped child process 1150, status = succeeded5073client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5074worker1 # [ 60.895632] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5075client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5076worker1 # [ 61.909076] nix-daemon[843]: reaped child process 1168, status = succeeded5077worker1 # [ 62.027522] nix-daemon[843]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5078worker1 # [ 62.039699] nix-daemon[843]: reaped child process 1186, status = succeeded5079lb # [ 62.046573] niks3-server[1021]: 2026/09/20 13:35:02 INFO Received uploads request method=POST path=/api/pending_closures5080worker1 # [ 62.060990] nix-grpc-daemon[853]: time=2026-09-20T13:35:03.138Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5081lb # [ 62.074965] niks3-server[1021]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5082lb # [ 62.083464] niks3-server[1021]: 2026/09/20 13:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5083worker1 # [ 62.094881] nix-grpc-daemon[853]: time=2026-09-20T13:35:03.172Z level=INFO msg="Uploading 1 narinfos"5084lb # [ 62.088509] niks3-server[1021]: 2026/09/20 13:35:02 INFO Signed narinfos id=22 count=15085lb # [ 62.095136] niks3-server[1021]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5086lb # [ 62.106910] niks3-server[1021]: 2026/09/20 13:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5087worker1 # [ 62.120402] nix-grpc-daemon[853]: time=2026-09-20T13:35:03.197Z level=INFO msg="Upload complete. (218ms)"5088lb # [ 62.113854] niks3-server[1021]: 2026/09/20 13:35:03 INFO Completed upload id=225089lb # [ 62.117465] niks3-server[1021]: 2026/09/20 13:35:03 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5090worker1 # [ 62.123503] nix-grpc-daemon[786]: ts=2026-09-20T13:35:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15091worker1 # [ 62.135626] nix-daemon[843]: reaped child process 1166, status = succeeded5092client # copying 1 paths...5093client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5094worker1 # [ 62.169280] nix-grpc-daemon[786]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:483025095worker1 # [ 62.182178] nix-grpc-daemon[786]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:483025096worker1 # [ 62.186320] nix-grpc-daemon[786]: ts=2026-09-20T13:35:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_out=1205097client # [ 62.258876] nix-daemon[948]: reaped child process 1055, status = succeeded5098client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.60 seconds)5099client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25100client # [ 62.426297] nix-daemon[948]: accepted connection from pid 1074, user root (trusted)5101client # this derivation will be built:5102client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5103worker1 # [ 62.779200] nix-grpc-daemon[786]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:483025104client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5105worker1 # [ 62.785423] nix-grpc-daemon[786]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483025106worker1 # [ 62.792549] nix-grpc-daemon[853]: time=2026-09-20T13:35:03.869Z level=INFO msg="All 1 paths already cached"5107worker2 # [ 62.821234] nix-grpc-daemon[787]: ts=2026-09-20T13:35:03Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05108worker2 # [ 62.827156] nix-grpc-daemon[787]: ts=2026-09-20T13:35:03Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15109worker2 # [ 62.832481] nix-grpc-daemon[787]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537305110worker2 # [ 62.844248] nix-grpc-daemon[787]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537305111worker2 # [ 62.856478] nix-grpc-daemon[906]: time=2026-09-20T13:35:03.844Z level=INFO msg="All 1 paths already cached"5112client # copying 1 paths to 'lb:50051'...5113client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5114worker2 # [ 62.863316] nix-grpc-daemon[787]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537305115worker2 # [ 62.874326] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5116worker2 # [ 63.041796] nix-daemon[855]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5117worker2 # [ 63.053800] nix-daemon[855]: reaped child process 1033, status = succeeded5118worker2 # [ 63.198445] nix-daemon[855]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)5119worker2 # [ 63.210149] nix-daemon[855]: reaped child process 1038, status = succeeded5120lb # [ 63.202400] niks3-server[1021]: 2026/09/20 13:35:04 INFO Received uploads request method=POST path=/api/pending_closures5121worker2 # [ 63.226646] nix-grpc-daemon[906]: time=2026-09-20T13:35:04.215Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5122worker2 # [ 63.228104] nix-grpc-daemon[906]: time=2026-09-20T13:35:04.215Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5123lb # [ 63.216354] niks3-server[1021]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5124lb # [ 63.220289] niks3-server[1021]: 2026/09/20 13:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5125lb # [ 63.223041] niks3-server[1021]: 2026/09/20 13:35:04 INFO Signed narinfos id=23 count=15126worker2 # [ 63.242160] nix-grpc-daemon[906]: time=2026-09-20T13:35:04.230Z level=INFO msg="Uploading 1 narinfos"5127lb # [ 63.225173] niks3-server[1021]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5128lb # [ 63.229181] niks3-server[1021]: 2026/09/20 13:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5129lb # [ 63.232431] niks3-server[1021]: 2026/09/20 13:35:04 INFO Completed upload id=235130worker2 # [ 63.251522] nix-grpc-daemon[906]: time=2026-09-20T13:35:04.240Z level=INFO msg="Upload complete. (366ms)"5131worker2 # [ 63.253389] nix-grpc-daemon[787]: ts=2026-09-20T13:35:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=0 paths=1 nar_bytes_in=5605132lb # [ 63.234938] niks3-server[1021]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5133worker2 # [ 63.256313] nix-grpc-daemon[787]: ts=2026-09-20T13:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537305134worker2 # [ 63.262634] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5135worker2 # [ 63.264831] nix-daemon[855]: reaped child process 1028, status = succeeded5136client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5137worker2 # [ 63.269895] nix-daemon[855]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5138client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5139worker2 # [ 64.094203] nix-daemon[855]: reaped child process 1042, status = succeeded5140worker2 # [ 64.252104] nix-daemon[855]: accepted connection from pid 1057, user nix-grpc-daemon (trusted)5141worker2 # [ 64.264583] nix-daemon[855]: reaped child process 1060, status = succeeded5142lb # [ 64.260836] niks3-server[1021]: 2026/09/20 13:35:05 INFO Received uploads request method=POST path=/api/pending_closures5143worker2 # [ 64.288483] nix-grpc-daemon[906]: time=2026-09-20T13:35:05.277Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5144lb # [ 64.293093] niks3-server[1021]: 2026/09/20 13:35:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5145lb # [ 64.297479] niks3-server[1021]: 2026/09/20 13:35:05 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5146worker2 # [ 64.323701] nix-grpc-daemon[906]: time=2026-09-20T13:35:05.312Z level=INFO msg="Uploading 1 narinfos"5147lb # [ 64.304843] niks3-server[1021]: 2026/09/20 13:35:05 INFO Signed narinfos id=24 count=15148lb # [ 64.311570] niks3-server[1021]: 2026/09/20 13:35:05 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5149lb # [ 64.322752] niks3-server[1021]: 2026/09/20 13:35:05 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5150worker2 # [ 64.347670] nix-grpc-daemon[906]: time=2026-09-20T13:35:05.336Z level=INFO msg="Upload complete. (271ms)"5151lb # [ 64.328465] niks3-server[1021]: 2026/09/20 13:35:05 INFO Completed upload id=245152lb # [ 64.333564] niks3-server[1021]: 2026/09/20 13:35:05 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5153worker2 # [ 64.351658] nix-grpc-daemon[787]: ts=2026-09-20T13:35:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53730 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15154worker2 # [ 64.364461] nix-daemon[855]: reaped child process 1040, status = succeeded5155client # copying 1 paths...5156worker2 # [ 64.396524] nix-grpc-daemon[787]: ts=2026-09-20T13:35:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:537305157client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5158worker1 # [ 64.404370] nix-grpc-daemon[786]: ts=2026-09-20T13:35:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:483025159worker1 # [ 64.419626] nix-grpc-daemon[786]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5160worker1 # [ 64.433327] nix-grpc-daemon[786]: ts=2026-09-20T13:35:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_out=1205161client # [ 64.512959] nix-daemon[948]: reaped child process 1077, status = succeeded5162client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.25 seconds)5163(finished: subtest: an input only one worker has still reaches the builder, in 9.31 seconds)5164subtest: upload whose reference the worker lacks is completed from the cache5165client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5166client # this derivation will be built:5167client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5168client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5169client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.37 seconds)5170client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5171client # this derivation will be built:5172client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5173client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5174client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds)5175client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5176client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds)5177worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5178worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.22 seconds)5179worker2 # [ 65.744649] systemd[1]: Stopping Nix worker-protocol over gRPC...5180worker2 # [ 66.676464] nix-grpc-daemon[787]: ts=2026-09-20T13:35:07Z level=info event=signal_exit5181worker2 # [ 66.922793] nix-grpc-daemon[787]: ts=2026-09-20T13:35:07Z level=info event=scheduler_yield5182lb # [ 66.907283] niks3-server[1021]: 2026/09/20 13:35:07 INFO lead: released remote=192.168.1.4:495005183worker2 # [ 66.927347] nix-grpc-daemon[787]: ts=2026-09-20T13:35:07Z level=info event=scheduler_restarting addr=lb:500515184worker2 # [ 66.932386] nix-grpc-daemon[787]: ts=2026-09-20T13:35:07Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:537245185worker1 # [ 66.920955] nix-grpc-daemon[786]: ts=2026-09-20T13:35:07Z level=info event=scheduler_restarting addr=lb:500515186worker2 # [ 66.937296] nix-grpc-daemon[787]: ts=2026-09-20T13:35:07Z level=info event=worker_gone addr=192.168.1.4:500515187worker2 # [ 66.940391] nix-grpc-daemon[787]: ts=2026-09-20T13:35:07Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:537245188worker2 # [ 66.943673] nix-grpc-daemon[787]: ts=2026-09-20T13:35:07Z level=info event=worker_gone addr=192.168.1.3:500515189worker2 # [ 67.128788] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515190worker2 # [ 67.132832] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5191worker1 # [ 67.122098] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515192worker1 # [ 67.125325] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5193worker2 # [ 67.333983] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515194worker1 # [ 67.323128] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515195worker2 # [ 67.338164] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5196worker1 # [ 67.326970] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5197worker2 # [ 67.538832] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515198worker2 # [ 67.540759] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5199worker1 # [ 67.527595] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515200worker1 # [ 67.531633] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5201worker2 # [ 67.743833] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515202worker1 # [ 67.732750] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515203worker2 # [ 67.747322] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5204worker1 # [ 67.735795] nix-grpc-daemon[786]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5205worker2 # [ 67.927190] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=scheduler_restarting5206worker1 # [ 67.934570] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:500515207worker2 # [ 67.952234] nix-grpc-daemon[787]: ts=2026-09-20T13:35:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5208worker1 # [ 67.938266] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5209worker2 # [ 67.961271] nix-daemon[855]: reaped child process 858, status = succeeded5210worker2 # [ 68.005715] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5211worker2 # [ 68.008276] systemd[1]: Stopped Nix worker-protocol over gRPC.5212worker2 # [ 68.009091] systemd[1]: nix-grpc-daemon.service: Consumed 1.351s CPU time over 49.583s wall clock time, 50.1M memory peak, 52.8K incoming IP traffic, 126.9K outgoing IP traffic.5213worker2 # [ 68.012832] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5214worker2 # [ 68.014680] systemd[1]: Closed Nix worker-protocol over gRPC.5215worker2 # [ 68.016302] systemd[1]: nix-grpc-daemon.socket: Consumed 278us CPU time over 58.500s wall clock time, 256K memory peak, 66.7K incoming IP traffic, 58.2K outgoing IP traffic.5216lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5217lb: must succeed: curl -sf localhost:9901/clusters5218lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5219lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5220client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25221worker1 # [ 68.136284] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:500515222worker1 # [ 68.140234] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5223worker1 # [ 68.256726] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483025224client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5225worker1 # [ 68.261915] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:483025226client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.21 seconds)5227worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5228worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5229lb # [ 68.301731] envoy[920]: conn peer=[2001:db8:1::1]:55612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=525230lb # [ 68.303248] envoy[920]: conn peer=[2001:db8:1::1]:55606 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3849 tx=1738 ms=22355231lb # [ 68.304798] envoy[920]: conn peer=[2001:db8:1::1]:55634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=515232lb # [ 68.306222] envoy[920]: conn peer=[2001:db8:1::1]:55618 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1798 ms=32005233lb # [ 68.307717] envoy[920]: conn peer=[2001:db8:1::1]:55644 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3715 tx=1780 ms=17065234lb # [ 68.309139] envoy[920]: conn peer=[2001:db8:1::1]:49590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=845235lb # [ 68.310566] envoy[920]: conn peer=[2001:db8:1::4]:60828 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=38106 tx=1973 ms=492595236lb # [ 68.312136] envoy[920]: conn peer=[2001:db8:1::1]:49592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=165237worker1 # [ 68.340841] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:500515238worker1 # [ 68.344613] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5239worker2 # [ 68.360185] systemd[1]: Listening on Nix worker-protocol over gRPC.5240worker1 # [ 68.407727] systemd[1]: Stopping Nix worker-protocol over gRPC...5241worker1 # [ 68.545455] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:500515242worker1 # [ 68.549970] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5243worker1 # [ 68.579272] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=signal_exit5244worker1 # [ 68.750409] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:500515245worker1 # [ 68.754348] nix-grpc-daemon[786]: ts=2026-09-20T13:35:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5246worker2 # [ 68.800191] systemd[1]: Starting scheduler-token.service...5247worker2 # [ 68.896101] systemd[1]: scheduler-token.service: Deactivated successfully.5248worker2 # [ 68.897790] systemd[1]: Finished scheduler-token.service.5249worker2 # [ 68.899416] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 97ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5250worker2 # [ 68.904659] systemd[1]: Starting Nix worker-protocol over gRPC...5251worker1 # [ 68.955950] nix-grpc-daemon[786]: ts=2026-09-20T13:35:10Z level=info event=scheduler_connected addr=lb:500515252worker1 # [ 68.959760] nix-grpc-daemon[786]: ts=2026-09-20T13:35:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5253worker2 # [ 69.062539] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5254worker2 # [ 69.064893] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5255worker2 # [ 69.068964] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15256worker2 # [ 69.076684] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5257worker2 # [ 69.078452] systemd[1]: Started Nix worker-protocol over gRPC.5258worker2 # [ 69.090128] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=scheduler_take_over5259lb # [ 69.071682] niks3-server[1021]: 2026/09/20 13:35:09 INFO lead: acquired remote=192.168.1.4:383805260worker2 # [ 69.101394] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=scheduler_connected addr=lb:500515261worker2 # [ 69.108369] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=oidc_jwks provider=mock keys=15262worker2 # [ 69.109937] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:594225263worker2 # [ 69.111465] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05264worker1 # [ 69.160354] nix-grpc-daemon[786]: ts=2026-09-20T13:35:10Z level=info event=scheduler_connected addr=lb:500515265worker2 # [ 69.174634] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:594225266worker2 # [ 69.177632] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05267worker1 # [ 69.824895] nix-grpc-daemon[786]: ts=2026-09-20T13:35:10Z level=info event=scheduler_restarting5268worker2 # [ 69.845990] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:594225269worker2 # [ 69.849784] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:10Z level=info event=worker_gone addr=192.168.1.3:500515270worker1 # [ 69.845300] nix-grpc-daemon[786]: ts=2026-09-20T13:35:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5271worker1 # [ 69.867429] nix-daemon[843]: reaped child process 845, status = succeeded5272worker1 # [ 69.945614] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5273worker1 # [ 69.948624] systemd[1]: Stopped Nix worker-protocol over gRPC.5274worker1 # [ 69.952462] systemd[1]: nix-grpc-daemon.service: Consumed 2.586s CPU time over 51.645s wall clock time, 58.6M memory peak, 86K incoming IP traffic, 157.8K outgoing IP traffic.5275worker1 # [ 69.963688] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5276worker1 # [ 69.967183] systemd[1]: Closed Nix worker-protocol over gRPC.5277worker1 # [ 69.969712] systemd[1]: nix-grpc-daemon.socket: Consumed 302us CPU time over 1min 538ms wall clock time, 256K memory peak, 73.8K incoming IP traffic, 61.6K outgoing IP traffic.5278lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5279lb: must succeed: curl -sf localhost:9901/clusters5280lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5281lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5282client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25283worker2 # [ 70.281897] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:594305284worker2 # [ 70.294324] nix-daemon[855]: accepted connection from pid 1084, user nix-grpc-daemon (trusted)5285worker2 # [ 70.312252] nix-grpc-daemon[1084]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5)5286worker2 # [ 70.348166] nix-grpc-daemon[1084]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5)5287worker2 # [ 70.510337] nix-grpc-daemon[1084]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 102 ms (attempt 3/5)5288worker2 # [ 70.612989] nix-grpc-daemon[1084]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 707 ms (attempt 4/5)5289worker2 # [ 71.327382] nix-grpc-daemon[1084]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5290client # copying 2 paths...5291client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5292worker2 # [ 71.346209] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:594305293client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5294worker2 # [ 71.360388] nix-daemon[855]: accepted connection from pid 1084, user nix-grpc-daemon (trusted)5295worker2 # [ 71.381566] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:12Z level=info event=niks3_push_started pid=11405296worker2 # [ 71.594283] nix-grpc-daemon[1140]: time=2026-09-20T13:35:12.581Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5297worker2 # [ 71.748632] nix-daemon[855]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)5298worker2 # [ 71.763086] nix-daemon[855]: reaped child process 1156, status = succeeded5299lb # [ 71.758568] niks3-server[1021]: 2026/09/20 13:35:12 INFO Received uploads request method=POST path=/api/pending_closures5300lb # [ 71.767088] niks3-server[1021]: 2026/09/20 13:35:12 INFO Received uploads request method=POST path=/api/pending_closures5301worker2 # [ 71.794260] nix-grpc-daemon[1140]: time=2026-09-20T13:35:12.783Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5302worker2 # [ 71.795913] nix-grpc-daemon[1140]: time=2026-09-20T13:35:12.784Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5303worker2 # [ 71.797968] nix-grpc-daemon[1140]: time=2026-09-20T13:35:12.786Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5304lb # [ 71.809661] niks3-server[1021]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5305lb # [ 71.827227] niks3-server[1021]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5306lb # [ 71.838927] niks3-server[1021]: 2026/09/20 13:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5307lb # [ 71.840511] niks3-server[1021]: 2026/09/20 13:35:12 INFO Signed narinfos id=26 count=25308lb # [ 71.843766] niks3-server[1021]: 2026/09/20 13:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5309lb # [ 71.847435] niks3-server[1021]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5310lb # [ 71.849236] niks3-server[1021]: 2026/09/20 13:35:12 INFO Signed narinfos id=25 count=15311worker2 # [ 71.870215] nix-grpc-daemon[1140]: time=2026-09-20T13:35:12.857Z level=INFO msg="Uploading 3 narinfos"5312lb # [ 71.865105] niks3-server[1021]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5313lb # [ 71.869071] niks3-server[1021]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5314lb # [ 71.871634] niks3-server[1021]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5315lb # [ 71.875926] niks3-server[1021]: 2026/09/20 13:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5316lb # [ 71.880567] niks3-server[1021]: 2026/09/20 13:35:12 INFO Completed upload id=255317lb # [ 71.881814] niks3-server[1021]: 2026/09/20 13:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5318lb # [ 71.883638] niks3-server[1021]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5319lb # [ 71.886325] niks3-server[1021]: 2026/09/20 13:35:12 INFO Completed upload id=265320worker2 # [ 71.906934] nix-grpc-daemon[1140]: time=2026-09-20T13:35:12.895Z level=INFO msg="Upload complete. (313ms)"5321worker2 # [ 71.911934] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59430 duration_s=0 paths=2 nar_bytes_in=3125322worker2 # [ 71.925656] nix-daemon[855]: reaped child process 1138, status = succeeded5323client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.89 seconds)5324worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5325worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5326worker1 # [ 72.033802] systemd[1]: Listening on Nix worker-protocol over gRPC.5327worker1 # [ 72.041939] systemd[1]: Starting Nix worker-protocol over gRPC...5328worker1 # [ 72.208372] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5329worker1 # [ 72.211114] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5330worker1 # [ 72.214642] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15331worker1 # [ 72.221525] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5332worker1 # [ 72.223168] systemd[1]: Started Nix worker-protocol over gRPC.5333lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5334lb: must succeed: curl -sf localhost:9901/clusters5335worker1 # [ 72.240656] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:13Z level=info event=scheduler_connected addr=lb:500515336worker2 # [ 72.257500] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:594225337worker2 # [ 72.262138] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05338lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5339lb: must succeed: curl -sf localhost:9901/clusters5340lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5341lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5342(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 8.81 seconds)5343subtest: scheduler down: the other node takes the lock and keeps it5344lb: must succeed: curl -sf localhost:9901/clusters5345lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5346lb: must succeed: curl -sf localhost:9901/clusters5347lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5348lb: must succeed: curl -sf localhost:9901/clusters5349lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5350lb: must succeed: curl -sf localhost:9901/clusters5351lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5352worker2 # [ 73.576512] systemd[1]: Stopping Nix worker-protocol over gRPC...5353worker2 # [ 74.084210] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=signal_exit5354worker2 # [ 74.091105] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_yield5355lb # [ 74.073782] niks3-server[1021]: 2026/09/20 13:35:14 INFO lead: released remote=192.168.1.4:383805356worker1 # [ 74.085808] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_restarting addr=lb:500515357worker2 # [ 74.098129] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:594225358worker2 # [ 74.103208] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=worker_gone addr=192.168.1.3:500515359worker2 # [ 74.106790] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_restarting addr=lb:500515360worker2 # [ 74.109718] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:594225361worker2 # [ 74.113986] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=worker_gone addr=192.168.1.4:500515362worker1 # [ 74.285722] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515363worker1 # [ 74.289587] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5364worker2 # [ 74.304829] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515365worker2 # [ 74.308690] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5366worker1 # [ 74.490394] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515367worker1 # [ 74.494418] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5368worker2 # [ 74.510332] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515369worker2 # [ 74.514273] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5370worker1 # [ 74.694779] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515371worker1 # [ 74.696553] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5372worker2 # [ 74.715808] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515373worker2 # [ 74.718967] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5374worker1 # [ 74.897586] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515375worker1 # [ 74.901546] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5376worker2 # [ 74.917655] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:500515377worker2 # [ 74.922365] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5378worker2 # [ 75.098650] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:16Z level=info event=scheduler_restarting5379worker2 # [ 75.115188] nix-daemon[855]: reaped child process 1133, status = succeeded5380worker1 # [ 75.103489] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:500515381worker2 # [ 75.119251] nix-grpc-daemon[1084]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5382worker1 # [ 75.106721] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5383worker2 # [ 75.123730] nix-grpc-daemon[1084]: E0000 00:00:1789911316.107270 1127 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5384worker2 # [ 75.128723] nix-grpc-daemon[1084]: E0000 00:00:1789911316.112127 1127 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5385worker2 # [ 75.141783] nix-grpc-daemon[1084]: ts=2026-09-20T13:35:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5386worker1 # [ 75.307466] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:500515387worker1 # [ 75.311397] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5388worker1 # [ 75.512118] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:500515389worker1 # [ 75.516173] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5390worker1 # [ 75.719104] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:500515391worker1 # [ 75.722196] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5392worker1 # [ 75.919291] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:500515393worker1 # [ 75.923228] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5394worker1 # [ 76.123888] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:500515395worker1 # [ 76.125610] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5396worker1 # [ 76.326648] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:500515397worker1 # [ 76.330540] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5398worker1 # [ 76.531083] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:500515399worker1 # [ 76.532838] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5400worker1 # [ 76.733265] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:500515401worker1 # [ 76.734938] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5402worker1 # [ 76.935963] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_connected addr=lb:500515403worker1 # [ 76.939880] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5404worker2 # [ 77.105534] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5405worker2 # [ 77.109095] systemd[1]: Stopped Nix worker-protocol over gRPC.5406worker2 # [ 77.112808] systemd[1]: nix-grpc-daemon.service: Consumed 362ms CPU time over 8.200s wall clock time, 30.6M memory peak, 19.4K incoming IP traffic, 26K outgoing IP traffic.5407worker2 # [ 77.124674] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5408worker2 # [ 77.128120] systemd[1]: Closed Nix worker-protocol over gRPC.5409worker2 # [ 77.131164] systemd[1]: nix-grpc-daemon.socket: Consumed 357us CPU time over 8.771s wall clock time, 256K memory peak, 19.4K incoming IP traffic, 13.8K outgoing IP traffic.5410worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5411worker1 # [ 77.141667] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_connected addr=lb:500515412worker1 # [ 77.145794] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5413lb # [ 77.226496] niks3-server[1021]: 2026/09/20 13:35:18 INFO lead: acquired remote=192.168.1.3:432205414worker1 # [ 77.236243] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_take_over5415worker1 # [ 77.346387] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_connected addr=lb:500515416worker1 # [ 77.350338] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5417worker1 # [ 77.550980] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_connected addr=lb:500515418worker1 # [ 77.554952] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5419worker1 # [ 77.755813] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=scheduler_connected addr=lb:500515420worker1 # [ 77.763950] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:431605421worker1 # [ 77.768213] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05422worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.14 seconds)5423worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5424lb # [ 78.301890] envoy[920]: conn peer=[2001:db8:1::3]:42884 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10859 tx=2345 ms=504275425worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5426client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25427lb # [ 78.303894] envoy[920]: conn peer=[2001:db8:1::1]:49596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=16445428lb # [ 78.305582] envoy[920]: conn peer=[2001:db8:1::4]:42422 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4478 tx=349 ms=60305429worker1 # [ 78.503798] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:431765430worker1 # [ 78.516567] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5431client # don't know how to build these paths:5432client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5433worker1 # [ 78.532796] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431765434worker1 # [ 78.544604] nix-grpc-daemon[1211]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5)5435worker1 # [ 78.560617] nix-grpc-daemon[1211]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 171 ms (attempt 2/5)5436worker1 # [ 78.737818] nix-grpc-daemon[1211]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 3/5)5437worker1 # [ 78.900442] nix-grpc-daemon[1211]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 4/5)5438worker1 # [ 79.082362] nix-grpc-daemon[1211]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5439worker1 # [ 79.107421] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05440worker1 # [ 79.109499] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15441worker1 # [ 79.153452] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765442worker1 # [ 79.166431] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431765443client # copying 1 paths to 'lb:50051'...5444client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5445worker1 # [ 79.178919] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431765446worker1 # [ 79.187331] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5447worker1 # [ 79.209199] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=info event=niks3_push_started pid=12845448worker1 # [ 79.400207] nix-grpc-daemon[1284]: time=2026-09-20T13:35:20.477Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5449worker1 # [ 79.558712] nix-daemon[843]: accepted connection from pid 1297, user nix-grpc-daemon (trusted)5450worker1 # [ 79.569789] nix-daemon[843]: reaped child process 1300, status = succeeded5451worker1 # [ 79.732108] nix-daemon[843]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5452worker1 # [ 79.743946] nix-daemon[843]: reaped child process 1305, status = succeeded5453lb # [ 79.753900] niks3-server[1021]: 2026/09/20 13:35:20 INFO Received uploads request method=POST path=/api/pending_closures5454worker1 # [ 79.772585] nix-grpc-daemon[1284]: time=2026-09-20T13:35:20.849Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5455worker1 # [ 79.775744] nix-grpc-daemon[1284]: time=2026-09-20T13:35:20.851Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5456lb # [ 79.797129] niks3-server[1021]: 2026/09/20 13:35:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5457worker1 # [ 79.814771] nix-grpc-daemon[1284]: time=2026-09-20T13:35:20.891Z level=INFO msg="Uploading 1 narinfos"5458lb # [ 79.809134] niks3-server[1021]: 2026/09/20 13:35:20 INFO Signed narinfos id=27 count=15459lb # [ 79.814125] niks3-server[1021]: 2026/09/20 13:35:20 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5460lb # [ 79.835714] niks3-server[1021]: 2026/09/20 13:35:20 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5461lb # [ 79.841867] niks3-server[1021]: 2026/09/20 13:35:20 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5462lb # [ 79.844337] niks3-server[1021]: 2026/09/20 13:35:20 INFO Completed upload id=275463lb # [ 79.846090] niks3-server[1021]: 2026/09/20 13:35:20 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5464worker1 # [ 79.851284] nix-grpc-daemon[1284]: time=2026-09-20T13:35:20.928Z level=INFO msg="Upload complete. (446ms)"5465worker1 # [ 79.857649] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=0 paths=1 nar_bytes_in=5205466worker1 # [ 79.863870] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765467worker1 # [ 79.874144] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5468worker1 # [ 79.881944] nix-daemon[843]: reaped child process 1282, status = succeeded5469worker1 # [ 79.890262] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5470client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5471client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5472client # farm-a> LOG-farm-a-on-standby5473worker1 # [ 80.916557] nix-daemon[843]: reaped child process 1309, status = succeeded5474worker1 # [ 81.063775] nix-daemon[843]: accepted connection from pid 1324, user nix-grpc-daemon (trusted)5475worker1 # [ 81.074645] nix-daemon[843]: reaped child process 1327, status = succeeded5476lb # [ 81.083528] niks3-server[1021]: 2026/09/20 13:35:21 INFO Received uploads request method=POST path=/api/pending_closures5477worker1 # [ 81.098036] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.175Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5478worker1 # [ 81.099614] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.176Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5479lb # [ 81.125751] niks3-server[1021]: 2026/09/20 13:35:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5480worker1 # [ 81.144619] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.221Z level=INFO msg="Uploading 1 narinfos"5481lb # [ 81.138419] niks3-server[1021]: 2026/09/20 13:35:22 INFO Signed narinfos id=28 count=15482lb # [ 81.143383] niks3-server[1021]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5483lb # [ 81.150550] niks3-server[1021]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5484lb # [ 81.154615] niks3-server[1021]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5485lb # [ 81.163521] niks3-server[1021]: 2026/09/20 13:35:22 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5486lb # [ 81.171679] niks3-server[1021]: 2026/09/20 13:35:22 INFO Completed upload id=285487lb # [ 81.172907] niks3-server[1021]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5488worker1 # [ 81.178551] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.255Z level=INFO msg="Upload complete. (281ms)"5489worker1 # [ 81.191600] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15490worker1 # [ 81.206948] nix-daemon[843]: reaped child process 1307, status = succeeded5491worker1 # [ 81.208375] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05492worker1 # [ 81.210184] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15493worker1 # [ 81.251732] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765494worker1 # [ 81.264652] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431765495worker1 # [ 81.277552] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.354Z level=INFO msg="All 1 paths already cached"5496client # copying 1 paths to 'lb:50051'...5497client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5498worker1 # [ 81.285781] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431765499worker1 # [ 81.295177] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5500worker1 # [ 81.432195] nix-daemon[843]: accepted connection from pid 1333, user nix-grpc-daemon (trusted)5501worker1 # [ 81.444961] nix-daemon[843]: reaped child process 1336, status = succeeded5502worker1 # [ 81.570472] nix-daemon[843]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5503worker1 # [ 81.582783] nix-daemon[843]: reaped child process 1341, status = succeeded5504lb # [ 81.585629] niks3-server[1021]: 2026/09/20 13:35:22 INFO Received uploads request method=POST path=/api/pending_closures5505worker1 # [ 81.601141] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.678Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5506worker1 # [ 81.602488] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.678Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5507lb # [ 81.611892] niks3-server[1021]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5508lb # [ 81.622447] niks3-server[1021]: 2026/09/20 13:35:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5509worker1 # [ 81.633974] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.711Z level=INFO msg="Uploading 1 narinfos"5510lb # [ 81.627572] niks3-server[1021]: 2026/09/20 13:35:22 INFO Signed narinfos id=29 count=15511lb # [ 81.633939] niks3-server[1021]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5512lb # [ 81.645691] niks3-server[1021]: 2026/09/20 13:35:22 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5513worker1 # [ 81.658100] nix-grpc-daemon[1284]: time=2026-09-20T13:35:22.735Z level=INFO msg="Upload complete. (351ms)"5514lb # [ 81.651567] niks3-server[1021]: 2026/09/20 13:35:22 INFO Completed upload id=295515worker1 # [ 81.660300] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=0 paths=1 nar_bytes_in=6405516worker1 # [ 81.663067] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765517lb # [ 81.656218] niks3-server[1021]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5518worker1 # [ 81.669667] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5519worker1 # [ 81.673288] nix-daemon[843]: reaped child process 1331, status = succeeded5520client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5521client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5522worker1 # [ 81.677552] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5523client # farm-b> LOG-farm-b-on-standby5524worker1 # [ 83.101322] nix-daemon[843]: reaped child process 1345, status = succeeded5525worker1 # [ 83.255325] nix-daemon[843]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5526worker1 # [ 83.267328] nix-daemon[843]: reaped child process 1363, status = succeeded5527lb # [ 83.272605] niks3-server[1021]: 2026/09/20 13:35:24 INFO Received uploads request method=POST path=/api/pending_closures5528worker1 # [ 83.289696] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.366Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5529worker1 # [ 83.291842] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.368Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5530lb # [ 83.313774] niks3-server[1021]: 2026/09/20 13:35:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5531worker1 # [ 83.329892] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.407Z level=INFO msg="Uploading 1 narinfos"5532lb # [ 83.323293] niks3-server[1021]: 2026/09/20 13:35:24 INFO Signed narinfos id=30 count=15533lb # [ 83.332167] niks3-server[1021]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5534lb # [ 83.338944] niks3-server[1021]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5535lb # [ 83.343834] niks3-server[1021]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5536lb # [ 83.352125] niks3-server[1021]: 2026/09/20 13:35:24 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5537lb # [ 83.357750] niks3-server[1021]: 2026/09/20 13:35:24 INFO Completed upload id=305538lb # [ 83.359082] niks3-server[1021]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5539worker1 # [ 83.365801] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.442Z level=INFO msg="Upload complete. (278ms)"5540worker1 # [ 83.375536] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15541worker1 # [ 83.383695] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05542worker1 # [ 83.388649] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15543worker1 # [ 83.396833] nix-daemon[843]: reaped child process 1343, status = succeeded5544worker1 # [ 83.428142] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765545worker1 # [ 83.440764] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431765546worker1 # [ 83.453683] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.530Z level=INFO msg="All 2 paths already cached"5547client # copying 1 paths to 'lb:50051'...5548client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5549worker1 # [ 83.461763] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431765550worker1 # [ 83.472170] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5551worker1 # [ 83.630632] nix-daemon[843]: accepted connection from pid 1369, user nix-grpc-daemon (trusted)5552worker1 # [ 83.642923] nix-daemon[843]: reaped child process 1372, status = succeeded5553worker1 # [ 83.775364] nix-daemon[843]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5554worker1 # [ 83.787708] nix-daemon[843]: reaped child process 1377, status = succeeded5555lb # [ 83.791976] niks3-server[1021]: 2026/09/20 13:35:24 INFO Received uploads request method=POST path=/api/pending_closures5556worker1 # [ 83.806040] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.883Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5557worker1 # [ 83.808102] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.884Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5558lb # [ 83.818452] niks3-server[1021]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5559lb # [ 83.829641] niks3-server[1021]: 2026/09/20 13:35:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5560lb # [ 83.835734] niks3-server[1021]: 2026/09/20 13:35:24 INFO Signed narinfos id=31 count=15561worker1 # [ 83.845383] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.922Z level=INFO msg="Uploading 1 narinfos"5562lb # [ 83.840842] niks3-server[1021]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5563lb # [ 83.852060] niks3-server[1021]: 2026/09/20 13:35:24 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5564lb # [ 83.858983] niks3-server[1021]: 2026/09/20 13:35:24 INFO Completed upload id=315565worker1 # [ 83.868257] nix-grpc-daemon[1284]: time=2026-09-20T13:35:24.945Z level=INFO msg="Upload complete. (384ms)"5566lb # [ 83.861709] niks3-server[1021]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5567worker1 # [ 83.870285] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=0 paths=1 nar_bytes_in=7685568worker1 # [ 83.875382] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765569worker1 # [ 83.884952] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5570worker1 # [ 83.887458] nix-daemon[843]: reaped child process 1367, status = succeeded5571worker1 # [ 83.892623] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5572client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5573client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5574client # farm-top> LOG-farm-top-on-standby5575worker1 # [ 84.923793] nix-daemon[843]: reaped child process 1381, status = succeeded5576worker1 # [ 85.049938] nix-daemon[843]: accepted connection from pid 1396, user nix-grpc-daemon (trusted)5577worker1 # [ 85.062498] nix-daemon[843]: reaped child process 1399, status = succeeded5578lb # [ 85.066537] niks3-server[1021]: 2026/09/20 13:35:25 INFO Received uploads request method=POST path=/api/pending_closures5579worker1 # [ 85.077625] nix-grpc-daemon[1284]: time=2026-09-20T13:35:26.154Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5580worker1 # [ 85.079367] nix-grpc-daemon[1284]: time=2026-09-20T13:35:26.156Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5581lb # [ 85.086226] niks3-server[1021]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5582lb # [ 85.090251] niks3-server[1021]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5583lb # [ 85.093284] niks3-server[1021]: 2026/09/20 13:35:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5584lb # [ 85.095686] niks3-server[1021]: 2026/09/20 13:35:25 INFO Signed narinfos id=32 count=15585worker1 # [ 85.102474] nix-grpc-daemon[1284]: time=2026-09-20T13:35:26.179Z level=INFO msg="Uploading 1 narinfos"5586lb # [ 85.099025] niks3-server[1021]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5587lb # [ 85.103285] niks3-server[1021]: 2026/09/20 13:35:25 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5588lb # [ 85.106268] niks3-server[1021]: 2026/09/20 13:35:25 INFO Completed upload id=325589worker1 # [ 85.113992] nix-grpc-daemon[1284]: time=2026-09-20T13:35:26.191Z level=INFO msg="Upload complete. (213ms)"5590lb # [ 85.107995] niks3-server[1021]: 2026/09/20 13:35:26 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5591worker1 # [ 85.118316] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15592worker1 # [ 85.124262] nix-daemon[843]: reaped child process 1379, status = succeeded5593client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.86 seconds)5594client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5595client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5596worker2 # [ 85.461371] systemd[1]: Listening on Nix worker-protocol over gRPC.5597worker2 # [ 85.467143] systemd[1]: Starting scheduler-token.service...5598worker2 # [ 85.541087] systemd[1]: scheduler-token.service: Deactivated successfully.5599worker2 # [ 85.543058] systemd[1]: Finished scheduler-token.service.5600worker2 # [ 85.543793] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 74ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5601worker2 # [ 85.549448] systemd[1]: Starting Nix worker-protocol over gRPC...5602worker2 # [ 85.723244] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5603worker2 # [ 85.725147] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5604worker2 # [ 85.729424] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15605worker2 # [ 85.738061] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5606worker2 # [ 85.741183] systemd[1]: Started Nix worker-protocol over gRPC.5607lb: must succeed: curl -sf localhost:9901/clusters5608worker2 # [ 85.754289] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:26Z level=info event=scheduler_connected addr=lb:500515609worker1 # [ 85.749202] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:26Z level=info event=oidc_jwks provider=mock keys=15610worker1 # [ 85.753442] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:26Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:431605611worker1 # [ 85.757855] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05612lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5613worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5614worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5615lb: must succeed: curl -sf localhost:9901/clusters5616lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5617lb: must succeed: curl -sf localhost:9901/clusters5618lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5619worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5620worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5621(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.63 seconds)5622subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5623client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5624client # [ 85.998397] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5625client # Running as unit: rs.service; invocation ID: caddcc84794f41289eaa0419b0a47a685626client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5627client # [ 86.196240] nix[1178]: don't know how to build these paths:5628client # [ 86.197157] nix[1178]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5629worker1 # [ 86.226163] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:431765630worker1 # [ 86.237079] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05631worker1 # [ 86.242227] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15632worker1 # [ 86.281074] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765633worker1 # [ 86.293336] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431765634client # [ 86.273255] nix[1178]: copying 1 paths to 'lb:50051'...5635worker1 # [ 86.304519] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431765636client # [ 86.275297] nix[1178]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5637worker1 # [ 86.317289] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5638worker1 # [ 86.462341] nix-daemon[843]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5639worker1 # [ 86.476146] nix-daemon[843]: reaped child process 1415, status = succeeded5640worker1 # [ 86.607688] nix-daemon[843]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5641worker1 # [ 86.619944] nix-daemon[843]: reaped child process 1420, status = succeeded5642lb # [ 86.623137] niks3-server[1021]: 2026/09/20 13:35:27 INFO Received uploads request method=POST path=/api/pending_closures5643worker1 # [ 86.634644] nix-grpc-daemon[1284]: time=2026-09-20T13:35:27.711Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5644worker1 # [ 86.635993] nix-grpc-daemon[1284]: time=2026-09-20T13:35:27.711Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5645lb # [ 86.638752] niks3-server[1021]: 2026/09/20 13:35:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5646lb # [ 86.641974] niks3-server[1021]: 2026/09/20 13:35:27 INFO Signed narinfos id=33 count=15647worker1 # [ 86.648816] nix-grpc-daemon[1284]: time=2026-09-20T13:35:27.726Z level=INFO msg="Uploading 1 narinfos"5648lb # [ 86.644399] niks3-server[1021]: 2026/09/20 13:35:27 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5649lb # [ 86.649861] niks3-server[1021]: 2026/09/20 13:35:27 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5650lb # [ 86.652475] niks3-server[1021]: 2026/09/20 13:35:27 INFO Completed upload id=335651worker1 # [ 86.660279] nix-grpc-daemon[1284]: time=2026-09-20T13:35:27.737Z level=INFO msg="Upload complete. (332ms)"5652lb # [ 86.654957] niks3-server[1021]: 2026/09/20 13:35:27 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5653worker1 # [ 86.662348] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=0 paths=1 nar_bytes_in=4165654lb # [ 86.657628] niks3-server[1021]: 2026/09/20 13:35:27 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5655worker1 # [ 86.666259] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431765656worker1 # [ 86.673224] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5657worker1 # [ 86.674518] nix-daemon[843]: reaped child process 1410, status = succeeded5658worker1 # [ 86.679848] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5659client # [ 86.649938] nix[1178]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5660lb # [ 88.302522] envoy[920]: conn peer=[2001:db8:1::1]:48472 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9564 tx=3836 ms=66345661lb: must succeed: curl -sf localhost:9901/clusters5662lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5663lb: must succeed: curl -sf localhost:9901/clusters5664lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5665lb: must succeed: curl -sf localhost:9901/clusters5666lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5667lb: must succeed: curl -sf localhost:9901/clusters5668lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5669worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5670worker2 # [ 88.890467] systemd-journald[286]: Received client request to rotate journal, rotating.5671worker2 # [ 88.912483] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/6799bd020d6846d195ade87c9402468a.5672worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5673worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5674worker1 # [ 88.817726] systemd[1]: Stopping Nix worker-protocol over gRPC...5675worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5676??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5677 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735678client: must succeed: sleep 5.05679worker1 # [ 89.233465] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:30Z level=info event=draining5680client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5681worker1 # [ 94.098705] nix-daemon[843]: reaped child process 1424, status = succeeded5682worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5683worker1 # [ 94.261096] nix-daemon[843]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)5684worker1 # [ 94.272230] nix-daemon[843]: reaped child process 1467, status = succeeded5685lb # [ 94.284457] niks3-server[1021]: 2026/09/20 13:35:35 INFO Received uploads request method=POST path=/api/pending_closures5686worker1 # [ 94.300939] nix-grpc-daemon[1284]: time=2026-09-20T13:35:35.378Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5687worker1 # [ 94.303607] nix-grpc-daemon[1284]: time=2026-09-20T13:35:35.379Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5688lb # [ 94.332844] niks3-server[1021]: 2026/09/20 13:35:35 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5689lb # [ 94.338685] niks3-server[1021]: 2026/09/20 13:35:35 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5690lb # [ 94.350392] niks3-server[1021]: 2026/09/20 13:35:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5691lb # [ 94.353936] niks3-server[1021]: 2026/09/20 13:35:35 INFO Signed narinfos id=34 count=15692worker1 # [ 94.363812] nix-grpc-daemon[1284]: time=2026-09-20T13:35:35.440Z level=INFO msg="Uploading 1 narinfos"5693lb # [ 94.360810] niks3-server[1021]: 2026/09/20 13:35:35 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5694lb # [ 94.370495] niks3-server[1021]: 2026/09/20 13:35:35 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5695lb # [ 94.373740] niks3-server[1021]: 2026/09/20 13:35:35 INFO Completed upload id=345696lb # [ 94.375472] niks3-server[1021]: 2026/09/20 13:35:35 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5697worker1 # [ 94.381805] nix-grpc-daemon[1284]: time=2026-09-20T13:35:35.459Z level=INFO msg="Upload complete. (289ms)"5698worker1 # [ 94.390602] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43176 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15699worker1 # [ 94.402868] nix-daemon[843]: reaped child process 1422, status = succeeded5700client # [ 94.397303] systemd[1]: rs.service: Deactivated successfully.5701client # [ 94.401169] systemd[1]: rs.service: Consumed 116ms CPU time over 8.401s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5702worker1 # [ 95.233604] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=signal_exit5703worker1 # [ 95.453693] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=scheduler_yield5704worker1 # [ 95.456624] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=scheduler_restarting addr=lb:500515705lb # [ 95.450399] niks3-server[1021]: 2026/09/20 13:35:36 INFO lead: released remote=192.168.1.3:432205706worker1 # [ 95.459569] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:431605707worker2 # [ 95.471832] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:36Z level=info event=scheduler_restarting addr=lb:500515708worker1 # [ 95.461415] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=worker_gone addr=192.168.1.3:500515709worker1 # [ 95.462872] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:431605710worker1 # [ 95.464389] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=worker_gone addr=192.168.1.4:500515711worker1 # [ 95.657337] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=scheduler_connected addr=lb:500515712worker1 # [ 95.660283] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5713worker2 # [ 95.672223] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:36Z level=info event=scheduler_connected addr=lb:500515714worker2 # [ 95.676546] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5715lb # [ 95.728911] niks3-server[1021]: 2026/09/20 13:35:36 INFO lead: acquired remote=192.168.1.4:603845716worker2 # [ 95.750053] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:36Z level=info event=scheduler_take_over5717worker1 # [ 95.860940] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=scheduler_connected addr=lb:500515718worker1 # [ 95.862659] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5719worker2 # [ 95.878468] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:36Z level=info event=scheduler_connected addr=lb:500515720worker2 # [ 95.881650] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5721worker1 # [ 96.063660] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:500515722worker2 # [ 96.080640] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:500515723worker1 # [ 96.067580] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5724worker2 # [ 96.083878] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5725worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.16 seconds)5726client: waiting for success: ! systemctl is-active rs5727worker1 # [ 96.268441] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:500515728worker2 # [ 96.281777] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:500515729worker2 # [ 96.284955] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5730worker1 # [ 96.272488] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5731client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5732client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5733client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5734client: must fail: journalctl -u rs | grep -q 'reconnecting'5735client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5736lb: must succeed: curl -sf localhost:9901/clusters5737lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5738worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5739worker1 # [ 96.457911] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:37Z level=info event=scheduler_restarting5740worker2 # [ 96.487937] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:500515741worker2 # [ 96.491909] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5742worker1 # [ 96.484227] nix-grpc-daemon[1211]: ts=2026-09-20T13:35:37Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5743worker1 # [ 96.493647] nix-daemon[843]: reaped child process 1275, status = succeeded5744worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5745worker2 # [ 96.692602] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:500515746worker2 # [ 96.696540] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5747worker1 # [ 96.748688] nix-grpc-daemon[1211]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5748worker1 # [ 96.752199] nix-grpc-daemon[1211]: E0000 00:00:1789911337.825144 1254 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5749worker1 # [ 96.756774] nix-grpc-daemon[1211]: E0000 00:00:1789911337.825818 1254 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5750worker2 # [ 96.897927] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:500515751worker2 # [ 96.901993] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5752worker2 # [ 97.103541] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:500515753worker2 # [ 97.107765] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5754worker2 # [ 97.309171] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:500515755worker2 # [ 97.322144] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:38Z level=info event=oidc_jwks provider=mock keys=15756worker2 # [ 97.325913] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:38Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:499405757worker2 # [ 97.329715] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:38Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05758lb: must succeed: curl -sf localhost:9901/clusters5759lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5760worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5761worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5762worker1 # [ 97.880754] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5763worker1 # [ 97.882487] systemd[1]: Stopped Nix worker-protocol over gRPC.5764worker1 # [ 97.883328] systemd[1]: nix-grpc-daemon.service: Consumed 1.254s CPU time over 25.839s wall clock time, 33.4M memory peak, 49K incoming IP traffic, 89K outgoing IP traffic.5765worker1 # [ 97.890671] systemd[1]: Starting Nix worker-protocol over gRPC...5766worker1 # [ 98.059436] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5767worker1 # [ 98.061271] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5768worker1 # [ 98.064882] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15769worker1 # [ 98.072805] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5770worker1 # [ 98.075198] systemd[1]: Started Nix worker-protocol over gRPC.5771worker1 # [ 98.087038] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:39Z level=info event=scheduler_connected addr=lb:500515772worker2 # [ 98.102751] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:39Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:499405773worker2 # [ 98.106857] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05774lb # [ 98.303501] envoy[920]: conn peer=[2001:db8:1::1]:33018 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1331 ms=81795775lb # [ 98.307454] envoy[920]: conn peer=[2001:db8:1::3]:60174 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5767 tx=1349 ms=242405776lb: must succeed: curl -sf localhost:9901/clusters5777lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5778worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5779worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5780(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.80 seconds)5781subtest: scheduler restart mid-build: build finishes, no double build5782client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5783client # [ 98.820610] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5784client # Running as unit: mid.service; invocation ID: 3962baa863a94da7951bdb8f85e3de7e5785client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5786worker1 # [ 99.042996] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457045787worker1 # [ 99.054464] nix-daemon[843]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)5788client # [ 99.036191] nix[1214]: don't know how to build these paths:5789client # [ 99.037154] nix[1214]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5790worker2 # [ 99.088850] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:40Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05791worker2 # [ 99.094325] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:40Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15792worker2 # [ 99.142872] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499505793worker2 # [ 99.155382] nix-daemon[855]: accepted connection from pid 1180, user nix-grpc-daemon (trusted)5794worker2 # [ 99.177462] nix-grpc-daemon[1180]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5795worker2 # [ 99.221389] nix-grpc-daemon[1180]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 2/5)5796worker2 # [ 99.321802] nix-grpc-daemon[1180]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 208 ms (attempt 3/5)5797worker2 # [ 99.530292] nix-grpc-daemon[1180]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 661 ms (attempt 4/5)5798worker2 # [ 100.198710] nix-grpc-daemon[1180]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5799worker2 # [ 100.217566] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499505800client # [ 100.186977] nix[1214]: copying 1 paths to 'lb:50051'...5801worker2 # [ 100.230501] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499505802client # [ 100.191185] nix[1214]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5803worker2 # [ 100.243410] nix-daemon[855]: accepted connection from pid 1180, user nix-grpc-daemon (trusted)5804worker2 # [ 100.264263] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:41Z level=info event=niks3_push_started pid=13055805worker2 # [ 100.461044] nix-grpc-daemon[1305]: time=2026-09-20T13:35:41.448Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5806worker2 # [ 100.627122] nix-daemon[855]: accepted connection from pid 1318, user nix-grpc-daemon (trusted)5807worker2 # [ 100.641275] nix-daemon[855]: reaped child process 1321, status = succeeded5808worker2 # [ 100.809220] nix-daemon[855]: accepted connection from pid 1323, user nix-grpc-daemon (trusted)5809worker2 # [ 100.823232] nix-daemon[855]: reaped child process 1326, status = succeeded5810lb # [ 100.819457] niks3-server[1021]: 2026/09/20 13:35:41 INFO Received uploads request method=POST path=/api/pending_closures5811worker2 # [ 100.848085] nix-grpc-daemon[1305]: time=2026-09-20T13:35:41.837Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5812worker2 # [ 100.849659] nix-grpc-daemon[1305]: time=2026-09-20T13:35:41.838Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5813lb # [ 100.851717] niks3-server[1021]: 2026/09/20 13:35:41 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5814lb # [ 100.862339] niks3-server[1021]: 2026/09/20 13:35:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5815worker2 # [ 100.887360] nix-grpc-daemon[1305]: time=2026-09-20T13:35:41.876Z level=INFO msg="Uploading 1 narinfos"5816lb # [ 100.868263] niks3-server[1021]: 2026/09/20 13:35:41 INFO Signed narinfos id=35 count=15817lb # [ 100.880959] niks3-server[1021]: 2026/09/20 13:35:41 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5818lb # [ 100.885683] niks3-server[1021]: 2026/09/20 13:35:41 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5819worker2 # [ 100.907410] nix-grpc-daemon[1305]: time=2026-09-20T13:35:41.896Z level=INFO msg="Upload complete. (443ms)"5820lb # [ 100.888781] niks3-server[1021]: 2026/09/20 13:35:41 INFO Completed upload id=355821worker2 # [ 100.910192] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49950 duration_s=0 paths=1 nar_bytes_in=4245822worker2 # [ 100.913281] nix-grpc-daemon[1305]: time=2026-09-20T13:35:41.898Z level=WARN msg="Failed to register uploaded object" key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo error="server returned 404: object is not pending upload\n"5823worker2 # [ 100.915531] nix-grpc-daemon[1180]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499505824worker2 # [ 100.922130] nix-daemon[855]: accepted connection from pid 1180, user nix-grpc-daemon (trusted)5825worker2 # [ 100.927097] nix-daemon[855]: reaped child process 1303, status = succeeded5826worker2 # [ 100.932096] nix-daemon[855]: accepted connection from pid 1180, user nix-grpc-daemon (trusted)5827client # [ 100.888739] nix[1214]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5828lb: must succeed: curl -sf localhost:9901/clusters5829lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5830lb: must succeed: curl -sf localhost:9901/clusters5831lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5832worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5833worker2 # [ 102.662991] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1180 (nix-grpc-daemon) on client request.5834worker2 # [ 102.665423] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5835lb # [ 102.646864] niks3-server[1021]: 2026/09/20 13:35:43 INFO lead: released remote=192.168.1.4:603845836client # [ 102.630755] nix[1214]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5837worker1 # [ 102.660345] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5838client # [ 102.634816] nix[1214]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5839worker2 # [ 102.685206] systemd[1]: Starting scheduler-token.service...5840worker2 # [ 102.697448] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5841worker2 # [ 102.699127] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5842worker2 # [ 102.700407] systemd[1]: nix-grpc-daemon.service: Consumed 482ms CPU time over 17.143s wall clock time, 31M memory peak, 17K incoming IP traffic, 30.9K outgoing IP traffic.5843worker2 # [ 102.706418] nix-daemon[855]: reaped child process 1328, status = succeeded5844worker2 # [ 102.708203] nix-daemon[855]: reaped child process 1294, status = succeeded5845worker2 # [ 102.717276] nix-daemon[1330]: unexpected Nix daemon error: error: interrupted by the user5846worker2 # [ 102.723305] nix-daemon[855]: reaped child process 1330, status = failed with exit code 15847worker2 # [ 102.764994] systemd[1]: scheduler-token.service: Deactivated successfully.5848worker2 # [ 102.766602] systemd[1]: Finished scheduler-token.service.5849worker2 # [ 102.768169] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 80ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5850worker2 # [ 102.771125] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5851worker2 # [ 102.775538] systemd[1]: Starting scheduler-token.service...5852worker2 # [ 102.834790] systemd[1]: scheduler-token.service: Deactivated successfully.5853worker2 # [ 102.835899] systemd[1]: Finished scheduler-token.service.5854worker2 # [ 102.837318] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 59ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5855worker2 # [ 102.842626] systemd[1]: Starting Nix worker-protocol over gRPC...5856worker1 # [ 102.860691] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:43Z level=info event=scheduler_connected addr=lb:500515857worker2 # [ 102.986979] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:43Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5858worker2 # [ 102.988653] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5859worker2 # [ 102.991855] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15860worker2 # [ 102.998814] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5861worker2 # [ 103.003148] systemd[1]: Started Nix worker-protocol over gRPC.5862worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.39 seconds)5863client: must succeed: sleep 5.05864worker2 # [ 103.013580] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=info event=scheduler_take_over5865lb # [ 102.994776] niks3-server[1021]: 2026/09/20 13:35:43 INFO lead: acquired remote=192.168.1.4:544625866worker2 # [ 103.019340] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:541585867worker2 # [ 103.021703] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05868worker2 # [ 103.024574] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=info event=scheduler_connected addr=lb:500515869worker2 # [ 103.029063] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=info event=oidc_jwks provider=mock keys=15870worker2 # [ 103.030623] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:541585871worker2 # [ 103.032266] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05872worker2 # [ 103.182592] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05873worker2 # [ 103.187288] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:44Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15874worker1 # [ 103.215536] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457045875worker1 # [ 103.227771] nix-grpc-daemon[1474]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)5876worker1 # [ 103.264220] nix-grpc-daemon[1474]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 119 ms (attempt 2/5)5877worker1 # [ 103.385874] nix-grpc-daemon[1474]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 211 ms (attempt 3/5)5878worker1 # [ 103.597309] nix-grpc-daemon[1474]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 339 ms (attempt 4/5)5879worker1 # [ 103.937853] nix-grpc-daemon[1474]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5880worker1 # [ 103.953583] nix-grpc-daemon[1474]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5881worker1 # [ 103.977656] nix-daemon[843]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)5882client # [ 103.958851] nix[1214]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5883worker1 # [ 103.990823] nix-daemon[843]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)5884client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5885client: waiting for success: ! systemctl is-active mid5886lb # [ 108.303643] envoy[920]: conn peer=[2001:db8:1::4]:56870 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=8646 tx=623 ms=169215887worker1 # [ 108.415301] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:49Z level=info event=niks3_push_started pid=15755888worker1 # [ 108.443487] nix-daemon[843]: reaped child process 1551, status = succeeded5889worker1 # [ 108.628741] nix-grpc-daemon[1575]: time=2026-09-20T13:35:49.705Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5890worker1 # [ 108.769356] nix-daemon[843]: accepted connection from pid 1588, user nix-grpc-daemon (trusted)5891worker1 # [ 108.780423] nix-daemon[843]: reaped child process 1591, status = succeeded5892lb # [ 108.793833] niks3-server[1021]: 2026/09/20 13:35:49 INFO Received uploads request method=POST path=/api/pending_closures5893worker1 # [ 108.812224] nix-grpc-daemon[1575]: time=2026-09-20T13:35:49.889Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5894worker1 # [ 108.813724] nix-grpc-daemon[1575]: time=2026-09-20T13:35:49.891Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5895lb # [ 108.832083] niks3-server[1021]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5896lb # [ 108.839496] niks3-server[1021]: 2026/09/20 13:35:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5897worker1 # [ 108.848587] nix-grpc-daemon[1575]: time=2026-09-20T13:35:49.925Z level=INFO msg="Uploading 1 narinfos"5898lb # [ 108.841964] niks3-server[1021]: 2026/09/20 13:35:49 INFO Signed narinfos id=36 count=15899lb # [ 108.850589] niks3-server[1021]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5900lb # [ 108.855772] niks3-server[1021]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5901lb # [ 108.860186] niks3-server[1021]: 2026/09/20 13:35:49 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5902lb # [ 108.863477] niks3-server[1021]: 2026/09/20 13:35:49 INFO Completed upload id=365903worker1 # [ 108.870167] nix-grpc-daemon[1575]: time=2026-09-20T13:35:49.947Z level=INFO msg="Upload complete. (237ms)"5904worker1 # [ 108.872501] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45704 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15905lb # [ 108.868534] niks3-server[1021]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5906worker1 # [ 108.879335] nix-daemon[843]: reaped child process 1549, status = succeeded5907client # [ 108.879733] systemd[1]: mid.service: Deactivated successfully.5908client # [ 108.881739] systemd[1]: mid.service: Consumed 126ms CPU time over 10.058s wall clock time, 37.3M memory peak, 9.7K incoming IP traffic, 10.6K outgoing IP traffic.5909client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds)5910client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5911client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5912(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.60 seconds)5913subtest: interrupting the client stops the build on the worker5914client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5915client # [ 109.396440] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5916client # Running as unit: intr.service; invocation ID: 19620d00f6744ad486e565be42c71f625917client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5918client # [ 109.584486] nix[1250]: don't know how to build these paths:5919client # [ 109.585352] nix[1250]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5920worker1 # [ 109.614438] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457045921worker2 # [ 109.639170] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:50Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05922worker2 # [ 109.643321] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:50Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15923worker2 # [ 109.685806] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541905924worker2 # [ 109.697653] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)5925worker2 # [ 109.714960] nix-grpc-daemon[1372]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5926worker2 # [ 109.759313] nix-grpc-daemon[1372]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 2/5)5927worker2 # [ 109.814307] nix-grpc-daemon[1372]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 214 ms (attempt 3/5)5928worker2 # [ 110.034307] nix-grpc-daemon[1372]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 617 ms (attempt 4/5)5929worker2 # [ 110.661284] nix-grpc-daemon[1372]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5930worker2 # [ 110.676529] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541905931client # [ 110.643340] nix[1250]: copying 1 paths to 'lb:50051'...5932worker2 # [ 110.689833] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541905933client # [ 110.646949] nix[1250]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5934worker2 # [ 110.698931] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)5935worker2 # [ 110.710895] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:51Z level=info event=niks3_push_started pid=14485936worker2 # [ 110.866426] nix-grpc-daemon[1448]: time=2026-09-20T13:35:51.854Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5937worker2 # [ 111.010501] nix-daemon[855]: accepted connection from pid 1461, user nix-grpc-daemon (trusted)5938worker2 # [ 111.025584] nix-daemon[855]: reaped child process 1464, status = succeeded5939worker2 # [ 111.187193] nix-daemon[855]: accepted connection from pid 1466, user nix-grpc-daemon (trusted)5940worker2 # [ 111.203675] nix-daemon[855]: reaped child process 1469, status = succeeded5941lb # [ 111.200956] niks3-server[1021]: 2026/09/20 13:35:52 INFO Received uploads request method=POST path=/api/pending_closures5942worker2 # [ 111.232868] nix-grpc-daemon[1448]: time=2026-09-20T13:35:52.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5943worker2 # [ 111.234597] nix-grpc-daemon[1448]: time=2026-09-20T13:35:52.220Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5944lb # [ 111.235926] niks3-server[1021]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5945lb # [ 111.250298] niks3-server[1021]: 2026/09/20 13:35:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5946worker2 # [ 111.278375] nix-grpc-daemon[1448]: time=2026-09-20T13:35:52.266Z level=INFO msg="Uploading 1 narinfos"5947lb # [ 111.258972] niks3-server[1021]: 2026/09/20 13:35:52 INFO Signed narinfos id=37 count=15948lb # [ 111.264689] niks3-server[1021]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5949lb # [ 111.274284] niks3-server[1021]: 2026/09/20 13:35:52 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5950lb # [ 111.282994] niks3-server[1021]: 2026/09/20 13:35:52 INFO Completed upload id=375951lb # [ 111.284285] niks3-server[1021]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5952worker2 # [ 111.302394] nix-grpc-daemon[1448]: time=2026-09-20T13:35:52.291Z level=INFO msg="Upload complete. (432ms)"5953worker2 # [ 111.306590] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=0 paths=1 nar_bytes_in=4245954worker2 # [ 111.312243] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541905955worker2 # [ 111.320471] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)5956worker2 # [ 111.325354] nix-daemon[855]: reaped child process 1446, status = succeeded5957worker2 # [ 111.331090] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)5958client # [ 111.286524] nix[1250]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5959client: must succeed: systemctl kill -s INT intr5960client # [ 112.906878] systemd[1]: intr.service: Sent signal SIGINT to main process 1250 (nix) on client request.5961client # [ 112.914299] nix[1250]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5962client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5963client # [ 112.921169] nix[1250]: error: interrupted by the user5964client # [ 112.951245] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5965client # [ 112.952760] systemd[1]: intr.service: Failed with result 'exit-code'.5966client # [ 112.954982] systemd[1]: intr.service: Consumed 106ms CPU time over 3.557s wall clock time, 39.1M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5967worker2 # [ 113.147872] nix-daemon[855]: reaped child process 1471, status = succeeded5968worker2 # [ 113.150240] nix-daemon[1473]: unexpected Nix daemon error: error: interrupted by the user5969worker2 # [ 113.153922] nix-daemon[855]: reaped child process 1473, status = failed with exit code 15970(finished: subtest: interrupting the client stops the build on the worker, in 4.77 seconds)5971subtest: a deploy mid-build drains: the build finishes, the new generation takes over5972client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5973client # [ 114.194470] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5974client # Running as unit: sw.service; invocation ID: 95ce42ea207548a0a2c4383755ae0d9f5975client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5976worker1 # [ 114.428876] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457045977client # [ 114.404294] nix[1271]: don't know how to build these paths:5978client # [ 114.405142] nix[1271]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5979worker2 # [ 114.457534] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:55Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05980worker2 # [ 114.462222] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:55Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=15981worker1 # [ 114.487492] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457045982worker1 # [ 114.498635] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457045983client # [ 114.476356] nix[1271]: copying 1 paths to 'lb:50051'...5984worker1 # [ 114.507744] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457045985client # [ 114.478683] nix[1271]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5986worker1 # [ 114.520519] nix-daemon[843]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)5987worker1 # [ 114.701713] nix-daemon[843]: accepted connection from pid 1623, user nix-grpc-daemon (trusted)5988worker1 # [ 114.714278] nix-daemon[843]: reaped child process 1626, status = succeeded5989worker1 # [ 114.872719] nix-daemon[843]: accepted connection from pid 1628, user nix-grpc-daemon (trusted)5990worker1 # [ 114.886144] nix-daemon[843]: reaped child process 1631, status = succeeded5991lb # [ 114.890069] niks3-server[1021]: 2026/09/20 13:35:55 INFO Received uploads request method=POST path=/api/pending_closures5992worker1 # [ 114.902525] nix-grpc-daemon[1575]: time=2026-09-20T13:35:55.979Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5993worker1 # [ 114.904061] nix-grpc-daemon[1575]: time=2026-09-20T13:35:55.981Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5994lb # [ 114.907630] niks3-server[1021]: 2026/09/20 13:35:55 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5995lb # [ 114.910932] niks3-server[1021]: 2026/09/20 13:35:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5996lb # [ 114.912785] niks3-server[1021]: 2026/09/20 13:35:55 INFO Signed narinfos id=38 count=15997worker1 # [ 114.920700] nix-grpc-daemon[1575]: time=2026-09-20T13:35:55.997Z level=INFO msg="Uploading 1 narinfos"5998lb # [ 114.917483] niks3-server[1021]: 2026/09/20 13:35:55 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5999lb # [ 114.921053] niks3-server[1021]: 2026/09/20 13:35:55 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6000lb # [ 114.924803] niks3-server[1021]: 2026/09/20 13:35:55 INFO Completed upload id=386001worker1 # [ 114.931429] nix-grpc-daemon[1575]: time=2026-09-20T13:35:56.008Z level=INFO msg="Upload complete. (399ms)"6002lb # [ 114.926244] niks3-server[1021]: 2026/09/20 13:35:55 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6003worker1 # [ 114.933422] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45704 duration_s=0 paths=1 nar_bytes_in=4166004worker1 # [ 114.936863] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457046005worker1 # [ 114.943164] nix-daemon[843]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)6006worker1 # [ 114.945362] nix-daemon[843]: reaped child process 1621, status = succeeded6007client # [ 114.919535] nix[1271]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6008worker1 # [ 114.951330] nix-daemon[843]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)6009worker1: must succeed: systemctl reload nix-grpc-daemon.service6010worker1 # [ 116.713633] systemd[1]: Reloading Nix worker-protocol over gRPC...6011worker1 # [ 116.751261] systemd[1]: Reloaded Nix worker-protocol over gRPC.6012worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds)6013worker1: must succeed: pgrep -f 'read -t [9]0 x'6014worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6015client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26016worker2 # [ 117.041757] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:541906017client # don't know how to build these paths:6018client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6019worker2 # [ 117.052871] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906020worker2 # [ 117.075441] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06021worker2 # [ 117.080505] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16022worker1 # [ 117.078714] nix-grpc-daemon[1474]: ts=2026-09-20T13:35:58Z level=info event=draining6023worker2 # [ 117.093698] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906024worker2 # [ 117.108469] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906025client # copying 1 paths to 'lb:50051'...6026worker2 # [ 117.121327] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541906027client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6028worker2 # [ 117.139262] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6029worker2 # [ 117.294776] nix-daemon[855]: accepted connection from pid 1527, user nix-grpc-daemon (trusted)6030worker2 # [ 117.306957] nix-daemon[855]: reaped child process 1530, status = succeeded6031worker2 # [ 117.473540] nix-daemon[855]: accepted connection from pid 1532, user nix-grpc-daemon (trusted)6032worker2 # [ 117.485305] nix-daemon[855]: reaped child process 1535, status = succeeded6033lb # [ 117.482727] niks3-server[1021]: 2026/09/20 13:35:58 INFO Received uploads request method=POST path=/api/pending_closures6034worker2 # [ 117.510784] nix-grpc-daemon[1448]: time=2026-09-20T13:35:58.499Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6035worker2 # [ 117.512234] nix-grpc-daemon[1448]: time=2026-09-20T13:35:58.499Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6036lb # [ 117.507886] niks3-server[1021]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6037lb # [ 117.522308] niks3-server[1021]: 2026/09/20 13:35:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6038worker2 # [ 117.545153] nix-grpc-daemon[1448]: time=2026-09-20T13:35:58.533Z level=INFO msg="Uploading 1 narinfos"6039lb # [ 117.525879] niks3-server[1021]: 2026/09/20 13:35:58 INFO Signed narinfos id=39 count=16040lb # [ 117.531395] niks3-server[1021]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6041lb # [ 117.542060] niks3-server[1021]: 2026/09/20 13:35:58 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6042lb # [ 117.544570] niks3-server[1021]: 2026/09/20 13:35:58 INFO Completed upload id=396043worker2 # [ 117.564986] nix-grpc-daemon[1448]: time=2026-09-20T13:35:58.553Z level=INFO msg="Upload complete. (414ms)"6044lb # [ 117.546625] niks3-server[1021]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6045worker2 # [ 117.567243] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=0 paths=1 nar_bytes_in=5286046worker2 # [ 117.572260] nix-grpc-daemon[1372]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906047worker2 # [ 117.579542] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6048worker2 # [ 117.585177] nix-daemon[855]: reaped child process 1525, status = succeeded6049client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6050worker2 # [ 117.590102] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6051client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6052lb # [ 118.304313] envoy[920]: conn peer=[2001:db8:1::1]:55976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1686 ms=98486053lb # [ 118.306196] envoy[920]: conn peer=[2001:db8:1::1]:37340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=731 ms=33526054client # farm-a> LOG-farm-a-during-drain6055worker2 # [ 118.813701] nix-daemon[855]: reaped child process 1539, status = succeeded6056worker2 # [ 118.964100] nix-daemon[855]: accepted connection from pid 1554, user nix-grpc-daemon (trusted)6057worker2 # [ 118.975632] nix-daemon[855]: reaped child process 1557, status = succeeded6058lb # [ 118.974509] niks3-server[1021]: 2026/09/20 13:35:59 INFO Received uploads request method=POST path=/api/pending_closures6059worker2 # [ 118.998196] nix-grpc-daemon[1448]: time=2026-09-20T13:35:59.986Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6060worker2 # [ 119.002060] nix-grpc-daemon[1448]: time=2026-09-20T13:35:59.988Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6061lb # [ 118.990774] niks3-server[1021]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6062lb # [ 118.997177] niks3-server[1021]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6063lb # [ 119.001467] niks3-server[1021]: 2026/09/20 13:35:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6064lb # [ 119.004190] niks3-server[1021]: 2026/09/20 13:35:59 INFO Signed narinfos id=40 count=16065worker2 # [ 119.023446] nix-grpc-daemon[1448]: time=2026-09-20T13:36:00.011Z level=INFO msg="Uploading 1 narinfos"6066lb # [ 119.007174] niks3-server[1021]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6067lb # [ 119.013639] niks3-server[1021]: 2026/09/20 13:35:59 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6068lb # [ 119.016269] niks3-server[1021]: 2026/09/20 13:35:59 INFO Completed upload id=406069worker2 # [ 119.035364] nix-grpc-daemon[1448]: time=2026-09-20T13:36:00.024Z level=INFO msg="Upload complete. (238ms)"6070lb # [ 119.018711] niks3-server[1021]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6071worker2 # [ 119.038240] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16072worker2 # [ 119.044258] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06073worker2 # [ 119.046449] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16074worker2 # [ 119.050322] nix-daemon[855]: reaped child process 1537, status = succeeded6075worker2 # [ 119.087780] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906076worker2 # [ 119.096789] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906077worker2 # [ 119.106272] nix-grpc-daemon[1448]: time=2026-09-20T13:36:00.095Z level=INFO msg="All 1 paths already cached"6078client # copying 1 paths to 'lb:50051'...6079worker2 # [ 119.112885] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541906080client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6081worker2 # [ 119.130428] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6082worker2 # [ 119.295649] nix-daemon[855]: accepted connection from pid 1563, user nix-grpc-daemon (trusted)6083worker2 # [ 119.307797] nix-daemon[855]: reaped child process 1566, status = succeeded6084worker2 # [ 119.461495] nix-daemon[855]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6085worker2 # [ 119.473335] nix-daemon[855]: reaped child process 1571, status = succeeded6086lb # [ 119.465704] niks3-server[1021]: 2026/09/20 13:36:00 INFO Received uploads request method=POST path=/api/pending_closures6087worker2 # [ 119.489082] nix-grpc-daemon[1448]: time=2026-09-20T13:36:00.478Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6088worker2 # [ 119.491083] nix-grpc-daemon[1448]: time=2026-09-20T13:36:00.479Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6089lb # [ 119.479335] niks3-server[1021]: 2026/09/20 13:36:00 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6090lb # [ 119.483059] niks3-server[1021]: 2026/09/20 13:36:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6091lb # [ 119.484851] niks3-server[1021]: 2026/09/20 13:36:00 INFO Signed narinfos id=41 count=16092worker2 # [ 119.504119] nix-grpc-daemon[1448]: time=2026-09-20T13:36:00.492Z level=INFO msg="Uploading 1 narinfos"6093lb # [ 119.488898] niks3-server[1021]: 2026/09/20 13:36:00 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6094lb # [ 119.492894] niks3-server[1021]: 2026/09/20 13:36:00 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6095lb # [ 119.496357] niks3-server[1021]: 2026/09/20 13:36:00 INFO Completed upload id=416096worker2 # [ 119.515382] nix-grpc-daemon[1448]: time=2026-09-20T13:36:00.504Z level=INFO msg="Upload complete. (373ms)"6097lb # [ 119.498767] niks3-server[1021]: 2026/09/20 13:36:00 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6098worker2 # [ 119.517291] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=0 paths=1 nar_bytes_in=6406099worker2 # [ 119.520562] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906100worker2 # [ 119.526823] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6101worker2 # [ 119.529045] nix-daemon[855]: reaped child process 1561, status = succeeded6102client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6103worker2 # [ 119.534975] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6104client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6105client # farm-b> LOG-farm-b-during-drain6106worker2 # [ 120.553469] nix-daemon[855]: reaped child process 1575, status = succeeded6107worker2 # [ 120.717836] nix-daemon[855]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6108worker2 # [ 120.728476] nix-daemon[855]: reaped child process 1593, status = succeeded6109lb # [ 120.728135] niks3-server[1021]: 2026/09/20 13:36:01 INFO Received uploads request method=POST path=/api/pending_closures6110worker2 # [ 120.755003] nix-grpc-daemon[1448]: time=2026-09-20T13:36:01.743Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6111worker2 # [ 120.756546] nix-grpc-daemon[1448]: time=2026-09-20T13:36:01.745Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6112lb # [ 120.750099] niks3-server[1021]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6113lb # [ 120.753953] niks3-server[1021]: 2026/09/20 13:36:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6114lb # [ 120.755779] niks3-server[1021]: 2026/09/20 13:36:01 INFO Signed narinfos id=42 count=16115worker2 # [ 120.776701] nix-grpc-daemon[1448]: time=2026-09-20T13:36:01.765Z level=INFO msg="Uploading 1 narinfos"6116lb # [ 120.760970] niks3-server[1021]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6117lb # [ 120.773306] niks3-server[1021]: 2026/09/20 13:36:01 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6118worker2 # [ 120.796591] nix-grpc-daemon[1448]: time=2026-09-20T13:36:01.785Z level=INFO msg="Upload complete. (255ms)"6119lb # [ 120.778687] niks3-server[1021]: 2026/09/20 13:36:01 INFO Completed upload id=426120lb # [ 120.781151] niks3-server[1021]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6121worker2 # [ 120.799047] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16122worker2 # [ 120.805497] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:01Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06123worker2 # [ 120.808362] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:01Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16124lb # [ 120.792361] niks3-server[1021]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6125worker2 # [ 120.812100] nix-daemon[855]: reaped child process 1573, status = succeeded6126worker2 # [ 120.848693] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906127worker2 # [ 120.858477] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906128worker2 # [ 120.872409] nix-grpc-daemon[1448]: time=2026-09-20T13:36:01.861Z level=INFO msg="All 2 paths already cached"6129client # copying 1 paths to 'lb:50051'...6130client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6131worker2 # [ 120.878626] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541906132worker2 # [ 120.888427] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6133worker2 # [ 121.050743] nix-daemon[855]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)6134worker2 # [ 121.062684] nix-daemon[855]: reaped child process 1602, status = succeeded6135worker2 # [ 121.228302] nix-daemon[855]: accepted connection from pid 1604, user nix-grpc-daemon (trusted)6136worker2 # [ 121.239920] nix-daemon[855]: reaped child process 1607, status = succeeded6137lb # [ 121.238514] niks3-server[1021]: 2026/09/20 13:36:02 INFO Received uploads request method=POST path=/api/pending_closures6138worker2 # [ 121.263258] nix-grpc-daemon[1448]: time=2026-09-20T13:36:02.252Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6139worker2 # [ 121.265158] nix-grpc-daemon[1448]: time=2026-09-20T13:36:02.253Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6140lb # [ 121.254734] niks3-server[1021]: 2026/09/20 13:36:02 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6141lb # [ 121.258948] niks3-server[1021]: 2026/09/20 13:36:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6142lb # [ 121.261714] niks3-server[1021]: 2026/09/20 13:36:02 INFO Signed narinfos id=43 count=16143worker2 # [ 121.280908] nix-grpc-daemon[1448]: time=2026-09-20T13:36:02.269Z level=INFO msg="Uploading 1 narinfos"6144lb # [ 121.262900] niks3-server[1021]: 2026/09/20 13:36:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6145lb # [ 121.269602] niks3-server[1021]: 2026/09/20 13:36:02 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6146lb # [ 121.272357] niks3-server[1021]: 2026/09/20 13:36:02 INFO Completed upload id=436147worker2 # [ 121.292570] nix-grpc-daemon[1448]: time=2026-09-20T13:36:02.281Z level=INFO msg="Upload complete. (393ms)"6148lb # [ 121.274602] niks3-server[1021]: 2026/09/20 13:36:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6149worker2 # [ 121.294461] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=0 paths=1 nar_bytes_in=7686150worker2 # [ 121.297252] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906151worker2 # [ 121.303996] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6152worker2 # [ 121.306112] nix-daemon[855]: reaped child process 1597, status = succeeded6153client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6154client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6155worker2 # [ 121.311476] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6156client # farm-top> LOG-farm-top-during-drain6157worker2 # [ 122.332829] nix-daemon[855]: reaped child process 1611, status = succeeded6158worker2 # [ 122.508812] nix-daemon[855]: accepted connection from pid 1626, user nix-grpc-daemon (trusted)6159worker2 # [ 122.519498] nix-daemon[855]: reaped child process 1629, status = succeeded6160lb # [ 122.518269] niks3-server[1021]: 2026/09/20 13:36:03 INFO Received uploads request method=POST path=/api/pending_closures6161worker2 # [ 122.542459] nix-grpc-daemon[1448]: time=2026-09-20T13:36:03.531Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6162worker2 # [ 122.544331] nix-grpc-daemon[1448]: time=2026-09-20T13:36:03.532Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6163lb # [ 122.538821] niks3-server[1021]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6164lb # [ 122.541283] niks3-server[1021]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6165lb # [ 122.545121] niks3-server[1021]: 2026/09/20 13:36:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6166lb # [ 122.547510] niks3-server[1021]: 2026/09/20 13:36:03 INFO Signed narinfos id=44 count=16167worker2 # [ 122.566769] nix-grpc-daemon[1448]: time=2026-09-20T13:36:03.555Z level=INFO msg="Uploading 1 narinfos"6168lb # [ 122.550775] niks3-server[1021]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6169lb # [ 122.554990] niks3-server[1021]: 2026/09/20 13:36:03 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6170lb # [ 122.557988] niks3-server[1021]: 2026/09/20 13:36:03 INFO Completed upload id=446171worker2 # [ 122.578283] nix-grpc-daemon[1448]: time=2026-09-20T13:36:03.567Z level=INFO msg="Upload complete. (260ms)"6172lb # [ 122.560045] niks3-server[1021]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6173worker2 # [ 122.581134] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16174worker2 # [ 122.587788] nix-daemon[855]: reaped child process 1609, status = succeeded6175client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 5.81 seconds)6176client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6177client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.16 seconds)6178worker1: must succeed: pkill -f 'read -t [9]0 x'6179worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6180client: waiting for success: ! systemctl is-active sw6181worker1 # [ 122.984266] nix-daemon[843]: reaped child process 1635, status = succeeded6182worker1 # [ 123.151994] nix-daemon[843]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)6183worker1 # [ 123.164284] nix-daemon[843]: reaped child process 1678, status = succeeded6184lb # [ 123.174603] niks3-server[1021]: 2026/09/20 13:36:04 INFO Received uploads request method=POST path=/api/pending_closures6185worker1 # [ 123.189600] nix-grpc-daemon[1575]: time=2026-09-20T13:36:04.266Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6186worker1 # [ 123.191172] nix-grpc-daemon[1575]: time=2026-09-20T13:36:04.268Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6187lb # [ 123.214486] niks3-server[1021]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6188lb # [ 123.220792] niks3-server[1021]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6189lb # [ 123.227164] niks3-server[1021]: 2026/09/20 13:36:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6190lb # [ 123.231355] niks3-server[1021]: 2026/09/20 13:36:04 INFO Signed narinfos id=45 count=16191worker1 # [ 123.241606] nix-grpc-daemon[1575]: time=2026-09-20T13:36:04.318Z level=INFO msg="Uploading 1 narinfos"6192lb # [ 123.241223] niks3-server[1021]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6193lb # [ 123.249175] niks3-server[1021]: 2026/09/20 13:36:04 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6194lb # [ 123.255228] niks3-server[1021]: 2026/09/20 13:36:04 INFO Completed upload id=456195worker1 # [ 123.261673] nix-grpc-daemon[1575]: time=2026-09-20T13:36:04.338Z level=INFO msg="Upload complete. (295ms)"6196lb # [ 123.258027] niks3-server[1021]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6197worker1 # [ 123.266134] nix-grpc-daemon[1474]: ts=2026-09-20T13:36:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45704 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16198worker1 # [ 123.273139] nix-daemon[843]: reaped child process 1633, status = succeeded6199client # [ 123.273961] systemd[1]: sw.service: Deactivated successfully.6200client # [ 123.277798] systemd[1]: sw.service: Consumed 112ms CPU time over 9.082s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.6201client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6202client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6203client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6204worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6205worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.06 seconds)6206lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6207lb: must succeed: curl -sf localhost:9901/clusters6208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6209worker1 # [ 124.080899] nix-grpc-daemon[1474]: ts=2026-09-20T13:36:05Z level=info event=signal_exit6210lb: must succeed: curl -sf localhost:9901/clusters6211lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6212worker1 # [ 125.304816] nix-grpc-daemon[1474]: ts=2026-09-20T13:36:06Z level=info event=scheduler_restarting6213worker2 # [ 125.325410] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:541586214worker2 # [ 125.328914] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:06Z level=info event=worker_gone addr=192.168.1.3:500516215worker1 # [ 125.322357] nix-grpc-daemon[1474]: ts=2026-09-20T13:36:06Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6216worker1 # [ 125.340466] nix-daemon[843]: reaped child process 1527, status = succeeded6217worker1 # [ 125.913914] nix-grpc-daemon[1474]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6218worker1 # [ 125.917918] nix-grpc-daemon[1474]: E0000 00:00:1789911366.990931 1517 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6219worker1 # [ 125.922760] nix-grpc-daemon[1474]: E0000 00:00:1789911366.994858 1517 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6220worker1 # [ 126.114733] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6221worker1 # [ 126.116436] systemd[1]: nix-grpc-daemon.service: Consumed 625ms CPU time over 28.223s wall clock time, 30.1M memory peak, 20.7K incoming IP traffic, 27.4K outgoing IP traffic.6222lb: must succeed: curl -sf localhost:9901/clusters6223lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6224worker1 # [ 127.105960] systemd[1]: Starting Nix worker-protocol over gRPC...6225lb: must succeed: curl -sf localhost:9901/clusters6226worker1 # [ 127.257452] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6227worker1 # [ 127.259253] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6228worker1 # [ 127.262612] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16229lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6230worker1 # [ 127.270374] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6231worker1 # [ 127.273423] systemd[1]: Started Nix worker-protocol over gRPC.6232worker1 # [ 127.286949] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:08Z level=info event=scheduler_connected addr=lb:500516233worker2 # [ 127.301265] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:541586234worker2 # [ 127.302939] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06235lb: must succeed: curl -sf localhost:9901/clusters6236lb # [ 128.305762] envoy[920]: conn peer=[2001:db8:1::1]:59152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=3835 ms=55596237lb # [ 128.310136] envoy[920]: conn peer=[2001:db8:1::1]:59138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1321 ms=88486238lb # [ 128.313363] envoy[920]: conn peer=[2001:db8:1::3]:50960 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1114 tx=425 ms=272296239lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6240lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 4.37 seconds)6241lb: must succeed: curl -sf localhost:9901/clusters6242lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6243worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6244worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6245(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.29 seconds)6246subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6247client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16248worker1 # [ 128.695515] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511966249worker1 # [ 128.707418] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6250worker2 # [ 128.734800] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906251worker2 # [ 128.782269] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:09Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06252worker2 # [ 128.787332] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:09Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16253worker2 # [ 128.792385] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:09Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06254worker2 # [ 128.796248] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:09Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06255worker1 # [ 128.819240] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966256worker1 # [ 128.831386] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)6257worker1 # [ 128.905285] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)6258worker1 # [ 129.047317] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 3/5)6259worker1 # [ 129.056128] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 4/5)6260worker1 # [ 129.227257] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6261worker1 # [ 129.243146] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966262worker1 # [ 129.253643] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966263worker1 # [ 129.262904] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6264worker1 # [ 129.285421] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:10Z level=info event=niks3_push_started pid=17466265worker1 # [ 129.457562] nix-grpc-daemon[1746]: time=2026-09-20T13:36:10.534Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""6266worker1 # [ 129.603885] nix-daemon[843]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6267worker1 # [ 129.615617] nix-daemon[843]: reaped child process 1762, status = succeeded6268worker1 # [ 129.757802] nix-daemon[843]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6269worker1 # [ 129.770316] nix-daemon[843]: reaped child process 1767, status = succeeded6270lb # [ 129.775854] niks3-server[1021]: 2026/09/20 13:36:10 INFO Received uploads request method=POST path=/api/pending_closures6271worker1 # [ 129.791928] nix-grpc-daemon[1746]: time=2026-09-20T13:36:10.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6272worker1 # [ 129.793327] nix-grpc-daemon[1746]: time=2026-09-20T13:36:10.868Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6273lb # [ 129.807671] niks3-server[1021]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6274lb # [ 129.820736] niks3-server[1021]: 2026/09/20 13:36:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6275worker1 # [ 129.833878] nix-grpc-daemon[1746]: time=2026-09-20T13:36:10.910Z level=INFO msg="Uploading 1 narinfos"6276lb # [ 129.827628] niks3-server[1021]: 2026/09/20 13:36:10 INFO Signed narinfos id=46 count=16277lb # [ 129.840790] niks3-server[1021]: 2026/09/20 13:36:10 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6278lb # [ 129.847344] niks3-server[1021]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6279lb # [ 129.854959] niks3-server[1021]: 2026/09/20 13:36:10 INFO Completed upload id=466280worker1 # [ 129.861448] nix-grpc-daemon[1746]: time=2026-09-20T13:36:10.938Z level=INFO msg="Upload complete. (400ms)"6281lb # [ 129.856819] niks3-server[1021]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6282worker1 # [ 129.865356] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=5046283worker1 # [ 129.868320] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966284worker1 # [ 129.873995] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6285worker1 # [ 129.881150] nix-daemon[843]: reaped child process 1744, status = succeeded6286worker1 # [ 129.884557] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6287worker1 # [ 130.509493] nix-daemon[843]: reaped child process 1771, status = succeeded6288worker1 # [ 130.668030] nix-daemon[843]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6289worker1 # [ 130.680265] nix-daemon[843]: reaped child process 1789, status = succeeded6290lb # [ 130.689636] niks3-server[1021]: 2026/09/20 13:36:11 INFO Received uploads request method=POST path=/api/pending_closures6291worker1 # [ 130.700679] nix-grpc-daemon[1746]: time=2026-09-20T13:36:11.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6292worker1 # [ 130.702190] nix-grpc-daemon[1746]: time=2026-09-20T13:36:11.779Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6293lb # [ 130.723901] niks3-server[1021]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6294lb # [ 130.731345] niks3-server[1021]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6295lb # [ 130.740908] niks3-server[1021]: 2026/09/20 13:36:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6296lb # [ 130.745477] niks3-server[1021]: 2026/09/20 13:36:11 INFO Signed narinfos id=47 count=16297worker1 # [ 130.752950] nix-grpc-daemon[1746]: time=2026-09-20T13:36:11.829Z level=INFO msg="Uploading 1 narinfos"6298lb # [ 130.750707] niks3-server[1021]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6299lb # [ 130.755517] niks3-server[1021]: 2026/09/20 13:36:11 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6300lb # [ 130.759155] niks3-server[1021]: 2026/09/20 13:36:11 INFO Completed upload id=476301worker1 # [ 130.765595] nix-grpc-daemon[1746]: time=2026-09-20T13:36:11.842Z level=INFO msg="Upload complete. (274ms)"6302lb # [ 130.760754] niks3-server[1021]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6303worker1 # [ 130.768604] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16304worker2 # [ 130.784420] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:11Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16305worker1 # [ 130.780215] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966306worker2 # [ 130.794294] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:11Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06307worker1 # [ 130.786275] nix-daemon[843]: reaped child process 1769, status = succeeded6308worker1 # [ 130.789827] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966309worker1 # [ 130.795542] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966310worker1 # [ 130.799491] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6311worker1 # [ 130.955085] nix-daemon[843]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)6312worker1 # [ 130.967433] nix-daemon[843]: reaped child process 1796, status = succeeded6313worker1 # [ 131.131314] nix-daemon[843]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6314worker1 # [ 131.143123] nix-daemon[843]: reaped child process 1801, status = succeeded6315lb # [ 131.154178] niks3-server[1021]: 2026/09/20 13:36:12 INFO Received uploads request method=POST path=/api/pending_closures6316worker1 # [ 131.168806] nix-grpc-daemon[1746]: time=2026-09-20T13:36:12.245Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6317worker1 # [ 131.170332] nix-grpc-daemon[1746]: time=2026-09-20T13:36:12.245Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6318lb # [ 131.181851] niks3-server[1021]: 2026/09/20 13:36:12 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6319lb # [ 131.191583] niks3-server[1021]: 2026/09/20 13:36:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6320lb # [ 131.197930] niks3-server[1021]: 2026/09/20 13:36:12 INFO Signed narinfos id=48 count=16321worker1 # [ 131.207661] nix-grpc-daemon[1746]: time=2026-09-20T13:36:12.284Z level=INFO msg="Uploading 1 narinfos"6322lb # [ 131.202921] niks3-server[1021]: 2026/09/20 13:36:12 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6323lb # [ 131.213409] niks3-server[1021]: 2026/09/20 13:36:12 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6324lb # [ 131.217527] niks3-server[1021]: 2026/09/20 13:36:12 INFO Completed upload id=486325worker1 # [ 131.226203] nix-grpc-daemon[1746]: time=2026-09-20T13:36:12.303Z level=INFO msg="Upload complete. (420ms)"6326lb # [ 131.222410] niks3-server[1021]: 2026/09/20 13:36:12 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6327worker1 # [ 131.230133] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=5046328worker1 # [ 131.235274] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966329worker1 # [ 131.245557] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6330worker1 # [ 131.249069] nix-daemon[843]: reaped child process 1791, status = succeeded6331worker1 # [ 131.254212] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6332worker1 # [ 132.468437] nix-daemon[843]: reaped child process 1805, status = succeeded6333worker1 # [ 132.622630] nix-daemon[843]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)6334worker1 # [ 132.634751] nix-daemon[843]: reaped child process 1823, status = succeeded6335lb # [ 132.645236] niks3-server[1021]: 2026/09/20 13:36:13 INFO Received uploads request method=POST path=/api/pending_closures6336worker1 # [ 132.660448] nix-grpc-daemon[1746]: time=2026-09-20T13:36:13.736Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6337worker1 # [ 132.661883] nix-grpc-daemon[1746]: time=2026-09-20T13:36:13.737Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6338lb # [ 132.680765] niks3-server[1021]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6339lb # [ 132.687059] niks3-server[1021]: 2026/09/20 13:36:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6340lb # [ 132.692287] niks3-server[1021]: 2026/09/20 13:36:13 INFO Signed narinfos id=49 count=16341worker1 # [ 132.701914] nix-grpc-daemon[1746]: time=2026-09-20T13:36:13.779Z level=INFO msg="Uploading 1 narinfos"6342lb # [ 132.703754] niks3-server[1021]: 2026/09/20 13:36:13 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6343lb # [ 132.712283] niks3-server[1021]: 2026/09/20 13:36:13 INFO Completed upload id=496344worker1 # [ 132.718903] nix-grpc-daemon[1746]: time=2026-09-20T13:36:13.796Z level=INFO msg="Upload complete. (257ms)"6345lb # [ 132.718274] niks3-server[1021]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6346worker1 # [ 132.722592] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16347lb # [ 132.722734] niks3-server[1021]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6348worker1 # [ 132.729846] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966349worker2 # [ 132.739407] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:13Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16350lb # [ 132.725261] niks3-server[1021]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6351worker1 # [ 132.736823] nix-daemon[843]: reaped child process 1803, status = succeeded6352worker2 # [ 132.748327] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:13Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06353worker1 # [ 132.738645] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966354worker1 # [ 132.744207] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966355worker1 # [ 132.748197] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6356worker1 # [ 132.912387] nix-daemon[843]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6357worker1 # [ 132.924476] nix-daemon[843]: reaped child process 1830, status = succeeded6358worker1 # [ 133.096077] nix-daemon[843]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)6359worker1 # [ 133.107919] nix-daemon[843]: reaped child process 1835, status = succeeded6360lb # [ 133.118827] niks3-server[1021]: 2026/09/20 13:36:14 INFO Received uploads request method=POST path=/api/pending_closures6361worker1 # [ 133.133787] nix-grpc-daemon[1746]: time=2026-09-20T13:36:14.210Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6362worker1 # [ 133.135202] nix-grpc-daemon[1746]: time=2026-09-20T13:36:14.210Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6363lb # [ 133.143614] niks3-server[1021]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6364lb # [ 133.155712] niks3-server[1021]: 2026/09/20 13:36:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6365worker1 # [ 133.167166] nix-grpc-daemon[1746]: time=2026-09-20T13:36:14.244Z level=INFO msg="Uploading 1 narinfos"6366lb # [ 133.160945] niks3-server[1021]: 2026/09/20 13:36:14 INFO Signed narinfos id=50 count=16367lb # [ 133.167416] niks3-server[1021]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6368lb # [ 133.179578] niks3-server[1021]: 2026/09/20 13:36:14 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6369lb # [ 133.185410] niks3-server[1021]: 2026/09/20 13:36:14 INFO Completed upload id=506370worker1 # [ 133.194260] nix-grpc-daemon[1746]: time=2026-09-20T13:36:14.271Z level=INFO msg="Upload complete. (440ms)"6371lb # [ 133.188338] niks3-server[1021]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6372worker1 # [ 133.197516] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=5046373worker1 # [ 133.203306] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966374worker1 # [ 133.211077] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6375worker1 # [ 133.218148] nix-daemon[843]: reaped child process 1825, status = succeeded6376worker1 # [ 133.223421] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6377worker1 # [ 133.847471] nix-daemon[843]: reaped child process 1839, status = succeeded6378worker1 # [ 134.009127] nix-daemon[843]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6379worker1 # [ 134.020449] nix-daemon[843]: reaped child process 1857, status = succeeded6380lb # [ 134.031620] niks3-server[1021]: 2026/09/20 13:36:14 INFO Received uploads request method=POST path=/api/pending_closures6381worker1 # [ 134.046064] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.123Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6382worker1 # [ 134.049353] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.124Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6383lb # [ 134.065772] niks3-server[1021]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6384lb # [ 134.076942] niks3-server[1021]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6385lb # [ 134.084638] niks3-server[1021]: 2026/09/20 13:36:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6386worker1 # [ 134.097556] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.174Z level=INFO msg="Uploading 1 narinfos"6387lb # [ 134.091362] niks3-server[1021]: 2026/09/20 13:36:14 INFO Signed narinfos id=51 count=16388lb # [ 134.095372] niks3-server[1021]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6389lb # [ 134.103454] niks3-server[1021]: 2026/09/20 13:36:14 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6390lb # [ 134.110149] niks3-server[1021]: 2026/09/20 13:36:15 INFO Completed upload id=516391worker1 # [ 134.116928] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.194Z level=INFO msg="Upload complete. (287ms)"6392lb # [ 134.112421] niks3-server[1021]: 2026/09/20 13:36:15 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6393worker1 # [ 134.121738] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16394worker2 # [ 134.135341] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:15Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16395worker1 # [ 134.128298] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966396worker2 # [ 134.145325] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:15Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06397worker1 # [ 134.139545] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966398worker1 # [ 134.145221] nix-daemon[843]: reaped child process 1837, status = succeeded6399worker1 # [ 134.150480] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.227Z level=INFO msg="All 1 paths already cached"6400worker1 # [ 134.154296] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966401worker1 # [ 134.158269] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6402worker1 # [ 134.307981] nix-daemon[843]: accepted connection from pid 1861, user nix-grpc-daemon (trusted)6403worker1 # [ 134.320627] nix-daemon[843]: reaped child process 1864, status = succeeded6404worker1 # [ 134.482561] nix-daemon[843]: accepted connection from pid 1866, user nix-grpc-daemon (trusted)6405worker1 # [ 134.495170] nix-daemon[843]: reaped child process 1869, status = succeeded6406lb # [ 134.502943] niks3-server[1021]: 2026/09/20 13:36:15 INFO Received uploads request method=POST path=/api/pending_closures6407worker1 # [ 134.518586] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.595Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6408worker1 # [ 134.519919] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.595Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6409lb # [ 134.527592] niks3-server[1021]: 2026/09/20 13:36:15 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6410lb # [ 134.538201] niks3-server[1021]: 2026/09/20 13:36:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6411lb # [ 134.542617] niks3-server[1021]: 2026/09/20 13:36:15 INFO Signed narinfos id=52 count=16412worker1 # [ 134.552226] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.629Z level=INFO msg="Uploading 1 narinfos"6413lb # [ 134.553376] niks3-server[1021]: 2026/09/20 13:36:15 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6414lb # [ 134.560679] niks3-server[1021]: 2026/09/20 13:36:15 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6415worker1 # [ 134.573081] nix-grpc-daemon[1746]: time=2026-09-20T13:36:15.650Z level=INFO msg="Upload complete. (408ms)"6416lb # [ 134.566797] niks3-server[1021]: 2026/09/20 13:36:15 INFO Completed upload id=526417worker1 # [ 134.575161] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=6246418lb # [ 134.570125] niks3-server[1021]: 2026/09/20 13:36:15 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6419worker1 # [ 134.580821] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966420worker1 # [ 134.589075] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6421worker1 # [ 134.591656] nix-daemon[843]: reaped child process 1859, status = succeeded6422worker1 # [ 134.596887] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6423worker1 # [ 135.609559] nix-daemon[843]: reaped child process 1873, status = succeeded6424worker1 # [ 135.753194] nix-daemon[843]: accepted connection from pid 1888, user nix-grpc-daemon (trusted)6425worker1 # [ 135.765994] nix-daemon[843]: reaped child process 1891, status = succeeded6426lb # [ 135.776858] niks3-server[1021]: 2026/09/20 13:36:16 INFO Received uploads request method=POST path=/api/pending_closures6427worker1 # [ 135.789548] nix-grpc-daemon[1746]: time=2026-09-20T13:36:16.866Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6428worker1 # [ 135.792330] nix-grpc-daemon[1746]: time=2026-09-20T13:36:16.868Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6429lb # [ 135.809694] niks3-server[1021]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6430lb # [ 135.824233] niks3-server[1021]: 2026/09/20 13:36:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6431worker1 # [ 135.837537] nix-grpc-daemon[1746]: time=2026-09-20T13:36:16.914Z level=INFO msg="Uploading 1 narinfos"6432lb # [ 135.831591] niks3-server[1021]: 2026/09/20 13:36:16 INFO Signed narinfos id=53 count=16433lb # [ 135.839395] niks3-server[1021]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6434lb # [ 135.842442] niks3-server[1021]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6435lb # [ 135.853241] niks3-server[1021]: 2026/09/20 13:36:16 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6436lb # [ 135.859233] niks3-server[1021]: 2026/09/20 13:36:16 INFO Completed upload id=536437worker1 # [ 135.865839] nix-grpc-daemon[1746]: time=2026-09-20T13:36:16.943Z level=INFO msg="Upload complete. (260ms)"6438lb # [ 135.860857] niks3-server[1021]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6439worker2 # [ 135.882906] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:16Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16440worker2 # [ 135.888132] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:16Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06441worker1 # [ 135.872324] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16442worker1 # [ 135.878538] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966443worker1 # [ 135.888547] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966444worker1 # [ 135.895769] nix-daemon[843]: reaped child process 1871, status = succeeded6445worker1 # [ 135.897349] nix-grpc-daemon[1746]: time=2026-09-20T13:36:16.974Z level=INFO msg="All 1 paths already cached"6446worker1 # [ 135.901162] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966447worker1 # [ 135.905312] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6448worker1 # [ 136.065100] nix-daemon[843]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6449worker1 # [ 136.077342] nix-daemon[843]: reaped child process 1898, status = succeeded6450worker1 # [ 136.230694] nix-daemon[843]: accepted connection from pid 1900, user nix-grpc-daemon (trusted)6451worker1 # [ 136.242909] nix-daemon[843]: reaped child process 1903, status = succeeded6452lb # [ 136.251139] niks3-server[1021]: 2026/09/20 13:36:17 INFO Received uploads request method=POST path=/api/pending_closures6453worker1 # [ 136.266816] nix-grpc-daemon[1746]: time=2026-09-20T13:36:17.343Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6454worker1 # [ 136.268182] nix-grpc-daemon[1746]: time=2026-09-20T13:36:17.343Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6455lb # [ 136.277295] niks3-server[1021]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6456lb # [ 136.288283] niks3-server[1021]: 2026/09/20 13:36:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6457lb # [ 136.294232] niks3-server[1021]: 2026/09/20 13:36:17 INFO Signed narinfos id=54 count=16458worker1 # [ 136.303224] nix-grpc-daemon[1746]: time=2026-09-20T13:36:17.380Z level=INFO msg="Uploading 1 narinfos"6459lb # [ 136.299850] niks3-server[1021]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6460lb # [ 136.309815] niks3-server[1021]: 2026/09/20 13:36:17 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6461lb # [ 136.312227] niks3-server[1021]: 2026/09/20 13:36:17 INFO Completed upload id=546462worker1 # [ 136.320035] nix-grpc-daemon[1746]: time=2026-09-20T13:36:17.397Z level=INFO msg="Upload complete. (408ms)"6463lb # [ 136.314800] niks3-server[1021]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6464worker1 # [ 136.321883] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=6246465worker1 # [ 136.325154] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966466worker1 # [ 136.329800] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6467worker1 # [ 136.334389] nix-daemon[843]: reaped child process 1893, status = succeeded6468worker1 # [ 136.339356] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6469worker1 # [ 136.958583] nix-daemon[843]: reaped child process 1907, status = succeeded6470worker1 # [ 137.096411] nix-daemon[843]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6471worker1 # [ 137.107556] nix-daemon[843]: reaped child process 1925, status = succeeded6472lb # [ 137.116636] niks3-server[1021]: 2026/09/20 13:36:18 INFO Received uploads request method=POST path=/api/pending_closures6473worker1 # [ 137.127576] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.204Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6474worker1 # [ 137.129046] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.206Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6475lb # [ 137.140867] niks3-server[1021]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6476lb # [ 137.144786] niks3-server[1021]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6477lb # [ 137.149159] niks3-server[1021]: 2026/09/20 13:36:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6478lb # [ 137.151575] niks3-server[1021]: 2026/09/20 13:36:18 INFO Signed narinfos id=55 count=16479worker1 # [ 137.159730] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.236Z level=INFO msg="Uploading 1 narinfos"6480lb # [ 137.156637] niks3-server[1021]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6481lb # [ 137.161063] niks3-server[1021]: 2026/09/20 13:36:18 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6482lb # [ 137.164797] niks3-server[1021]: 2026/09/20 13:36:18 INFO Completed upload id=556483worker1 # [ 137.171198] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.248Z level=INFO msg="Upload complete. (226ms)"6484lb # [ 137.166479] niks3-server[1021]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6485worker1 # [ 137.173672] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16486worker1 # [ 137.180586] nix-daemon[843]: reaped child process 1905, status = succeeded6487worker2 # [ 137.189769] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:18Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16488worker1 # [ 137.219327] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966489worker2 # [ 137.235605] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:18Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06490worker1 # [ 137.228423] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966491worker1 # [ 137.237346] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.314Z level=INFO msg="All 1 paths already cached"6492worker1 # [ 137.242773] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966493worker1 # [ 137.249266] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6494worker1 # [ 137.407088] nix-daemon[843]: accepted connection from pid 1929, user nix-grpc-daemon (trusted)6495worker1 # [ 137.419518] nix-daemon[843]: reaped child process 1932, status = succeeded6496worker1 # [ 137.573236] nix-daemon[843]: accepted connection from pid 1934, user nix-grpc-daemon (trusted)6497worker1 # [ 137.585548] nix-daemon[843]: reaped child process 1937, status = succeeded6498lb # [ 137.588304] niks3-server[1021]: 2026/09/20 13:36:18 INFO Received uploads request method=POST path=/api/pending_closures6499worker1 # [ 137.598636] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.675Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6500worker1 # [ 137.600459] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.677Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6501lb # [ 137.602465] niks3-server[1021]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6502lb # [ 137.604904] niks3-server[1021]: 2026/09/20 13:36:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6503lb # [ 137.606889] niks3-server[1021]: 2026/09/20 13:36:18 INFO Signed narinfos id=56 count=16504worker1 # [ 137.613606] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.690Z level=INFO msg="Uploading 1 narinfos"6505lb # [ 137.612711] niks3-server[1021]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6506lb # [ 137.617670] niks3-server[1021]: 2026/09/20 13:36:18 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6507lb # [ 137.620494] niks3-server[1021]: 2026/09/20 13:36:18 INFO Completed upload id=566508worker1 # [ 137.627038] nix-grpc-daemon[1746]: time=2026-09-20T13:36:18.704Z level=INFO msg="Upload complete. (367ms)"6509worker1 # [ 137.628968] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=6246510lb # [ 137.623427] niks3-server[1021]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6511worker1 # [ 137.632361] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966512worker1 # [ 137.638597] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6513worker1 # [ 137.640804] nix-daemon[843]: reaped child process 1927, status = succeeded6514worker1 # [ 137.645852] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6515worker1 # [ 138.459561] nix-daemon[843]: reaped child process 1941, status = succeeded6516worker1 # [ 138.599541] nix-daemon[843]: accepted connection from pid 1956, user nix-grpc-daemon (trusted)6517worker1 # [ 138.611941] nix-daemon[843]: reaped child process 1959, status = succeeded6518lb # [ 138.621670] niks3-server[1021]: 2026/09/20 13:36:19 INFO Received uploads request method=POST path=/api/pending_closures6519worker1 # [ 138.635784] nix-grpc-daemon[1746]: time=2026-09-20T13:36:19.712Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6520worker1 # [ 138.637294] nix-grpc-daemon[1746]: time=2026-09-20T13:36:19.714Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6521lb # [ 138.653156] niks3-server[1021]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6522lb # [ 138.667363] niks3-server[1021]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6523lb # [ 138.675511] niks3-server[1021]: 2026/09/20 13:36:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6524lb # [ 138.679754] niks3-server[1021]: 2026/09/20 13:36:19 INFO Signed narinfos id=57 count=16525worker1 # [ 138.689238] nix-grpc-daemon[1746]: time=2026-09-20T13:36:19.766Z level=INFO msg="Uploading 1 narinfos"6526lb # [ 138.688422] niks3-server[1021]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6527lb # [ 138.696948] niks3-server[1021]: 2026/09/20 13:36:19 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6528lb # [ 138.702780] niks3-server[1021]: 2026/09/20 13:36:19 INFO Completed upload id=576529worker1 # [ 138.709452] nix-grpc-daemon[1746]: time=2026-09-20T13:36:19.786Z level=INFO msg="Upload complete. (257ms)"6530lb # [ 138.704439] niks3-server[1021]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6531worker1 # [ 138.716442] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16532worker2 # [ 138.731404] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:19Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16533worker1 # [ 138.723918] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966534worker2 # [ 138.738865] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:19Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06535worker1 # [ 138.736549] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966536worker1 # [ 138.741288] nix-daemon[843]: reaped child process 1939, status = succeeded6537worker1 # [ 138.747517] nix-grpc-daemon[1746]: time=2026-09-20T13:36:19.824Z level=INFO msg="All 2 paths already cached"6538worker1 # [ 138.753678] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966539worker1 # [ 138.760457] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6540worker1 # [ 138.905184] nix-daemon[843]: accepted connection from pid 1963, user nix-grpc-daemon (trusted)6541worker1 # [ 138.917418] nix-daemon[843]: reaped child process 1966, status = succeeded6542worker1 # [ 139.067539] nix-daemon[843]: accepted connection from pid 1968, user nix-grpc-daemon (trusted)6543worker1 # [ 139.079637] nix-daemon[843]: reaped child process 1971, status = succeeded6544lb # [ 139.087750] niks3-server[1021]: 2026/09/20 13:36:19 INFO Received uploads request method=POST path=/api/pending_closures6545worker1 # [ 139.098508] nix-grpc-daemon[1746]: time=2026-09-20T13:36:20.175Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6546worker1 # [ 139.100042] nix-grpc-daemon[1746]: time=2026-09-20T13:36:20.177Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6547lb # [ 139.104763] niks3-server[1021]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6548lb # [ 139.108275] niks3-server[1021]: 2026/09/20 13:36:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6549worker1 # [ 139.117874] nix-grpc-daemon[1746]: time=2026-09-20T13:36:20.195Z level=INFO msg="Uploading 1 narinfos"6550lb # [ 139.111552] niks3-server[1021]: 2026/09/20 13:36:20 INFO Signed narinfos id=58 count=16551lb # [ 139.113927] niks3-server[1021]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6552lb # [ 139.119164] niks3-server[1021]: 2026/09/20 13:36:20 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6553lb # [ 139.123446] niks3-server[1021]: 2026/09/20 13:36:20 INFO Completed upload id=586554worker1 # [ 139.130238] nix-grpc-daemon[1746]: time=2026-09-20T13:36:20.207Z level=INFO msg="Upload complete. (363ms)"6555lb # [ 139.125078] niks3-server[1021]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6556worker1 # [ 139.132181] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=7526557worker1 # [ 139.136082] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966558worker1 # [ 139.141971] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6559worker1 # [ 139.144475] nix-daemon[843]: reaped child process 1961, status = succeeded6560worker1 # [ 139.149531] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6561worker1 # [ 139.775372] nix-daemon[843]: reaped child process 1975, status = succeeded6562worker1 # [ 139.930552] nix-daemon[843]: accepted connection from pid 1990, user nix-grpc-daemon (trusted)6563worker1 # [ 139.942880] nix-daemon[843]: reaped child process 1993, status = succeeded6564lb # [ 139.951044] niks3-server[1021]: 2026/09/20 13:36:20 INFO Received uploads request method=POST path=/api/pending_closures6565worker1 # [ 139.962496] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.039Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6566worker1 # [ 139.964024] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.041Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6567lb # [ 139.971255] niks3-server[1021]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6568lb # [ 139.975782] niks3-server[1021]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6569lb # [ 139.978806] niks3-server[1021]: 2026/09/20 13:36:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6570lb # [ 139.981149] niks3-server[1021]: 2026/09/20 13:36:20 INFO Signed narinfos id=59 count=16571worker1 # [ 139.987555] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.064Z level=INFO msg="Uploading 1 narinfos"6572lb # [ 139.984396] niks3-server[1021]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6573lb # [ 139.988887] niks3-server[1021]: 2026/09/20 13:36:20 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6574lb # [ 139.991575] niks3-server[1021]: 2026/09/20 13:36:20 INFO Completed upload id=596575worker1 # [ 139.998140] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.075Z level=INFO msg="Upload complete. (240ms)"6576lb # [ 139.994264] niks3-server[1021]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6577worker1 # [ 140.000512] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16578worker2 # [ 140.014947] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:21Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16579worker1 # [ 140.007685] nix-daemon[843]: reaped child process 1973, status = succeeded6580worker1 # [ 140.046107] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966581worker1 # [ 140.054639] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966582worker1 # [ 140.062747] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.140Z level=INFO msg="All 2 paths already cached"6583worker1 # [ 140.068264] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966584worker1 # [ 140.074848] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6585worker1 # [ 140.227978] nix-daemon[843]: accepted connection from pid 1997, user nix-grpc-daemon (trusted)6586worker1 # [ 140.240359] nix-daemon[843]: reaped child process 2000, status = succeeded6587worker1 # [ 140.402369] nix-daemon[843]: accepted connection from pid 2002, user nix-grpc-daemon (trusted)6588worker1 # [ 140.415406] nix-daemon[843]: reaped child process 2005, status = succeeded6589lb # [ 140.423223] niks3-server[1021]: 2026/09/20 13:36:21 INFO Received uploads request method=POST path=/api/pending_closures6590worker1 # [ 140.433835] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.510Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6591worker1 # [ 140.435264] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.510Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6592lb # [ 140.435027] niks3-server[1021]: 2026/09/20 13:36:21 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6593lb # [ 140.438583] niks3-server[1021]: 2026/09/20 13:36:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6594lb # [ 140.440238] niks3-server[1021]: 2026/09/20 13:36:21 INFO Signed narinfos id=60 count=16595worker1 # [ 140.447102] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.524Z level=INFO msg="Uploading 1 narinfos"6596lb # [ 140.445859] niks3-server[1021]: 2026/09/20 13:36:21 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6597lb # [ 140.447808] niks3-server[1021]: 2026/09/20 13:36:21 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6598lb # [ 140.451410] niks3-server[1021]: 2026/09/20 13:36:21 INFO Completed upload id=606599worker1 # [ 140.457980] nix-grpc-daemon[1746]: time=2026-09-20T13:36:21.535Z level=INFO msg="Upload complete. (374ms)"6600lb # [ 140.452691] niks3-server[1021]: 2026/09/20 13:36:21 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6601worker1 # [ 140.460887] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=7526602worker1 # [ 140.463494] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966603worker1 # [ 140.470277] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6604worker1 # [ 140.472455] nix-daemon[843]: reaped child process 1995, status = succeeded6605worker1 # [ 140.477867] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6606worker1 # [ 141.492535] nix-daemon[843]: reaped child process 2009, status = succeeded6607worker1 # [ 141.641180] nix-daemon[843]: accepted connection from pid 2024, user nix-grpc-daemon (trusted)6608worker1 # [ 141.653545] nix-daemon[843]: reaped child process 2027, status = succeeded6609lb # [ 141.661659] niks3-server[1021]: 2026/09/20 13:36:22 INFO Received uploads request method=POST path=/api/pending_closures6610worker1 # [ 141.673483] nix-grpc-daemon[1746]: time=2026-09-20T13:36:22.750Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6611worker1 # [ 141.674966] nix-grpc-daemon[1746]: time=2026-09-20T13:36:22.752Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6612lb # [ 141.697164] niks3-server[1021]: 2026/09/20 13:36:22 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6613lb # [ 141.706153] niks3-server[1021]: 2026/09/20 13:36:22 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6614lb # [ 141.711144] niks3-server[1021]: 2026/09/20 13:36:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6615lb # [ 141.717191] niks3-server[1021]: 2026/09/20 13:36:22 INFO Signed narinfos id=61 count=16616worker1 # [ 141.726669] nix-grpc-daemon[1746]: time=2026-09-20T13:36:22.803Z level=INFO msg="Uploading 1 narinfos"6617lb # [ 141.723348] niks3-server[1021]: 2026/09/20 13:36:22 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6618lb # [ 141.731845] niks3-server[1021]: 2026/09/20 13:36:22 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6619lb # [ 141.736726] niks3-server[1021]: 2026/09/20 13:36:22 INFO Completed upload id=616620worker1 # [ 141.743434] nix-grpc-daemon[1746]: time=2026-09-20T13:36:22.820Z level=INFO msg="Upload complete. (258ms)"6621lb # [ 141.740665] niks3-server[1021]: 2026/09/20 13:36:22 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6622worker1 # [ 141.750372] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16623worker2 # [ 141.763932] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:22Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16624worker1 # [ 141.761727] nix-daemon[843]: reaped child process 2007, status = succeeded6625worker1 # [ 141.795248] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966626worker1 # [ 141.807422] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966627worker1 # [ 141.819745] nix-grpc-daemon[1746]: time=2026-09-20T13:36:22.896Z level=INFO msg="All 2 paths already cached"6628worker1 # [ 141.827313] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511966629worker1 # [ 141.836170] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6630worker1 # [ 142.012289] nix-daemon[843]: accepted connection from pid 2031, user nix-grpc-daemon (trusted)6631worker1 # [ 142.024711] nix-daemon[843]: reaped child process 2034, status = succeeded6632worker1 # [ 142.191878] nix-daemon[843]: accepted connection from pid 2036, user nix-grpc-daemon (trusted)6633worker1 # [ 142.204070] nix-daemon[843]: reaped child process 2039, status = succeeded6634lb # [ 142.211552] niks3-server[1021]: 2026/09/20 13:36:23 INFO Received uploads request method=POST path=/api/pending_closures6635worker1 # [ 142.227043] nix-grpc-daemon[1746]: time=2026-09-20T13:36:23.304Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6636worker1 # [ 142.228576] nix-grpc-daemon[1746]: time=2026-09-20T13:36:23.305Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6637lb # [ 142.240872] niks3-server[1021]: 2026/09/20 13:36:23 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6638lb # [ 142.251960] niks3-server[1021]: 2026/09/20 13:36:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6639lb # [ 142.257504] niks3-server[1021]: 2026/09/20 13:36:23 INFO Signed narinfos id=62 count=16640worker1 # [ 142.267526] nix-grpc-daemon[1746]: time=2026-09-20T13:36:23.344Z level=INFO msg="Uploading 1 narinfos"6641lb # [ 142.261644] niks3-server[1021]: 2026/09/20 13:36:23 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6642lb # [ 142.274215] niks3-server[1021]: 2026/09/20 13:36:23 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6643lb # [ 142.280643] niks3-server[1021]: 2026/09/20 13:36:23 INFO Completed upload id=626644worker1 # [ 142.287365] nix-grpc-daemon[1746]: time=2026-09-20T13:36:23.364Z level=INFO msg="Upload complete. (439ms)"6645lb # [ 142.283257] niks3-server[1021]: 2026/09/20 13:36:23 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6646worker1 # [ 142.290912] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=0 paths=1 nar_bytes_in=7526647worker1 # [ 142.296239] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511966648worker1 # [ 142.305924] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6649worker1 # [ 142.312056] nix-daemon[843]: reaped child process 2029, status = succeeded6650worker1 # [ 142.315820] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6651worker1 # [ 143.337725] nix-daemon[843]: reaped child process 2043, status = succeeded6652worker1 # [ 143.483614] nix-daemon[843]: accepted connection from pid 2058, user nix-grpc-daemon (trusted)6653worker1 # [ 143.495830] nix-daemon[843]: reaped child process 2061, status = succeeded6654lb # [ 143.504957] niks3-server[1021]: 2026/09/20 13:36:24 INFO Received uploads request method=POST path=/api/pending_closures6655worker1 # [ 143.519789] nix-grpc-daemon[1746]: time=2026-09-20T13:36:24.596Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6656worker1 # [ 143.521296] nix-grpc-daemon[1746]: time=2026-09-20T13:36:24.598Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6657lb # [ 143.539704] niks3-server[1021]: 2026/09/20 13:36:24 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6658lb # [ 143.549352] niks3-server[1021]: 2026/09/20 13:36:24 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6659lb # [ 143.558375] niks3-server[1021]: 2026/09/20 13:36:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6660lb # [ 143.563559] niks3-server[1021]: 2026/09/20 13:36:24 INFO Signed narinfos id=63 count=16661worker1 # [ 143.573175] nix-grpc-daemon[1746]: time=2026-09-20T13:36:24.650Z level=INFO msg="Uploading 1 narinfos"6662lb # [ 143.569053] niks3-server[1021]: 2026/09/20 13:36:24 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6663lb # [ 143.579589] niks3-server[1021]: 2026/09/20 13:36:24 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6664lb # [ 143.584457] niks3-server[1021]: 2026/09/20 13:36:24 INFO Completed upload id=636665worker1 # [ 143.591225] nix-grpc-daemon[1746]: time=2026-09-20T13:36:24.668Z level=INFO msg="Upload complete. (267ms)"6666lb # [ 143.589205] niks3-server[1021]: 2026/09/20 13:36:24 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6667worker1 # [ 143.596715] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51196 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16668worker1 # [ 143.609741] nix-daemon[843]: reaped child process 2041, status = succeeded6669client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.23 seconds)6670worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6671worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6672client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16673worker1 # [ 143.967575] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511966674worker1 # [ 143.972759] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511966675worker2 # [ 144.008559] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:24Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06676lb # [ 148.306922] envoy[920]: conn peer=[2001:db8:1::1]:54842 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27012 tx=10609 ms=149656677client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.27 seconds)6678(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.56 seconds)6679subtest: low disk drains a worker and builds go to the other6680worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6681worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.95 seconds)6682worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6683worker1 # [ 175.286680] nix-grpc-daemon[1690]: ts=2026-09-20T13:36:56Z level=info event=unhealthy reason=min_free6684worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)6685client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26686client # don't know how to build these paths:6687worker2 # [ 176.277311] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:541906688client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6689worker2 # [ 176.280286] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906690worker2 # [ 176.299098] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06691worker2 # [ 176.301293] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16692worker2 # [ 176.343189] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906693worker2 # [ 176.351855] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906694client # copying 1 paths to 'lb:50051'...6695worker2 # [ 176.360370] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541906696client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6697worker2 # [ 176.368133] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6698worker2 # [ 176.528796] nix-daemon[855]: accepted connection from pid 1654, user nix-grpc-daemon (trusted)6699worker2 # [ 176.544220] nix-daemon[855]: reaped child process 1657, status = succeeded6700worker2 # [ 176.690203] nix-daemon[855]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6701worker2 # [ 176.705399] nix-daemon[855]: reaped child process 1662, status = succeeded6702lb # [ 176.700837] niks3-server[1021]: 2026/09/20 13:36:57 INFO Received uploads request method=POST path=/api/pending_closures6703worker2 # [ 176.728498] nix-grpc-daemon[1448]: time=2026-09-20T13:36:57.717Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6704worker2 # [ 176.730227] nix-grpc-daemon[1448]: time=2026-09-20T13:36:57.719Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6705lb # [ 176.732737] niks3-server[1021]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6706lb # [ 176.745342] niks3-server[1021]: 2026/09/20 13:36:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6707worker2 # [ 176.773646] nix-grpc-daemon[1448]: time=2026-09-20T13:36:57.762Z level=INFO msg="Uploading 1 narinfos"6708lb # [ 176.755122] niks3-server[1021]: 2026/09/20 13:36:57 INFO Signed narinfos id=64 count=16709lb # [ 176.760969] niks3-server[1021]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6710lb # [ 176.773208] niks3-server[1021]: 2026/09/20 13:36:57 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6711lb # [ 176.779696] niks3-server[1021]: 2026/09/20 13:36:57 INFO Completed upload id=646712worker2 # [ 176.799212] nix-grpc-daemon[1448]: time=2026-09-20T13:36:57.787Z level=INFO msg="Upload complete. (424ms)"6713lb # [ 176.781349] niks3-server[1021]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6714worker2 # [ 176.805215] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=0 paths=1 nar_bytes_in=5126715worker2 # [ 176.811677] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906716worker2 # [ 176.823112] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6717worker2 # [ 176.831201] nix-daemon[855]: reaped child process 1652, status = succeeded6718client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6719client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6720worker2 # [ 176.836539] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6721lb # [ 178.308693] envoy[920]: conn peer=[2001:db8:1::1]:45610 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=300446722client # farm-a> LOG-farm-a-drain6723worker2 # [ 178.466381] nix-daemon[855]: reaped child process 1666, status = succeeded6724worker2 # [ 178.632899] nix-daemon[855]: accepted connection from pid 1681, user nix-grpc-daemon (trusted)6725worker2 # [ 178.647447] nix-daemon[855]: reaped child process 1684, status = succeeded6726lb # [ 178.647071] niks3-server[1021]: 2026/09/20 13:36:59 INFO Received uploads request method=POST path=/api/pending_closures6727worker2 # [ 178.672425] nix-grpc-daemon[1448]: time=2026-09-20T13:36:59.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6728worker2 # [ 178.674103] nix-grpc-daemon[1448]: time=2026-09-20T13:36:59.663Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6729lb # [ 178.683923] niks3-server[1021]: 2026/09/20 13:36:59 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6730lb # [ 178.694448] niks3-server[1021]: 2026/09/20 13:36:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6731lb # [ 178.698858] niks3-server[1021]: 2026/09/20 13:36:59 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6732lb # [ 178.706482] niks3-server[1021]: 2026/09/20 13:36:59 INFO Signed narinfos id=65 count=16733worker2 # [ 178.729465] nix-grpc-daemon[1448]: time=2026-09-20T13:36:59.717Z level=INFO msg="Uploading 1 narinfos"6734lb # [ 178.713499] niks3-server[1021]: 2026/09/20 13:36:59 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6735lb # [ 178.723205] niks3-server[1021]: 2026/09/20 13:36:59 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6736lb # [ 178.728147] niks3-server[1021]: 2026/09/20 13:36:59 INFO Completed upload id=656737worker2 # [ 178.747328] nix-grpc-daemon[1448]: time=2026-09-20T13:36:59.736Z level=INFO msg="Upload complete. (301ms)"6738lb # [ 178.731212] niks3-server[1021]: 2026/09/20 13:36:59 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6739worker2 # [ 178.755271] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16740worker2 # [ 178.763626] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:59Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06741worker2 # [ 178.767234] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:59Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16742worker2 # [ 178.774665] nix-daemon[855]: reaped child process 1664, status = succeeded6743worker2 # [ 178.808748] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906744worker2 # [ 178.821813] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906745worker2 # [ 178.834159] nix-grpc-daemon[1448]: time=2026-09-20T13:36:59.822Z level=INFO msg="All 1 paths already cached"6746client # copying 1 paths to 'lb:50051'...6747client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6748worker2 # [ 178.842297] nix-grpc-daemon[1372]: ts=2026-09-20T13:36:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541906749worker2 # [ 178.850860] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6750worker2 # [ 179.007659] nix-daemon[855]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6751worker2 # [ 179.022883] nix-daemon[855]: reaped child process 1693, status = succeeded6752worker2 # [ 179.185493] nix-daemon[855]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6753worker2 # [ 179.199714] nix-daemon[855]: reaped child process 1698, status = succeeded6754lb # [ 179.195098] niks3-server[1021]: 2026/09/20 13:37:00 INFO Received uploads request method=POST path=/api/pending_closures6755worker2 # [ 179.223326] nix-grpc-daemon[1448]: time=2026-09-20T13:37:00.211Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6756worker2 # [ 179.224767] nix-grpc-daemon[1448]: time=2026-09-20T13:37:00.211Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6757lb # [ 179.221199] niks3-server[1021]: 2026/09/20 13:37:00 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6758lb # [ 179.233278] niks3-server[1021]: 2026/09/20 13:37:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6759lb # [ 179.237915] niks3-server[1021]: 2026/09/20 13:37:00 INFO Signed narinfos id=66 count=16760worker2 # [ 179.260062] nix-grpc-daemon[1448]: time=2026-09-20T13:37:00.248Z level=INFO msg="Uploading 1 narinfos"6761lb # [ 179.243635] niks3-server[1021]: 2026/09/20 13:37:00 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6762lb # [ 179.255171] niks3-server[1021]: 2026/09/20 13:37:00 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6763worker2 # [ 179.280777] nix-grpc-daemon[1448]: time=2026-09-20T13:37:00.269Z level=INFO msg="Upload complete. (417ms)"6764lb # [ 179.261754] niks3-server[1021]: 2026/09/20 13:37:00 INFO Completed upload id=666765lb # [ 179.265520] niks3-server[1021]: 2026/09/20 13:37:00 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6766worker2 # [ 179.283958] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=0 paths=1 nar_bytes_in=6246767worker2 # [ 179.290303] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906768worker2 # [ 179.300959] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6769worker2 # [ 179.306780] nix-daemon[855]: reaped child process 1688, status = succeeded6770worker2 # [ 179.310110] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6771client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6772client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6773client # farm-b> LOG-farm-b-drain6774worker2 # [ 180.337138] nix-daemon[855]: reaped child process 1702, status = succeeded6775worker2 # [ 180.482304] nix-daemon[855]: accepted connection from pid 1717, user nix-grpc-daemon (trusted)6776worker2 # [ 180.494611] nix-daemon[855]: reaped child process 1720, status = succeeded6777lb # [ 180.492412] niks3-server[1021]: 2026/09/20 13:37:01 INFO Received uploads request method=POST path=/api/pending_closures6778worker2 # [ 180.519607] nix-grpc-daemon[1448]: time=2026-09-20T13:37:01.508Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6779worker2 # [ 180.521160] nix-grpc-daemon[1448]: time=2026-09-20T13:37:01.510Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6780lb # [ 180.526128] niks3-server[1021]: 2026/09/20 13:37:01 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6781lb # [ 180.543147] niks3-server[1021]: 2026/09/20 13:37:01 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6782lb # [ 180.549498] niks3-server[1021]: 2026/09/20 13:37:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6783worker2 # [ 180.573538] nix-grpc-daemon[1448]: time=2026-09-20T13:37:01.562Z level=INFO msg="Uploading 1 narinfos"6784lb # [ 180.554880] niks3-server[1021]: 2026/09/20 13:37:01 INFO Signed narinfos id=67 count=16785lb # [ 180.560286] niks3-server[1021]: 2026/09/20 13:37:01 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6786lb # [ 180.569893] niks3-server[1021]: 2026/09/20 13:37:01 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6787lb # [ 180.577702] niks3-server[1021]: 2026/09/20 13:37:01 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6788lb # [ 180.580242] niks3-server[1021]: 2026/09/20 13:37:01 INFO Completed upload id=676789worker2 # [ 180.599484] nix-grpc-daemon[1448]: time=2026-09-20T13:37:01.588Z level=INFO msg="Upload complete. (280ms)"6790worker2 # [ 180.604480] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16791worker2 # [ 180.614831] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:01Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06792worker2 # [ 180.617225] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:01Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16793worker2 # [ 180.621799] nix-daemon[855]: reaped child process 1700, status = succeeded6794worker2 # [ 180.658683] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906795worker2 # [ 180.671060] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541906796worker2 # [ 180.683674] nix-grpc-daemon[1448]: time=2026-09-20T13:37:01.672Z level=INFO msg="All 2 paths already cached"6797client # copying 1 paths to 'lb:50051'...6798client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6799worker2 # [ 180.691600] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541906800worker2 # [ 180.700284] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6801worker2 # [ 180.864098] nix-daemon[855]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)6802worker2 # [ 180.876803] nix-daemon[855]: reaped child process 1729, status = succeeded6803worker2 # [ 181.031672] nix-daemon[855]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6804worker2 # [ 181.043635] nix-daemon[855]: reaped child process 1734, status = succeeded6805lb # [ 181.039676] niks3-server[1021]: 2026/09/20 13:37:01 INFO Received uploads request method=POST path=/api/pending_closures6806worker2 # [ 181.067866] nix-grpc-daemon[1448]: time=2026-09-20T13:37:02.056Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6807worker2 # [ 181.069217] nix-grpc-daemon[1448]: time=2026-09-20T13:37:02.056Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6808lb # [ 181.064720] niks3-server[1021]: 2026/09/20 13:37:01 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6809lb # [ 181.077130] niks3-server[1021]: 2026/09/20 13:37:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6810lb # [ 181.082291] niks3-server[1021]: 2026/09/20 13:37:01 INFO Signed narinfos id=68 count=16811worker2 # [ 181.105084] nix-grpc-daemon[1448]: time=2026-09-20T13:37:02.093Z level=INFO msg="Uploading 1 narinfos"6812lb # [ 181.095896] niks3-server[1021]: 2026/09/20 13:37:01 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6813lb # [ 181.103752] niks3-server[1021]: 2026/09/20 13:37:01 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6814lb # [ 181.111230] niks3-server[1021]: 2026/09/20 13:37:02 INFO Completed upload id=686815worker2 # [ 181.130443] nix-grpc-daemon[1448]: time=2026-09-20T13:37:02.119Z level=INFO msg="Upload complete. (417ms)"6816lb # [ 181.113743] niks3-server[1021]: 2026/09/20 13:37:02 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6817worker2 # [ 181.134200] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=0 paths=1 nar_bytes_in=7526818worker2 # [ 181.139259] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541906819worker2 # [ 181.149107] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6820worker2 # [ 181.157118] nix-daemon[855]: reaped child process 1724, status = succeeded6821worker2 # [ 181.160898] nix-daemon[855]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)6822client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6823client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6824client # farm-top> LOG-farm-top-drain6825worker2 # [ 182.185914] nix-daemon[855]: reaped child process 1738, status = succeeded6826worker2 # [ 182.339323] nix-daemon[855]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)6827worker2 # [ 182.350992] nix-daemon[855]: reaped child process 1756, status = succeeded6828lb # [ 182.350748] niks3-server[1021]: 2026/09/20 13:37:03 INFO Received uploads request method=POST path=/api/pending_closures6829worker2 # [ 182.377120] nix-grpc-daemon[1448]: time=2026-09-20T13:37:03.365Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6830worker2 # [ 182.378625] nix-grpc-daemon[1448]: time=2026-09-20T13:37:03.367Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6831lb # [ 182.388610] niks3-server[1021]: 2026/09/20 13:37:03 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6832lb # [ 182.396116] niks3-server[1021]: 2026/09/20 13:37:03 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6833lb # [ 182.408517] niks3-server[1021]: 2026/09/20 13:37:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6834worker2 # [ 182.432098] nix-grpc-daemon[1448]: time=2026-09-20T13:37:03.420Z level=INFO msg="Uploading 1 narinfos"6835lb # [ 182.413106] niks3-server[1021]: 2026/09/20 13:37:03 INFO Signed narinfos id=69 count=16836lb # [ 182.422344] niks3-server[1021]: 2026/09/20 13:37:03 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6837lb # [ 182.428574] niks3-server[1021]: 2026/09/20 13:37:03 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6838lb # [ 182.434160] niks3-server[1021]: 2026/09/20 13:37:03 INFO Completed upload id=696839lb # [ 182.437310] niks3-server[1021]: 2026/09/20 13:37:03 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6840worker2 # [ 182.455411] nix-grpc-daemon[1448]: time=2026-09-20T13:37:03.444Z level=INFO msg="Upload complete. (287ms)"6841worker2 # [ 182.462430] nix-grpc-daemon[1372]: ts=2026-09-20T13:37:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54190 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16842worker2 # [ 182.475695] nix-daemon[855]: reaped child process 1736, status = succeeded6843client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.42 seconds)6844client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6845client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.18 seconds)6846worker1: must succeed: rm /nix/.rw-store/fill6847worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6848worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6849worker1 # [ 183.293725] nix-grpc-daemon[1690]: ts=2026-09-20T13:37:04Z level=info event=healthy reason=min_free6850worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.09 seconds)6851(finished: subtest: low disk drains a worker and builds go to the other, in 9.95 seconds)6852(finished: run the VM test script, in 184.87 seconds)6853test script finished in 185.11s6854cleanup6855kill QemuMachine (pid 49)6856client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6857kill QemuMachine (pid 51)6858lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6859kill QemuMachine (pid 50)6860worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6861kill QemuMachine (pid 52)6862worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6863(finished: cleanup, in 0.96 seconds)6864additionally exposed symbols:6865 client, lb, worker1, worker2,6866 vlan1,6867 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh