vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #238
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb: QEMU running (pid 50)14lb # Formatting '/build/vm-state-lb/tmp.oFem9z7Ib9', fmt=raw size=107374182415lb # mke2fs 1.47.4 (6-Mar-2025)16lb # Discarding device blocks: 0/262144 done17lb # Creating filesystem with 262144 4k blocks and 65536 inodes18lb # Filesystem UUID: 512cb752-32a1-43ac-b5e6-bf5484017d1619lb # Superblock backups stored on blocks:20lb # 32768, 98304, 163840, 22937621lb # 22lb # Allocating group tables: 0/8 done23lb # Writing inode tables: 0/8 done24lb # Creating journal (8192 blocks): done25lb # Writing superblocks and filesystem accounting information: 0/8 done26lb # 27lb # Virtualisation disk image created.28worker1 # Disk image does not exist, creating the virtualisation disk image...29worker1: QEMU running (pid 52)30worker1 # Formatting '/build/vm-state-worker1/tmp.8jyYPbJUNA', fmt=raw size=107374182431worker1 # mke2fs 1.47.4 (6-Mar-2025)32worker1 # Discarding device blocks: 0/262144 done33worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes34worker1 # Filesystem UUID: 2940e042-0a4e-4138-90bd-e6a32c59c62e35worker1 # Superblock backups stored on blocks:36worker1 # 32768, 98304, 163840, 22937637worker1 # 38worker1 # Allocating group tables: 0/8 done39worker1 # Writing inode tables: 0/8 done40worker1 # Creating journal (8192 blocks): done41worker1 # Writing superblocks and filesystem accounting information: 0/8 done42worker1 # 43worker1 # Virtualisation disk image created.44client # Disk image does not exist, creating the virtualisation disk image...45client: QEMU running (pid 49)46client # Formatting '/build/vm-state-client/tmp.I5ElJdCAvb', fmt=raw size=107374182447client # mke2fs 1.47.4 (6-Mar-2025)48client # Discarding device blocks: 0/262144 done49client # Creating filesystem with 262144 4k blocks and 65536 inodes50client # Filesystem UUID: 90370718-eda1-4b87-9a37-3e43570b5d8b51client # Superblock backups stored on blocks:52client # 32768, 98304, 163840, 22937653client # 54client # Allocating group tables: 0/8 done55client # Writing inode tables: 0/8 done56client # Creating journal (8192 blocks): done57client # Writing superblocks and filesystem accounting information: 0/8 done58client # 59client # Virtualisation disk image created.60worker2 # Disk image does not exist, creating the virtualisation disk image...61worker2: QEMU running (pid 51)62worker2 # Formatting '/build/vm-state-worker2/tmp.xpLjZU7rGT', fmt=raw size=107374182463worker2 # mke2fs 1.47.4 (6-Mar-2025)64worker2 # Discarding device blocks: 0/262144 done65(finished: start all VMs, in 0.23 seconds)66worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes67client: waiting for unit network-addresses-eth1.service68worker2 # Filesystem UUID: d6e46cca-eff4-4cae-b40e-480b6bcdb37669client: waiting for the VM to finish booting70worker2 # Superblock backups stored on blocks:71worker2 # 32768, 98304, 163840, 22937672worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086lb # 87lb # 88lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...90worker1 # 91worker1 # 92worker1 # 93worker1 # 94client # 95worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0096client # 97lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...98lb # 99client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00100lb # 101lb # 102lb # 103lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105worker1 # 106worker1 # 107client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108worker2 # 109client # 110worker2 # 111client # 112client # 113client # 114worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00115client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117lb # 118lb # 119worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...120worker2 # 121worker2 # 122worker2 # 123worker2 # 124client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...125client # 126client # 127worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker2 # 130worker2 # 131worker1 # Booting from ROM...132lb # Booting from ROM...133client # Booting from ROM...134worker2 # Booting from ROM...135worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/riz6v2gib15fx5cm4zm7zjb2w367l1px-nixos-system-worker1-test/init regInfo=/nix/store/bjbxw5wa82sp3dnlyh9b1k7djicmw95y-closure-info/registration console=ttyS0,115200n8 console=tty0137worker1 # [ 0.000000] BIOS-provided physical RAM map:138worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148worker1 # [ 0.000000] NX (Execute Disable) protection: active149worker1 # [ 0.000000] APIC: Static calls initialized150worker1 # [ 0.000000] SMBIOS 2.8 present.151worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152worker1 # [ 0.000000] DMI: Memory slots populated: 1/1153worker1 # [ 0.000000] Hypervisor detected: KVM154worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000155worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00156worker1 # [ 0.000001] kvm-clock: using sched offset of 455122364 cycles157worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns158worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor159worker1 # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000160worker1 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs161worker1 # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT162worker1 # [ 0.002745] found SMP MP-table at [mem 0x000f5450-0x000f545f]163worker1 # [ 0.002757] Using GB pages for direct mapping164worker1 # [ 0.002842] RAMDISK: [mem 0x5e367000-0x5ffcffff]165worker1 # [ 0.002849] ACPI: Early table checksum verification disabled166lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026167worker1 # [ 0.002853] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )168worker1 # [ 0.002857] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)169worker1 # [ 0.002861] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)170lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0171worker1 # [ 0.002869] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)172lb # [ 0.000000] BIOS-provided physical RAM map:173worker1 # [ 0.002871] ACPI: FACS 0x000000005FFE0000 000040174lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable175worker1 # [ 0.002872] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)176lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved177client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026178worker1 # [ 0.002874] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)179lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved180lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable181worker1 # [ 0.002875] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)182lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved183worker1 # [ 0.002877] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)184lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved185worker1 # [ 0.002878] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]186lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved187worker1 # [ 0.002879] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]188client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test/init regInfo=/nix/store/nc269ch11d9y5i5mmzsc7lzql3vkpbc5-closure-info/registration console=ttyS0,115200n8 console=tty0189lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved190client # [ 0.000000] BIOS-provided physical RAM map:191worker1 # [ 0.002880] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]192lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved193client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable194worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026195worker1 # [ 0.002880] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]196lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved197client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved198worker1 # [ 0.002881] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]199lb # [ 0.000000] NX (Execute Disable) protection: active200lb # [ 0.000000] APIC: Static calls initialized201client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved202worker1 # [ 0.002881] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]203lb # [ 0.000000] SMBIOS 2.8 present.204client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable205worker1 # [ 0.002882] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]206worker1 # [ 0.003104] No NUMA configuration found207lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014208client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved209worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ll48yx5nakx0nblsfrhxnkiaziccsil3-nixos-system-worker2-test/init regInfo=/nix/store/kdc2ki0fvqr7ggp0qnfihfgh6ad20rmc-closure-info/registration console=ttyS0,115200n8 console=tty0210lb # [ 0.000000] DMI: Memory slots populated: 1/1211worker1 # [ 0.003105] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]212lb # [ 0.000000] Hypervisor detected: KVM213worker2 # [ 0.000000] BIOS-provided physical RAM map:214client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved215worker1 # [ 0.003107] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]216lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000217worker1 # [ 0.005399] Zone ranges:218worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable219client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved220lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00221worker1 # [ 0.005400] DMA [mem 0x0000000000001000-0x0000000000ffffff]222client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved223worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved224lb # [ 0.000001] kvm-clock: using sched offset of 473824281 cycles225worker1 # [ 0.005402] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]226client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved227worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved228worker1 # [ 0.005403] Normal empty229worker1 # [ 0.005404] Device empty230lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns231worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable232worker1 # [ 0.005404] Movable zone start for each node233lb # [ 0.000006] tsc: Detected 2400.012 MHz processor234worker1 # [ 0.005405] Early memory node ranges235worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved236client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved237lb # [ 0.000829] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000238client # [ 0.000000] NX (Execute Disable) protection: active239worker1 # [ 0.005405] node 0: [mem 0x0000000000001000-0x000000000009efff]240client # [ 0.000000] APIC: Static calls initialized241worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved242client # [ 0.000000] SMBIOS 2.8 present.243worker1 # [ 0.005406] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]244lb # [ 0.000858] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs245worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved246client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014247worker1 # [ 0.005408] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]248lb # [ 0.000861] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT249client # [ 0.000000] DMI: Memory slots populated: 1/1250worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved251worker1 # [ 0.005428] On node 0, zone DMA: 1 pages in unavailable ranges252lb # [ 0.002782] found SMP MP-table at [mem 0x000f5450-0x000f545f]253client # [ 0.000000] Hypervisor detected: KVM254lb # [ 0.002798] Using GB pages for direct mapping255worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved256worker1 # [ 0.005701] On node 0, zone DMA: 97 pages in unavailable ranges257client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000258lb # [ 0.002890] RAMDISK: [mem 0x5e367000-0x5ffcffff]259worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved260worker1 # [ 0.034268] On node 0, zone DMA32: 40 pages in unavailable ranges261client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00262lb # [ 0.002900] ACPI: Early table checksum verification disabled263worker1 # [ 0.034731] ACPI: PM-Timer IO Port: 0x608264worker2 # [ 0.000000] NX (Execute Disable) protection: active265client # [ 0.000000] kvm-clock: using sched offset of 460410078 cycles266lb # [ 0.002905] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )267worker2 # [ 0.000000] APIC: Static calls initialized268worker1 # [ 0.034742] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])269worker2 # [ 0.000000] SMBIOS 2.8 present.270worker1 # [ 0.034771] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23271lb # [ 0.002909] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)272client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns273worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014274client # [ 0.000006] tsc: Detected 2400.012 MHz processor275worker1 # [ 0.034773] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)276lb # [ 0.002914] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)277worker2 # [ 0.000000] DMI: Memory slots populated: 1/1278client # [ 0.000840] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000279worker1 # [ 0.034775] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)280worker2 # [ 0.000000] Hypervisor detected: KVM281lb # [ 0.002923] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)282worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000283worker1 # [ 0.034776] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)284client # [ 0.000868] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs285lb # [ 0.002925] ACPI: FACS 0x000000005FFE0000 000040286worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00287worker1 # [ 0.034777] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)288client # [ 0.000872] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT289lb # [ 0.002927] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)290worker2 # [ 0.000000] kvm-clock: using sched offset of 470465397 cycles291client # [ 0.002785] found SMP MP-table at [mem 0x000f5450-0x000f545f]292worker1 # [ 0.034777] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)293client # [ 0.002800] Using GB pages for direct mapping294lb # [ 0.002929] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)295worker1 # [ 0.034780] ACPI: Using ACPI (MADT) for SMP configuration information296worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns297client # [ 0.002942] RAMDISK: [mem 0x5e366000-0x5ffcffff]298worker1 # [ 0.034781] ACPI: HPET id: 0x8086a201 base: 0xfed00000299worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor300lb # [ 0.002930] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)301worker1 # [ 0.034784] TSC deadline timer available302client # [ 0.002951] ACPI: Early table checksum verification disabled303worker2 # [ 0.000805] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000304worker1 # [ 0.034788] CPU topo: Max. logical packages: 1305client # [ 0.002954] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )306lb # [ 0.002932] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)307worker1 # [ 0.034789] CPU topo: Max. logical dies: 1308worker2 # [ 0.000833] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs309client # [ 0.002959] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)310lb # [ 0.002933] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]311worker1 # [ 0.034789] CPU topo: Max. dies per package: 1312worker1 # [ 0.034793] CPU topo: Max. threads per core: 1313worker2 # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT314lb # [ 0.002934] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]315client # [ 0.002964] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)316worker1 # [ 0.034794] CPU topo: Num. cores per package: 1317worker2 # [ 0.002741] found SMP MP-table at [mem 0x000f5450-0x000f545f]318worker1 # [ 0.034794] CPU topo: Num. threads per package: 1319lb # [ 0.002935] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]320worker2 # [ 0.002752] Using GB pages for direct mapping321client # [ 0.002977] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)322worker1 # [ 0.034794] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs323worker2 # [ 0.002905] RAMDISK: [mem 0x5e367000-0x5ffcffff]324lb # [ 0.002935] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]325client # [ 0.002979] ACPI: FACS 0x000000005FFE0000 000040326worker2 # [ 0.002914] ACPI: Early table checksum verification disabled327worker1 # [ 0.034815] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()328lb # [ 0.002936] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]329worker2 # [ 0.002925] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )330client # [ 0.002981] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)331worker1 # [ 0.034847] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]332lb # [ 0.002936] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]333client # [ 0.002983] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)334worker2 # [ 0.002930] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)335worker1 # [ 0.034849] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]336lb # [ 0.002937] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]337client # [ 0.002984] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)338lb # [ 0.003187] No NUMA configuration found339worker2 # [ 0.002934] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)340worker1 # [ 0.034850] [mem 0x60000000-0xafffffff] available for PCI devices341lb # [ 0.003188] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]342worker1 # [ 0.034852] Booting paravirtualized kernel on KVM343client # [ 0.002986] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)344worker2 # [ 0.002942] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)345lb # [ 0.003190] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]346worker2 # [ 0.002944] ACPI: FACS 0x000000005FFE0000 000040347lb # [ 0.005690] Zone ranges:348client # [ 0.002987] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]349worker1 # [ 0.034856] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns350lb # [ 0.005692] DMA [mem 0x0000000000001000-0x0000000000ffffff]351worker2 # [ 0.002946] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)352client # [ 0.002988] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]353worker1 # [ 0.039333] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1354lb # [ 0.005695] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]355lb # [ 0.005696] Normal empty356client # [ 0.002989] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]357worker2 # [ 0.002947] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)358lb # [ 0.005697] Device empty359worker1 # [ 0.041571] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152360worker1 # [ 0.041617] kvm-guest: PV spinlocks disabled, single CPU361client # [ 0.002989] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]362lb # [ 0.005698] Movable zone start for each node363worker2 # [ 0.002949] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)364lb # [ 0.005699] Early memory node ranges365client # [ 0.002990] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]366lb # [ 0.005700] node 0: [mem 0x0000000000001000-0x000000000009efff]367worker2 # [ 0.002950] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)368client # [ 0.002990] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]369lb # [ 0.005701] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]370worker2 # [ 0.002952] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]371client # [ 0.002990] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]372lb # [ 0.005702] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]373worker2 # [ 0.002953] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]374client # [ 0.003229] No NUMA configuration found375lb # [ 0.005726] On node 0, zone DMA: 1 pages in unavailable ranges376client # [ 0.003230] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]377worker1 # [ 0.041619] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/riz6v2gib15fx5cm4zm7zjb2w367l1px-nixos-system-worker1-test/init regInfo=/nix/store/bjbxw5wa82sp3dnlyh9b1k7djicmw95y-closure-info/registration console=ttyS0,115200n8 console=tty0378worker2 # [ 0.002953] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]379lb # [ 0.006006] On node 0, zone DMA: 97 pages in unavailable ranges380client # [ 0.003233] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]381worker2 # [ 0.002954] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]382client # [ 0.005544] Zone ranges:383lb # [ 0.035652] On node 0, zone DMA32: 40 pages in unavailable ranges384worker1 # [ 0.041726] Unknown kernel command line parameters "regInfo=/nix/store/bjbxw5wa82sp3dnlyh9b1k7djicmw95y-closure-info/registration", will be passed to user space.385lb # [ 0.036159] ACPI: PM-Timer IO Port: 0x608386client # [ 0.005545] DMA [mem 0x0000000000001000-0x0000000000ffffff]387worker2 # [ 0.002954] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]388worker1 # [ 0.041738] random: crng init done389lb # [ 0.036174] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])390client # [ 0.005547] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]391worker2 # [ 0.002955] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]392worker1 # [ 0.041739] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes393client # [ 0.005548] Normal empty394client # [ 0.005549] Device empty395lb # [ 0.036205] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23396worker2 # [ 0.002955] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]397client # [ 0.005550] Movable zone start for each node398worker1 # [ 0.043942] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)399lb # [ 0.036208] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)400worker2 # [ 0.003185] No NUMA configuration found401client # [ 0.005551] Early memory node ranges402lb # [ 0.036210] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)403worker2 # [ 0.003186] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]404client # [ 0.005551] node 0: [mem 0x0000000000001000-0x000000000009efff]405worker1 # [ 0.045347] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)406worker1 # [ 0.045382] Fallback order for Node 0: 0407worker2 # [ 0.003189] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]408lb # [ 0.036212] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)409client # [ 0.005552] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]410worker2 # [ 0.005578] Zone ranges:411worker1 # [ 0.045385] Built 1 zonelists, mobility grouping on. Total pages: 393078412lb # [ 0.036213] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)413worker1 # [ 0.045386] Policy zone: DMA32414client # [ 0.005553] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]415worker2 # [ 0.005580] DMA [mem 0x0000000000001000-0x0000000000ffffff]416client # [ 0.005574] On node 0, zone DMA: 1 pages in unavailable ranges417lb # [ 0.036214] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)418worker1 # [ 0.047956] mem auto-init: stack:all(zero), heap alloc:on, heap free:off419worker2 # [ 0.005582] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]420worker2 # [ 0.005583] Normal empty421worker2 # [ 0.005584] Device empty422lb # [ 0.036222] ACPI: Using ACPI (MADT) for SMP configuration information423client # [ 0.005896] On node 0, zone DMA: 97 pages in unavailable ranges424worker1 # [ 0.051747] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1425worker2 # [ 0.005584] Movable zone start for each node426lb # [ 0.036223] ACPI: HPET id: 0x8086a201 base: 0xfed00000427worker1 # [ 0.055145] allocated 3145728 bytes of page_ext428worker2 # [ 0.005585] Early memory node ranges429client # [ 0.033953] On node 0, zone DMA32: 40 pages in unavailable ranges430lb # [ 0.036230] TSC deadline timer available431client # [ 0.034443] ACPI: PM-Timer IO Port: 0x608432worker1 # [ 0.065513] ftrace: allocating 48731 entries in 192 pages433worker2 # [ 0.005586] node 0: [mem 0x0000000000001000-0x000000000009efff]434lb # [ 0.036234] CPU topo: Max. logical packages: 1435client # [ 0.034458] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])436lb # [ 0.036235] CPU topo: Max. logical dies: 1437worker1 # [ 0.065514] ftrace: allocated 192 pages with 2 groups438worker2 # [ 0.005587] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]439lb # [ 0.036236] CPU topo: Max. dies per package: 1440worker1 # [ 0.066735] Dynamic Preempt: lazy441client # [ 0.034490] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23442worker2 # [ 0.005588] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]443lb # [ 0.036239] CPU topo: Max. threads per core: 1444client # [ 0.034493] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)445worker1 # [ 0.066858] rcu: Preemptible hierarchical RCU implementation.446worker2 # [ 0.005609] On node 0, zone DMA: 1 pages in unavailable ranges447lb # [ 0.036239] CPU topo: Num. cores per package: 1448worker1 # [ 0.066859] rcu: RCU event tracing is enabled.449client # [ 0.034495] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)450lb # [ 0.036240] CPU topo: Num. threads per package: 1451worker2 # [ 0.005887] On node 0, zone DMA: 97 pages in unavailable ranges452lb # [ 0.036240] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs453client # [ 0.034497] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)454worker1 # [ 0.066859] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.455worker2 # [ 0.034560] On node 0, zone DMA32: 40 pages in unavailable ranges456worker2 # [ 0.035035] ACPI: PM-Timer IO Port: 0x608457client # [ 0.034498] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)458lb # [ 0.036268] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()459worker1 # [ 0.066861] Trampoline variant of Tasks RCU enabled.460worker2 # [ 0.035049] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])461worker1 # [ 0.066861] Rude variant of Tasks RCU enabled.462client # [ 0.034498] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)463lb # [ 0.036311] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]464worker1 # [ 0.066862] Tracing variant of Tasks RCU enabled.465worker2 # [ 0.035081] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23466client # [ 0.034501] ACPI: Using ACPI (MADT) for SMP configuration information467lb # [ 0.036313] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]468worker1 # [ 0.066862] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.469worker2 # [ 0.035084] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)470client # [ 0.034502] ACPI: HPET id: 0x8086a201 base: 0xfed00000471lb # [ 0.036315] [mem 0x60000000-0xafffffff] available for PCI devices472client # [ 0.034508] TSC deadline timer available473worker1 # [ 0.066863] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1474worker2 # [ 0.035085] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)475lb # [ 0.036317] Booting paravirtualized kernel on KVM476client # [ 0.034512] CPU topo: Max. logical packages: 1477worker2 # [ 0.035087] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)478client # [ 0.034513] CPU topo: Max. logical dies: 1479worker1 # [ 0.066880] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.480client # [ 0.034514] CPU topo: Max. dies per package: 1481lb # [ 0.036321] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns482worker2 # [ 0.035088] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)483client # [ 0.034517] CPU topo: Max. threads per core: 1484worker1 # [ 0.066882] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.485lb # [ 0.040886] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1486worker2 # [ 0.035089] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)487client # [ 0.034518] CPU topo: Num. cores per package: 1488client # [ 0.034518] CPU topo: Num. threads per package: 1489worker2 # [ 0.035091] ACPI: Using ACPI (MADT) for SMP configuration information490worker1 # [ 0.066883] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.491lb # [ 0.043343] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152492worker2 # [ 0.035092] ACPI: HPET id: 0x8086a201 base: 0xfed00000493lb # [ 0.043393] kvm-guest: PV spinlocks disabled, single CPU494client # [ 0.034518] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs495worker1 # [ 0.071325] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16496worker2 # [ 0.035097] TSC deadline timer available497client # [ 0.034543] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()498worker2 # [ 0.035101] CPU topo: Max. logical packages: 1499worker1 # [ 0.071606] rcu: srcu_init: Setting srcu_struct sizes based on contention.500worker2 # [ 0.035102] CPU topo: Max. logical dies: 1501client # [ 0.034579] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]502worker2 # [ 0.035102] CPU topo: Max. dies per package: 1503worker1 # [ 0.071612] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns504worker2 # [ 0.035108] CPU topo: Max. threads per core: 1505client # [ 0.034581] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]506worker1 # [ 0.071733] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)507worker2 # [ 0.035109] CPU topo: Num. cores per package: 1508client # [ 0.034583] [mem 0x60000000-0xafffffff] available for PCI devices509worker1 # [ 0.075244] Console: colour VGA+ 80x25510lb # [ 0.043395] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0511worker2 # [ 0.035109] CPU topo: Num. threads per package: 1512client # [ 0.034585] Booting paravirtualized kernel on KVM513worker1 # [ 0.075247] printk: legacy console [tty0] enabled514worker2 # [ 0.035110] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs515worker1 # [ 0.104836] printk: legacy console [ttyS0] enabled516client # [ 0.034588] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns517lb # [ 0.043499] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.518worker2 # [ 0.035132] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()519worker1 # [ 0.204645] ACPI: Core revision 20250807520lb # [ 0.043515] random: crng init done521client # [ 0.039205] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1522worker2 # [ 0.035167] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]523lb # [ 0.043516] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes524client # [ 0.042052] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152525worker1 # [ 0.205476] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns526worker2 # [ 0.035168] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]527lb # [ 0.046236] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)528client # [ 0.042118] kvm-guest: PV spinlocks disabled, single CPU529worker2 # [ 0.035170] [mem 0x60000000-0xafffffff] available for PCI devices530worker1 # [ 0.206960] APIC: Switch to symmetric I/O mode setup531worker2 # [ 0.035171] Booting paravirtualized kernel on KVM532lb # [ 0.047439] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)533worker1 # [ 0.207919] x2apic enabled534lb # [ 0.047484] Fallback order for Node 0: 0535worker2 # [ 0.035175] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns536lb # [ 0.047487] Built 1 zonelists, mobility grouping on. Total pages: 393078537worker1 # [ 0.208664] APIC: Switched APIC routing to: physical x2apic538lb # [ 0.047489] Policy zone: DMA32539worker2 # [ 0.039643] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1540lb # [ 0.050540] mem auto-init: stack:all(zero), heap alloc:on, heap free:off541client # [ 0.042120] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test/init regInfo=/nix/store/nc269ch11d9y5i5mmzsc7lzql3vkpbc5-closure-info/registration console=ttyS0,115200n8 console=tty0542worker2 # [ 0.041976] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152543worker1 # [ 0.210453] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1544lb # [ 0.054353] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1545worker2 # [ 0.042026] kvm-guest: PV spinlocks disabled, single CPU546lb # [ 0.058027] allocated 3145728 bytes of page_ext547lb # [ 0.069090] ftrace: allocating 48731 entries in 192 pages548client # [ 0.042244] Unknown kernel command line parameters "regInfo=/nix/store/nc269ch11d9y5i5mmzsc7lzql3vkpbc5-closure-info/registration", will be passed to user space.549worker1 # [ 0.211419] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns550lb # [ 0.069095] ftrace: allocated 192 pages with 2 groups551client # [ 0.042260] random: crng init done552lb # [ 0.070613] Dynamic Preempt: lazy553client # [ 0.042261] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes554lb # [ 0.070828] rcu: Preemptible hierarchical RCU implementation.555worker1 # [ 0.213098] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)556lb # [ 0.070829] rcu: RCU event tracing is enabled.557client # [ 0.045051] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)558worker2 # [ 0.042028] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ll48yx5nakx0nblsfrhxnkiaziccsil3-nixos-system-worker2-test/init regInfo=/nix/store/kdc2ki0fvqr7ggp0qnfihfgh6ad20rmc-closure-info/registration console=ttyS0,115200n8 console=tty0559worker1 # [ 0.214181] x86/cpu: User Mode Instruction Prevention (UMIP) activated560lb # [ 0.070830] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.561client # [ 0.047134] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)562lb # [ 0.070831] Trampoline variant of Tasks RCU enabled.563client # [ 0.047186] Fallback order for Node 0: 0564worker1 # [ 0.215237] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127565lb # [ 0.070832] Rude variant of Tasks RCU enabled.566worker2 # [ 0.042128] Unknown kernel command line parameters "regInfo=/nix/store/kdc2ki0fvqr7ggp0qnfihfgh6ad20rmc-closure-info/registration", will be passed to user space.567client # [ 0.047191] Built 1 zonelists, mobility grouping on. Total pages: 393078568lb # [ 0.070832] Tracing variant of Tasks RCU enabled.569client # [ 0.047192] Policy zone: DMA32570worker2 # [ 0.042141] random: crng init done571worker1 # [ 0.216096] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0572lb # [ 0.070833] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.573client # [ 0.050570] mem auto-init: stack:all(zero), heap alloc:on, heap free:off574worker2 # [ 0.042142] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes575lb # [ 0.070834] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1576client # [ 0.054492] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1577worker1 # [ 0.217099] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto578worker2 # [ 0.044425] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)579client # [ 0.058345] allocated 3145728 bytes of page_ext580lb # [ 0.070852] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.581client # [ 0.069274] ftrace: allocating 48731 entries in 192 pages582worker2 # [ 0.045844] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)583worker2 # [ 0.045879] Fallback order for Node 0: 0584worker1 # [ 0.219096] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl585client # [ 0.069278] ftrace: allocated 192 pages with 2 groups586lb # [ 0.070854] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.587client # [ 0.070252] Dynamic Preempt: lazy588worker2 # [ 0.045882] Built 1 zonelists, mobility grouping on. Total pages: 393078589worker1 # [ 0.220096] Transient Scheduler Attacks: Vulnerable: No microcode590worker2 # [ 0.045883] Policy zone: DMA32591client # [ 0.070435] rcu: Preemptible hierarchical RCU implementation.592lb # [ 0.070855] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.593client # [ 0.070435] rcu: RCU event tracing is enabled.594worker1 # [ 0.221095] Spectre V2 : Mitigation: Enhanced / Automatic IBRS595worker2 # [ 0.048566] mem auto-init: stack:all(zero), heap alloc:on, heap free:off596lb # [ 0.075453] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16597client # [ 0.070436] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.598worker2 # [ 0.052395] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1599worker1 # [ 0.222095] Speculative Return Stack Overflow: Mitigation: Safe RET600lb # [ 0.075747] rcu: srcu_init: Setting srcu_struct sizes based on contention.601client # [ 0.070437] Trampoline variant of Tasks RCU enabled.602worker2 # [ 0.055976] allocated 3145728 bytes of page_ext603client # [ 0.070438] Rude variant of Tasks RCU enabled.604worker2 # [ 0.066796] ftrace: allocating 48731 entries in 192 pages605lb # [ 0.075756] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns606client # [ 0.070438] Tracing variant of Tasks RCU enabled.607worker2 # [ 0.066798] ftrace: allocated 192 pages with 2 groups608worker2 # [ 0.067722] Dynamic Preempt: lazy609client # [ 0.070439] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.610lb # [ 0.075879] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)611worker2 # [ 0.067903] rcu: Preemptible hierarchical RCU implementation.612lb # [ 0.079506] Console: colour VGA+ 80x25613client # [ 0.070440] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1614worker2 # [ 0.067903] rcu: RCU event tracing is enabled.615lb # [ 0.079510] printk: legacy console [tty0] enabled616worker1 # [ 0.223095] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization617worker2 # [ 0.067904] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.618lb # [ 0.109227] printk: legacy console [ttyS0] enabled619client # [ 0.070458] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.620worker1 # [ 0.225102] Spectre V2 : Enabling IBPB for BPF621worker2 # [ 0.067906] Trampoline variant of Tasks RCU enabled.622lb # [ 0.205096] ACPI: Core revision 20250807623worker2 # [ 0.067907] Rude variant of Tasks RCU enabled.624client # [ 0.070460] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.625worker2 # [ 0.067907] Tracing variant of Tasks RCU enabled.626worker1 # [ 0.226096] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier627client # [ 0.070461] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.628lb # [ 0.205987] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns629worker2 # [ 0.067908] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.630worker1 # [ 0.227096] active return thunk: srso_alias_return_thunk631client # [ 0.075328] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16632lb # [ 0.207496] APIC: Switch to symmetric I/O mode setup633worker2 # [ 0.067908] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1634client # [ 0.075633] rcu: srcu_init: Setting srcu_struct sizes based on contention.635lb # [ 0.208445] x2apic enabled636worker1 # [ 0.228117] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'637worker2 # [ 0.068005] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.638client # [ 0.075641] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns639worker1 # [ 0.229095] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'640lb # [ 0.209236] APIC: Switched APIC routing to: physical x2apic641worker2 # [ 0.068007] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.642worker1 # [ 0.230095] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'643client # [ 0.075814] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)644client # [ 0.080213] Console: colour VGA+ 80x25645worker2 # [ 0.068008] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.646worker1 # [ 0.231095] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'647lb # [ 0.211063] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1648client # [ 0.080217] printk: legacy console [tty0] enabled649worker2 # [ 0.072493] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16650client # [ 0.117621] printk: legacy console [ttyS0] enabled651worker1 # [ 0.232095] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'652worker2 # [ 0.072789] rcu: srcu_init: Setting srcu_struct sizes based on contention.653client # [ 0.215141] ACPI: Core revision 20250807654lb # [ 0.212034] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns655worker1 # [ 0.233095] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'656worker2 # [ 0.072798] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns657lb # [ 0.213700] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)658client # [ 0.216023] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns659worker1 # [ 0.234095] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'660worker2 # [ 0.072914] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)661worker2 # [ 0.076794] Console: colour VGA+ 80x25662client # [ 0.217524] APIC: Switch to symmetric I/O mode setup663worker1 # [ 0.235096] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256664lb # [ 0.214794] x86/cpu: User Mode Instruction Prevention (UMIP) activated665worker2 # [ 0.076797] printk: legacy console [tty0] enabled666client # [ 0.218486] x2apic enabled667worker2 # [ 0.106561] printk: legacy console [ttyS0] enabled668worker1 # [ 0.236095] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64669lb # [ 0.215835] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127670worker2 # [ 0.202577] ACPI: Core revision 20250807671client # [ 0.219331] APIC: Switched APIC routing to: physical x2apic672worker1 # [ 0.237095] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512673lb # [ 0.217397] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0674worker1 # [ 0.238095] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024675worker2 # [ 0.203525] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns676client # [ 0.221200] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1677worker1 # [ 0.239095] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8678lb # [ 0.217701] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto679worker2 # [ 0.205070] APIC: Switch to symmetric I/O mode setup680worker2 # [ 0.206007] x2apic enabled681worker1 # [ 0.240095] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.682client # [ 0.222168] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns683lb # [ 0.219697] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl684worker2 # [ 0.206734] APIC: Switched APIC routing to: physical x2apic685lb # [ 0.220697] Transient Scheduler Attacks: Vulnerable: No microcode686client # [ 0.223783] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)687lb # [ 0.222420] Spectre V2 : Mitigation: Enhanced / Automatic IBRS688client # [ 0.224868] x86/cpu: User Mode Instruction Prevention (UMIP) activated689worker2 # [ 0.208666] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1690lb # [ 0.222697] Speculative Return Stack Overflow: Mitigation: Safe RET691client # [ 0.225950] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127692worker2 # [ 0.209652] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns693client # [ 0.227471] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0694worker2 # [ 0.211361] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)695client # [ 0.228591] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto696worker2 # [ 0.212448] x86/cpu: User Mode Instruction Prevention (UMIP) activated697lb # [ 0.223697] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization698lb # [ 0.225711] Spectre V2 : Enabling IBPB for BPF699client # [ 0.229779] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl700worker2 # [ 0.213489] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127701client # [ 0.230779] Transient Scheduler Attacks: Vulnerable: No microcode702worker2 # [ 0.215028] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0703lb # [ 0.226697] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier704client # [ 0.232479] Spectre V2 : Mitigation: Enhanced / Automatic IBRS705lb # [ 0.227697] active return thunk: srso_alias_return_thunk706worker2 # [ 0.215362] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto707client # [ 0.233488] Speculative Return Stack Overflow: Mitigation: Safe RET708lb # [ 0.229365] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'709worker2 # [ 0.217358] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl710lb # [ 0.230630] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'711worker2 # [ 0.218358] Transient Scheduler Attacks: Vulnerable: No microcode712lb # [ 0.231501] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'713worker2 # [ 0.220060] Spectre V2 : Mitigation: Enhanced / Automatic IBRS714lb # [ 0.232487] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'715client # [ 0.234516] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization716worker2 # [ 0.221024] Speculative Return Stack Overflow: Mitigation: Safe RET717client # [ 0.235788] Spectre V2 : Enabling IBPB for BPF718lb # [ 0.233696] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'719lb # [ 0.234696] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'720client # [ 0.236780] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier721client # [ 0.237780] active return thunk: srso_alias_return_thunk722lb # [ 0.235697] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'723lb # [ 0.236697] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256724worker2 # [ 0.221357] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization725client # [ 0.239468] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'726worker2 # [ 0.223366] Spectre V2 : Enabling IBPB for BPF727lb # [ 0.237696] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64728client # [ 0.240649] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'729lb # [ 0.238696] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512730client # [ 0.241515] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'731worker2 # [ 0.224358] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier732lb # [ 0.239696] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024733worker2 # [ 0.225358] active return thunk: srso_alias_return_thunk734client # [ 0.242508] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'735lb # [ 0.240696] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8736client # [ 0.243550] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'737worker2 # [ 0.226380] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'738client # [ 0.244517] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'739worker2 # [ 0.227357] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'740lb # [ 0.241696] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.741worker2 # [ 0.228357] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'742client # [ 0.245604] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'743worker2 # [ 0.229357] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'744client # [ 0.246779] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256745worker2 # [ 0.230357] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'746client # [ 0.247787] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64747worker2 # [ 0.231357] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'748client # [ 0.248778] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512749client # [ 0.249778] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024750worker2 # [ 0.232358] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'751client # [ 0.250778] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8752worker2 # [ 0.234255] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256753worker2 # [ 0.235056] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64754client # [ 0.251778] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.755worker2 # [ 0.236055] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756worker2 # [ 0.236358] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757worker2 # [ 0.238067] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758worker1 # [ 0.275937] Freeing SMP alternatives memory: 44K759worker2 # [ 0.239064] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.760worker1 # [ 0.276648] pid_max: default: 32768 minimum: 301761worker1 # [ 0.277186] LSM: initializing lsm=capability,landlock,yama,bpf,ima762worker1 # [ 0.278199] landlock: Up and running.763worker1 # [ 0.279096] Yama: becoming mindful.764worker1 # [ 0.280164] LSM support for eBPF active765worker1 # [ 0.280908] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766worker1 # [ 0.282109] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker1 # [ 0.284420] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768worker1 # [ 0.285685] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769worker1 # [ 0.286104] ... version: 2770worker1 # [ 0.286803] ... bit width: 48771worker1 # [ 0.287098] ... generic counters: 6772worker1 # [ 0.287788] ... generic bitmap: 000000000000003f773worker1 # [ 0.288098] ... fixed-purpose counters: 0774worker1 # [ 0.288798] ... fixed-purpose bitmap: 0000000000000000775worker1 # [ 0.289098] ... value mask: 0000ffffffffffff776worker1 # [ 0.289947] ... max period: 00007fffffffffff777worker1 # [ 0.290735] ... global_ctrl mask: 000000000000003f778worker1 # [ 0.291212] signal: max sigframe size: 3376779worker1 # [ 0.292025] rcu: Hierarchical SRCU implementation.780worker1 # [ 0.292670] rcu: Max phase no-delay instances is 400.781lb # [ 0.278332] Freeing SMP alternatives memory: 44K782worker1 # [ 0.297628] smp: Bringing up secondary CPUs ...783lb # [ 0.278701] pid_max: default: 32768 minimum: 301784worker1 # [ 0.298113] smp: Brought up 1 node, 1 CPU785lb # [ 0.279807] LSM: initializing lsm=capability,landlock,yama,bpf,ima786worker1 # [ 0.298770] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)787lb # [ 0.280809] landlock: Up and running.788lb # [ 0.281697] Yama: becoming mindful.789lb # [ 0.282915] LSM support for eBPF active790worker1 # [ 0.299261] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)791worker1 # [ 0.300336] devtmpfs: initialized792lb # [ 0.283730] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)793worker1 # [ 0.301160] x86/mm: Memory block size: 128MB794lb # [ 0.284736] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)795client # [ 0.288530] Freeing SMP alternatives memory: 44K796client # [ 0.288783] pid_max: default: 32768 minimum: 301797worker1 # [ 0.302963] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)798client # [ 0.289878] LSM: initializing lsm=capability,landlock,yama,bpf,ima799lb # [ 0.287400] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)800worker1 # [ 0.303980] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).801client # [ 0.290893] landlock: Up and running.802client # [ 0.291780] Yama: becoming mindful.803worker1 # [ 0.305163] pinctrl core: initialized pinctrl subsystem804lb # [ 0.288262] Performance Events: Fam17h+ core perfctr, AMD PMU driver.805worker2 # [ 0.275693] Freeing SMP alternatives memory: 44K806client # [ 0.292813] LSM support for eBPF active807worker1 # [ 0.306220] PM: RTC time: 08:15:22, date: 2026-09-20808lb # [ 0.288702] ... version: 2809worker2 # [ 0.276362] pid_max: default: 32768 minimum: 301810lb # [ 0.289409] ... bit width: 48811client # [ 0.293565] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)812worker2 # [ 0.277188] LSM: initializing lsm=capability,landlock,yama,bpf,ima813lb # [ 0.289699] ... generic counters: 6814worker2 # [ 0.278421] landlock: Up and running.815client # [ 0.294802] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)816lb # [ 0.290391] ... generic bitmap: 000000000000003f817worker2 # [ 0.279019] Yama: becoming mindful.818lb # [ 0.290710] ... fixed-purpose counters: 0819worker2 # [ 0.279578] LSM support for eBPF active820worker1 # [ 0.309767] NET: Registered PF_NETLINK/PF_ROUTE protocol family821lb # [ 0.291406] ... fixed-purpose bitmap: 0000000000000000822client # [ 0.297026] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)823lb # [ 0.291699] ... value mask: 0000ffffffffffff824worker2 # [ 0.280489] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)825worker1 # [ 0.310624] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations826lb # [ 0.292582] ... max period: 00007fffffffffff827worker2 # [ 0.281397] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)828client # [ 0.298349] Performance Events: Fam17h+ core perfctr, AMD PMU driver.829worker1 # [ 0.311120] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations830lb # [ 0.293396] ... global_ctrl mask: 000000000000003f831client # [ 0.298789] ... version: 2832lb # [ 0.293817] signal: max sigframe size: 3376833client # [ 0.299455] ... bit width: 48834worker1 # [ 0.312378] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations835lb # [ 0.294616] rcu: Hierarchical SRCU implementation.836client # [ 0.299781] ... generic counters: 6837worker2 # [ 0.284146] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)838worker1 # [ 0.313107] audit: initializing netlink subsys (disabled)839lb # [ 0.295266] rcu: Max phase no-delay instances is 400.840client # [ 0.300464] ... generic bitmap: 000000000000003f841client # [ 0.300781] ... fixed-purpose counters: 0842worker1 # [ 0.314252] thermal_sys: Registered thermal governor 'fair_share'843worker2 # [ 0.284927] Performance Events: Fam17h+ core perfctr, AMD PMU driver.844client # [ 0.301460] ... fixed-purpose bitmap: 0000000000000000845worker2 # [ 0.285363] ... version: 2846worker1 # [ 0.314254] thermal_sys: Registered thermal governor 'bang_bang'847worker2 # [ 0.286067] ... bit width: 48848client # [ 0.301781] ... value mask: 0000ffffffffffff849worker1 # [ 0.315099] thermal_sys: Registered thermal governor 'step_wise'850worker2 # [ 0.286361] ... generic counters: 6851client # [ 0.302671] ... max period: 00007fffffffffff852worker1 # [ 0.316014] thermal_sys: Registered thermal governor 'user_space'853worker2 # [ 0.287043] ... generic bitmap: 000000000000003f854client # [ 0.303458] ... global_ctrl mask: 000000000000003f855worker2 # [ 0.287371] ... fixed-purpose counters: 0856worker1 # [ 0.316797] audit: type=2000 audit(1789892123.309:1): state=initialized audit_enabled=0 res=1857client # [ 0.303898] signal: max sigframe size: 3376858worker2 # [ 0.288077] ... fixed-purpose bitmap: 0000000000000000859lb # [ 0.300447] smp: Bringing up secondary CPUs ...860client # [ 0.304738] rcu: Hierarchical SRCU implementation.861worker1 # [ 0.318100] thermal_sys: Registered thermal governor 'power_allocator'862lb # [ 0.300715] smp: Brought up 1 node, 1 CPU863worker2 # [ 0.288360] ... value mask: 0000ffffffffffff864worker1 # [ 0.318124] cpuidle: using governor menu865client # [ 0.305361] rcu: Max phase no-delay instances is 400.866lb # [ 0.301367] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)867worker2 # [ 0.289224] ... max period: 00007fffffffffff868worker2 # [ 0.290023] ... global_ctrl mask: 000000000000003f869worker1 # [ 0.320107] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5870worker2 # [ 0.290497] signal: max sigframe size: 3376871lb # [ 0.301877] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)872worker1 # [ 0.321300] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]873worker2 # [ 0.291287] rcu: Hierarchical SRCU implementation.874lb # [ 0.302991] devtmpfs: initialized875worker2 # [ 0.291918] rcu: Max phase no-delay instances is 400.876worker1 # [ 0.322101] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry877lb # [ 0.303889] x86/mm: Memory block size: 128MB878worker1 # [ 0.323110] PCI: Using configuration type 1 for base access879client # [ 0.310482] smp: Bringing up secondary CPUs ...880client # [ 0.310799] smp: Brought up 1 node, 1 CPU881worker1 # [ 0.324180] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.882lb # [ 0.305721] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)883client # [ 0.311457] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)884lb # [ 0.306725] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).885worker2 # [ 0.297144] smp: Bringing up secondary CPUs ...886client # [ 0.311995] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)887lb # [ 0.307795] pinctrl core: initialized pinctrl subsystem888worker2 # [ 0.297376] smp: Brought up 1 node, 1 CPU889client # [ 0.313062] devtmpfs: initialized890lb # [ 0.308907] PM: RTC time: 08:15:22, date: 2026-09-20891worker2 # [ 0.298011] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)892client # [ 0.313839] x86/mm: Memory block size: 128MB893worker1 # [ 0.329326] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages894worker1 # [ 0.330099] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page895worker2 # [ 0.298583] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)896client # [ 0.315584] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)897worker2 # [ 0.299670] devtmpfs: initialized898lb # [ 0.312632] NET: Registered PF_NETLINK/PF_ROUTE protocol family899client # [ 0.316663] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).900worker2 # [ 0.300480] x86/mm: Memory block size: 128MB901client # [ 0.317877] pinctrl core: initialized pinctrl subsystem902lb # [ 0.313983] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations903client # [ 0.318928] PM: RTC time: 08:15:22, date: 2026-09-20904worker2 # [ 0.302214] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)905lb # [ 0.314734] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations906worker1 # [ 0.335099] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages907worker1 # [ 0.336098] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page908worker2 # [ 0.303239] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).909lb # [ 0.315991] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations910worker2 # [ 0.304479] pinctrl core: initialized pinctrl subsystem911lb # [ 0.316712] audit: initializing netlink subsys (disabled)912client # [ 0.322593] NET: Registered PF_NETLINK/PF_ROUTE protocol family913worker2 # [ 0.305667] PM: RTC time: 08:15:22, date: 2026-09-20914lb # [ 0.317949] thermal_sys: Registered thermal governor 'fair_share'915client # [ 0.323989] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations916lb # [ 0.317952] thermal_sys: Registered thermal governor 'bang_bang'917lb # [ 0.318700] thermal_sys: Registered thermal governor 'step_wise'918client # [ 0.324803] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations919lb # [ 0.319665] thermal_sys: Registered thermal governor 'user_space'920worker2 # [ 0.309263] NET: Registered PF_NETLINK/PF_ROUTE protocol family921client # [ 0.326063] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations922lb # [ 0.320433] audit: type=2000 audit(1789892123.339:1): state=initialized audit_enabled=0 res=1923client # [ 0.326794] audit: initializing netlink subsys (disabled)924worker2 # [ 0.310620] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations925lb # [ 0.321702] thermal_sys: Registered thermal governor 'power_allocator'926client # [ 0.327909] thermal_sys: Registered thermal governor 'fair_share'927lb # [ 0.321729] cpuidle: using governor menu928worker2 # [ 0.311386] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations929client # [ 0.327912] thermal_sys: Registered thermal governor 'bang_bang'930client # [ 0.328782] thermal_sys: Registered thermal governor 'step_wise'931worker1 # [ 0.346472] ACPI: Added _OSI(Module Device)932lb # [ 0.323941] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5933worker2 # [ 0.312651] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations934worker1 # [ 0.347100] ACPI: Added _OSI(Processor Device)935client # [ 0.329688] thermal_sys: Registered thermal governor 'user_space'936worker2 # [ 0.313372] audit: initializing netlink subsys (disabled)937worker1 # [ 0.347807] ACPI: Added _OSI(Processor Aggregator Device)938lb # [ 0.324965] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]939client # [ 0.330465] audit: type=2000 audit(1789892123.336:1): state=initialized audit_enabled=0 res=1940worker2 # [ 0.314452] thermal_sys: Registered thermal governor 'fair_share'941lb # [ 0.325707] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry942client # [ 0.331785] thermal_sys: Registered thermal governor 'power_allocator'943worker2 # [ 0.314454] thermal_sys: Registered thermal governor 'bang_bang'944lb # [ 0.326713] PCI: Using configuration type 1 for base access945client # [ 0.331816] cpuidle: using governor menu946worker2 # [ 0.315361] thermal_sys: Registered thermal governor 'step_wise'947worker2 # [ 0.316289] thermal_sys: Registered thermal governor 'user_space'948lb # [ 0.327851] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.949client # [ 0.334010] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5950worker2 # [ 0.317061] audit: type=2000 audit(1789892123.348:1): state=initialized audit_enabled=0 res=1951client # [ 0.335021] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]952worker2 # [ 0.318363] thermal_sys: Registered thermal governor 'power_allocator'953client # [ 0.335785] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry954worker2 # [ 0.318390] cpuidle: using governor menu955client # [ 0.336793] PCI: Using configuration type 1 for base access956worker2 # [ 0.320576] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5957client # [ 0.337869] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.958worker1 # [ 0.356140] ACPI: 1 ACPI AML tables successfully acquired and loaded959worker2 # [ 0.321605] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]960worker2 # [ 0.322364] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry961lb # [ 0.335000] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages962worker2 # [ 0.323373] PCI: Using configuration type 1 for base access963lb # [ 0.335701] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page964worker1 # [ 0.360503] ACPI: Interpreter enabled965worker2 # [ 0.324443] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.966worker1 # [ 0.361115] ACPI: PM: (supports S0 S3 S4 S5)967client # [ 0.343081] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages968worker1 # [ 0.361786] ACPI: Using IOAPIC for interrupt routing969client # [ 0.343783] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page970worker1 # [ 0.362152] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug971worker1 # [ 0.363099] PCI: Using E820 reservations for host bridge windows972lb # [ 0.340700] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages973lb # [ 0.341700] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page974worker1 # [ 0.366162] ACPI: Enabled 2 GPEs in block 00 to 3F975client # [ 0.348783] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages976worker2 # [ 0.331645] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages977client # [ 0.349781] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page978worker2 # [ 0.332362] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page979lb # [ 0.350377] ACPI: Added _OSI(Module Device)980worker2 # [ 0.337362] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages981lb # [ 0.350701] ACPI: Added _OSI(Processor Device)982worker2 # [ 0.338362] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page983lb # [ 0.351443] ACPI: Added _OSI(Processor Aggregator Device)984worker1 # [ 0.374702] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])985worker1 # [ 0.375105] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]986client # [ 0.360181] ACPI: Added _OSI(Module Device)987worker1 # [ 0.376966] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]988client # [ 0.360783] ACPI: Added _OSI(Processor Device)989client # [ 0.361489] ACPI: Added _OSI(Processor Aggregator Device)990worker1 # [ 0.378163] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]991worker1 # [ 0.379443] PCI host bridge to bus 0000:00992worker1 # [ 0.380103] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]993lb # [ 0.358347] ACPI: 1 ACPI AML tables successfully acquired and loaded994worker1 # [ 0.381099] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]995worker2 # [ 0.348065] ACPI: Added _OSI(Module Device)996worker1 # [ 0.382098] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]997worker2 # [ 0.348362] ACPI: Added _OSI(Processor Device)998worker1 # [ 0.383098] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]999worker2 # [ 0.349144] ACPI: Added _OSI(Processor Aggregator Device)1000lb # [ 0.361730] ACPI: Interpreter enabled1001worker1 # [ 0.384098] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1002lb # [ 0.362396] ACPI: PM: (supports S0 S3 S4 S5)1003worker1 # [ 0.385098] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1004lb # [ 0.362700] ACPI: Using IOAPIC for interrupt routing1005worker1 # [ 0.386099] pci_bus 0000:00: root bus resource [bus 00-ff]1006client # [ 0.370183] ACPI: 1 ACPI AML tables successfully acquired and loaded1007worker1 # [ 0.387036] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1008lb # [ 0.365756] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1009worker1 # [ 0.388513] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1010lb # [ 0.366700] PCI: Using E820 reservations for host bridge windows1011client # [ 0.374200] ACPI: Interpreter enabled1012worker2 # [ 0.355981] ACPI: 1 ACPI AML tables successfully acquired and loaded1013client # [ 0.374797] ACPI: PM: (supports S0 S3 S4 S5)1014client # [ 0.375483] ACPI: Using IOAPIC for interrupt routing1015lb # [ 0.369810] ACPI: Enabled 2 GPEs in block 00 to 3F1016client # [ 0.375822] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1017client # [ 0.376781] PCI: Using E820 reservations for host bridge windows1018worker2 # [ 0.359363] ACPI: Interpreter enabled1019worker2 # [ 0.360006] ACPI: PM: (supports S0 S3 S4 S5)1020worker2 # [ 0.360361] ACPI: Using IOAPIC for interrupt routing1021client # [ 0.379839] ACPI: Enabled 2 GPEs in block 00 to 3F1022worker2 # [ 0.361298] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1023worker1 # [ 0.391170] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1024worker1 # [ 0.392228] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1025worker1 # [ 0.393162] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1026lb # [ 0.378466] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1027worker1 # [ 0.394426] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1028worker2 # [ 0.366360] PCI: Using E820 reservations for host bridge windows1029lb # [ 0.378706] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1030worker2 # [ 0.367470] ACPI: Enabled 2 GPEs in block 00 to 3F1031worker1 # [ 0.395809] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1032lb # [ 0.380526] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1033client # [ 0.388475] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1034lb # [ 0.381767] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1035worker1 # [ 0.399105] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1036client # [ 0.388789] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1037lb # [ 0.383079] PCI host bridge to bus 0000:001038worker1 # [ 0.400027] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1039lb # [ 0.383704] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1040worker1 # [ 0.400863] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1041client # [ 0.390934] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1042lb # [ 0.384700] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1043worker1 # [ 0.401104] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1044client # [ 0.391906] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1045lb # [ 0.385699] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1046client # [ 0.393178] PCI host bridge to bus 0000:001047worker2 # [ 0.376116] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1048worker1 # [ 0.402648] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1049lb # [ 0.386699] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1050client # [ 0.393786] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1051lb # [ 0.387700] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1052worker2 # [ 0.376423] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1053client # [ 0.394782] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1054worker1 # [ 0.404106] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1055lb # [ 0.388699] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1056worker2 # [ 0.377454] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1057client # [ 0.395781] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1058worker1 # [ 0.404989] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1059lb # [ 0.389700] pci_bus 0000:00: root bus resource [bus 00-ff]1060worker2 # [ 0.378486] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1061client # [ 0.396781] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1062worker1 # [ 0.405833] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1063worker2 # [ 0.379753] PCI host bridge to bus 0000:001064lb # [ 0.390741] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1065client # [ 0.397781] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1066worker2 # [ 0.380365] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1067worker1 # [ 0.406664] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1068client # [ 0.398781] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1069lb # [ 0.392163] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1070worker2 # [ 0.381361] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1071client # [ 0.399782] pci_bus 0000:00: root bus resource [bus 00-ff]1072worker2 # [ 0.382360] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1073client # [ 0.400772] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1074worker2 # [ 0.383360] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1075worker1 # [ 0.409281] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1076client # [ 0.402256] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1077worker2 # [ 0.384360] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1078worker1 # [ 0.410116] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1079worker2 # [ 0.385361] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1080worker1 # [ 0.411078] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1081worker2 # [ 0.386360] pci_bus 0000:00: root bus resource [bus 00-ff]1082worker2 # [ 0.387327] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1083worker1 # [ 0.412514] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1084worker2 # [ 0.388826] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1085worker1 # [ 0.414127] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1086worker1 # [ 0.414976] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1087worker1 # [ 0.415842] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1088lb # [ 0.394897] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1089client # [ 0.404978] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1090lb # [ 0.395716] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1091worker1 # [ 0.416647] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1092client # [ 0.405794] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1093lb # [ 0.396728] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1094client # [ 0.406709] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1095worker1 # [ 0.418105] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1096lb # [ 0.398131] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1097client # [ 0.407861] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1098worker1 # [ 0.418925] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1099worker1 # [ 0.419796] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1100lb # [ 0.399684] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1101client # [ 0.409538] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1102worker2 # [ 0.391563] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1103worker1 # [ 0.420685] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1104worker2 # [ 0.392423] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1105worker2 # [ 0.393376] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1106client # [ 0.412789] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1107worker1 # [ 0.422107] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1108client # [ 0.413613] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1109lb # [ 0.402896] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1110worker2 # [ 0.394728] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1111client # [ 0.414471] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1112lb # [ 0.403711] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1113worker1 # [ 0.422945] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1114client # [ 0.414787] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1115worker1 # [ 0.424120] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1116lb # [ 0.404728] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1117worker2 # [ 0.396181] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1118lb # [ 0.405710] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1119worker1 # [ 0.425707] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1120client # [ 0.416347] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1121lb # [ 0.407448] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1122worker1 # [ 0.427125] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1123client # [ 0.417789] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1124worker2 # [ 0.399390] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1125worker1 # [ 0.427954] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1126client # [ 0.418644] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1127worker2 # [ 0.400349] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1128worker1 # [ 0.428792] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1129client # [ 0.419531] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1130worker1 # [ 0.429104] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1131worker2 # [ 0.401098] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1132lb # [ 0.410728] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1133worker2 # [ 0.401391] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1134client # [ 0.420396] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1135lb # [ 0.411713] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1136worker1 # [ 0.430597] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1137worker2 # [ 0.402956] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1138lb # [ 0.412729] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1139worker1 # [ 0.431907] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1140worker1 # [ 0.432814] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1141client # [ 0.422791] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1142lb # [ 0.414431] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143worker2 # [ 0.405397] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1144client # [ 0.423642] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1145worker1 # [ 0.433653] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1146worker2 # [ 0.406237] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1147client # [ 0.424499] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1148worker2 # [ 0.407089] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1149worker1 # [ 0.435131] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1150client # [ 0.425344] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1151lb # [ 0.417734] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1152worker1 # [ 0.435939] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1153worker2 # [ 0.407945] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1154lb # [ 0.418709] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1155worker1 # [ 0.436836] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1156client # [ 0.426791] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1157lb # [ 0.419728] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1158client # [ 0.427696] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1159worker2 # [ 0.409384] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1160worker1 # [ 0.437656] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1161client # [ 0.428532] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1162worker2 # [ 0.410244] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1163lb # [ 0.421397] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1164worker2 # [ 0.411085] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1165worker1 # [ 0.439106] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1166client # [ 0.429813] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1167worker1 # [ 0.439956] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1168worker2 # [ 0.411927] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1169worker1 # [ 0.440809] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1170lb # [ 0.424733] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1171client # [ 0.431799] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1172lb # [ 0.425683] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1173worker1 # [ 0.441694] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1174client # [ 0.432650] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1175lb # [ 0.426527] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1176worker2 # [ 0.414367] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1177worker1 # [ 0.442640] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1178client # [ 0.433532] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1179worker2 # [ 0.415200] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1180worker1 # [ 0.443301] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1181worker2 # [ 0.416089] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1182client # [ 0.434345] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1183lb # [ 0.428340] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1184worker2 # [ 0.416931] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1185worker1 # [ 0.445105] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1186lb # [ 0.431709] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1187client # [ 0.437131] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1188worker2 # [ 0.418388] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1189lb # [ 0.432679] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1190client # [ 0.438454] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1191worker2 # [ 0.419224] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1192lb # [ 0.433507] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1193client # [ 0.438804] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1194worker2 # [ 0.420091] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1195lb # [ 0.435342] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1196client # [ 0.440392] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1197worker2 # [ 0.420956] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1198client # [ 0.441791] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1199worker2 # [ 0.422385] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1200client # [ 0.442701] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1201worker2 # [ 0.423234] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1202client # [ 0.443537] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1203lb # [ 0.438711] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1204worker2 # [ 0.424158] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1205lb # [ 0.439638] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1206worker1 # [ 0.446141] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1207client # [ 0.443787] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1208lb # [ 0.440523] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1209worker2 # [ 0.425795] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1210worker1 # [ 0.449047] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1211client # [ 0.445335] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1212lb # [ 0.442305] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1213worker1 # [ 0.449942] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1214client # [ 0.446794] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1215worker1 # [ 0.452071] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1216worker2 # [ 0.428368] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1217client # [ 0.447804] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1218worker2 # [ 0.429367] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1219lb # [ 0.444709] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1220worker1 # [ 0.453042] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1221client # [ 0.449372] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1222worker2 # [ 0.430285] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1223worker2 # [ 0.431160] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1224worker1 # [ 0.454340] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1225lb # [ 0.445643] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1226lb # [ 0.446726] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1227client # [ 0.450810] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1228worker1 # [ 0.455348] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1229worker2 # [ 0.432636] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1230lb # [ 0.447706] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1231client # [ 0.451614] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1232worker2 # [ 0.434373] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1233worker1 # [ 0.457629] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1234client # [ 0.452595] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1235lb # [ 0.449322] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1236worker1 # [ 0.458105] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1237worker2 # [ 0.435302] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1238client # [ 0.454137] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1239worker1 # [ 0.459329] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1240lb # [ 0.450715] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1241worker2 # [ 0.436695] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1242lb # [ 0.451712] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1243client # [ 0.455790] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1244worker1 # [ 0.461127] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1245client # [ 0.456630] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1246worker2 # [ 0.438369] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1247client # [ 0.457502] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1248worker2 # [ 0.439191] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1249lb # [ 0.453267] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1250worker2 # [ 0.440054] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1251client # [ 0.458351] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1252worker1 # [ 0.464898] ACPI: PCI: Interrupt link LNKA configured for IRQ 101253worker2 # [ 0.440910] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1254lb # [ 0.455654] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1255worker1 # [ 0.465982] ACPI: PCI: Interrupt link LNKB configured for IRQ 101256lb # [ 0.456312] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1257worker1 # [ 0.466889] ACPI: PCI: Interrupt link LNKC configured for IRQ 111258client # [ 0.460182] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1259lb # [ 0.456726] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1260worker1 # [ 0.467879] ACPI: PCI: Interrupt link LNKD configured for IRQ 111261worker2 # [ 0.442368] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1262client # [ 0.460986] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1263worker1 # [ 0.468193] ACPI: PCI: Interrupt link LNKE configured for IRQ 101264worker2 # [ 0.443198] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1265lb # [ 0.458302] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1266worker1 # [ 0.469194] ACPI: PCI: Interrupt link LNKF configured for IRQ 101267client # [ 0.462476] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1268worker1 # [ 0.470197] ACPI: PCI: Interrupt link LNKG configured for IRQ 111269worker2 # [ 0.444088] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1270worker1 # [ 0.471203] ACPI: PCI: Interrupt link LNKH configured for IRQ 111271worker2 # [ 0.445745] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1272worker1 # [ 0.472135] ACPI: PCI: Interrupt link GSIA configured for IRQ 161273lb # [ 0.460710] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1274worker1 # [ 0.473048] ACPI: PCI: Interrupt link GSIB configured for IRQ 171275worker2 # [ 0.447076] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1276worker1 # [ 0.473809] ACPI: PCI: Interrupt link GSIC configured for IRQ 181277lb # [ 0.461580] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1278worker1 # [ 0.474112] ACPI: PCI: Interrupt link GSID configured for IRQ 191279worker2 # [ 0.447577] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1280lb # [ 0.462412] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1281worker1 # [ 0.475112] ACPI: PCI: Interrupt link GSIE configured for IRQ 201282worker2 # [ 0.449048] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1283worker1 # [ 0.476072] ACPI: PCI: Interrupt link GSIF configured for IRQ 211284lb # [ 0.463306] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1285worker1 # [ 0.476855] ACPI: PCI: Interrupt link GSIG configured for IRQ 221286worker1 # [ 0.477113] ACPI: PCI: Interrupt link GSIH configured for IRQ 231287lb # [ 0.464648] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1288lb # [ 0.465562] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1289worker1 # [ 0.479481] iommu: Default domain type: Translated1290client # [ 0.462976] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1291lb # [ 0.467499] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1292worker1 # [ 0.480113] iommu: DMA domain TLB invalidation policy: lazy mode1293worker1 # [ 0.481443] ACPI: bus type USB registered1294client # [ 0.465496] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1295worker1 # [ 0.482184] usbcore: registered new interface driver usbfs1296worker1 # [ 0.483122] usbcore: registered new interface driver hub1297client # [ 0.466060] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1298worker1 # [ 0.484114] usbcore: registered new device driver usb1299client # [ 0.467442] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1300worker1 # [ 0.486187] NetLabel: Initializing1301client # [ 0.468051] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1302worker1 # [ 0.486883] NetLabel: domain hash size = 1281303worker2 # [ 0.449553] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1304worker1 # [ 0.487692] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1305client # [ 0.469082] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1306worker1 # [ 0.488153] NetLabel: unlabeled traffic allowed by default1307worker2 # [ 0.452220] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1308worker1 # [ 0.489115] PCI: Using ACPI for IRQ routing1309client # [ 0.470041] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1310worker2 # [ 0.453271] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1311client # [ 0.471696] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1312worker2 # [ 0.455004] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1313client # [ 0.472474] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1314lb # [ 0.468580] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1315worker2 # [ 0.455656] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1316client # [ 0.473108] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1317worker2 # [ 0.456649] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1318client # [ 0.475489] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1319worker2 # [ 0.457641] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1320lb # [ 0.471387] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1321worker2 # [ 0.459707] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1322client # [ 0.478765] ACPI: PCI: Interrupt link LNKA configured for IRQ 101323worker2 # [ 0.460367] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1324lb # [ 0.472001] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1325client # [ 0.479610] ACPI: PCI: Interrupt link LNKB configured for IRQ 101326worker2 # [ 0.461656] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1327client # [ 0.480574] ACPI: PCI: Interrupt link LNKC configured for IRQ 111328lb # [ 0.473708] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1329client # [ 0.481573] ACPI: PCI: Interrupt link LNKD configured for IRQ 111330worker2 # [ 0.463057] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1331lb # [ 0.474939] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1332client # [ 0.482568] ACPI: PCI: Interrupt link LNKE configured for IRQ 101333client # [ 0.482884] ACPI: PCI: Interrupt link LNKF configured for IRQ 101334lb # [ 0.475999] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1335client # [ 0.483893] ACPI: PCI: Interrupt link LNKG configured for IRQ 111336lb # [ 0.476993] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1337client # [ 0.484893] ACPI: PCI: Interrupt link LNKH configured for IRQ 111338worker2 # [ 0.466306] ACPI: PCI: Interrupt link LNKA configured for IRQ 101339client # [ 0.485827] ACPI: PCI: Interrupt link GSIA configured for IRQ 161340worker2 # [ 0.467192] ACPI: PCI: Interrupt link LNKB configured for IRQ 101341client # [ 0.486747] ACPI: PCI: Interrupt link GSIB configured for IRQ 171342worker2 # [ 0.468387] ACPI: PCI: Interrupt link LNKC configured for IRQ 111343lb # [ 0.479703] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1344client # [ 0.487484] ACPI: PCI: Interrupt link GSIC configured for IRQ 181345worker2 # [ 0.469441] ACPI: PCI: Interrupt link LNKD configured for IRQ 111346lb # [ 0.480554] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1347client # [ 0.487793] ACPI: PCI: Interrupt link GSID configured for IRQ 191348worker2 # [ 0.470462] ACPI: PCI: Interrupt link LNKE configured for IRQ 101349client # [ 0.488714] ACPI: PCI: Interrupt link GSIE configured for IRQ 201350lb # [ 0.481757] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1351client # [ 0.489499] ACPI: PCI: Interrupt link GSIF configured for IRQ 211352worker2 # [ 0.471461] ACPI: PCI: Interrupt link LNKF configured for IRQ 101353client # [ 0.489794] ACPI: PCI: Interrupt link GSIG configured for IRQ 221354worker2 # [ 0.472462] ACPI: PCI: Interrupt link LNKG configured for IRQ 111355lb # [ 0.483591] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1356client # [ 0.490796] ACPI: PCI: Interrupt link GSIH configured for IRQ 231357worker2 # [ 0.473463] ACPI: PCI: Interrupt link LNKH configured for IRQ 111358worker2 # [ 0.474395] ACPI: PCI: Interrupt link GSIA configured for IRQ 161359client # [ 0.492829] iommu: Default domain type: Translated1360worker2 # [ 0.475377] ACPI: PCI: Interrupt link GSIB configured for IRQ 171361client # [ 0.493637] iommu: DMA domain TLB invalidation policy: lazy mode1362worker2 # [ 0.476369] ACPI: PCI: Interrupt link GSIC configured for IRQ 181363lb # [ 0.487376] ACPI: PCI: Interrupt link LNKA configured for IRQ 101364client # [ 0.494768] ACPI: bus type USB registered1365worker2 # [ 0.477354] ACPI: PCI: Interrupt link GSID configured for IRQ 191366client # [ 0.495333] usbcore: registered new interface driver usbfs1367lb # [ 0.487811] ACPI: PCI: Interrupt link LNKB configured for IRQ 101368worker2 # [ 0.478225] ACPI: PCI: Interrupt link GSIE configured for IRQ 201369client # [ 0.495797] usbcore: registered new interface driver hub1370lb # [ 0.488803] ACPI: PCI: Interrupt link LNKC configured for IRQ 111371worker2 # [ 0.479097] ACPI: PCI: Interrupt link GSIF configured for IRQ 211372client # [ 0.496689] usbcore: registered new device driver usb1373lb # [ 0.489802] ACPI: PCI: Interrupt link LNKD configured for IRQ 111374worker2 # [ 0.479376] ACPI: PCI: Interrupt link GSIG configured for IRQ 221375client # [ 0.498307] NetLabel: Initializing1376lb # [ 0.490797] ACPI: PCI: Interrupt link LNKE configured for IRQ 101377worker2 # [ 0.480337] ACPI: PCI: Interrupt link GSIH configured for IRQ 231378client # [ 0.498782] NetLabel: domain hash size = 1281379lb # [ 0.491797] ACPI: PCI: Interrupt link LNKF configured for IRQ 101380client # [ 0.499511] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1381worker2 # [ 0.482219] iommu: Default domain type: Translated1382lb # [ 0.492800] ACPI: PCI: Interrupt link LNKG configured for IRQ 111383client # [ 0.499822] NetLabel: unlabeled traffic allowed by default1384worker2 # [ 0.482977] iommu: DMA domain TLB invalidation policy: lazy mode1385lb # [ 0.493809] ACPI: PCI: Interrupt link LNKH configured for IRQ 111386client # [ 0.500792] PCI: Using ACPI for IRQ routing1387worker2 # [ 0.483643] ACPI: bus type USB registered1388worker2 # [ 0.484440] usbcore: registered new interface driver usbfs1389worker2 # [ 0.485383] usbcore: registered new interface driver hub1390lb # [ 0.494739] ACPI: PCI: Interrupt link GSIA configured for IRQ 161391worker2 # [ 0.486378] usbcore: registered new device driver usb1392lb # [ 0.495732] ACPI: PCI: Interrupt link GSIB configured for IRQ 171393lb # [ 0.497505] ACPI: PCI: Interrupt link GSIC configured for IRQ 181394worker2 # [ 0.488492] NetLabel: Initializing1395lb # [ 0.498463] ACPI: PCI: Interrupt link GSID configured for IRQ 191396worker2 # [ 0.489803] NetLabel: domain hash size = 1281397lb # [ 0.498772] ACPI: PCI: Interrupt link GSIE configured for IRQ 201398worker2 # [ 0.490361] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1399lb # [ 0.499721] ACPI: PCI: Interrupt link GSIF configured for IRQ 211400worker2 # [ 0.491368] NetLabel: unlabeled traffic allowed by default1401lb # [ 0.500716] ACPI: PCI: Interrupt link GSIG configured for IRQ 221402worker2 # [ 0.492326] PCI: Using ACPI for IRQ routing1403lb # [ 0.501689] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404lb # [ 0.503675] iommu: Default domain type: Translated1405lb # [ 0.504295] iommu: DMA domain TLB invalidation policy: lazy mode1406lb # [ 0.504984] ACPI: bus type USB registered1407lb # [ 0.505747] usbcore: registered new interface driver usbfs1408worker1 # [ 0.540318] pci 0000:00:01.0: vgaarb: setting as boot VGA device1409lb # [ 0.506647] usbcore: registered new interface driver hub1410worker1 # [ 0.541094] pci 0000:00:01.0: vgaarb: bridge control possible1411lb # [ 0.507358] usbcore: registered new device driver usb1412worker1 # [ 0.541094] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1413worker1 # [ 0.541103] vgaarb: loaded1414lb # [ 0.508630] NetLabel: Initializing1415worker1 # [ 0.541834] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01416lb # [ 0.509172] NetLabel: domain hash size = 1281417worker1 # [ 0.542100] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1418lb # [ 0.509699] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1419lb # [ 0.510701] NetLabel: unlabeled traffic allowed by default1420lb # [ 0.511675] PCI: Using ACPI for IRQ routing1421worker1 # [ 0.546189] clocksource: Switched to clocksource kvm-clock1422worker1 # [ 0.549680] VFS: Disk quotas dquot_6.6.01423worker1 # [ 0.550402] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424worker1 # [ 0.551747] pnp: PnP ACPI init1425worker1 # [ 0.552601] ACPI: IRQ 4 override to edge(!), high(!)1426worker1 # [ 0.553647] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1427worker1 # [ 0.555244] pnp: PnP ACPI: found 6 devices1428worker1 # [ 0.562955] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1429worker1 # [ 0.564410] clocksource: Switched to clocksource acpi_pm1430worker1 # [ 0.565384] NET: Registered PF_INET protocol family1431worker1 # [ 0.566596] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1432client # [ 0.546941] pci 0000:00:01.0: vgaarb: setting as boot VGA device1433client # [ 0.547777] pci 0000:00:01.0: vgaarb: bridge control possible1434client # [ 0.547777] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435client # [ 0.547787] vgaarb: loaded1436client # [ 0.548527] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01437client # [ 0.548784] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1438worker2 # [ 0.538177] pci 0000:00:01.0: vgaarb: setting as boot VGA device1439worker2 # [ 0.538356] pci 0000:00:01.0: vgaarb: bridge control possible1440worker2 # [ 0.538356] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1441client # [ 0.553880] clocksource: Switched to clocksource kvm-clock1442worker2 # [ 0.538366] vgaarb: loaded1443worker2 # [ 0.539133] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01444worker2 # [ 0.539362] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1445client # [ 0.557444] VFS: Disk quotas dquot_6.6.01446client # [ 0.558123] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1447worker1 # [ 0.583430] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1448client # [ 0.559498] pnp: PnP ACPI init1449worker1 # [ 0.584979] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1450client # [ 0.560314] ACPI: IRQ 4 override to edge(!), high(!)1451worker1 # [ 0.586256] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1452worker2 # [ 0.543503] clocksource: Switched to clocksource kvm-clock1453client # [ 0.561258] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1454worker1 # [ 0.587567] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1455client # [ 0.562777] pnp: PnP ACPI: found 6 devices1456worker1 # [ 0.588774] TCP: Hash tables configured (established 16384 bind 16384)1457worker1 # [ 0.589867] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1458worker2 # [ 0.547135] VFS: Disk quotas dquot_6.6.01459worker1 # [ 0.591103] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1460worker2 # [ 0.547882] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1461lb # [ 0.559997] pci 0000:00:01.0: vgaarb: setting as boot VGA device1462worker1 # [ 0.592122] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1463worker2 # [ 0.549252] pnp: PnP ACPI init1464lb # [ 0.560695] pci 0000:00:01.0: vgaarb: bridge control possible1465worker1 # [ 0.593276] NET: Registered PF_UNIX/PF_LOCAL protocol family1466worker2 # [ 0.550080] ACPI: IRQ 4 override to edge(!), high(!)1467worker1 # [ 0.594246] NET: Registered PF_XDP protocol family1468lb # [ 0.560695] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1469lb # [ 0.560705] vgaarb: loaded1470worker2 # [ 0.551139] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1471worker1 # [ 0.595049] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1472lb # [ 0.561460] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01473worker1 # [ 0.595999] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1474worker2 # [ 0.552714] pnp: PnP ACPI: found 6 devices1475client # [ 0.570399] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1476lb # [ 0.561701] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1477worker1 # [ 0.596939] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1478client # [ 0.571776] clocksource: Switched to clocksource acpi_pm1479worker1 # [ 0.597999] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1480client # [ 0.572740] NET: Registered PF_INET protocol family1481worker1 # [ 0.599039] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1482client # [ 0.573876] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1483worker1 # [ 0.600080] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1484worker1 # [ 0.601810] ACPI: \_SB_.GSIA: Enabled at IRQ 161485lb # [ 0.565814] clocksource: Switched to clocksource kvm-clock1486worker1 # [ 0.604002] ACPI: \_SB_.GSIB: Enabled at IRQ 171487worker2 # [ 0.561066] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1488lb # [ 0.569489] VFS: Disk quotas dquot_6.6.01489worker1 # [ 0.605900] ACPI: \_SB_.GSIC: Enabled at IRQ 181490worker2 # [ 0.562507] clocksource: Switched to clocksource acpi_pm1491lb # [ 0.570251] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1492worker2 # [ 0.563444] NET: Registered PF_INET protocol family1493lb # [ 0.571684] pnp: PnP ACPI init1494worker1 # [ 0.607807] ACPI: \_SB_.GSID: Enabled at IRQ 191495worker2 # [ 0.564631] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1496lb # [ 0.572502] ACPI: IRQ 4 override to edge(!), high(!)1497worker1 # [ 0.609435] PCI: CLS 0 bytes, default 641498lb # [ 0.573503] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1499worker1 # [ 0.610286] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1500lb # [ 0.575075] pnp: PnP ACPI: found 6 devices1501worker1 # [ 0.611979] Trying to unpack rootfs image as initramfs...1502client # [ 0.590402] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1503client # [ 0.591903] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1504client # [ 0.593163] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1505lb # [ 0.582706] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1506client # [ 0.594460] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1507lb # [ 0.584178] clocksource: Switched to clocksource acpi_pm1508lb # [ 0.585149] NET: Registered PF_INET protocol family1509client # [ 0.595661] TCP: Hash tables configured (established 16384 bind 16384)1510client # [ 0.596742] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1511lb # [ 0.586349] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1512client # [ 0.597948] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1513client # [ 0.599010] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1514worker2 # [ 0.581515] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1515client # [ 0.600204] NET: Registered PF_UNIX/PF_LOCAL protocol family1516client # [ 0.601106] NET: Registered PF_XDP protocol family1517worker2 # [ 0.583067] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1518client # [ 0.601920] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1519worker2 # [ 0.584348] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1520client # [ 0.602885] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1521worker2 # [ 0.585660] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1522client # [ 0.603846] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1523worker2 # [ 0.586858] TCP: Hash tables configured (established 16384 bind 16384)1524client # [ 0.604898] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1525client # [ 0.605942] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1526worker2 # [ 0.587959] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1527client # [ 0.606973] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1528worker2 # [ 0.589176] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1529worker2 # [ 0.590280] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1530client # [ 0.608634] ACPI: \_SB_.GSIA: Enabled at IRQ 161531worker2 # [ 0.591463] NET: Registered PF_UNIX/PF_LOCAL protocol family1532worker2 # [ 0.592401] NET: Registered PF_XDP protocol family1533client # [ 0.611178] ACPI: \_SB_.GSIB: Enabled at IRQ 171534worker2 # [ 0.593204] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1535worker2 # [ 0.594189] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1536client # [ 0.613076] ACPI: \_SB_.GSIC: Enabled at IRQ 181537worker2 # [ 0.595167] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1538worker2 # [ 0.596229] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1539lb # [ 0.603522] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1540client # [ 0.614961] ACPI: \_SB_.GSID: Enabled at IRQ 191541worker2 # [ 0.597297] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1542lb # [ 0.605198] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1543client # [ 0.616577] PCI: CLS 0 bytes, default 641544worker2 # [ 0.598342] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1545lb # [ 0.606521] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1546worker2 # [ 0.600003] ACPI: \_SB_.GSIA: Enabled at IRQ 161547client # [ 0.617443] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1548lb # [ 0.607879] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1549client # [ 0.619088] Trying to unpack rootfs image as initramfs...1550lb # [ 0.609201] TCP: Hash tables configured (established 16384 bind 16384)1551worker2 # [ 0.602304] ACPI: \_SB_.GSIB: Enabled at IRQ 171552lb # [ 0.610379] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1553worker2 # [ 0.604314] ACPI: \_SB_.GSIC: Enabled at IRQ 181554lb # [ 0.611713] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1555lb # [ 0.612846] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1556worker2 # [ 0.606298] ACPI: \_SB_.GSID: Enabled at IRQ 191557lb # [ 0.614150] NET: Registered PF_UNIX/PF_LOCAL protocol family1558lb # [ 0.615191] NET: Registered PF_XDP protocol family1559worker2 # [ 0.608048] PCI: CLS 0 bytes, default 641560lb # [ 0.616087] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1561worker2 # [ 0.608963] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1562lb # [ 0.617131] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1563worker2 # [ 0.610675] Trying to unpack rootfs image as initramfs...1564lb # [ 0.618166] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565worker1 # [ 0.654785] Initialise system trusted keyrings1566lb # [ 0.619267] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1567lb # [ 0.620450] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1568worker1 # [ 0.657662] workingset: timestamp_bits=40 max_order=19 bucket_order=01569lb # [ 0.621616] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1570lb # [ 0.623406] ACPI: \_SB_.GSIA: Enabled at IRQ 161571lb # [ 0.625978] ACPI: \_SB_.GSIB: Enabled at IRQ 171572lb # [ 0.627991] ACPI: \_SB_.GSIC: Enabled at IRQ 181573lb # [ 0.629986] ACPI: \_SB_.GSID: Enabled at IRQ 191574lb # [ 0.631721] PCI: CLS 0 bytes, default 641575lb # [ 0.632649] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1576lb # [ 0.634485] Trying to unpack rootfs image as initramfs...1577worker1 # [ 0.679616] Key type asymmetric registered1578worker1 # [ 0.680333] Asymmetric key parser 'x509' registered1579worker1 # [ 0.681162] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1580worker1 # [ 0.686647] io scheduler mq-deadline registered1581worker1 # [ 0.687400] io scheduler kyber registered1582client # [ 0.664381] Initialise system trusted keyrings1583worker1 # [ 0.690513] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1584client # [ 0.667210] workingset: timestamp_bits=40 max_order=19 bucket_order=01585worker1 # [ 0.693745] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1586worker1 # [ 0.697661] Linux agpgart interface v0.1031587worker1 # [ 0.698410] ACPI: bus type drm_connector registered1588worker2 # [ 0.654951] Initialise system trusted keyrings1589worker1 # [ 0.701632] usbcore: registered new interface driver usbserial_generic1590worker2 # [ 0.658757] workingset: timestamp_bits=40 max_order=19 bucket_order=01591worker1 # [ 0.702677] usbserial: USB Serial support registered for generic1592worker1 # [ 0.705512] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1593worker1 # [ 0.705512] Please enable it if your BIOS has the CPPC option.1594worker1 # [ 0.707815] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1595worker1 # [ 0.711661] drop_monitor: Initializing network drop monitor service1596worker1 # [ 0.712851] NET: Registered PF_INET6 protocol family1597client # [ 0.688454] Key type asymmetric registered1598client # [ 0.689238] Asymmetric key parser 'x509' registered1599worker1 # [ 0.715968] Segment Routing with IPv61600client # [ 0.690061] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1601lb # [ 0.681423] Initialise system trusted keyrings1602worker1 # [ 0.718535] In-situ OAM (IOAM) with IPv61603lb # [ 0.682464] workingset: timestamp_bits=40 max_order=19 bucket_order=01604worker1 # [ 0.719619] IPI shorthand broadcast: enabled1605client # [ 0.695351] io scheduler mq-deadline registered1606client # [ 0.696078] io scheduler kyber registered1607worker2 # [ 0.680732] Key type asymmetric registered1608client # [ 0.698807] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1609worker2 # [ 0.681431] Asymmetric key parser 'x509' registered1610client # [ 0.700068] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1611worker2 # [ 0.682299] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1612worker1 # [ 0.727938] sched_clock: Marking stable (591014254, 136482433)->(799282444, -71785757)1613worker2 # [ 0.685719] io scheduler mq-deadline registered1614worker2 # [ 0.686466] io scheduler kyber registered1615client # [ 0.707243] Linux agpgart interface v0.1031616client # [ 0.707968] ACPI: bus type drm_connector registered1617worker1 # [ 0.733778] registered taskstats version 11618worker2 # [ 0.690782] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1619worker1 # [ 0.734766] Loading compiled-in X.509 certificates1620worker2 # [ 0.692045] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1621client # [ 0.710306] usbcore: registered new interface driver usbserial_generic1622client # [ 0.711338] usbserial: USB Serial support registered for generic1623client # [ 0.714181] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1624worker2 # [ 0.697407] Linux agpgart interface v0.1031625client # [ 0.714181] Please enable it if your BIOS has the CPPC option.1626worker2 # [ 0.698154] ACPI: bus type drm_connector registered1627lb # [ 0.706164] Key type asymmetric registered1628client # [ 0.716344] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1629lb # [ 0.706886] Asymmetric key parser 'x509' registered1630lb # [ 0.707840] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1631worker2 # [ 0.701059] usbcore: registered new interface driver usbserial_generic1632worker2 # [ 0.702104] usbserial: USB Serial support registered for generic1633client # [ 0.720359] drop_monitor: Initializing network drop monitor service1634client # [ 0.721510] NET: Registered PF_INET6 protocol family1635lb # [ 0.713109] io scheduler mq-deadline registered1636worker2 # [ 0.705597] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1637lb # [ 0.713873] io scheduler kyber registered1638worker2 # [ 0.705597] Please enable it if your BIOS has the CPPC option.1639worker2 # [ 0.707730] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1640client # [ 0.726296] Segment Routing with IPv61641client # [ 0.726923] In-situ OAM (IOAM) with IPv61642lb # [ 0.716555] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1643worker1 # [ 0.753512] Demotion targets for Node 0: null1644client # [ 0.727992] IPI shorthand broadcast: enabled1645worker1 # [ 0.754384] Key type .fscrypt registered1646lb # [ 0.717884] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1647worker1 # [ 0.755056] Key type fscrypt-provisioning registered1648worker2 # [ 0.711728] drop_monitor: Initializing network drop monitor service1649worker1 # [ 0.755972] ima: No TPM chip found, activating TPM-bypass!1650worker2 # [ 0.712931] NET: Registered PF_INET6 protocol family1651worker2 # [ 0.716082] Segment Routing with IPv61652lb # [ 0.723391] Linux agpgart interface v0.1031653worker1 # [ 0.760519] ima: Allocated hash algorithm: sha11654lb # [ 0.724210] ACPI: bus type drm_connector registered1655worker1 # [ 0.761304] ima: No architecture policies found1656worker1 # [ 0.762266] PM: Magic number: 10:89:2711657worker2 # [ 0.719606] In-situ OAM (IOAM) with IPv61658lb # [ 0.727445] usbcore: registered new interface driver usbserial_generic1659worker2 # [ 0.720735] IPI shorthand broadcast: enabled1660client # [ 0.738555] sched_clock: Marking stable (595016060, 143136869)->(815521142, -77368213)1661lb # [ 0.728560] usbserial: USB Serial support registered for generic1662client # [ 0.740020] registered taskstats version 11663worker1 # [ 0.765943] RAS: Correctable Errors collector initialized.1664client # [ 0.740936] Loading compiled-in X.509 certificates1665lb # [ 0.731980] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1666lb # [ 0.731980] Please enable it if your BIOS has the CPPC option.1667lb # [ 0.734153] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1668worker2 # [ 0.729096] sched_clock: Marking stable (594014534, 134558787)->(807166644, -78593323)1669worker1 # [ 0.774625] clk: Disabling unused clocks1670lb # [ 0.738120] drop_monitor: Initializing network drop monitor service1671worker1 # [ 0.775321] PM: genpd: Disabling unused power domains1672lb # [ 0.739292] NET: Registered PF_INET6 protocol family1673worker2 # [ 0.732857] registered taskstats version 11674worker2 # [ 0.733829] Loading compiled-in X.509 certificates1675lb # [ 0.742067] Segment Routing with IPv61676lb # [ 0.742788] In-situ OAM (IOAM) with IPv61677lb # [ 0.745283] IPI shorthand broadcast: enabled1678client # [ 0.759159] Demotion targets for Node 0: null1679client # [ 0.760071] Key type .fscrypt registered1680client # [ 0.762171] Key type fscrypt-provisioning registered1681client # [ 0.763068] ima: No TPM chip found, activating TPM-bypass!1682client # [ 0.763945] ima: Allocated hash algorithm: sha11683lb # [ 0.753689] sched_clock: Marking stable (619017045, 133940570)->(838519957, -85562342)1684client # [ 0.766190] ima: No architecture policies found1685lb # [ 0.757180] registered taskstats version 11686client # [ 0.768173] PM: Magic number: 10:89:2711687lb # [ 0.758143] Loading compiled-in X.509 certificates1688client # [ 0.769791] RAS: Correctable Errors collector initialized.1689worker2 # [ 0.752594] Demotion targets for Node 0: null1690worker2 # [ 0.753473] Key type .fscrypt registered1691worker2 # [ 0.756582] Key type fscrypt-provisioning registered1692worker2 # [ 0.757495] ima: No TPM chip found, activating TPM-bypass!1693worker2 # [ 0.758377] ima: Allocated hash algorithm: sha11694worker2 # [ 0.759165] ima: No architecture policies found1695client # [ 0.778890] clk: Disabling unused clocks1696worker2 # [ 0.761591] PM: Magic number: 10:89:2711697worker2 # [ 0.763372] RAS: Correctable Errors collector initialized.1698client # [ 0.782179] PM: genpd: Disabling unused power domains1699lb # [ 0.777335] Demotion targets for Node 0: null1700lb # [ 0.778388] Key type .fscrypt registered1701worker2 # [ 0.772370] clk: Disabling unused clocks1702lb # [ 0.780968] Key type fscrypt-provisioning registered1703lb # [ 0.782005] ima: No TPM chip found, activating TPM-bypass!1704lb # [ 0.782933] ima: Allocated hash algorithm: sha11705worker2 # [ 0.776594] PM: genpd: Disabling unused power domains1706lb # [ 0.785004] ima: No architecture policies found1707lb # [ 0.787979] PM: Magic number: 10:89:2711708lb # [ 0.789835] RAS: Correctable Errors collector initialized.1709lb # [ 0.798699] clk: Disabling unused clocks1710lb # [ 0.802976] PM: genpd: Disabling unused power domains1711worker1 # [ 0.942917] Freeing initrd memory: 29092K1712worker1 # [ 0.946228] Freeing unused decrypted memory: 2028K1713worker1 # [ 0.949008] Freeing unused kernel image (initmem) memory: 3644K1714worker1 # [ 0.950099] Write protecting the kernel read-only data: 32768k1715worker1 # [ 0.952045] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker1 # [ 0.953619] Freeing unused kernel image (rodata/data gap) memory: 752K1717client # [ 0.959828] Freeing initrd memory: 29096K1718client # [ 0.963099] Freeing unused decrypted memory: 2028K1719client # [ 0.965886] Freeing unused kernel image (initmem) memory: 3644K1720client # [ 0.967060] Write protecting the kernel read-only data: 32768k1721client # [ 0.968982] Freeing unused kernel image (text/rodata gap) memory: 1208K1722client # [ 0.970563] Freeing unused kernel image (rodata/data gap) memory: 752K1723worker2 # [ 0.957459] Freeing initrd memory: 29092K1724worker2 # [ 0.960772] Freeing unused decrypted memory: 2028K1725worker1 # [ 1.004777] x86/mm: Checked W+X mappings: passed, no W+X pages found.1726worker1 # [ 1.005813] Run /init as init process1727worker2 # [ 0.963528] Freeing unused kernel image (initmem) memory: 3644K1728worker2 # [ 0.964714] Write protecting the kernel read-only data: 32768k1729worker2 # [ 0.966691] Freeing unused kernel image (text/rodata gap) memory: 1208K1730worker2 # [ 0.968278] Freeing unused kernel image (rodata/data gap) memory: 752K1731worker1 # [ 1.016371] systemd[1]: Inserted module 'autofs4'1732lb # [ 0.983871] Freeing initrd memory: 29092K1733lb # [ 0.987206] Freeing unused decrypted memory: 2028K1734lb # [ 0.989993] Freeing unused kernel image (initmem) memory: 3644K1735lb # [ 0.991051] Write protecting the kernel read-only data: 32768k1736lb # [ 0.992883] Freeing unused kernel image (text/rodata gap) memory: 1208K1737lb # [ 0.994435] Freeing unused kernel image (rodata/data gap) memory: 752K1738worker1 # [ 1.032934] fuse: init (API version 7.45)1739worker1 # [ 1.038862] ACPI: \_SB_.GSIG: Enabled at IRQ 221740worker1 # [ 1.041238] ACPI: \_SB_.GSIH: Enabled at IRQ 231741worker1 # [ 1.044130] ACPI: \_SB_.GSIE: Enabled at IRQ 201742worker1 # [ 1.046345] ACPI: \_SB_.GSIF: Enabled at IRQ 211743client # [ 1.022022] x86/mm: Checked W+X mappings: passed, no W+X pages found.1744client # [ 1.023261] Run /init as init process1745client # [ 1.033938] systemd[1]: Inserted module 'autofs4'1746worker2 # [ 1.019695] x86/mm: Checked W+X mappings: passed, no W+X pages found.1747worker2 # [ 1.020932] Run /init as init process1748worker1 # [ 1.072341] systemd[1]: Successfully made /usr/ read-only.1749worker2 # [ 1.032160] systemd[1]: Inserted module 'autofs4'1750client # [ 1.050625] fuse: init (API version 7.45)1751lb # [ 1.045629] x86/mm: Checked W+X mappings: passed, no W+X pages found.1752client # [ 1.056622] ACPI: \_SB_.GSIG: Enabled at IRQ 221753lb # [ 1.046730] Run /init as init process1754client # [ 1.059180] ACPI: \_SB_.GSIH: Enabled at IRQ 231755client # [ 1.062840] ACPI: \_SB_.GSIE: Enabled at IRQ 201756client # [ 1.065645] ACPI: \_SB_.GSIF: Enabled at IRQ 211757worker2 # [ 1.048871] fuse: init (API version 7.45)1758lb # [ 1.057454] systemd[1]: Inserted module 'autofs4'1759worker2 # [ 1.054898] ACPI: \_SB_.GSIG: Enabled at IRQ 221760worker2 # [ 1.057536] ACPI: \_SB_.GSIH: Enabled at IRQ 231761worker2 # [ 1.061160] ACPI: \_SB_.GSIE: Enabled at IRQ 201762worker2 # [ 1.064551] ACPI: \_SB_.GSIF: Enabled at IRQ 211763lb # [ 1.074015] fuse: init (API version 7.45)1764lb # [ 1.080036] ACPI: \_SB_.GSIG: Enabled at IRQ 221765client # [ 1.093024] systemd[1]: Successfully made /usr/ read-only.1766lb # [ 1.082746] ACPI: \_SB_.GSIH: Enabled at IRQ 231767lb # [ 1.086804] ACPI: \_SB_.GSIE: Enabled at IRQ 201768lb # [ 1.090335] ACPI: \_SB_.GSIF: Enabled at IRQ 211769worker2 # [ 1.096663] systemd[1]: Successfully made /usr/ read-only.1770lb # [ 1.124286] systemd[1]: Successfully made /usr/ read-only.1771worker1 # [ 1.407957] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker1 # [ 1.413262] systemd[1]: Detected virtualization kvm.1773worker1 # [ 1.414153] systemd[1]: Detected architecture x86-64.1774worker1 # [ 1.415073] systemd[1]: Running in initrd.1775worker1 # [ 1.416180] systemd[1]: Initializing machine ID from random generator.1776worker1 # [ 1.417577] systemd[1]: Hostname set to <worker1>.1777client # [ 1.428538] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778client # [ 1.433597] systemd[1]: Detected virtualization kvm.1779client # [ 1.434472] systemd[1]: Detected architecture x86-64.1780client # [ 1.435358] systemd[1]: Running in initrd.1781client # [ 1.436474] systemd[1]: Initializing machine ID from random generator.1782client # [ 1.437736] systemd[1]: Hostname set to <client>.1783worker2 # [ 1.432473] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784worker2 # [ 1.438623] systemd[1]: Detected virtualization kvm.1785worker2 # [ 1.439795] systemd[1]: Detected architecture x86-64.1786worker2 # [ 1.440789] systemd[1]: Running in initrd.1787worker2 # [ 1.442014] systemd[1]: Initializing machine ID from random generator.1788worker2 # [ 1.443294] systemd[1]: Hostname set to <worker2>.1789lb # [ 1.461078] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790lb # [ 1.474752] systemd[1]: Detected virtualization kvm.1791lb # [ 1.477501] systemd[1]: Detected architecture x86-64.1792lb # [ 1.480274] systemd[1]: Running in initrd.1793lb # [ 1.483697] systemd[1]: Initializing machine ID from random generator.1794lb # [ 1.487444] systemd[1]: Hostname set to <lb>.1795worker1 # [ 1.611548] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker1 # [ 1.654721] systemd[1]: Queued start job for default target Initrd Default Target.1797worker1 # [ 1.658955] systemd[1]: Created slice Slice /system/modprobe.1798worker1 # [ 1.660185] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1799worker1 # [ 1.661663] systemd[1]: Expecting device /dev/disk/by-label/nixos...1800worker1 # [ 1.662829] systemd[1]: Reached target Path Units.1801worker1 # [ 1.663760] systemd[1]: Reached target Slice Units.1802worker1 # [ 1.664658] systemd[1]: Reached target Swaps.1803worker1 # [ 1.665504] systemd[1]: Reached target Timer Units.1804worker1 # [ 1.666563] systemd[1]: Listening on D-Bus System Message Bus Socket.1805worker1 # [ 1.667800] systemd[1]: Listening on Journal Socket (/dev/log).1806worker1 # [ 1.669032] systemd[1]: Listening on Journal Sockets.1807worker1 # [ 1.670087] systemd[1]: Listening on udev Control Socket.1808client # [ 1.642934] systemd[1]: bpf-restrict-fs: LSM BPF program attached1809worker1 # [ 1.671076] systemd[1]: Listening on udev Kernel Socket.1810worker1 # [ 1.672051] systemd[1]: Reached target Socket Units.1811worker1 # [ 1.674054] systemd[1]: Starting Create List of Static Device Nodes...1812worker1 # [ 1.679588] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1813worker1 # [ 1.684576] systemd[1]: Starting Load Kernel Module configfs...1814worker2 # [ 1.642114] systemd[1]: bpf-restrict-fs: LSM BPF program attached1815worker1 # [ 1.697594] systemd[1]: Starting Journal Service...1816worker1 # [ 1.711576] systemd[1]: Starting Load Kernel Modules...1817client # [ 1.696304] systemd[1]: Queued start job for default target Initrd Default Target.1818worker2 # [ 1.681890] systemd[1]: Queued start job for default target Initrd Default Target.1819client # [ 1.700522] systemd[1]: Created slice Slice /system/modprobe.1820client # [ 1.701725] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1821client # [ 1.703070] systemd[1]: Expecting device /dev/disk/by-label/nixos...1822client # [ 1.704216] systemd[1]: Reached target Path Units.1823worker1 # [ 1.717578] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1824worker2 # [ 1.686165] systemd[1]: Created slice Slice /system/modprobe.1825client # [ 1.705023] systemd[1]: Reached target Slice Units.1826client # [ 1.705857] systemd[1]: Reached target Swaps.1827worker2 # [ 1.687514] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1828client # [ 1.706649] systemd[1]: Reached target Timer Units.1829worker2 # [ 1.689074] systemd[1]: Expecting device /dev/disk/by-label/nixos...1830client # [ 1.707637] systemd[1]: Listening on D-Bus System Message Bus Socket.1831worker2 # [ 1.690351] systemd[1]: Reached target Path Units.1832client # [ 1.708804] systemd[1]: Listening on Journal Socket (/dev/log).1833worker2 # [ 1.691292] systemd[1]: Reached target Slice Units.1834client # [ 1.709913] systemd[1]: Listening on Journal Sockets.1835worker2 # [ 1.692259] systemd[1]: Reached target Swaps.1836client # [ 1.710891] systemd[1]: Listening on udev Control Socket.1837worker2 # [ 1.693161] systemd[1]: Reached target Timer Units.1838client # [ 1.711884] systemd[1]: Listening on udev Kernel Socket.1839worker1 # [ 1.738182] netfs: FS-Cache loaded1840client # [ 1.712805] systemd[1]: Reached target Socket Units.1841worker2 # [ 1.694230] systemd[1]: Listening on D-Bus System Message Bus Socket.1842worker2 # [ 1.696313] systemd[1]: Listening on Journal Socket (/dev/log).1843client # [ 1.714628] systemd[1]: Starting Create List of Static Device Nodes...1844worker2 # [ 1.697594] systemd[1]: Listening on Journal Sockets.1845worker2 # [ 1.698635] systemd[1]: Listening on udev Control Socket.1846worker1 # [ 1.743251] 9pnet: Installing 9P2000 support1847worker2 # [ 1.699683] systemd[1]: Listening on udev Kernel Socket.1848client # [ 1.718264] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1849worker2 # [ 1.700736] systemd[1]: Reached target Socket Units.1850worker2 # [ 1.703042] systemd[1]: Starting Create List of Static Device Nodes...1851client # [ 1.723231] systemd[1]: Starting Load Kernel Module configfs...1852worker2 # [ 1.708659] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1853worker1 # [ 1.753603] systemd[1]: Starting Coldplug All udev Devices...1854lb # [ 1.718839] systemd[1]: bpf-restrict-fs: LSM BPF program attached1855worker2 # [ 1.714045] systemd[1]: Starting Load Kernel Module configfs...1856client # [ 1.736800] systemd[1]: Starting Journal Service...1857worker1 # [ 1.769614] systemd[1]: Finished Create List of Static Device Nodes.1858worker2 # [ 1.728008] systemd[1]: Starting Journal Service...1859client # [ 1.750220] systemd[1]: Starting Load Kernel Modules...1860worker1 # [ 1.776607] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1861worker1 # [ 1.782967] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1862worker2 # [ 1.743838] systemd[1]: Starting Load Kernel Modules...1863worker1 # [ 1.788283] systemd[1]: modprobe@configfs.service: Deactivated successfully.1864worker1 # [ 1.793805] systemd-journald[67]: Collecting audit messages is disabled.1865client # [ 1.755968] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1866worker1 # [ 1.795907] systemd[1]: Finished Load Kernel Module configfs.1867client # [ 1.777558] netfs: FS-Cache loaded1868worker1 # [ 1.803054] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1869lb # [ 1.768240] systemd[1]: Queued start job for default target Initrd Default Target.1870worker1 # [ 1.806993] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1871lb # [ 1.772346] systemd[1]: Created slice Slice /system/modprobe.1872lb # [ 1.773539] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1873lb # [ 1.774929] systemd[1]: Expecting device /dev/disk/by-label/nixos...1874client # [ 1.786473] 9pnet: Installing 9P2000 support1875lb # [ 1.776029] systemd[1]: Reached target Path Units.1876lb # [ 1.776859] systemd[1]: Reached target Slice Units.1877worker2 # [ 1.753735] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1878lb # [ 1.777713] systemd[1]: Reached target Swaps.1879worker1 # [ 1.813710] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1880lb # [ 1.778499] systemd[1]: Reached target Timer Units.1881worker1 # [ 1.814978] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1882lb # [ 1.779526] systemd[1]: Listening on D-Bus System Message Bus Socket.1883lb # [ 1.780795] systemd[1]: Listening on Journal Socket (/dev/log).1884lb # [ 1.781967] systemd[1]: Listening on Journal Sockets.1885lb # [ 1.782970] systemd[1]: Listening on udev Control Socket.1886lb # [ 1.784001] systemd[1]: Listening on udev Kernel Socket.1887lb # [ 1.785086] systemd[1]: Reached target Socket Units.1888client # [ 1.796416] systemd[1]: Starting Coldplug All udev Devices...1889lb # [ 1.787241] systemd[1]: Starting Create List of Static Device Nodes...1890worker2 # [ 1.780487] netfs: FS-Cache loaded1891lb # [ 1.792029] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1892worker2 # [ 1.788606] 9pnet: Installing 9P2000 support1893lb # [ 1.799035] systemd[1]: Starting Load Kernel Module configfs...1894client # [ 1.816890] systemd-journald[67]: Collecting audit messages is disabled.1895client # [ 1.820314] systemd[1]: Finished Create List of Static Device Nodes.1896worker2 # [ 1.803690] systemd[1]: Starting Coldplug All udev Devices...1897worker1 # [ 1.850585] systemd[1]: Finished Load Kernel Modules.1898lb # [ 1.816188] systemd[1]: Starting Journal Service...1899client # [ 1.830337] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1900worker1 # [ 1.859705] systemd[1]: Starting Apply Kernel Variables...1901worker2 # [ 1.819092] systemd[1]: Finished Create List of Static Device Nodes.1902client # [ 1.838262] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1903lb # [ 1.828167] systemd[1]: Starting Load Kernel Modules...1904worker1 # [ 1.869619] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1905client # [ 1.844731] systemd[1]: modprobe@configfs.service: Deactivated successfully.1906worker2 # [ 1.829150] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1907client # [ 1.852691] systemd[1]: Finished Load Kernel Module configfs.1908worker1 # [ 1.880741] systemd[1]: Starting Create Static Device Nodes in /dev...1909worker2 # [ 1.839665] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1910client # [ 1.857290] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1911lb # [ 1.836049] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1912worker2 # [ 1.842396] systemd-journald[67]: Collecting audit messages is disabled.1913client # [ 1.860040] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1914lb # [ 1.852679] netfs: FS-Cache loaded1915worker2 # [ 1.847050] systemd[1]: modprobe@configfs.service: Deactivated successfully.1916lb # [ 1.857705] 9pnet: Installing 9P2000 support1917worker2 # [ 1.852013] systemd[1]: Finished Load Kernel Module configfs.1918client # [ 1.869389] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1919client # [ 1.872541] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1920worker2 # [ 1.854066] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1921worker1 # [ 1.901086] systemd[1]: Finished Apply Kernel Variables.1922worker2 # [ 1.859146] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1923worker2 # [ 1.863618] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1924lb # [ 1.872272] systemd[1]: Starting Coldplug All udev Devices...1925worker1 # [ 1.913621] systemd[1]: Started Journal Service.1926worker2 # [ 1.870815] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1927worker1 # [ 1.778235] systemd-modules-load[68]: Inserted module 'dm_mod'1928worker1 # [ 1.780313] systemd-modules-load[68]: Inserted module 'virtio_balloon'1929worker1 # [ 1.782307] systemd-modules-load[68]: Inserted module 'virtio_gpu'1930lb # [ 1.889064] systemd[1]: Finished Create List of Static Device Nodes.1931worker1 # [ 1.791969] systemd[1]: Finished Create Static Device Nodes in /dev.1932lb # [ 1.895183] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1933client # [ 1.906927] systemd[1]: Finished Load Kernel Modules.1934worker1 # [ 1.796799] systemd[1]: Reached target Preparation for Local File Systems.1935worker1 # [ 1.799878] systemd[1]: Reached target Local File Systems.1936worker1 # [ 1.801138] systemd[1]: Starting Create System Files and Directories...1937lb # [ 1.901175] systemd-journald[67]: Collecting audit messages is disabled.1938lb # [ 1.902760] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1939worker2 # [ 1.896153] systemd[1]: Finished Load Kernel Modules.1940client # [ 1.915669] systemd[1]: Starting Apply Kernel Variables...1941worker1 # [ 1.808154] systemd[1]: Starting Rule-based Manager for Device Events and Files...1942lb # [ 1.910470] systemd[1]: modprobe@configfs.service: Deactivated successfully.1943worker2 # [ 1.904821] systemd[1]: Starting Apply Kernel Variables...1944lb # [ 1.915118] systemd[1]: Finished Load Kernel Module configfs.1945lb # [ 1.920525] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1946lb # [ 1.925905] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1947client # [ 1.940449] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1948worker2 # [ 1.924655] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1949lb # [ 1.934255] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1950lb # [ 1.936983] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1951client # [ 1.951851] systemd[1]: Starting Create Static Device Nodes in /dev...1952worker2 # [ 1.934812] systemd[1]: Starting Create Static Device Nodes in /dev...1953worker1 # [ 1.842954] systemd[1]: Finished Create System Files and Directories.1954client # [ 1.812785] systemd-modules-load[68]: Inserted module 'dm_mod'1955client # [ 1.815264] systemd-modules-load[68]: Inserted module 'virtio_balloon'1956client # [ 1.817358] systemd-modules-load[68]: Inserted module 'virtio_gpu'1957client # [ 1.964531] systemd[1]: Started Journal Service.1958worker2 # [ 1.947220] systemd[1]: Finished Apply Kernel Variables.1959worker1 # [ 1.865285] systemd-udevd[84]: Using default interface naming scheme 'v261'.1960worker2 # [ 1.961438] systemd[1]: Started Journal Service.1961client # [ 1.837179] systemd[1]: Finished Apply Kernel Variables.1962lb # [ 1.970627] systemd[1]: Finished Load Kernel Modules.1963worker2 # [ 1.829259] systemd-modules-load[68]: Inserted module 'dm_mod'1964worker2 # [ 1.830621] systemd-modules-load[68]: Inserted module 'virtio_balloon'1965worker2 # [ 1.833699] systemd-modules-load[68]: Inserted module 'virtio_gpu'1966lb # [ 1.979271] systemd[1]: Starting Apply Kernel Variables...1967worker2 # [ 1.841896] systemd[1]: Finished Create Static Device Nodes in /dev.1968worker2 # [ 1.847106] systemd[1]: Reached target Preparation for Local File Systems.1969worker1 # [ 1.889607] systemd[1]: Started Rule-based Manager for Device Events and Files.1970worker2 # [ 1.848531] systemd[1]: Reached target Local File Systems.1971client # [ 1.862202] systemd[1]: Finished Create Static Device Nodes in /dev.1972worker2 # [ 1.853919] systemd[1]: Starting Create System Files and Directories...1973client # [ 1.863389] systemd[1]: Reached target Preparation for Local File Systems.1974client # [ 1.864387] systemd[1]: Reached target Local File Systems.1975worker2 # [ 1.857070] systemd[1]: Starting Rule-based Manager for Device Events and Files...1976client # [ 1.866819] systemd[1]: Starting Create System Files and Directories...1977lb # [ 2.000068] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1978client # [ 1.874082] systemd[1]: Starting Rule-based Manager for Device Events and Files...1979lb # [ 2.010387] systemd[1]: Starting Create Static Device Nodes in /dev...1980worker2 # [ 1.882686] systemd[1]: Finished Create System Files and Directories.1981lb # [ 2.026049] systemd[1]: Finished Apply Kernel Variables.1982lb # [ 1.893648] systemd-modules-load[68]: Inserted module 'dm_mod'1983lb # [ 1.896953] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984worker1 # [ 1.932138] systemd[1]: Finished Coldplug All udev Devices.1985lb # [ 1.899161] systemd-modules-load[68]: Inserted module 'virtio_gpu'1986worker1 # [ 1.933175] systemd[1]: Reached target System Initialization.1987worker1 # [ 1.934115] systemd[1]: Reached target Basic System.1988lb # [ 2.036202] systemd[1]: Started Journal Service.1989client # [ 1.917238] systemd[1]: Finished Create System Files and Directories.1990worker2 # [ 1.911401] systemd-udevd[84]: Using default interface naming scheme 'v261'.1991lb # [ 1.922267] systemd[1]: Finished Create Static Device Nodes in /dev.1992lb # [ 1.924265] systemd[1]: Reached target Preparation for Local File Systems.1993lb # [ 1.925309] systemd[1]: Reached target Local File Systems.1994lb # [ 1.929402] systemd[1]: Starting Create System Files and Directories...1995lb # [ 1.934747] systemd[1]: Starting Rule-based Manager for Device Events and Files...1996client # [ 1.943444] systemd-udevd[83]: Using default interface naming scheme 'v261'.1997worker2 # [ 1.936391] systemd[1]: Started Rule-based Manager for Device Events and Files.1998client # [ 1.970105] systemd[1]: Started Rule-based Manager for Device Events and Files.1999lb # [ 1.970557] systemd[1]: Finished Create System Files and Directories.2000worker2 # [ 1.983703] systemd[1]: Finished Coldplug All udev Devices.
loading 2,104 hidden lines…
4105lb # [ 20.443473] envoy[997]: [2026-09-20 08:15:42.969][997][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4106lb # [ 20.445161] envoy[997]: [2026-09-20 08:15:42.969][997][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4107lb # [ 20.494616] envoy[997]: [2026-09-20 08:15:43.020][997][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4108worker2 # [ 20.491657] systemd[1]: Starting Nix worker-protocol over gRPC...4109worker1 # [ 20.532793] systemd[1]: Starting Nix worker-protocol over gRPC...4110lb # [ 20.519476] envoy[997]: [2026-09-20 08:15:43.045][997][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4111lb # [ 20.522054] envoy[997]: [2026-09-20 08:15:43.048][997][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4112lb # [ 20.524886] envoy[997]: [2026-09-20 08:15:43.048][997][info][main] [source/server/server.cc:1077] starting main dispatch loop4113worker2 # [ 20.681958] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4114worker2 # [ 20.696190] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14115worker1 # [ 20.745391] nix-grpc-daemon[849]: ts=2026-09-20T08:15:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4116worker1 # [ 20.759986] nix-grpc-daemon[849]: ts=2026-09-20T08:15:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14117worker2 # [ 20.737885] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4118worker2 # [ 20.741476] systemd[1]: Started Nix worker-protocol over gRPC.4119worker1 # [ 20.797202] nix-grpc-daemon[849]: ts=2026-09-20T08:15:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4120worker1 # [ 20.800424] systemd[1]: Started Nix worker-protocol over gRPC.4121lb # [ 20.801801] envoy[997]: [2026-09-20 08:15:43.328][997][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4122lb # [ 20.803800] envoy[997]: [2026-09-20 08:15:43.330][997][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4123lb # [ 20.805595] envoy[997]: [2026-09-20 08:15:43.330][997][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4124lb # [ 20.807320] envoy[997]: [2026-09-20 08:15:43.331][997][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4125worker2 # [ 20.816657] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514126worker2 # [ 20.830778] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4127worker1 # [ 20.874702] nix-grpc-daemon[849]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514128worker1 # [ 20.878915] nix-grpc-daemon[849]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4129worker2 # [ 21.032150] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 21.079659] nix-grpc-daemon[849]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514131worker2 # [ 21.037930] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4132worker1 # [ 21.082950] nix-grpc-daemon[849]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4133worker2 # [ 21.238750] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514134worker1 # [ 21.283970] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514135worker2 # [ 21.243683] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker1 # [ 21.288731] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4137worker1 # [ 21.486312] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514138worker2 # [ 21.444595] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514139worker1 # [ 21.488573] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker2 # [ 21.449463] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4141worker1 # [ 21.689538] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514142worker2 # [ 21.650360] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514143worker1 # [ 21.694232] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker2 # [ 21.654322] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4145worker1 # [ 21.895509] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514146worker2 # [ 21.855939] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 21.861182] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 21.902341] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4149worker2 # [ 22.061542] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514150worker1 # [ 22.103329] nix-grpc-daemon[849]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 22.066666] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 22.108884] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4153worker2 # [ 22.267846] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514154worker1 # [ 22.309809] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514155worker1 # [ 22.314963] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker2 # [ 22.273296] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4157worker1 # [ 22.515628] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514158worker2 # [ 22.474374] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514159worker1 # [ 22.520629] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker2 # [ 22.479193] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4161worker2 # [ 22.679196] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514162worker1 # [ 22.721319] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514163worker1 # [ 22.724322] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker2 # [ 22.683538] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4165worker1 # [ 22.926119] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514166worker2 # [ 22.885235] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 22.889890] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 22.932135] nix-grpc-daemon[849]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4169worker2 # [ 23.090552] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514170worker1 # [ 23.133863] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 23.095695] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 23.137862] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4173worker2 # [ 23.296316] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514174worker1 # [ 23.338618] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 23.301368] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker1 # [ 23.343327] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4177worker2 # [ 23.502461] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514178worker1 # [ 23.544422] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 23.507657] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 23.549402] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4181worker2 # [ 23.708240] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 23.750269] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514183worker2 # [ 23.710639] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 23.754189] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4185worker2 # [ 23.913837] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514186worker1 # [ 23.957397] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 23.917224] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 23.960481] nix-grpc-daemon[849]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4189worker2 # [ 24.114344] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 24.157318] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 24.119624] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 24.162561] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4193worker1 # [ 24.363141] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514194worker2 # [ 24.320684] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514195worker1 # [ 24.365623] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker2 # [ 24.325658] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4197worker1 # [ 24.566645] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514198worker2 # [ 24.526812] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 24.531112] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 24.572514] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4201worker2 # [ 24.730776] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 24.773223] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 24.733206] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 24.775811] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4205worker2 # [ 24.934280] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 24.977563] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 24.936713] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 24.979514] nix-grpc-daemon[849]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4209worker1 # [ 25.180069] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514210worker2 # [ 25.137907] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 25.182279] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker2 # [ 25.142647] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4213worker1 # [ 25.382913] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514214worker2 # [ 25.343216] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514215worker1 # [ 25.384784] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker2 # [ 25.345547] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4217worker1 # [ 25.585980] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514218worker2 # [ 25.546573] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514219worker1 # [ 25.589814] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker2 # [ 25.550542] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4221worker1 # [ 25.790189] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514222worker1 # [ 25.793405] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker2 # [ 25.751699] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514224worker2 # [ 25.755908] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4225worker1 # [ 25.995318] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514226worker2 # [ 25.956749] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514227worker2 # [ 25.958340] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 25.999880] nix-grpc-daemon[849]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4229worker2 # [ 26.158884] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 26.200463] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514231worker2 # [ 26.163451] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker1 # [ 26.205283] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4233worker2 # [ 26.364153] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 26.405653] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514235worker2 # [ 26.367650] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker1 # [ 26.409854] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4237worker1 # [ 26.609557] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514238worker2 # [ 26.568339] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514239worker2 # [ 26.570626] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker1 # [ 26.612601] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4241worker2 # [ 26.771761] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 26.813782] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514243worker2 # [ 26.776624] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker1 # [ 26.819473] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4245worker1 # [ 27.020229] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514246worker2 # [ 26.978550] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514247worker1 # [ 27.023308] nix-grpc-daemon[849]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker2 # [ 26.983642] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4249worker1 # [ 27.223934] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514250worker2 # [ 27.184497] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514251worker2 # [ 27.188887] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker1 # [ 27.231231] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4253worker2 # [ 27.389675] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514254worker1 # [ 27.433153] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514255worker2 # [ 27.395114] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker1 # [ 27.436928] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4257worker1 # [ 27.634798] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514258worker2 # [ 27.595267] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514259worker2 # [ 27.597490] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker1 # [ 27.639367] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4261worker1 # [ 27.840157] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514262worker2 # [ 27.798499] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514263worker1 # [ 27.846331] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker2 # [ 27.805690] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4265worker2 # [ 28.006333] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 28.047984] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514267worker1 # [ 28.053261] nix-grpc-daemon[849]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker2 # [ 28.011670] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4269worker2 # [ 28.212433] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 28.254277] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514271worker2 # [ 28.215161] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker1 # [ 28.256699] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4273worker2 # [ 28.415881] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514274worker1 # [ 28.457766] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514275worker2 # [ 28.420501] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker1 # [ 28.462508] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4277worker1 # [ 28.663168] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514278worker2 # [ 28.621533] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514279worker2 # [ 28.626663] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4280worker1 # [ 28.668357] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4281worker2 # [ 28.827443] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514282worker1 # [ 28.869473] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514283worker2 # [ 28.832429] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4284worker1 # [ 28.876591] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4285worker2 # [ 29.036473] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 29.079132] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514287worker1 # [ 29.082381] nix-grpc-daemon[849]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4288worker2 # [ 29.039990] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4289worker2 # [ 29.236590] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514290worker1 # [ 29.280725] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514291worker2 # [ 29.241365] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4292worker1 # [ 29.284730] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4293worker1 # [ 29.485148] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514294worker2 # [ 29.442347] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514295worker1 # [ 29.487330] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4296worker2 # [ 29.447214] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4297worker1 # [ 29.688032] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514298worker2 # [ 29.647898] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514299worker1 # [ 29.691590] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4300worker2 # [ 29.651654] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4301worker1 # [ 29.892145] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514302worker2 # [ 29.852323] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514303worker1 # [ 29.896513] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304worker2 # [ 29.856165] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4305worker1 # [ 30.097156] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514306worker2 # [ 30.057963] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514307worker1 # [ 30.104703] nix-grpc-daemon[849]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4308worker2 # [ 30.063085] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4309worker2 # [ 30.262785] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514310worker1 # [ 30.305740] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514311worker2 # [ 30.267695] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4312worker1 # [ 30.310596] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4313worker2 # [ 30.468002] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514314worker2 # [ 30.471036] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4315worker1 # [ 30.511610] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514316worker1 # [ 30.518642] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4317worker2 # [ 30.671650] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514318worker2 # [ 30.675616] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4319worker1 # [ 30.720713] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514320worker1 # [ 30.724494] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4321worker2 # [ 30.876716] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514322worker1 # [ 30.922435] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514323worker2 # [ 30.881967] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4324worker1 # [ 30.926985] nix-grpc-daemon[849]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4325worker2 # [ 31.083048] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514326worker2 # [ 31.085438] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4327worker1 # [ 31.128451] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514328worker1 # [ 31.130196] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4329worker2 # [ 31.286596] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514330worker1 # [ 31.331442] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514331worker2 # [ 31.291596] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4332worker1 # [ 31.336134] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4333worker2 # [ 31.492344] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514334worker2 # [ 31.494821] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4335worker1 # [ 31.537156] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514336worker1 # [ 31.542203] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4337worker2 # [ 31.695459] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514338worker2 # [ 31.698444] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4339worker1 # [ 31.744597] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514340worker1 # [ 31.748598] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4341worker2 # [ 31.899233] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514342worker2 # [ 31.901681] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4343worker1 # [ 31.948764] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514344worker1 # [ 31.950838] nix-grpc-daemon[849]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4345worker2 # [ 32.104574] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514346worker2 # [ 32.108444] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4347worker1 # [ 32.153947] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514348worker1 # [ 32.156883] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4349worker2 # [ 32.308745] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514350worker2 # [ 32.311283] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4351worker1 # [ 32.355552] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514352worker1 # [ 32.359792] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4353worker2 # [ 32.511987] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_connected addr=lb:500514354worker2 # [ 32.514395] nix-grpc-daemon[787]: ts=2026-09-20T08:15:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4355worker1 # [ 32.559953] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514356worker1 # [ 32.562172] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4357worker2 # [ 32.715446] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514358worker1 # [ 32.762986] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514359worker2 # [ 32.720431] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4360worker1 # [ 32.765518] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4361worker2 # [ 32.921814] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514362worker1 # [ 32.967575] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514363worker2 # [ 32.926693] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4364worker1 # [ 32.971383] nix-grpc-daemon[849]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4365worker2 # [ 33.127690] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514366worker2 # [ 33.129960] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4367worker1 # [ 33.172918] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514368worker1 # [ 33.174251] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4369worker1 # [ 33.373833] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514370worker2 # [ 33.331104] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514371worker1 # [ 33.376388] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4372worker2 # [ 33.336249] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4373worker1 # [ 33.576876] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514374worker2 # [ 33.537546] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_connected addr=lb:500514375worker1 # [ 33.583961] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4376worker2 # [ 33.541824] nix-grpc-daemon[787]: ts=2026-09-20T08:15:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4377worker2 # [ 33.742355] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514378worker1 # [ 33.785117] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514379worker2 # [ 33.745389] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4380worker1 # [ 33.790149] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4381worker2 # [ 33.946099] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514382worker2 # [ 33.948674] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4383worker1 # [ 33.990860] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514384worker1 # [ 33.995663] nix-grpc-daemon[849]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4385worker2 # [ 34.149833] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514386worker1 # [ 34.197776] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514387worker2 # [ 34.154296] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4388worker1 # [ 34.202838] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4389worker2 # [ 34.355461] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514390worker2 # [ 34.360810] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4391worker1 # [ 34.403882] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514392worker1 # [ 34.408789] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4393worker2 # [ 34.561936] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_connected addr=lb:500514394worker1 # [ 34.609435] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514395worker2 # [ 34.566933] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4396worker1 # [ 34.611531] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4397worker2 # [ 34.767550] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514398worker2 # [ 34.770034] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4399worker1 # [ 34.812102] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514400worker1 # [ 34.815960] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4401worker2 # [ 34.970994] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514402worker1 # [ 35.016987] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514403worker2 # [ 34.976670] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4404worker1 # [ 35.021933] nix-grpc-daemon[849]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4405worker2 # [ 35.178704] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514406worker1 # [ 35.223114] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514407worker1 # [ 35.225970] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4408worker2 # [ 35.183549] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4409worker2 # [ 35.384097] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514410worker1 # [ 35.426734] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514411worker2 # [ 35.386499] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4412worker1 # [ 35.429136] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4413worker2 # [ 35.587171] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_connected addr=lb:500514414worker1 # [ 35.629800] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514415worker2 # [ 35.589821] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4416worker1 # [ 35.632208] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4417worker2 # [ 35.790501] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514418worker1 # [ 35.833248] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514419worker2 # [ 35.793349] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4420worker1 # [ 35.838267] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4421worker2 # [ 35.994293] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514422worker1 # [ 36.038502] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514423worker1 # [ 36.041517] nix-grpc-daemon[849]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4424worker2 # [ 35.998867] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4425worker2 # [ 36.201978] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514426worker1 # [ 36.244787] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514427worker2 # [ 36.205103] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4428worker1 # [ 36.247760] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4429worker2 # [ 36.402426] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514430worker1 # [ 36.444549] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514431worker2 # [ 36.404688] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4432worker1 # [ 36.447169] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4433worker2 # [ 36.605453] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_connected addr=lb:500514434worker1 # [ 36.648373] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514435worker2 # [ 36.608961] nix-grpc-daemon[787]: ts=2026-09-20T08:15:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4436worker1 # [ 36.653733] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4437worker2 # [ 36.809982] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514438worker1 # [ 36.854753] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514439worker2 # [ 36.815373] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4440worker1 # [ 36.859546] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4441worker2 # [ 37.016460] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514442worker1 # [ 37.060361] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514443worker2 # [ 37.021235] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4444worker1 # [ 37.065095] nix-grpc-daemon[849]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4445worker2 # [ 37.222174] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514446worker2 # [ 37.225082] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4447worker1 # [ 37.268313] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514448worker1 # [ 37.271469] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4449worker2 # [ 37.425969] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514450worker1 # [ 37.469221] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514451worker2 # [ 37.430877] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4452worker1 # [ 37.473687] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4453worker2 # [ 37.631476] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_connected addr=lb:500514454worker1 # [ 37.674515] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514455worker2 # [ 37.634479] nix-grpc-daemon[787]: ts=2026-09-20T08:15:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4456worker1 # [ 37.679510] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4457worker2 # [ 37.835389] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514458worker1 # [ 37.880499] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514459worker2 # [ 37.840332] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4460worker1 # [ 37.885546] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4461worker2 # [ 37.983503] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"4462worker1 # [ 38.037745] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"4463worker2 # [ 38.041298] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514464worker1 # [ 38.086562] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514465worker2 # [ 38.047448] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4466worker1 # [ 38.091645] nix-grpc-daemon[849]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4467worker2 # [ 38.248385] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514468worker2 # [ 38.250886] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4469worker1 # [ 38.294781] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514470worker1 # [ 38.297923] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4471worker2 # [ 38.451958] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514472worker1 # [ 38.495402] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514473worker2 # [ 38.457648] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4474worker1 # [ 38.500478] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4475worker2 # [ 38.658614] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_connected addr=lb:500514476worker1 # [ 38.702590] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514477worker1 # [ 38.706657] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4478worker2 # [ 38.664279] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4479worker2 # [ 38.864436] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514480worker1 # [ 38.907917] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514481worker2 # [ 38.869668] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4482worker1 # [ 38.911897] nix-grpc-daemon[849]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4483worker2 # [ 39.070740] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514484worker1 # [ 39.112954] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514485worker2 # [ 39.075696] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4486worker1 # [ 39.117848] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4487worker2 # [ 39.276683] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514488worker1 # [ 39.319641] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514489worker2 # [ 39.279353] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4490worker1 # [ 39.321376] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4491worker2 # [ 39.480024] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514492worker1 # [ 39.522668] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514493worker2 # [ 39.482730] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4494worker1 # [ 39.527865] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4495worker2 # [ 39.683806] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_connected addr=lb:500514496worker1 # [ 39.729371] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514497worker2 # [ 39.689250] nix-grpc-daemon[787]: ts=2026-09-20T08:16:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4498worker1 # [ 39.735198] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4499worker2 # [ 39.890169] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514500worker2 # [ 39.892915] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4501worker1 # [ 39.935726] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514502worker1 # [ 39.938301] nix-grpc-daemon[849]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4503worker2 # [ 40.094219] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514504worker1 # [ 40.139146] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514505worker1 # [ 40.141720] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4506worker2 # [ 40.100528] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4507worker1 # [ 40.343056] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514508worker1 # [ 40.345733] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4509worker2 # [ 40.304332] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514510worker2 # [ 40.307608] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4511worker2 # [ 40.505228] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_connected addr=lb:500514512worker1 # [ 40.547149] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514513worker2 # [ 40.508059] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4514worker1 # [ 40.552193] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4515worker2 # [ 40.711119] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514516worker1 # [ 40.753281] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514517worker1 # [ 40.758358] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4518worker2 # [ 40.716968] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4519worker1 # [ 40.959195] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514520worker2 # [ 40.918133] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514521worker1 # [ 40.962423] nix-grpc-daemon[849]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4522worker2 # [ 40.920780] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4523worker2 # [ 41.122276] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514524worker1 # [ 41.163924] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514525worker1 # [ 41.168884] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4526worker2 # [ 41.127958] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4527worker1 # [ 41.370773] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514528worker2 # [ 41.329755] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514529worker1 # [ 41.377138] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4530worker2 # [ 41.335436] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4531worker1 # [ 41.577908] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514532worker2 # [ 41.537107] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_connected addr=lb:500514533worker1 # [ 41.583454] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4534worker2 # [ 41.542348] nix-grpc-daemon[787]: ts=2026-09-20T08:16:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4535worker1 # [ 41.784598] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514536worker2 # [ 41.742407] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514537worker1 # [ 41.789639] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4538worker2 # [ 41.748400] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4539worker2 # [ 41.948673] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514540worker1 # [ 41.990713] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514541worker2 # [ 41.951095] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4542worker1 # [ 41.995732] nix-grpc-daemon[849]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4543worker2 # [ 42.152071] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514544worker1 # [ 42.196679] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514545worker2 # [ 42.155164] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4546worker1 # [ 42.199617] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4547worker2 # [ 42.357674] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514548worker1 # [ 42.403520] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514549worker1 # [ 42.405274] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4550worker2 # [ 42.362602] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4551worker1 # [ 42.603489] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514552worker2 # [ 42.563958] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_connected addr=lb:500514553worker1 # [ 42.610501] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4554worker2 # [ 42.568962] nix-grpc-daemon[787]: ts=2026-09-20T08:16:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4555worker2 # [ 42.769122] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514556worker1 # [ 42.811380] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514557worker2 # [ 42.772212] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4558worker1 # [ 42.814730] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4559worker1 # [ 43.015864] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514560worker2 # [ 42.973470] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514561worker1 # [ 43.019341] nix-grpc-daemon[849]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4562worker2 # [ 42.978681] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4563worker1 # [ 43.220453] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514564worker2 # [ 43.179819] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514565worker1 # [ 43.226222] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4566worker2 # [ 43.184693] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4567worker2 # [ 43.385900] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514568worker1 # [ 43.428490] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514569worker2 # [ 43.389166] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4570worker1 # [ 43.431378] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4571worker2 # [ 43.589842] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_connected addr=lb:500514572worker1 # [ 43.632442] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514573worker2 # [ 43.592488] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4574worker1 # [ 43.635681] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4575worker1 # [ 43.836545] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514576worker2 # [ 43.793605] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514577worker1 # [ 43.843368] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4578worker2 # [ 43.801677] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4579worker2 # [ 44.002253] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514580worker2 # [ 44.004719] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4581worker1 # [ 44.044814] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514582worker1 # [ 44.050089] nix-grpc-daemon[849]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4583worker2 # [ 44.205313] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514584worker2 # [ 44.207706] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4585worker1 # [ 44.252912] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514586worker1 # [ 44.257288] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4587worker2 # [ 44.408795] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514588worker2 # [ 44.411280] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4589worker1 # [ 44.459395] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514590worker1 # [ 44.463386] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4591worker2 # [ 44.612100] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_connected addr=lb:500514592worker2 # [ 44.615078] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4593worker1 # [ 44.662087] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514594worker1 # [ 44.666366] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4595worker2 # [ 44.816183] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514596worker1 # [ 44.863812] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514597worker2 # [ 44.821454] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4598worker1 # [ 44.867510] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4599worker2 # [ 45.021947] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514600worker2 # [ 45.024630] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4601worker1 # [ 45.068717] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514602worker1 # [ 45.071450] nix-grpc-daemon[849]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4603worker2 # [ 45.225738] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514604worker2 # [ 45.231577] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4605worker1 # [ 45.274952] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514606worker1 # [ 45.278511] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4607worker2 # [ 45.432106] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514608worker2 # [ 45.434292] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4609worker1 # [ 45.479376] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514610worker1 # [ 45.482531] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4611worker2 # [ 45.635272] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_connected addr=lb:500514612worker2 # [ 45.638222] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4613worker1 # [ 45.680096] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514614worker1 # [ 45.686129] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4615worker2 # [ 45.838762] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514616worker2 # [ 45.841297] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4617worker1 # [ 45.887097] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514618worker1 # [ 45.889803] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4619worker2 # [ 46.042078] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514620worker2 # [ 46.044615] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4621worker1 # [ 46.090622] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514622worker1 # [ 46.093641] nix-grpc-daemon[849]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4623worker2 # [ 46.245332] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514624worker2 # [ 46.247827] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4625worker1 # [ 46.294626] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514626worker1 # [ 46.297337] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4627lb # [ 46.304682] rustfs-bucket-start[1247]: mb s3://farm4628lb # [ 46.311396] systemd[1]: Finished rustfs-bucket.service.4629lb # [ 46.318607] systemd[1]: Starting niks3 server...4630worker2 # [ 46.450497] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514631worker2 # [ 46.454425] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4632worker1 # [ 46.501690] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514633worker1 # [ 46.504952] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4634lb # [ 46.547812] postgres[1261]: [1261] ERROR: relation "goose_db_version" does not exist at character 364635lb # [ 46.549138] postgres[1261]: [1261] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4636lb # [ 46.589993] niks3-server[1256]: 2026/09/20 08:16:09 OK 20241026095416_initial_model.sql (22.07ms)4637lb # [ 46.593789] niks3-server[1256]: 2026/09/20 08:16:09 OK 20251210153512_drop_unused_gin_index.sql (4.07ms)4638lb # [ 46.598877] niks3-server[1256]: 2026/09/20 08:16:09 OK 20251218171726_add_pins.sql (3.43ms)4639lb # [ 46.604498] niks3-server[1256]: 2026/09/20 08:16:09 OK 20260628120000_add_object_size_and_stats.sql (5.8ms)4640lb # [ 46.610048] niks3-server[1256]: 2026/09/20 08:16:09 OK 20260905000000_add_claims.sql (5.51ms)4641lb # [ 46.614502] niks3-server[1256]: 2026/09/20 08:16:09 OK 20260920000000_drop_claims.sql (4.53ms)4642lb # [ 46.615924] niks3-server[1256]: 2026/09/20 08:16:09 goose: successfully migrated database to version: 202609200000004643lb # [ 46.622258] niks3-server[1256]: 2026/09/20 08:16:09 OK 1_commit_pending_closure.sql (6.36ms)4644lb # [ 46.625031] niks3-server[1256]: 2026/09/20 08:16:09 OK 2_object_stats_trigger.sql (1.48ms)4645lb # [ 46.626351] niks3-server[1256]: 2026/09/20 08:16:09 goose: up to current file version: 24646lb # [ 46.633357] niks3-server[1256]: 2026/09/20 08:16:09 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4647worker2 # [ 46.655317] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_connected addr=lb:500514648worker2 # [ 46.660208] nix-grpc-daemon[787]: ts=2026-09-20T08:16:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4649worker1 # [ 46.701903] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514650worker1 # [ 46.707305] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4651lb # [ 46.728070] niks3-server[1256]: 2026/09/20 08:16:09 INFO Read proxy enabled — serving cache objects from S34652lb # [ 46.730056] niks3-server[1256]: 2026/09/20 08:16:09 INFO Using socket-activated listener address=0.0.0.0:57514653lb # [ 46.735605] niks3-server[1256]: 2026/09/20 08:16:09 INFO systemd watchdog enabled interval=15s4654lb # [ 46.736836] systemd[1]: Started niks3 server.4655lb # [ 46.737572] systemd[1]: Reached target Multi-User System.4656lb # [ 46.740188] systemd[1]: Startup finished in 916ms (kernel) + 5.026s (initrd) + 40.797s (userspace) = 46.739s.4657lb # [ 46.742157] niks3-server[1256]: 2026/09/20 08:16:09 INFO Starting HTTP server address=0.0.0.0:57514658lb # [ 46.748156] niks3-server[1256]: 2026/09/20 08:16:09 INFO lead: acquired remote=192.168.1.3:373884659worker1 # [ 46.788614] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_take_over4660worker2 # [ 46.860737] nix-grpc-daemon[787]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514661worker2 # [ 46.863173] nix-grpc-daemon[787]: ts=2026-09-20T08:16:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4662worker1 # [ 46.908612] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514663worker1 # [ 46.914495] nix-grpc-daemon[849]: ts=2026-09-20T08:16:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04664worker2 # [ 47.063831] nix-grpc-daemon[787]: ts=2026-09-20T08:16:09Z level=info event=scheduler_connected addr=lb:500514665worker1 # [ 47.108324] nix-grpc-daemon[849]: ts=2026-09-20T08:16:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04666lb: (finished: waiting for unit niks3.service, in 35.76 seconds)4667lb: waiting for TCP port 5751 on localhost4668lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4669lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)4670lb: waiting for unit envoy.service4671lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4672lb: waiting for TCP port 50051 on localhost4673lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4674lb # [ 48.001843] envoy[997]: conn peer=[::1]:33688 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34675lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4676lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4677lb: must succeed: curl -sf localhost:9901/clusters4678lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4679lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4680subtest: one node schedules and both builders hold a WorkerSession on it4681lb: must succeed: curl -sf localhost:9901/clusters4682lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4683worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4684worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4685(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.13 seconds)4686subtest: balancer auth: client cert, bearer token, nothing, unknown CN4687worker2 # [ 48.630790] nix-grpc-daemon[787]: ts=2026-09-20T08:16:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:407044688worker2 # [ 48.636655] systemd[1]: Started Nix Daemon.4689worker2 # [ 48.802727] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4690worker2 # [ 48.842026] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 1/5)4691worker2 # [ 48.910843] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 2/5)4692worker2 # [ 48.988554] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 239 ms (attempt 3/5)4693worker2 # [ 49.232757] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 794 ms (attempt 4/5)4694worker2 # [ 50.033346] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4695worker2 # [ 50.063144] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407044696worker2 # [ 50.080463] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4697worker2 # [ 50.089551] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407044698worker2 # [ 50.098140] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4699client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4700client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)4701client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4702client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4703lb # [ 50.506183] envoy[997]: conn peer=[2001:db8:1::1]:60424 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=15194704worker1 # [ 50.587078] nix-grpc-daemon[849]: ts=2026-09-20T08:16:13Z level=info event=oidc_jwks provider=mock keys=14705worker1 # [ 50.590795] nix-grpc-daemon[849]: ts=2026-09-20T08:16:13Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:417704706worker1 # [ 50.607794] systemd[1]: Started Nix Daemon.4707worker1 # [ 50.864643] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4708worker1 # [ 50.903376] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 1/5)4709worker1 # [ 50.976689] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5)4710worker1 # [ 50.987445] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 328 ms (attempt 3/5)4711worker1 # [ 51.321793] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 4/5)4712worker1 # [ 51.438749] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4713worker1 # [ 51.465577] nix-grpc-daemon[849]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:417704714worker1 # [ 51.484802] nix-grpc-daemon[849]: ts=2026-09-20T08:16:14Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4715worker2 # [ 51.460618] nix-grpc-daemon[787]: ts=2026-09-20T08:16:13Z level=info event=oidc_jwks provider=mock keys=14716worker2 # [ 51.464699] nix-grpc-daemon[787]: ts=2026-09-20T08:16:13Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:407044717worker2 # [ 51.472410] nix-grpc-daemon[787]: ts=2026-09-20T08:16:13Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4718client: must succeed: rm -r /var/lib/nix-grpc-store4719client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4720worker2 # [ 51.736846] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=info event=denied method=QueryMissing cn=- role=none4721worker2 # [ 51.994281] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=info event=denied method=QueryMissing cn=stranger role=none4722(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.68 seconds)4723subtest: DAG build is scheduled across workers and lands in the cache4724client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24725worker2 # [ 52.240111] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:407044726client # don't know how to build these paths:4727client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4728worker1 # [ 52.309380] nix-grpc-daemon[849]: ts=2026-09-20T08:16:15Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04729worker1 # [ 52.311620] nix-grpc-daemon[849]: ts=2026-09-20T08:16:15Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14730worker1 # [ 52.355625] nix-grpc-daemon[849]: ts=2026-09-20T08:16:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417704731worker1 # [ 52.369985] nix-grpc-daemon[849]: ts=2026-09-20T08:16:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417704732client # copying 1 paths to 'lb:50051'...4733worker1 # [ 52.377527] nix-grpc-daemon[849]: ts=2026-09-20T08:16:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417704734client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4735worker1 # [ 52.394199] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4736worker1 # [ 52.414558] nix-grpc-daemon[849]: ts=2026-09-20T08:16:15Z level=info event=niks3_push_started pid=9284737worker1 # [ 52.894515] nix-daemon[917]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4738worker1 # [ 52.914565] nix-daemon[917]: reaped child process 943, status = succeeded4739worker1 # [ 53.087460] nix-daemon[917]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4740worker1 # [ 53.102361] nix-daemon[917]: reaped child process 948, status = succeeded4741lb # [ 53.082516] niks3-server[1256]: 2026/09/20 08:16:15 INFO Received uploads request method=POST path=/api/pending_closures4742worker1 # [ 53.541564] nix-grpc-daemon[928]: time=2026-09-20T08:16:16.431Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4743worker1 # [ 53.543886] nix-grpc-daemon[928]: time=2026-09-20T08:16:16.433Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4744lb # [ 53.562911] niks3-server[1256]: 2026/09/20 08:16:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4745lb # [ 53.579550] niks3-server[1256]: 2026/09/20 08:16:16 INFO Signed narinfos id=1 count=14746worker1 # [ 53.617286] nix-grpc-daemon[928]: time=2026-09-20T08:16:16.509Z level=INFO msg="Uploading 1 narinfos"4747lb # [ 53.596502] niks3-server[1256]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4748lb # [ 53.600133] niks3-server[1256]: 2026/09/20 08:16:16 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4749lb # [ 53.607784] niks3-server[1256]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4750lb # [ 53.637295] niks3-server[1256]: 2026/09/20 08:16:16 INFO Completed upload id=14751worker1 # [ 53.673392] nix-grpc-daemon[928]: time=2026-09-20T08:16:16.565Z level=INFO msg="Upload complete. (968ms)"4752worker1 # [ 53.679788] nix-grpc-daemon[849]: ts=2026-09-20T08:16:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 paths=1 nar_bytes_in=5044753worker1 # [ 53.688372] nix-grpc-daemon[849]: ts=2026-09-20T08:16:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417704754lb # [ 53.657451] niks3-server[1256]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4755worker1 # [ 53.700897] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4756worker1 # [ 53.718266] nix-daemon[917]: reaped child process 926, status = succeeded4757client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4758worker1 # [ 53.725099] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4759client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4760client # farm-a> LOG-farm-a-t14761worker1 # [ 54.541995] nix-daemon[917]: reaped child process 952, status = succeeded4762worker1 # [ 54.696108] nix-daemon[917]: accepted connection from pid 967, user nix-grpc-daemon (trusted)4763worker1 # [ 54.710060] nix-daemon[917]: reaped child process 970, status = succeeded4764lb # [ 54.685838] niks3-server[1256]: 2026/09/20 08:16:17 INFO Received uploads request method=POST path=/api/pending_closures4765worker1 # [ 54.848293] nix-grpc-daemon[928]: time=2026-09-20T08:16:17.739Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4766worker1 # [ 54.853907] nix-grpc-daemon[928]: time=2026-09-20T08:16:17.743Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4767lb # [ 54.867671] niks3-server[1256]: 2026/09/20 08:16:17 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4768lb # [ 54.877513] niks3-server[1256]: 2026/09/20 08:16:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4769lb # [ 54.884330] niks3-server[1256]: 2026/09/20 08:16:17 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4770lb # [ 54.888227] niks3-server[1256]: 2026/09/20 08:16:17 INFO Signed narinfos id=2 count=14771worker1 # [ 54.927167] nix-grpc-daemon[928]: time=2026-09-20T08:16:17.818Z level=INFO msg="Uploading 1 narinfos"4772lb # [ 54.897347] niks3-server[1256]: 2026/09/20 08:16:17 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4773lb # [ 54.908353] niks3-server[1256]: 2026/09/20 08:16:17 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4774lb # [ 54.914393] niks3-server[1256]: 2026/09/20 08:16:17 INFO Completed upload id=24775lb # [ 54.917118] niks3-server[1256]: 2026/09/20 08:16:17 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4776worker1 # [ 54.948375] nix-grpc-daemon[928]: time=2026-09-20T08:16:17.840Z level=INFO msg="Upload complete. (409ms)"4777worker1 # [ 54.958418] nix-grpc-daemon[849]: ts=2026-09-20T08:16:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14778worker1 # [ 54.978651] nix-grpc-daemon[849]: ts=2026-09-20T08:16:17Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04779worker1 # [ 54.980962] nix-grpc-daemon[849]: ts=2026-09-20T08:16:17Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14780worker1 # [ 54.988325] nix-daemon[917]: reaped child process 950, status = succeeded4781worker1 # [ 55.028473] nix-grpc-daemon[849]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417704782worker1 # [ 55.039655] nix-grpc-daemon[849]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417704783worker1 # [ 55.050202] nix-grpc-daemon[928]: time=2026-09-20T08:16:17.942Z level=INFO msg="All 1 paths already cached"4784client # copying 1 paths to 'lb:50051'...4785worker1 # [ 55.057796] nix-grpc-daemon[849]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417704786client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4787worker1 # [ 55.079165] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4788worker1 # [ 55.244620] nix-daemon[917]: accepted connection from pid 976, user nix-grpc-daemon (trusted)4789worker1 # [ 55.260475] nix-daemon[917]: reaped child process 979, status = succeeded4790worker1 # [ 55.406595] nix-daemon[917]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4791worker1 # [ 55.421104] nix-daemon[917]: reaped child process 985, status = succeeded4792lb # [ 55.400544] niks3-server[1256]: 2026/09/20 08:16:17 INFO Received uploads request method=POST path=/api/pending_closures4793worker1 # [ 55.537321] nix-grpc-daemon[928]: time=2026-09-20T08:16:18.428Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4794worker1 # [ 55.540728] nix-grpc-daemon[928]: time=2026-09-20T08:16:18.429Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4795lb # [ 55.536401] niks3-server[1256]: 2026/09/20 08:16:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4796worker1 # [ 55.578128] nix-grpc-daemon[928]: time=2026-09-20T08:16:18.469Z level=INFO msg="Uploading 1 narinfos"4797lb # [ 55.543706] niks3-server[1256]: 2026/09/20 08:16:18 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4798lb # [ 55.547905] niks3-server[1256]: 2026/09/20 08:16:18 INFO Signed narinfos id=3 count=14799lb # [ 55.561565] niks3-server[1256]: 2026/09/20 08:16:18 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4800lb # [ 55.566501] niks3-server[1256]: 2026/09/20 08:16:18 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4801lb # [ 55.579324] niks3-server[1256]: 2026/09/20 08:16:18 INFO Completed upload id=34802worker1 # [ 55.612967] nix-grpc-daemon[928]: time=2026-09-20T08:16:18.504Z level=INFO msg="Upload complete. (519ms)"4803worker1 # [ 55.618149] nix-grpc-daemon[849]: ts=2026-09-20T08:16:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_in=6244804lb # [ 55.588240] niks3-server[1256]: 2026/09/20 08:16:18 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4805worker1 # [ 55.624394] nix-grpc-daemon[849]: ts=2026-09-20T08:16:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417704806worker1 # [ 55.637143] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4807worker1 # [ 55.652746] nix-daemon[917]: reaped child process 974, status = succeeded4808client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4809worker1 # [ 55.658520] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4810client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4811client # farm-b> LOG-farm-b-t14812worker1 # [ 56.490193] nix-daemon[917]: reaped child process 989, status = succeeded4813worker1 # [ 56.647107] nix-daemon[917]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4814worker1 # [ 56.659710] nix-daemon[917]: reaped child process 1007, status = succeeded4815lb # [ 56.641534] niks3-server[1256]: 2026/09/20 08:16:19 INFO Received uploads request method=POST path=/api/pending_closures4816worker1 # [ 56.687543] nix-grpc-daemon[928]: time=2026-09-20T08:16:19.579Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4817worker1 # [ 56.689846] nix-grpc-daemon[928]: time=2026-09-20T08:16:19.581Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4818lb # [ 56.669705] niks3-server[1256]: 2026/09/20 08:16:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4819lb # [ 56.672207] niks3-server[1256]: 2026/09/20 08:16:19 INFO Signed narinfos id=4 count=14820worker1 # [ 56.706494] nix-grpc-daemon[928]: time=2026-09-20T08:16:19.598Z level=INFO msg="Uploading 1 narinfos"4821lb # [ 56.674766] niks3-server[1256]: 2026/09/20 08:16:19 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4822lb # [ 56.679520] niks3-server[1256]: 2026/09/20 08:16:19 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4823lb # [ 56.682891] niks3-server[1256]: 2026/09/20 08:16:19 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4824lb # [ 56.686707] niks3-server[1256]: 2026/09/20 08:16:19 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4825lb # [ 56.690489] niks3-server[1256]: 2026/09/20 08:16:19 INFO Completed upload id=44826worker1 # [ 56.725519] nix-grpc-daemon[928]: time=2026-09-20T08:16:19.617Z level=INFO msg="Upload complete. (255ms)"4827lb # [ 56.692115] niks3-server[1256]: 2026/09/20 08:16:19 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4828worker1 # [ 56.728480] nix-grpc-daemon[849]: ts=2026-09-20T08:16:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14829worker1 # [ 56.735098] nix-grpc-daemon[849]: ts=2026-09-20T08:16:19Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04830worker1 # [ 56.737917] nix-grpc-daemon[849]: ts=2026-09-20T08:16:19Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14831worker1 # [ 56.739715] nix-grpc-daemon[849]: ts=2026-09-20T08:16:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417704832worker1 # [ 56.745166] nix-daemon[917]: reaped child process 987, status = succeeded4833worker1 # [ 56.747090] nix-grpc-daemon[849]: ts=2026-09-20T08:16:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417704834worker1 # [ 57.136926] nix-grpc-daemon[928]: time=2026-09-20T08:16:20.028Z level=INFO msg="All 2 paths already cached"4835client # copying 1 paths to 'lb:50051'...4836worker1 # [ 57.145473] nix-grpc-daemon[849]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417704837client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4838worker1 # [ 57.165219] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4839worker1 # [ 57.324767] nix-daemon[917]: accepted connection from pid 1013, user nix-grpc-daemon (trusted)4840worker1 # [ 57.337872] nix-daemon[917]: reaped child process 1016, status = succeeded4841worker1 # [ 57.459615] nix-daemon[917]: accepted connection from pid 1018, user nix-grpc-daemon (trusted)4842worker1 # [ 57.472591] nix-daemon[917]: reaped child process 1021, status = succeeded4843lb # [ 57.455496] niks3-server[1256]: 2026/09/20 08:16:19 INFO Received uploads request method=POST path=/api/pending_closures4844worker1 # [ 57.493599] nix-grpc-daemon[928]: time=2026-09-20T08:16:20.385Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4845worker1 # [ 57.495436] nix-grpc-daemon[928]: time=2026-09-20T08:16:20.387Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4846lb # [ 57.472450] niks3-server[1256]: 2026/09/20 08:16:19 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4847lb # [ 57.475728] niks3-server[1256]: 2026/09/20 08:16:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4848lb # [ 57.477855] niks3-server[1256]: 2026/09/20 08:16:20 INFO Signed narinfos id=5 count=14849worker1 # [ 57.513139] nix-grpc-daemon[928]: time=2026-09-20T08:16:20.405Z level=INFO msg="Uploading 1 narinfos"4850lb # [ 57.481637] niks3-server[1256]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4851lb # [ 57.487334] niks3-server[1256]: 2026/09/20 08:16:20 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4852lb # [ 57.489898] niks3-server[1256]: 2026/09/20 08:16:20 INFO Completed upload id=54853worker1 # [ 57.524903] nix-grpc-daemon[928]: time=2026-09-20T08:16:20.417Z level=INFO msg="Upload complete. (346ms)"4854lb # [ 57.492579] niks3-server[1256]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4855worker1 # [ 57.526926] nix-grpc-daemon[849]: ts=2026-09-20T08:16:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_in=7524856worker1 # [ 57.531148] nix-grpc-daemon[849]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417704857worker1 # [ 57.537322] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4858worker1 # [ 57.539659] nix-daemon[917]: reaped child process 1011, status = succeeded4859client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4860client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4861worker1 # [ 57.545148] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)4862client # farm-top> LOG-farm-top-t14863worker1 # [ 58.567943] nix-daemon[917]: reaped child process 1025, status = succeeded4864worker1 # [ 58.682511] nix-daemon[917]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4865worker1 # [ 58.695038] nix-daemon[917]: reaped child process 1043, status = succeeded4866lb # [ 58.673245] niks3-server[1256]: 2026/09/20 08:16:21 INFO Received uploads request method=POST path=/api/pending_closures4867worker1 # [ 58.711844] nix-grpc-daemon[928]: time=2026-09-20T08:16:21.603Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4868worker1 # [ 58.713393] nix-grpc-daemon[928]: time=2026-09-20T08:16:21.605Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4869lb # [ 58.692262] niks3-server[1256]: 2026/09/20 08:16:21 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4870lb # [ 58.695588] niks3-server[1256]: 2026/09/20 08:16:21 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4871lb # [ 58.699482] niks3-server[1256]: 2026/09/20 08:16:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4872lb # [ 58.701155] niks3-server[1256]: 2026/09/20 08:16:21 INFO Signed narinfos id=6 count=14873worker1 # [ 58.735259] nix-grpc-daemon[928]: time=2026-09-20T08:16:21.627Z level=INFO msg="Uploading 1 narinfos"4874lb # [ 58.705308] niks3-server[1256]: 2026/09/20 08:16:21 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4875lb # [ 58.709412] niks3-server[1256]: 2026/09/20 08:16:21 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4876lb # [ 58.712518] niks3-server[1256]: 2026/09/20 08:16:21 INFO Completed upload id=64877worker1 # [ 58.746210] nix-grpc-daemon[928]: time=2026-09-20T08:16:21.638Z level=INFO msg="Upload complete. (193ms)"4878lb # [ 58.714153] niks3-server[1256]: 2026/09/20 08:16:21 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4879worker1 # [ 58.748493] nix-grpc-daemon[849]: ts=2026-09-20T08:16:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14880worker1 # [ 58.755576] nix-daemon[917]: reaped child process 1023, status = succeeded4881client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.72 seconds)4882client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4883client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4884client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4885client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4886client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4887client # copying 3 paths...4888client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4889client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4890client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4891client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4892(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.23 seconds)4893subtest: repeat is answered Cached by the scheduler without building4894worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4895worker1 # finding garbage collector roots...4896worker1 # deleting specified paths...4897worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4898worker1 # deleting unused links...4899worker1 # note: hard linking is currently saving 0.0 KiB4900worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4901worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4902worker2 # finding garbage collector roots...4903worker2 # deleting specified paths...4904worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4905worker2 # deleting unused links...4906worker2 # note: hard linking is currently saving 0.0 KiB4907worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4908client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24909worker1 # [ 60.017515] nix-grpc-daemon[849]: ts=2026-09-20T08:16:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417704910client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4911client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4912worker1 # [ 60.043388] nix-grpc-daemon[849]: ts=2026-09-20T08:16:22Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14913worker1 # [ 60.054397] nix-grpc-daemon[849]: ts=2026-09-20T08:16:22Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14914worker1 # [ 60.065774] nix-grpc-daemon[849]: ts=2026-09-20T08:16:22Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14915client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.29 seconds)4916client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4917client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4918lb: must succeed: curl -sf localhost:9901/clusters4919lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4920lb: must succeed: curl -sf localhost:9901/clusters4921lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4922worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4923worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.07 seconds)4924(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.23 seconds)4925subtest: two clients wanting the same drv build it once4926client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4927lb # [ 60.505800] envoy[997]: conn peer=[2001:db8:1::1]:60430 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=9844928lb # [ 60.509532] envoy[997]: conn peer=[2001:db8:1::1]:60438 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=144929lb # [ 60.512956] envoy[997]: conn peer=[2001:db8:1::1]:60454 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=104930lb # [ 60.516766] envoy[997]: conn peer=[2001:db8:1::1]:60458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9342 tx=3780 ms=65004931lb # [ 60.520341] envoy[997]: conn peer=[2001:db8:1::1]:43798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=624932client # [ 60.550345] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4933client # Running as unit: dedup1.service; invocation ID: 31ad1970ba934bceaec7b1138082daf74934client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.08 seconds)4935client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4936worker1 # [ 60.791459] nix-grpc-daemon[849]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417704937client # [ 60.765505] nix[871]: don't know how to build these paths:4938client # [ 60.766461] nix[871]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4939worker1 # [ 60.804559] nix-grpc-daemon[849]: ts=2026-09-20T08:16:23Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04940worker2 # [ 60.766206] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407044941worker1 # [ 60.808931] nix-grpc-daemon[849]: ts=2026-09-20T08:16:23Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14942worker2 # [ 60.777158] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407044943client # [ 60.794072] nix[871]: copying 1 paths to 'lb:50051'...4944worker2 # [ 60.784129] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407044945client # [ 60.795817] nix[871]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4946worker2 # [ 60.792578] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4947worker2 # [ 60.804458] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=niks3_push_started pid=8724948worker2 # [ 61.225087] nix-daemon[850]: accepted connection from pid 884, user nix-grpc-daemon (trusted)4949worker2 # [ 61.239609] nix-daemon[850]: reaped child process 887, status = succeeded4950worker2 # [ 61.370176] nix-daemon[850]: accepted connection from pid 889, user nix-grpc-daemon (trusted)4951worker2 # [ 61.382531] nix-daemon[850]: reaped child process 892, status = succeeded4952lb # [ 61.405703] niks3-server[1256]: 2026/09/20 08:16:23 INFO Received uploads request method=POST path=/api/pending_closures4953worker2 # [ 61.408656] nix-grpc-daemon[872]: time=2026-09-20T08:16:23.698Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4954worker2 # [ 61.411357] nix-grpc-daemon[872]: time=2026-09-20T08:16:23.701Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4955lb # [ 61.443586] niks3-server[1256]: 2026/09/20 08:16:23 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4956lb # [ 61.456127] niks3-server[1256]: 2026/09/20 08:16:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4957lb # [ 61.462413] niks3-server[1256]: 2026/09/20 08:16:23 INFO Signed narinfos id=7 count=14958worker2 # [ 61.458358] nix-grpc-daemon[872]: time=2026-09-20T08:16:23.749Z level=INFO msg="Uploading 1 narinfos"4959lb # [ 61.471037] niks3-server[1256]: 2026/09/20 08:16:23 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4960lb # [ 61.481265] niks3-server[1256]: 2026/09/20 08:16:24 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4961lb # [ 61.490596] niks3-server[1256]: 2026/09/20 08:16:24 INFO Completed upload id=74962worker2 # [ 61.483057] nix-grpc-daemon[872]: time=2026-09-20T08:16:23.774Z level=INFO msg="Upload complete. (431ms)"4963lb # [ 61.492136] niks3-server[1256]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4964worker2 # [ 61.488180] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=0 paths=1 nar_bytes_in=4324965worker2 # [ 61.492802] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407044966worker2 # [ 61.500545] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4967worker2 # [ 61.503427] nix-daemon[850]: reaped child process 870, status = succeeded4968worker2 # [ 61.509408] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4969client # [ 61.517708] nix[871]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4970client # [ 61.633895] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4971client # Running as unit: dedup2.service; invocation ID: d48b3ad1cb424a4b88ba14e6bde7fdda4972client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4973client # [ 61.901452] nix[887]: don't know how to build these paths:4974worker1 # [ 61.931667] nix-grpc-daemon[849]: ts=2026-09-20T08:16:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417704975client # [ 61.902363] nix[887]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4976worker1 # [ 61.945146] nix-grpc-daemon[849]: ts=2026-09-20T08:16:24Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04977worker2 # [ 61.906316] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407044978client # [ 61.920522] nix[887]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4979client: must succeed: sleep 24980client: (finished: must succeed: sleep 2, in 2.03 seconds)4981client: waiting for success: ! systemctl is-active dedup1 dedup24982worker2 # [ 65.126535] nix-daemon[850]: reaped child process 896, status = succeeded4983worker2 # [ 65.254398] nix-daemon[850]: accepted connection from pid 925, user nix-grpc-daemon (trusted)4984worker2 # [ 65.266130] nix-daemon[850]: reaped child process 928, status = succeeded4985lb # [ 65.288728] niks3-server[1256]: 2026/09/20 08:16:27 INFO Received uploads request method=POST path=/api/pending_closures4986worker2 # [ 65.286036] nix-grpc-daemon[872]: time=2026-09-20T08:16:27.577Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4987worker2 # [ 65.287690] nix-grpc-daemon[872]: time=2026-09-20T08:16:27.579Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4988lb # [ 65.315616] niks3-server[1256]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4989lb # [ 65.320634] niks3-server[1256]: 2026/09/20 08:16:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4990lb # [ 65.323052] niks3-server[1256]: 2026/09/20 08:16:27 INFO Signed narinfos id=8 count=14991worker2 # [ 65.318025] nix-grpc-daemon[872]: time=2026-09-20T08:16:27.608Z level=INFO msg="Uploading 1 narinfos"4992lb # [ 65.325496] niks3-server[1256]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4993lb # [ 65.332285] niks3-server[1256]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4994lb # [ 65.335207] niks3-server[1256]: 2026/09/20 08:16:27 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4995lb # [ 65.338031] niks3-server[1256]: 2026/09/20 08:16:27 INFO Completed upload id=84996worker2 # [ 65.331394] nix-grpc-daemon[872]: time=2026-09-20T08:16:27.622Z level=INFO msg="Upload complete. (210ms)"4997lb # [ 65.339460] niks3-server[1256]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4998worker2 # [ 65.334320] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14999worker2 # [ 65.338129] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=15000worker2 # [ 65.343365] nix-daemon[850]: reaped child process 894, status = succeeded5001client # [ 65.396558] systemd[1]: dedup1.service: Deactivated successfully.5002client # [ 65.400181] systemd[1]: dedup1.service: Consumed 122ms CPU time over 4.849s wall clock time, 37.3M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5003client # [ 65.406421] systemd[1]: dedup2.service: Deactivated successfully.5004client # [ 65.408326] systemd[1]: dedup2.service: Consumed 147ms CPU time over 3.772s wall clock time, 33.2M memory peak, 7.5K incoming IP traffic, 6.4K outgoing IP traffic.5005client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds)5006client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }5007client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)5008worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true5009worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)5010worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true5011worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)5012worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true5013worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)5014worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true5015worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.04 seconds)5016(finished: subtest: two clients wanting the same drv build it once, in 5.83 seconds)5017subtest: build hook: nix-daemon with builders = grpc://lb5018client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log5019client # [ 66.492969] systemd[1]: Started Nix Daemon.5020client # [ 66.645664] nix-daemon[929]: accepted connection from pid 926, user root (trusted)5021worker2 # [ 66.794787] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:407045022worker2 # [ 66.803300] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407045023worker1 # [ 66.861888] nix-grpc-daemon[849]: ts=2026-09-20T08:16:29Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=05024worker1 # [ 66.867446] nix-grpc-daemon[849]: ts=2026-09-20T08:16:29Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=15025worker1 # [ 66.872098] nix-grpc-daemon[849]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705026worker1 # [ 66.879334] nix-grpc-daemon[849]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417705027worker1 # [ 66.890216] nix-grpc-daemon[849]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417705028worker1 # [ 66.900566] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5029worker1 # [ 67.078562] nix-daemon[917]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)5030worker1 # [ 67.095061] nix-daemon[917]: reaped child process 1103, status = succeeded5031worker1 # [ 67.246646] nix-daemon[917]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)5032worker1 # [ 67.260203] nix-daemon[917]: reaped child process 1108, status = succeeded5033lb # [ 67.237408] niks3-server[1256]: 2026/09/20 08:16:29 INFO Received uploads request method=POST path=/api/pending_closures5034worker1 # [ 67.290926] nix-grpc-daemon[928]: time=2026-09-20T08:16:30.182Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5035worker1 # [ 67.292357] nix-grpc-daemon[928]: time=2026-09-20T08:16:30.182Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"5036lb # [ 67.278937] niks3-server[1256]: 2026/09/20 08:16:29 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst5037lb # [ 67.288494] niks3-server[1256]: 2026/09/20 08:16:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign5038worker1 # [ 67.327776] nix-grpc-daemon[928]: time=2026-09-20T08:16:30.219Z level=INFO msg="Uploading 1 narinfos"5039lb # [ 67.293914] niks3-server[1256]: 2026/09/20 08:16:29 INFO Signed narinfos id=9 count=15040lb # [ 67.299768] niks3-server[1256]: 2026/09/20 08:16:29 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls5041lb # [ 67.308639] niks3-server[1256]: 2026/09/20 08:16:29 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete5042lb # [ 67.315763] niks3-server[1256]: 2026/09/20 08:16:29 INFO Completed upload id=95043worker1 # [ 67.349764] nix-grpc-daemon[928]: time=2026-09-20T08:16:30.241Z level=INFO msg="Upload complete. (437ms)"5044lb # [ 67.320880] niks3-server[1256]: 2026/09/20 08:16:29 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo5045worker1 # [ 67.353529] nix-grpc-daemon[849]: ts=2026-09-20T08:16:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_in=5125046worker1 # [ 67.359777] nix-grpc-daemon[849]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705047worker1 # [ 67.370141] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5048worker1 # [ 67.373847] nix-daemon[917]: reaped child process 1098, status = succeeded5049worker1 # [ 67.379056] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5050worker1 # [ 68.593900] nix-daemon[917]: reaped child process 1112, status = succeeded5051worker1 # [ 68.730741] nix-daemon[917]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)5052worker1 # [ 68.742838] nix-daemon[917]: reaped child process 1130, status = succeeded5053lb # [ 68.725489] niks3-server[1256]: 2026/09/20 08:16:31 INFO Received uploads request method=POST path=/api/pending_closures5054worker1 # [ 68.763705] nix-grpc-daemon[928]: time=2026-09-20T08:16:31.655Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5055worker1 # [ 68.765362] nix-grpc-daemon[928]: time=2026-09-20T08:16:31.657Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"5056lb # [ 68.769857] niks3-server[1256]: 2026/09/20 08:16:31 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst5057lb # [ 68.774359] niks3-server[1256]: 2026/09/20 08:16:31 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv5058lb # [ 68.782105] niks3-server[1256]: 2026/09/20 08:16:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign5059lb # [ 68.787157] niks3-server[1256]: 2026/09/20 08:16:31 INFO Signed narinfos id=10 count=15060worker1 # [ 68.824023] nix-grpc-daemon[928]: time=2026-09-20T08:16:31.715Z level=INFO msg="Uploading 1 narinfos"5061lb # [ 68.790263] niks3-server[1256]: 2026/09/20 08:16:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls5062lb # [ 68.800462] niks3-server[1256]: 2026/09/20 08:16:31 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete5063lb # [ 68.807177] niks3-server[1256]: 2026/09/20 08:16:31 INFO Completed upload id=105064worker1 # [ 68.841112] nix-grpc-daemon[928]: time=2026-09-20T08:16:31.733Z level=INFO msg="Upload complete. (254ms)"5065lb # [ 68.809052] niks3-server[1256]: 2026/09/20 08:16:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo5066worker1 # [ 68.847457] nix-grpc-daemon[849]: ts=2026-09-20T08:16:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=15067worker2 # [ 68.814826] nix-grpc-daemon[787]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407045068worker1 # [ 68.858429] nix-daemon[917]: reaped child process 1110, status = succeeded5069worker2 # [ 68.827333] nix-grpc-daemon[787]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...5070worker1 # [ 68.906785] nix-grpc-daemon[849]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:417705071worker1 # [ 68.912624] nix-grpc-daemon[849]: ts=2026-09-20T08:16:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_out=1285072worker1 # [ 69.141086] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417705073worker2 # [ 69.102297] nix-grpc-daemon[787]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407045074worker2 # [ 69.108539] nix-grpc-daemon[872]: time=2026-09-20T08:16:31.399Z level=INFO msg="All 1 paths already cached"5075worker1 # [ 69.162255] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=05076worker1 # [ 69.167619] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=15077worker1 # [ 69.173561] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705078worker1 # [ 69.185122] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417705079worker1 # [ 69.199275] nix-grpc-daemon[928]: time=2026-09-20T08:16:32.091Z level=INFO msg="All 1 paths already cached"5080worker1 # [ 69.206196] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417705081worker1 # [ 69.216140] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5082worker1 # [ 69.374454] nix-daemon[917]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)5083worker1 # [ 69.389443] nix-daemon[917]: reaped child process 1139, status = succeeded5084worker1 # [ 69.543993] nix-daemon[917]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)5085worker1 # [ 69.556920] nix-daemon[917]: reaped child process 1144, status = succeeded5086lb # [ 69.538252] niks3-server[1256]: 2026/09/20 08:16:32 INFO Received uploads request method=POST path=/api/pending_closures5087worker1 # [ 69.580604] nix-grpc-daemon[928]: time=2026-09-20T08:16:32.472Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5088worker1 # [ 69.582562] nix-grpc-daemon[928]: time=2026-09-20T08:16:32.474Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"5089lb # [ 69.566564] niks3-server[1256]: 2026/09/20 08:16:32 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst5090lb # [ 69.578881] niks3-server[1256]: 2026/09/20 08:16:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign5091lb # [ 69.583939] niks3-server[1256]: 2026/09/20 08:16:32 INFO Signed narinfos id=11 count=15092worker1 # [ 69.622143] nix-grpc-daemon[928]: time=2026-09-20T08:16:32.514Z level=INFO msg="Uploading 1 narinfos"5093lb # [ 69.590168] niks3-server[1256]: 2026/09/20 08:16:32 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls5094lb # [ 69.602444] niks3-server[1256]: 2026/09/20 08:16:32 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete5095lb # [ 69.609208] niks3-server[1256]: 2026/09/20 08:16:32 INFO Completed upload id=115096worker1 # [ 69.643187] nix-grpc-daemon[928]: time=2026-09-20T08:16:32.535Z level=INFO msg="Upload complete. (415ms)"5097lb # [ 69.611829] niks3-server[1256]: 2026/09/20 08:16:32 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo5098worker1 # [ 69.648129] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_in=6245099worker1 # [ 69.653272] nix-grpc-daemon[849]: ts=2026-09-20T08:16:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705100worker1 # [ 69.666233] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5101worker1 # [ 69.667907] nix-daemon[917]: reaped child process 1134, status = succeeded5102worker1 # [ 69.673536] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5103lb # [ 70.505692] envoy[997]: conn peer=[2001:db8:1::1]:43800 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2968 tx=1329 ms=46015104lb # [ 70.507465] envoy[997]: conn peer=[2001:db8:1::1]:43806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=34685105lb # [ 70.509164] envoy[997]: conn peer=[2001:db8:1::1]:56350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3408 tx=1749 ms=20915106lb # [ 70.510797] envoy[997]: conn peer=[2001:db8:1::1]:56360 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=235107worker1 # [ 70.701918] nix-daemon[917]: reaped child process 1148, status = succeeded5108worker1 # [ 70.835440] nix-daemon[917]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5109worker1 # [ 70.848714] nix-daemon[917]: reaped child process 1166, status = succeeded5110lb # [ 70.826923] niks3-server[1256]: 2026/09/20 08:16:33 INFO Received uploads request method=POST path=/api/pending_closures5111worker1 # [ 70.871521] nix-grpc-daemon[928]: time=2026-09-20T08:16:33.763Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5112worker1 # [ 70.872979] nix-grpc-daemon[928]: time=2026-09-20T08:16:33.765Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"5113lb # [ 70.874764] niks3-server[1256]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst5114lb # [ 70.881958] niks3-server[1256]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv5115lb # [ 70.887686] niks3-server[1256]: 2026/09/20 08:16:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign5116worker1 # [ 70.927891] nix-grpc-daemon[928]: time=2026-09-20T08:16:33.819Z level=INFO msg="Uploading 1 narinfos"5117lb # [ 70.893984] niks3-server[1256]: 2026/09/20 08:16:33 INFO Signed narinfos id=12 count=15118lb # [ 70.896401] niks3-server[1256]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls5119lb # [ 70.905857] niks3-server[1256]: 2026/09/20 08:16:33 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete5120lb # [ 70.908649] niks3-server[1256]: 2026/09/20 08:16:33 INFO Completed upload id=125121worker1 # [ 70.942626] nix-grpc-daemon[928]: time=2026-09-20T08:16:33.834Z level=INFO msg="Upload complete. (261ms)"5122lb # [ 70.911031] niks3-server[1256]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo5123worker1 # [ 70.948342] nix-grpc-daemon[849]: ts=2026-09-20T08:16:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=15124worker1 # [ 70.960545] nix-daemon[917]: reaped child process 1146, status = succeeded5125worker2 # [ 70.951659] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407045126worker2 # [ 70.963209] nix-grpc-daemon[787]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...5127worker1 # [ 71.030463] nix-grpc-daemon[849]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:417705128worker1 # [ 71.035572] nix-grpc-daemon[849]: ts=2026-09-20T08:16:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_out=1765129worker2 # [ 71.189503] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:407045130worker1 # [ 71.236659] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417705131worker1 # [ 71.245918] nix-grpc-daemon[928]: time=2026-09-20T08:16:34.137Z level=INFO msg="All 2 paths already cached"5132worker1 # [ 71.261076] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=05133worker1 # [ 71.267529] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=15134worker1 # [ 71.272269] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705135worker1 # [ 71.284273] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417705136worker1 # [ 71.297522] nix-grpc-daemon[928]: time=2026-09-20T08:16:34.189Z level=INFO msg="All 2 paths already cached"5137worker1 # [ 71.305380] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417705138worker1 # [ 71.313733] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5139worker1 # [ 71.490037] nix-daemon[917]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)5140worker1 # [ 71.504633] nix-daemon[917]: reaped child process 1175, status = succeeded5141worker1 # [ 71.646581] nix-daemon[917]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5142worker1 # [ 71.660254] nix-daemon[917]: reaped child process 1180, status = succeeded5143lb # [ 71.639587] niks3-server[1256]: 2026/09/20 08:16:34 INFO Received uploads request method=POST path=/api/pending_closures5144worker1 # [ 71.677517] nix-grpc-daemon[928]: time=2026-09-20T08:16:34.569Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5145worker1 # [ 71.679586] nix-grpc-daemon[928]: time=2026-09-20T08:16:34.571Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"5146lb # [ 71.658132] niks3-server[1256]: 2026/09/20 08:16:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign5147lb # [ 71.662907] niks3-server[1256]: 2026/09/20 08:16:34 INFO Signed narinfos id=13 count=15148worker1 # [ 71.699780] nix-grpc-daemon[928]: time=2026-09-20T08:16:34.591Z level=INFO msg="Uploading 1 narinfos"5149lb # [ 71.668809] niks3-server[1256]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst5150lb # [ 71.674136] niks3-server[1256]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls5151lb # [ 71.683626] niks3-server[1256]: 2026/09/20 08:16:34 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete5152lb # [ 71.689433] niks3-server[1256]: 2026/09/20 08:16:34 INFO Completed upload id=135153worker1 # [ 71.723345] nix-grpc-daemon[928]: time=2026-09-20T08:16:34.615Z level=INFO msg="Upload complete. (396ms)"5154lb # [ 71.691375] niks3-server[1256]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo5155worker1 # [ 71.725520] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_in=7525156worker1 # [ 71.729418] nix-grpc-daemon[849]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705157worker1 # [ 71.735897] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5158worker1 # [ 71.738262] nix-daemon[917]: reaped child process 1170, status = succeeded5159worker1 # [ 71.743939] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5160worker1 # [ 72.969507] nix-daemon[917]: reaped child process 1184, status = succeeded5161worker1 # [ 73.106199] nix-daemon[917]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5162worker1 # [ 73.119866] nix-daemon[917]: reaped child process 1202, status = succeeded5163lb # [ 73.100825] niks3-server[1256]: 2026/09/20 08:16:35 INFO Received uploads request method=POST path=/api/pending_closures5164worker1 # [ 73.143902] nix-grpc-daemon[928]: time=2026-09-20T08:16:36.035Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5165worker1 # [ 73.146520] nix-grpc-daemon[928]: time=2026-09-20T08:16:36.037Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"5166lb # [ 73.146603] niks3-server[1256]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv5167lb # [ 73.154919] niks3-server[1256]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst5168lb # [ 73.165183] niks3-server[1256]: 2026/09/20 08:16:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign5169worker1 # [ 73.202520] nix-grpc-daemon[928]: time=2026-09-20T08:16:36.094Z level=INFO msg="Uploading 1 narinfos"5170lb # [ 73.168695] niks3-server[1256]: 2026/09/20 08:16:35 INFO Signed narinfos id=14 count=15171lb # [ 73.180704] niks3-server[1256]: 2026/09/20 08:16:35 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete5172lb # [ 73.186303] niks3-server[1256]: 2026/09/20 08:16:35 INFO Completed upload id=145173worker1 # [ 73.221962] nix-grpc-daemon[928]: time=2026-09-20T08:16:36.114Z level=INFO msg="Upload complete. (270ms)"5174lb # [ 73.188860] niks3-server[1256]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo5175worker1 # [ 73.225137] nix-grpc-daemon[849]: ts=2026-09-20T08:16:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=15176lb # [ 73.192622] niks3-server[1256]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls5177worker1 # [ 73.232040] nix-daemon[917]: reaped child process 1182, status = succeeded5178worker2 # [ 73.190286] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407045179worker2 # [ 73.200161] nix-grpc-daemon[787]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...5180worker2 # [ 73.223260] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:407045181worker2 # [ 73.229154] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=0 paths=1 nar_bytes_out=2325182client # [ 73.330347] nix-daemon[929]: reaped child process 931, status = succeeded5183client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.02 seconds)5184client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5185client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)5186client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5187client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)5188client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5189client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)5190(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.12 seconds)5191subtest: an input only one worker has still reaches the builder5192client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only5193client # this derivation will be built:5194client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5195client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5196client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.41 seconds)5197client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5198client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.19 seconds)5199worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5200worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.22 seconds)5201worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5202worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)5203client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&25204client # [ 74.468328] nix-daemon[929]: accepted connection from pid 1012, user root (trusted)5205client # this derivation will be built:5206client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5207worker1 # [ 74.694753] nix-grpc-daemon[849]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417705208client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5209worker2 # [ 74.655976] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407045210client # copying 1 paths...5211client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...5212worker1 # [ 74.704154] nix-grpc-daemon[849]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417705213worker1 # [ 74.714267] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5214worker1 # [ 74.874446] nix-daemon[917]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5215worker1 # [ 74.888373] nix-daemon[917]: reaped child process 1214, status = succeeded5216lb # [ 74.872070] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received uploads request method=POST path=/api/pending_closures5217worker1 # [ 74.910670] nix-grpc-daemon[928]: time=2026-09-20T08:16:37.802Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5218worker1 # [ 74.912745] nix-grpc-daemon[928]: time=2026-09-20T08:16:37.804Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5219lb # [ 74.889537] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign5220lb # [ 74.892351] niks3-server[1256]: 2026/09/20 08:16:37 INFO Signed narinfos id=15 count=15221worker1 # [ 74.926487] nix-grpc-daemon[928]: time=2026-09-20T08:16:37.818Z level=INFO msg="Uploading 1 narinfos"5222lb # [ 74.895952] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5223lb # [ 74.900109] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5224lb # [ 74.903926] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete5225lb # [ 74.906931] niks3-server[1256]: 2026/09/20 08:16:37 INFO Completed upload id=155226worker1 # [ 74.940756] nix-grpc-daemon[928]: time=2026-09-20T08:16:37.832Z level=INFO msg="Upload complete. (216ms)"5227worker1 # [ 74.942739] nix-grpc-daemon[849]: ts=2026-09-20T08:16:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_in=1205228lb # [ 74.909600] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5229worker1 # [ 74.948942] nix-daemon[917]: reaped child process 1209, status = succeeded5230worker1 # [ 74.953357] nix-grpc-daemon[849]: ts=2026-09-20T08:16:37Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05231worker1 # [ 74.955335] nix-grpc-daemon[849]: ts=2026-09-20T08:16:37Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15232worker2 # [ 74.954613] nix-grpc-daemon[787]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407045233worker2 # [ 74.961140] nix-grpc-daemon[787]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407045234client # copying 2 paths to 'lb:50051'...5235worker2 # [ 74.969278] nix-grpc-daemon[787]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407045236client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5237client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5238worker2 # [ 74.980330] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5239worker2 # [ 75.156574] nix-daemon[850]: accepted connection from pid 949, user nix-grpc-daemon (trusted)5240worker2 # [ 75.169698] nix-daemon[850]: reaped child process 952, status = succeeded5241worker2 # [ 75.331398] nix-daemon[850]: accepted connection from pid 955, user nix-grpc-daemon (trusted)5242worker2 # [ 75.343098] nix-daemon[850]: reaped child process 958, status = succeeded5243lb # [ 75.365941] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received uploads request method=POST path=/api/pending_closures5244lb # [ 75.381646] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received uploads request method=POST path=/api/pending_closures5245worker2 # [ 75.383655] nix-grpc-daemon[872]: time=2026-09-20T08:16:37.674Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5246worker2 # [ 75.385085] nix-grpc-daemon[872]: time=2026-09-20T08:16:37.674Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5247worker2 # [ 75.386701] nix-grpc-daemon[872]: time=2026-09-20T08:16:37.674Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5248lb # [ 75.419595] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5249lb # [ 75.423793] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5250lb # [ 75.440744] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5251lb # [ 75.446260] niks3-server[1256]: 2026/09/20 08:16:37 INFO Signed narinfos id=16 count=15252lb # [ 75.448601] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5253lb # [ 75.450327] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5254lb # [ 75.452683] niks3-server[1256]: 2026/09/20 08:16:37 INFO Signed narinfos id=17 count=25255lb # [ 75.455433] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5256worker2 # [ 75.446150] nix-grpc-daemon[872]: time=2026-09-20T08:16:37.736Z level=INFO msg="Uploading 3 narinfos"5257lb # [ 75.467295] niks3-server[1256]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5258lb # [ 75.472202] niks3-server[1256]: 2026/09/20 08:16:37 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5259lb # [ 75.474802] niks3-server[1256]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5260lb # [ 75.476938] niks3-server[1256]: 2026/09/20 08:16:38 INFO Completed upload id=165261lb # [ 75.478408] niks3-server[1256]: 2026/09/20 08:16:38 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5262lb # [ 75.482425] niks3-server[1256]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5263lb # [ 75.485502] niks3-server[1256]: 2026/09/20 08:16:38 INFO Completed upload id=175264worker2 # [ 75.478059] nix-grpc-daemon[872]: time=2026-09-20T08:16:37.769Z level=INFO msg="Upload complete. (490ms)"5265worker2 # [ 75.482419] nix-grpc-daemon[787]: ts=2026-09-20T08:16:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=0 paths=2 nar_bytes_in=9765266worker2 # [ 75.488508] nix-grpc-daemon[787]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407045267worker2 # [ 75.499565] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5268worker2 # [ 75.509204] nix-daemon[850]: reaped child process 947, status = succeeded5269worker2 # [ 75.519299] nix-grpc-daemon[787]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5270client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5271worker2 # [ 75.530651] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5272client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5273worker2 # [ 76.959593] nix-daemon[850]: reaped child process 963, status = succeeded5274worker2 # [ 77.132563] nix-daemon[850]: accepted connection from pid 978, user nix-grpc-daemon (trusted)5275worker2 # [ 77.142972] nix-daemon[850]: reaped child process 981, status = succeeded5276lb # [ 77.168519] niks3-server[1256]: 2026/09/20 08:16:39 INFO Received uploads request method=POST path=/api/pending_closures5277worker2 # [ 77.166109] nix-grpc-daemon[872]: time=2026-09-20T08:16:39.457Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5278lb # [ 77.185994] niks3-server[1256]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5279lb # [ 77.188289] niks3-server[1256]: 2026/09/20 08:16:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5280lb # [ 77.190094] niks3-server[1256]: 2026/09/20 08:16:39 INFO Signed narinfos id=18 count=15281worker2 # [ 77.183508] nix-grpc-daemon[872]: time=2026-09-20T08:16:39.474Z level=INFO msg="Uploading 1 narinfos"5282lb # [ 77.193676] niks3-server[1256]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5283lb # [ 77.199255] niks3-server[1256]: 2026/09/20 08:16:39 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5284lb # [ 77.202499] niks3-server[1256]: 2026/09/20 08:16:39 INFO Completed upload id=185285worker2 # [ 77.195837] nix-grpc-daemon[872]: time=2026-09-20T08:16:39.487Z level=INFO msg="Upload complete. (251ms)"5286lb # [ 77.204400] niks3-server[1256]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5287worker2 # [ 77.198147] nix-grpc-daemon[787]: ts=2026-09-20T08:16:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=15288worker2 # [ 77.204599] nix-daemon[850]: reaped child process 960, status = succeeded5289client # copying 1 paths...5290worker2 # [ 77.242338] nix-grpc-daemon[787]: ts=2026-09-20T08:16:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407045291client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5292worker1 # [ 77.294871] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:417705293worker1 # [ 77.308212] nix-grpc-daemon[849]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5294worker1 # [ 77.323976] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=0 paths=1 nar_bytes_out=1205295client # [ 77.381659] nix-daemon[929]: reaped child process 1015, status = succeeded5296client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.12 seconds)5297client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25298client # [ 77.569822] nix-daemon[929]: accepted connection from pid 1034, user root (trusted)5299client # this derivation will be built:5300client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5301worker2 # [ 77.733876] nix-grpc-daemon[787]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:407045302worker1 # [ 77.779050] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417705303client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5304worker1 # [ 77.786111] nix-grpc-daemon[928]: time=2026-09-20T08:16:40.677Z level=INFO msg="All 1 paths already cached"5305worker1 # [ 77.795861] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05306worker1 # [ 77.798190] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15307worker1 # [ 77.800754] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705308worker1 # [ 77.808232] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417705309client # copying 1 paths to 'lb:50051'...5310client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5311worker1 # [ 77.821823] nix-grpc-daemon[849]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417705312worker1 # [ 77.827379] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5313worker1 # [ 77.837489] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)5314worker1 # [ 77.908247] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 2/5)5315worker1 # [ 78.038285] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 110 ms (attempt 3/5)5316worker1 # [ 78.154249] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 408 ms (attempt 4/5)5317worker1 # [ 78.562964] nix-grpc-daemon[849]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5318worker1 # [ 78.565490] nix-grpc-daemon[849]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5319worker1 # [ 78.744886] nix-daemon[917]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5320worker1 # [ 78.757210] nix-daemon[917]: reaped child process 1230, status = succeeded5321worker1 # [ 78.929281] nix-daemon[917]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5322worker1 # [ 78.942051] nix-daemon[917]: reaped child process 1235, status = succeeded5323lb # [ 78.924658] niks3-server[1256]: 2026/09/20 08:16:41 INFO Received uploads request method=POST path=/api/pending_closures5324worker1 # [ 79.008149] nix-grpc-daemon[928]: time=2026-09-20T08:16:41.899Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5325worker1 # [ 79.009765] nix-grpc-daemon[928]: time=2026-09-20T08:16:41.901Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5326lb # [ 79.003059] niks3-server[1256]: 2026/09/20 08:16:41 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5327lb # [ 79.013845] niks3-server[1256]: 2026/09/20 08:16:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5328lb # [ 79.021284] niks3-server[1256]: 2026/09/20 08:16:41 INFO Signed narinfos id=19 count=15329worker1 # [ 79.054684] nix-grpc-daemon[928]: time=2026-09-20T08:16:41.946Z level=INFO msg="Uploading 1 narinfos"5330lb # [ 79.029299] niks3-server[1256]: 2026/09/20 08:16:41 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5331lb # [ 79.039376] niks3-server[1256]: 2026/09/20 08:16:41 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5332lb # [ 79.045878] niks3-server[1256]: 2026/09/20 08:16:41 INFO Completed upload id=195333worker1 # [ 79.079685] nix-grpc-daemon[928]: time=2026-09-20T08:16:41.971Z level=INFO msg="Upload complete. (504ms)"5334lb # [ 79.048562] niks3-server[1256]: 2026/09/20 08:16:41 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5335worker1 # [ 79.084583] nix-grpc-daemon[849]: ts=2026-09-20T08:16:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 paths=1 nar_bytes_in=5605336worker1 # [ 79.090650] nix-grpc-daemon[849]: ts=2026-09-20T08:16:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417705337worker1 # [ 79.105143] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5338worker1 # [ 79.115482] nix-daemon[917]: reaped child process 1221, status = succeeded5339client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5340worker1 # [ 79.123462] nix-daemon[917]: accepted connection from pid 849, user nix-grpc-daemon (trusted)5341client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5342worker1 # [ 80.341377] nix-daemon[917]: reaped child process 1239, status = succeeded5343worker1 # [ 80.492722] nix-daemon[917]: accepted connection from pid 1254, user nix-grpc-daemon (trusted)5344worker1 # [ 80.503505] nix-daemon[917]: reaped child process 1257, status = succeeded5345lb # [ 80.488085] niks3-server[1256]: 2026/09/20 08:16:43 INFO Received uploads request method=POST path=/api/pending_closures5346worker1 # [ 80.526564] nix-grpc-daemon[928]: time=2026-09-20T08:16:43.418Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5347lb # [ 80.507781] envoy[997]: conn peer=[2001:db8:1::1]:56378 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=125348lb # [ 80.514068] envoy[997]: conn peer=[2001:db8:1::1]:56374 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1973 ms=19065349lb # [ 80.517616] envoy[997]: conn peer=[2001:db8:1::1]:56386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2221 ms=20885350lb # [ 80.521889] envoy[997]: conn peer=[2001:db8:1::1]:44956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=535351lb # [ 80.525385] envoy[997]: conn peer=[2001:db8:1::1]:44962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4200 tx=1726 ms=26805352lb # [ 80.528959] envoy[997]: conn peer=[2001:db8:1::1]:44974 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=785353lb # [ 80.538772] niks3-server[1256]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5354lb # [ 80.542799] niks3-server[1256]: 2026/09/20 08:16:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5355lb # [ 80.547150] niks3-server[1256]: 2026/09/20 08:16:43 INFO Signed narinfos id=20 count=15356worker1 # [ 80.583600] nix-grpc-daemon[928]: time=2026-09-20T08:16:43.475Z level=INFO msg="Uploading 1 narinfos"5357lb # [ 80.553523] niks3-server[1256]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5358lb # [ 80.558788] niks3-server[1256]: 2026/09/20 08:16:43 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5359lb # [ 80.561995] niks3-server[1256]: 2026/09/20 08:16:43 INFO Completed upload id=205360worker1 # [ 80.596134] nix-grpc-daemon[928]: time=2026-09-20T08:16:43.488Z level=INFO msg="Upload complete. (261ms)"5361lb # [ 80.564503] niks3-server[1256]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5362worker1 # [ 80.602122] nix-grpc-daemon[849]: ts=2026-09-20T08:16:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41770 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15363worker1 # [ 80.612565] nix-daemon[917]: reaped child process 1237, status = succeeded5364client # copying 1 paths...5365worker1 # [ 80.646589] nix-grpc-daemon[849]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417705366client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5367worker2 # [ 80.629279] nix-grpc-daemon[787]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:407045368worker2 # [ 80.638553] nix-grpc-daemon[787]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5369worker2 # [ 80.648190] nix-grpc-daemon[787]: ts=2026-09-20T08:16:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=0 paths=1 nar_bytes_out=1205370client # [ 80.764759] nix-daemon[929]: reaped child process 1037, status = succeeded5371client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.38 seconds)5372client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25373client # [ 80.951190] nix-daemon[929]: accepted connection from pid 1056, user root (trusted)5374client # this derivation will be built:5375client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5376worker2 # [ 81.116925] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:407045377client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5378worker1 # [ 81.162224] nix-grpc-daemon[849]: ts=2026-09-20T08:16:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417705379worker1 # [ 81.170939] nix-grpc-daemon[928]: time=2026-09-20T08:16:44.062Z level=INFO msg="All 1 paths already cached"5380worker1 # [ 81.184277] nix-grpc-daemon[849]: ts=2026-09-20T08:16:44Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05381worker1 # [ 81.188598] nix-grpc-daemon[849]: ts=2026-09-20T08:16:44Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15382worker2 # [ 81.154252] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407045383worker2 # [ 81.162076] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407045384worker2 # [ 81.170255] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.461Z level=INFO msg="All 1 paths already cached"5385client # copying 1 paths to 'lb:50051'...5386client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5387worker2 # [ 81.174660] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407045388worker2 # [ 81.179966] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5389worker2 # [ 81.335374] nix-daemon[850]: accepted connection from pid 986, user nix-grpc-daemon (trusted)5390worker2 # [ 81.349068] nix-daemon[850]: reaped child process 989, status = succeeded5391worker2 # [ 81.498628] nix-daemon[850]: accepted connection from pid 991, user nix-grpc-daemon (trusted)5392worker2 # [ 81.511494] nix-daemon[850]: reaped child process 994, status = succeeded5393lb # [ 81.537815] niks3-server[1256]: 2026/09/20 08:16:44 INFO Received uploads request method=POST path=/api/pending_closures5394worker2 # [ 81.537750] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.829Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5395worker2 # [ 81.539352] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.830Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5396lb # [ 81.567944] niks3-server[1256]: 2026/09/20 08:16:44 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5397lb # [ 81.577346] niks3-server[1256]: 2026/09/20 08:16:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5398lb # [ 81.582963] niks3-server[1256]: 2026/09/20 08:16:44 INFO Signed narinfos id=21 count=15399worker2 # [ 81.578127] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.869Z level=INFO msg="Uploading 1 narinfos"5400lb # [ 81.589339] niks3-server[1256]: 2026/09/20 08:16:44 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5401lb # [ 81.602043] niks3-server[1256]: 2026/09/20 08:16:44 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5402lb # [ 81.605963] niks3-server[1256]: 2026/09/20 08:16:44 INFO Completed upload id=215403worker2 # [ 81.600346] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.891Z level=INFO msg="Upload complete. (415ms)"5404worker2 # [ 81.602589] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=0 paths=1 nar_bytes_in=5605405lb # [ 81.609994] niks3-server[1256]: 2026/09/20 08:16:44 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5406worker2 # [ 81.608603] nix-daemon[850]: reaped child process 984, status = succeeded5407worker2 # [ 81.610117] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407045408worker2 # [ 81.615046] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5409worker2 # [ 81.621192] nix-daemon[850]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5410client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5411client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5412worker2 # [ 82.846867] nix-daemon[850]: reaped child process 998, status = succeeded5413worker2 # [ 83.018267] nix-daemon[850]: accepted connection from pid 1013, user nix-grpc-daemon (trusted)5414worker2 # [ 83.030308] nix-daemon[850]: reaped child process 1016, status = succeeded5415lb # [ 83.053293] niks3-server[1256]: 2026/09/20 08:16:45 INFO Received uploads request method=POST path=/api/pending_closures5416worker2 # [ 83.049879] nix-grpc-daemon[872]: time=2026-09-20T08:16:45.340Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5417lb # [ 83.068752] niks3-server[1256]: 2026/09/20 08:16:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5418lb # [ 83.070757] niks3-server[1256]: 2026/09/20 08:16:45 INFO Signed narinfos id=22 count=15419worker2 # [ 83.064207] nix-grpc-daemon[872]: time=2026-09-20T08:16:45.355Z level=INFO msg="Uploading 1 narinfos"5420lb # [ 83.073492] niks3-server[1256]: 2026/09/20 08:16:45 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5421lb # [ 83.075930] niks3-server[1256]: 2026/09/20 08:16:45 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5422lb # [ 83.081245] niks3-server[1256]: 2026/09/20 08:16:45 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5423lb # [ 83.084653] niks3-server[1256]: 2026/09/20 08:16:45 INFO Completed upload id=225424worker2 # [ 83.076814] nix-grpc-daemon[872]: time=2026-09-20T08:16:45.368Z level=INFO msg="Upload complete. (246ms)"5425lb # [ 83.086248] niks3-server[1256]: 2026/09/20 08:16:45 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5426worker2 # [ 83.079131] nix-grpc-daemon[787]: ts=2026-09-20T08:16:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15427worker2 # [ 83.085633] nix-daemon[850]: reaped child process 996, status = succeeded5428client # copying 1 paths...5429worker1 # [ 83.166476] nix-grpc-daemon[849]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417705430worker1 # [ 83.174510] nix-grpc-daemon[849]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5431client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5432worker2 # [ 83.155475] nix-grpc-daemon[787]: ts=2026-09-20T08:16:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:407045433worker2 # [ 83.158481] nix-grpc-daemon[787]: ts=2026-09-20T08:16:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40704 duration_s=0 paths=1 nar_bytes_out=1205434client # [ 83.251276] nix-daemon[929]: reaped child process 1059, status = succeeded5435client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.48 seconds)5436(finished: subtest: an input only one worker has still reaches the builder, in 9.83 seconds)5437subtest: upload whose reference the worker lacks is completed from the cache5438client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5439client # this derivation will be built:5440client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5441client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5442client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.41 seconds)5443client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5444client # this derivation will be built:5445client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5446client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5447client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.38 seconds)5448client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5449client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5450worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5451worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.22 seconds)5452worker2 # [ 84.497071] systemd[1]: Stopping Nix worker-protocol over gRPC...5453worker2 # [ 84.766445] nix-grpc-daemon[787]: ts=2026-09-20T08:16:47Z level=info event=signal_exit5454worker2 # [ 86.254699] nix-grpc-daemon[787]: ts=2026-09-20T08:16:48Z level=info event=scheduler_restarting5455worker1 # [ 86.305489] nix-grpc-daemon[849]: ts=2026-09-20T08:16:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:561225456worker1 # [ 86.309461] nix-grpc-daemon[849]: ts=2026-09-20T08:16:49Z level=info event=worker_gone addr=192.168.1.4:500515457worker2 # [ 86.274810] nix-grpc-daemon[787]: ts=2026-09-20T08:16:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5458worker2 # [ 86.291997] nix-daemon[850]: reaped child process 852, status = succeeded5459worker2 # [ 86.359642] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5460worker2 # [ 86.362675] systemd[1]: Stopped Nix worker-protocol over gRPC.5461worker2 # [ 86.365826] systemd[1]: nix-grpc-daemon.service: Consumed 1.495s CPU time over 1min 5.867s wall clock time, 50.1M memory peak, 63.1K incoming IP traffic, 121.4K outgoing IP traffic.5462worker2 # [ 86.375474] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5463worker2 # [ 86.378734] systemd[1]: Closed Nix worker-protocol over gRPC.5464worker2 # [ 86.381260] systemd[1]: nix-grpc-daemon.socket: Consumed 334us CPU time over 1min 17.257s wall clock time, 256K memory peak, 121K incoming IP traffic, 98.7K outgoing IP traffic.5465lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5466lb: must succeed: curl -sf localhost:9901/clusters5467lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5468lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5469client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25470worker1 # [ 86.675171] nix-grpc-daemon[849]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417705471client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5472worker1 # [ 86.680394] nix-grpc-daemon[849]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417705473client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.21 seconds)5474worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5475worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5476worker2 # [ 86.745727] systemd[1]: Listening on Nix worker-protocol over gRPC.5477worker1 # [ 86.823178] systemd[1]: Stopping Nix worker-protocol over gRPC...5478worker1 # [ 86.826134] nix-grpc-daemon[849]: ts=2026-09-20T08:16:49Z level=info event=signal_exit5479worker2 # [ 86.906738] systemd[1]: Starting Nix worker-protocol over gRPC...5480worker2 # [ 87.101146] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5481worker2 # [ 87.104397] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15482worker2 # [ 87.111135] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5483worker2 # [ 87.114187] systemd[1]: Started Nix worker-protocol over gRPC.5484worker2 # [ 87.143822] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500515485worker1 # [ 87.195068] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05486worker1 # [ 87.302460] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_yield5487worker2 # [ 87.263037] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=scheduler_restarting addr=lb:500515488lb # [ 87.271448] niks3-server[1256]: 2026/09/20 08:16:49 INFO lead: released remote=192.168.1.3:373885489worker1 # [ 87.312705] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:351965490worker1 # [ 87.316465] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=worker_gone addr=192.168.1.4:500515491worker1 # [ 87.319883] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_restarting addr=lb:500515492worker1 # [ 87.323518] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:561225493worker1 # [ 87.327100] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=worker_gone addr=192.168.1.3:500515494worker2 # [ 87.464317] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500515495worker1 # [ 87.511826] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515496worker1 # [ 87.516857] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5497worker2 # [ 87.478131] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5498worker1 # [ 87.717871] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515499worker2 # [ 87.679749] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500515500worker1 # [ 87.722680] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5501worker2 # [ 87.683941] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5502worker1 # [ 87.922965] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515503worker2 # [ 87.884477] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515504worker1 # [ 87.930861] nix-grpc-daemon[849]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5505worker2 # [ 87.889341] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5506worker2 # [ 88.089914] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515507worker1 # [ 88.131909] nix-grpc-daemon[849]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500515508worker1 # [ 88.136816] nix-grpc-daemon[849]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5509worker2 # [ 88.095213] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5510worker1 # [ 88.307234] nix-grpc-daemon[849]: ts=2026-09-20T08:16:51Z level=info event=scheduler_restarting5511worker1 # [ 88.331672] nix-daemon[917]: reaped child process 919, status = succeeded5512worker2 # [ 88.297971] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515513worker2 # [ 88.301888] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5514worker1 # [ 88.354788] nix-grpc-daemon[849]: ts=2026-09-20T08:16:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5515worker2 # [ 88.502853] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515516worker1 # [ 88.547831] nix-grpc-daemon[849]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5517worker1 # [ 88.551280] nix-grpc-daemon[849]: E0000 00:00:1789892211.439172 892 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5518worker1 # [ 88.983781] nix-grpc-daemon[849]: E0000 00:00:1789892211.875737 892 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5519worker1 # [ 88.988721] nix-grpc-daemon[849]: E0000 00:00:1789892211.875870 892 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5520worker2 # [ 90.302675] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5521worker1 # [ 90.358398] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5522worker1 # [ 90.359588] systemd[1]: Stopped Nix worker-protocol over gRPC.5523worker1 # [ 90.360502] systemd[1]: nix-grpc-daemon.service: Consumed 2.826s CPU time over 1min 9.825s wall clock time, 63.3M memory peak, 102.9K incoming IP traffic, 204.4K outgoing IP traffic.5524worker1 # [ 90.365081] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5525worker1 # [ 90.366782] systemd[1]: Closed Nix worker-protocol over gRPC.5526worker1 # [ 90.367932] systemd[1]: nix-grpc-daemon.socket: Consumed 359us CPU time over 1min 20.787s wall clock time, 256K memory peak, 155.7K incoming IP traffic, 119.7K outgoing IP traffic.5527lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5528lb: must succeed: curl -sf localhost:9901/clusters5529lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5530lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5531client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25532lb # [ 90.506783] envoy[997]: conn peer=[2001:db8:1::1]:44986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3710 tx=1802 ms=29675533lb # [ 90.508405] envoy[997]: conn peer=[2001:db8:1::1]:44990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=745534worker2 # [ 90.503143] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500515535lb # [ 90.510673] envoy[997]: conn peer=[2001:db8:1::1]:44998 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1915 ms=20895536lb # [ 90.515513] envoy[997]: conn peer=[2001:db8:1::1]:54396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=505537lb # [ 90.519509] envoy[997]: conn peer=[2001:db8:1::4]:52898 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=25964 tx=4671 ms=654675538lb # [ 90.523895] envoy[997]: conn peer=[2001:db8:1::1]:54408 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=165539worker2 # [ 90.516247] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5540lb # [ 90.527340] envoy[997]: conn peer=[2001:db8:1::3]:44730 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=27990 tx=5152 ms=674745541worker2 # [ 90.595986] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:402765542worker2 # [ 90.609189] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5543worker2 # [ 90.626360] nix-grpc-daemon[1037]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5)5544worker2 # [ 90.676211] nix-grpc-daemon[1037]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 2/5)5545worker2 # [ 90.717491] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500515546worker2 # [ 90.721951] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5547worker2 # [ 90.777729] nix-grpc-daemon[1037]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 3/5)5548worker2 # [ 90.833547] nix-grpc-daemon[1037]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 4/5)5549worker2 # [ 90.870432] nix-grpc-daemon[1037]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5550client # copying 2 paths...5551client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5552client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5553worker2 # [ 90.890958] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:402765554worker2 # [ 90.900901] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5555worker2 # [ 90.924914] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500515556worker2 # [ 90.929843] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=niks3_push_started pid=10935557worker2 # [ 90.935698] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5558worker2 # [ 91.136089] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500515559worker2 # [ 91.138850] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5560worker2 # [ 91.271759] nix-daemon[850]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)5561worker2 # [ 91.282841] nix-daemon[850]: reaped child process 1109, status = succeeded5562lb # [ 91.309728] niks3-server[1256]: 2026/09/20 08:16:53 INFO Received uploads request method=POST path=/api/pending_closures5563lb # [ 91.318961] niks3-server[1256]: 2026/09/20 08:16:53 INFO Received uploads request method=POST path=/api/pending_closures5564worker2 # [ 91.318830] nix-grpc-daemon[1093]: time=2026-09-20T08:16:53.609Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5565worker2 # [ 91.320569] nix-grpc-daemon[1093]: time=2026-09-20T08:16:53.611Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5566worker2 # [ 91.324269] nix-grpc-daemon[1093]: time=2026-09-20T08:16:53.613Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5567worker2 # [ 91.339051] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500515568worker2 # [ 91.341580] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5569lb # [ 91.369075] niks3-server[1256]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5570lb # [ 91.380277] niks3-server[1256]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5571lb # [ 91.385918] niks3-server[1256]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5572lb # [ 91.394199] niks3-server[1256]: 2026/09/20 08:16:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5573lb # [ 91.395819] niks3-server[1256]: 2026/09/20 08:16:53 INFO Signed narinfos id=24 count=25574lb # [ 91.397944] niks3-server[1256]: 2026/09/20 08:16:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5575lb # [ 91.399949] niks3-server[1256]: 2026/09/20 08:16:53 INFO Signed narinfos id=23 count=15576lb # [ 91.401646] niks3-server[1256]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5577worker2 # [ 91.394318] nix-grpc-daemon[1093]: time=2026-09-20T08:16:53.684Z level=INFO msg="Uploading 3 narinfos"5578lb # [ 91.417059] niks3-server[1256]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5579lb # [ 91.420078] niks3-server[1256]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5580lb # [ 91.422046] niks3-server[1256]: 2026/09/20 08:16:53 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5581lb # [ 91.425850] niks3-server[1256]: 2026/09/20 08:16:53 INFO Completed upload id=235582lb # [ 91.427749] niks3-server[1256]: 2026/09/20 08:16:53 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5583lb # [ 91.430148] niks3-server[1256]: 2026/09/20 08:16:53 INFO Completed upload id=245584lb # [ 91.431910] niks3-server[1256]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5585worker2 # [ 91.422615] nix-grpc-daemon[1093]: time=2026-09-20T08:16:53.713Z level=INFO msg="Upload complete. (309ms)"5586worker2 # [ 91.429205] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=0 paths=2 nar_bytes_in=3125587worker2 # [ 91.440833] nix-daemon[850]: reaped child process 1091, status = succeeded5588client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.05 seconds)5589worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5590worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5591worker1 # [ 91.582664] systemd[1]: Listening on Nix worker-protocol over gRPC.5592worker2 # [ 91.542740] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500515593worker1 # [ 91.590381] systemd[1]: Starting Nix worker-protocol over gRPC...5594worker1 # [ 91.746502] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5595worker1 # [ 91.749713] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15596worker1 # [ 91.756884] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5597worker1 # [ 91.760152] systemd[1]: Started Nix worker-protocol over gRPC.5598worker1 # [ 91.771783] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=scheduler_take_over5599lb # [ 91.737494] niks3-server[1256]: 2026/09/20 08:16:54 INFO lead: acquired remote=192.168.1.3:369065600lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5601lb: must succeed: curl -sf localhost:9901/clusters5602worker2 # [ 91.735076] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5603worker1 # [ 91.791685] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500515604worker1 # [ 91.794082] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5605lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5606worker2 # [ 91.936085] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500515607worker1 # [ 91.980403] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05608worker1 # [ 91.994532] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500515609worker1 # [ 91.997115] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5610worker1 # [ 92.198268] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500515611worker1 # [ 92.203113] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05612lb: must succeed: curl -sf localhost:9901/clusters5613lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5614lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.12 seconds)5615(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.60 seconds)5616subtest: scheduler down: the other node takes the lock and keeps it5617lb: must succeed: curl -sf localhost:9901/clusters5618lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5619lb: must succeed: curl -sf localhost:9901/clusters5620lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5621lb: must succeed: curl -sf localhost:9901/clusters5622lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5623lb: must succeed: curl -sf localhost:9901/clusters5624lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5625worker1 # [ 93.102925] systemd[1]: Stopping Nix worker-protocol over gRPC...5626worker1 # [ 93.757574] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:56Z level=info event=signal_exit5627worker1 # [ 93.967429] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:56Z level=info event=scheduler_yield5628worker1 # [ 93.969630] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:56Z level=info event=scheduler_restarting addr=lb:500515629lb # [ 93.936813] niks3-server[1256]: 2026/09/20 08:16:56 INFO lead: released remote=192.168.1.3:369065630worker1 # [ 93.973905] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:352865631worker1 # [ 93.975499] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:56Z level=info event=worker_gone addr=192.168.1.3:500515632worker1 # [ 93.977497] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:352865633worker1 # [ 93.979108] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:56Z level=info event=worker_gone addr=192.168.1.4:500515634worker2 # [ 93.936442] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:56Z level=info event=scheduler_restarting addr=lb:500515635worker1 # [ 94.170190] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515636worker1 # [ 94.172993] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5637worker2 # [ 94.136325] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500515638worker2 # [ 94.140290] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5639worker1 # [ 94.373467] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515640worker1 # [ 94.376483] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5641worker2 # [ 94.340904] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500515642worker2 # [ 94.344816] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5643worker1 # [ 94.577549] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515644worker1 # [ 94.581644] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5645worker2 # [ 94.545591] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500515646worker2 # [ 94.549422] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5647worker1 # [ 94.783368] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515648worker1 # [ 94.787373] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5649worker2 # [ 94.749784] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515650worker2 # [ 94.753622] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5651worker1 # [ 94.968892] nix-grpc-daemon[1283]: ts=2026-09-20T08:16:57Z level=info event=scheduler_restarting5652worker2 # [ 94.955865] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515653worker2 # [ 94.959545] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5654worker1 # [ 95.202922] nix-grpc-daemon[1283]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5655worker2 # [ 95.160340] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500515656worker1 # [ 95.204360] nix-grpc-daemon[1283]: E0000 00:00:1789892218.094975 1326 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5657worker1 # [ 95.354530] nix-grpc-daemon[1283]: E0000 00:00:1789892218.246506 1326 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5658worker1 # [ 95.356612] nix-grpc-daemon[1283]: E0000 00:00:1789892218.246671 1326 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5659worker2 # [ 95.719965] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5660worker1 # [ 95.776179] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5661worker1 # [ 95.778506] systemd[1]: Stopped Nix worker-protocol over gRPC.5662worker1 # [ 95.781685] systemd[1]: nix-grpc-daemon.service: Consumed 140ms CPU time over 4.185s wall clock time, 12.3M memory peak, 7.7K incoming IP traffic, 8.4K outgoing IP traffic.5663worker1 # [ 95.790071] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5664worker1 # [ 95.791750] systemd[1]: Closed Nix worker-protocol over gRPC.5665worker1 # [ 95.793068] systemd[1]: nix-grpc-daemon.socket: Consumed 524us CPU time over 4.216s wall clock time, 256K memory peak, 19.3K incoming IP traffic, 13.4K outgoing IP traffic.5666worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5667worker2 # [ 95.920972] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500515668worker2 # [ 95.925651] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5669worker2 # [ 96.127572] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500515670worker2 # [ 96.131780] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5671worker2 # [ 96.332616] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500515672worker2 # [ 96.337729] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5673worker2 # [ 96.538882] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500515674worker2 # [ 96.542823] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5675worker2 # [ 96.743719] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515676worker2 # [ 96.746391] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5677worker2 # [ 96.947095] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515678worker2 # [ 96.950059] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5679lb # [ 97.132326] niks3-server[1256]: 2026/09/20 08:16:59 INFO lead: acquired remote=192.168.1.4:513405680worker2 # [ 97.128502] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:59Z level=info event=scheduler_take_over5681worker2 # [ 97.151142] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500515682worker2 # [ 97.155435] nix-grpc-daemon[1037]: ts=2026-09-20T08:16:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05683worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.18 seconds)5684worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5685worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5686client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25687worker2 # [ 98.174543] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:402765688client # don't know how to build these paths:5689client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5690worker2 # [ 98.191168] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:00Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05691worker2 # [ 98.196633] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:00Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=15692worker2 # [ 98.234972] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765693worker2 # [ 98.247644] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:402765694client # copying 1 paths to 'lb:50051'...5695client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5696worker2 # [ 98.259087] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:402765697worker2 # [ 98.270196] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5698worker2 # [ 98.450261] nix-daemon[850]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)5699worker2 # [ 98.462418] nix-daemon[850]: reaped child process 1144, status = succeeded5700worker2 # [ 98.624663] nix-daemon[850]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)5701worker2 # [ 98.636533] nix-daemon[850]: reaped child process 1149, status = succeeded5702lb # [ 98.660854] niks3-server[1256]: 2026/09/20 08:17:01 INFO Received uploads request method=POST path=/api/pending_closures5703worker2 # [ 98.662449] nix-grpc-daemon[1093]: time=2026-09-20T08:17:00.953Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5704worker2 # [ 98.663881] nix-grpc-daemon[1093]: time=2026-09-20T08:17:00.953Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5705lb # [ 98.695105] niks3-server[1256]: 2026/09/20 08:17:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5706worker2 # [ 98.702355] nix-grpc-daemon[1093]: time=2026-09-20T08:17:00.993Z level=INFO msg="Uploading 1 narinfos"5707lb # [ 98.709796] niks3-server[1256]: 2026/09/20 08:17:01 INFO Signed narinfos id=25 count=15708lb # [ 98.733362] niks3-server[1256]: 2026/09/20 08:17:01 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5709lb # [ 98.741570] niks3-server[1256]: 2026/09/20 08:17:01 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5710lb # [ 98.744050] niks3-server[1256]: 2026/09/20 08:17:01 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5711lb # [ 98.746386] niks3-server[1256]: 2026/09/20 08:17:01 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5712lb # [ 98.750053] niks3-server[1256]: 2026/09/20 08:17:01 INFO Completed upload id=255713worker2 # [ 98.742268] nix-grpc-daemon[1093]: time=2026-09-20T08:17:01.033Z level=INFO msg="Upload complete. (460ms)"5714worker2 # [ 98.745075] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=0 paths=1 nar_bytes_in=5205715worker2 # [ 98.747557] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765716worker2 # [ 98.754106] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5717worker2 # [ 98.756788] nix-daemon[850]: reaped child process 1139, status = succeeded5718worker2 # [ 98.761587] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5719client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5720client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5721client # farm-a> LOG-farm-a-on-standby5722worker2 # [ 99.581784] nix-daemon[850]: reaped child process 1153, status = succeeded5723worker2 # [ 99.732231] nix-daemon[850]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5724worker2 # [ 99.744157] nix-daemon[850]: reaped child process 1171, status = succeeded5725lb # [ 99.768339] niks3-server[1256]: 2026/09/20 08:17:02 INFO Received uploads request method=POST path=/api/pending_closures5726worker2 # [ 99.867113] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.157Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5727worker2 # [ 99.870589] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.159Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5728lb # [ 99.907685] niks3-server[1256]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5729lb # [ 99.918103] niks3-server[1256]: 2026/09/20 08:17:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5730lb # [ 99.922628] niks3-server[1256]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5731lb # [ 99.930503] niks3-server[1256]: 2026/09/20 08:17:02 INFO Signed narinfos id=26 count=15732worker2 # [ 99.923814] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.214Z level=INFO msg="Uploading 1 narinfos"5733lb # [ 99.938402] niks3-server[1256]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5734lb # [ 99.944323] niks3-server[1256]: 2026/09/20 08:17:02 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5735lb # [ 99.952916] niks3-server[1256]: 2026/09/20 08:17:02 INFO Completed upload id=265736worker2 # [ 99.945398] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.236Z level=INFO msg="Upload complete. (377ms)"5737lb # [ 99.956602] niks3-server[1256]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5738worker2 # [ 99.958325] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15739worker2 # [ 99.972503] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05740worker2 # [ 99.978151] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=15741worker2 # [ 99.986580] nix-daemon[850]: reaped child process 1151, status = succeeded5742worker2 # [ 100.017254] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765743worker2 # [ 100.030246] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:402765744worker2 # [ 100.042168] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.333Z level=INFO msg="All 1 paths already cached"5745client # copying 1 paths to 'lb:50051'...5746client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5747worker2 # [ 100.050161] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:402765748worker2 # [ 100.058443] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5749worker2 # [ 100.219895] nix-daemon[850]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5750worker2 # [ 100.231973] nix-daemon[850]: reaped child process 1180, status = succeeded5751worker2 # [ 100.385809] nix-daemon[850]: accepted connection from pid 1182, user nix-grpc-daemon (trusted)5752worker2 # [ 100.398242] nix-daemon[850]: reaped child process 1185, status = succeeded5753lb # [ 100.420702] niks3-server[1256]: 2026/09/20 08:17:02 INFO Received uploads request method=POST path=/api/pending_closures5754worker2 # [ 100.420349] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.711Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5755worker2 # [ 100.422291] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.713Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5756lb # [ 100.446629] niks3-server[1256]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5757lb # [ 100.460169] niks3-server[1256]: 2026/09/20 08:17:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5758worker2 # [ 100.460145] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.751Z level=INFO msg="Uploading 1 narinfos"5759lb # [ 100.467758] niks3-server[1256]: 2026/09/20 08:17:02 INFO Signed narinfos id=27 count=15760lb # [ 100.472334] niks3-server[1256]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5761lb # [ 100.485342] niks3-server[1256]: 2026/09/20 08:17:03 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5762lb # [ 100.490645] niks3-server[1256]: 2026/09/20 08:17:03 INFO Completed upload id=275763worker2 # [ 100.485239] nix-grpc-daemon[1093]: time=2026-09-20T08:17:02.776Z level=INFO msg="Upload complete. (414ms)"5764lb # [ 100.495266] niks3-server[1256]: 2026/09/20 08:17:03 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5765worker2 # [ 100.487868] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=0 paths=1 nar_bytes_in=6405766worker2 # [ 100.492840] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765767lb # [ 100.507150] envoy[997]: conn peer=[2001:db8:1::1]:54412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1002 tx=282 ms=8455768lb # [ 100.509483] envoy[997]: conn peer=[2001:db8:1::3]:56796 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1746 tx=441 ms=32045769worker2 # [ 100.501483] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5770worker2 # [ 100.511198] nix-daemon[850]: reaped child process 1175, status = succeeded5771worker2 # [ 100.514246] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5772client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5773client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5774client # farm-b> LOG-farm-b-on-standby5775worker2 # [ 101.935302] nix-daemon[850]: reaped child process 1189, status = succeeded5776worker2 # [ 102.087735] nix-daemon[850]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5777worker2 # [ 102.098851] nix-daemon[850]: reaped child process 1207, status = succeeded5778lb # [ 102.121330] niks3-server[1256]: 2026/09/20 08:17:04 INFO Received uploads request method=POST path=/api/pending_closures5779worker2 # [ 102.328187] nix-grpc-daemon[1093]: time=2026-09-20T08:17:04.618Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5780worker2 # [ 102.334989] nix-grpc-daemon[1093]: time=2026-09-20T08:17:04.623Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5781lb # [ 102.370483] niks3-server[1256]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5782lb # [ 102.380615] niks3-server[1256]: 2026/09/20 08:17:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5783lb # [ 102.386781] niks3-server[1256]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5784lb # [ 102.391922] niks3-server[1256]: 2026/09/20 08:17:04 INFO Signed narinfos id=28 count=15785worker2 # [ 102.387703] nix-grpc-daemon[1093]: time=2026-09-20T08:17:04.678Z level=INFO msg="Uploading 1 narinfos"5786lb # [ 102.395555] niks3-server[1256]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5787lb # [ 102.407226] niks3-server[1256]: 2026/09/20 08:17:04 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5788lb # [ 102.416268] niks3-server[1256]: 2026/09/20 08:17:04 INFO Completed upload id=285789worker2 # [ 102.408615] nix-grpc-daemon[1093]: time=2026-09-20T08:17:04.699Z level=INFO msg="Upload complete. (486ms)"5790lb # [ 102.422747] niks3-server[1256]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5791worker2 # [ 102.419087] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15792worker2 # [ 102.428213] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:04Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05793worker2 # [ 102.432269] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:04Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=15794worker2 # [ 102.443360] nix-daemon[850]: reaped child process 1187, status = succeeded5795worker2 # [ 102.471619] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765796worker2 # [ 102.484328] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:402765797worker2 # [ 102.497147] nix-grpc-daemon[1093]: time=2026-09-20T08:17:04.788Z level=INFO msg="All 2 paths already cached"5798client # copying 1 paths to 'lb:50051'...5799client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5800worker2 # [ 102.505562] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:402765801worker2 # [ 102.512275] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5802worker2 # [ 102.677229] nix-daemon[850]: accepted connection from pid 1213, user nix-grpc-daemon (trusted)5803worker2 # [ 102.690242] nix-daemon[850]: reaped child process 1216, status = succeeded5804worker2 # [ 102.839946] nix-daemon[850]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5805worker2 # [ 102.852718] nix-daemon[850]: reaped child process 1221, status = succeeded5806lb # [ 102.872961] niks3-server[1256]: 2026/09/20 08:17:05 INFO Received uploads request method=POST path=/api/pending_closures5807worker2 # [ 102.873557] nix-grpc-daemon[1093]: time=2026-09-20T08:17:05.164Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5808worker2 # [ 102.875350] nix-grpc-daemon[1093]: time=2026-09-20T08:17:05.166Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5809lb # [ 102.905678] niks3-server[1256]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5810lb # [ 102.914251] niks3-server[1256]: 2026/09/20 08:17:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5811worker2 # [ 102.910957] nix-grpc-daemon[1093]: time=2026-09-20T08:17:05.202Z level=INFO msg="Uploading 1 narinfos"5812lb # [ 102.918840] niks3-server[1256]: 2026/09/20 08:17:05 INFO Signed narinfos id=29 count=15813lb # [ 102.924434] niks3-server[1256]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5814lb # [ 102.936471] niks3-server[1256]: 2026/09/20 08:17:05 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5815lb # [ 102.942740] niks3-server[1256]: 2026/09/20 08:17:05 INFO Completed upload id=295816worker2 # [ 102.937398] nix-grpc-daemon[1093]: time=2026-09-20T08:17:05.228Z level=INFO msg="Upload complete. (411ms)"5817lb # [ 102.945883] niks3-server[1256]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5818worker2 # [ 102.941066] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=0 paths=1 nar_bytes_in=7685819worker2 # [ 102.944516] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765820worker2 # [ 102.953310] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5821worker2 # [ 102.955557] nix-daemon[850]: reaped child process 1211, status = succeeded5822worker2 # [ 102.960938] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5823client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5824client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5825client # farm-top> LOG-farm-top-on-standby5826worker2 # [ 103.985653] nix-daemon[850]: reaped child process 1225, status = succeeded5827worker2 # [ 104.151205] nix-daemon[850]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5828worker2 # [ 104.164192] nix-daemon[850]: reaped child process 1243, status = succeeded5829lb # [ 104.190325] niks3-server[1256]: 2026/09/20 08:17:06 INFO Received uploads request method=POST path=/api/pending_closures5830worker2 # [ 104.193410] nix-grpc-daemon[1093]: time=2026-09-20T08:17:06.484Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5831worker2 # [ 104.194937] nix-grpc-daemon[1093]: time=2026-09-20T08:17:06.486Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5832lb # [ 104.229057] niks3-server[1256]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5833lb # [ 104.235583] niks3-server[1256]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5834lb # [ 104.244872] niks3-server[1256]: 2026/09/20 08:17:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5835worker2 # [ 104.241462] nix-grpc-daemon[1093]: time=2026-09-20T08:17:06.532Z level=INFO msg="Uploading 1 narinfos"5836lb # [ 104.249347] niks3-server[1256]: 2026/09/20 08:17:06 INFO Signed narinfos id=30 count=15837lb # [ 104.254302] niks3-server[1256]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5838lb # [ 104.259165] niks3-server[1256]: 2026/09/20 08:17:06 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5839lb # [ 104.262131] niks3-server[1256]: 2026/09/20 08:17:06 INFO Completed upload id=305840worker2 # [ 104.254576] nix-grpc-daemon[1093]: time=2026-09-20T08:17:06.545Z level=INFO msg="Upload complete. (286ms)"5841lb # [ 104.265107] niks3-server[1256]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5842worker2 # [ 104.260286] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15843worker2 # [ 104.271633] nix-daemon[850]: reaped child process 1223, status = succeeded5844client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 6.33 seconds)5845client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5846client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5847worker1 # [ 104.619346] systemd[1]: Listening on Nix worker-protocol over gRPC.5848worker1 # [ 104.623206] systemd[1]: Starting Nix worker-protocol over gRPC...5849worker1 # [ 104.784889] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5850worker1 # [ 104.786973] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15851worker1 # [ 104.793101] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5852worker1 # [ 104.794730] systemd[1]: Started Nix worker-protocol over gRPC.5853lb: must succeed: curl -sf localhost:9901/clusters5854worker1 # [ 104.825031] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500515855worker2 # [ 104.784717] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05856lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5857worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5858worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5859lb: must succeed: curl -sf localhost:9901/clusters5860lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5861lb: must succeed: curl -sf localhost:9901/clusters5862lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5863worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5864worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5865(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.17 seconds)5866subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5867client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5868client # [ 105.059406] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5869client # Running as unit: rs.service; invocation ID: 40ee4d85b79d4e1f9adc5f78b5020f6d5870client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5871worker2 # [ 105.243473] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:402765872client # [ 105.259844] nix[1158]: don't know how to build these paths:5873client # [ 105.261327] nix[1158]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5874worker2 # [ 105.261314] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:07Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05875worker2 # [ 105.267401] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:07Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=15876worker2 # [ 105.272482] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765877worker2 # [ 105.284161] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:402765878client # [ 105.303941] nix[1158]: copying 1 paths to 'lb:50051'...5879client # [ 105.304976] nix[1158]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5880worker2 # [ 105.295730] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:402765881worker2 # [ 105.307210] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5882worker2 # [ 105.474421] nix-daemon[850]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)5883worker2 # [ 105.487228] nix-daemon[850]: reaped child process 1261, status = succeeded5884worker2 # [ 105.649327] nix-daemon[850]: accepted connection from pid 1263, user nix-grpc-daemon (trusted)5885worker2 # [ 105.661698] nix-daemon[850]: reaped child process 1266, status = succeeded5886lb # [ 105.686824] niks3-server[1256]: 2026/09/20 08:17:08 INFO Received uploads request method=POST path=/api/pending_closures5887worker2 # [ 105.687539] nix-grpc-daemon[1093]: time=2026-09-20T08:17:07.978Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5888worker2 # [ 105.688970] nix-grpc-daemon[1093]: time=2026-09-20T08:17:07.978Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5889lb # [ 105.716626] niks3-server[1256]: 2026/09/20 08:17:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5890lb # [ 105.721797] niks3-server[1256]: 2026/09/20 08:17:08 INFO Signed narinfos id=31 count=15891worker2 # [ 105.717152] nix-grpc-daemon[1093]: time=2026-09-20T08:17:08.008Z level=INFO msg="Uploading 1 narinfos"5892lb # [ 105.727260] niks3-server[1256]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5893lb # [ 105.740728] niks3-server[1256]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5894lb # [ 105.748581] niks3-server[1256]: 2026/09/20 08:17:08 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5895lb # [ 105.753482] niks3-server[1256]: 2026/09/20 08:17:08 INFO Completed upload id=315896worker2 # [ 105.747900] nix-grpc-daemon[1093]: time=2026-09-20T08:17:08.039Z level=INFO msg="Upload complete. (431ms)"5897lb # [ 105.756731] niks3-server[1256]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5898worker2 # [ 105.752144] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=0 paths=1 nar_bytes_in=4165899worker2 # [ 105.756954] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:402765900worker2 # [ 105.766191] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5901worker2 # [ 105.771289] nix-daemon[850]: reaped child process 1256, status = succeeded5902worker2 # [ 105.776185] nix-daemon[850]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)5903client # [ 105.785187] nix[1158]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5904lb: must succeed: curl -sf localhost:9901/clusters5905lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5906lb: must succeed: curl -sf localhost:9901/clusters5907lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5908lb: must succeed: curl -sf localhost:9901/clusters5909lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5910lb: must succeed: curl -sf localhost:9901/clusters5911lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5912worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5913worker1 # [ 107.924537] systemd-journald[287]: Received client request to rotate journal, rotating.5914worker1 # [ 107.934328] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/7f53345af2e6487aad14efcdc3acca0b.5915worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5916worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5917worker2 # [ 107.799940] systemd[1]: Stopping Nix worker-protocol over gRPC...5918worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5919client: must succeed: sleep 5.05920worker2 # [ 108.118257] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:10Z level=info event=draining5921lb # [ 110.508766] envoy[997]: conn peer=[2001:db8:1::1]:44636 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9477 tx=3802 ms=61025922client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5923worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5924worker2 # [ 113.196050] nix-daemon[850]: reaped child process 1270, status = succeeded5925worker2 # [ 113.352577] nix-daemon[850]: accepted connection from pid 1310, user nix-grpc-daemon (trusted)5926worker2 # [ 113.364698] nix-daemon[850]: reaped child process 1313, status = succeeded5927lb # [ 113.388097] niks3-server[1256]: 2026/09/20 08:17:15 INFO Received uploads request method=POST path=/api/pending_closures5928worker2 # [ 113.386285] nix-grpc-daemon[1093]: time=2026-09-20T08:17:15.676Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5929worker2 # [ 113.389841] nix-grpc-daemon[1093]: time=2026-09-20T08:17:15.676Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5930lb # [ 113.409990] niks3-server[1256]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5931lb # [ 113.414332] niks3-server[1256]: 2026/09/20 08:17:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5932lb # [ 113.416146] niks3-server[1256]: 2026/09/20 08:17:15 INFO Signed narinfos id=32 count=15933worker2 # [ 113.409968] nix-grpc-daemon[1093]: time=2026-09-20T08:17:15.701Z level=INFO msg="Uploading 1 narinfos"5934lb # [ 113.419806] niks3-server[1256]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5935lb # [ 113.423326] niks3-server[1256]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5936lb # [ 113.429200] niks3-server[1256]: 2026/09/20 08:17:15 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5937lb # [ 113.432988] niks3-server[1256]: 2026/09/20 08:17:15 INFO Completed upload id=325938worker2 # [ 113.425209] nix-grpc-daemon[1093]: time=2026-09-20T08:17:15.716Z level=INFO msg="Upload complete. (236ms)"5939lb # [ 113.434382] niks3-server[1256]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5940worker2 # [ 113.427711] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40276 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15941worker2 # [ 113.435463] nix-daemon[850]: reaped child process 1268, status = succeeded5942client # [ 113.479097] systemd[1]: rs.service: Deactivated successfully.5943client # [ 113.482650] systemd[1]: rs.service: Consumed 105ms CPU time over 8.422s wall clock time, 39.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.5944worker2 # [ 114.119486] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=signal_exit5945worker2 # [ 114.347172] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=scheduler_yield5946lb # [ 114.357353] niks3-server[1256]: 2026/09/20 08:17:16 INFO lead: released remote=192.168.1.4:513405947worker1 # [ 114.392152] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_restarting addr=lb:500515948worker2 # [ 114.354467] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:402605949worker2 # [ 114.359646] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=worker_gone addr=192.168.1.3:500515950worker2 # [ 114.362731] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=scheduler_restarting addr=lb:500515951worker2 # [ 114.365696] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:402605952worker2 # [ 114.368925] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=worker_gone addr=192.168.1.4:500515953worker1 # [ 114.592465] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515954worker2 # [ 114.562385] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500515955worker1 # [ 114.605880] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5956worker2 # [ 114.566629] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5957worker1 # [ 114.806743] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515958worker2 # [ 114.767588] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515959worker1 # [ 114.810484] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_take_over5960lb # [ 114.777218] niks3-server[1256]: 2026/09/20 08:17:17 INFO lead: acquired remote=192.168.1.3:463785961worker1 # [ 114.814611] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05962worker1 # [ 114.823578] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5963worker1 # [ 115.021854] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515964worker1 # [ 115.025719] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5965worker1 # [ 115.226585] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500515966worker1 # [ 115.231275] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05967worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.19 seconds)5968client: waiting for success: ! systemctl is-active rs5969client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5970client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5971worker2 # [ 115.351661] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:17Z level=info event=scheduler_restarting5972worker1 # [ 115.398648] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:336785973worker1 # [ 115.402678] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:18Z level=info event=worker_gone addr=192.168.1.4:500515974worker2 # [ 115.371670] nix-grpc-daemon[1037]: ts=2026-09-20T08:17:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5975client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5976client: must fail: journalctl -u rs | grep -q 'reconnecting'5977worker2 # [ 115.387301] nix-daemon[850]: reaped child process 1086, status = succeeded5978client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5979lb: must succeed: curl -sf localhost:9901/clusters5980lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5981worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5982worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5983worker2 # [ 116.178044] nix-grpc-daemon[1037]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5984worker2 # [ 116.179733] nix-grpc-daemon[1037]: E0000 00:00:1789892238.468457 1080 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5985worker2 # [ 116.181614] nix-grpc-daemon[1037]: E0000 00:00:1789892238.471067 1080 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5986lb: must succeed: curl -sf localhost:9901/clusters5987lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5988worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5989worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5990worker2 # [ 116.936073] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5991worker2 # [ 116.940361] systemd[1]: Stopped Nix worker-protocol over gRPC.5992worker2 # [ 116.942530] systemd[1]: nix-grpc-daemon.service: Consumed 1.483s CPU time over 30.028s wall clock time, 35.7M memory peak, 57.2K incoming IP traffic, 109.6K outgoing IP traffic.5993worker2 # [ 116.959050] systemd[1]: Starting Nix worker-protocol over gRPC...5994worker2 # [ 117.115971] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5995worker2 # [ 117.119918] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15996worker2 # [ 117.126059] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5997worker2 # [ 117.129555] systemd[1]: Started Nix worker-protocol over gRPC.5998worker2 # [ 117.152707] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500515999worker1 # [ 117.197527] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06000lb: must succeed: curl -sf localhost:9901/clusters6001lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6002worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6003worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6004(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.82 seconds)6005subtest: scheduler restart mid-build: build finishes, no double build6006client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid6007client # [ 117.900166] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.6008client # Running as unit: mid.service; invocation ID: ad5d7c24399d40169207d6ff2cc80c4b6009client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)6010worker2 # [ 118.105095] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:507546011worker2 # [ 118.110575] nix-daemon[850]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)6012client # [ 118.126345] nix[1194]: don't know how to build these paths:6013client # [ 118.127295] nix[1194]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6014worker1 # [ 118.166860] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:21Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06015worker1 # [ 118.172349] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:21Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=16016worker1 # [ 118.216323] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:336906017worker1 # [ 118.224338] nix-daemon[917]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)6018worker1 # [ 118.241719] nix-grpc-daemon[1347]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 1/5)6019worker1 # [ 118.324487] nix-grpc-daemon[1347]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 101 ms (attempt 2/5)6020worker1 # [ 118.428196] nix-grpc-daemon[1347]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 288 ms (attempt 3/5)6021worker1 # [ 118.716709] nix-grpc-daemon[1347]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 149 ms (attempt 4/5)6022worker1 # [ 118.871841] nix-grpc-daemon[1347]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6023worker1 # [ 118.889487] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:336906024client # [ 118.867403] nix[1194]: copying 1 paths to 'lb:50051'...6025worker1 # [ 118.901748] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:336906026client # [ 118.872253] nix[1194]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...6027worker1 # [ 118.910580] nix-daemon[917]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)6028worker1 # [ 118.933296] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:21Z level=info event=niks3_push_started pid=14766029worker1 # [ 119.264535] nix-daemon[917]: accepted connection from pid 1493, user nix-grpc-daemon (trusted)6030worker1 # [ 119.275606] nix-daemon[917]: reaped child process 1496, status = succeeded6031worker1 # [ 119.430377] nix-daemon[917]: accepted connection from pid 1498, user nix-grpc-daemon (trusted)6032worker1 # [ 119.441981] nix-daemon[917]: reaped child process 1501, status = succeeded6033lb # [ 119.423661] niks3-server[1256]: 2026/09/20 08:17:21 INFO Received uploads request method=POST path=/api/pending_closures6034worker1 # [ 119.466304] nix-grpc-daemon[1476]: time=2026-09-20T08:17:22.357Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6035worker1 # [ 119.467643] nix-grpc-daemon[1476]: time=2026-09-20T08:17:22.357Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"6036lb # [ 119.463875] niks3-server[1256]: 2026/09/20 08:17:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign6037worker1 # [ 119.505701] nix-grpc-daemon[1476]: time=2026-09-20T08:17:22.397Z level=INFO msg="Uploading 1 narinfos"6038lb # [ 119.471406] niks3-server[1256]: 2026/09/20 08:17:21 INFO Signed narinfos id=33 count=16039lb # [ 119.479769] niks3-server[1256]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst6040lb # [ 119.485504] niks3-server[1256]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls6041lb # [ 119.498249] niks3-server[1256]: 2026/09/20 08:17:22 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete6042lb # [ 119.503612] niks3-server[1256]: 2026/09/20 08:17:22 INFO Completed upload id=336043worker1 # [ 119.540708] nix-grpc-daemon[1476]: time=2026-09-20T08:17:22.432Z level=INFO msg="Upload complete. (427ms)"6044lb # [ 119.507143] niks3-server[1256]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo6045worker1 # [ 119.544887] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33690 duration_s=0 paths=1 nar_bytes_in=4246046worker1 # [ 119.552695] nix-grpc-daemon[1347]: ts=2026-09-20T08:17:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:336906047worker1 # [ 119.561678] nix-daemon[917]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)6048worker1 # [ 119.569315] nix-daemon[917]: reaped child process 1474, status = succeeded6049worker1 # [ 119.574761] nix-daemon[917]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)6050client # [ 119.542455] nix[1194]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6051lb # [ 120.507928] envoy[997]: conn peer=[2001:db8:1::1]:42948 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2930 tx=1329 ms=81986052lb # [ 120.511947] envoy[997]: conn peer=[2001:db8:1::4]:40744 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6889 tx=1656 ms=282216053lb: must succeed: curl -sf localhost:9901/clusters6054lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6055lb: must succeed: curl -sf localhost:9901/clusters6056lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6057worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6058worker1 # [ 121.676454] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1347 (nix-grpc-daemon) on client request.6059worker1 # [ 121.679311] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6060lb # [ 121.652508] niks3-server[1256]: 2026/09/20 08:17:24 INFO lead: released remote=192.168.1.3:463786061client # [ 121.653175] nix[1194]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again6062client # [ 121.655541] nix[1194]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6063worker2 # [ 121.643215] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"6064worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)6065client: must succeed: sleep 5.06066worker1 # [ 121.712338] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6067worker1 # [ 121.714380] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6068worker1 # [ 121.715792] systemd[1]: nix-grpc-daemon.service: Consumed 420ms CPU time over 17.086s wall clock time, 33M memory peak, 14.5K incoming IP traffic, 22.3K outgoing IP traffic.6069worker1 # [ 121.718346] nix-daemon[917]: reaped child process 1503, status = succeeded6070worker1 # [ 121.719297] nix-daemon[917]: reaped child process 1469, status = succeeded6071worker1 # [ 121.726256] nix-daemon[1505]: unexpected Nix daemon error: error: interrupted by the user6072worker1 # [ 121.730192] nix-daemon[917]: reaped child process 1505, status = failed with exit code 16073worker1 # [ 121.835884] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.6074worker1 # [ 121.841147] systemd[1]: Starting Nix worker-protocol over gRPC...6075worker2 # [ 121.843676] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500516076worker1 # [ 121.987505] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:24Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6077worker1 # [ 121.990553] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:24Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16078worker1 # [ 121.996436] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:24Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6079worker1 # [ 122.000132] systemd[1]: Started Nix worker-protocol over gRPC.6080lb # [ 121.973646] niks3-server[1256]: 2026/09/20 08:17:24 INFO lead: acquired remote=192.168.1.3:391246081worker1 # [ 122.012185] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:24Z level=info event=scheduler_take_over6082worker1 # [ 122.015826] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06083worker1 # [ 122.031634] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500516084worker1 # [ 122.033214] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06085worker1 # [ 122.196598] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:25Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06086worker1 # [ 122.200928] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:25Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=16087worker2 # [ 122.199537] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507546088worker2 # [ 122.211325] nix-grpc-daemon[1320]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 1/5)6089worker2 # [ 122.315291] nix-grpc-daemon[1320]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 2/5)6090worker2 # [ 122.328130] nix-grpc-daemon[1320]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 252 ms (attempt 3/5)6091worker2 # [ 122.586464] nix-grpc-daemon[1320]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 188 ms (attempt 4/5)6092worker2 # [ 122.775732] nix-grpc-daemon[1320]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6093worker2 # [ 122.789582] nix-grpc-daemon[1320]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...6094worker2 # [ 122.809850] nix-daemon[850]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)6095client # [ 122.831375] nix[1194]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6096worker2 # [ 122.823127] nix-daemon[850]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)6097client: (finished: must succeed: sleep 5.0, in 5.05 seconds)6098client: waiting for success: ! systemctl is-active mid6099worker2 # [ 127.043687] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:29Z level=info event=niks3_push_started pid=14216100worker2 # [ 127.070830] nix-daemon[850]: reaped child process 1397, status = succeeded6101worker2 # [ 127.405137] nix-daemon[850]: accepted connection from pid 1434, user nix-grpc-daemon (trusted)6102worker2 # [ 127.417109] nix-daemon[850]: reaped child process 1437, status = succeeded6103lb # [ 127.443773] niks3-server[1256]: 2026/09/20 08:17:29 INFO Received uploads request method=POST path=/api/pending_closures6104worker2 # [ 127.444158] nix-grpc-daemon[1421]: time=2026-09-20T08:17:29.735Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6105worker2 # [ 127.445663] nix-grpc-daemon[1421]: time=2026-09-20T08:17:29.736Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"6106lb # [ 127.490150] niks3-server[1256]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6107lb # [ 127.498175] niks3-server[1256]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6108lb # [ 127.506163] niks3-server[1256]: 2026/09/20 08:17:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign6109lb # [ 127.509924] niks3-server[1256]: 2026/09/20 08:17:30 INFO Signed narinfos id=34 count=16110worker2 # [ 127.504385] nix-grpc-daemon[1421]: time=2026-09-20T08:17:29.795Z level=INFO msg="Uploading 1 narinfos"6111lb # [ 127.514493] niks3-server[1256]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls6112lb # [ 127.523077] niks3-server[1256]: 2026/09/20 08:17:30 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete6113lb # [ 127.527099] niks3-server[1256]: 2026/09/20 08:17:30 INFO Completed upload id=346114worker2 # [ 127.519460] nix-grpc-daemon[1421]: time=2026-09-20T08:17:29.810Z level=INFO msg="Upload complete. (269ms)"6115worker2 # [ 127.523952] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50754 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=16116worker2 # [ 127.529447] nix-grpc-daemon[1421]: time=2026-09-20T08:17:29.820Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo error="server returned 404: object is not pending upload\n"6117worker2 # [ 127.540090] nix-daemon[850]: reaped child process 1395, status = succeeded6118client # [ 127.558712] systemd[1]: mid.service: Deactivated successfully.6119client # [ 127.560447] systemd[1]: mid.service: Consumed 112ms CPU time over 9.660s wall clock time, 39.3M memory peak, 9.7K incoming IP traffic, 10.6K outgoing IP traffic.6120client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)6121client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6122client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)6123(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.26 seconds)6124subtest: interrupting the client stops the build on the worker6125client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr6126client # [ 128.135099] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.6127client # Running as unit: intr.service; invocation ID: ae4311697454432887cbcbc27581b34e6128client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)6129worker1 # [ 128.371777] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:605666130worker1 # [ 128.382935] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6131client # [ 128.362417] nix[1230]: don't know how to build these paths:6132client # [ 128.363367] nix[1230]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6133worker1 # [ 128.403446] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:31Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06134worker1 # [ 128.408142] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:31Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=16135worker1 # [ 128.451516] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666136worker1 # [ 128.462298] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5)6137worker1 # [ 128.562242] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 2/5)6138worker1 # [ 128.693813] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 3/5)6139worker1 # [ 128.787673] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 555 ms (attempt 4/5)6140worker1 # [ 129.349605] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6141worker1 # [ 129.369140] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666142client # [ 129.348344] nix[1230]: copying 1 paths to 'lb:50051'...6143client # [ 129.352155] nix[1230]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6144worker1 # [ 129.385156] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666145worker1 # [ 129.392538] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6146worker1 # [ 129.407152] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:32Z level=info event=niks3_push_started pid=16176147worker1 # [ 129.738743] nix-daemon[917]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)6148worker1 # [ 129.749911] nix-daemon[917]: reaped child process 1633, status = succeeded6149worker1 # [ 129.919203] nix-daemon[917]: accepted connection from pid 1635, user nix-grpc-daemon (trusted)6150worker1 # [ 129.931308] nix-daemon[917]: reaped child process 1638, status = succeeded6151lb # [ 129.918214] niks3-server[1256]: 2026/09/20 08:17:32 INFO Received uploads request method=POST path=/api/pending_closures6152worker1 # [ 129.963523] nix-grpc-daemon[1617]: time=2026-09-20T08:17:32.855Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6153worker1 # [ 129.966746] nix-grpc-daemon[1617]: time=2026-09-20T08:17:32.857Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6154lb # [ 129.962598] niks3-server[1256]: 2026/09/20 08:17:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign6155worker1 # [ 130.005691] nix-grpc-daemon[1617]: time=2026-09-20T08:17:32.897Z level=INFO msg="Uploading 1 narinfos"6156lb # [ 129.972206] niks3-server[1256]: 2026/09/20 08:17:32 INFO Signed narinfos id=35 count=16157lb # [ 129.981063] niks3-server[1256]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6158lb # [ 129.994844] niks3-server[1256]: 2026/09/20 08:17:32 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete6159lb # [ 130.000393] niks3-server[1256]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6160lb # [ 130.003513] niks3-server[1256]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6161lb # [ 130.006199] niks3-server[1256]: 2026/09/20 08:17:32 INFO Completed upload id=356162worker1 # [ 130.040342] nix-grpc-daemon[1617]: time=2026-09-20T08:17:32.932Z level=INFO msg="Upload complete. (464ms)"6163worker1 # [ 130.045163] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=4246164worker1 # [ 130.050553] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666165worker1 # [ 130.059125] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6166worker1 # [ 130.067136] nix-daemon[917]: reaped child process 1615, status = succeeded6167worker1 # [ 130.073332] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6168client # [ 130.040327] nix[1230]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6169lb # [ 130.509174] envoy[997]: conn peer=[2001:db8:1::3]:50272 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1391 tx=468 ms=168616170lb # [ 130.513181] envoy[997]: conn peer=[2001:db8:1::1]:56876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1660 ms=94326171client: must succeed: systemctl kill -s INT intr6172client # [ 131.727092] systemd[1]: intr.service: Sent signal SIGINT to main process 1230 (nix) on client request.6173worker1 # [ 131.761103] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:34Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6174client # [ 131.733326] nix[1230]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6175client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)6176client # [ 131.740731] nix[1230]: error: interrupted by the user6177client # [ 131.763952] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6178client # [ 131.765805] systemd[1]: intr.service: Failed with result 'exit-code'.6179client # [ 131.767413] systemd[1]: intr.service: Consumed 104ms CPU time over 3.630s wall clock time, 37.1M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.6180worker1 # [ 131.891246] nix-daemon[917]: reaped child process 1640, status = succeeded6181worker1 # [ 131.892545] nix-daemon[1642]: unexpected Nix daemon error: error: interrupted by the user6182worker1 # [ 131.896402] nix-daemon[917]: reaped child process 1642, status = failed with exit code 16183(finished: subtest: interrupting the client stops the build on the worker, in 4.88 seconds)6184subtest: a deploy mid-build drains: the build finishes, the new generation takes over6185client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw6186client # [ 133.040672] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.6187client # Running as unit: sw.service; invocation ID: 23f294f9ef3147b4b35e01924c379de46188client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)6189client # [ 133.251187] nix[1250]: don't know how to build these paths:6190client # [ 133.252155] nix[1250]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6191worker1 # [ 133.282502] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:605666192worker1 # [ 133.294842] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:36Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06193worker1 # [ 133.298811] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:36Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=16194worker2 # [ 133.297946] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507546195worker2 # [ 133.310879] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507546196client # [ 133.331271] nix[1250]: copying 1 paths to 'lb:50051'...6197worker2 # [ 133.323141] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507546198client # [ 133.334133] nix[1250]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6199worker2 # [ 133.336158] nix-daemon[850]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)6200worker2 # [ 133.506536] nix-daemon[850]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)6201worker2 # [ 133.518603] nix-daemon[850]: reaped child process 1472, status = succeeded6202worker2 # [ 133.682046] nix-daemon[850]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)6203worker2 # [ 133.693770] nix-daemon[850]: reaped child process 1477, status = succeeded6204lb # [ 133.718878] niks3-server[1256]: 2026/09/20 08:17:36 INFO Received uploads request method=POST path=/api/pending_closures6205worker2 # [ 133.720191] nix-grpc-daemon[1421]: time=2026-09-20T08:17:36.010Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6206worker2 # [ 133.721648] nix-grpc-daemon[1421]: time=2026-09-20T08:17:36.010Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6207lb # [ 133.747708] niks3-server[1256]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6208lb # [ 133.756701] niks3-server[1256]: 2026/09/20 08:17:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign6209worker2 # [ 133.753859] nix-grpc-daemon[1421]: time=2026-09-20T08:17:36.044Z level=INFO msg="Uploading 1 narinfos"6210lb # [ 133.761118] niks3-server[1256]: 2026/09/20 08:17:36 INFO Signed narinfos id=36 count=16211lb # [ 133.767132] niks3-server[1256]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6212lb # [ 133.777477] niks3-server[1256]: 2026/09/20 08:17:36 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete6213lb # [ 133.782162] niks3-server[1256]: 2026/09/20 08:17:36 INFO Completed upload id=366214worker2 # [ 133.774233] nix-grpc-daemon[1421]: time=2026-09-20T08:17:36.065Z level=INFO msg="Upload complete. (426ms)"6215lb # [ 133.783648] niks3-server[1256]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6216worker2 # [ 133.777935] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50754 duration_s=0 paths=1 nar_bytes_in=4166217worker2 # [ 133.783276] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507546218worker2 # [ 133.791265] nix-daemon[850]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)6219worker2 # [ 133.796217] nix-daemon[850]: reaped child process 1467, status = succeeded6220worker2 # [ 133.801093] nix-daemon[850]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)6221client # [ 133.810000] nix[1250]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6222worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26223worker2 # Checking switch inhibitors... done6224worker2 # activating the configuration...6225worker2 # [ 136.228775] nixos[1512]: switching to system configuration /nix/store/0sd7392fsyrxrxkry5702q2g6zn71g87-nixos-system-worker2-test6226worker2 # [ 136.232342] systemd[1]: Stopped target Local File Systems.6227worker2 # [ 136.234457] systemd[1]: Stopped target Remote File Systems.6228worker2 # setting up /etc...6229worker2 # [ 136.848596] systemd[1]: Reload requested from client PID 1512 ('.switch-to-conf') (unit backdoor.service)...6230worker2 # [ 136.851218] systemd[1]: Reloading...6231worker2 # [ 137.546083] systemd[1]: Reloading finished in 693 ms.6232worker2 # restarting sysinit-reactivation.target6233worker2 # [ 137.605912] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6234worker2 # [ 137.738290] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6235worker2 # [ 137.741503] systemd[1]: Reached target Reactivate sysinit units.6236worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6237worker2 # [ 137.746928] systemd[1]: Reloading D-Bus System Message Bus...6238worker2 # [ 137.747919] dbus-broker-launch[535]: Caught SIGHUP, trigger reload.6239worker2 # [ 137.750617] systemd[1]: Reloading Nix worker-protocol over gRPC...6240worker2 # [ 137.779373] dbus-broker-launch[535]: Looking up NSS user entry for 'systemd-timesync'...6241worker2 # [ 137.782578] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync'6242worker2 # [ 137.783578] dbus-broker-launch[535]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6243worker2 # [ 137.795315] systemd[1]: Reloaded Nix worker-protocol over gRPC.6244worker2 # [ 137.814145] systemd[1]: Reloaded D-Bus System Message Bus.6245worker2 # [ 137.819126] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6246worker2 # [ 137.820439] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6247worker2 # [ 137.826342] systemd[1]: Reached target Local File Systems.6248worker2 # [ 137.827151] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6249worker2 # [ 137.832355] systemd[1]: Starting Create SUID/SGID Wrappers...6250worker2 # [ 137.833655] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6251worker2 # [ 137.834936] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676252worker2 # [ 137.837123] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6253worker2 # [ 137.839901] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6254worker2 # [ 137.844138] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6255worker2 # [ 137.845794] systemd[1]: Reached target Remote File Systems.6256worker2 # [ 138.133543] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:40Z level=info event=draining6257worker2 # [ 138.246163] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6258worker2 # [ 138.249239] systemd[1]: Finished Create SUID/SGID Wrappers.6259worker2 # [ 138.251336] systemd[1]: Starting linger-users.service...6260worker2 # [ 138.294073] systemd[1]: linger-users.service: Deactivated successfully.6261worker2 # [ 138.294950] systemd[1]: Finished linger-users.service.6262worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6263worker2 # [ 138.553353] nixos[1512]: finished switching to system configuration /nix/store/0sd7392fsyrxrxkry5702q2g6zn71g87-nixos-system-worker2-test6264worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.01 seconds)6265worker2: must succeed: pgrep -f 'read -t [9]0 x'6266worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6267client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&26268client # don't know how to build these paths:6269client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6270worker1 # [ 138.850893] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:605666271worker1 # [ 138.860456] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:41Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06272worker1 # [ 138.865465] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:41Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16273worker1 # [ 138.903605] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666274worker1 # [ 138.918581] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666275client # copying 1 paths to 'lb:50051'...6276worker1 # [ 138.930605] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666277client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6278worker1 # [ 138.948240] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6279worker1 # [ 139.127080] nix-daemon[917]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)6280worker1 # [ 139.139793] nix-daemon[917]: reaped child process 1699, status = succeeded6281worker1 # [ 139.306638] nix-daemon[917]: accepted connection from pid 1701, user nix-grpc-daemon (trusted)6282worker1 # [ 139.318819] nix-daemon[917]: reaped child process 1704, status = succeeded6283lb # [ 139.302599] niks3-server[1256]: 2026/09/20 08:17:41 INFO Received uploads request method=POST path=/api/pending_closures6284worker1 # [ 139.349583] nix-grpc-daemon[1617]: time=2026-09-20T08:17:42.241Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6285worker1 # [ 139.351153] nix-grpc-daemon[1617]: time=2026-09-20T08:17:42.241Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6286lb # [ 139.334670] niks3-server[1256]: 2026/09/20 08:17:41 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6287lb # [ 139.346675] niks3-server[1256]: 2026/09/20 08:17:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6288worker1 # [ 139.386518] nix-grpc-daemon[1617]: time=2026-09-20T08:17:42.278Z level=INFO msg="Uploading 1 narinfos"6289lb # [ 139.352572] niks3-server[1256]: 2026/09/20 08:17:41 INFO Signed narinfos id=37 count=16290lb # [ 139.358655] niks3-server[1256]: 2026/09/20 08:17:41 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6291lb # [ 139.368959] niks3-server[1256]: 2026/09/20 08:17:41 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6292worker1 # [ 139.409360] nix-grpc-daemon[1617]: time=2026-09-20T08:17:42.301Z level=INFO msg="Upload complete. (448ms)"6293lb # [ 139.375791] niks3-server[1256]: 2026/09/20 08:17:41 INFO Completed upload id=376294lb # [ 139.379298] niks3-server[1256]: 2026/09/20 08:17:41 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6295worker1 # [ 139.412350] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=5286296worker1 # [ 139.417482] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666297worker1 # [ 139.426485] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6298worker1 # [ 139.433944] nix-daemon[917]: reaped child process 1694, status = succeeded6299worker1 # [ 139.438845] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6300client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6301client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6302client # farm-a> LOG-farm-a-during-drain6303worker1 # [ 140.452296] nix-daemon[917]: reaped child process 1708, status = succeeded6304lb # [ 140.509763] envoy[997]: conn peer=[2001:db8:1::1]:37170 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=756 ms=34156305worker1 # [ 140.594513] nix-daemon[917]: accepted connection from pid 1723, user nix-grpc-daemon (trusted)6306worker1 # [ 140.606636] nix-daemon[917]: reaped child process 1726, status = succeeded6307lb # [ 140.591365] niks3-server[1256]: 2026/09/20 08:17:43 INFO Received uploads request method=POST path=/api/pending_closures6308worker1 # [ 140.633775] nix-grpc-daemon[1617]: time=2026-09-20T08:17:43.525Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6309worker1 # [ 140.637274] nix-grpc-daemon[1617]: time=2026-09-20T08:17:43.527Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6310lb # [ 140.621764] niks3-server[1256]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6311lb # [ 140.642311] niks3-server[1256]: 2026/09/20 08:17:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6312lb # [ 140.648758] niks3-server[1256]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6313lb # [ 140.652949] niks3-server[1256]: 2026/09/20 08:17:43 INFO Signed narinfos id=38 count=16314worker1 # [ 140.689819] nix-grpc-daemon[1617]: time=2026-09-20T08:17:43.581Z level=INFO msg="Uploading 1 narinfos"6315lb # [ 140.655820] niks3-server[1256]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6316lb # [ 140.667441] niks3-server[1256]: 2026/09/20 08:17:43 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6317lb # [ 140.670750] niks3-server[1256]: 2026/09/20 08:17:43 INFO Completed upload id=386318worker1 # [ 140.704870] nix-grpc-daemon[1617]: time=2026-09-20T08:17:43.596Z level=INFO msg="Upload complete. (259ms)"6319lb # [ 140.672799] niks3-server[1256]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6320worker1 # [ 140.711654] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16321worker1 # [ 140.719448] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:43Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06322worker1 # [ 140.723320] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:43Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16323worker1 # [ 140.731126] nix-daemon[917]: reaped child process 1706, status = succeeded6324worker1 # [ 140.763702] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666325worker1 # [ 140.776753] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666326worker1 # [ 140.790186] nix-grpc-daemon[1617]: time=2026-09-20T08:17:43.682Z level=INFO msg="All 1 paths already cached"6327client # copying 1 paths to 'lb:50051'...6328worker1 # [ 140.797979] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666329client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6330worker1 # [ 140.815322] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6331worker1 # [ 141.005130] nix-daemon[917]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6332worker1 # [ 141.018095] nix-daemon[917]: reaped child process 1735, status = succeeded6333worker1 # [ 141.189915] nix-daemon[917]: accepted connection from pid 1737, user nix-grpc-daemon (trusted)6334worker1 # [ 141.202293] nix-daemon[917]: reaped child process 1740, status = succeeded6335lb # [ 141.186350] niks3-server[1256]: 2026/09/20 08:17:43 INFO Received uploads request method=POST path=/api/pending_closures6336worker1 # [ 141.229437] nix-grpc-daemon[1617]: time=2026-09-20T08:17:44.121Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6337worker1 # [ 141.230866] nix-grpc-daemon[1617]: time=2026-09-20T08:17:44.121Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6338lb # [ 141.211735] niks3-server[1256]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6339lb # [ 141.225524] niks3-server[1256]: 2026/09/20 08:17:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6340lb # [ 141.230314] niks3-server[1256]: 2026/09/20 08:17:43 INFO Signed narinfos id=39 count=16341worker1 # [ 141.267155] nix-grpc-daemon[1617]: time=2026-09-20T08:17:44.159Z level=INFO msg="Uploading 1 narinfos"6342lb # [ 141.235238] niks3-server[1256]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6343lb # [ 141.246896] niks3-server[1256]: 2026/09/20 08:17:43 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6344worker1 # [ 141.286079] nix-grpc-daemon[1617]: time=2026-09-20T08:17:44.178Z level=INFO msg="Upload complete. (456ms)"6345lb # [ 141.252234] niks3-server[1256]: 2026/09/20 08:17:43 INFO Completed upload id=396346worker1 # [ 141.288214] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=6406347lb # [ 141.257782] niks3-server[1256]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6348worker1 # [ 141.291837] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666349worker1 # [ 141.300059] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6350worker1 # [ 141.304578] nix-daemon[917]: reaped child process 1730, status = succeeded6351client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6352client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6353worker1 # [ 141.308924] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6354client # farm-b> LOG-farm-b-during-drain6355worker1 # [ 142.322523] nix-daemon[917]: reaped child process 1744, status = succeeded6356worker1 # [ 142.476066] nix-daemon[917]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6357worker1 # [ 142.487084] nix-daemon[917]: reaped child process 1762, status = succeeded6358lb # [ 142.470921] niks3-server[1256]: 2026/09/20 08:17:44 INFO Received uploads request method=POST path=/api/pending_closures6359worker1 # [ 142.512278] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.404Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6360worker1 # [ 142.513880] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.406Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6361lb # [ 142.502567] niks3-server[1256]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6362lb # [ 142.519081] niks3-server[1256]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6363lb # [ 142.528178] niks3-server[1256]: 2026/09/20 08:17:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6364lb # [ 142.532860] niks3-server[1256]: 2026/09/20 08:17:45 INFO Signed narinfos id=40 count=16365worker1 # [ 142.569451] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.461Z level=INFO msg="Uploading 1 narinfos"6366lb # [ 142.542852] niks3-server[1256]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6367lb # [ 142.552062] niks3-server[1256]: 2026/09/20 08:17:45 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6368lb # [ 142.555479] niks3-server[1256]: 2026/09/20 08:17:45 INFO Completed upload id=406369worker1 # [ 142.589666] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.481Z level=INFO msg="Upload complete. (272ms)"6370lb # [ 142.557963] niks3-server[1256]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6371worker1 # [ 142.603169] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16372worker1 # [ 142.608862] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06373worker1 # [ 142.614226] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16374worker1 # [ 142.622144] nix-daemon[917]: reaped child process 1742, status = succeeded6375worker1 # [ 142.646156] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666376worker1 # [ 142.654556] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666377worker1 # [ 142.663829] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.555Z level=INFO msg="All 2 paths already cached"6378client # copying 1 paths to 'lb:50051'...6379worker1 # [ 142.669325] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666380client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6381worker1 # [ 142.686859] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6382worker1 # [ 142.859838] nix-daemon[917]: accepted connection from pid 1768, user nix-grpc-daemon (trusted)6383worker1 # [ 142.872670] nix-daemon[917]: reaped child process 1771, status = succeeded6384worker1 # [ 143.036315] nix-daemon[917]: accepted connection from pid 1773, user nix-grpc-daemon (trusted)6385worker1 # [ 143.048241] nix-daemon[917]: reaped child process 1776, status = succeeded6386lb # [ 143.031282] niks3-server[1256]: 2026/09/20 08:17:45 INFO Received uploads request method=POST path=/api/pending_closures6387worker1 # [ 143.069520] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.961Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6388worker1 # [ 143.070956] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.961Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6389lb # [ 143.044158] niks3-server[1256]: 2026/09/20 08:17:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6390lb # [ 143.046963] niks3-server[1256]: 2026/09/20 08:17:45 INFO Signed narinfos id=41 count=16391worker1 # [ 143.081069] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.973Z level=INFO msg="Uploading 1 narinfos"6392lb # [ 143.049437] niks3-server[1256]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6393lb # [ 143.054415] niks3-server[1256]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6394lb # [ 143.057782] niks3-server[1256]: 2026/09/20 08:17:45 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6395lb # [ 143.062226] niks3-server[1256]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6396lb # [ 143.065547] niks3-server[1256]: 2026/09/20 08:17:45 INFO Completed upload id=416397worker1 # [ 143.099403] nix-grpc-daemon[1617]: time=2026-09-20T08:17:45.991Z level=INFO msg="Upload complete. (401ms)"6398worker1 # [ 143.101449] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=7686399worker1 # [ 143.103872] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666400worker1 # [ 143.109951] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6401worker1 # [ 143.113488] nix-daemon[917]: reaped child process 1766, status = succeeded6402worker1 # [ 143.118741] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6403client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6404client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6405client # farm-top> LOG-farm-top-during-drain6406worker1 # [ 144.743760] nix-daemon[917]: reaped child process 1780, status = succeeded6407worker1 # [ 144.912386] nix-daemon[917]: accepted connection from pid 1795, user nix-grpc-daemon (trusted)6408worker1 # [ 144.923531] nix-daemon[917]: reaped child process 1798, status = succeeded6409lb # [ 144.903439] niks3-server[1256]: 2026/09/20 08:17:47 INFO Received uploads request method=POST path=/api/pending_closures6410worker1 # [ 144.946752] nix-grpc-daemon[1617]: time=2026-09-20T08:17:47.838Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6411worker1 # [ 144.948247] nix-grpc-daemon[1617]: time=2026-09-20T08:17:47.840Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6412lb # [ 144.942284] niks3-server[1256]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6413lb # [ 144.951430] niks3-server[1256]: 2026/09/20 08:17:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6414lb # [ 144.956421] niks3-server[1256]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6415lb # [ 144.959992] niks3-server[1256]: 2026/09/20 08:17:47 INFO Signed narinfos id=42 count=16416worker1 # [ 144.996549] nix-grpc-daemon[1617]: time=2026-09-20T08:17:47.888Z level=INFO msg="Uploading 1 narinfos"6417lb # [ 144.966536] niks3-server[1256]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6418lb # [ 144.971697] niks3-server[1256]: 2026/09/20 08:17:47 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6419lb # [ 144.978143] niks3-server[1256]: 2026/09/20 08:17:47 INFO Completed upload id=426420worker1 # [ 145.012054] nix-grpc-daemon[1617]: time=2026-09-20T08:17:47.904Z level=INFO msg="Upload complete. (283ms)"6421lb # [ 144.979440] niks3-server[1256]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6422worker1 # [ 145.019159] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16423worker1 # [ 145.029329] nix-daemon[917]: reaped child process 1778, status = succeeded6424client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 6.41 seconds)6425client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6426client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.17 seconds)6427worker2: must succeed: pkill -f 'read -t [9]0 x'6428worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6429client: waiting for success: ! systemctl is-active sw6430worker2 # [ 145.435716] nix-daemon[850]: reaped child process 1481, status = succeeded6431worker2 # [ 145.618110] nix-daemon[850]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6432worker2 # [ 145.631400] nix-daemon[850]: reaped child process 1655, status = succeeded6433lb # [ 145.654513] niks3-server[1256]: 2026/09/20 08:17:48 INFO Received uploads request method=POST path=/api/pending_closures6434worker2 # [ 145.651372] nix-grpc-daemon[1421]: time=2026-09-20T08:17:47.942Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6435worker2 # [ 145.652948] nix-grpc-daemon[1421]: time=2026-09-20T08:17:47.944Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6436lb # [ 145.683280] niks3-server[1256]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6437lb # [ 145.696178] niks3-server[1256]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6438lb # [ 145.705990] niks3-server[1256]: 2026/09/20 08:17:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6439worker2 # [ 145.703705] nix-grpc-daemon[1421]: time=2026-09-20T08:17:47.994Z level=INFO msg="Uploading 1 narinfos"6440lb # [ 145.711406] niks3-server[1256]: 2026/09/20 08:17:48 INFO Signed narinfos id=43 count=16441lb # [ 145.715456] niks3-server[1256]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6442lb # [ 145.724121] niks3-server[1256]: 2026/09/20 08:17:48 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6443lb # [ 145.729854] niks3-server[1256]: 2026/09/20 08:17:48 INFO Completed upload id=436444worker2 # [ 145.722191] nix-grpc-daemon[1421]: time=2026-09-20T08:17:48.013Z level=INFO msg="Upload complete. (303ms)"6445lb # [ 145.732902] niks3-server[1256]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6446worker2 # [ 145.729327] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50754 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16447worker2 # [ 145.741272] nix-daemon[850]: reaped child process 1479, status = succeeded6448client # [ 145.775636] systemd[1]: sw.service: Deactivated successfully.6449client # [ 145.779938] systemd[1]: sw.service: Consumed 112ms CPU time over 12.738s wall clock time, 37.3M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.6450worker2 # [ 146.135278] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:48Z level=info event=signal_exit6451client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)6452client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6453client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6454worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6455worker2 # [ 147.367518] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:49Z level=info event=scheduler_restarting6456worker1 # [ 147.409283] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:337206457worker1 # [ 147.412876] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:50Z level=info event=worker_gone addr=192.168.1.4:500516458worker2 # [ 147.383492] nix-grpc-daemon[1320]: ts=2026-09-20T08:17:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6459worker2 # [ 147.399344] nix-daemon[850]: reaped child process 1373, status = succeeded6460worker2 # [ 147.971608] nix-grpc-daemon[1320]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6461worker2 # [ 147.975108] nix-grpc-daemon[1320]: E0000 00:00:1789892270.262625 1363 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6462worker2 # [ 147.979690] nix-grpc-daemon[1320]: E0000 00:00:1789892270.262817 1363 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6463worker2 # [ 149.185253] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6464worker2 # [ 149.186438] systemd[1]: nix-grpc-daemon.service: Consumed 667ms CPU time over 32.225s wall clock time, 32.4M memory peak, 20.6K incoming IP traffic, 26.9K outgoing IP traffic.6465worker2 # [ 149.193830] systemd[1]: Starting Nix worker-protocol over gRPC...6466worker2 # [ 149.368284] nix-grpc-daemon[1669]: ts=2026-09-20T08:17:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6467worker2 # [ 149.371601] nix-grpc-daemon[1669]: ts=2026-09-20T08:17:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16468worker2 # [ 149.377636] nix-grpc-daemon[1669]: ts=2026-09-20T08:17:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6469worker2 # [ 149.379181] systemd[1]: Started Nix worker-protocol over gRPC.6470worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.03 seconds)6471lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6472lb: must succeed: curl -sf localhost:9901/clusters6473worker2 # [ 149.412400] nix-grpc-daemon[1669]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500516474worker1 # [ 149.458083] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06475lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6476lb: must succeed: curl -sf localhost:9901/clusters6477lb # [ 150.511106] envoy[997]: conn peer=[2001:db8:1::1]:42172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9485 tx=3755 ms=61806478lb # [ 150.514841] envoy[997]: conn peer=[2001:db8:1::1]:42162 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1352 ms=125036479lb # [ 150.519268] envoy[997]: conn peer=[2001:db8:1::4]:58768 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1104 tx=425 ms=302196480lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6481lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.17 seconds)6482lb: must succeed: curl -sf localhost:9901/clusters6483lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6484worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6485worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6486(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.70 seconds)6487subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6488client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16489worker1 # [ 150.929613] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:605666490worker1 # [ 150.943694] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06491worker1 # [ 150.948784] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16492worker1 # [ 150.953126] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06493worker1 # [ 150.956918] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06494worker1 # [ 150.987245] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666495worker1 # [ 151.000115] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666496worker1 # [ 151.011261] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666497worker1 # [ 151.022181] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6498worker1 # [ 151.199632] nix-daemon[917]: accepted connection from pid 1809, user nix-grpc-daemon (trusted)6499worker1 # [ 151.211981] nix-daemon[917]: reaped child process 1812, status = succeeded6500worker1 # [ 151.374661] nix-daemon[917]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)6501worker1 # [ 151.387093] nix-daemon[917]: reaped child process 1817, status = succeeded6502lb # [ 151.370580] niks3-server[1256]: 2026/09/20 08:17:53 INFO Received uploads request method=POST path=/api/pending_closures6503worker1 # [ 151.412464] nix-grpc-daemon[1617]: time=2026-09-20T08:17:54.304Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6504worker1 # [ 151.413930] nix-grpc-daemon[1617]: time=2026-09-20T08:17:54.304Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6505lb # [ 151.394078] niks3-server[1256]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6506lb # [ 151.407382] niks3-server[1256]: 2026/09/20 08:17:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6507worker1 # [ 151.447245] nix-grpc-daemon[1617]: time=2026-09-20T08:17:54.339Z level=INFO msg="Uploading 1 narinfos"6508lb # [ 151.413768] niks3-server[1256]: 2026/09/20 08:17:53 INFO Signed narinfos id=44 count=16509lb # [ 151.418564] niks3-server[1256]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6510lb # [ 151.428450] niks3-server[1256]: 2026/09/20 08:17:53 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6511lb # [ 151.435927] niks3-server[1256]: 2026/09/20 08:17:53 INFO Completed upload id=446512worker1 # [ 151.472212] nix-grpc-daemon[1617]: time=2026-09-20T08:17:54.364Z level=INFO msg="Upload complete. (438ms)"6513lb # [ 151.438618] niks3-server[1256]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6514worker1 # [ 151.474213] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=5046515worker1 # [ 151.478957] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666516worker1 # [ 151.489109] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6517worker1 # [ 151.493204] nix-daemon[917]: reaped child process 1807, status = succeeded6518worker1 # [ 151.498130] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6519worker1 # [ 152.913773] nix-daemon[917]: reaped child process 1821, status = succeeded6520worker1 # [ 153.054776] nix-daemon[917]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6521worker1 # [ 153.067264] nix-daemon[917]: reaped child process 1839, status = succeeded6522lb # [ 153.051864] niks3-server[1256]: 2026/09/20 08:17:55 INFO Received uploads request method=POST path=/api/pending_closures6523worker1 # [ 153.091478] nix-grpc-daemon[1617]: time=2026-09-20T08:17:55.983Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6524worker1 # [ 153.093171] nix-grpc-daemon[1617]: time=2026-09-20T08:17:55.985Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6525lb # [ 153.083734] niks3-server[1256]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6526lb # [ 153.092820] niks3-server[1256]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6527lb # [ 153.105542] niks3-server[1256]: 2026/09/20 08:17:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6528lb # [ 153.110685] niks3-server[1256]: 2026/09/20 08:17:55 INFO Signed narinfos id=45 count=16529worker1 # [ 153.147569] nix-grpc-daemon[1617]: time=2026-09-20T08:17:56.039Z level=INFO msg="Uploading 1 narinfos"6530lb # [ 153.116512] niks3-server[1256]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6531lb # [ 153.125576] niks3-server[1256]: 2026/09/20 08:17:55 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6532lb # [ 153.130574] niks3-server[1256]: 2026/09/20 08:17:55 INFO Completed upload id=456533worker1 # [ 153.164159] nix-grpc-daemon[1617]: time=2026-09-20T08:17:56.056Z level=INFO msg="Upload complete. (258ms)"6534lb # [ 153.135705] niks3-server[1256]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6535worker1 # [ 153.170503] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16536worker1 # [ 153.178314] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16537worker1 # [ 153.183445] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666538worker1 # [ 153.187556] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06539worker1 # [ 153.195917] nix-daemon[917]: reaped child process 1819, status = succeeded6540worker1 # [ 153.197951] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666541worker1 # [ 153.204520] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666542worker1 # [ 153.208206] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6543worker1 # [ 153.356881] nix-daemon[917]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)6544worker1 # [ 153.369258] nix-daemon[917]: reaped child process 1848, status = succeeded6545worker1 # [ 153.520121] nix-daemon[917]: accepted connection from pid 1850, user nix-grpc-daemon (trusted)6546worker1 # [ 153.532613] nix-daemon[917]: reaped child process 1853, status = succeeded6547lb # [ 153.509653] niks3-server[1256]: 2026/09/20 08:17:56 INFO Received uploads request method=POST path=/api/pending_closures6548worker1 # [ 153.550961] nix-grpc-daemon[1617]: time=2026-09-20T08:17:56.442Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6549worker1 # [ 153.552328] nix-grpc-daemon[1617]: time=2026-09-20T08:17:56.442Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6550lb # [ 153.532534] niks3-server[1256]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6551lb # [ 153.543960] niks3-server[1256]: 2026/09/20 08:17:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6552lb # [ 153.549106] niks3-server[1256]: 2026/09/20 08:17:56 INFO Signed narinfos id=46 count=16553worker1 # [ 153.585809] nix-grpc-daemon[1617]: time=2026-09-20T08:17:56.477Z level=INFO msg="Uploading 1 narinfos"6554lb # [ 153.554995] niks3-server[1256]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6555lb # [ 153.566816] niks3-server[1256]: 2026/09/20 08:17:56 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6556worker1 # [ 153.605308] nix-grpc-daemon[1617]: time=2026-09-20T08:17:56.497Z level=INFO msg="Upload complete. (391ms)"6557lb # [ 153.571521] niks3-server[1256]: 2026/09/20 08:17:56 INFO Completed upload id=466558worker1 # [ 153.607227] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=5046559lb # [ 153.574730] niks3-server[1256]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6560worker1 # [ 153.612354] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666561worker1 # [ 153.617944] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6562worker1 # [ 153.620286] nix-daemon[917]: reaped child process 1843, status = succeeded6563worker1 # [ 153.625535] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6564worker1 # [ 154.238194] nix-daemon[917]: reaped child process 1857, status = succeeded6565worker1 # [ 154.378509] nix-daemon[917]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)6566worker1 # [ 154.390519] nix-daemon[917]: reaped child process 1875, status = succeeded6567lb # [ 154.372147] niks3-server[1256]: 2026/09/20 08:17:56 INFO Received uploads request method=POST path=/api/pending_closures6568worker1 # [ 154.411735] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.303Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6569worker1 # [ 154.413230] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.305Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6570lb # [ 154.411976] niks3-server[1256]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6571lb # [ 154.421797] niks3-server[1256]: 2026/09/20 08:17:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6572lb # [ 154.427864] niks3-server[1256]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6573lb # [ 154.435108] niks3-server[1256]: 2026/09/20 08:17:56 INFO Signed narinfos id=47 count=16574worker1 # [ 154.471642] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.363Z level=INFO msg="Uploading 1 narinfos"6575lb # [ 154.437956] niks3-server[1256]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6576lb # [ 154.449112] niks3-server[1256]: 2026/09/20 08:17:56 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6577lb # [ 154.455085] niks3-server[1256]: 2026/09/20 08:17:56 INFO Completed upload id=476578worker1 # [ 154.489166] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.381Z level=INFO msg="Upload complete. (257ms)"6579lb # [ 154.456876] niks3-server[1256]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6580worker1 # [ 154.497150] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16581worker1 # [ 154.502628] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16582worker1 # [ 154.512262] nix-daemon[917]: reaped child process 1855, status = succeeded6583worker1 # [ 154.537965] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666584worker1 # [ 154.543783] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06585worker1 # [ 154.554499] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666586worker1 # [ 154.564641] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666587worker1 # [ 154.570969] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6588worker1 # [ 154.730309] nix-daemon[917]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6589worker1 # [ 154.742473] nix-daemon[917]: reaped child process 1884, status = succeeded6590worker1 # [ 154.885707] nix-daemon[917]: accepted connection from pid 1886, user nix-grpc-daemon (trusted)6591worker1 # [ 154.898401] nix-daemon[917]: reaped child process 1889, status = succeeded6592lb # [ 154.873480] niks3-server[1256]: 2026/09/20 08:17:57 INFO Received uploads request method=POST path=/api/pending_closures6593worker1 # [ 154.915149] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6594worker1 # [ 154.916492] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.807Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6595lb # [ 154.897150] niks3-server[1256]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6596lb # [ 154.909289] niks3-server[1256]: 2026/09/20 08:17:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6597lb # [ 154.915072] niks3-server[1256]: 2026/09/20 08:17:57 INFO Signed narinfos id=48 count=16598worker1 # [ 154.951862] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.843Z level=INFO msg="Uploading 1 narinfos"6599lb # [ 154.919917] niks3-server[1256]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6600lb # [ 154.932374] niks3-server[1256]: 2026/09/20 08:17:57 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6601lb # [ 154.937224] niks3-server[1256]: 2026/09/20 08:17:57 INFO Completed upload id=486602worker1 # [ 154.973320] nix-grpc-daemon[1617]: time=2026-09-20T08:17:57.865Z level=INFO msg="Upload complete. (391ms)"6603lb # [ 154.939962] niks3-server[1256]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6604worker1 # [ 154.975320] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=5046605worker1 # [ 154.980303] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666606worker1 # [ 154.987543] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6607worker1 # [ 154.993573] nix-daemon[917]: reaped child process 1879, status = succeeded6608worker1 # [ 154.997445] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6609worker1 # [ 155.823911] nix-daemon[917]: reaped child process 1893, status = succeeded6610worker1 # [ 155.980790] nix-daemon[917]: accepted connection from pid 1908, user nix-grpc-daemon (trusted)6611worker1 # [ 155.992960] nix-daemon[917]: reaped child process 1911, status = succeeded6612lb # [ 155.975845] niks3-server[1256]: 2026/09/20 08:17:58 INFO Received uploads request method=POST path=/api/pending_closures6613worker1 # [ 156.019053] nix-grpc-daemon[1617]: time=2026-09-20T08:17:58.910Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6614worker1 # [ 156.021146] nix-grpc-daemon[1617]: time=2026-09-20T08:17:58.912Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6615lb # [ 156.018932] niks3-server[1256]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6616worker1 # [ 156.062852] nix-grpc-daemon[1617]: time=2026-09-20T08:17:58.954Z level=INFO msg="Uploading 1 narinfos"6617lb # [ 156.029130] niks3-server[1256]: 2026/09/20 08:17:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6618lb # [ 156.032917] niks3-server[1256]: 2026/09/20 08:17:58 INFO Signed narinfos id=49 count=16619lb # [ 156.040895] niks3-server[1256]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6620lb # [ 156.047156] niks3-server[1256]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6621lb # [ 156.056225] niks3-server[1256]: 2026/09/20 08:17:58 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6622lb # [ 156.059264] niks3-server[1256]: 2026/09/20 08:17:58 INFO Completed upload id=496623lb # [ 156.061125] niks3-server[1256]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6624worker1 # [ 156.094719] nix-grpc-daemon[1617]: time=2026-09-20T08:17:58.986Z level=INFO msg="Upload complete. (289ms)"6625worker1 # [ 156.102697] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:58Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16626worker1 # [ 156.108494] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16627worker1 # [ 156.121835] nix-daemon[917]: reaped child process 1891, status = succeeded6628worker1 # [ 156.144858] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666629worker1 # [ 156.154281] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:59Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06630worker1 # [ 156.162827] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666631worker1 # [ 156.177942] nix-grpc-daemon[1617]: time=2026-09-20T08:17:59.069Z level=INFO msg="All 1 paths already cached"6632worker1 # [ 156.186717] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666633worker1 # [ 156.196169] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6634worker1 # [ 156.337100] nix-daemon[917]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)6635worker1 # [ 156.349949] nix-daemon[917]: reaped child process 1920, status = succeeded6636worker1 # [ 156.508178] nix-daemon[917]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6637worker1 # [ 156.521598] nix-daemon[917]: reaped child process 1925, status = succeeded6638lb # [ 156.501754] niks3-server[1256]: 2026/09/20 08:17:59 INFO Received uploads request method=POST path=/api/pending_closures6639worker1 # [ 156.543516] nix-grpc-daemon[1617]: time=2026-09-20T08:17:59.435Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6640worker1 # [ 156.545630] nix-grpc-daemon[1617]: time=2026-09-20T08:17:59.437Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6641lb # [ 156.529983] niks3-server[1256]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6642lb # [ 156.540381] niks3-server[1256]: 2026/09/20 08:17:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6643worker1 # [ 156.579161] nix-grpc-daemon[1617]: time=2026-09-20T08:17:59.471Z level=INFO msg="Uploading 1 narinfos"6644lb # [ 156.546397] niks3-server[1256]: 2026/09/20 08:17:59 INFO Signed narinfos id=50 count=16645lb # [ 156.551113] niks3-server[1256]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6646lb # [ 156.561843] niks3-server[1256]: 2026/09/20 08:17:59 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6647worker1 # [ 156.603713] nix-grpc-daemon[1617]: time=2026-09-20T08:17:59.495Z level=INFO msg="Upload complete. (396ms)"6648lb # [ 156.569892] niks3-server[1256]: 2026/09/20 08:17:59 INFO Completed upload id=506649lb # [ 156.572553] niks3-server[1256]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6650worker1 # [ 156.606814] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=6246651worker1 # [ 156.612720] nix-grpc-daemon[1541]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666652worker1 # [ 156.622502] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6653worker1 # [ 156.628232] nix-daemon[917]: reaped child process 1915, status = succeeded6654worker1 # [ 156.633954] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6655worker1 # [ 157.860536] nix-daemon[917]: reaped child process 1929, status = succeeded6656worker1 # [ 158.007089] nix-daemon[917]: accepted connection from pid 1944, user nix-grpc-daemon (trusted)6657worker1 # [ 158.018418] nix-daemon[917]: reaped child process 1947, status = succeeded6658lb # [ 157.994656] niks3-server[1256]: 2026/09/20 08:18:00 INFO Received uploads request method=POST path=/api/pending_closures6659worker1 # [ 158.033600] nix-grpc-daemon[1617]: time=2026-09-20T08:18:00.925Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6660worker1 # [ 158.035267] nix-grpc-daemon[1617]: time=2026-09-20T08:18:00.927Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6661lb # [ 158.018594] niks3-server[1256]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6662lb # [ 158.021127] niks3-server[1256]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6663lb # [ 158.025056] niks3-server[1256]: 2026/09/20 08:18:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6664lb # [ 158.027753] niks3-server[1256]: 2026/09/20 08:18:00 INFO Signed narinfos id=51 count=16665worker1 # [ 158.061581] nix-grpc-daemon[1617]: time=2026-09-20T08:18:00.953Z level=INFO msg="Uploading 1 narinfos"6666lb # [ 158.031588] niks3-server[1256]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6667lb # [ 158.035371] niks3-server[1256]: 2026/09/20 08:18:00 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6668lb # [ 158.038739] niks3-server[1256]: 2026/09/20 08:18:00 INFO Completed upload id=516669worker1 # [ 158.072586] nix-grpc-daemon[1617]: time=2026-09-20T08:18:00.964Z level=INFO msg="Upload complete. (229ms)"6670lb # [ 158.040363] niks3-server[1256]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6671worker1 # [ 158.076083] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16672worker1 # [ 158.079697] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:00Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16673worker1 # [ 158.083571] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:00Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06674worker1 # [ 158.087979] nix-daemon[917]: reaped child process 1927, status = succeeded6675worker1 # [ 158.122227] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666676worker1 # [ 158.130588] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666677worker1 # [ 158.138974] nix-grpc-daemon[1617]: time=2026-09-20T08:18:01.031Z level=INFO msg="All 1 paths already cached"6678worker1 # [ 158.144342] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666679worker1 # [ 158.152128] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6680worker1 # [ 158.276215] nix-daemon[917]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6681worker1 # [ 158.288431] nix-daemon[917]: reaped child process 1956, status = succeeded6682worker1 # [ 158.422192] nix-daemon[917]: accepted connection from pid 1958, user nix-grpc-daemon (trusted)6683worker1 # [ 158.434402] nix-daemon[917]: reaped child process 1961, status = succeeded6684lb # [ 158.414365] niks3-server[1256]: 2026/09/20 08:18:00 INFO Received uploads request method=POST path=/api/pending_closures6685worker1 # [ 158.456749] nix-grpc-daemon[1617]: time=2026-09-20T08:18:01.348Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6686worker1 # [ 158.458117] nix-grpc-daemon[1617]: time=2026-09-20T08:18:01.348Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6687lb # [ 158.439250] niks3-server[1256]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6688lb # [ 158.450871] niks3-server[1256]: 2026/09/20 08:18:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6689worker1 # [ 158.489485] nix-grpc-daemon[1617]: time=2026-09-20T08:18:01.381Z level=INFO msg="Uploading 1 narinfos"6690lb # [ 158.457108] niks3-server[1256]: 2026/09/20 08:18:00 INFO Signed narinfos id=52 count=16691lb # [ 158.461949] niks3-server[1256]: 2026/09/20 08:18:00 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6692lb # [ 158.473211] niks3-server[1256]: 2026/09/20 08:18:00 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6693worker1 # [ 158.513257] nix-grpc-daemon[1617]: time=2026-09-20T08:18:01.405Z level=INFO msg="Upload complete. (355ms)"6694lb # [ 158.479395] niks3-server[1256]: 2026/09/20 08:18:01 INFO Completed upload id=526695worker1 # [ 158.515201] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=6246696lb # [ 158.483333] niks3-server[1256]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6697worker1 # [ 158.521434] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666698worker1 # [ 158.529424] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6699worker1 # [ 158.531684] nix-daemon[917]: reaped child process 1951, status = succeeded6700worker1 # [ 158.536914] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6701worker1 # [ 159.562657] nix-daemon[917]: reaped child process 1965, status = succeeded6702worker1 # [ 159.718271] nix-daemon[917]: accepted connection from pid 1980, user nix-grpc-daemon (trusted)6703worker1 # [ 159.729258] nix-daemon[917]: reaped child process 1983, status = succeeded6704lb # [ 159.710683] niks3-server[1256]: 2026/09/20 08:18:02 INFO Received uploads request method=POST path=/api/pending_closures6705worker1 # [ 159.752672] nix-grpc-daemon[1617]: time=2026-09-20T08:18:02.644Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6706worker1 # [ 159.754257] nix-grpc-daemon[1617]: time=2026-09-20T08:18:02.646Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6707lb # [ 159.746229] niks3-server[1256]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6708lb # [ 159.756945] niks3-server[1256]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6709lb # [ 159.763754] niks3-server[1256]: 2026/09/20 08:18:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6710worker1 # [ 159.805046] nix-grpc-daemon[1617]: time=2026-09-20T08:18:02.697Z level=INFO msg="Uploading 1 narinfos"6711lb # [ 159.771099] niks3-server[1256]: 2026/09/20 08:18:02 INFO Signed narinfos id=53 count=16712lb # [ 159.776365] niks3-server[1256]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6713lb # [ 159.788657] niks3-server[1256]: 2026/09/20 08:18:02 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6714lb # [ 159.793576] niks3-server[1256]: 2026/09/20 08:18:02 INFO Completed upload id=536715lb # [ 159.797159] niks3-server[1256]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6716worker1 # [ 159.829852] nix-grpc-daemon[1617]: time=2026-09-20T08:18:02.721Z level=INFO msg="Upload complete. (285ms)"6717worker1 # [ 159.842374] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16718worker1 # [ 159.848491] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:02Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16719worker1 # [ 159.853269] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666720worker1 # [ 159.857339] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:02Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06721worker1 # [ 159.868090] nix-daemon[917]: reaped child process 1963, status = succeeded6722worker1 # [ 159.870964] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666723worker1 # [ 159.880699] nix-grpc-daemon[1617]: time=2026-09-20T08:18:02.772Z level=INFO msg="All 1 paths already cached"6724worker1 # [ 159.885179] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666725worker1 # [ 159.891338] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6726worker1 # [ 160.041540] nix-daemon[917]: accepted connection from pid 1989, user nix-grpc-daemon (trusted)6727worker1 # [ 160.054945] nix-daemon[917]: reaped child process 1992, status = succeeded6728worker1 # [ 160.212339] nix-daemon[917]: accepted connection from pid 1994, user nix-grpc-daemon (trusted)6729worker1 # [ 160.224693] nix-daemon[917]: reaped child process 1997, status = succeeded6730lb # [ 160.204330] niks3-server[1256]: 2026/09/20 08:18:02 INFO Received uploads request method=POST path=/api/pending_closures6731worker1 # [ 160.247737] nix-grpc-daemon[1617]: time=2026-09-20T08:18:03.139Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6732worker1 # [ 160.249150] nix-grpc-daemon[1617]: time=2026-09-20T08:18:03.139Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6733lb # [ 160.231597] niks3-server[1256]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6734lb # [ 160.242536] niks3-server[1256]: 2026/09/20 08:18:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6735lb # [ 160.248820] niks3-server[1256]: 2026/09/20 08:18:02 INFO Signed narinfos id=54 count=16736worker1 # [ 160.285846] nix-grpc-daemon[1617]: time=2026-09-20T08:18:03.177Z level=INFO msg="Uploading 1 narinfos"6737lb # [ 160.253906] niks3-server[1256]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6738lb # [ 160.263762] niks3-server[1256]: 2026/09/20 08:18:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6739worker1 # [ 160.304116] nix-grpc-daemon[1617]: time=2026-09-20T08:18:03.196Z level=INFO msg="Upload complete. (407ms)"6740lb # [ 160.270324] niks3-server[1256]: 2026/09/20 08:18:02 INFO Completed upload id=546741worker1 # [ 160.306043] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=6246742lb # [ 160.275158] niks3-server[1256]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6743worker1 # [ 160.312617] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666744worker1 # [ 160.319298] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6745worker1 # [ 160.320623] nix-daemon[917]: reaped child process 1987, status = succeeded6746worker1 # [ 160.325869] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6747worker1 # [ 161.351324] nix-daemon[917]: reaped child process 2001, status = succeeded6748worker1 # [ 161.488233] nix-daemon[917]: accepted connection from pid 2016, user nix-grpc-daemon (trusted)6749worker1 # [ 161.500829] nix-daemon[917]: reaped child process 2019, status = succeeded6750lb # [ 161.477457] niks3-server[1256]: 2026/09/20 08:18:04 INFO Received uploads request method=POST path=/api/pending_closures6751worker1 # [ 161.518158] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.410Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6752worker1 # [ 161.519704] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.411Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6753lb # [ 161.498735] niks3-server[1256]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6754lb # [ 161.502935] niks3-server[1256]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6755lb # [ 161.505586] niks3-server[1256]: 2026/09/20 08:18:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6756lb # [ 161.507849] niks3-server[1256]: 2026/09/20 08:18:04 INFO Signed narinfos id=55 count=16757worker1 # [ 161.541916] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.433Z level=INFO msg="Uploading 1 narinfos"6758lb # [ 161.511912] niks3-server[1256]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6759lb # [ 161.515484] niks3-server[1256]: 2026/09/20 08:18:04 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6760lb # [ 161.518785] niks3-server[1256]: 2026/09/20 08:18:04 INFO Completed upload id=556761worker1 # [ 161.553641] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.445Z level=INFO msg="Upload complete. (220ms)"6762lb # [ 161.520233] niks3-server[1256]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6763worker1 # [ 161.556479] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16764worker1 # [ 161.560387] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16765worker1 # [ 161.564993] nix-daemon[917]: reaped child process 1999, status = succeeded6766worker1 # [ 161.600307] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666767worker1 # [ 161.608824] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06768worker1 # [ 161.616639] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666769worker1 # [ 161.628204] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.520Z level=INFO msg="All 2 paths already cached"6770worker1 # [ 161.634155] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666771worker1 # [ 161.642137] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6772worker1 # [ 161.787288] nix-daemon[917]: accepted connection from pid 2025, user nix-grpc-daemon (trusted)6773worker1 # [ 161.800088] nix-daemon[917]: reaped child process 2028, status = succeeded6774worker1 # [ 161.959719] nix-daemon[917]: accepted connection from pid 2030, user nix-grpc-daemon (trusted)6775worker1 # [ 161.971979] nix-daemon[917]: reaped child process 2033, status = succeeded6776lb # [ 161.952451] niks3-server[1256]: 2026/09/20 08:18:04 INFO Received uploads request method=POST path=/api/pending_closures6777worker1 # [ 161.994979] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.886Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6778worker1 # [ 161.996349] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.886Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6779lb # [ 161.985275] niks3-server[1256]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6780lb # [ 161.996529] niks3-server[1256]: 2026/09/20 08:18:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6781lb # [ 162.002059] niks3-server[1256]: 2026/09/20 08:18:04 INFO Signed narinfos id=56 count=16782worker1 # [ 162.039993] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.931Z level=INFO msg="Uploading 1 narinfos"6783lb # [ 162.007970] niks3-server[1256]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6784lb # [ 162.018309] niks3-server[1256]: 2026/09/20 08:18:04 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6785lb # [ 162.022962] niks3-server[1256]: 2026/09/20 08:18:04 INFO Completed upload id=566786worker1 # [ 162.056905] nix-grpc-daemon[1617]: time=2026-09-20T08:18:04.949Z level=INFO msg="Upload complete. (408ms)"6787lb # [ 162.027643] niks3-server[1256]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6788worker1 # [ 162.061131] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=7526789worker1 # [ 162.065868] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666790worker1 # [ 162.075966] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6791worker1 # [ 162.080529] nix-daemon[917]: reaped child process 2023, status = succeeded6792worker1 # [ 162.084623] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6793worker1 # [ 162.898735] nix-daemon[917]: reaped child process 2037, status = succeeded6794worker1 # [ 163.032919] nix-daemon[917]: accepted connection from pid 2052, user nix-grpc-daemon (trusted)6795worker1 # [ 163.044329] nix-daemon[917]: reaped child process 2055, status = succeeded6796lb # [ 163.026605] niks3-server[1256]: 2026/09/20 08:18:05 INFO Received uploads request method=POST path=/api/pending_closures6797worker1 # [ 163.068800] nix-grpc-daemon[1617]: time=2026-09-20T08:18:05.960Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6798worker1 # [ 163.070284] nix-grpc-daemon[1617]: time=2026-09-20T08:18:05.962Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6799lb # [ 163.061288] niks3-server[1256]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6800lb # [ 163.074509] niks3-server[1256]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6801lb # [ 163.082513] niks3-server[1256]: 2026/09/20 08:18:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6802worker1 # [ 163.121780] nix-grpc-daemon[1617]: time=2026-09-20T08:18:06.013Z level=INFO msg="Uploading 1 narinfos"6803lb # [ 163.087993] niks3-server[1256]: 2026/09/20 08:18:05 INFO Signed narinfos id=57 count=16804lb # [ 163.092888] niks3-server[1256]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6805lb # [ 163.101918] niks3-server[1256]: 2026/09/20 08:18:05 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6806lb # [ 163.106708] niks3-server[1256]: 2026/09/20 08:18:05 INFO Completed upload id=576807worker1 # [ 163.140662] nix-grpc-daemon[1617]: time=2026-09-20T08:18:06.032Z level=INFO msg="Upload complete. (249ms)"6808lb # [ 163.110677] niks3-server[1256]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6809worker1 # [ 163.145864] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16810worker1 # [ 163.154217] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:06Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16811worker1 # [ 163.163546] nix-daemon[917]: reaped child process 2035, status = succeeded6812worker1 # [ 163.189688] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666813worker1 # [ 163.201239] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666814worker1 # [ 163.213371] nix-grpc-daemon[1617]: time=2026-09-20T08:18:06.105Z level=INFO msg="All 2 paths already cached"6815worker1 # [ 163.219884] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666816worker1 # [ 163.228595] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6817worker1 # [ 163.384376] nix-daemon[917]: accepted connection from pid 2059, user nix-grpc-daemon (trusted)6818worker1 # [ 163.396670] nix-daemon[917]: reaped child process 2062, status = succeeded6819worker1 # [ 163.556124] nix-daemon[917]: accepted connection from pid 2064, user nix-grpc-daemon (trusted)6820worker1 # [ 163.568207] nix-daemon[917]: reaped child process 2067, status = succeeded6821lb # [ 163.550346] niks3-server[1256]: 2026/09/20 08:18:06 INFO Received uploads request method=POST path=/api/pending_closures6822worker1 # [ 163.591973] nix-grpc-daemon[1617]: time=2026-09-20T08:18:06.484Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6823worker1 # [ 163.593580] nix-grpc-daemon[1617]: time=2026-09-20T08:18:06.485Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6824lb # [ 163.590920] niks3-server[1256]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6825lb # [ 163.599592] niks3-server[1256]: 2026/09/20 08:18:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6826worker1 # [ 163.638055] nix-grpc-daemon[1617]: time=2026-09-20T08:18:06.530Z level=INFO msg="Uploading 1 narinfos"6827lb # [ 163.604437] niks3-server[1256]: 2026/09/20 08:18:06 INFO Signed narinfos id=58 count=16828lb # [ 163.611453] niks3-server[1256]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6829lb # [ 163.621968] niks3-server[1256]: 2026/09/20 08:18:06 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6830worker1 # [ 163.661147] nix-grpc-daemon[1617]: time=2026-09-20T08:18:06.553Z level=INFO msg="Upload complete. (420ms)"6831lb # [ 163.627526] niks3-server[1256]: 2026/09/20 08:18:06 INFO Completed upload id=586832worker1 # [ 163.662835] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=7526833lb # [ 163.630189] niks3-server[1256]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6834worker1 # [ 163.670473] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666835worker1 # [ 163.675310] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6836worker1 # [ 163.677914] nix-daemon[917]: reaped child process 2057, status = succeeded6837worker1 # [ 163.684032] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6838worker1 # [ 164.913194] nix-daemon[917]: reaped child process 2071, status = succeeded6839worker1 # [ 165.046305] nix-daemon[917]: accepted connection from pid 2086, user nix-grpc-daemon (trusted)6840worker1 # [ 165.060359] nix-daemon[917]: reaped child process 2089, status = succeeded6841lb # [ 165.035671] niks3-server[1256]: 2026/09/20 08:18:07 INFO Received uploads request method=POST path=/api/pending_closures6842worker1 # [ 165.074838] nix-grpc-daemon[1617]: time=2026-09-20T08:18:07.966Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6843worker1 # [ 165.076625] nix-grpc-daemon[1617]: time=2026-09-20T08:18:07.968Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6844lb # [ 165.062754] niks3-server[1256]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6845lb # [ 165.065606] niks3-server[1256]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6846lb # [ 165.068111] niks3-server[1256]: 2026/09/20 08:18:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6847lb # [ 165.070043] niks3-server[1256]: 2026/09/20 08:18:07 INFO Signed narinfos id=59 count=16848worker1 # [ 165.105402] nix-grpc-daemon[1617]: time=2026-09-20T08:18:07.997Z level=INFO msg="Uploading 1 narinfos"6849lb # [ 165.074183] niks3-server[1256]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6850lb # [ 165.078150] niks3-server[1256]: 2026/09/20 08:18:07 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6851lb # [ 165.080986] niks3-server[1256]: 2026/09/20 08:18:07 INFO Completed upload id=596852worker1 # [ 165.114894] nix-grpc-daemon[1617]: time=2026-09-20T08:18:08.007Z level=INFO msg="Upload complete. (222ms)"6853lb # [ 165.083503] niks3-server[1256]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6854worker1 # [ 165.118270] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16855worker1 # [ 165.120947] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:08Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16856worker1 # [ 165.126930] nix-daemon[917]: reaped child process 2069, status = succeeded6857worker1 # [ 165.160593] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666858worker1 # [ 165.166650] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:605666859worker1 # [ 165.175935] nix-grpc-daemon[1617]: time=2026-09-20T08:18:08.068Z level=INFO msg="All 2 paths already cached"6860worker1 # [ 165.180868] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:605666861worker1 # [ 165.188965] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6862worker1 # [ 165.335046] nix-daemon[917]: accepted connection from pid 2093, user nix-grpc-daemon (trusted)6863worker1 # [ 165.347274] nix-daemon[917]: reaped child process 2096, status = succeeded6864worker1 # [ 165.498243] nix-daemon[917]: accepted connection from pid 2098, user nix-grpc-daemon (trusted)6865worker1 # [ 165.510152] nix-daemon[917]: reaped child process 2101, status = succeeded6866lb # [ 165.491505] niks3-server[1256]: 2026/09/20 08:18:08 INFO Received uploads request method=POST path=/api/pending_closures6867worker1 # [ 165.535197] nix-grpc-daemon[1617]: time=2026-09-20T08:18:08.427Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6868worker1 # [ 165.536612] nix-grpc-daemon[1617]: time=2026-09-20T08:18:08.427Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6869lb # [ 165.522261] niks3-server[1256]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6870lb # [ 165.527348] niks3-server[1256]: 2026/09/20 08:18:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6871worker1 # [ 165.565816] nix-grpc-daemon[1617]: time=2026-09-20T08:18:08.457Z level=INFO msg="Uploading 1 narinfos"6872lb # [ 165.532133] niks3-server[1256]: 2026/09/20 08:18:08 INFO Signed narinfos id=60 count=16873lb # [ 165.543124] niks3-server[1256]: 2026/09/20 08:18:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6874lb # [ 165.548339] niks3-server[1256]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6875worker1 # [ 165.587139] nix-grpc-daemon[1617]: time=2026-09-20T08:18:08.479Z level=INFO msg="Upload complete. (393ms)"6876lb # [ 165.552858] niks3-server[1256]: 2026/09/20 08:18:08 INFO Completed upload id=606877worker1 # [ 165.589208] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=0 paths=1 nar_bytes_in=7526878lb # [ 165.558348] niks3-server[1256]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6879worker1 # [ 165.592735] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:605666880worker1 # [ 165.599478] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6881worker1 # [ 165.603918] nix-daemon[917]: reaped child process 2091, status = succeeded6882worker1 # [ 165.608979] nix-daemon[917]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)6883worker1 # [ 166.621692] nix-daemon[917]: reaped child process 2105, status = succeeded6884worker1 # [ 166.741963] nix-daemon[917]: accepted connection from pid 2120, user nix-grpc-daemon (trusted)6885worker1 # [ 166.754131] nix-daemon[917]: reaped child process 2123, status = succeeded6886lb # [ 166.731503] niks3-server[1256]: 2026/09/20 08:18:09 INFO Received uploads request method=POST path=/api/pending_closures6887worker1 # [ 166.776718] nix-grpc-daemon[1617]: time=2026-09-20T08:18:09.668Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6888worker1 # [ 166.778191] nix-grpc-daemon[1617]: time=2026-09-20T08:18:09.670Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6889lb # [ 166.769845] niks3-server[1256]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6890lb # [ 166.779236] niks3-server[1256]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6891lb # [ 166.786298] niks3-server[1256]: 2026/09/20 08:18:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6892lb # [ 166.791898] niks3-server[1256]: 2026/09/20 08:18:09 INFO Signed narinfos id=61 count=16893worker1 # [ 166.828140] nix-grpc-daemon[1617]: time=2026-09-20T08:18:09.720Z level=INFO msg="Uploading 1 narinfos"6894lb # [ 166.797482] niks3-server[1256]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6895lb # [ 166.806869] niks3-server[1256]: 2026/09/20 08:18:09 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6896worker1 # [ 166.845341] nix-grpc-daemon[1617]: time=2026-09-20T08:18:09.737Z level=INFO msg="Upload complete. (229ms)"6897lb # [ 166.811844] niks3-server[1256]: 2026/09/20 08:18:09 INFO Completed upload id=616898lb # [ 166.813390] niks3-server[1256]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6899worker1 # [ 166.848426] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60566 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16900worker1 # [ 166.861585] nix-daemon[917]: reaped child process 2103, status = succeeded6901client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.22 seconds)6902worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6903worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6904client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16905worker1 # [ 167.183090] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:605666906worker1 # [ 167.197232] nix-grpc-daemon[1541]: ts=2026-09-20T08:18:10Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06907lb # [ 170.511164] envoy[997]: conn peer=[2001:db8:1::1]:50280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26765 tx=10568 ms=159796908client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.22 seconds)6909(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 136.50 seconds)6910subtest: low disk drains a worker and builds go to the other6911worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6912worker1 # [ 288.051969] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:10Z level=info event=unhealthy reason=min_free6913worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.95 seconds)6914worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6915worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.03 seconds)6916client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26917worker2 # [ 288.372449] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:598386918worker2 # [ 288.377857] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6919client # don't know how to build these paths:6920client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6921worker1 # [ 288.435512] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:11Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06922worker1 # [ 288.439643] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:11Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16923worker2 # [ 288.404620] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598386924worker2 # [ 288.410221] nix-grpc-daemon[1669]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5)6925worker2 # [ 288.436466] nix-grpc-daemon[1669]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 181 ms (attempt 2/5)6926worker2 # [ 288.619944] nix-grpc-daemon[1669]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 3/5)6927worker2 # [ 288.905639] nix-grpc-daemon[1669]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 672 ms (attempt 4/5)6928worker2 # [ 289.581191] nix-grpc-daemon[1669]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6929worker2 # [ 289.597197] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598386930client # copying 1 paths to 'lb:50051'...6931worker2 # [ 289.606331] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598386932client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6933worker2 # [ 289.613161] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6934worker2 # [ 289.622936] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:11Z level=info event=niks3_push_started pid=17256935worker2 # [ 289.903539] nix-daemon[850]: accepted connection from pid 1738, user nix-grpc-daemon (trusted)6936worker2 # [ 289.915836] nix-daemon[850]: reaped child process 1741, status = succeeded6937worker2 # [ 290.063377] nix-daemon[850]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)6938worker2 # [ 290.073948] nix-daemon[850]: reaped child process 1746, status = succeeded6939lb # [ 290.092624] niks3-server[1256]: 2026/09/20 08:20:12 INFO Received uploads request method=POST path=/api/pending_closures6940worker2 # [ 290.090282] nix-grpc-daemon[1725]: time=2026-09-20T08:20:12.381Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6941worker2 # [ 290.092289] nix-grpc-daemon[1725]: time=2026-09-20T08:20:12.383Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6942lb # [ 290.114303] niks3-server[1256]: 2026/09/20 08:20:12 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6943lb # [ 290.118577] niks3-server[1256]: 2026/09/20 08:20:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6944lb # [ 290.120780] niks3-server[1256]: 2026/09/20 08:20:12 INFO Signed narinfos id=62 count=16945worker2 # [ 290.114193] nix-grpc-daemon[1725]: time=2026-09-20T08:20:12.405Z level=INFO msg="Uploading 1 narinfos"6946lb # [ 290.124774] niks3-server[1256]: 2026/09/20 08:20:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6947lb # [ 290.129057] niks3-server[1256]: 2026/09/20 08:20:12 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6948lb # [ 290.133979] niks3-server[1256]: 2026/09/20 08:20:12 INFO Completed upload id=626949worker2 # [ 290.126266] nix-grpc-daemon[1725]: time=2026-09-20T08:20:12.417Z level=INFO msg="Upload complete. (346ms)"6950lb # [ 290.135541] niks3-server[1256]: 2026/09/20 08:20:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6951worker2 # [ 290.128392] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59838 duration_s=0 paths=1 nar_bytes_in=5126952worker2 # [ 290.131845] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598386953worker2 # [ 290.137702] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6954worker2 # [ 290.139878] nix-daemon[850]: reaped child process 1723, status = succeeded6955worker2 # [ 290.144897] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6956client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6957client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6958lb # [ 290.521590] envoy[997]: conn peer=[2001:db8:1::1]:39920 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=725 tx=455 ms=1200286959client # farm-a> LOG-farm-a-drain6960worker2 # [ 291.157621] nix-daemon[850]: reaped child process 1750, status = succeeded6961worker2 # [ 291.299503] nix-daemon[850]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6962worker2 # [ 291.311618] nix-daemon[850]: reaped child process 1768, status = succeeded6963lb # [ 291.335654] niks3-server[1256]: 2026/09/20 08:20:13 INFO Received uploads request method=POST path=/api/pending_closures6964worker2 # [ 291.336833] nix-grpc-daemon[1725]: time=2026-09-20T08:20:13.627Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6965worker2 # [ 291.338445] nix-grpc-daemon[1725]: time=2026-09-20T08:20:13.629Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6966lb # [ 291.379181] niks3-server[1256]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6967lb # [ 291.386357] niks3-server[1256]: 2026/09/20 08:20:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6968worker2 # [ 291.382726] nix-grpc-daemon[1725]: time=2026-09-20T08:20:13.673Z level=INFO msg="Uploading 1 narinfos"6969lb # [ 291.390248] niks3-server[1256]: 2026/09/20 08:20:13 INFO Signed narinfos id=63 count=16970lb # [ 291.397993] niks3-server[1256]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6971lb # [ 291.403219] niks3-server[1256]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6972lb # [ 291.406853] niks3-server[1256]: 2026/09/20 08:20:13 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6973lb # [ 291.410265] niks3-server[1256]: 2026/09/20 08:20:13 INFO Completed upload id=636974worker2 # [ 291.403805] nix-grpc-daemon[1725]: time=2026-09-20T08:20:13.695Z level=INFO msg="Upload complete. (252ms)"6975lb # [ 291.411722] niks3-server[1256]: 2026/09/20 08:20:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6976worker2 # [ 291.407338] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59838 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16977worker1 # [ 291.453942] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:14Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06978worker2 # [ 291.413584] nix-daemon[850]: reaped child process 1748, status = succeeded6979worker1 # [ 291.456200] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:14Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16980worker2 # [ 291.455375] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598386981worker2 # [ 291.465959] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598386982worker2 # [ 291.475854] nix-grpc-daemon[1725]: time=2026-09-20T08:20:13.767Z level=INFO msg="All 1 paths already cached"6983client # copying 1 paths to 'lb:50051'...6984client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6985worker2 # [ 291.483162] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598386986worker2 # [ 291.491401] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6987worker2 # [ 291.623860] nix-daemon[850]: accepted connection from pid 1772, user nix-grpc-daemon (trusted)6988worker2 # [ 291.635908] nix-daemon[850]: reaped child process 1775, status = succeeded6989worker2 # [ 291.781206] nix-daemon[850]: accepted connection from pid 1777, user nix-grpc-daemon (trusted)6990worker2 # [ 291.793096] nix-daemon[850]: reaped child process 1780, status = succeeded6991lb # [ 291.815622] niks3-server[1256]: 2026/09/20 08:20:14 INFO Received uploads request method=POST path=/api/pending_closures6992worker2 # [ 291.815548] nix-grpc-daemon[1725]: time=2026-09-20T08:20:14.106Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6993worker2 # [ 291.817123] nix-grpc-daemon[1725]: time=2026-09-20T08:20:14.108Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6994lb # [ 291.844240] niks3-server[1256]: 2026/09/20 08:20:14 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6995lb # [ 291.855331] niks3-server[1256]: 2026/09/20 08:20:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6996lb # [ 291.859464] niks3-server[1256]: 2026/09/20 08:20:14 INFO Signed narinfos id=64 count=16997worker2 # [ 291.854465] nix-grpc-daemon[1725]: time=2026-09-20T08:20:14.145Z level=INFO msg="Uploading 1 narinfos"6998lb # [ 291.865525] niks3-server[1256]: 2026/09/20 08:20:14 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6999lb # [ 291.877471] niks3-server[1256]: 2026/09/20 08:20:14 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete7000worker2 # [ 291.875849] nix-grpc-daemon[1725]: time=2026-09-20T08:20:14.167Z level=INFO msg="Upload complete. (372ms)"7001lb # [ 291.883896] niks3-server[1256]: 2026/09/20 08:20:14 INFO Completed upload id=647002lb # [ 291.886504] niks3-server[1256]: 2026/09/20 08:20:14 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo7003worker2 # [ 291.879063] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59838 duration_s=0 paths=1 nar_bytes_in=6247004worker2 # [ 291.885267] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598387005worker2 # [ 291.895279] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)7006worker2 # [ 291.898971] nix-daemon[850]: reaped child process 1770, status = succeeded7007worker2 # [ 291.902889] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)7008client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...7009client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7010client # farm-b> LOG-farm-b-drain7011worker2 # [ 293.117352] nix-daemon[850]: reaped child process 1784, status = succeeded7012worker2 # [ 293.253541] nix-daemon[850]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)7013worker2 # [ 293.265782] nix-daemon[850]: reaped child process 1802, status = succeeded7014lb # [ 293.283695] niks3-server[1256]: 2026/09/20 08:20:15 INFO Received uploads request method=POST path=/api/pending_closures7015worker2 # [ 293.283877] nix-grpc-daemon[1725]: time=2026-09-20T08:20:15.574Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7016worker2 # [ 293.285364] nix-grpc-daemon[1725]: time=2026-09-20T08:20:15.576Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"7017lb # [ 293.323139] niks3-server[1256]: 2026/09/20 08:20:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign7018lb # [ 293.327533] niks3-server[1256]: 2026/09/20 08:20:15 INFO Signed narinfos id=65 count=17019worker2 # [ 293.322531] nix-grpc-daemon[1725]: time=2026-09-20T08:20:15.613Z level=INFO msg="Uploading 1 narinfos"7020lb # [ 293.338577] niks3-server[1256]: 2026/09/20 08:20:15 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst7021lb # [ 293.346226] niks3-server[1256]: 2026/09/20 08:20:15 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7022lb # [ 293.352614] niks3-server[1256]: 2026/09/20 08:20:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls7023lb # [ 293.359825] niks3-server[1256]: 2026/09/20 08:20:15 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete7024worker2 # [ 293.356921] nix-grpc-daemon[1725]: time=2026-09-20T08:20:15.648Z level=INFO msg="Upload complete. (246ms)"7025lb # [ 293.364607] niks3-server[1256]: 2026/09/20 08:20:15 INFO Completed upload id=657026worker2 # [ 293.359781] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59838 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=17027lb # [ 293.369497] niks3-server[1256]: 2026/09/20 08:20:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo7028worker1 # [ 293.407192] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:16Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=07029worker2 # [ 293.368339] nix-daemon[850]: reaped child process 1782, status = succeeded7030worker1 # [ 293.409235] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:16Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=17031worker2 # [ 293.409719] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598387032worker2 # [ 293.418418] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598387033worker2 # [ 293.427135] nix-grpc-daemon[1725]: time=2026-09-20T08:20:15.718Z level=INFO msg="All 2 paths already cached"7034client # copying 1 paths to 'lb:50051'...7035client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...7036worker2 # [ 293.433868] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598387037worker2 # [ 293.438588] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)7038worker2 # [ 293.586459] nix-daemon[850]: accepted connection from pid 1806, user nix-grpc-daemon (trusted)7039worker2 # [ 293.598526] nix-daemon[850]: reaped child process 1809, status = succeeded7040worker2 # [ 293.749151] nix-daemon[850]: accepted connection from pid 1811, user nix-grpc-daemon (trusted)7041worker2 # [ 293.761108] nix-daemon[850]: reaped child process 1814, status = succeeded7042lb # [ 293.783163] niks3-server[1256]: 2026/09/20 08:20:16 INFO Received uploads request method=POST path=/api/pending_closures7043worker2 # [ 293.783176] nix-grpc-daemon[1725]: time=2026-09-20T08:20:16.074Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7044worker2 # [ 293.784699] nix-grpc-daemon[1725]: time=2026-09-20T08:20:16.076Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"7045lb # [ 293.809821] niks3-server[1256]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst7046lb # [ 293.822848] niks3-server[1256]: 2026/09/20 08:20:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign7047worker2 # [ 293.821186] nix-grpc-daemon[1725]: time=2026-09-20T08:20:16.112Z level=INFO msg="Uploading 1 narinfos"7048lb # [ 293.829131] niks3-server[1256]: 2026/09/20 08:20:16 INFO Signed narinfos id=66 count=17049lb # [ 293.833471] niks3-server[1256]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls7050lb # [ 293.845143] niks3-server[1256]: 2026/09/20 08:20:16 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete7051worker2 # [ 293.844298] nix-grpc-daemon[1725]: time=2026-09-20T08:20:16.135Z level=INFO msg="Upload complete. (399ms)"7052lb # [ 293.852250] niks3-server[1256]: 2026/09/20 08:20:16 INFO Completed upload id=667053worker2 # [ 293.845755] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59838 duration_s=0 paths=1 nar_bytes_in=7527054lb # [ 293.855138] niks3-server[1256]: 2026/09/20 08:20:16 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo7055worker2 # [ 293.852502] nix-daemon[850]: reaped child process 1804, status = succeeded7056worker2 # [ 293.854195] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598387057worker2 # [ 293.858297] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)7058worker2 # [ 293.866141] nix-daemon[850]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)7059client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...7060client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7061client # farm-top> LOG-farm-top-drain7062worker2 # [ 295.493475] nix-daemon[850]: reaped child process 1818, status = succeeded7063worker2 # [ 295.632573] nix-daemon[850]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7064worker2 # [ 295.643319] nix-daemon[850]: reaped child process 1836, status = succeeded7065lb # [ 295.666101] niks3-server[1256]: 2026/09/20 08:20:18 INFO Received uploads request method=POST path=/api/pending_closures7066worker2 # [ 295.662595] nix-grpc-daemon[1725]: time=2026-09-20T08:20:17.953Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7067worker2 # [ 295.664200] nix-grpc-daemon[1725]: time=2026-09-20T08:20:17.955Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"7068lb # [ 295.686747] niks3-server[1256]: 2026/09/20 08:20:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign7069lb # [ 295.690547] niks3-server[1256]: 2026/09/20 08:20:18 INFO Signed narinfos id=67 count=17070worker2 # [ 295.682486] nix-grpc-daemon[1725]: time=2026-09-20T08:20:17.973Z level=INFO msg="Uploading 1 narinfos"7071lb # [ 295.692486] niks3-server[1256]: 2026/09/20 08:20:18 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7072lb # [ 295.694832] niks3-server[1256]: 2026/09/20 08:20:18 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst7073lb # [ 295.697332] niks3-server[1256]: 2026/09/20 08:20:18 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls7074lb # [ 295.701312] niks3-server[1256]: 2026/09/20 08:20:18 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete7075lb # [ 295.704622] niks3-server[1256]: 2026/09/20 08:20:18 INFO Completed upload id=677076worker2 # [ 295.696941] nix-grpc-daemon[1725]: time=2026-09-20T08:20:17.988Z level=INFO msg="Upload complete. (221ms)"7077lb # [ 295.706165] niks3-server[1256]: 2026/09/20 08:20:18 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo7078worker2 # [ 295.699223] nix-grpc-daemon[1669]: ts=2026-09-20T08:20:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59838 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=17079worker2 # [ 295.705828] nix-daemon[850]: reaped child process 1816, status = succeeded7080client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 7.58 seconds)7081client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath7082client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.16 seconds)7083worker1: must succeed: rm /nix/.rw-store/fill7084worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)7085worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7086worker1 # [ 297.057427] nix-grpc-daemon[1541]: ts=2026-09-20T08:20:19Z level=info event=healthy reason=min_free7087worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.09 seconds)7088(finished: subtest: low disk drains a worker and builds go to the other, in 10.00 seconds)7089(finished: run the VM test script, in 298.10 seconds)7090test script finished in 298.30s7091cleanup7092kill QemuMachine (pid 49)7093client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7094kill QemuMachine (pid 50)7095lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7096kill QemuMachine (pid 52)7097worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7098kill QemuMachine (pid 51)7099worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7100(finished: cleanup, in 1.04 seconds)7101additionally exposed symbols:7102 client, lb, worker1, worker2,7103 vlan1,7104 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh